Real-World Examples of Interpreting Hypothesis Test Results

📚 Quick Study Guide

🧪 Null Hypothesis ($H_0$): A statement of no effect or no difference. It's what we try to disprove. 📊 Alternative Hypothesis ($H_1$ or $H_a$): A statement that contradicts the null hypothesis; it's what we're trying to prove. 📈 P-value: The probability of observing a test statistic as extreme as, or more extreme than, the one computed, assuming the null hypothesis is true. A small p-value (typically ≤ 0.05) suggests strong evidence against the null hypothesis. ⚙️ Significance Level ($\alpha$): A pre-determined threshold for rejecting the null hypothesis (commonly 0.05). If the p-value is less than or equal to $\alpha$, we reject $H_0$. 🧭 Type I Error (False Positive): Rejecting the null hypothesis when it is actually true. 🧭 Type II Error (False Negative): Failing to reject the null hypothesis when it is actually false.

Practice Quiz

1. What does a p-value of 0.03 indicate when the significance level is 0.05?
   1. Reject the null hypothesis.
   2. Fail to reject the null hypothesis.
   3. The null hypothesis is true.
   4. The alternative hypothesis is false.
2. In medical research, a new drug is tested against a placebo. The null hypothesis is that there is no difference in effectiveness. If the p-value is 0.10, what conclusion can be drawn?
   1. The drug is significantly more effective than the placebo.
   2. The drug is significantly less effective than the placebo.
   3. There is not enough evidence to conclude the drug is different from the placebo.
   4. The drug is completely ineffective.
3. An online retailer wants to test if a new website design increases sales. They conduct an A/B test. The null hypothesis is that the new design has no effect on sales. If they reject the null hypothesis, what type of error could they be making?
   1. Type I error
   2. Type II error
   3. Standard error
   4. No error
4. A factory claims that the average weight of their product is 500g. A consumer group suspects it's less. They perform a hypothesis test. What is the appropriate null hypothesis?
   1. $H_0: \mu < 500$
   2. $H_0: \mu > 500$
   3. $H_0: \mu = 500$
   4. $H_0: \mu \neq 500$
5. A political pollster wants to determine if a candidate has more than 50% support. They set up a hypothesis test. What would be a Type II error in this context?
   1. Concluding the candidate has more than 50% support when they actually do.
   2. Concluding the candidate has less than or equal to 50% support when they actually have more than 50%.
   3. Concluding the candidate has more than 50% support when they actually have less than or equal to 50%.
   4. There is no possibility of error.
6. A quality control manager tests if the defect rate of a production line is below 5%. If the p-value is 0.01, what is the correct interpretation?
   1. There is strong evidence that the defect rate is above 5%.
   2. There is strong evidence that the defect rate is below 5%.
   3. There is not enough evidence to determine the defect rate.
   4. The defect rate is exactly 5%.
7. A researcher is studying the effect of a new fertilizer on crop yield. They find a statistically significant increase in yield (p < 0.05). What does this suggest?
   1. The fertilizer has no effect on crop yield.
   2. The fertilizer likely increases crop yield.
   3. The fertilizer likely decreases crop yield.
   4. More research is needed to draw any conclusions.