Sampling distribution of regression coefficients quiz for university statistics students.

📚 Quick Study Guide

• 📏 Regression Coefficient: Represents the change in the dependent variable for a one-unit change in the independent variable.
• 📊 Sampling Distribution: The distribution of a statistic (like a regression coefficient) computed from different samples of the same size taken from the same population.
• 🤔 Standard Error: An estimate of the standard deviation of the sampling distribution of a statistic. A smaller standard error indicates a more precise estimate.
• ✅ Assumptions for Valid Inference:
  • ➕ Linearity: The relationship between the independent and dependent variables is linear.
  • 🏡 Homoscedasticity: The variance of the errors is constant across all levels of the independent variable.
  • ♾️ Independence: The errors are independent of each other.
  • 🍎 Normality: The errors are normally distributed.
• 🧪 Central Limit Theorem (CLT): States that the sampling distribution of the sample mean approaches a normal distribution as the sample size increases, regardless of the shape of the population distribution. This is relevant when dealing with regression coefficients from larger samples.
• 🧮 t-statistic: Used to test hypotheses about individual regression coefficients. Calculated as $t = \frac{\hat{\beta} - \beta_0}{SE(\hat{\beta})}$ where $\hat{\beta}$ is the estimated coefficient, $\beta_0$ is the hypothesized value, and $SE(\hat{\beta})$ is the standard error of the coefficient.
• 🔑 Confidence Interval: Provides a range of plausible values for the true regression coefficient. Calculated as $\hat{\beta} \pm t_{\alpha/2, n-p} * SE(\hat{\beta})$ where $t_{\alpha/2, n-p}$ is the critical t-value with $n-p$ degrees of freedom ($n$ = sample size, $p$ = number of parameters in the model).

Practice Quiz

1. Which of the following best describes the sampling distribution of a regression coefficient?
   1. A) The distribution of the independent variable.
   2. B) The distribution of the dependent variable.
   3. C) The distribution of the regression coefficient computed from many different samples.
   4. D) The distribution of the residuals.
2. What does the standard error of a regression coefficient estimate?
   1. A) The bias of the coefficient.
   2. B) The standard deviation of the sample data.
   3. C) The standard deviation of the sampling distribution of the coefficient.
   4. D) The range of the coefficient.
3. Which assumption is NOT required for valid inference about regression coefficients?
   1. A) Linearity.
   2. B) Homoscedasticity.
   3. C) Independence of errors.
   4. D) Multicollinearity.
4. What theorem supports the approximate normality of the sampling distribution of regression coefficients when the sample size is large?
   1. A) Bayes' Theorem.
   2. B) The Law of Large Numbers.
   3. C) The Central Limit Theorem.
   4. D) The Pythagorean Theorem.
5. A t-statistic for a regression coefficient tests which of the following hypotheses?
   1. A) The coefficient is positive.
   2. B) The coefficient is negative.
   3. C) The coefficient is equal to zero.
   4. D) The coefficient is statistically significant.
6. What information is needed to calculate a confidence interval for a regression coefficient?
   1. A) The estimated coefficient and the p-value.
   2. B) The estimated coefficient and the sample mean.
   3. C) The estimated coefficient and its standard error.
   4. D) The estimated coefficient and the R-squared value.
7. If the standard error of a regression coefficient increases, what happens to the width of the confidence interval for that coefficient?
   1. A) It becomes narrower.
   2. B) It stays the same.
   3. C) It becomes wider.
   4. D) It becomes zero.