T-test for individual MLR coefficients vs. confidence interval approach.

📚 Quick Study Guide

• 🔢 Multiple Linear Regression (MLR) aims to model the relationship between a dependent variable and multiple independent variables. The equation is typically represented as: $Y = \beta_0 + \beta_1X_1 + \beta_2X_2 + ... + \beta_nX_n + \epsilon$, where $Y$ is the dependent variable, $X_i$ are the independent variables, $\beta_i$ are the coefficients, and $\epsilon$ is the error term.
• 🧪 The T-test for individual MLR coefficients assesses whether a specific coefficient is statistically different from zero. The null hypothesis is $H_0: \beta_i = 0$, and the alternative hypothesis is $H_1: \beta_i \neq 0$. The test statistic is calculated as $t = \frac{\hat{\beta}_i}{SE(\hat{\beta}_i)}$, where $\hat{\beta}_i$ is the estimated coefficient and $SE(\hat{\beta}_i)$ is its standard error.
• 📊 Confidence intervals provide a range within which the true value of the coefficient is likely to fall. A (1 - α)% confidence interval for $\beta_i$ is given by $\hat{\beta}_i \pm t_{\alpha/2, n-p} \cdot SE(\hat{\beta}_i)$, where $t_{\alpha/2, n-p}$ is the critical value from the t-distribution with $n-p$ degrees of freedom ($n$ = number of observations, $p$ = number of parameters).
• 💡 If the p-value from the T-test is less than the significance level (α), or if the confidence interval does not contain zero, we reject the null hypothesis and conclude that the coefficient is statistically significant.
• 📝 Both methods (T-test and Confidence Intervals) essentially provide the same information but in different formats. The T-test gives a specific p-value, while the confidence interval gives a range of plausible values.

Practice Quiz

1. Which of the following is the null hypothesis for a T-test of an individual coefficient in Multiple Linear Regression?

   1. $\beta_i > 0$
   2. $\beta_i \neq 0$
   3. $\beta_i = 0$
   4. $\beta_i < 0$

2. What does the standard error of a coefficient ($\hat{\beta}_i$) represent?

   1. The bias of the coefficient estimate.
   2. The standard deviation of the coefficient estimate.
   3. The mean of the coefficient estimate.
   4. The range of the coefficient estimate.

3. A 95% confidence interval for a coefficient is [0.1, 0.9]. What can you conclude about the significance of this coefficient at α = 0.05?

   1. The coefficient is not statistically significant.
   2. The coefficient is statistically significant.
   3. More information is needed to determine significance.
   4. The confidence interval is invalid.

4. In the formula for the T-test statistic, $t = \frac{\hat{\beta}_i}{SE(\hat{\beta}_i)}$, what does the denominator represent?

   1. The estimated coefficient.
   2. The p-value of the coefficient.
   3. The standard error of the coefficient.
   4. The t-distribution value.

5. If the p-value from a T-test is 0.03 and α = 0.05, what is your conclusion?

   1. Fail to reject the null hypothesis.
   2. Reject the null hypothesis.
   3. The test is inconclusive.
   4. Increase α.

6. What is the effect of increasing the sample size on the width of a confidence interval (assuming other factors remain constant)?

   1. The width increases.
   2. The width decreases.
   3. The width remains the same.
   4. The width becomes unpredictable.

7. What degrees of freedom are used for the t-distribution when constructing a confidence interval for a coefficient in MLR with $n$ observations and $p$ parameters?

   1. $n$
   2. $p$
   3. $n + p$
   4. $n - p$