Real-world examples: Applying R-squared for model evaluation in statistical research.

📚 Quick Study Guide

• 📈 Definition: R-squared (Coefficient of Determination) measures the proportion of variance in the dependent variable that can be predicted from the independent variable(s).
• 🧮 Formula: $R^2 = 1 - \frac{SS_{res}}{SS_{tot}}$, where $SS_{res}$ is the sum of squares of residuals and $SS_{tot}$ is the total sum of squares.
• 🎯 Range: R-squared ranges from 0 to 1. Higher values indicate a better fit.
• ⚠️ Limitations: R-squared doesn't indicate if a model is adequate. It can be artificially inflated by adding more variables.
• 💡 Interpretation: An R-squared of 0.75 means that 75% of the variance in the dependent variable is explained by the independent variable(s).

Practice Quiz

1. Which of the following best describes what R-squared measures?

   • A) The standard deviation of the residuals.
   • B) The proportion of variance in the dependent variable explained by the independent variable(s).
   • C) The correlation between independent variables.
   • D) The p-value of the model.

2. In a linear regression model, if R-squared is 0, what does this indicate?

   • A) The model perfectly predicts the dependent variable.
   • B) The model explains none of the variability in the dependent variable.
   • C) There is a perfect negative correlation.
   • D) The model is overfit.

3. What does a high R-squared value suggest about a regression model?

   • A) The model is definitely a good fit for the data.
   • B) The model explains a large proportion of the variance in the dependent variable.
   • C) The model is free from multicollinearity.
   • D) The model's residuals are normally distributed.

4. Which of the following is a limitation of using R-squared to evaluate a model?

   • A) R-squared cannot be used for non-linear models.
   • B) R-squared always decreases as more variables are added.
   • C) R-squared can be artificially inflated by adding irrelevant variables.
   • D) R-squared is difficult to calculate.

5. In the context of evaluating a research study about housing prices, an R-squared of 0.65 indicates:

   • A) The model explains 65% of the variability in housing prices.
   • B) The model is 65% accurate in predicting housing prices.
   • C) 65% of the independent variables are significant.
   • D) The model is 35% accurate in predicting housing prices.

6. If the total sum of squares (SST) is 100 and the sum of squared errors (SSE) is 25, what is the R-squared value?

   • A) 0.25
   • B) 0.50
   • C) 0.75
   • D) 1.00

7. Why is it important to consider adjusted R-squared instead of R-squared when comparing models with different numbers of predictors?

   • A) Adjusted R-squared always gives a higher value.
   • B) Adjusted R-squared penalizes the inclusion of irrelevant predictors.
   • C) R-squared is not applicable for models with multiple predictors.
   • D) Adjusted R-squared is easier to calculate.