Supervised Learning Quiz: Test Your Knowledge of Classification and Regression

📚 Quick Study Guide

• 🧠 Supervised Learning Overview: It's a type of machine learning where models learn from a dataset that includes both inputs and desired outputs (labeled data). The goal is to predict an output based on given input features. It primarily consists of two main categories: Classification and Regression.
• 🎯 Classification: This task involves predicting a discrete, categorical label or class. Think of it as answering a "yes/no" or "which category?" type of question.
• 📧 Common Applications: Spam detection, image recognition (e.g., cat vs. dog), medical diagnosis, sentiment analysis.
• 🌳 Key Algorithms: Decision Trees, Logistic Regression, Support Vector Machines (SVM), Random Forests, K-Nearest Neighbors (KNN).
• ✔️ Evaluation Metrics:
  • 📊 Accuracy: The proportion of correctly predicted instances out of the total instances.
  • 🔍 Precision: The proportion of true positive predictions among all positive predictions ($Precision = \frac{TP}{TP + FP}$).
  • 📈 Recall (Sensitivity): The proportion of true positive predictions among all actual positive instances ($Recall = \frac{TP}{TP + FN}$).
  • ⚖️ F1-Score: The harmonic mean of Precision and Recall, useful for imbalanced datasets ($F1 = 2 \times \frac{Precision \times Recall}{Precision + Recall}$).
• 📉 Regression: This task involves predicting a continuous, numerical value. It's about answering "how much?" or "how many?".
• 🏠 Common Applications: House price prediction, stock market forecasting, predicting temperature, estimating age.
• 📏 Key Algorithms: Linear Regression, Polynomial Regression, Decision Trees, Random Forests, Support Vector Regression (SVR).
• 🔢 Evaluation Metrics:
  • 📐 Mean Absolute Error (MAE): The average of the absolute differences between predictions and actual values: $MAE = \frac{1}{N} \sum_{i=1}^{N} |y_i - \hat{y}_i|$.
  • 🔥 Mean Squared Error (MSE): The average of the squared differences between predictions and actual values, penalizing larger errors more: $MSE = \frac{1}{N} \sum_{i=1}^{N} (y_i - \hat{y}_i)^2$.
  • 💡 Root Mean Squared Error (RMSE): The square root of MSE, providing error in the same units as the target variable: $RMSE = \sqrt{MSE}$.
  • ⭐ R-squared ($R^2$): Represents the proportion of the variance in the dependent variable that is predictable from the independent variable(s).
• 🔄 Important Concepts:
  • 🧪 Training Data: The subset of data used to train the machine learning model.
  • 📊 Test Data: The subset of data used to evaluate the performance of the trained model on unseen data.
  • ⚖️ Bias-Variance Trade-off: A fundamental concept illustrating the balance between underfitting (high bias, simple model) and overfitting (high variance, complex model).
  • 🛠️ Cross-Validation: A technique to assess how the results of a statistical analysis will generalize to an independent dataset, helping to prevent overfitting.

📝 Practice Quiz

1. What is the defining characteristic of supervised learning?
   A) It works with unlabeled data.
   B) It requires a human supervisor to label data during training.
   C) It learns from input-output pairs (labeled data).
   D) It discovers hidden patterns without prior knowledge.
2. Which of the following is a typical application of a classification algorithm?
   A) Predicting the future stock price of a company.
   B) Estimating the height of a person based on their age.
   C) Identifying whether an email is spam or not spam.
   D) Forecasting daily temperature variations.
3. Which evaluation metric is commonly used for regression tasks?
   A) Accuracy
   B) Precision
   C) Mean Squared Error (MSE)
   D) F1-Score
4. In the context of supervised learning, what does 'overfitting' primarily refer to?
   A) A model that performs poorly on both training and test data.
   B) A model that is too simple to capture the underlying patterns in the data.
   C) A model that learns the training data too well, including noise, and performs poorly on unseen data.
   D) A model that cannot be trained due to insufficient data.
5. A machine learning model that predicts whether a customer will click on an advertisement (Yes/No) is an example of what type of supervised learning?
   A) Regression
   B) Clustering
   C) Classification
   D) Dimensionality Reduction
6. Which of these algorithms is primarily used for regression tasks?
   A) Logistic Regression
   B) K-Nearest Neighbors (KNN)
   C) Support Vector Machine (SVM)
   D) Linear Regression
7. What is the formula for Mean Squared Error (MSE)?
   A) $MAE = \frac{1}{N} \sum_{i=1}^{N} |y_i - \hat{y}_i|$
   B) $MSE = \frac{1}{N} \sum_{i=1}^{N} (y_i - \hat{y}_i)^2$
   C) $RMSE = \sqrt{\frac{1}{N} \sum_{i=1}^{N} (y_i - \hat{y}_i)^2}$
   D) $R^2 = 1 - \frac{\sum_{i=1}^{N} (y_i - \hat{y}_i)^2}{\sum_{i=1}^{N} (y_i - \bar{y})^2}$