Multiple Choice Questions on Neural Network Structure and Function

📚 Quick Study Guide

• 🧠 Neuron: The basic unit of a neural network. Receives inputs, applies a weight and bias, and then an activation function.
• 🧮 Weights: Numerical values that determine the strength of the connection between neurons. Updated during training.
• ➕ Bias: A constant added to the weighted sum of inputs, allowing the neuron to activate even when all inputs are zero.
• 📈 Activation Function: Introduces non-linearity, allowing the network to learn complex patterns (e.g., Sigmoid, ReLU, Tanh).
• 🔗 Layers: Neural networks are organized into layers: Input, Hidden, and Output.
• ⚙️ Forward Propagation: The process of passing inputs through the network to produce an output.
• 🔙 Backpropagation: The process of updating weights based on the error between predicted and actual outputs, using gradient descent.
• 📉 Loss Function: Measures the difference between predicted and actual outputs (e.g., Mean Squared Error). Formula: $MSE = \frac{1}{n} \sum_{i=1}^{n} (Y_i - \hat{Y_i})^2$ where $Y_i$ is the actual value and $\hat{Y_i}$ is the predicted value.
• 💡 Learning Rate: A hyperparameter that controls the size of the weight updates during backpropagation.

🧪 Practice Quiz

1. Which of the following is the fundamental building block of a neural network?
   1. A. Synapse
   2. B. Neuron
   3. C. Dendrite
   4. D. Axon
2. What is the purpose of the activation function in a neuron?
   1. A. To normalize the input data.
   2. B. To introduce non-linearity into the network.
   3. C. To reduce the number of layers.
   4. D. To increase the learning rate.
3. During backpropagation, what is being adjusted to minimize the loss function?
   1. A. Input data
   2. B. Activation functions
   3. C. Weights and biases
   4. D. Number of layers
4. What does the term "learning rate" refer to in the context of neural networks?
   1. A. The speed at which data is processed.
   2. B. The number of neurons in a layer.
   3. C. The size of the weight updates during training.
   4. D. The frequency of activation function updates.
5. Which of the following is a common type of activation function?
   1. A. Linear Regression
   2. B. Principal Component Analysis (PCA)
   3. C. ReLU (Rectified Linear Unit)
   4. D. K-Means Clustering
6. What is the role of the bias in a neuron?
   1. A. To scale the input data.
   2. B. To allow activation even when all inputs are zero.
   3. C. To reduce the variance of the weights.
   4. D. To prevent overfitting.
7. Which layer is responsible for receiving the initial input data in a neural network?
   1. A. Output Layer
   2. B. Hidden Layer
   3. C. Input Layer
   4. D. Convolutional Layer