📚 Defining Column Space
The column space of a matrix $A$ is the span of its column vectors. In other words, it's the set of all possible linear combinations of the columns of $A$. It's also known as the image or range of the matrix $A$. The column space is a subspace of $\mathbb{R}^m$, where $A$ is an $m \times n$ matrix.
- ➕Definition: If $A = [a_1, a_2, ..., a_n]$, where $a_i$ are the column vectors of $A$, then the column space, denoted as $C(A)$, is given by $C(A) = \{c_1a_1 + c_2a_2 + ... + c_na_n \mid c_i \in \mathbb{R}\}$.
- 💡Key Principle: The column space of $A$ is the set of all vectors $b$ for which the equation $Ax = b$ has a solution.
- 🌍Real-world Example: In image processing, the column space can represent the possible outputs of a linear transformation applied to an image.
📊 Defining Row Space
The row space of a matrix $A$ is the span of its row vectors. It's the set of all possible linear combinations of the rows of $A$. The row space is a subspace of $\mathbb{R}^n$, where $A$ is an $m \times n$ matrix. It's closely related to the column space of the transpose of $A$, denoted as $C(A^T)$.
- 🔢 Definition: If $A$ has rows $r_1, r_2, ..., r_m$, then the row space, denoted as $R(A)$, is given by $R(A) = \{c_1r_1 + c_2r_2 + ... + c_mr_m \mid c_i \in \mathbb{R}\}$.
- 🧭Key Principle: The row space of $A$ is orthogonal to the null space of $A$. This is a fundamental result in linear algebra.
- ⚙️Real-world Example: In coding theory, row space helps define the set of valid codewords in a linear code.
🧮 Defining Null Space
The null space (or kernel) of a matrix $A$ is the set of all vectors $x$ such that $Ax = 0$. In other words, it's the set of vectors that, when multiplied by $A$, result in the zero vector. The null space is a subspace of $\mathbb{R}^n$, where $A$ is an $m \times n$ matrix.
- 🧠Definition: The null space, denoted as $N(A)$, is given by $N(A) = \{x \in \mathbb{R}^n \mid Ax = 0\}$.
- 🔑Key Principle: The dimension of the null space is called the nullity of $A$. The Rank-Nullity Theorem states that rank(A) + nullity(A) = n.
- 💾Real-world Example: In computer graphics, the null space can represent transformations that leave an object unchanged.
🧪 Defining Left Null Space
The left null space of a matrix $A$ is the set of all vectors $x$ such that $x^TA = 0$, or equivalently, $A^Tx = 0$. It is the null space of the transpose of $A$. The left null space is a subspace of $\mathbb{R}^m$, where $A$ is an $m \times n$ matrix.
- 🧬Definition: The left null space, denoted as $N(A^T)$, is given by $N(A^T) = \{x \in \mathbb{R}^m \mid A^Tx = 0\}$.
- 🔬Key Principle: The left null space of $A$ is orthogonal to the column space of $A$.
- 💡Real-world Example: In electrical networks, the left null space can be used to analyze current flow.