Get Linear Subspace essential facts below. View Videos or join the Linear Subspace discussion. Add Linear Subspace to your PopFlock.com topic list for future reference or share this resource on social media.
Linear Subspace
One-dimensional subspaces in the two-dimensional vector space over the finite fieldF_{5}. The origin (0, 0), marked with green circles, belongs to any of six 1-subspaces, while each of 24 remaining points belongs to exactly one; a property which holds for 1-subspaces over any field and in all dimensions. All F_{5}^{2} (i.e. a 5 × 5 square) is pictured four times for a better visualization
In mathematics, and more specifically in linear algebra, a linear subspace, also known as a vector subspace^{[1]}^{[note 1]} is a vector space that is a subset of some larger vector space. A linear subspace is usually simply called a subspace when the context serves to distinguish it from other types of subspaces.
Definition
If V is a vector space over a fieldK and if W is a subset of V, then W is a subspace of V if under the operations of V, W is a vector space over K. Equivalently, a nonempty subset W is a subspace of V if, whenever w_{1}, w_{2} are elements of W and ?, ? are elements of K, it follows that ?w_{1} + ?w_{2} is in W.^{[2]}^{[3]}^{[4]}^{[5]}^{[6]}
As a corollary, all vector spaces are equipped with at least two subspaces: the singleton set with the zero vector and the vector space itself. These are called the trivial subspaces of the vector space.^{[7]}
Examples
Example I
Let the field K be the setR of real numbers, and let the vector space V be the real coordinate spaceR^{3}.
Take W to be the set of all vectors in V whose last component is 0.
Then W is a subspace of V.
Proof:
Given u and v in W, then they can be expressed as and . Then . Thus, u + v is an element of W, too.
Given u in W and a scalar c in R, if again, then . Thus, cu is an element of W too.
Example II
Let the field be R again, but now let the vector space V be the Cartesian planeR^{2}.
Take W to be the set of points (x, y) of R^{2} such that x = y.
Then W is a subspace of R^{2}.
Example II Illustrated
Proof:
Let and be elements of W, that is, points in the plane such that p_{1} = p_{2} and q_{1} = q_{2}. Then ; since p_{1} = p_{2} and q_{1} = q_{2}, then p_{1} + q_{1} = p_{2} + q_{2}, so p + q is an element of W.
Let p = (p_{1}, p_{2}) be an element of W, that is, a point in the plane such that p_{1} = p_{2}, and let c be a scalar in R. Then ; since p_{1} = p_{2}, then cp_{1} = cp_{2}, so cp is an element of W.
In general, any subset of the real coordinate space R^{n} that is defined by a system of homogeneous linear equations will yield a subspace.
(The equation in example I was z = 0, and the equation in example II was x = y.)
Geometrically, these subspaces are points, lines, planes and spaces that pass through the point 0.
Example III
Again take the field to be R, but now let the vector space V be the set R^{R} of all functions from R to R.
Let C(R) be the subset consisting of continuous functions.
Then C(R) is a subspace of R^{R}.
Proof:
We know from calculus that .
We know from calculus that the sum of continuous functions is continuous.
Again, we know from calculus that the product of a continuous function and a number is continuous.
Example IV
Keep the same field and vector space as before, but now consider the set Diff(R) of all differentiable functions.
The same sort of argument as before shows that this is a subspace too.
From the definition of vector spaces, it follows that subspaces are nonempty, and are closed under sums and under scalar multiples.^{[8]} Equivalently, subspaces can be characterized by the property of being closed under linear combinations. That is, a nonempty set W is a subspace if and only if every linear combination of finitely many elements of W also belongs to W.
The equivalent definition states that it is also equivalent to consider linear combinations of two elements at a time.
Descriptions of subspaces include the solution set to a homogeneous system of linear equations, the subset of Euclidean space described by a system of homogeneous linear parametric equations, the span of a collection of vectors, and the null space, column space, and row space of a matrix. Geometrically (especially over the field of real numbers and its subfields), a subspace is a flat in an n-space that passes through the origin.
A natural description of a 1-subspace is the scalar multiplication of one non-zero vector v to all possible scalar values. 1-subspaces specified by two vectors are equal if and only if one vector can be obtained from another with scalar multiplication:
This idea is generalized for higher dimensions with linear span, but criteria for equality of k-spaces specified by sets of k vectors are not so simple.
A dual description is provided with linear functionals (usually implemented as linear equations). One non-zero linear functional F specifies its kernel subspace F = 0 of codimension 1. Subspaces of codimension 1 specified by two linear functionals are equal, if and only if one functional can be obtained from another with scalar multiplication (in the dual space):
It is generalized for higher codimensions with a system of equations. The following two subsections will present this latter description in details, and the remaining four subsections further describe the idea of linear span.
For example, the set of all vectors (x, y, z) (over real or rational numbers) satisfying the equations
$x+3y+2z=0\;\;\;\;{\text{and}}\;\;\;\;2x-4y+5z=0$
is a one-dimensional subspace. More generally, that is to say that given a set of n independent functions, the dimension of the subspace in K^{k} will be the dimension of the null set of A, the composite matrix of the n functions.
Null space of a matrix
In a finite-dimensional space, a homogeneous system of linear equations can be written as a single matrix equation:
$A\mathbf {x} =\mathbf {0} .$
The set of solutions to this equation is known as the null space of the matrix. For example, the subspace described above is the null space of the matrix
$A={\begin{bmatrix}1&3&2\\2&-4&5\end{bmatrix}}.$
Every subspace of K^{n} can be described as the null space of some matrix (see § Algorithms below for more).
Linear parametric equations
The subset of K^{n} described by a system of homogeneous linear parametric equations is a subspace:
$\left\{\left[\!\!{\begin{array}{c}x_{1}\\x_{2}\\\vdots \\x_{n}\end{array}}\!\!\right]\in K^{n}:{\begin{alignedat}{7}x_{1}&&\;=\;&&a_{11}t_{1}&&\;+\;&&a_{12}t_{2}&&\;+\cdots +\;&&a_{1m}t_{m}&\\x_{2}&&\;=\;&&a_{21}t_{1}&&\;+\;&&a_{22}t_{2}&&\;+\cdots +\;&&a_{2m}t_{m}&\\&&\vdots \;\;&&&&&&&&&&&\\x_{n}&&\;=\;&&a_{n1}t_{1}&&\;+\;&&a_{n2}t_{2}&&\;+\cdots +\;&&a_{nm}t_{m}&\\\end{alignedat}}{\text{ for some }}t_{1},\ldots ,t_{m}\in K\right\}.$
For example, the set of all vectors (x, y, z) parameterized by the equations
The expression on the right is called a linear combination of the vectors
(2, 5, -1) and (3, -4, 2). These two vectors are said to span the resulting subspace.
In general, a linear combination of vectors v_{1}, v_{2}, ... , v_{k} is any vector of the form
If the vectors v_{1}, ... , v_{k} have n components, then their span is a subspace of K^{n}. Geometrically, the span is the flat through the origin in n-dimensional space determined by the points v_{1}, ... , v_{k}.
Example
The xz-plane in R^{3} can be parameterized by the equations
$x=t_{1},\;\;\;y=0,\;\;\;z=t_{2}.$
As a subspace, the xz-plane is spanned by the vectors (1, 0, 0) and (0, 0, 1). Every vector in the xz-plane can be written as a linear combination of these two:
Geometrically, this corresponds to the fact that every point on the xz-plane can be reached from the origin by first moving some distance in the direction of (1, 0, 0) and then moving some distance in the direction of (0, 0, 1).
Column space and row space
A system of linear parametric equations in a finite-dimensional space can also be written as a single matrix equation:
In this case, the subspace consists of all possible values of the vector x. In linear algebra, this subspace is known as the column space (or image) of the matrix A. It is precisely the subspace of K^{n} spanned by the column vectors of A.
The row space of a matrix is the subspace spanned by its row vectors. The row space is interesting because it is the orthogonal complement of the null space (see below).
Independence, basis, and dimension
The vectors u and v are a basis for this two-dimensional subspace of R^{3}.
In general, a subspace of K^{n} determined by k parameters (or spanned by k vectors) has dimension k. However, there are exceptions to this rule. For example, the subspace of K^{3} spanned by the three vectors (1, 0, 0), (0, 0, 1), and (2, 0, 3) is just the xz-plane, with each point on the plane described by infinitely many different values of .
In general, vectors v_{1}, ... , v_{k} are called linearly independent if
for
(t_{1}, t_{2}, ... , t_{k}) ? (u_{1}, u_{2}, ... , u_{k}).^{[note 3]}
If are linearly independent, then the coordinates for a vector in the span are uniquely determined.
A basis for a subspace S is a set of linearly independent vectors whose span is S. The number of elements in a basis is always equal to the geometric dimension of the subspace. Any spanning set for a subspace can be changed into a basis by removing redundant vectors (see § Algorithms below for more).
Example
Let S be the subspace of R^{4} defined by the equations
Then the vectors (2, 1, 0, 0) and (0, 0, 5, 1) are a basis for S. In particular, every vector that satisfies the above equations can be written uniquely as a linear combination of the two basis vectors:
A subspace cannot lie in any subspace of lesser dimension. If dim U = k, a finite number, and U ? W, then dim W = k if and only if U = W.
Intersection
In R^{3}, the intersection of two distinct two-dimensional subspaces is one-dimensional
Given subspaces U and W of a vector space V, then their intersectionU ? W := {v ? V : v is an element of both U and W} is also a subspace of V.^{[10]}
Proof:
Let v and w be elements of U ? W. Then v and w belong to both U and W. Because U is a subspace, then v + w belongs to U. Similarly, since W is a subspace, then v + w belongs to W. Thus, v + w belongs to U ? W.
Let v belong to U ? W, and let c be a scalar. Then v belongs to both U and W. Since U and W are subspaces, cv belongs to both U and W.
Since U and W are vector spaces, then 0 belongs to both sets. Thus, 0 belongs to U ? W.
For every vector space V, the set {0} and V itself are subspaces of V.^{[11]}^{[12]}
Sum
If U and W are subspaces, their sum is the subspace
Here, the minimum only occurs if one subspace is contained in the other, while the maximum is the most general case. The dimension of the intersection and the sum are related by the following equation:
$\dim(U+W)=\dim(U)+\dim(W)-\dim(U\cap W).$^{[15]}
A set of subspaces is independent when the only intersection between any pair of subspaces is the trivial subspace. The direct sum is the sum of independent subspaces, written as $U\oplus W$. An equivalent restatement is that a direct sum is a subspace sum under the condition that every subspace contributes to the span of the sum.^{[16]}^{[17]}^{[18]}^{[19]}
The dimension of a direct sum $U\oplus W$ is the same as the sum of subspaces, but may be shortened because the dimension of the trivial subspace is zero.^{[20]}
$\dim(U\oplus W)=\dim(U)+\dim(W)$
Lattice of subspaces
The operations intersection and sum make the set of all subspaces a bounded modular lattice, where the {0} subspace, the least element, is an identity element of the sum operation, and the identical subspace V, the greatest element, is an identity element of the intersection operation.
Orthogonal complements
If $V$ is an inner product space and $N$ is a subset of $V$, then the orthogonal complement of $N$, denoted $N^{\perp }$, is again a subspace.^{[21]} If $V$ is finite-dimensional and $N$ is a subspace, then the dimensions of $N$ and $N^{\perp }$ satisfy the complementary relationship $\dim(N)+\dim(N^{\perp })=\dim(V)$.^{[22]} Moreover, no vector is orthogonal to itself, so $N\cap N^{\perp }=\{0\}$ and $V$ is the direct sum of $N$ and $N^{\perp }$.^{[23]} Applying orthogonal complements twice returns the original subspace: $(N^{\perp })^{\perp }=N$ for every subspace $N$.^{[24]}
This operation, understood as negation ($\neg$), makes the lattice of subspaces a (possibly infinite) orthocomplemented lattice (although not a distributive lattice).^{[]}
In spaces with other bilinear forms, some but not all of these results still hold. In pseudo-Euclidean spaces and symplectic vector spaces, for example, orthogonal complements exist. However, these spaces may have null vectors that are orthogonal to themselves, and consequently there exist subspaces $N$ such that $N\cap N^{\perp }\neq \{0\}$. As a result, this operation does not turn the lattice of subspaces into a Boolean algebra (nor a Heyting algebra).^{[]}
If we instead put the matrix A into reduced row echelon form, then the resulting basis for the row space is uniquely determined. This provides an algorithm for checking whether two row spaces are equal and, by extension, whether two subspaces of K^{n} are equal.
Subspace membership
Input A basis {b_{1}, b_{2}, ..., b_{k}} for a subspace S of K^{n}, and a vector v with n components.
Output Determines whether v is an element of S
Create a (k + 1) × n matrix A whose rows are the vectors b_{1}, ... , b_{k} and v.
Use elementary row operations to put A into row echelon form.
If the echelon form has a row of zeroes, then the vectors are linearly dependent, and therefore .
Basis for a column space
Input An m × n matrix A
Output A basis for the column space of A
Use elementary row operations to put A into row echelon form.
Determine which columns of the echelon form have pivots. The corresponding columns of the original matrix are a basis for the column space.
This produces a basis for the column space that is a subset of the original column vectors. It works because the columns with pivots are a basis for the column space of the echelon form, and row reduction does not change the linear dependence relationships between the columns.
Coordinates for a vector
Input A basis {b_{1}, b_{2}, ..., b_{k}} for a subspace S of K^{n}, and a vector
Output Numbers t_{1}, t_{2}, ..., t_{k} such that
Create an augmented matrixA whose columns are b_{1},...,b_{k} , with the last column being v.
Use elementary row operations to put A into reduced row echelon form.
Express the final column of the reduced echelon form as a linear combination of the first k columns. The coefficients used are the desired numbers . (These should be precisely the first k entries in the final column of the reduced echelon form.)
If the final column of the reduced row echelon form contains a pivot, then the input vector v does not lie in S.
Basis for a null space
Input An m × n matrix A.
Output A basis for the null space of A
Use elementary row operations to put A in reduced row echelon form.
Using the reduced row echelon form, determine which of the variables are free. Write equations for the dependent variables in terms of the free variables.
For each free variable x_{i}, choose a vector in the null space for which and the remaining free variables are zero. The resulting collection of vectors is a basis for the null space of A.
Basis for the sum and intersection of two subspaces
Given two subspaces U and W of V, a basis of the sum $U+W$ and the intersection $U\cap W$ can be calculated using the Zassenhaus algorithm
Equations for a subspace
Input A basis {b_{1}, b_{2}, ..., b_{k}} for a subspace S of K^{n}
Output An (n - k) × n matrix whose null space is S.
Create a matrix A whose rows are .
Use elementary row operations to put A into reduced row echelon form.
Let be the columns of the reduced row echelon form. For each column without a pivot, write an equation expressing the column as a linear combination of the columns with pivots.
This results in a homogeneous system of n - k linear equations involving the variables c_{1},...,c_{n}. The matrix corresponding to this system is the desired matrix with nullspace S.
^The term linear subspace is sometimes used for referring to flats and affine subspaces. In the case of vector spaces over the reals, linear subspaces, flats, and affine subspaces are also called linear manifolds for emphasizing that there are also manifolds.
^Generally, K can be any field of such characteristic that the given integer matrix has the appropriate rank in it. All fields include integers, but some integers may equal to zero in some fields.
^This definition is often stated differently: vectors v_{1}, ..., v_{k} are linearly independent if
for . The two definitions are equivalent.