Singular Values, Singular Vectors, and Their Relation To The SVD
A non-negative real number σ is a singular value for M if and only if there exist unit-length vectors u in Km and v in Kn such that
The vectors u and v are called left-singular and right-singular vectors for σ, respectively.
In any singular value decomposition
the diagonal entries of Σ are equal to the singular values of M. The columns of U and V are, respectively, left- and right-singular vectors for the corresponding singular values. Consequently, the above theorem implies that:
- An m × n matrix M has at least one and at most p = min(m,n) distinct singular values.
- It is always possible to find an orthogonal basis U for Km consisting of left-singular vectors of M.
- It is always possible to find an orthogonal basis V for Kn consisting of right-singular vectors of M.
A singular value for which we can find two left (or right) singular vectors that are linearly independent is called degenerate.
Non-degenerate singular values always have unique left- and right-singular vectors, up to multiplication by a unit-phase factor eiφ (for the real case up to sign). Consequently, if all singular values of M are non-degenerate and non-zero, then its singular value decomposition is unique, up to multiplication of a column of U by a unit-phase factor and simultaneous multiplication of the corresponding column of V by the same unit-phase factor.
Degenerate singular values, by definition, have non-unique singular vectors. Furthermore, if u1 and u2 are two left-singular vectors which both correspond to the singular value σ, then any normalized linear combination of the two vectors is also a left-singular vector corresponding to the singular value σ. The similar statement is true for right-singular vectors. Consequently, if M has degenerate singular values, then its singular value decomposition is not unique.
Read more about this topic: Singular Value Decomposition
Famous quotes containing the words singular and/or relation:
“Not from this anger, anticlimax after
Refusal struck her loin and the lame flower
Bent like a beast to lap the singular floods....”
—Dylan Thomas (1914–1953)
“In relation to God, we are like a thief who has burgled the house of a kindly householder and been allowed to keep some of the gold. From the point of view of the lawful owner this gold is a gift; From the point of view of the burglar it is a theft. He must go and give it back. It is the same with our existence. We have stolen a little of God’s being to make it ours. God has made us a gift of it. But we have stolen it. We must return it.”
—Simone Weil (1909–1943)