Existence
An eigenvalue λ of a matrix is characterized by the algebraic relation M u = λ u. When M is Hermitian, a variational characterization is also available. Let M be a real n × n symmetric matrix. Define f :Rn → R by f(x) = xT M x. By the extreme value theorem, this continuous function attains a maximum at some u when restricted to the closed unit sphere {||x|| ≤ 1}. By the Lagrange multipliers theorem, u necessarily satisfies
where the nabla symbol, is the del operator.
A short calculation shows the above leads to M u = λ u (symmetry of M is needed here). Therefore λ is the largest eigenvalue of M. The same calculation performed on the orthogonal complement of u gives the next largest eigenvalue and so on. The complex Hermitian case is similar; there f(x) = x* M x is a real-valued function of 2n real variables.
Singular values are similar in that they can be described algebraically or from variational principles. Although, unlike the eigenvalue case, Hermiticity, or symmetry, of M is no longer required.
This section gives these two arguments for existence of singular value decomposition.
Read more about this topic: Singular Value Decomposition
Famous quotes containing the word existence:
“An “unemployed” existence is a worse negation of life than death itself.”
—José Ortega Y Gasset (1883–1955)
“There surely is a being who presides over the universe; and who, with infinite wisdom and power, has reduced the jarring elements into just order and proportion. Let speculative reasoners dispute, how far this beneficent being extends his care, and whether he prolongs our existence beyond the grave, in order to bestow on virtue its just reward, and render it fully triumphant.”
—David Hume (1711–1776)
“A more simple and natural man it would be hard to find. Vice and disease, which cast such a sombre moral hue over the world, seemed to have hardly any existence for him.”
—Henry David Thoreau (1817–1862)