Existence
An eigenvalue λ of a matrix is characterized by the algebraic relation M u = λ u. When M is Hermitian, a variational characterization is also available. Let M be a real n × n symmetric matrix. Define f :Rn → R by f(x) = xT M x. By the extreme value theorem, this continuous function attains a maximum at some u when restricted to the closed unit sphere {||x|| ≤ 1}. By the Lagrange multipliers theorem, u necessarily satisfies
where the nabla symbol, is the del operator.
A short calculation shows the above leads to M u = λ u (symmetry of M is needed here). Therefore λ is the largest eigenvalue of M. The same calculation performed on the orthogonal complement of u gives the next largest eigenvalue and so on. The complex Hermitian case is similar; there f(x) = x* M x is a real-valued function of 2n real variables.
Singular values are similar in that they can be described algebraically or from variational principles. Although, unlike the eigenvalue case, Hermiticity, or symmetry, of M is no longer required.
This section gives these two arguments for existence of singular value decomposition.
Read more about this topic: Singular Value Decomposition
Famous quotes containing the word existence:
“What is a novel if not a conviction of our fellow-men’s existence strong enough to take upon itself a form of imagined life clearer than reality and whose accumulated verisimilitude of selected episodes puts to shame the pride of documentary history?”
—Joseph Conrad (1857–1924)
“Things perceived by the senses are immediately perceived by the senses; and things immediately perceived by the senses are ideas; and ideas cannot exist without the mind, their existence therefore consists in being perceived; when therefore they are actually perceived, there can be no doubt of their existence.”
—George Berkeley (1685–1753)
“The very existence of government at all, infers inequality. The citizen who is preferred to office becomes the superior to those who are not, so long as he is the repository of power, and the child inherits the wealth of the parent as a controlling law of society.”
—James Fenimore Cooper (1789–1851)