Relationship To Principal Components
The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.
Read more about this topic: Least Squares
Famous quotes containing the words relationship to, relationship, principal and/or components:
“... the Wall became a magnet for citizens of every generation, class, race, and relationship to the war perhaps because it is the only great public monument that allows the anesthetized holes in the heart to fill with a truly national grief.”
—Adrienne Rich (b. 1929)
“Every relationship that does not raise us up pulls us down, and vice versa; this is why men usually sink down somewhat when they take wives while women are usually somewhat raised up. Overly spiritual men require marriage every bit as much as they resist it as bitter medicine.”
—Friedrich Nietzsche (18441900)
“Heaven has a Sea of Glass on which angels go sliding every afternoon. There are many golden streets, but the principal thoroughfares are Amen Street and Hallelujah Avenue, which intersect in front of the Throne. These streets play tunes when walked on, and all shoes have songs in them.”
—For the State of Florida, U.S. public relief program (1935-1943)
“Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.”
—Noam Chomsky (b. 1928)