Relationship To Principal Components
The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.
Read more about this topic: Least Squares
Famous quotes containing the words relationship, principal and/or components:
“The relationship between mother and professional has not been a partnership in which both work together on behalf of the child, in which the expert helps the mother achieve her own goals for her child. Instead, professionals often behave as if they alone are advocates for the child; as if they are the guardians of the child’s needs; as if the mother left to her own devices will surely damage the child and only the professional can rescue him.”
—Elaine Heffner (20th century)
“There are three principal means of acquiring knowledge available to us: observation of nature, reflection, and experimentation. Observation collects facts; reflection combines them; experimentation verifies the result of that combination. Our observation of nature must be diligent, our reflection profound, and our experiments exact. We rarely see these three means combined; and for this reason, creative geniuses are not common.”
—Denis Diderot (1713–1784)
“Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.”
—Noam Chomsky (b. 1928)