Relationship To Principal Components
The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.
Read more about this topic: Least Squares
Famous quotes containing the words relationship to, relationship, principal and/or components:
“Sometimes in our relationship to another human being the proper balance of friendship is restored when we put a few grains of impropriety onto our own side of the scale.”
—Friedrich Nietzsche (1844–1900)
“It is possible to make friends with our children—but probably not while they are children.... Friendship is a relationship of mutual dependence-interdependence. A family is a relationship in which some of the participants are dependent on others. It is the job of parents to provide for their children. It is not appropriate for adults to enter into parenthood recognizing they have made a decision to accept dependents and then try to pretend that their children are not dependent on them.”
—Donald C. Medeiros (20th century)
“The principal office of history I take to be this: to prevent virtuous actions from being forgotten, and that evil words and deeds should fear an infamous reputation with posterity.”
—Tacitus (c. 55–c. 120)
“Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.”
—Noam Chomsky (b. 1928)