Least Squares - Relationship To Principal Components

Relationship To Principal Components

The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.

Read more about this topic:  Least Squares

Famous quotes containing the words relationship to, relationship, principal and/or components:

    Women, because of their colonial relationship to men, have to fight for their own independence. This fight for our own independence will lead to the growth and development of the revolutionary movement in this country. Only the independent woman can be truly effective in the larger revolutionary struggle.
    Women’s Liberation Workshop, Students for a Democratic Society, Radical political/social activist organization. “Liberation of Women,” in New Left Notes (July 10, 1967)

    Our mother gives us our earliest lessons in love—and its partner, hate. Our father—our “second other”Melaborates on them. Offering us an alternative to the mother-baby relationship . . . presenting a masculine model which can supplement and contrast with the feminine. And providing us with further and perhaps quite different meanings of lovable and loving and being loved.
    Judith Viorst (20th century)

    So in accepting the leading of the sentiments, it is not what we believe concerning the immortality of the soul, or the like, but the universal impulse to believe, that is the material circumstance, and is the principal fact in this history of the globe.
    Ralph Waldo Emerson (1803–1882)

    Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.
    Noam Chomsky (b. 1928)