Relationship To Principal Components
The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.
Read more about this topic: Least Squares
Famous quotes containing the words relationship to, relationship, principal and/or components:
“Film music should have the same relationship to the film drama that somebody’s piano playing in my living room has to the book I am reading.”
—Igor Stravinsky (1882–1971)
“Only men of moral and mental force, of a patriotic regard for the relationship of the two races, can be of real service as ministers in the South. Less theology and more of human brotherhood, less declamation and more common sense and love for truth, must be the qualifications of the new ministry that shall yet save the race from the evils of false teaching.”
—Fannie Barrier Williams (1855–1944)
“The principal saloon was the Howlin’ Wilderness, an immense log cabin with a log fire always burning in the huge fireplace, where so many fights broke out that the common saying was, “We will have a man for breakfast tomorrow.””
—For the State of California, U.S. public relief program (1935-1943)
“Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.”
—Noam Chomsky (b. 1928)