Relation To Law of Diminishing Returns
Amdahl's law is often conflated with the law of diminishing returns, whereas only a special case of applying Amdahl's law demonstrates 'law of diminishing returns'. If one picks optimally (in terms of the achieved speed-up) what to improve, then one will see monotonically decreasing improvements as one improves. If, however, one picks non-optimally, after improving a sub-optimal component and moving on to improve a more optimal component, one can see an increase in return. Note that it is often rational to improve a system in an order that is "non-optimal" in this sense, given that some improvements are more difficult or consuming of development time than others.
Amdahl's law does represent the law of diminishing returns if you are considering what sort of return you get by adding more processors to a machine, if you are running a fixed-size computation that will use all available processors to their capacity. Each new processor you add to the system will add less usable power than the previous one. Each time you double the number of processors the speedup ratio will diminish, as the total throughput heads toward the limit of .
This analysis neglects other potential bottlenecks such as memory bandwidth and I/O bandwidth, if they do not scale with the number of processors; however, taking into account such bottlenecks would tend to further demonstrate the diminishing returns of only adding processors.
Read more about this topic: Amdahl's Law
Famous quotes containing the words diminishing returns, relation to, relation, law, diminishing and/or returns:
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“Hesitation increases in relation to risk in equal proportion to age.”
—Ernest Hemingway (1899–1961)
“A theory of the middle class: that it is not to be determined by its financial situation but rather by its relation to government. That is, one could shade down from an actual ruling or governing class to a class hopelessly out of relation to government, thinking of gov’t as beyond its control, of itself as wholly controlled by gov’t. Somewhere in between and in gradations is the group that has the sense that gov’t exists for it, and shapes its consciousness accordingly.”
—Lionel Trilling (1905–1975)
“The law of humanity ought to be composed of the past, the present, and the future, that we bear within us; whoever possesses but one of these terms, has but a fragment of the law of the moral world.”
—Edgar Quinet (1803–1875)
“I take it that the good of mankind means the attainment, by every man, of all the happiness which he can enjoy without diminishing the happiness of his fellow men.”
—Thomas Henry Huxley (1825–95)
“Dear, why should you command me to my rest,
When now the night doth summon all to sleep?
Methinks this time becometh lovers best;
Night was ordained together friends to keep.
How happy are all other living things,
Which though the day disjoin by several flight,
The quiet evening yet together brings,
And each returns unto his love at night.”
—Michael Drayton (1563–1631)