Relation To Law of Diminishing Returns
Amdahl's law is often conflated with the law of diminishing returns, whereas only a special case of applying Amdahl's law demonstrates 'law of diminishing returns'. If one picks optimally (in terms of the achieved speed-up) what to improve, then one will see monotonically decreasing improvements as one improves. If, however, one picks non-optimally, after improving a sub-optimal component and moving on to improve a more optimal component, one can see an increase in return. Note that it is often rational to improve a system in an order that is "non-optimal" in this sense, given that some improvements are more difficult or consuming of development time than others.
Amdahl's law does represent the law of diminishing returns if you are considering what sort of return you get by adding more processors to a machine, if you are running a fixed-size computation that will use all available processors to their capacity. Each new processor you add to the system will add less usable power than the previous one. Each time you double the number of processors the speedup ratio will diminish, as the total throughput heads toward the limit of .
This analysis neglects other potential bottlenecks such as memory bandwidth and I/O bandwidth, if they do not scale with the number of processors; however, taking into account such bottlenecks would tend to further demonstrate the diminishing returns of only adding processors.
Read more about this topic: Amdahl's Law
Famous quotes containing the words diminishing returns, relation to, relation, law, diminishing and/or returns:
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“The whole point of Camp is to dethrone the serious. Camp is playful, anti-serious. More precisely, Camp involves a new, more complex relation to “the serious.” One can be serious about the frivolous, frivolous about the serious.”
—Susan Sontag (b. 1933)
“Unaware of the absurdity of it, we introduce our own petty household rules into the economy of the universe for which the life of generations, peoples, of entire planets, has no importance in relation to the general development.”
—Alexander Herzen (1812–1870)
“The most absurd apology for authority and law is that they serve to diminish crime. Aside from the fact that the State is itself the greatest criminal, breaking every written and natural law, stealing in the form of taxes, killing in the form of war and capital punishment, it has come to an absolute standstill in coping with crime. It has failed utterly to destroy or even minimize the horrible scourge of its own creation.”
—Emma Goldman (1869–1940)
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“If Thought is capable of being classed with Electricity, or Will with chemical affinity, as a mode of motion, it seems necessary to fall at once under the second law of thermodynamics as one of the energies which most easily degrades itself, and, if not carefully guarded, returns bodily to the cheaper form called Heat. Of all possible theories, this is likely to prove the most fatal to Professors of History.”
—Henry Brooks Adams (1838–1918)