Selecting A Loss Function
Sound statistical practice requires selecting an estimator consistent with the actual loss experienced in the context of a particular applied problem. Thus, in the applied use of loss functions, selecting which statistical method to use to model an applied problem depends on knowing the losses that will be experienced from being wrong under the problem's particular circumstances, which results in the introduction of an element of teleology into problems of scientific decision-making.
A common example involves estimating "location." Under typical statistical assumptions, the mean or average is the statistic for estimating location that minimizes the expected loss experienced under the Taguchi or squared-error loss function, while the median is the estimator that minimizes expected loss experienced under the absolute-difference loss function. Still different estimators would be optimal under other, less common circumstances.
In economics, when an agent is risk neutral, the loss function is simply expressed in monetary terms, such as profit, income, or end-of-period wealth.
But for risk averse (or risk-loving) agents, loss is measured as the negative of a utility function, which represents satisfaction and is usually interpreted in ordinal terms rather than in cardinal (absolute) terms.
Other measures of cost are possible, for example mortality or morbidity in the field of public health or safety engineering.
For most optimization algorithms, it is desirable to have a loss function that is globally continuous and differentiable.
Two very commonly-used loss functions are the squared loss, and the absolute loss, . However the absolute loss has the disadvantage that it is not differentiable at . The squared loss has the disadvantage that it has the tendency to be dominated by outliers---when summing over a set of 's (as in ), the final sum tends to be the result of a few particularly-large a-values, rather than an expression of the average a-value.
Read more about this topic: Loss Function
Famous quotes containing the words selecting a, selecting, loss and/or function:
“If marriages were made by putting all the men’s names into one sack and the women’s names into another, and having them taken out by a blindfolded child like lottery numbers, there would be just as high a percentage of happy marriages as we have here in England.... If you can tell me of any trustworthy method of selecting a wife, I shall be happy to make use of it.”
—George Bernard Shaw (1856–1950)
“A man is a method, a progressive arrangement; a selecting principle, gathering his like to him; wherever he goes.”
—Ralph Waldo Emerson (1803–1882)
“One has but to observe a community of beavers at work in a stream to understand the loss in his sagacity, balance, co-operation, competence, and purpose which Man has suffered since he rose up on his hind legs.... He began to chatter and he developed Reason, Thought, and Imagination, qualities which would get the smartest group of rabbits or orioles in the world into inextricable trouble overnight.”
—James Thurber (1894–1961)
“The press and politicians. A delicate relationship. Too close, and danger ensues. Too far apart and democracy itself cannot function without the essential exchange of information. Creative leaks, a discreet lunch, interchange in the Lobby, the art of the unattributable telephone call, late at night.”
—Howard Brenton (b. 1942)