Loss Function - Decision Rules

Decision Rules

A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:

  • Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
  • Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
  • Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):

Read more about this topic:  Loss Function

Famous quotes containing the words decision and/or rules:

    The decision to feed the world
    is the real decision. No revolution
    has chosen it. For that choice requires
    that women shall be free.
    Adrienne Rich (b. 1929)

    Never invite to dinner: those who won’t decide until the last minute; those who come more than half an hour late; those who want to bring along two or three friends; drunks; monologists; those who stay until three o’clock in the morning; those who think that conversation means having an argument; those who take a high moral tone; those who are stupid, ugly, or dull. Enforcement of these rules will enable one to eat alone every night in comfort.
    Mason Cooley (b. 1927)