Loss Function - Decision Rules

Decision Rules

A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:

  • Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
  • Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
  • Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):

Read more about this topic:  Loss Function

Famous quotes containing the words decision and/or rules:

    Will mankind never learn that policy is not morality,—that it never secures any moral right, but considers merely what is expedient? chooses the available candidate,—who is invariably the devil,—and what right have his constituents to be surprised, because the devil does not behave like an angel of light? What is wanted is men, not of policy, but of probity,—who recognize a higher law than the Constitution, or the decision of the majority.
    Henry David Thoreau (1817–1862)

    Critics are more committed to the rules of art than artists are.
    Mason Cooley (b. 1927)