Loss Function - Decision Rules

Decision Rules

A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:

  • Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
  • Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
  • Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):

Read more about this topic:  Loss Function

Famous quotes containing the words decision and/or rules:

    Our decision about energy will test the character of the American people and the ability of the President and the Congress to govern this nation. This difficult effort will be the “moral equivalent of war,” except that we will be uniting our efforts to build and not to destroy.
    Jimmy Carter (James Earl Carter, Jr.)

    ... a large portion of success is derived from flexibility. It is all very well to have principles, rules of behavior concerning right and wrong. But it is quite as essential to know when to forget as when to use them.
    Alice Foote MacDougall (1867–1945)