Loss Function - Decision Rules

Decision Rules

A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:

  • Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
  • Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
  • Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):

Read more about this topic:  Loss Function

Famous quotes containing the words decision and/or rules:

    Moral choices do not depend on personal preference and private decision but on right reason and, I would add, divine order.
    Basil Hume (b. 1923)

    Now that the steam engine rules the world, a title is an absurdity, still I am all dressed up in this title. It will crush me if I do not support it. The title attracts attention to myself.
    Stendhal [Marie Henri Beyle] (1783–1842)