Loss Function - Decision Rules

Decision Rules

A decision rule makes a choice using an optimality criterion. Some commonly used criteria are:

  • Minimax: Choose the decision rule with the lowest worst loss — that is, minimize the worst-case (maximum possible) loss:
  • Invariance: Choose the optimal decision rule which satisfies an invariance requirement.
  • Choose the decision rule with the lowest average loss (i.e. minimize the expected value of the loss function):

Read more about this topic:  Loss Function

Famous quotes containing the words decision and/or rules:

    The decision to have a child is both a private and a public decision, for children are our collective future.
    Sylvia Ann Hewitt (20th century)

    Each person calls barbarism whatever is not his or her own practice.... We may call Cannibals barbarians, in respect to the rules of reason, but not in respect to ourselves, who surpass them in every kind of barbarity.
    Michel de Montaigne (1533–1592)