Generative Training
The training methods described above are discriminative training methods, because they seek to find a function that discriminates well between the different output values (see discriminative model). For the special case where is a joint probability distribution and the loss function is the negative log likelihood a risk minimization algorithm is said to perform generative training, because can be regarded as a generative model that explains how the data were generated. Generative training algorithms are often simpler and more computationally efficient than discriminative training algorithms. In some cases, the solution can be computed in closed form as in naive Bayes and linear discriminant analysis.
Read more about this topic: Supervised Learning
Famous quotes containing the words generative and/or training:
“The generative energy, which, when we are loose, dissipates and makes us unclean, when we are continent invigorates and inspires us. Chastity is the flowering of man; and what are called Genius, Heroism, Holiness, and the like, are but various fruits which succeed it.”
—Henry David Thoreau (1817–1862)
“Perhaps the most valuable result of all education is the ability to make yourself do the thing you have to do, when it ought to be done, whether you like it or not; it is the first lesson that ought to be learned; and however early a man’s training begins, its probably the last lesson that he learns thoroughly.”
—Thomas Henry Huxley (1825–95)