Random forest (or random forests) is an ensemble classifier that consists of many decision trees and outputs the class that is the mode of the classes output by individual trees. The algorithm for inducing a random forest was developed by Leo Breiman and Adele Cutler, and "Random Forests" is their trademark. The term came from random decision forests that was first proposed by Tin Kam Ho of Bell Labs in 1995. The method combines Breiman's "bagging" idea and the random selection of features, introduced independently by Ho and Amit and Geman in order to construct a collection of decision trees with controlled variation.
The selection of a random subset of features is an example of the random subspace method, which, in Ho's formulation, is a way to implement stochastic discrimination proposed by Eugene Kleinberg.
Read more about Random Forest: Learning Algorithm, Features and Advantages, Disadvantages, Visualization
Famous quotes containing the words random and/or forest:
“There is a potential 4-6 percentage point net gain for the President [George Bush] by replacing Dan Quayle on the ticket with someone of neutral stature.”
—Mary Matalin, U.S. Republican political advisor, author, and James Carville b. 1946, U.S. Democratic political advisor, author. All’s Fair: Love, War, and Running for President, p. 205, Random House (1994)
“The lakes are something which you are unprepared for; they lie up so high, exposed to the light, and the forest is diminished to a fine fringe on their edges, with here and there a blue mountain, like amethyst jewels set around some jewel of the first water,—so anterior, so superior, to all the changes that are to take place on their shores, even now civil and refined, and fair as they can ever be.”
—Henry David Thoreau (1817–1862)