A hidden Markov model (HMM) is a statistical Markov model in which the system being modeled is assumed to be a Markov process with unobserved (hidden) states. An HMM can be considered as the simplest dynamic Bayesian network. The mathematics behind the HMM was developed by L. E. Baum and coworkers. It is closely related to an earlier work on optimal nonlinear filtering problem (stochastic processes) by Ruslan L. Stratonovich, who was the first to describe the forward-backward procedure.
In simpler Markov models (like a Markov chain), the state is directly visible to the observer, and therefore the state transition probabilities are the only parameters. In a hidden Markov model, the state is not directly visible, but output, dependent on the state, is visible. Each state has a probability distribution over the possible output tokens. Therefore the sequence of tokens generated by an HMM gives some information about the sequence of states. Note that the adjective 'hidden' refers to the state sequence through which the model passes, not to the parameters of the model; even if the model parameters are known exactly, the model is still 'hidden'.
Hidden Markov models are especially known for their application in temporal pattern recognition such as speech, handwriting, gesture recognition, part-of-speech tagging, musical score following, partial discharges and bioinformatics.
A hidden Markov model can be considered a generalization of a mixture model where the hidden variables (or latent variables), which control the mixture component to be selected for each observation, are related through a Markov process rather than independent of each other.
Read more about Hidden Markov Model: Description in Terms of Urns, Architecture, Learning, A Concrete Example, Applications, History, Types, Extensions
Famous quotes containing the words hidden and/or model:
“Yet there is a mystery here and it is not one that I understand: without the sting of otherness, of—even—the vicious, without the terrible energies of the underside of health, sanity, sense, then nothing works or can work. I tell you that goodness-what we in our ordinary daylight selves call goodness: the ordinary, the decent—these are nothing without the hidden powers that pour forth continually from their shadow sides. Their hidden aspects contained and tempered.”
—Doris Lessing (b. 1919)
“She represents the unavowed aspiration of the male human being, his potential infidelity—and infidelity of a very special kind, which would lead him to the opposite of his wife, to the “woman of wax” whom he could model at will, make and unmake in any way he wished, even unto death.”
—Marguerite Duras (b. 1914)