Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“The finite is annihilated in the presence of the infinite, and becomes a pure nothing. So our spirit before God, so our justice before divine justice.”
—Blaise Pascal (1623–1662)
“Such is my jealousy and such my hate
though I would state it otherwise.”
—Hilda Doolittle (1886–1961)
“Sir Walter Raleigh might well be studied, if only for the excellence of his style, for he is remarkable in the midst of so many masters. There is a natural emphasis in his style, like a man’s tread, and a breathing space between the sentences, which the best of modern writing does not furnish. His chapters are like English parks, or say rather like a Western forest, where the larger growth keeps down the underwood, and one may ride on horseback through the openings.”
—Henry David Thoreau (1817–1862)