Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Are not all finite beings better pleased with motions relative than absolute?”
—Henry David Thoreau (1817–1862)
“If, during his daily walk, he met any children flying kites, playing marbles, or whirling peg tops, he would buy the toys from them and exhort them not to gamble or indulge in vain sport.”
—For the State of Rhode Island, U.S. public relief program (1935-1943)
“I take SPACE to be the central fact to man born in America.... I spell it large because it comes large here. Large and without mercy.”
—Charles Olson (1910–1970)