Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“For it is only the finite that has wrought and suffered; the infinite lies stretched in smiling repose.”
—Ralph Waldo Emerson (1803–1882)
“The educated do not share a common body of information, but a common state of mind.”
—Mason Cooley (b. 1927)
“The merit of those who fill a space in the world’s history, who are borne forward, as it were, by the weight of thousands whom they lead, shed a perfume less sweet than do the sacrifices of private virtue.”
—Ralph Waldo Emerson (1803–1882)