Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.”
—George Berkeley (1685–1753)
“In a free society the state does not administer the affairs of men. It administers justice among men who conduct their own affairs.”
—Walter Lippmann (1889–1974)
“Art and power will go on as they have done,—will make day out of night, time out of space, and space out of time.”
—Ralph Waldo Emerson (1803–1882)