Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“For it is only the finite that has wrought and suffered; the infinite lies stretched in smiling repose.”
—Ralph Waldo Emerson (1803–1882)
“... here hundreds sit and play Bingo; here the bright lights of Broadway burn through a sea haze; here Somebodies tumble over other Somebodies and over Nobodies as well.”
—For the State of New Jersey, U.S. public relief program (1935-1943)
“The limerick packs laughs anatomical
Into space that is quite economical,
But the good ones I’ve seen
So seldom are clean
And the clean ones so seldom are comical.”
—Anonymous.