Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“All finite things reveal infinitude:”
—Theodore Roethke (19081963)
“Such is the state of life, that none are happy but by the anticipation of change: the change itself is nothing; when we have made it, the next wish is to change again. The world is not yet exhausted; let me see something tomorrow which I never saw before.”
—Samuel Johnson (17091784)
“... the movie womans world is designed to remind us that a woman may live in a mansion, an apartment, or a yurt, but its all the same thing because what she really lives in is the body of a woman, and that body is allowed to occupy space only according to the dictates of polite society.”
—Jeanine Basinger (b. 1936)