Markov Chain - Finite State Space

Finite State Space

If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to

Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.

Read more about this topic:  Markov Chain

Famous quotes containing the words finite, state and/or space:

    “All finite things reveal infinitude:”
    —Theodore Roethke (1908–1963)

    “Such is the state of life, that none are happy but by the anticipation of change: the change itself is nothing; when we have made it, the next wish is to change again. The world is not yet exhausted; let me see something tomorrow which I never saw before.”
    —Samuel Johnson (1709–1784)

    “... the movie woman’s world is designed to remind us that a woman may live in a mansion, an apartment, or a yurt, but it’s all the same thing because what she really lives in is the body of a woman, and that body is allowed to occupy space only according to the dictates of polite society.”
    —Jeanine Basinger (b. 1936)