Markov Chain - Finite State Space

Finite State Space

If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to

Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.

Read more about this topic:  Markov Chain

Famous quotes containing the words finite, state and/or space:

    “All finite things reveal infinitude:”
    —Theodore Roethke (1908–1963)

    ““He swore that day till the leaves shook on the trees. Charming! Delightful! Never have I enjoyed such swearing before or since. Sir, on that memorable day he swore like an angel from Heaven!””
    —For the State of New Jersey, U.S. public relief program (1935-1943)

    “Why not a space flower? Why do we always expect metal ships?”
    —W.D. Richter (b. 1945)