Markov Chain - Finite State Space

Finite State Space

If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to

Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.

Read more about this topic:  Markov Chain

Famous quotes containing the words finite and/or state:

    “For it is only the finite that has wrought and suffered; the infinite lies stretched in smiling repose.”
    —Ralph Waldo Emerson (1803–1882)

    “If a hermit lives in a state of ecstasy, his lack of comfort becomes the height of comfort. He must relinquish it.”
    —Jean Cocteau (1889–1963)