Markov Chain - Finite State Space

Finite State Space

If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to

Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.

Read more about this topic:  Markov Chain

Famous quotes containing the words finite, state and/or space:

    God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.
    George Berkeley (1685–1753)

    The human race is yet in its infancy—no, not infancy; infancy is innocent and sweet—it is in its ugly boyhood, half way between the child and the man—in a state of semi-barbarism.
    Anonymous, U.S. magazine contributor. Herald of Progress (no dates available)

    For good teaching rests neither in accumulating a shelfful of knowledge nor in developing a repertoire of skills. In the end, good teaching lies in a willingness to attend and care for what happens in our students, ourselves, and the space between us. Good teaching is a certain kind of stance, I think. It is a stance of receptivity, of attunement, of listening.
    Laurent A. Daloz (20th century)