Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.”
—George Berkeley (1685–1753)
“I incline to think that the people will not now sustain the policy of upholding a State Government against a rival government, by the use of the forces of the United States. If this leads to the overthrow of the de jure government in a State, the de facto government must be recognized.”
—Rutherford Birchard Hayes (1822–1893)
“True spoiling is nothing to do with what a child owns or with amount of attention he gets. he can have the major part of your income, living space and attention and not be spoiled, or he can have very little and be spoiled. It is not what he gets that is at issue. It is how and why he gets it. Spoiling is to do with the family balance of power.”
—Penelope Leach (20th century)