Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“The finite is annihilated in the presence of the infinite, and becomes a pure nothing. So our spirit before God, so our justice before divine justice.”
—Blaise Pascal (1623–1662)
“Politics is about putting yourself in a state of grace.”
—Paddy Ashdown (b. 1941)
“Mere human beings can’t afford to be fanatical about anything.... Not even about justice or loyalty. The fanatic for justice ends by murdering a million helpless people to clear a space for his law-courts. If we are to survive on this planet, there must be compromises.”
—Storm Jameson (1891–1986)