Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.”
—George Berkeley (1685–1753)
“It is said the city was spared a golden-oak period because its residents, lacking money to buy the popular atrocities of the nineties, necessarily clung to their rosewood and mahogany.”
—Administration in the State of Sout, U.S. public relief program (1935-1943)
“Finally she grew quiet, and after that, coherent thought. With this, stalked through her a cold, bloody rage. Hours of this, a period of introspection, a space of retrospection, then a mixture of both. Out of this an awful calm.”
—Zora Neale Hurston (1891–1960)