Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“All finite things reveal infinitude:”
—Theodore Roethke (1908–1963)
“Just across the Green from the post office is the county jail, seldom occupied except by some backwoodsman who has been intemperate; the courthouse is under the same roof. The dog warden usually basks in the sunlight near the harness store or the post office, his golden badge polished bright.”
—Administration for the State of Con, U.S. public relief program (1935-1943)
“What a phenomenon it has been—science fiction, space fiction—exploding out of nowhere, unexpectedly of course, as always happens when the human mind is being forced to expand; this time starwards, galaxy-wise, and who knows where next.”
—Doris Lessing (b. 1919)