Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Any language is necessarily a finite system applied with different degrees of creativity to an infinite variety of situations, and most of the words and phrases we use are “prefabricated” in the sense that we don’t coin new ones every time we speak.”
—David Lodge (b. 1935)
“The wealthy man is not he who has money, but he who has the means to live in the luxurious state of early spring.”
—Anton Pavlovich Chekhov (1860–1904)
“The woman’s world ... is shown as a series of limited spaces, with the woman struggling to get free of them. The struggle is what the film is about; what is struggled against is the limited space itself. Consequently, to make its point, the film has to deny itself and suggest it was the struggle that was wrong, not the space.”
—Jeanine Basinger (b. 1936)