Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Any language is necessarily a finite system applied with different degrees of creativity to an infinite variety of situations, and most of the words and phrases we use are “prefabricated” in the sense that we don’t coin new ones every time we speak.”
—David Lodge (b. 1935)
“The twelve Cells for Incorrigibles ... are also carved out of the solid rock hill. On the walls of one of the cells human “liberty” is clearly inscribed, with the “liberty” in significant quotation marks.”
—Administration in the State of Ariz, U.S. public relief program (1935-1943)
“Mere human beings can’t afford to be fanatical about anything.... Not even about justice or loyalty. The fanatic for justice ends by murdering a million helpless people to clear a space for his law-courts. If we are to survive on this planet, there must be compromises.”
—Storm Jameson (1891–1986)