Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Are not all finite beings better pleased with motions relative than absolute?”
—Henry David Thoreau (1817–1862)
““Hear me,” he said to the white commander. “I am tired. My heart is sick and sad. Our chiefs are dead; the little children are freezing. My people have no blankets, no food. From where the sun stands, I will fight no more forever.””
—For the State of Montana, U.S. public relief program (1935-1943)
“I would have broke mine eye-strings, cracked them, but
To look upon him, till the diminution
Of space had pointed him sharp as my needle;
Nay, followed him till he had melted from
The smallness of a gnat to air, and then
Have turned mine eye and wept.”
—William Shakespeare (1564–1616)