Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Sisters define their rivalry in terms of competition for the gold cup of parental love. It is never perceived as a cup which runneth over, rather a finite vessel from which the more one sister drinks, the less is left for the others.”
—Elizabeth Fishel (20th century)
“I was put into jail as I was going to the shoemaker’s to get a shoe which was mended. When I was let out the next morning, I proceeded to finish my errand, and, having put on my mended shoe, joined a huckleberry party, who were impatient to put themselves under my conduct; and in half an hour ... was in the midst of a huckleberry field, on one of our highest hills, two miles off, and then the State was nowhere to be seen.”
—Henry David Thoreau (1817–1862)
“A set of ideas, a point of view, a frame of reference is in space only an intersection, the state of affairs at some given moment in the consciousness of one man or many men, but in time it has evolving form, virtually organic extension. In time ideas can be thought of as sprouting, growing, maturing, bringing forth seed and dying like plants.”
—John Dos Passos (1896–1970)