Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Are not all finite beings better pleased with motions relative than absolute?”
—Henry David Thoreau (1817–1862)
“While you are nurturing your newborn, you need someone to nurture you, whether it is with healthful drinks while you’re nursing, or with words of recognition and encouragement as you talk about your feelings. In this state of continual giving to your infant—whether it is nourishment or care or love—you are easily drained, and you need to be replenished from sources outside yourself so that you will have reserves to draw from.”
—Sally Placksin (20th century)
“Though seas and land be ‘twixt us both,
Our faith and troth,
Like separated souls,
All time and space controls:
Above the highest sphere we meet
Unseen, unknown, and greet as angels greet.”
—Richard Lovelace (1618–1658)