Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“The finite is annihilated in the presence of the infinite, and becomes a pure nothing. So our spirit before God, so our justice before divine justice.”
—Blaise Pascal (1623–1662)
“Decency ... must be an even more exhausting state to maintain than its opposite. Those who succeed seem to need a stupefying amount of sleep.”
—Quentin Crisp (b. 1908)
“For tribal man space was the uncontrollable mystery. For technological man it is time that occupies the same role.”
—Marshall McLuhan (1911–1980)