Markov Chain - General State Space

General State Space

Many results for Markov chains with finite state space can be generalized to chains with uncountable state space through Harris chains. The main idea is to see if there is a point in the state space that the chain hits with probability one. Generally, it is not true for continuous state space, however, we can define sets A and B along with a positive number ε and a probability measure ρ, such that

Then we could collapse the sets into an auxiliary point α, and a recurrent Harris chain can be modified to contain α. Lastly, the collection of Harris chains is a comfortable level of generality, which is broad enough to contain a large number of interesting examples, yet restrictive enough to allow for a rich theory.

Read more about this topic:  Markov Chain

Famous quotes containing the words general, state and/or space:

    There is a mortifying experience in particular, which does not fail to wreak itself also in the general history; I mean “the foolish face of praise,” the forced smile which we put on in company where we do not feel at ease, in answer to conversation which does not interest us. The muscles, not spontaneously moved but moved, by a low usurping wilfulness, grow tight about the outline of the face, with the most disagreeable sensation.
    Ralph Waldo Emerson (1803–1882)

    “Well, well,” he said to himself, “you are not in Belgium; let us begin our apprenticeship in earnest, and so long as we are in the woods, howl heartily with the wolves.”
    —For the State of Nebraska, U.S. public relief program (1935-1943)

    It is not through space that I must seek my dignity, but through the management of my thought. I shall have no more if I possess worlds.
    Blaise Pascal (1623–1662)