Recursive Bayesian Estimation - Model

Model

The true state is assumed to be an unobserved Markov process, and the measurements are the observed states of a Hidden Markov Model (HMM). The following picture presents a Bayesian Network of a HMM.

Because of the Markov assumption, the probability of the current true state given the immediately previous one is conditionally independent of the other earlier states.

Similarly, the measurement at the k-th timestep is dependent only upon the current state, so is conditionally independent of all other states given the current state.

Using these assumptions the probability distribution over all states of the HMM can be written simply as:

However, when using the Kalman filter to estimate the state x, the probability distribution of interest is associated with the current states conditioned on the measurements up to the current timestep. (This is achieved by marginalising out the previous states and dividing by the probability of the measurement set.)

This leads to the predict and update steps of the Kalman filter written probabilistically. The probability distribution associated with the predicted state is the sum (integral) of the products of the probability distribution associated with the transition from the (k - 1)-th timestep to the k-th and the probability distribution associated with the previous state, over all possible .

The probability distribution of update is proportional to the product of the measurement likelihood and the predicted state.

p(\textbf{x}_k|\textbf{z}_{k}) = \frac{p(\textbf{z}_k|\textbf{x}_k) p(\textbf{x}_k|\textbf{z}_{k-1})}{p(\textbf{z}_k|\textbf{z}_{k-1})} = \alpha\,p(\textbf{z}_k|\textbf{x}_k) p(\textbf{x}_k|\textbf{z}_{k-1})

The denominator

is constant relative to, so we can always substitute it for a coefficient, which can usually be ignored in practice. The numerator can be calculated and then simply normalized, since its integral must be unitary.

Read more about this topic:  Recursive Bayesian Estimation

Famous quotes containing the word model:

    “Socrates, who was a perfect model in all great qualities, ... hit on a body and face so ugly and so incongruous with the beauty of his soul, he who was so madly in love with beauty.”
    —Michel de Montaigne (1533–1592)

    “When Titian was mixing brown madder,
    His model was posed up a ladder.
    Said Titian, “That position
    Calls for coition,”
    So he lept up the ladder and had her.”
    —Anonymous.

    “The playing adult steps sideward into another reality; the playing child advances forward to new stages of mastery....Child’s play is the infantile form of the human ability to deal with experience by creating model situations and to master reality by experiment and planning.”
    —Erik H. Erikson (20th century)