Skip to content
LearnStatisticspowered by UpThink

Statistics and data science, defined

Kalman Filter (Equations)

The basic mathematics behind the idea of Kalman filter may be described as follows – Consider, for example, a Markov chain – i.e. a random series with Markov property – described by the following equation:

mathematical symbol(1)

where

  • – is the value of the vector-values Markov chain mathematical symbol at the moment mathematical symbol of discrete time mathematical symbol;
  • is a known matrix which describes regular causal link between the current state and the next state mathematical symbol;
  • mathematical symbol is a zero-mean random noise with known covariance matrix.

The Kalman filter for time series specified by equation (1) may be described by the following recursive expression:

mathematical symbol(2)

where

  • mathematical symbol is the output of the Kalman filter, which is normally used as a predictor for mathematical symbol;
  • is the “Kalman gain”.

The expression (2) is only one of several mathematically- equivalent forms. It shows that the Kalman filter output mathematical symbol is a sum of two terms. The first term ( mathematical symbol) is a dynamic prognosis based on the known transition matrix of the Markov chain (1) ; the second term is a linear function of the prediction error ( mathematical symbol) from the previous step.

The theory of Kalman filtering specifies expressions for calculation of the optimal matrix in equation (2) from the known covariance matrix mathematical symbol of the random vector mathematical symbol in the model (1) .

Besides the simplest case described by (1-2) , the classical theory of Kalman filters covers more complex settings, e.g. when the state vector is not observable – i.e. only a linear function mathematical symbol of is known

Formula: Kalman Filter (Equations)

where

  • mathematical symbol is a known matrix;
  • mathematical symbol is the observation noise with known covariance matrix.

There are also generalizations of the Kalman filter theory for continuous time , expressed in terms of differential equations (not difference equations, like above); and there are extensions to non-linear filtering.

Related entries

Where this gets used

We teach data science and statistics online, one subject at a time, on fixed start dates with an instructor who marks your work.