Questions tagged [kalman-filter]
The Kalman filter is an algorithm for estimating the mean vector and variance-covariance matrix of the unknown state in a state space model.
340
questions
0
votes
1answer
29 views
Stationary Kalman Filter
Ecercise 4.5 from Bayesian Filtering & Smoothing by Simo Särkkä:
Derive the stationary Kalman filter for the Gaussian random walk
model. That is, compute the limiting Kalman filter gain when $...
0
votes
0answers
13 views
Finite grid approximation to the Bayesian filtering problem
I need some hints for solving Ecercise 4.4 from Bayesian Filtering & Smoothing by Simo Särkkä:
Select a finite interval in the state space, say, $x \in [-10, 10]$ and discretize it evenly to N ...
0
votes
0answers
12 views
How to estimate and determine the confidence level of the presence of an object with respect to another object?
I'm working on a university project to estimate the confidence (And therefore, the change in confidence) of the presence an area of given dimensions with respect to positions obtained from a moving ...
0
votes
0answers
48 views
RNN vs Kalman filter : learning the underlying dynamics?
Being recently interested in Kalman filters and Recurrent neural networks, it appears to me that the two are closely related, yet I can't find relevant enough litterature :
In a Kalman filter, the ...
0
votes
0answers
17 views
zero-lag filter: size of negative part of filter weights: when in-phase with sinusoid?
This question is about negative weights in causal filters and their effect on the lag, or "synchronization" with a sinusoidal signal.
There are a few types of moving averages that use negative ...
0
votes
1answer
20 views
Examples of Real Applications for Time-series with Continuous-valued Targets and Continuous-valued Observations
Suppose that we are interested in estimating continuous-valued targets $y_t$ from continuous-valued observations $x_t$ over discrete time steps $t = \{1,2,3,\dots,T\}$. Could you give me some ...
0
votes
0answers
28 views
Outliers Kalman Filtering
This might not be the right place to ask this questions, but I figured it's more of a machine learning question. I am also asking on the pyro forum for brevity.
I'm working with the simple extended ...
0
votes
1answer
69 views
Retrodiction / Specific filter to obtain initial state
Problem
I have a system that is measured at regular intervals. The state of the system at those times is given by the vector $\vec x=(x_0, x_1, x_2,\cdots)$. In between each measurement, a random ...
0
votes
0answers
18 views
MLE vs Expectation Maximization to estimate time-changing parameters in state space model
Suppose I have a generic model in state-space form described as
$$x_{t+1}=\phi_{t} x_{t}+w_{t+1}\epsilon_{t+1}$$
$$y_{t}=H_{t}x_{t}+v_{t}e_{t+1}$$
where both $e_{t+1}$ and $\epsilon_{t+1}$ are iid ...
1
vote
1answer
25 views
Clarification on Akaike's IC (AIC) and BIC for Expectation Maximization with time-changing parameters
I apologize in advance for the trivial question, but I need a clarification on the following issue. Suppose I have a generic model in state-space form described as
$$x_{t+1}=\phi_{t} x_{t}+w_{t+1}$$
$...
0
votes
0answers
13 views
What is behind “forecast” in Eviews?
I have been trying to use state space models in order to represent some gestural data. Until now I have been using Eviews to to do all the dynamic forecasting part, so I was curious what is behind ...
0
votes
2answers
48 views
Kalman Filter with heteroscedastic Q (covariance of the transition noise)
I am looking at a generic derivation of the Kalman Filter (like this but you can take any). And I was wondering, checking all the derivation, why are we forced to assume that the covariance matrix Q ...
0
votes
0answers
19 views
R- Auto Arima with Kalman Filter
In Python auto arima, it is clearly stated that when you set the method parameter as "ml" (maximum likelihood), residuals are obtained via the Kalman Filter.
What is its equivalent in R?
0
votes
1answer
37 views
What are the differences between Bayesian filters and adaptive filters?
I am learning about state estimation and I am having difficulty understanding the difference between Bayesian filters such as Kalman filter and particle filters compared to adaptive filters. According ...
0
votes
0answers
34 views
Dynamic factor model (DFM) with R, please help
I'm interested doing a dynamic factor model (DLM) similar to Doz, Giannone and Reichlin (2011) and Giannone, Reichlin and Small (2008). Moreover, I'm trying doing macroeconomic nowcasting model.
In ...
0
votes
0answers
34 views
How to plot results from Kalman filter
I am interested in representing the performance/consistency of my Kalman filter in a single plot. I would like to compare the norm of the estimate error against 3$\sigma$ error. I would also like the ...
0
votes
0answers
15 views
Log innovation vs squared
I see some state space models specify their innovation process as log innovations and some squaring the term. For example, the examples in the R package DLM favours the use of log innovations when ...
2
votes
1answer
106 views
Are Kalman Filter recursions valid when the state noise has a singular covariance matrix?
Consider a Linear Gaussian State-Space Model where the states are denoted by $X_t$ and observations are denoted by $Y_t$:
\begin{align}
X_t &= A X_{t-1} + \epsilon_t, &&\epsilon_t \sim \...
0
votes
1answer
41 views
How do I model the chaotic behaviour(like the sequence from Lorenz attractor) in a stochastic sense?
Recently, I encountered a difficulty of prediction Lorenz attractor by using a GRU.
(See the code from here.)
I think that it's inevitable since the original system, i.e. Lorenz equation, is too ...
0
votes
1answer
52 views
Two time-varying coefficients in Kalman filter with DLM package [closed]
I am trying to estimate a model that has two time varying coefficients in R using the "DLM" package.
My measurement equation would be = Yt = F1tx1t + F2tx2t + v
The state equations are:
F1t = F1t-...
1
vote
2answers
69 views
When forecasting, is it better to remove the outliers or just to transform them?
I am forecasting the number of logins. I have a dataset with the number of logins for each hour.
First, I use LOF (local outlier factor) to find the outliers and then I remove them.
Second, I use ...
0
votes
1answer
22 views
How to Derive SISO Kalman Filter Update Equation Using only Probability Density Functions
I'm trying to prove to myself that a single state/single measurement kalman update can be derived using bayes theorem (as proof of concept for a more complicated task) only using the PDF. I am able ...
1
vote
1answer
44 views
Do we need to stationarize a time series signal when using Kalman filter?
I am working on forecasting the number of logins.
I know that before using ARIMA, it is important to remove trend and seasonality.
But in the case of Kalman filter, I am not sure. After all it is a ...
2
votes
0answers
45 views
Continuous-time Kalman filter with no observation/measurement noise
The continuous-time (linear) state space model can be written
\begin{align*}
\text{d}\mathbf{x}_t &= \mathbf{F} \,\mathbf{x}_t \, \text{d}t +
\mathbf{G} \,\text{d} \boldsymbol{\...
0
votes
0answers
10 views
Books on systematic risk(beta)
I am looking for some reference material on beta (systematic risk in market model regression). I want to calculate time varying beta for stocks using kalman filter. First I would like to go through ...
1
vote
3answers
132 views
Kalman filter parameter estimation
From what I've known about Kalman filter, it requires all the parameters of the underlying state space model. Say the state space model is:
$$\xi_{t+1} = F\xi_t + v_{t+1}$$
$$y_t = H\xi_t + w_{t}$$
...
0
votes
0answers
25 views
How do I tell if the sensors that feed a Kalman filter has diverged?
I have a time varying variable $x$ that I want to estimate. I have two sensors A and B that measure $x$. I feed their measurements to a Kalman filter.
Sometimes, one of the sensors degrades for a ...
2
votes
0answers
24 views
State space estimation with state dependent state variance
I am estimating a state space of the following form
$$Y_t= A X_t + \epsilon_t$$
$$X_{t+1} = B X_{t} + \sigma \sqrt{( a-X_t)(X_t-b)} \eta_t$$
Considering the variance of the state error is state ...
0
votes
0answers
31 views
Kalman filter on stock sentiment time series
I was wondering if & how I can use a Kalman filter on my dataset which contains closing prices of stocks + sentiment scores of tweets about that stock for each day in a timeframe of 1 month.
e.g....
0
votes
0answers
71 views
DLM regression with parameter restriction
Good afternoon,
I am attempting to fit a state space regression model of the form:
$Y_{t} = \beta_{1}Y_{t-1} + (1-\beta_{1})[i^* + \beta_{2}X_{t}] + \epsilon_{1,t}$
$i^* = i^*_{t-1} + \epsilon_{2,t}...
1
vote
1answer
61 views
Parameter estimation in Dynamic Linear Models
I am currently developing a DLM of the following form
$$\underset{k \times 1} {y_t} = \underset{k \times n}A \underset{n \times 1}{\theta_t} + \epsilon_t$$
$$\theta_t = \mu + \underset{n \times n}B\...
0
votes
0answers
17 views
Smoothing detected vehicle positions from camera given my own vehicle's location, velocity and acceleration
I have a dashcam which detects the position and estimated depth of other vehicles on the road relative to my own. Given my own vehicle's global co-ordinates, I can convert the detected vehicle's ...
0
votes
0answers
155 views
Kalman Filter with MLE giving bad estimates
I am trying to learn and implement the Kalman filter. Yesterday I successfully implemented a non linear kalman filter of the form:
$$
x_t = a(x_{t-1}) + u_t \\
y_t = Gy_{t-1} + v_t
$$
$u_t$ and $v_t$...
0
votes
0answers
38 views
Kalman/HMM for (short) multivariate time series from a sample with missing values
The problem in short:
I want to estimate (?) a lag-1 Markovian hidden process for offline multi-variate discrete-time time series with continuous distributions via smoothing, with no dimensionality ...
0
votes
0answers
22 views
Calculating travel distance from GPS updates
I am learning about Kalman filters but struggle to apply them for the following problem: tracking the distance traveled from GPS data. The GPS provides position updates every second and an estimate of ...
0
votes
0answers
258 views
Statsmodels Kalman Filter: simple equivalent to pykalman set up (partly answered)
Following some examples on Chad Fulton's blog and in statsmodels' tests,
I have tried to come up with an equivalent of a pykalman implementation.
The original question was deemed unclear and was ...
2
votes
0answers
72 views
What is the difference between using a Kalman filter and just recursively applying the Bayes rule as new data comes in?
I'm having a hard time wrapping my head around the Kalman filter: Is it just Bayes rule applied over and over with each new measurement? Or is there more to it?
1
vote
0answers
86 views
Multilevel dynamic linear models in R
I am interested in fitting a multilevel bayesian structural time series with a hierarchical structure of the dynamic regression coefficients. The reason I want to do this is is that I have a number of ...
0
votes
0answers
26 views
Covariance matrix for a 2D state vector
I'm performing Optimal Interpolation (which in fact is a simplified Kalman filter with constant $\mathbf{K}$). My state variable is a 2D concentration field with a size of 370 x 400 on which I try to ...
0
votes
1answer
36 views
Custom Space State model using DLM in R
DLM package in R can model linear space state models of the form:
I have a different category of equation which is also a linear polynomial equation of order 1 with constant coefficients. I would ...
0
votes
0answers
37 views
Parameters estimation using Kalman filter
I have a model like this:
$$P_t=\alpha_t+gP_{t-1}+u_t$$
$$\alpha_t=\alpha_{t-1}+d+n_t$$
Where {$u_t$} and {$n_t$} are normal, iid with 0 mean but unknown variance.
I want to estimate the parameters $...
0
votes
0answers
50 views
Updating the kalman filter and RTS with multiple measurements at each time step
I am currently working with kalman filter in area of target tracking. The sensor we are using gets me multiple measurements at each time step. Number of measurements is not fixed, meaning that in one ...
0
votes
0answers
49 views
Noise reduction with known noise distribution
I have a time signal with a known noise distribution parameters (gaussian, sd is known). I would like to estimate the true value statistically and in the best case obtain a confidence interval.
As I ...
1
vote
1answer
35 views
Kalman filter-ish model, is this identifiable?
Time series of observations $y_t$. The proposed model is that there's unobservable scalar series $x_t$:
$$x_t=\phi x_{t-1}+B_tu_t+w_t$$
where $u_t$ - vector predictirs and $w_t$ - noise.
Then there's ...
1
vote
1answer
34 views
In a LGSSM how do we know that the prediction distribution is Gaussian?
I am trying to follow lecture notes regarding the Kalman Filter from a course taught at Stanford. The lecture notes can be found here.
The linear Gaussian state space model (LGSSM) is introduced as
...
1
vote
0answers
46 views
Time varying representation of Okun's law
I've estimated a dynamic linear model to capture time varying parameters in an Okun's law type of model:
I set the starting values for the state vector all equal to zero and estimate the system ...
0
votes
0answers
33 views
Auto.arima differencing order test for the model with external regressors
Suppose that we have a regression model with ARIMA errors. We need to determine the appropriate level of differencing, so that the errors from the regression are actually stationary. In Hyndman's <...
0
votes
1answer
42 views
Observation Operator - Data Assimilation
In data assimilation, one assumes the existence of a observation operator $\mathcal{H}$ that maps the model-state vector $\bf{x_b}$ to $
\bf{y_b}$ (the model-equivalent of the observations $\bf{y_o}$) ...
0
votes
0answers
41 views
Fixed-Delay Kalman smoother with/without augmented measurements
There are several algorithms regarding fixed-lag Kalman smoothing.
In most cases, an augmented state vector is defined in which the elements are the current and delays of the original state vector.
...
0
votes
1answer
52 views
Is a Kalman filter ever the optimal way to estimate a dynamic value given a full history of measurements?
I'm trying to get some intuition for Kalman filtering, and I conceived this toy example:
Say that I have a sensor that tracks a moving 1-dimensional target. Say that the measurements from the sensor ...
