Questions tagged [sequential-monte-carlo]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
15 views

Sequence analysis - adding a time vector

I'm currently attempting to define a Markov chain technique for producing high-resolution synthetic activity sequences. I'm using time-use data with a resolution of 10 minutes. According to the ...
  • 111
1 vote
0 answers
31 views

Computing mean of filtering and smoothing distributions from a particle filter

Suppose I have a model with latent states $x_1, x_2, \ldots x_T$ and observations $y_1, y_2, \ldots y_T$. I run a sequential monte carlo algorithm to give me the following approximation to $p(x_{1:T} |...
0 votes
0 answers
23 views

Is there a Sequential Gaussian Simulation that uses Ordinary Kriging?

As far as I have read, Sequential Gaussian Simulation always uses Simple Kriging. Is there any chance that it uses Ordinary Kriging?
  • 11
0 votes
1 answer
77 views

Sequential recommendation: how to effective encoding output item?

Now I am learning about sequential recommendation - session based recommendation. I have understood that User-item interactions may be viewed as sequential action (first I clicked item A, then click ...
  • 150
0 votes
0 answers
38 views

ABC-SMC, how to obtain summary statistics

I'm using the package pyABC which implements the ABC-SMC algorithm. My model is described by fewer than 10 parameters. I run the code with $N=50$ particles and stop the process after a maximum run ...
  • 3,348
0 votes
1 answer
51 views

Particle Filter Derivation based on Forward Algorithm

I have been studying the particle filter, sequential monte carlo methods, and sequential importance sampling. I am interested in apply the particle filter equations to the standard forward algorithm: $...
  • 217
3 votes
1 answer
66 views

SMC Samplers - Optimal Backward Kernel Explanation

In Sequential Monte Carlo Samplers of Del Moral (2006) we see that the optimal backward kernel is $$ L_{n-1}^{\text{opt}} (x_{n-1} \mid x_n) = \frac{\eta_{n-1}(x_{n-1}) K_n(x_n \mid x_{n-1})}{\eta_n(...
1 vote
0 answers
76 views

How does Particle Filters work?

I'm trying to figure out how particle filter works. Assume that I have selected propability function called $a \sim Gauss(\mu, \sigma)$. We call it proposial (Gaussian) Distribution. Then we have ...
  • 173
0 votes
0 answers
32 views

Do I need to know the distribution of the noise before I'm using Monte Carlo Sampling?

I'm going to use Particle Filter, which is a Monte Carlo Sampling. My simple question is: Do I need to know the distribution of the noise before I'm using Monte Carlo Sampling? Or can I just use a ...
  • 173
0 votes
0 answers
38 views

Importance sampling and Metropolis MC

I am evaluating numerically integral $$I(\theta) = \int_{-\infty}^{+\infty} dx_1 dx_2 dx_3 dx_4 \int_0^{+\infty} dy_1 dy_2 dy_3 dy_4 \prod_{k=0}^4\left[w_n(x_k)w_e(y_k)\right]F(x_1, x_2, x_3, x_4, y_1,...
  • 1,660
3 votes
1 answer
118 views

Help understanding the proof that Monte Carlo methods that the expectation of $R$ samples is the expectation of the function

The above proof I got from UofT's CS412 lecture slides. So I have a few questions regarding this notation that I don't understand is $x \sim p(\{x^{(r)}\}^R_{r=1})$ supposed to represent $R$ number ...
0 votes
0 answers
46 views

Monte Carlo probability approximation vs Histogram

I am trying to learn the sequential Monte Carlo method (particle filter) in data assimilation. In this method, the aim is to approximate the CDF of the target variable having a random sample of the ...
1 vote
0 answers
135 views

Calculating the weights in ABC SMC (2 parameters and more)

Im trying to implement ABC SMC for ODE model which has 2 parameters to estimate. I stopped in the step when calculating the weights as it appear in this answer. My question is should I calculate the ...
  • 11
2 votes
0 answers
52 views

Particle Filter for structural credit risk model

Kwon (2012)* proposes a structural credit risk model where the asset value process and the noise are estimated based on the observed equity prices: $S$ - equity prices $V$ - value of the assets $Z$ - ...
0 votes
0 answers
39 views

Use of the inversion method in sequential sampling to "invert" a random walk

Let $M\subseteq\mathbb R^3$ be Borel measurable, $\lambda$ be a $\sigma$-finite measure on $\mathcal B(M)$, $k\in\mathbb N$, $I:=\{0,\ldots,k\}$, $q$ be a probability density on $\left(E^I,{\mathcal E}...
  • 539
1 vote
0 answers
97 views

ABC SMC: How do weights scale proportionally with number of parameters

Having some problems with the ABC SMC algorithm. I'm trying to implement the methods taken from here: Simulation-based model selection for dynamical systems in systems and population biology How do ...
  • 11
1 vote
1 answer
71 views

Predictions after SMC

I have a statistical model given by $$ y_t\sim p(y_t|x_t, \theta)\\ x_t\sim p(x_t|x_{t-1},\theta)\\ \theta\sim p(\theta) $$ where $y$ is the only observed component. Using a sequential Monte Carlo ...
  • 195
1 vote
0 answers
173 views

Posterior as prior for correlated parameters [closed]

I want to use the posterior distribution of the model parameters $\theta$ given data in the time frame $[0,t]$ days, $P(\theta|y_{0:t})$; as a prior for the parameters in the time frame $[t+1, t+n]$ ...
  • 41
2 votes
1 answer
218 views

sequential Monte Carlo sampler, why the extended space and backward kernel?

Hello cross validated, I am currently studying sequential Monte Carlo samplers. My current understanding is as follows: We are interested in the marginal distribution of some sequence of joint ...
  • 2,141
2 votes
1 answer
168 views

Kernel for MCMC moves in sequential monte carlo

I'm trying to understand how to employ MCMC moves in a sequential Monte Carlo procedure for estimating static parameters as in the setting described by Chopin. He proposes, for example, the usage of a ...
3 votes
1 answer
888 views

Why is it necessary to perform resampling step in particle filtering (or sequential monte carlo)?

I read the Wikipedia page on particle filter, it says that during 'prediction-updating', the samples from the distribution are weighted by a likelihood that represents the probability of that particle ...
  • 388
0 votes
0 answers
157 views

Sequential monte carlo : A simple example

I am attempting to understand how to implement the sequential monte carlo algorithm using this article. Here are the steps that the author proposes: Example problem: Say I have a self moving robot ...
  • 101
1 vote
1 answer
167 views

Particle filter - expectations

I've recently been implementing some particle filter algorithms and I've realized there is a small detail I might have been doing incorrectly. Unfortunately the descriptions of the algorithms in ...
0 votes
1 answer
245 views

Sequential monte carlo, resampling

In particle filters when one is doing sequential importance sampling, the quantity of interest that is being approximated is usually a weighted sum: $$\hat x_t = \sum_{i=1}^M \Bigl [f(v^{(i)}_{t}) \...
2 votes
1 answer
150 views

Are the Sequential Monte Carlo algorithm invariant to the step at which we resample?

In a usual textual description (according to SMC in Practice book ) of a SMC algorithm for State-Space models, we usually expand the particles according to the distribution from the transition ...
-1 votes
2 answers
68 views

Variance of a mixture of Normals with same $\sigma^2_i$

Let $Y\sim \sum^N_{i=1}\omega_iN(m_i,h^2 V)$. The text I'm reading states that $Var(Y)=(1+h^2)V$, when $m_i=\theta_i$, where $\theta_i$ are draws taken from $P(\theta|D)$, and $V=Var(\theta|D)$ I ...
2 votes
2 answers
149 views

A doubt on the formula for updating the weights in Sequential Importance Sampling in a State-Space model

Let $x_{0:t}^{(i)}$ be the states from time $0$ to $t$ from sample $i$. Similarly for the observations $y_{1:t}$. The normalized weights are updated according to Where does the term $p(y_t|x_t^{(i)})...
3 votes
1 answer
100 views

SIR explanation in Robert and Casella Intro to Monte Carlo Methods - How to do this derivation?

Why is it an exact simulation from $f$, and not only an approximation? I get $\begin{split} P(X^*\in A) & = \sum_i^n P(X^*\in A , X^* = X_i)=\sum_i^n P(X^*\in A | X^* = X_i)P(X^* = X_i) \\ & ...
3 votes
1 answer
240 views

Importance weight of conditioned particle in conditional SMC

In a generic particle filter, I understand the importance weights for each particle are calculated as $w_t^s \propto w_{t-1}^s \frac{p(y_t \mid z_t^s) p(z_t^s \mid z_{t-1}^s)}{q(z_t^s \mid z_{t-1}^s, ...
4 votes
2 answers
2k views

Understanding Sequential Importance Sampling and Particle Filtering

I am struggling with SIS for particle filtering in the following aspect: In particle filtering (as per this book), the objective is to estimate the full posterior $p( x_{0:k} \mid y_{1:k} )$ rather ...
  • 111
3 votes
0 answers
67 views

Soft Question: What background do I need to understand Feynmann Kac Formulae by Pierre Del Moral?

I am attempting to understand Sequential Monte Carlo(SMC) deeply, but with little theoretical background on probability theory and stochastic processes. Usually, the 'statistics' perspective of markov ...
0 votes
2 answers
1k views

How do I calculate the weights in ABC-SMC

I have been reading through the Tutorial on ABC rejection and ABC SMC for parameter estimation and model selection by Tina Toni and Michael P. H. Stumpf. I can't work out how to calculate the weights ...
11 votes
1 answer
2k views

Rao-Blackwellization of sequential Monte Carlo filters

In the seminal paper "Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks" by A. Doucet et. al. a sequential monte carlo filter (particle filter) is proposed, which makes use of a ...
  • 281