Tagged Questions

The autoregressive (AR) model is a stochastic process modelling time series, which specifies the value of the series linearly in terms of the previous values.

learn more… | top users | synonyms

1
vote
1answer
18 views

How to construct appropriately reverting geometric AR(1) process?

Suppose I have a mean-reverting AR(1) type process, $X_{t+1} = X_t + \theta(\mu - X_t) + \epsilon_t$ where $\theta > 0 $ and $\mathrm{Var}(\epsilon_t) = \sigma^2$. This process is clearly ...
1
vote
1answer
37 views

Stochastic Volatility Model

In Kim et al. (1998) stochastic volatility model is specified as: $y_t=\beta\exp({\frac{h_t}{2}})\varepsilon_t,\quad t\geqslant1$ $h_{t+1}=\mu+\phi(h_t-\mu)+\sigma_\eta\eta_t$ $h_1\sim ...
1
vote
0answers
31 views

The inverse of AR correlation matrix

I want to find the inverse of the following matrix: $$ R_{k-1}=\begin{pmatrix} 1 &\rho &\rho^2 &\cdots &\rho^{k-2} \\ \rho &1 &\rho &\cdots ...
0
votes
0answers
9 views

On the derivation of the closed form Yule-Walker moment estimator of a GARCH(1,1). (exercise)

The exercise states: (Yule-Walker estimator) GARCH models are typically estimated by a numerical implementation of maximum likelihood methods. This procedure has the disadvantage that it does ...
2
votes
1answer
46 views

Proving for an AR(2) process that $E[X_t | F_{t-1}]=E[X_t | F_{t-2}]=E[X_t | F_{t-3}]$

An exercise states: Using the law of iterated expectations applied to an AR(2) process, verify that $E_{t−k} . . . E_{t−1} (X_t ) = E(X_t |F_{t−k} ) $ for $ k = 1, 2, 3 $ where $ E_{t−k} (X_t ) = ...
2
votes
1answer
49 views

How to build a function with the result of auto.arima in R?

I use: fit = auto.arima(Y, xreg=X) in R to get ARIMA(1,0,0), result as follows: ...
3
votes
2answers
93 views

How to write an AR(2) stationary process in the Wold representation

I managed to write an AR(1) process in the Wold representation with help from the geometric series. I am having trouble with a stationary AR(2). How could I do?
1
vote
0answers
16 views

Predicting dropout in an ordered process: Cox regression, autoregressive model, multilevel modeling?

I am working on a project in which I collected data about 100 people’s steps in an ordered process. All took at least one step, with some continuing up to a fourth step. Each person either drops out ...
1
vote
0answers
15 views

What is the “scale” parameter in “continuous autoregressive model” in cts package?

I am trying to use the "car" command in "cts package" in R program and I see the "scale" parameter there. I wonder whether this can be assumed to be equivalent to time intervals for time series ...
0
votes
0answers
15 views

AR models on non stationary data

i am currently reading Diebold and Li's 2006 paper: Forecasting the term structure of government yields where the authors fit, albeit simple, AR(1) models on clearly non stationary data. Why is this ...
3
votes
1answer
121 views

Doubts in linear regression

If a linear regression model has a constant term say 1 or 0.2, for example if the original model is $y(t) = 0.2 + ay(t-1) $, then what does this constant term imply? Will it hamper the estimates if ...
4
votes
1answer
87 views

Are Auto-Associative Regression Trees Distinct from Auto-Regressive Trees?

After some reading in the field I was confused as to whether these two models are distinct or really the same. I'm just looking for a simple yes/no with a brief explanation. Note that ...
1
vote
0answers
40 views

Handling overflow warnings in pymc

Abstract I am getting numerical overflow warnings in pymc that are stalling the sampler. I'll first specify what the context is then ask more directed questions about the solution. The context ...
0
votes
0answers
31 views

Autoregressive model with input variables in proc arima procedure

I am currently working on the time series analysis for series Y but I have to use other two variable A and B as an input variable in SAS proc arima procedure. But I am unable to interpret the cross ...
0
votes
0answers
62 views

Problem simulating AR and MA models using filters

I do not know how to use filter to simulate AR and MA models. To me it looks the same way for both MA and AR Estimate AR so then how do I know that the model is AR or MA ? For example, Problem1: For ...
1
vote
1answer
36 views

Whitening a regression with an AR process

I was reading a research paper: $Y_{t}\text{=}\beta_{0}+\beta_{1}X_{1t}+\beta_{2}X_{2t}$ (where $Y_{t}$ is stock returns and not the change in stock returns) ($X{}_{1t}$ is the return of a stock ...
4
votes
1answer
201 views

Is there a convenient form for this large covariance matrix?

Consider the following bivariate vector autoregression: $$X_t=\mu +X_{t-1}A+\varepsilon_t,\ \varepsilon_t \overset{iid}{\sim} MVN(0, V),\ X_t=(X_{1,t},X_{2,t})',$$ where the assumptions on the ...
1
vote
1answer
19 views

Reference requested for Moving Average model

I am not from econometrics background and hence not familiar with text books which may contain a large moving average and an auto regressive model. I have found AR model from Simon Haykin's Adaptive ...
1
vote
1answer
72 views

Multivariate model and large regression

I am not familiar with the concept of multivariate model and just learning about regression model. I am familiar with Autoregressive model and Moving Average. Multivariate regression model provided ...
0
votes
0answers
12 views

Do AR models with GARCH errors have a positive spectral density?

Can someone please help me to verify that AR models with GARCH errors have a positive spectral density and are bounded?
4
votes
0answers
53 views

Determining parameters in AR model for non-stationary time series

I am currently trying to fit an AR model to some financial data. The time series $Y_t$ in levels is clearly non-stationary; however it appears the first differences $dY_t$ are stationary (and this is ...
4
votes
2answers
193 views

Steps to perform time series analysis

I'm trying estimate an autoregressive model with an exogenous variable. It's about the impact of changes in oil prices on the economy. I'm planning on regressing gdp growth rate on its own lagged ...
1
vote
1answer
38 views

Geographic regression

I'm working on a project to estimate real estate and started with some classique techniques, such as linear regression etc. The obtained results are already going in the good direction, but to get ...
0
votes
1answer
54 views

Spatially auto-regressive two-stage model

I'm working on a project in which I use a 'Generalized Spatial Two-Stage Least Squares' model, mostly known as $y= X \beta + \lambda W y + u$ and $u = \rho M u + \epsilon_n$ where $y$ and $u$ are ...
1
vote
2answers
129 views

Mean reversion in AR(1) process

Mean reverting level in following AR(1) process is $b/(1-a)$. $$x(t) = a + bx(t-1).$$ I understand this. I read that the mean reverting level for AR(1) process given below with finite differencing ...
2
votes
1answer
84 views

Practical issues with dynamic panel data modeling

Unfortunately for me, I've got a situation where I need to control for the lag of a dependent variable as a robustness check against an alternative interpretation of my main regression. The baseline ...
3
votes
3answers
151 views

Under what circumstances is an MA process or AR process appropriate?

I have a very basic question. Please let me know if this has been asked before, but in my defence I haven't seen it on Cross Validated. I understand that if a process depends on previous values of ...
2
votes
0answers
22 views

Methods for measuring snowball effects in a “complete” longitudinal dataset

I'm looking for ways to test for "cumulative advantage" effects in a longitudinal dataset (see image) I guess the data set is principally similar to this: http://www.caldercenter.org/whatis.cfm , ...
0
votes
1answer
61 views

Is the Moving Average of ARMA the same of Moving Average of Stock Market?

I'm studying time series prediction and I have some questions. Is the Moving Averages movel studied the methods of the ARMA family has the same concept as the methods studied in Moving Averages ...
0
votes
0answers
22 views

How do you calculate standard error in a Dickey-Fuller test?

So in everything I've found, they tell you have to calculate $\rho$, or how to test for confidence interval for it. What I am trying to figure out is how to calculate the SE which would get us our ...
1
vote
1answer
42 views

Predicting time series with OpenBUGS

I have a number of fairly short time series (about 4–100 observations) which I need to forecast into the future. I decided to use Bayesian inference, because there is external information about each ...
1
vote
0answers
73 views

How can I correct for residual autocorrelation in a fixed effect panel model?

The residuals have an AR(2) structure. Is it appropriate to add AR terms to a fixed-effects panel model?
2
votes
1answer
78 views

calculating the expected value and variance of a log AR(1) process

I have an AR(1) process that looks like this: $$ \ln(g_t) = (1 - \rho_g)(\ln(\mu_g) - c) + \rho_g\ln(g_{t-1}) + \epsilon^g_t $$ where $|\rho_g| < 1$, $\epsilon^g_t \sim N(0, \sigma^2_g)$, and ...
1
vote
1answer
130 views

R fit restricted AR(p) model

I have a question about using R to fit an AR model. If we want fit a AR(p) model, the equation will be $Y_t = φ_1Y_{t-1} + φ_2Y_{t-2} + ... + φ_pY_{t-p} + Z_t$. What about I only want to fit the model ...
2
votes
1answer
151 views

Fit a moving average (MA) time series model to the data (R:stats::ar equivalent)

I am looking for some tools for automatic fitting of moving average (MA) time series model to my data in R. I know R:stats::ar ...
0
votes
0answers
13 views

Why must the solutions of the characteristic equation be greater than 1 for an Auto-regressive model to be stationary?

According to my notes, stationarity occurs if: All the solutions of the characteristic equation of the $AR(P)$, $1-\phi_1X-\phi_2X^2-...-\phi_PX^P=0$, are greater than 1 in modulus. No ...
1
vote
1answer
75 views

How to interpret the expression of MA(1) as AR($\infty$)

When AR(1) is expressed as MA($\infty$), I can interpret it as: let's say my wage this year depends only on last year's wage and a random shock (my boss' mood). But last year's wage also depends on ...
0
votes
1answer
117 views

Determining order of AR model

Suppose that we have the following model $$ y[t] = A_1\sin(\omega_1 t+\phi_1)+A_2\sin(\omega_2 t + \phi_2)+ \cdots + A_p \sin(\omega_pt + \phi_p) + z(t) . $$ Let us call this signal as B. Then in ...
2
votes
1answer
58 views

What does “AR(p) filtered series” mean?

I guess this means that omitting some variables in a certain interval, say, $(x_1, x_2, x_3, x_4, x_5) \to (x_1, x_5)$ in AR(4) model. Is it right? Or does this means eliminating autocorrelations ...
3
votes
2answers
163 views

Differencing a time series

I am looking to find the ACF of a time series, but after it is differenced. $y_t = a_1y_{t-1} + \epsilon_t , \mid a_1 \mid < 1$ I understand that to find the ACF this process needs to be ...
1
vote
0answers
24 views

AR(2) simulation problem

Take covariances $Cov[X_{t-2},X_{t}]$, $Cov[X_{t-1},X_{t}]$ and $Cov[X_t,X_t]=Var[X_t]$ and calculate the parameters for the AR(2) process ($a_1$, $a_2$ and $\sigma^2$ (the variance of the error ...
2
votes
0answers
62 views

How to interpret the characteristic roots of moment equation of a AR(2) model?

I am learning the financial time series using the book 'Analysis of financial time series' by Ruey Tsay. In chapter 2, they introduced AR(2) models. The moment equation (which is the function between ...
2
votes
0answers
45 views

Autoregressive Markov chain simulation and the likelihood ratio test for Markov property

I am trying to estimate a Markov chain of second order (Markov chain that fulfills $P[X_t|X_{t-1},X_{t-2}]=P[X_t|X_{t-1},X_{t-2},...,X_{t-p}]$) using an AR(2) process. Once I have simulated the ...
4
votes
0answers
152 views

How to fit log-linear poisson autoregressive mixed model?

I have time-series count data $N_{i,j}$ (population sizes in site $i$ and year $j$) and I want to correlate year-to-year changes with the environmental conditions $x_{i,j}$. For this, I want to fit ...
0
votes
0answers
123 views

ARDL, Lag Terms and Singularity

I am interested in fitting an ARDL model that has 4 lags for each explanatory variable. However, when I fitting the model in R. R says that coefficients are not defined because of singularities. Is ...
4
votes
0answers
62 views

Computing Standard Errors in EM algorithm

I'm applying the EM to a hidden markov chain (the $\mathbf{Z}=\{Z_1,...,Z_n\}$ variable), with observations(the $\mathbf{Y}=\{Y_0,...,Y_n\}$ variable) dependent not only on the hidden markov chain, ...
2
votes
1answer
32 views

Mixture of normals, dependent on past

I have the following probability model: $(X_k|\text{PastHistory}_{k-1}, \theta_0,\theta_1,\theta_2) \sim (\pi\cdot N(\theta_1+\theta_0\cdot X_{k-1},1)+(1-\pi)\cdot N(\theta_2+\theta_0\cdot ...
0
votes
1answer
137 views

Conditional expectation in AR(1) process

Suppose we have a stationary AR(1) process: $Y_{t+1}=a+ \rho Y_{t} + \epsilon_{t+1}$ where $\epsilon_{t+1}$ is white noise with probability density function $\phi(.)$. Now say we have a equation ...
1
vote
0answers
84 views

Fit Negbin glm model with autoregressive correlation structure

I am attempting to estimate the effect of various variables on the time-series of counts of reported cattle stillbirths. We investigate the effect of day-of-week, month, holidays etc…and also the ...
0
votes
0answers
41 views

Vector autoregression with gradient descent

I am no expert in statistics, but I have been asked to implement a VAR model using gradient descent in R. I have written a code that, from what I have been told, it makes sense. However, the estimated ...