Questions tagged [autoregressive]

The autoregressive (AR) model is a stochastic process modelling time series, which specifies the value of the series linearly in terms of the previous values.

Filter by
Sorted by
Tagged with
10
votes
1answer
1k views

Modelling auto-correlated binary time series

What are the usual approach to modelling binary time series? Is there a paper or a text book where this is treated? I think of a binary process with strong auto-correlation. Something like the sign of ...
11
votes
3answers
11k views

Why is OLS estimator of AR(1) coefficient biased?

I am trying to understand why OLS gives a biased estimator of an AR(1) process. Consider $$ \begin{aligned} y_{t} &= \alpha + \beta y_{t-1} + \epsilon_{t}, \\ \epsilon_{t} &\stackrel{iid}{\...
6
votes
2answers
3k views

Estimation of unit-root AR(1) model with OLS

Given a random walk $x_t$, $$x_t=x_{t-1}+\varepsilon_t,$$ consider estimating the slope coefficient $\beta$ in $$x_t=\beta x_{t-1}+\varepsilon_t$$ by OLS. This question and the following answer ...
6
votes
2answers
8k views

Auto-regression versus linear regression of x(t)-with-t for modelling time series

What difference precisely does autoregression (for AR(p), p=1,2,...) have when compared to linear regression of that time series random variable w.r.t time axis? Explanation with diagrams clarifying ...
3
votes
1answer
440 views

Conceptual questions: Variance of a process

Wikepedia, at Variance of Autoregressive model, mentions an expression of variance for an AR(1) process. I am learning signal processing (beginner level) and facing difficulty in understanding some ...
14
votes
3answers
20k views

How does ACF & PACF identify the order of MA and AR terms?

It's been more than 2 years that I am working on different time series. I have read on many articles that ACF is used to identify order of MA term, and PACF for AR. There is a thumb rule that for MA, ...
6
votes
2answers
10k views

How to write an AR(2) stationary process in the Wold representation

I managed to write an AR(1) process in the Wold representation with help from the geometric series. I am having trouble with a stationary AR(2). How could I do?
6
votes
1answer
10k views

AR(1) coefficient is correlation?

Is the ar1 coefficient from an AR(1) model the "first order correlation of the noise" of a time series? I'm using R's aws package and one of the arguments of the <...
6
votes
1answer
513 views

The distribution of the initial point of an AR process

Consider a stochastic process $\{X_t, t = 1, 2, \ldots\}$ following the model $$X_t = \alpha X_{t-1} + e_t,$$ where $e_t \thicksim f$. Can I say that the distribution of the initial point, $X_1$, ...
4
votes
1answer
2k views

How to build a function with the result of auto.arima in R?

I use: fit = auto.arima(Y, xreg=X) in R to get ARIMA(1,0,0), result as follows: ...
1
vote
1answer
132 views

Superposition of random walk and autoregressive process

Let us consider the following model: $$ y_{t} = c_{t} + \alpha y_{t-1} + v_{t} \\ c_{t+1} = c_{t} + w_{t} $$ where $v_{t} \in \mathcal{N}(0, \sigma^{2}_{v})$ and $w_{t} \in \mathcal{N}(0, \sigma^{2}...
32
votes
1answer
16k views

How to understand SARIMAX intuitively?

I'm trying to understand a paper about electric load forecasting but I'm struggling with the concepts inside, specially the SARIMAX model. This model is used to the predict the load and uses many ...
21
votes
4answers
32k views

Under what circumstances is an MA process or AR process appropriate?

I understand that if a process depends on previous values of itself, then it is an AR process. If it depends on previous errors, then it is an MA process. When would one of either of these two ...
5
votes
1answer
11k views

Simulate AR(1) process in R with specified nonzero mean and AR coefficient [closed]

I need to simulate an AR(1) process with the following equation in R: $$ X_{t} = 5 + 0.5X_{t-1}+Z_t $$ Where $Z_t$ ~ White Noise(0,1) and $T=500$. I know I should be using the ...
4
votes
2answers
1k views

Cross correlation influenced by self auto correlation

I have two stationary time series ts1, ts2, I wanna find the cross correlation ($\textrm{CCF}$) between them. As a result, it ...
3
votes
2answers
2k views

What's wrong if I fit the auto-regression with OLS?

I am doing auto-regress by usual linear regression package. e.g. $y_t=φx+ε_t$ with $x =y_{t-1}$ My reason is that, Auto-regression does assumes iid errors, same for linear regression. Linear ...
1
vote
2answers
5k views

What is the difference between AR and VAR?

What is the exact difference between an autoregressive (AR) and vector autoregressive model (VAR)? I always thought that VAR would just be for more than two variables, until I learned that AR can ...
0
votes
1answer
484 views

Auto regressive process, maximum likelihood estimator

A first-order autoregressive process, $X_0,\dots,X_n$, is given through the following conditional distributions: $X_i | X_{i-1},\dots,X_0 \sim \mathcal{N}(\alpha X_{i-1},1)$, for $i = 1,2,\dots,n$ and ...
5
votes
1answer
340 views

Generate a random variable which follow Gamma distribution and AR(1) process simulatenously

Is it possible to generate numbers from Gamma distribution (with parameters shape=10, scale=15, say) which also follow a AR(1) process, simultaneously? If it's possible, than how to do that?
1
vote
2answers
843 views

AR(1) forecasting

So I have a small question about forecasting using an AR(1) model. I have $Y_t=4-0.6Y_{t-1}+e_t$ with {$e_t$} as W.N. with $\sigma^2_e=2$ I am asked to forecast $\hat{Y_t}(1)$ for which I am using ...
1
vote
0answers
142 views

Skipping lags in autoregressive modeling?

is it possible to skip immediately preceding time points? So that, if, for example, you are using model order 2, that is, two time points, but not the two immediately previous time points, but rather, ...
17
votes
1answer
1k views

If an auto-regressive time series model is non-linear, does it still require stationarity?

Thinking about using recurrent neural networks for time series forecasting. They basically implement a sort of generalized non-linear auto-regression, compared to ARMA and ARIMA models which use ...
14
votes
1answer
3k views

Why do we care if an MA process is invertible?

I am having trouble understanding why we care if an MA process is invertible or not. Please correct me if I'm wrong, but I can understand why we care whether or not an AR process is causal, ie if we ...
11
votes
2answers
1k views

Unbiased estimator for AR($p$) model

Consider an AR($p$) model (assuming zero mean for simplicity): $$ x_t = \varphi_1 x_{t-1} + \dotsc + \varphi_p x_{t-p} + \varepsilon_t $$ The OLS estimator (equivalent to the conditional maximum ...
10
votes
2answers
5k views

Random walk estimation with AR(1)

When I estimate a random walk with an AR(1), the coefficient is very close to 1 but always less. What is the math reason that the coefficient is not greater than one?
10
votes
1answer
11k views

Random Forest regression for time series prediction

I'm attempting to utilise RF regression to make predictions on the performance of a paper mill. I have minute by minute data for the inputs (rate and amount of wood pulp going in etc...) as well as ...
6
votes
2answers
3k views

Poisson with an autoregressive term

I want to fit a fairly "standard" Poisson model, but with an autoregressive term. $N_i \sim \mathrm{Pois}( \lambda_i E_i)$ with $\log \lambda_i = X_i \beta + \delta$ $\delta \sim AR(1)$ $X_i$ is a ...
4
votes
2answers
3k views

Steps to perform time series analysis

I'm trying estimate an autoregressive model with an exogenous variable. It's about the impact of changes in oil prices on the economy. I'm planning on regressing gdp growth rate on its own lagged ...
6
votes
2answers
3k views

What is the reason for not including an intercept term in AR and ARMA models?

In econometric literature it is usually argued that in case of estimating an equation, an intercept term must be always included regardless of its statistical importance because removing the constant ...
4
votes
1answer
6k views

How to write variance covariance matrix of AR(1) process in R

I'm trying to write autocovariance matrix of AR(1) process in R and I'm having difficulty. The autocovariance matrix that I'm using in my project takes the form as shown in the picture: I also ...
2
votes
2answers
4k views

Breusch-Pagan Test for ARIMA Model in R [closed]

I am testing my model using the Breusch-Pagan Test, but have not been able to find anything online regarding how to calculate it for an ARIMA Model. My AR1 Model is: ...
2
votes
0answers
149 views

Can I use OLS to estimate an ARX(1) model? [duplicate]

Is a statistically correct to find the parameters of the model $$ Y_t = \beta_1 Y_{t-1} + \beta_2 X + \epsilon $$ by just using OLS? For example, there won't be any problems with bias of the ...
2
votes
1answer
114 views

Parameters in Autoregressive representation of an ARCH model

Suppose we have a $0$ mean time serie representing stock index returns about a title, $r$. I also know it follows an $ARCH(p)$ model with parameters $\omega$ and $\alpha$, specified in the following ...
2
votes
1answer
1k views

AR.OLS isn't matching to an OLS on the autoregressive lags, Why?

I am using R and running ar.ols() on some data. And trying to compare to a more "manual" method of computing an AR model by doing lm() using the autoregressive lags as my independent variables. ...
2
votes
1answer
739 views

Good Resource For Converting ARIMA output in R to equation form?

I've seen this question asked a few times but I still haven't seen a place where I can get some good examples on how to convert an arima() output in ...
1
vote
1answer
138 views

I understand why stationarity is a requirement for AR(p) models, but why is it necessary for MA(q) models?

I have (or at least I think I have) a good intuition for why stationarity is a requirement for modeling $AR(p)$ models: an $AR(p)$ model with coefficients $a_1,....,a_p$ : $ Y_t = a_1Y_{t-1}+a_2Y_{...
1
vote
1answer
2k views

Auto correlation function of AR(p) process

I am doing a time series course and in the theory part there are few things I don't understand.In obtaining auto correlation function for AR(p) process it is done as: $$\newcommand{\Var}{{\rm Var}}\...
5
votes
1answer
521 views

Why are exponential smoothing models not considered auto-regressive?

I've seen so far two definitions of the term "auto-regressive" model when it comes to time series modeling: The first definition is just basic AR models and their relatives such as ARMA and ARIMA, ...
5
votes
2answers
4k views

Finding variance of AR process

$\newcommand{\E}{\mathbb{E}}$How do I find the variance of an autoregressive AR(1) process $$y_t=\phi y_{t-1}+\varepsilon_{t}$$ where $\lvert {\phi}\rvert<1$ and knowing that $$y_t=\sum_{j=0}^\...
4
votes
0answers
482 views

How to fit log-linear poisson autoregressive mixed model?

I have time-series count data $N_{i,j}$ (population sizes in site $i$ and year $j$) and I want to correlate year-to-year changes with the environmental conditions $x_{i,j}$. For this, I want to fit ...
4
votes
2answers
73 views

Why are we not concerned about the distribution of the $x_t$ in an AR(1) model?

I am trying to investigate the reasons why we don't bother about the distribution of the $x_t$ in an autoregressive model. Why do we concern ourselves about the distribution of $e_t$? And why are ...
4
votes
1answer
5k views

Breusch-Godfrey Test and the length of the lag, p

I'll use Breusch-Godfrey (BG) test to test correlation of an AR(1) model. In order to perform a BG test, the simple regression model is first fitted by ordinary least squares to obtain a set of sample ...
3
votes
4answers
3k views

Time Series for each customer

Is it possible to create Time Series Analysis for each customer? Say if have 100 customers and I wanted to predict how much amount they are going to spend next. I have done the Time Series for the ...
3
votes
2answers
188 views

Variance of sum of AR(2) processes

We have $$y_t = a\mu_t + b\mu_{t-1} + c\mu_{t-2} + d\mu_{t-3}$$ and $\mu$ itself is an AR process, let's assume here an AR(2) $$\mu_t = \phi_1 \mu_{t-1} + \phi_2 \mu_{t-2} + \epsilon_t$$ where $\...
3
votes
1answer
158 views

Are all $AR(p)$ processes for which $|a_1|,…,|a_p| < 1$ stationary?

For an $AR(p)$ process $ Y_t = a_1Y_{t-1}+a_2Y_{t-2}+...+a_qY_{t-q}$ : Is having the coefficients $|a_1|,....,|a_p| < 1$ just a necessary condition for stationarity, or is it sufficient as well?
2
votes
1answer
789 views

Variance of AR(1) process using lag operator

Suppose for the AR(1) model, $$Y_t=\phi_1Y_{t-1}+e_t$$ I want to find the variance $Var(Y_t)$ using lag operator: $$Y_t=(1-\phi_1L)^{-1}e_t$$ My way is simply taking the variance, $$Var(Y_t)=(1-\...
2
votes
1answer
188 views

Unable to calculate the density function for AR

The model is an AR(p) process excited by a white Gaussian noise $\epsilon_t$, \begin{align} Y_t = &c+ \phi_1Y_{t-1} + \phi_2 Y_{t-2}+ \ldots+ \phi_p Y_{t-p} + \epsilon_t\\ \epsilon_t = &\...
1
vote
1answer
496 views

Conceptual Question: Autocorrelation of autoregressive process

An AR(1) process: $X_t = c+\theta X_{t-1} + \epsilon_t$ where $\epsilon_t$ is a zero mean white Gaussian noise. The Autocorrelation matrix is expressed by the formula mentioned in the Wikipedia entry....
1
vote
1answer
939 views

Auto-Regressional & Moving Average Model Formula Properties

I seeking help in understanding specific values underlying the formula's for the MA(p) model & the AR(q) model. I am attempting to implement the models (building up to the combined ARIMA model) in ...
1
vote
0answers
26 views

Is it allowed to reduce a dataset of moving averages to run an AR(1) model properly?

I run a simple AR(1) and AR(2) model with the following code: ar.ols(df$y, order.max = 1) ar.ols(df$y, order.max =2) My dataset is as follows: I do have yearly ...