Skip to main content
added 105 characters in body
Source Link
Ben
  • 132.9k
  • 7
  • 255
  • 588

Much of this answer is copied from an answer I have given in this related question.

If you have data with seasonal effects in it, you would usually fit a model with seasonal terms and then extract residuals from the model as your estimates of the error terms (which the model assumes to be noise). This pushes things back a step, but obviously you still need to test to see if there are any further seasonal effects in the residuals.

One useful formal test for this purpose is the "permutation spectrum test" which tests the maximum signal intensity against its null distribution under the assumption of exchangeability of the values in the signal (see O'Neill 2020). This particular test does not make any assumption about the marginal distribution of the data, so it is not restricted to testing Gaussian time-series. The null hypothesis for the test is that the time-series values are exchangeable and the alternative hypothesis is that there is at least one periodic signal in the time-series. (It may be usefulYou need to remove trends before applying this test, since an linear or polynomial trend in the data may show up in frequency space as low-frequency periodic signal.)


Implementation in R: You can use the ts.extend package in R to produce and plot the signal intensity for a time-series or conduct the permutation-spectrum-test. To show you an example of this, let's first produce a time-series with a periodic component.

#Generate periodic part and random part of time-series
set.seed(1)
n <- 1000
A <- rep(1:20, 50)
E <- rgamma(n, shape = 2, scale = 30)

#Generate time-series with periodic part
a <- 1
X <- a*A + E

It is simple to produce and plot the intensity of the series in the frequency domain to see if there are any "spikes" giving evidence of a periodic component.

#Show intensity of time-series
library(ts.extend)
INTENSITY <- intensity(X, scaled = TRUE)
plot(INTENSITY)

enter image description here

We can see that there are some spikes at particular frequencies in the Fourier domain, but are they big enough to falsify the assumption that this is exchangeable noise? To test this we implement the permutation-spectrum test and produce an appropriate plot. In the present case the test correctly identifies strong evidence that there is at least one signal in the data. (The p-value for the test is $p=0.001385$.)

#Implement the permutation-spectrum test
TEST <- spectrum.test(X)
plot(TEST)
TEST

        Permutation-Spectrum Test

data:  real time-series vector X with 1000 values
maximum scaled intensity = 3.5762, p-value = 0.001385
alternative hypothesis: distribution of time-series vector is not exchangeable 
(at least one periodic signal is present)

enter image description here

Much of this answer is copied from an answer I have given in this related question.

If you have data with seasonal effects in it, you would usually fit a model with seasonal terms and then extract residuals from the model as your estimates of the error terms (which the model assumes to be noise). This pushes things back a step, but obviously you still need to test to see if there are any further seasonal effects in the residuals.

One useful formal test for this purpose is the "permutation spectrum test" which tests the maximum signal intensity against its null distribution under the assumption of exchangeability of the values in the signal (see O'Neill 2020). This particular test does not make any assumption about the marginal distribution of the data, so it is not restricted to testing Gaussian time-series. The null hypothesis for the test is that the time-series values are exchangeable and the alternative hypothesis is that there is at least one periodic signal in the time-series. (It may be useful to remove trends before applying this test.)


Implementation in R: You can use the ts.extend package in R to produce and plot the signal intensity for a time-series or conduct the permutation-spectrum-test. To show you an example of this, let's first produce a time-series with a periodic component.

#Generate periodic part and random part of time-series
set.seed(1)
n <- 1000
A <- rep(1:20, 50)
E <- rgamma(n, shape = 2, scale = 30)

#Generate time-series with periodic part
a <- 1
X <- a*A + E

It is simple to produce and plot the intensity of the series in the frequency domain to see if there are any "spikes" giving evidence of a periodic component.

#Show intensity of time-series
library(ts.extend)
INTENSITY <- intensity(X, scaled = TRUE)
plot(INTENSITY)

enter image description here

We can see that there are some spikes at particular frequencies in the Fourier domain, but are they big enough to falsify the assumption that this is exchangeable noise? To test this we implement the permutation-spectrum test and produce an appropriate plot. In the present case the test correctly identifies strong evidence that there is at least one signal in the data. (The p-value for the test is $p=0.001385$.)

#Implement the permutation-spectrum test
TEST <- spectrum.test(X)
plot(TEST)
TEST

        Permutation-Spectrum Test

data:  real time-series vector X with 1000 values
maximum scaled intensity = 3.5762, p-value = 0.001385
alternative hypothesis: distribution of time-series vector is not exchangeable 
(at least one periodic signal is present)

enter image description here

Much of this answer is copied from an answer I have given in this related question.

If you have data with seasonal effects in it, you would usually fit a model with seasonal terms and then extract residuals from the model as your estimates of the error terms (which the model assumes to be noise). This pushes things back a step, but obviously you still need to test to see if there are any further seasonal effects in the residuals.

One useful formal test for this purpose is the "permutation spectrum test" which tests the maximum signal intensity against its null distribution under the assumption of exchangeability of the values in the signal (see O'Neill 2020). This particular test does not make any assumption about the marginal distribution of the data, so it is not restricted to testing Gaussian time-series. The null hypothesis for the test is that the time-series values are exchangeable and the alternative hypothesis is that there is at least one periodic signal in the time-series. (You need to remove trends before applying this test, since an linear or polynomial trend in the data may show up in frequency space as low-frequency periodic signal.)


Implementation in R: You can use the ts.extend package in R to produce and plot the signal intensity for a time-series or conduct the permutation-spectrum-test. To show you an example of this, let's first produce a time-series with a periodic component.

#Generate periodic part and random part of time-series
set.seed(1)
n <- 1000
A <- rep(1:20, 50)
E <- rgamma(n, shape = 2, scale = 30)

#Generate time-series with periodic part
a <- 1
X <- a*A + E

It is simple to produce and plot the intensity of the series in the frequency domain to see if there are any "spikes" giving evidence of a periodic component.

#Show intensity of time-series
library(ts.extend)
INTENSITY <- intensity(X, scaled = TRUE)
plot(INTENSITY)

enter image description here

We can see that there are some spikes at particular frequencies in the Fourier domain, but are they big enough to falsify the assumption that this is exchangeable noise? To test this we implement the permutation-spectrum test and produce an appropriate plot. In the present case the test correctly identifies strong evidence that there is at least one signal in the data. (The p-value for the test is $p=0.001385$.)

#Implement the permutation-spectrum test
TEST <- spectrum.test(X)
plot(TEST)
TEST

        Permutation-Spectrum Test

data:  real time-series vector X with 1000 values
maximum scaled intensity = 3.5762, p-value = 0.001385
alternative hypothesis: distribution of time-series vector is not exchangeable 
(at least one periodic signal is present)

enter image description here

Source Link
Ben
  • 132.9k
  • 7
  • 255
  • 588

Much of this answer is copied from an answer I have given in this related question.

If you have data with seasonal effects in it, you would usually fit a model with seasonal terms and then extract residuals from the model as your estimates of the error terms (which the model assumes to be noise). This pushes things back a step, but obviously you still need to test to see if there are any further seasonal effects in the residuals.

One useful formal test for this purpose is the "permutation spectrum test" which tests the maximum signal intensity against its null distribution under the assumption of exchangeability of the values in the signal (see O'Neill 2020). This particular test does not make any assumption about the marginal distribution of the data, so it is not restricted to testing Gaussian time-series. The null hypothesis for the test is that the time-series values are exchangeable and the alternative hypothesis is that there is at least one periodic signal in the time-series. (It may be useful to remove trends before applying this test.)


Implementation in R: You can use the ts.extend package in R to produce and plot the signal intensity for a time-series or conduct the permutation-spectrum-test. To show you an example of this, let's first produce a time-series with a periodic component.

#Generate periodic part and random part of time-series
set.seed(1)
n <- 1000
A <- rep(1:20, 50)
E <- rgamma(n, shape = 2, scale = 30)

#Generate time-series with periodic part
a <- 1
X <- a*A + E

It is simple to produce and plot the intensity of the series in the frequency domain to see if there are any "spikes" giving evidence of a periodic component.

#Show intensity of time-series
library(ts.extend)
INTENSITY <- intensity(X, scaled = TRUE)
plot(INTENSITY)

enter image description here

We can see that there are some spikes at particular frequencies in the Fourier domain, but are they big enough to falsify the assumption that this is exchangeable noise? To test this we implement the permutation-spectrum test and produce an appropriate plot. In the present case the test correctly identifies strong evidence that there is at least one signal in the data. (The p-value for the test is $p=0.001385$.)

#Implement the permutation-spectrum test
TEST <- spectrum.test(X)
plot(TEST)
TEST

        Permutation-Spectrum Test

data:  real time-series vector X with 1000 values
maximum scaled intensity = 3.5762, p-value = 0.001385
alternative hypothesis: distribution of time-series vector is not exchangeable 
(at least one periodic signal is present)

enter image description here