Questions tagged [fourier-transform]
The Fourier transform decomposes a signal (a function of time) into frequencies, giving the energy at each frequency.
182
questions
1
vote
0answers
28 views
The length of spectral density is longer than the data using spectrum() in R
I'm using spectrum(method = "pgram") in R to calculate the spectral density in my time series.
spectrum() returns the spectral density for each frequency(from 1/n, 2/n to 1/2, n is the time ...
1
vote
1answer
60 views
Using Fourier Coefficients to approximate a time series
I'm trying to understand approximating periodic functions with Fourier Transforms. I'm using R, but I suppose the question is language agnostic.
Say I have this discrete periodic series. It is some ...
0
votes
0answers
26 views
Is a Laplace Prior the same thing or related to a Laplace Transformation?
Context: I was watching this video https://youtu.be/pOYAXv15r3A?t=796 about Facebook Prophet and the speaker mentioned they use a Laplace Prior $$\delta \sim Laplace(\lambda)$$.
What I have gleaned so ...
0
votes
0answers
73 views
Forecasting time series with multiple seasonaliy by using auto_arima(SARIMAX) and Fourier terms
I am trying to forecast a time series in Python by using auto_arima and adding Fourier terms as exogenous features. The data come from kaggle's Store item demand forecasting challenge. It consists of ...
0
votes
1answer
45 views
How can i get the phase difference between two frequencies?
I have two signals of the same frequency. Both have frequencies of 13.56Mhz, and I want to find the phase difference between these two frequencies.
The function generator generates a sinusoidal ...
1
vote
1answer
28 views
Seasonal ARIMA vs ARIMA with Fourier terms for monthly series
I have monthly data and my goal is to forecast values with an inclusion of exogenous variables. I've built SARIMA and Dynamic Harmonic Regression models, where the second one performs little bit ...
0
votes
0answers
13 views
DFT of Multivariate Normal Random Vector
I have a real zero-mean multivariate rv $X \sim \mathcal{N}(0, \Sigma)$, with $N^d$ entries. $X \in \mathbb{R}^{N^d}$ is the flattened representation of a $d$-dimensional signal, of "side length&...
1
vote
1answer
44 views
Looking for repeated patterns in time series data
I have spent the best part of the last few days searching forums and reading papers trying to solve the following question. I have thousands of time series arrays each of varying lengths containing a ...
1
vote
0answers
46 views
Random Fourier Features approximating a kernel inverse?
There is a method I have been studying called Spectral Normalised Neural Gaussian Processes which leaves me with a question I cannot answer. In this method, they utilize Random Fourier Features but ...
1
vote
0answers
34 views
Examples of Fourier Analysis in statistics?
My brother in law is studying Electrical Engineering (undergrad level.) I was helping him select some coursework, and noticed that "engineering analysis" includes Fourier analysis. I didn't ...
0
votes
0answers
6 views
How to compute the minimum functional norm solution $h_{n,\infty}$ obtained from $\mathcal{H}_{\infty}$
I stumbled upon the following paper Reconciling modern machine learning practice
and the bias-variance trade-off and do not completely understand how they produce the line for the minimum functional ...
1
vote
0answers
20 views
Correlated residuals - white noise analysis
I want to check and analyze the goodness of my compressed sensing reconstruction algorithm (fit) using the autocorrelation of the residuals. Given my problem, I guess there are two ways to do this:
...
0
votes
0answers
41 views
Relation between Fourier transforms and coherence of signals
My overall aim is to compare the edges of two images by comparing their Fourier Transforms (FFT) and to calculate one number as a key performance indicator that describes how much they are similar to ...
0
votes
0answers
32 views
Identifying a single dominant number with high probability in a data point array of 4 to 20 numbers
EDIT 3: added below picture of raw readings of oscope from doppler data showing "periods" of sine waves before processed sine signal into square pulses.
EDIT 1: These numbers on the left ...
0
votes
0answers
23 views
How can I quantify the oscillation score of a complex wave?
My question is similar to this question, where I need to quantify a score that expresses the rate of oscillation, as shown in the question above.
In my case, the wave may contain multiple frequencies ...
0
votes
0answers
72 views
Why are Deep CNN's mesh dependent?(Fourier Neural Operators article)
I am reading the article named "Fourier Neural Operator for Parametric Partial Differential Equations" by Zongyi Li et al. In the very first page, there is a paragragh about Finite ...
2
votes
1answer
145 views
How to identify a non-periodic time-series?
I am working on a problem where I have to first classify whether a time-series is periodic or not and then, if it is periodic identify its period(s) (the time-series could have multiple periodicities, ...
0
votes
0answers
24 views
Correlation estimation by the Blackman-Tukey method
Problem statement: Assume that the spectral estimation for an unknown signal is given by the Blackman-Tukey method as follows:
$$ S_x(\omega) = 5+8\cos(\omega)-6\cos(2\omega)+2\cos(3\omega).$$
Assume ...
1
vote
0answers
37 views
Functional PCA for stationary signal
I just came across this technique:
https://en.wikipedia.org/wiki/Functional_principal_component_analysis
As far as I understand, if projects a signal onto a functional subspace that describe the "...
0
votes
1answer
45 views
Finding autocorrelation coefficients given PSD values at 2 frequencies
Assuming that $S_X(w)$ denotes powers spectral density function at
frequency $w$, we are given
$$S_X\left(\frac{\pi}{4}\right)=10+3\sqrt{2},\quad
S_X\left(\frac{\pi}{6}\right)=11+3\sqrt{3}.$$ We also ...
0
votes
0answers
57 views
How using a Fourier Series to model seasonal data with ARIMA works?
My understanding is that if we have a seasonal time series with period of $m$ we could model seasonal data by approximating the time series as $y_{t} = a + \sum\limits_{k=1}^{K}[\alpha_{k}]\sin(2 \pi ...
0
votes
0answers
32 views
Spectral decomposition of the DC part of the signal
The title of the question might be misleading, but it shows how clueless I am about this problem.
I have a time series of some quantity $X(t)$. I can calculate autocorrelation of this quantity $Y(\tau)...
0
votes
0answers
25 views
Do I need to use the complex conjugate when convolving two functions with the FFT?
I know that, due to the convolution theorem, two densities $f$ and $g$ can be convolved by (i) applying the FFT to both of them, (ii) multiplying the results, (iii) applying an inverse FFT.
Since I ...
0
votes
0answers
21 views
How to do clustering of fft values of a time series dataset?
I have a time series dataset, I have computed its fft. But I want to know if there is any specific clustering technique for fft values or can I use clustering techniques such as kmeans,heirachial?
1
vote
0answers
48 views
Uncertainty principle in probability theory
In probability theory, there is the covariance inequality
$$\operatorname{Var}(Y) \geq \frac{\operatorname{Cov}(Y,X)^{2}}{\operatorname {Var} (X)}.$$
In signal processing, there is a similar ...
1
vote
0answers
301 views
Model specification for seasonal ARMA-GARCH model using rugarch
TL;DR: I'm trying to find an adequate model for time series data that exhibits multiplicative seasonality and volatility clustering by identifying an ARMA-GARCH-model with Fourier terms using ...
1
vote
0answers
21 views
Are people still researching the use of spectral decomposition on finite groups for data analysis?
In A GENERALIZATION OF SPECTRAL ANALYSIS WITH APPLICATION TO RANKED DATA (Diaconis 1989), the author discusses a dataset of election results. There were 5 candidates, and each voter was asked to rank ...
1
vote
0answers
40 views
Using Cross Validation for Highly Seasonal Data with small sample
I'm having trouble getting good scores on cross validated metrics on time series regression models. Essentially, I am trying to model product purchases based on amount of money spent on different ...
1
vote
0answers
22 views
A space of functions and their Fourier Transforms?
Conjugate variables and the Fourier transform are often used to analyze different states of a single object. For example in Quantum Mechanics it can be used to describe changing information about ...
3
votes
1answer
664 views
Characteristic function and Fourier transform for a discrete random variable!
Let $\phi_{x}(t)= E [ e^{itx}]$ be the characteristic function
If X is a continuous random variable, then:
$\phi_{x}(t)= E [ e^{itx}] = \int e^{itx} f(x)dx$ (being $f(x)$ the probability density ...
0
votes
0answers
59 views
Method to calculate optimal nbasis (K) for fourier basis
Is there any method to calculate the optimal K for fourier basis transformation?
For example if I were to use RMSE, it seems that as K increases RMSE keeps going lower.
I'm thinking of the elbow-...
1
vote
1answer
27 views
Estimating Fourier spectrum from multiple time series of a system
I have a set of N time series, each of length T, that describe separate realisations of a single physical system. For each series, I can compute an FFT to find the Fourier spectrum up to a period 2/T, ...
1
vote
0answers
25 views
Spectral analysis in R, how to interpret periodogram
I'm relatively new to spectral analysis and have been working through some online tutorials. I have some time series data that I would like to examine for periodicity / repeating patterns.
When I ...
1
vote
1answer
534 views
Why SARIMA has better accuracy on weekly dataset than on daily one?
I am studying time series right now. So, I have this dataset. My aim is temperature prediction.
I've found out that ARIMA can't work with long period seasonality. So, I've resampled daily dataset ...
0
votes
1answer
20 views
Fourier analysis to retrieve components of individual spectra
I have a basic, simple question, I am a physics student, and searching internet gives me a lot of signal processing theory but couldn't find this basic answer, which I plan to implement in my speech ...
1
vote
1answer
50 views
Log-likelihood function for a filtered Fourier spectrum
I have time series data from which I am trying to infer parameters using MCMC. I normally infer parameters about the data in the time domain, using a Normal log-likelihood. However, I now have to ...
2
votes
0answers
208 views
Measuring weather impact on sales as a crossed random effect
I'm trying to model sales of a clothing brand having longitudinal data (unbalanced panel: 20 stores with 50 - 157 weeks of datapoints).
There are many regressors in my analysis, but I believe that ...
3
votes
1answer
37 views
Periodicity of random kitchen sink feature mappings
In various papers, e.g. Random Features for Large-Scale Kernel Machines, Rahimi and Recht introduce the now popular methodology wherein a "low rank" approximation to a stationary, PSD, kernel $K(x,y) =...
1
vote
1answer
29 views
Fourier series question I need help with
For the case of $a_n$ I am confused how my notes say we have 1 for the case n = 0. When calculating this integral for sin(nx) when n=0, we should also get zero as at x=0, sin(x) is 0. I must be ...
2
votes
0answers
29 views
How to efficiently find spikes in 2D data projected to 1 axis
I have the following points:
My goal is to find the be able to differentiate the yellow points from the purple ones.
We can assume that the yellow points are aligned on the vertical axis.
We cannot ...
0
votes
0answers
19 views
Multitaper F statistics
I'm having some problems interpreting the F-statistics output from multitaper analysis. To illustrate, the following code-snip in R performs multitaper analysis on the same sine-frequency but with ...
1
vote
1answer
41 views
How to discard the first spike after auto-correlation and handle sloping auto-correlation output [closed]
Disclaimer: I am not very mathematically inclined and am mostly looking to be pointed in the right direction.
I have various signals that I am putting through an auto-correlation function that uses ...
1
vote
0answers
143 views
How to search for irregular signals: Fourier, DWT or k-means?
See my notebook here
I want to search for irregular time signals in a data set of ~3 500 000 time signals. I can't give a clear definition of irregular signal, but it must fulfil the criteria of: not ...
0
votes
1answer
37 views
What is the difference between machine learning approaches and Fourier series to fit a curve to data graph?
As I know machine learning(at least in some problems) tries to fit a curve to data graph. And I think Fourier transform tried to do it. But machine learning use a hypothesis curve with the formula ...
1
vote
0answers
302 views
Fast Non-uniform DFT in R
So, if I want to compute discrete Fourier transform (DFT) in R, I can create my own functions like so:
...
1
vote
1answer
107 views
Why is spectral density only defined for stationary processes?
I read Brockwell and Davis(2016), Shumway and Stoffer(2016), and Stoica and Moses(2004). However, none of them laid out clearly the reasoning behind the presumption of stationarity when conducting ...
3
votes
0answers
30 views
Probability of sparse spectrum
Consider a vector $v$ such that $v \sim \mathrm{Unif}(\mathbb{S}^{d-1})$, the uniform distribution on the unit sphere in $d$ dimensions.
Question: is there an upper bound on the probability that $v$ ...
0
votes
1answer
835 views
K in Fourier series - How to find value of K to use it in ARIMA?
I am using the forecast library for doing some time series forecasting. I need to forecast number of sold items. I am planning to add holidays as xreg in auto.arima. The holiday will be a 0/1 list, ...
3
votes
1answer
149 views
Continuous time Fourier representation
I have learned that the Fourier transform of a continuous-time unit-periodic stochastic process is:
$$x(t) = \sum\limits_{k=-\infty}^{\infty} a_k e^{i2\pi kt} \quad \quad \text{ where } \quad \quad ...
3
votes
2answers
760 views
Inverse Fast Fourier Transform in R
plot(fft(fft(1:100),inverse = "true")/100)
plot(1:100)
In the above example, I was expecting the plots to be identical.
The first, however, returns:
while the ...
