Questions tagged [unevenly-spaced-time-series]
Time series sampled or measured at unevenly (or irregularly) distributed time points.
179
questions
-1
votes
1
answer
19
views
evenly spaced values in [0, 1]? [closed]
First, what does it mean by the evenly spaced values of an interval, for example, $[0.1, 1]$ or $[0, 1]$?
- 131
0
votes
0
answers
31
views
Why do simulated arrival times from a Poisson distribution seem to show periodicity?
I am experimenting with simulated arrival times drawn from a Poisson distribution. To construct the arrival times, I am randomly drawing inter-arrival times from the inverse CDF, which is ...
- 111
1
vote
1
answer
12
views
How to weigh time-series data with a utility function with jumps?
I have data measured at fixed intervals in one process. It needs to be weighed with cost value that is generated in another process that is analogue and the costs it generates have jumps.
Imagine a ...
- 149
0
votes
0
answers
18
views
Can rescaled range analysis to calculate Hurst exponent be used in unevenly sampled data?
I am working with some data that I'd like to calculate the Hurst exponent of using a rescaled range analysis. The only issue is, this data I am working with is sampled unevenly. The timesteps aren't ...
- 101
1
vote
0
answers
16
views
Can I use OLS techniques to analyse trends in documents from irregularly spaced time intervals
Apologies in advance as this is a lengthy query. I have a few questions involving research looking at the differences in level of ambition of language of documents on environmental issues from Group ...
- 11
1
vote
0
answers
30
views
How to incorporate known future target values in prediction model?
Imagine that we collect time series data from a sensor. Due to measurement errors and let's say power outages, there are gaps in the time series that can be quite long. For example if data would be ...
- 11
2
votes
0
answers
24
views
When do ARMA models fail?
I have just started learning about Autoregressive–moving-average model (ARMA). On the Wiki page, it has been mentioned that:
ARMA is appropriate when a system is a function of a series of
unobserved ...
- 211
0
votes
0
answers
74
views
Generating a surrogate time series from unevenly spaced time series
I work in the atmospheric sciences and I have data from an automated weather station measuring mean sea level pressure. Due to an extreme event(and consequent loss of electricity)the measurement is ...
- 101
1
vote
0
answers
29
views
Hypothesis testing on a moving-average model on unevenly-spaced time series
I have some irregular time series $X$, where $X_t$ are identically distributed, and bounded between 0 and 1. I perform a moving average $Y_t = \sum_{t'} \frac{w(t-t')}{\sum_k w(t-k)}X_{t'}$. The ...
- 11
2
votes
1
answer
42
views
What is this type of data called?
An event occurs once per period, such as once per year. Time is measured in discrete units, such as days of the year. Let $A_y$ be the day in year $y$ on which this event occurs. However, we do not ...
- 1,121
0
votes
0
answers
22
views
Predicting the dates of intermittent events
Hello I am trying to predict the date and location of certain events using an LSTM model. The observations of dates are not structured (sometimes no events for many days and sometimes many events on ...
- 1
0
votes
0
answers
45
views
Lagged predictors in irregular-time / asynchronous / time-unconstrained data
In growth curve modeling or other approaches, when time is constrained/synchronous/regular (i.e. panel/wave data; all observations occur synchronously), lagged prediction is trivial - simply add t-1 ...
- 1
0
votes
0
answers
55
views
Modelling irregularly sampled observations of a continuous time signal with a discrete state space model
I need to model time series whose observations are sampled at arbitrary points in time. By modelling, I mean that I would like to fit a generative (probabilistic) model that can approximately ...
- 1,215
1
vote
1
answer
80
views
Extract features of uneven time series and use it in cross-sectional study
I have a data like below
subj_1 = 10,20,15,30,60,70,90 (in resolution of years - 2011 to 2018)
subj_2 = 10,20,30,40 (in resolution of months - Jan 2011 to Apr 2011)
subj_3 = 10,15,20,30,45,55,60,70,90,...
- 2,096
0
votes
0
answers
46
views
Quantify similarity between time-series with uneven sampling
I would like to find a way to numerically represent the similarity between three time series, with differing sampling rates. In the past I have used other methods in R, including dynamic time warping, ...
- 113
1
vote
0
answers
110
views
How can I generate probabilistic forecasts to do probabilistic classification?
I have a collection of univariate, irregularly spaced, financial time series. Each series is labeled by its class. The image below shows some example data.
A note on the data:
The time series could ...
- 124
0
votes
1
answer
68
views
Controlling for time elapsed between baseline and treatment
I'm having a mixed model with 5 repeated measurements (time is categorical because the timepoints represent discrete events).
Edit: I have 5 meaningful timepoints: t0 baseline (neutral timepoint); t1 ...
- 27
0
votes
0
answers
35
views
Short Time Series Granularity of Timestamps
I have to make a prediction on a time series whereby there are 10 years of data. My first option is to predict the values aggregated to the annual level using SARIMAX (excluding the seasonality ...
2
votes
1
answer
48
views
Interrupted Time Series with Unevenly Distributed Samples
I'm working on causal inference using Interrupted Time Series Design. I have multiple samples per day and am selecting my analysis bandwidth based on pre-treatment RMSE on leave-on-out cross ...
0
votes
1
answer
44
views
Forecasting Prices with interdependence that form a Timeseires
I have already asked a simmilar question, but i thoguth that this was not phrased well and hence i am trying a new post were i ask a better question. Let me know if this is ok. Judging by some of the ...
- 109
3
votes
0
answers
46
views
Unevenly spaced multiple time series modelling
In the context of unevenly spaced (multiple) time series (USTS), are there any classical approaches? If they were evenly spaced, we would try ARIMA, or VAR, or even State-Space models.
I've been ...
- 5,200
0
votes
0
answers
114
views
A times series problem with variable length and time shifted sequences
I would like to get some guidance (maybe papers, algorithms to try) on a times series problem and I don't know how to approach it, as I am a novice in the domain. The problem brings several challenges ...
- 21
0
votes
1
answer
84
views
causal effects when y is continuous and discontinuous over time
I am interested in estimating the causal effects of A(treatment) on Y(outcome). Here treatment is a binary variables (yes vs no). Outcome is a continuous variable(weight), and this is normalized to Z ...
2
votes
0
answers
75
views
Regression for hierarchical time series
I have a dataset with time series A, B and C from different countries. These time series have different starting points, missing values, and irregular intervals (only weekdays).
Instead of forecasting,...
- 93
0
votes
0
answers
19
views
Covariance from time series with asynchronously observed components
Let $(X_t) = (X^1_t, \cdots, X^d_t)$ be a time series in $\mathbb{R}^d$ with
covariance matrix $C_t := \big(\mathrm{Cov}[X^i_t, X^j_t]\big)_{i,j}$.
Suppose that $X\equiv(X_t)$ satisfies some ...
- 145
1
vote
1
answer
34
views
How to get daily returns from irregularly spaced price time-series?
I have a timeseries that has irregularly spaced time indices as below
...
- 1,174
0
votes
0
answers
9
views
Difference of 1 time series vs many others
I have many time series that span for 30 periods but they might be unbalanced over time i.e. some individuals may lack an observation on a given time period. I'd like to know if a given series is ...
- 1,056
1
vote
0
answers
59
views
Feature creation based on irregular time series with strictly monotonic values
I am given the following problem to run predictive maintenance on the following mess:
I have some IoT sensors out in the field, but I cannot easily change the software on them. Also, data collection ...
- 11
0
votes
1
answer
99
views
Unevenly spaced time-series forecasting and anomaly detection for an industrial usecase
I am currently working on a PhD project for a car manufacturing company, which basically consists of creating a predictive maintenance application for the machines that are currently used to fill the ...
- 1
1
vote
0
answers
27
views
How to create an ML training dataset from unevenly spaced multivariate timeseries?
I have a time series dataset with multiple features X_n from which I want to predict an output y. However, both the x and y values are unevenly spaced and were sometimes collected at different ...
- 111
1
vote
0
answers
18
views
Predicting events - seizures in epilepsy. A question about time series models matching with observations
I've been keep a diary of epilepsy seizures, and would like to attempt prediction modelling as an help for better management of anti consultant therapy.
Could you help to suggest models that fit with ...
- 111
1
vote
0
answers
35
views
How to analyse simple internet downtime log?
I have a log of internet downtime (timestamp + downtime in seconds) and I'd like to analyse it to try and spot trends, especially if I can see that it normally happens around specific times of the day,...
- 111
1
vote
0
answers
106
views
Cross Correlation between highly unevenly spaced time series
I have the following problem.
I have 2 time series, one on a yearly basis (2010 - 2020) and one on a daily basis (01/01/2010 - 31/12/2020).
I looking for methods how I can investigate the correlation ...
- 21
0
votes
0
answers
55
views
Should you bin data when creating moving average to generate a forecast?
Let's say I have insurance claims that are created on a daily basis on Monday through Friday but sometimes there will be days in which we don't get a claim, perhaps it'll be a week or two that we don'...
0
votes
0
answers
70
views
Equivalent of "lm" for irregular time series forecasting in R
I have a two column data frame corresponding to time series of the form (Date, Value). I want to predict future values of Value based on this data. I don't need anything fancy, just a quick and dirty ...
- 1
1
vote
1
answer
26
views
How to perform autoregression analysis with higher-resolution explanatory data
I have two time series of data, shown in the below plot. My response data is an annual total (brown, plotted in the middle of the year totalled), my explanatory data is a monthly summary index (black)....
- 135
0
votes
0
answers
69
views
Fill missing values when aggregating a time series from minutes to hours
I am attempting to predict future values using AWS Forecast, and my data is by minute. However, due to data size constraints, I need to aggregate this data to hourly.
The problem is that I am missing ...
- 147
1
vote
0
answers
110
views
Can I use Granger causality for missing data/ irregular time series?
I have two time series and I want to look at their Granger causality. My data is from two irregular time series. Irregular here means sampling was done sporadically across 3 years. In some months, ...
0
votes
0
answers
23
views
Time Series Classification with Unequal Time Between Events and Number
I have a problem where I'd like to predict whether a customer is going to convert. I have event data for these customers over time and the histogram for time to conversion follows a 1/x pattern where ...
0
votes
0
answers
41
views
Measuring frequency of change in time series data with inconsistent time intervals?
Context
I'm tracking auction house prices for items in Guild Wars 2 in a database. They provide an API that allows me to get the item's current buy/sell offer quantities and prices at that moment. As ...
- 101
0
votes
0
answers
52
views
Time dependent representation for time series events with different time gaps?
In natural language processing, we can treat characters as evenly spaced time series in RNN models where time gaps are independent of the sequence and only sequential positions matter.
If I want to ...
- 5,446
0
votes
0
answers
14
views
Statistical Test for Trends in Samples from a Possibly Changing Distribution
I have some data of quantitative measurements of the language in books from the years 1800 to 2000. For each year I have between 0 and 50 samples, mostly about 10 samples per year. If I bin the data ...
- 135
1
vote
0
answers
175
views
Calculating EWMA & EWMV of concurrency from duration & interval
I'm looking to calculate the exponential moving average & exponential moving variance of a continuous series of request/responses, using each response's duration and the interval (time delta) ...
- 111
0
votes
1
answer
13
views
Creating an index using transactional data
I have a dataset of a series of leases.
Variables we have: precinct, date (in quarters), lettable area, price as well as a few others.
These assets are not homogenous, although are comparable.
In some ...
- 85
0
votes
0
answers
122
views
What is the best method to predict the water consumption of EACH customer for the next month?
Say we have a dataset that has the following attributes:
customer_id: There are a total of 1000 customers, each of them with a unique customer_id
observation_date: The date on which we last observed ...
2
votes
0
answers
48
views
Does it make more logical sense to model the discrete FFT output as a categorical variable or a numerical variable?
I am training a time-series data classifier and some of my features are the output of CT FFT. The results are of course discrete frequencies. I understand that they are in numerical order and higher ...
2
votes
0
answers
61
views
Spot unusual patterns in a discrete intermittent time series
I have a multitude of daily time series representing the volume of a certain product arriving per day at a station. There are as many time series as their are stations, and they each look like the ...
- 529
2
votes
2
answers
504
views
Data leakage in temporally overlapping train-test split
Question: In the sliding window train-test split strategy, will there be data leakage if, say, I train on a dataset $X_{t}$ to predict values $y_t$ that were collected after my test data $X_{t+1}$?
...
- 43
1
vote
0
answers
36
views
Forecasting with Irregularly Missing Data
Suppose I am supplying $N = 1000$ vendors, and I am looking for a way to predict their demand for my product over $T = 90$ days. Concretely, I hope to take some features for each vendor, such as their ...
- 143
0
votes
0
answers
801
views
Comparing time series data with different interval
I have time series data for one day (temperature) measured every 5 seconds and would like to increase the period between measurements and somehow calculate the level of error/similarity/correlation (I'...
- 101