Questions tagged [trend]
An observable pattern in the data.
622
questions
0
votes
0
answers
10
views
dealing with non-stationary data in regression [closed]
in designing a simple linear regression model between inflation (independent variable, X) and stock prices (dependent variable, Y), stock prices tend to exhibit a trend. do I have to difference both X ...
1
vote
0
answers
16
views
Is non-stationarity an issue in this setting?
I am trying to model the development of European spot prices of gas. My purpose is to explain what has caused past movements in the gas price, rather than forecasting future gas prices.
Naturally, ...
- 11
0
votes
0
answers
20
views
Estimation of two successive treatments - Differences in Differences
I am trying to estimate the effect of two successives policies on individual subjects.
I have a panel data following individuals each 3 years from 2005 : 2005, 2008, 2011, 2014 and 2017.
The first ...
- 1
0
votes
0
answers
18
views
Test for incidence-rate trend in Stata
I am using Stata 17.0 MB and working on a dataset of Enterococci bacteria infections in the previous ten years (2012–2021). These bacteria have more dangerous subtypes resistant to one antibiotic (...
0
votes
0
answers
18
views
Anomalies detection algorithms
I would like to detect drastic uptrend changes in a bunch of different systems faults counts through a certain number of weeks.
My data looks like this:
And I would like to know what would be the ...
- 1
0
votes
1
answer
17
views
Difference between seasonality-adjusted data and the trend component
After decomposing the time series, what is the intuitive difference between seasonality-adjusted data and the trend component (from decomposition)?
- 5
0
votes
1
answer
13
views
Finding Correlation between Defect Rate and Handling Time
My team works to resolve online tasks assigned to them through a queue system; time taken to clear each task is measured (called handle_seconds). Approximately 18% of the tasks turn out to be ...
- 13
0
votes
2
answers
51
views
Mark Location of Trend Time Series
I am new in the topic of time series data and found out about the STL decomposition which can smoothly show the trend in some time series data. My task is to detect trends given certain data.
At first,...
- 1
0
votes
1
answer
23
views
Trend in exogenous variable in time series
I have a time series of a variable V1 with seasonality and a strong trend. The trend however seems to be closely related to (and caused by) the trend of another time varying variable (V2). As V2 grows ...
0
votes
0
answers
33
views
Ideas to validate predictions on timeseries data
This is no search for the one answer but for ideas, how to deal with this (my) problem in general.
So I need to set up a model (e. g. with ANN or RandomForest) to value real estate properties.
Since ...
- 31
0
votes
0
answers
16
views
How can trends be compared between two groups with individuals having a different number of observations?
That is a subset of mydataset
...
- 559
0
votes
0
answers
20
views
Could output from a Mann-Kendall test (Kendall's Tau) meaningfully be used as a dependent variable in a regression analysis?
I am using a combination of registry data and survey data to analyze how much of the differences in sickness absence percentages, between companies in different industries, can be explained by their ...
0
votes
0
answers
48
views
Why do we detrend time series data?
If I have annual international trade (from 2000 to 2022) data and Country A has implemented a new policy in 2012. What is the benefit of detrending in this case if I want to investigate the impact of ...
- 111
9
votes
1
answer
249
views
Can a timeseries with a clear trend be considered stationary?
I performed a augmented Dickey-Fuller test on a timeseries (that clearly has a trend) and, from the results, it suggests it is stationary (p-value = 0.01). Is this possible?
...
- 91
0
votes
1
answer
32
views
P trend and association
what does p trend mean for categorical analyzes with HR (proportionnal regression cox) ?
Do we have to interpret this with HR on our result ?
- 1
0
votes
0
answers
28
views
Extracting the trend from the Gamm function in mgcv with a AR(2) correlation
I'm referencing a paper, "Filtering Time Series with Penalized Splines" from 2011 where the authors provide some code to show how a time series can be detrended by expressing penalized ...
- 411
0
votes
0
answers
15
views
Nonpar group medians test with repeated subjects
Working with biomedical data, we have oddly distributed measurements, so we like to do nonparametric or medians tests like Mann-Whitney U. I would use wilcox.test() in R when comparing two groups. ...
- 224
0
votes
0
answers
35
views
Creating custom trends or perform trend reversal in unobserved components model
I am using statsmodels unobserved components model to forecast some time series.
I use the 'local linear trend' model, however I expect a reversal of trend at some point in the future.
Is there a way ...
1
vote
1
answer
37
views
Approach for Trend comparison in a Time Series
I'm a bit confused on how to properly compare a known trend to an estimated one. I've got two sets of data which are of the following format,
$$y_{t_1}=x_{t_1}+WN$$
$$y_{t_2}=x_{t_1}+MA(2)$$
Where $WN ...
- 411
0
votes
0
answers
28
views
trend between values in a single variable
What measure can one see to find trend between values in a single variable- for e.g if a gene is always overexpressed in different conditions. Other than skewness and kurtosis are there any other ...
0
votes
0
answers
15
views
Testing for Trends in Sales Data, of 2 Products(Independent data of each Product)
The Data is structured as:
Date of Sale | Order Amt | Price of product | Qty.
Product A was sold independent of Product B(thus, 2 datasets), so dates do not match at certain instances, and entries are ...
0
votes
0
answers
15
views
Contrary results using prewhitened MK test and MK test when checking significant trend of time series in R
I am testing whether the duration of drought (days of year) had increased significantly in the past decades. However, I am getting opppsite results using the prewhitening MK test and MK test in R. ...
- 1
0
votes
0
answers
23
views
What is the formula for the p value of a tendline?
I can't find any no matter how hard I google. Every search result just tells me either how to calculate it on excel or explains what the p value is.
0
votes
0
answers
38
views
How to measure strength of upward or downward trend in a time series
I have sales data of 500 different products from September 2021 to May 2022. I need to do a quick assessment on their time series characteristics. First of all I should name the ones which shows a ...
- 43
0
votes
0
answers
21
views
How can I modify the mean absolute percentage error to account for the curve direction?
I am trying to predict the trend of a certain curve in the future (whether it will be increasing, decreasing, or remain constant). For evaluating my prediction, I am using the mean absolute percentage ...
1
vote
1
answer
51
views
Should I difference my data before run a ADF test?
I plot my data as shown in the following screenshot:
Clearly the series contains a trend. A first order difference of my data will eliminate the trend, which I plot as follows:
Now I would like to ...
- 123
0
votes
0
answers
24
views
Do we still have to care about stationarity when using a fixed effects model?
I have a balanced panel dataset for 37 countries and 11 years. I am using a fixed effects model for both country- and time-fixed effects. Now, I am asking myself if I still have to check stationarity ...
- 133
2
votes
0
answers
75
views
How to check stationarity in panel data?
Unfortunately, I am not very familiar with panel data methods (yet) but it seems important to check if my data display stationarity (aka time trends). Assuming that my regression function looks like ...
- 133
1
vote
1
answer
29
views
Where to start? [closed]
I am very new to data science and machine learning. I need some advice on how to recognize long/short-term patterns/trends in a big data set (demand data), make predictions for future and make optimal ...
0
votes
0
answers
11
views
Testing for significant trend factors
I'm currently working on a project to improve my company's methods for frequency and severity trend selection in a few models. At the moment, given a series of points in time, we take a ...
1
vote
0
answers
25
views
Seasonal and trend adjustment for irregularly spaced time series
I know of different methods that exist to remove seasonality and trend in the data to make it stationary. However, that exists only for regular time series; that is, a series that follows a fixed ...
- 11
0
votes
0
answers
14
views
Handle User Behavior Change when creating a ML classifer
I'm creating a churn model.
My first thought was that the bigger the training set, it would be better.
However, 2020 was a crazy year because the COVID 19. For example, a user who was sick and ...
- 77
0
votes
0
answers
8
views
How to generate a general trend from hundreds of time-series data
I have hundreds of time-series data from individual experiments[2] with a similar trend that reading rises as time goes by (evaluated by my naked eyes). So what statistical tools should I use to ...
- 229
0
votes
0
answers
24
views
How to adjusting p-values from results of trend analysis on water quality data
I have results from Mann Kendall test for trends at 100 sample locations for 5 different analytes at each location (i.e., 500 p-values). If I had the trend results from 500 sample locations for 1 ...
- 1
0
votes
1
answer
25
views
What are the best-practices for validating phone records? [closed]
I have a bunch of telephone data including information on call start time, end time, and duration. I am trying to evaluate the quality of the dataset to determine if the phone call data are legitimate ...
- 494
1
vote
0
answers
45
views
How to compare trend of two different datasets?
I have two different datasets (ID 1 and 2) which show the number of animals per hectare for each year. I need to know if the trend for the first periode is different then the trend for the second ...
- 11
1
vote
0
answers
18
views
Trend and Variance of Residuals for real world data
I am modeling the internal Resistance of a battery and have proposed the following equation:
$$R_{int}(SOH,SOC,T,Current)=A_1+A_2*SOH+\frac{A_3*T*SOH*asinh(Current*\frac{SOC}{A_4})}{Current*SOC}+\frac{...
- 121
0
votes
0
answers
21
views
How to compare trend for split datasets
I have product price data, at monthly frequency, available for a set of different products. Each of these series have a break point which is the point where we do some kind of intervention. The break ...
0
votes
1
answer
124
views
VAR with trend-stationary variables
I'm currently trying to estimate a VAR with 3 variables - consumption, investment and a credit spread. I have inspected the variables and run ADF tests to determine that they are in-fact trend-...
1
vote
1
answer
174
views
Mann-Kendall test for multiple groups
I'm currently working on a problem, where I want to test weather there is a trend in the course of a certain metric in an animal, where I wanted to use something like the Mann-Kendall test. The ...
- 11
4
votes
3
answers
274
views
Which statistical tests can I conduct to analyse the trend of series data?
I have a dataset that measures students' time spent working on a set of mathematics questions. My dataframe looks a little something like this:
Participant ID
Question 1
Question 2
Question 3
1107
...
- 163
0
votes
1
answer
18
views
evaluate movement trend
I have some timestamped data (four groups) and I am looking to find a way to find which of the three is moving more closely with the purple one? Is Pearson correlation is the best approach, or there ...
- 173
0
votes
0
answers
25
views
Which test or method can I use to assess trend in dependent proportions over time?
Let's assume there are 4 time points, t0 (baseline) ... t3
At each time point I assess a % of successes of some outcome: p0, p1...p3. The denominators vary over time, so the counts itself do not ...
1
vote
0
answers
206
views
How to test for the increasing and decreasing trend in a non-time series data
I have the following data frame:
...
- 121
1
vote
2
answers
183
views
Why does autocorrelation function for trend in data decrease with increasing lag?
Forecasting: Principles and Practice, 3rd edition by Hyndman and Athanasopoulos states in section 2.8, Autocorrelation that, for trend in data the autocorrelation function has positive values that ...
0
votes
0
answers
190
views
Select the best period value to visualize clearly the Trend and Seasonality
I have a daily data for 4 years range between 2016 - 2019. I used statsmodels.tsa.seasonal.seasonal_decompose to decompose the seasonality and trend but I should ...
- 111
0
votes
0
answers
22
views
How to deal with few trends in my time series?
I would like to make this data stationary, but I do not know how to deal with this series. This is not stationary and has autocorrelation. It looks like it has 3 different trends. How should I treat ...
0
votes
1
answer
28
views
How do I test the significance of factors on a time series dependant data set?
I am working on a dataset where a new administrator joins a school, and I want to see if it affects the number of students at the school. There are also characteristics of the administrator (age, ...
- 1
2
votes
1
answer
70
views
What is the mean and variance of an MA(4) process with time drift?
For a project I need to simulate a relatively smooth time series with an upward drift.
This is what I came up with:
$$y_t = \mu + \alpha t+ \sum_{j=0}^{q=4} \theta_{j} e_{t-j}$$ where
$\theta_j = 0.2^{...
- 219
0
votes
1
answer
114
views
Long-term trend prediction of time series data
I have a time series dataset project (single variable time series) on market share changes of a particular product in a region (values are recorded every day from 2018 to 2022) where I need to predict ...
- 25