Questions tagged [intervention-analysis]
Intervention analysis estimates the effect of an external intervention on a time-series.
121
questions
2
votes
1answer
129 views
Estimate the time series like an event was never happened
I have data from a website where a specific advertising campaign happened a couple of years ago. What I want to do is to estimate how the signups on that website would have been without that big ...
0
votes
1answer
21 views
Two simultaneous time series vars. Want “confidence” intervals for one's prediction (not forecast per se) of the other
Let me know if this is a duplicate.
This seems to differ from other time series questions I've seen in that I'm not trying to forecast the future. Maybe that will mean only a difference in the ...
0
votes
0answers
14 views
intervention analysis with multivariate regression
Does intervention analysis make sense when one has multiple external regressors? How would one know if say, a level shift, is caused by a combination of external regressors or by a change in a law ...
0
votes
0answers
9 views
elastic net with random interventions
Since elastic net gets rid of regressors that do not correlate, would it make sense to randomly put in a bunch of interventions (pulses, level shifts, ect)?
If the intervention is not needed, won't ...
0
votes
1answer
73 views
CausalImpact Conflicting Results - Posterior prob. v Confidence Interval
I'm getting conflicting results from a Causal Impact analysis I'm running. The 95% C.I. indicates that 0 is included and thus the impact is not significant; however the Posterior Probability is <....
1
vote
0answers
51 views
How should I specify seasonality in CausalImpact? [closed]
I am working with the Python implementation of Google's CausalImpact package. My data is at daily frequency (365 observations per year); however, to inspect the effect of intervention, my pre-period ...
0
votes
0answers
20 views
Pre post intervention analysis
I have a theoretical question about a fabricated before-after analysis with Intervention and Control groups based around a new testing method. In addition to the treatment groups and time (before and ...
0
votes
1answer
22 views
Before/After unpaired study with control villages analysed in R
For the implementation of a project, we have been following household access to services in two groups of villages, one an intervention group (I) and one a control group (C). Access as a Yes/No ...
1
vote
0answers
45 views
Before - After survey testing with a control group, how to analyse
Sample size in intervention area n=800
For the purpose of measuring progress on the proportion of families having access to a service (yes/no variable) by households in eight intervention villages, a ...
0
votes
0answers
7 views
Testing Response Model
I'm thinking about strategies to examine how well a churn model performs. And, I know one question I'll receive is can we just target customers in the top decile of the churn model to evaluate model ...
0
votes
0answers
20 views
Estimating Policy Effect with a Logit
So I am testing a policy which was introduced in a country trying to incentivise people to stay employed at older ages (beyond the retirement age of 65). As such, they introduced a bonus where people ...
0
votes
1answer
15 views
Testing an intervention by repeated measure of opinion before and after the intervention
How can we test the null hypothesis that an intervention has no effect on opinions for 44 people. These opinions were measured as frequencies in 3 categories (A, B, C) before and after the ...
0
votes
0answers
8 views
Medical or Intervention Study
A friend and I are trying to better understand proper design of a randomized trial, from beginning to end, with an eye to creating an informal one showing the benefits of a particular academic ...
1
vote
0answers
30 views
Pursuing meaningful questions about pre- post- intervention outcome measures in single condition treatment
If you are not fortunate enough to have a control group and have a single condition only, what meaningful questions can you ask about the change in pre to post intervention scores?
If ANOVA or ANCOVA ...
0
votes
1answer
37 views
Does statistical significance impact uplift calculation for marketing campaign
I'm trying to understand 2 things in relation to calculating uplift from a marketing email campaign:
Impact of statistical significance
Impact of highly skewed data on calculating uplift
The ...
0
votes
0answers
64 views
intervention analysis on several time series samples where intervention occurs at different times
I have quarterly sales data for ~80 products spanning 4 years. I also have 16 different external interventions, where one or multiple of them have occured on the products on different dates during the ...
1
vote
0answers
29 views
Statistical analysis for quasi-experiments
This is my first message on this forum. I hope I am not doing any mistake.
I must analyze data obtained after a quasi-experiment and I am not sure how to proceed. The experiment has been carried out ...
3
votes
2answers
269 views
Interrupted Time Series Analysis with multiple Intervention timepoints
I was wondering if it is possible to do a interrupted time series analysis with an intervention that is introduced and removed at specific intervals throughout the time-series.
All of the literature ...
2
votes
0answers
32 views
Determine how long the effect of x on y may last in time series data
I have a time series dataset that contains variable x and y per month (180 rows). x represents incidents that happen infrequently and y is a continuous variable. However, when there is some incident y ...
1
vote
0answers
22 views
Can I compare daily averages using a T test?
Pretend you had a sales group that was required to perform a bunch of administrative work for every prospect they contacted. E.g., entering the prospect's contact info into a CRM, researching the ...
0
votes
1answer
38 views
Validating A Model On Pre-Test Post-Test Design
I am phd candidate at primary education department. My aim is to validate a model but i have not find a exact answer yet.
I have 2 groups. (Actually 4 but only 2 of them are going to use to validate ...
1
vote
1answer
72 views
Are high schools dumbing down their exams? I don't know. How can we find out?
I have a large-ish longitudinal dataset of high school and college course registration and grades. I want to test the assertion that high schools are "dumbing down" their courses to meet graduation ...
0
votes
1answer
24 views
How to manage fusion of firms or countries in time series analysis
I am working with time series analysis and one of my series is loans of a very large bank between 1970 and 2015. However in 2000 that bank, acquired a smaller bank. I only have the data for the big ...
1
vote
0answers
30 views
Methods to account/correct for dropouts in intervention study
I have depression scores for patients before and after intervention, there is no control sample. I want to assess if demographics have an effect on recovery, and I was thinking of doing a linear ...
2
votes
3answers
91 views
Hypothesis test for intervention with class imbalance before intervention. Alternative to McNemar
I want to assess an intervention to cure a disease. An example is described by the following matrix:
...
1
vote
1answer
96 views
How to statistically determine if there was sales lift?
Say my company is about to make some changes that they expect will increase sales and customer acquisition in current markets, what would be the best way statistically to determine if that lift was ...
1
vote
3answers
36 views
Pre- and post-values for two groups randomly assigned to either intervention or control
My project aims to see if sitting for an hour temporarily slows movement in patients with movement disorders.
I have two groups (20 sick patients and 10 healthy patients) who are randomly assigned ...
2
votes
1answer
95 views
Can a random slope in a linear mixed model mask the effect of my intervention?
I want to assess the impact of my intervention in a repeated-measures design. I have subject as a random intercept in order to account for the dependence of measurements within subjects:
...
1
vote
0answers
100 views
Measuring impact of intervention using a counterfactual forecast?
I'm an economics student who's trying to dive into causality. I've tried looking into intervention analysis, but I can't seem to find many sources on forecasting using historical data as an approach.
...
2
votes
0answers
48 views
Analysis of Pre-post Likert-type scales: Intervention vs. Control group
I gathered the following data:
Intervention group (n= 24, received treatment): pre- and post- scores of different psychometric questionnaires
Control group (n=23, inactive): same questionnaires, same ...
0
votes
0answers
52 views
Time Series Data: Unequal Sample sizes
I have a dataset which consists of daily observations over a 3 month period for different variables. The data are aggregated so I do not have access to user level data.
The problem is that the ...
1
vote
0answers
31 views
Determining relation between branding spend and sales growth
A company exports a units of product to a distributor in a foreign country. This distributor then sends units to dealers across the country who run shops that sell the product.
Until May 2017, ...
0
votes
0answers
136 views
Statistical Significance of Time Series Data pre and post intervention
I am currently working on data in which I have to see the rate of entry of children to a foster home is statistically significant or not before and after a welfare program was implemented. I got the ...
2
votes
1answer
50 views
Looking for techniques to understand the impact of a discrete events (interventions) on a continuous response variable in time series
I am trying to model the effect of one or more discrete interventions (e.g., taking a pill, attending therapy) on a continuous outcome (e.g., pain level of a patient over time). The features are ...
2
votes
1answer
243 views
Is a Chow test appropriate for this intervention analysis?
I am fairly new to R was wondering if this approach was appropriate. Sorry if I forget anything in my question.
I have long-form panel data for 15 years (2001-2015) for hundreds of counties and ...
1
vote
1answer
879 views
Comparing slopes in a time series following an intervention
There are lots of related CV questions to the title above, but I'm looking for some clarification on a specific approach, and some explanation.
The set up is as follows (adapted from another question)...
2
votes
1answer
1k views
Linear Regression vs. ARIMA
I have a data set that was sampled at a high frequency relative to the speed over which changes are expected to occur. This has resulted in high autocorrelation between adjacent values upto a lag of ...
1
vote
1answer
411 views
Repeated measure ANOVA vs independent 2-sample t-test
I have this data where I have a control and an intervention group. For both of these two groups, I have a continuous outcome measured at baseline $(y_0)$ and at 1 month $(y_1)$. To test for the ...
0
votes
1answer
156 views
Casual Impact Analysis with Linear Regression - Interpreting Results
I have two groups of customers. One received a promotion another did not. I want to determine the effect of the promotion. I created a simple linear regression with a dummy variable for weekend.
...
0
votes
2answers
141 views
How to analyze trends of multiple patients' data before and after an intervention
I have data for 200 patients' blood sugar levels before and after an intervention. There are multiple readings both before and after the intervention.
In order to see if the intervention had a ...
1
vote
0answers
42 views
Pre/Post Analysis - questions about covariates
I am trying to evaluate the impact of an intervention (0/1) on readmission rates pre- and post-intervention. Every individual has a pre-period rate and a post-period rate.
A few important points:
1. ...
0
votes
1answer
39 views
Choosing a test to compare means within a sample
I have blood sugar values for diabetic patients over the past few years from a clinical practice. Half way through the observation period, a treatment intervention was applied to all of the patients. ...
2
votes
1answer
48 views
Determine if there is an influence of newspaper articles on stock quotation
Lets assume there is a company called "XY", which is listed in the NASDAQ. Lets further assume that newspapers are frequently reporting about company XY, either in a positive, neutral or a negative ...
1
vote
0answers
97 views
Comparing pre/post percentage change between pairs of random samples
I am studying cycling rates along a street that recently received a bike lane. The data I have consists of 4 random samples of people intersected on the sidewalk. For each person, we know if they rode ...
1
vote
0answers
60 views
Which is best method and interpretation for a single-group pre-post model with interactions?
I have some one-group pre-post data where the outcome is a score and an IV of interest is the whether or not the subject has performed the task in the past. I am looking at this in a few ways and am ...
0
votes
0answers
305 views
Calculating Cronbach's alpha for pre-post scales separately or together?
I am measuring a self-efficacy (SE) score by measuring 7 sub-scales for pre and post intervention.For example, for a participant, I have the SE score by measuring 7 sub-scales before the intervention, ...
1
vote
1answer
35 views
Using change in rank to assess effectiveness of an intervention
Is it possible to assess the effectiveness of a classroom intervention by:
Taking scores from an entrance exam administered before the intervention
Ranking these scores (i.e. 1st, 2nd, 3rd, ...)
...
1
vote
0answers
601 views
Stratified Paired T-Test for One Group
I have pre/post data where all subjects underwent the intervention. The outcome is a score. I am also looking to stratify my analysis by gender. I understand I can stratify my paired t-test in SAS via ...
1
vote
1answer
95 views
one group pre/post test
I am conducting a one-group pre-intervention / post-intervention test. All the subjects completed the intervention as otherwise there would be ethical concerns. Is there any test other than a paired t-...
0
votes
0answers
556 views
Interpreting ARIMA for Interrupted Time Series Analysis
I want to test for efficacy of an intervention. I have pre- and post-intervention data and I used auto.arima to find the best fit for the two data sets.
I'm stuck ...
