Questions tagged [causalimpact]

CausalImpact R package for estimating the effect of an intervention on a time series.

Filter by
Sorted by
Tagged with
1 vote
1 answer
35 views

Invalid use of Propensity Score Matching?

I wonder if using a propensity score in the following situation is wrong. Imagine I have the next causal model $$X = N_x$$ $$Y = f(X, N_y)$$ $$ Z = g(X, Y, N_z)$$ Where $N_z, N_y, N_x$ are ...
Nicolas Beltran's user avatar
0 votes
0 answers
17 views

Interpret CausalImpact summary

What is Prediction(s.d.) in the summary output calculated based on? My understanding is that there are iterations done to get predictions of the counterfactual in the post-intervention period at each ...
Olive L's user avatar
0 votes
0 answers
19 views

Statistical inference in A/B testing: is it enough to compare observed test outcome to control distribution?

I want to run an A/B test to examine the effect of a marketing campaign on revenue. I’m using a synthetic control setup, hence I have to compare the revenue generated by treated units to the ...
Stefano's user avatar
2 votes
0 answers
42 views

How to handle previous interventions within the pre-period of the same time series using causalimpact?

Below you can view the univariate sales dataset for a particular product with x3 promotional interventions/campaigns (highlighted in grey and green); each promotion campaign stretched for a length of ...
d_-'s user avatar
  • 121
0 votes
0 answers
38 views

Building a Causal Impact model and Understanding the results

I work for a company that helps online retailers to group their inventory into google ad campaigns. I am using Causal Impact to determine whether the release of a new feature within our software had ...
damson_jam's user avatar
1 vote
0 answers
61 views

Should I check for autocorrelation in a Bayesian Structural Time Series Model (CausalImpact)?

Is it recommended to check for autocorrelation in a Bayesian Structural Time Series model (using CausalImpact)? If so, could I use the Durbin Watson significance table for models with no intercept to ...
user16993967's user avatar
0 votes
1 answer
87 views

Portfolio Optimization using causal inferences

I'm trying to use causal inferences in portfolio optimization and I used CausalImpact library in python because it deals with time series. I wanted to check the effect of covid19 on the daily closing ...
ImalUbay's user avatar
0 votes
0 answers
74 views

CausalImpact (using BSTS) vs Synthetic DID (using linear regression) vs Deep Learning to forecast the counterfactual

Average treatment effect estimates for panel (timeseries) data follow the same underlying approach: Use pre-treatment values of all units and covariates (and in some case post-treatment values of non-...
GuSuku's user avatar
  • 233
0 votes
0 answers
26 views

What is most appropriate Difference in Difference estimator for controlling time varying covariates except TWFE

Due to limitations of two way fixed effects model in staggered settings. What is the most appropriate Difference in Difference estimator for controlling time varying observed confounders/covariates. ...
Scholar's user avatar
  • 11
0 votes
0 answers
53 views

Causal inference using dowhy (do calculus into conditional probability)

I have a causal graph which you can see in the figure where y is my outcome, w0-w4 are the confounders, x0-x1 are direct effects, z0-z4 are instrument variables or covariates and v0 is my treatment. I ...
Asha Choudhary's user avatar
0 votes
0 answers
29 views

Can I use a univariate time-series as an input for CausalImpact library in python?

I am working on an issue where something new was launched on the website for the whole population (so no control group) without any A/B test. In order to understand the impact of the launch, I decided ...
Swasti Saxena's user avatar
0 votes
0 answers
64 views

How to do Causal Inference for Observational Data [Supply Cain]?

Problem statement: Understand what factors impact the different operational times in a supply chain warehouse operation. I have observational data (past 1 year) which contains number of orders, ...
Shivam Bindal's user avatar
0 votes
0 answers
16 views

Estimate effect of intervention with only partial comparison group

I work in public policy, and our goal is to evaluate the effectiveness of an intervention that prevents a type of violence. The intervention has been running for a couple of years, and of those who ...
matt5m's user avatar
  • 21
1 vote
1 answer
199 views

CausalImpact analysis giving bad predictors

I am quite new to causal impact. I have been using the python package 'causalimpact' since I read good feedback online and decided to give it a go. For context I am trying to check the impact of a ...
Daniel DIaz's user avatar
5 votes
1 answer
525 views

How to output treatment for predicted CATE using CausalForest using DoWhy in python?

I am new to Causal Inference but working on my first project. In this project I have a continuous treatment such as discount%. My outcome or Y is the ...
titutubs's user avatar
  • 193
1 vote
0 answers
41 views

Choosing the correct set of covariates (i.e. confounders) for inverse probability weighting

I use inverse probability weighting (IPW) to estimate the impact of a marketing intervention in the retail industry. There is a test group of stores and a control group of stores, and the ...
Iterator516's user avatar
2 votes
1 answer
133 views

ignorable assignment mechanism in causal studies

In the causal studies, there is so-called ignorable assignment mechanism. For instance, The vast majority of causal studies assume certain versions of an ignorable assignment mechanism, where the ...
user3269's user avatar
  • 5,034
0 votes
0 answers
101 views

CausalImpact: How to validate the model using multiple controls

I'm using CausalImpact lib for estimating the results of the marketing campaign. I'm providing several control time series as a model input. As I read in causal impact - adding multiple control groups ...
Elena Ivashkovskaia's user avatar
1 vote
1 answer
86 views

Inference Modeling for COVID Data

I am trying to build a model to analyze the relationship between COVID-19 mortality rate in each U.S. state or county (y) and independent variables (x) including: Vaccination rate: 1st, 2nd, booster ...
A BeauTifful Life's user avatar
0 votes
0 answers
127 views

Adding holiday effect to CausalImpact model

I'm using CausalImpact to measure the impact of Marketing campaigns in one market but I would like to include the holidays that are unique to that market so that they are not considered as an uplift ...
nescobar's user avatar
2 votes
0 answers
142 views

Causal impact: noisy controls lead to strange results

I am using R causal impact to measure the effect of a campaign intervention. Doing some tests, I found some consistent but very strange results. What I did is to generate a time series with weekly ...
Javier Portillo's user avatar
1 vote
0 answers
142 views

Methods for evaluating a geo-experimental research design (DiD, CausalImpact or a third option?)

I'm doing my undergraduate thesis on an experimental design of the incrementality of clicks using Google Ads vs not using Google Ads. I've created a geo-experimental design, where I've made a split of ...
Typeand19's user avatar
0 votes
0 answers
44 views

What is the right econometric model to use

I want to evaluate how the cultivation of a particular crop has impacted several socioeconomic variables at the municipality level. I have a map that identifies the municipalities where this crop can ...
Ana's user avatar
  • 1
0 votes
1 answer
117 views

Causal impact: how can i determine the incremental impact of campaign 1 when campaign 2 was so live in same markets and dates?

0 I have a theoretical / stats related question. I've run the package in R and it's easy. Question: How can I know the incremental impact of Campaign #1 during a period when Campaign #2 was also ...
AdilK's user avatar
  • 113
3 votes
1 answer
733 views

Can we talk about statistical significance using Bayesian Inference?

In short: can we use the words statistical significance when interpreting the hypothesis testing results in the bayesian inference field ? Or is it only correct to use it in the frequentist approach ? ...
greenglas's user avatar
0 votes
1 answer
141 views

Causal Inference where the treatment assignment is randomized

I have mostly worked with Observational data where the treatment assignment was not randomized. In the past, I have used PSM, IPTW to balance and then calculate ATE. My problem is: Now I am working on ...
manish Prasad's user avatar
4 votes
1 answer
400 views

Custom model using BSTS does not match with CausalImpact in R (please help!)

I am trying to match the results from using CausalImpact with those from using BSTS for a custom model. I followed exactly what the package instruction says but the results completely do not match. ...
Kang Inkyu's user avatar
1 vote
0 answers
244 views

CausalImpact package - results summary inconsistent with the result plots

I'm trying to get some experience with the `CausalImpact` [package][1] in python. I'm using this seemingly simple example: ...
Optimesh's user avatar
  • 163
0 votes
0 answers
357 views

Causal Impact confidence interval and statistical significance

I am analyzing effect of a regional marketing campaign using the causal impact R package. I am getting posterior tail-area probability p: 0.02951, which I understand should be a significant result. ...
FHTE's user avatar
  • 1
1 vote
0 answers
109 views

Evaluating causal impact of a treatment at various time units

I am trying to understand the causal impact of a treatment (T) that can be offered to people at different (and multiple) days until a desired outcome is reached. (for ex: a customer may be offered a ...
Fiori's user avatar
  • 81
0 votes
1 answer
117 views

CausalImpact for a single individual time series of physiological data

I am using CausalImpact for the first time and I am not completely sure whether it would be statistically correct for my case. We wanted to test if the change of enclosure did significantly impact the ...
Rosana's user avatar
  • 1
0 votes
0 answers
84 views

Picking a suitable performance metric when comparing the same model but using different sets of training data (Causal inference model)

I am comparing the same models prediction accuracy (Causal Impact) using different control variables as predictors and looking for a metric to decide which set of controls to use. Reading into AIC and ...
DataKing's user avatar
0 votes
1 answer
1k views

Generalized difference-in-differences where all units are treated, but at a different intensity

Is it possible to run a generalized difference-in-differences analysis where all units are treated, but at a different intensity? In my situation, a policy was introduced in 5 countries, designed to ...
Andrew's user avatar
  • 1
2 votes
1 answer
521 views

Inferring causal effects on a time series from a forecast

Part of my job is measuring the effect of marketing interventions using experiments when possible, or estimating their effect when it's not possible to experiment. I know relatively little about ...
kaydee's user avatar
  • 23
3 votes
1 answer
2k views

Difference-in-differences: dynamic treatment group/timing

I want to use difference-in-differences (DiD) to estimate a treatment effect. However, my problem is a little different from the standard DiD application in that: The items in the treatment group may ...
dingx's user avatar
  • 220
2 votes
0 answers
168 views

how to measure the causal impact of interventions which happen at different times on different time series?

My data consists of a bunch of time series of daily clicks on some merchandises on a website, a portion of which have an intervention (only 1 intervention per time series), others don't. The ...
contentortilla's user avatar
2 votes
0 answers
68 views

how to get the confidence interval of accumulative effect when using Difference-In-Difference

say i have a dataframe like below: ...
dingx's user avatar
  • 220
1 vote
1 answer
134 views

Causal Inference on test scores

I administered a test and wanted to know if the exam scores were influenced by watching videos. The participants were randomly entered into 2 arms. I have one control arm that did not watch videos, ...
user1449249's user avatar
2 votes
1 answer
205 views

Difference in difference with similar units over 2 periods of time

I have ESG (Environmental, Social & Governance) scores for 20 companies over a period of 10 years. In the fifth year a policy was introduced and I want to estimate the impact/effect of the policy ...
Frank's user avatar
  • 21
5 votes
2 answers
343 views

causal impact estimation

say i have following causal model: outcome variable: Y (e.g. sales) treatment variable: T (e.g. price) covariate variable: x2 (e.g. traffic) unobserved variables: U (unobserved) causal relation: ...
dingx's user avatar
  • 220
2 votes
0 answers
238 views

how to run causalImpact on a time series with multiple interventions?

In CausalImpact package, one defines pre-period and post-period for a single intervention. However, in the scenarios where there are multiple interventions at irregular time intervals, is there a way ...
santoku's user avatar
  • 201
0 votes
0 answers
121 views

Why diff-in-diff over regression with control variable for measuring treatment intervention in time series?

Let's suppose we have a time series data set, with an intervention period for the treatment where the mean of the independent variable increases by 10. The goal is to measure the effect of the ...
mcnittycomittee's user avatar
1 vote
1 answer
221 views

CausalImpact plot upper and lower bounds

Below is a screenshot of causal impact result. Upper and lower bounds of point wise results plot hovers around 10k and -10k. In summery statistics, sd shows 1879 with 95 CI of -4674 and 2736. Is the ...
svl2019's user avatar
  • 11
0 votes
1 answer
315 views

CausalImpact estimates a statistically significant impact for multiple intervention-free validation periods

While trying to validate the estimated impact by CausalImpact package I ran backtests on several dummy pre and post time-periods prior to the actual intervention but ended up with statistically ...
Laura Pereira's user avatar
1 vote
1 answer
590 views

Causal impact R - Is it possible to model multiple the pre and post periods? Indivudally for participants

I would like to use the causal impact algorithm, however, not in the context of marketing, but in medicine. The problem is that the intervention does not take place at the same time, but on an ...
Julia's user avatar
  • 11
3 votes
1 answer
5k views

Staggered Difference-in-Difference: Multiple Treatments Equation

I wonder if you can help me to figure out how to rewrite the basic difference-in-difference equation (pictured) so that it takes into account the fact that treatment has occurred at different times ...
Daria's user avatar
  • 33
1 vote
0 answers
133 views

Combine Different Metrics to CausalImpact

I am currently trying to understand the Google package of CausalImpact, to be more concrete the python implementation. My current state is that I have for example the sales of a car on different ...
yoko's user avatar
  • 111
0 votes
1 answer
168 views

How to test the stability assumption when using the CausalImpact package in R?

In the case of CausalImpact it is assumed that the relationship between covariates and treated time series, as established during the pre-period, remains stable throughout the post-period. Why is it ...
Thomas's user avatar
  • 1
1 vote
0 answers
215 views

How to use CausalImpact in R to construct an interrupted time series model with >2 periods of interest?

I would like to conduct an interrupted time series analysis on data with three time periods: Pre intervention During intervention Post intervention My outcome variable is a continuous biological ...
mkpcr's user avatar
  • 143
1 vote
0 answers
130 views

Logistic Regression Coefficient Intrepretation - Impact On Churn

I am using logistic to see the relationship between churn and minute seen. I get something like this ...
James Taylor's user avatar