Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [treatment-effect]

A treatment effect is the causal effect of some "treatment" or policy intervention on an outcome variable. Such effects can be estimated with data from randomized or quasi experiments, and clinical trials or with observational data and methods for causal inference.

6
votes
0answers
365 views

Propensity Score Matching – How do the mechanics lead to a different result than unmatched?

The gist of propensity score matching, as I understand it, is as follows: You want to estimate the average treatment effect (ATE) of a treatment on some outcome. However, if you simply calculate the ...
4
votes
0answers
416 views

Panel data regression on the effect of a treatment without control group

I have a panel data set. The dependent variable is a certain numerical score for each individual and time period. I have a number of independent variables that vary by individual, by time, or by both. ...
4
votes
0answers
363 views

Why do my boostrapped CI's (using boot.ci in R) not include the point estimate?

I'm interested in estimating an average treatment effect $$ \operatorname{ATE}\left(A', A''\right) = \mathbb{E}\left( Y\ |\ A'' \right) - \mathbb{E}\left( Y\ |\ A' \right) $$ with a generalized ...
3
votes
0answers
69 views

How to deal with treatment effects that occurs multiple times at different time for each individual ID

I've been searching for a long time for this issue and couldn't find the proper answer so I post a question here. Here I put the data set example first. ...
3
votes
0answers
96 views

Family-wise error of dependent tests?

Say you have a drug of which you want to test wether it increases the number of immune cells in your blood. You divide your sample in two groups where one group receives the treatment and the other ...
3
votes
0answers
348 views

Heterogeneous Treatment Effects - How to test differences in the ATE?

I want to conduct a simple propensity score estimation where the treatment $D_i$ is a binary variable ($D_i=1$ individual $i$ participates in the labor market program, zero otherwise). I estimate the ...
2
votes
0answers
11 views

Comparing two difference-in-difference models when making the treatment group larger

I have a question regarding some potentially existing empirical tests in the difference-in-difference context. Assume that I have the usual setting of observing some hypothetical outcome for a ...
2
votes
0answers
530 views

Parallel trend assumption in difference-in-differences

I want to run a difference in difference model to evaluate the impact of a policy change using panel data with 30 individuals in the control group and 35 individuals in the treatment group. When ...
2
votes
0answers
478 views

Computing and interpreting treatment effects for binary outcome using multiply imputed and matched data

I am using genetic matching, implemented through the MatchIt package (dependent on Matching and ...
2
votes
0answers
312 views

Before and after effect with logistic regression, what method to use?

So I have a test subject A which consist of a binary variable 0 and 1. I want to see if this binary variable is decided by some independent variables (plus interactions) which are continuous, which in ...
2
votes
0answers
546 views

Which is the best approach? Difference in Difference with Heterogeneous Effects

I am interested in the performance of two competing approaches to estimate a treatment effect, for which one would expect heterogeneous effects. The point of origin is a treatment conducted from ...
2
votes
0answers
178 views

How to set sum contrasts for unbalanced factors

Let's say that I have a model where the response time depends on accuracy (0/1, coded either as categorical or numerical) and another categorical variable (pres: idem/diff), both interacting with the ...
2
votes
0answers
65 views

Repeated measures binomial effect confidence intervals

I have a repeated measures study design with two separate conditions in a memory task where one must recognize previously seen items in a list. The conditions are concrete vs. abstract. I'd like to ...
2
votes
0answers
282 views

Simulation setting for the average treatment effect on the treated (ATT)

I have a question about a simulation set up. Assume there are two groups (Z = 0 and Z = 1). The outcome for Z = 0 and Z = 1 are generated by the following equations: $Y_0 = \alpha_0 + \beta_{01}*{x_1}...
2
votes
0answers
293 views

Constructing the OLS standard error by hand to avoid regression

I am having trouble deriving the standard error of a simple regression estimator by hand. Stata code and output for a toy example using the cars dataset is below. The basic idea is that I have a ...
2
votes
0answers
161 views

Testing endogeneity against decision probability

I am working with a model where the literature suggests there is potential endogeneity between the dependent variable and the primary independent variable of interest (a binary treatment). However, ...
1
vote
0answers
25 views

Best method to investigate treatment effect after creating a Matched control group using Gentic Matching (with replacement)?

Project background: I have data on patients who received varying amounts of therapy dose during treatment of stroke-induced paralysis. I wish to investigate if there are differences in motor-function ...
1
vote
0answers
16 views

Treatment effect estimation: year is treatment

I want to estimate the effect of tax increase on the consumption at the regional level. I have 100 regions in pre-treatment period (year 2010) and the same regions in post-treatment period (year 2011)....
1
vote
0answers
42 views

Difference-in-differences model with time-fixed effects only

Assume that we have a panel data set with individuals' income (Y) over multiple years and a certain event (POST) in one year that is hypothesized to affect Y for a subgroup of these individuals (TREAT)...
1
vote
0answers
29 views

Pursuing meaningful questions about pre- post- intervention outcome measures in single condition treatment

If you are not fortunate enough to have a control group and have a single condition only, what meaningful questions can you ask about the change in pre to post intervention scores? If ANOVA or ANCOVA ...
1
vote
0answers
63 views

Stabilized propensity weights: intuition and ATT formula

The average treatment effect (ATE) of binary treatment T on outcome Y can be estimated using inverse propensity weights: \begin{equation}\nonumber \frac{\sum_{i=1}^{N}t_i\hat{\pi}_i^{-1}y_i}{\sum_{i=...
1
vote
0answers
45 views

Linear Regression: Calculating a treatment effect directly in regression vs. averaging potential outcomes

Suppose I have the following true model, where an individual $i$ at a particular point in time $t$ is either treated ($W=1)$ or untreated ($W=0$). The outcome for individual $i$ at time $t$ under ...
1
vote
0answers
12 views

Sample selection in difference-in-differences

I have a dependent variables with a significant amount of zeros (and the share of zeros is different between the control and treatment groups, and changes between the pre- and post-treatment periods). ...
1
vote
0answers
31 views

Treatment (equivalent to experimental groups) in Experiment as Fixed AND Random Effect in Mixed Model Linear Regression

I have data from a sociology experiment with three groups. Each group is equivalent with a different treatment for a subject (n=700). The treatment were surveys, differing in the amount of information ...
1
vote
0answers
178 views

Difference-in-differences with unbalanced panel data

I am working on a quasi-experimental study with a large unbalanced panel dataset. There are N=300,000 and T=20, where roughly 50,000 individuals receive treatment since several different periods. I ...
1
vote
0answers
20 views

Randomized Treatment within treated group

I don't know if this situation has a particular name. I'll just give the example and my question. Suppose we have two naturally concurring groups, $A$ and $B$. By that, I mean there is a naturalistic ...
1
vote
0answers
63 views

Post dummy in multiple groups and time periods DiD estimation

I have a question regarding an answer of another question posted here. My dataset seems comparable and has different policy treatment timings for different firms. The answer outlines how to construct ...
1
vote
0answers
55 views

Performing a two-way ANOVA, I get a non significant Levene's and a significant interaction effect. What it the next step?

In the case described above, our Professor instructs as to interpret the simple effects by using MSwithin of the two-way ANOVA. In case the Levene's test is significant though, he instructs us to ...
1
vote
0answers
296 views

What distinct matching routines do exist?

In a seminar paper I'm discussing all possible matching routines. It turned out that there are quite many of them. Now I am looking for several answers: First, I discovered that some routines happen ...
1
vote
0answers
957 views

How to assess for balance of propensity score matching covariates in Stata?

I am comparing outcomes of a treated cohort (n=127) to a control cohort (n=732) using teffects propensity score matching in Stata. I did initial comparisons of baseline characteristics between the two ...
1
vote
0answers
468 views

Difference in difference model with multiple time periods and treatment/control pairs

I am trying to estimate a difference in difference model with 10 time periods (t=10) and many different plots of land, which are the unit of observation. Each plot of land which becomes treated at ...
1
vote
0answers
136 views

Interpreting DD estimates in terms of their economic magnitude

I'm currently doing the statistical part of my final thesis and I am having troubles with correctly interpreting my regressions results. The models I am using (with the plm package in R) are pretty ...
1
vote
0answers
35 views

Combing panel data with cross -section counter-factual?

I have a panel dataset of a treatment group with no control group panel. It has been proposed to me that I use cross-section from a a national survey, taken at baseline and same time as post-...
1
vote
0answers
267 views

Calculating the CACE using instrumental variables

In randomized trials with non-compliance among the treatment group, a common estimator is the Complier Average Causal Effect (also called the Local Average Treatment Effect), which (conditional on a ...
1
vote
0answers
20 views

Matching / imputing between experimental and control group on a specific (i.e. latent) variable

I am currently researching the impact of survey participation on subsequent behavior, i.e., does merely participating in an intention survey about fitness products influence post survey spending. As ...
1
vote
0answers
232 views

Longitudinal measures mixed model in lmer in R

I would like to build a mixed model using the lme4 package in R. The study design is like this: We have measured the change in a variable over time in mice under different Diets. The mice under ...
1
vote
0answers
233 views

Control group construction in Synthetic Control Method

I want to use the Synthetic Control Method to estimate the effect of the adaption of a new ballot institution (treatment) on fiscal policy. My sample consists of 20 units observed at 100 time points. ...
1
vote
0answers
5 views

Thresholds as function of treatment

Y=function of some treatment. So when a treatment is applied I want to develop thresholds(depending on some sort of variance). Any ideas?
1
vote
0answers
153 views

Substantive interpretation of main and interaction effects in nested hierarchical linear models using effect coding

I have two categorical IVs each with three levels: group (Control, Int1, Int2) and a longitudinal variable wave (T1, T2, T3). ...
1
vote
0answers
34 views

Two years of data with pre/post, need to figure out size of impact

I have 2 data sets: 2013-14 and 2014-15. Each year has pre and post data, measuring literacy. Sample size is 101 in one year and 93 in the other. I would like to determine if 2014-15 results were ...
1
vote
0answers
38 views

Methods to deal with latent variables

I had a general question about methods to adjust for the effect of latent variables (specially variables that are suspected to be confounder) in observational studies. In particular, I'm working on a ...
1
vote
0answers
1k views

propensity score matching and difference in difference

I am trying to analyse the impact of a cash stipend program, onto child learning outcomes. I have first modeled the conditional probability of each student receiving this program. So basically I have ...
1
vote
0answers
108 views

Subject-specific graphics for repeated-measure design

I am doing linear mixed effect modelling testing the effect of treatment on pitch, with ...
1
vote
0answers
27 views

Recommendation for type of analysis to measure whether intervention is effective

I have a dataset of about 90,000 cases. In something like 10% of these cases, an intervention was applied to hopefully bring about a specific outcome. The intervention was not equally applied across ...
1
vote
0answers
170 views

Creating a treatment group to measure uplift in sales for an advertising campaign

I have sales by state and week. Alabama|Alaska|Arizona|... 231|139|277|... 256|154|307|... 267|160|320|... 256|154|307|... 267|160|320|... I need to create a treatment group that bunches up the ...
1
vote
0answers
82 views

Constructing Counterfactuals and Estimating Prevalence

I'm a social scientist working on a research project where I try to estimate the prevalence of lying in responding to a certain sensitive question. The way I estimate it is to rely on a quasi-...
1
vote
0answers
907 views

Modeling Difference-in-Difference with Multiple Treatments

I ran a field experiment across 100 cities. The cities belong to two types: Type_A(50 cities) and Type_B(the other 50 cities). From January 1 to February 30(The Pre-Treatment Period), I only collected ...
1
vote
0answers
47 views

Measuring treatment effect on top-ranked subjects selected at point in time from longitudinal data

I am trying to measure the effect of treatment after some time on a group of subjects who were selected for treatment because they were the highest (top 1200) ranked subjects during a single period ...
1
vote
0answers
34 views

Inferring treatment start date for comparison group

I'm trying to work out the effect of treatment on a group using a counterfactual approach. However, I don't know how I can infer the treatment start date for the comparison group. For both groups I ...
1
vote
0answers
108 views

Weighting FE regression with full matching

I have a dataset that has been partitioned into propensity-score-based matching groups using the optmatch package in R. We used full matching, so this allows any number of treatment observations to be ...