Tagged Questions

A treatment effect is the causal effect of some "treatment" or policy intervention on an outcome variable. Such effects can be estimated with data from randomized or quasi experiments, and clinical trials or with observational data and methods for causal inference.

learn more… | top users | synonyms

1
vote
0answers
13 views

Creating a treatment group to measure uplift in sales for an advertising campaign

I have sales by state and week. Alabama|Alaska|Arizona|... 231|139|277|... 256|154|307|... 267|160|320|... 256|154|307|... 267|160|320|... I need to create a treatment group that bunches up the ...
0
votes
0answers
10 views

test to be applied

I have applied 3 treatments at 10 different concentrations of each on a bacteria to see if they affect its existence. my response variable is binary i.e. 1 for effective and 0 for ineffective. basic ...
1
vote
1answer
47 views

Interactions in Propensity Score Models

I am doing an analysis to see if a first-year seminar has an effect on student retention in college. Students choose whether or not to enroll in the seminar on their own, so it seems like it makes ...
0
votes
2answers
15 views

Multiple drug treatment effects

Suppose I have five vitamins VA VB VC VD VE, and wish to study the effects of each drug on the weight of patients with data measured at daily frequency. The typical data look like this Patient 1 take ...
2
votes
1answer
39 views

Propensity Score Analysis with continuous treatment

I have an observational dataset of about two dozen observed variables (continuous or discrete), plus a continuous variable of which I would like to measure the causal impact of on my dependent ...
0
votes
0answers
11 views

Two repeated measures treatment analysis. Regression of the delta or mixed effect model?

We want to study the effect of a certain treatment on performance on a test and I would like to have some suggestion from you. We want to use a regression model in order to control for confounders. ...
3
votes
0answers
62 views

Why do my boostrapped CI's (using boot.ci in R) not include the point estimate?

I'm interested in estimating an average treatment effect $$ \operatorname{ATE}\left(A', A''\right) = \mathbb{E}\left( Y\ |\ A'' \right) - \mathbb{E}\left( Y\ |\ A' \right) $$ with a generalized ...
1
vote
1answer
29 views

Difference in difference model with 2 treatment groups

I have an experiment which has 2 treatment groups(effects) and a control group. Up until this point in my analysis, I've been carrying out a DID using a regression equation of the form: Y= γD_t + ...
1
vote
1answer
39 views

Is there such thing as correlation trees? Clustering rows of X based on correlation between A and B

I have been searching for several days for a method that fits this description, though cannot find one. I'm pretty sure it must exist. The problem (short version): I'd like to run something like a ...
1
vote
0answers
27 views

Constructing Counterfactuals and Estimating Prevalence

I'm a social scientist working on a research project where I try to estimate the prevalence of lying in responding to a certain sensitive question. The way I estimate it is to rely on a ...
0
votes
1answer
105 views

Confused about the basic maths in Incremental/Uplift modelling

I have recently gotten to study Incremental modelling, which is used in Marketing to study the incremental impact of a certain action on a treatment group against a control group. However, I am very ...
5
votes
0answers
88 views

Propensity Score Matching – How do the mechanics lead to a different result than unmatched?

The gist of propensity score matching, as I understand it, is as follows: You want to estimate the average treatment effect (ATE) of a treatment on some outcome. However, if you simply calculate the ...
1
vote
1answer
43 views

Pre-post treatment design: accounting for reduced effect of treatment in baseline high scorers

I'm planning a study in which I want to test the effect of a treatment on a dependent psychometric variable. I expect subjects who score lower at baseline to benefit more from the treatment (larger ...
0
votes
0answers
111 views

Modeling Difference-in-Difference with Multiple Treatments

I ran a field experiment across 100 cities. The cities belong to two types: Type_A(50 cities) and Type_B(the other 50 cities). From January 1 to February 30(The Pre-Treatment Period), I only collected ...
5
votes
1answer
49 views

Treatment Effect Bounds

My supervisor and I have run a randomized experiment in a developing country. Due to administrative problems there we unfortunately have the problem of non-response. This non-response is also not ...
0
votes
0answers
12 views

Two Step estimation of treatment effects

I want to estimate the treatment effect of a selection Model without a preimplemented package in R. I allready have the probit estimates for the inverse mills ratio. How can I estimate the switching ...
5
votes
1answer
79 views

Statistical tests for comparing a skewed clinical sample

I recently surveyed 350 low-income families -- they were randomly split into two groups: control and treatment. One of the variables I am very interested in is the amount of savings of each family. ...
3
votes
1answer
240 views

Hypothesis testing - Wilcoxon test, bootstrapping, or something else?

A colleague has developed a treatment for to "prevent falls" in cognitively impaired, psychiatric patients. Since this would be very useful treatment in this population, we especially do not want to ...
0
votes
0answers
29 views

Standard deviation of lift

I am trying to calculate the standard deviation of lift given treatment and control groups, and the respective response values, which are binary, for each entity in the groups. Here is the problem in ...
1
vote
0answers
19 views

Measuring treatment effect on top-ranked subjects selected at point in time from longitudinal data

I am trying to measure the effect of treatment after some time on a group of subjects who were selected for treatment because they were the highest (top 1200) ranked subjects during a single period ...
8
votes
2answers
236 views

Using control variables in experiments?

Why would one want to control for any number of baseline covariates in a situation where the assignment to treatment group is random? My understanding is that randomly assigning treatment should make ...
1
vote
0answers
15 views

Inferring treatment start date for comparison group

I'm trying to work out the effect of treatment on a group using a counterfactual approach. However, I don't know how I can infer the treatment start date for the comparison group. For both groups I ...
2
votes
0answers
27 views

Family-wise error of dependent tests?

Say you have a drug of which you want to test wether it increases the number of immune cells in your blood. You divide your sample in two groups where one group receives the treatment and the other ...
1
vote
1answer
103 views

Endogenous treatment effects: exogenous covariates

I am interested in estimating an endogenous treatment effects model of the following form: \begin{eqnarray} Y_i = \alpha + \beta_x X_i + \beta_{z1} Z_{1i} + e_i \\ X_i = a + \beta_{z2} Z_{2i} + v_i ...
2
votes
0answers
72 views

Simulation setting for the average treatment effect on the treated (ATT)

I have a question about a simulation set up. Assume there are two groups (Z = 0 and Z = 1). The outcome for Z = 0 and Z = 1 are generated by the following equations: $Y_0 = \alpha_0 + ...
2
votes
0answers
111 views

Constructing the OLS standard error by hand to avoid regression

I am having trouble deriving the standard error of a simple regression estimator by hand. Stata code and output for a toy example using the cars dataset is below. The basic idea is that I have a ...
3
votes
1answer
83 views

How to correctly measure effect on heavy-tailed distribution

I ran an experiment on my website where I randomly assigned users to either the treatment or control group, and have two questions about how to correctly compute significance of the results. Some ...
1
vote
0answers
113 views

What to input into Wilcoxon rank sum test when three pre and three post measurements are compared?

I have measured 23 patients three times pre and three times post treatment. Now I would like to see if the treatment had a significant effect. I thought about using a Wilcoxon rank sum test for this ...
1
vote
0answers
37 views

Weighting FE regression with full matching

I have a dataset that has been partitioned into propensity-score-based matching groups using the optmatch package in R. We used full matching, so this allows any number of treatment observations to be ...
1
vote
1answer
90 views

Controlled before-and-after

I've got a study, a before-and-after controlled design. I have pre-intervention data and post-intervention data, the intervention is an educational intervention, given to general practitioners and ...
0
votes
2answers
383 views

R Package for Treatment Effect Analysis?

I could not find a package in R about Treatment Effect Analysis. So is there a R package about Treatment Effect Analysis? This means, estimating the average treatment effect, average treatment ...
2
votes
1answer
95 views

Treatment effect Analysis: What is Stratification and explanation/interpretation?

In this paper by Angrist a stratification estimator is used (page 16 formula (4)) to calculate the Average Treatment Effect on the Treated (ATOT). The formula is given by: \begin{align} ...
0
votes
2answers
482 views

Plot normal probability for effect estimates in factorial design in R

I have 2 level Design (DOE) with 4 factors (A,B,C,D). I've already calculated the estimates for each main effect and all the interaction effects. How can I construct the normal probability plot to ...
2
votes
1answer
133 views

How to test significance of pre-post difference scores on 8 measures (1 group)

I have a set of pre and post treatment scores on 8 measures. I'd like to test which of these show significant improvement after treatment. If I use within-subjects t tests it will mean carrying out 8 ...
3
votes
1answer
418 views

Significant difference from regression confidence intervals

I have a question about statistical significance in relation to confidence intervals from linear regression. I'm obviously far from a stats expert, and I've been searching for the answer to this, ...
2
votes
0answers
71 views

Heterogeneous Treatment Effects - How to test differences in the ATE?

I want to conduct a simple propensity score estimation where the treatment $D_i$ is a binary variable ($D_i=1$ individual $i$ participates in the labor market program, zero otherwise). I estimate the ...
2
votes
1answer
97 views

multiplicative treatment effects with standard errors

I simplified this a fair bit after finding a draft version of the Imbens and Rubin chapter. I am interested in estimating a constant multiplicative treatment effect from a randomized experiment. I ...
1
vote
1answer
790 views

Deriving effect sizes form pre-post treatment design in R?

This question is related to my previous post. In case of a meta-analysis of a pre-post treatment design I have data given from 5 studies that tested subjects pre- and post-treatment on a continuous ...
1
vote
2answers
95 views

What would be the most appropriate significance test for my scenario?

I have three groups of users $-$ $G1$, $G2$ and $Control$. The users in each of these three groups are different but are carefully selected and have similar properties. I treat each group with a ...
1
vote
0answers
19 views

Using non-treatment factors to rank patients for receiving a treatment

I'm facing a problem and am wondering if the biostats community may already have a method for it that I just haven't heard about in my field. I am doing some work with a test vs. control group and a ...
0
votes
0answers
109 views

Test for differences between treatment groups over time?

I have two treatments (rodent poisoning quadrats ($n=5$) and non poisoning quadrats ($n=5$)) and for each treatment I survey the number of individually identified invertebrates appearing across time ...
4
votes
3answers
278 views

Can p values be used to show impact of treatment

Does it make sense to use the differences in p value to show a tendency or the 'importance' of the effect of a treatment. for example, I have treated a contaminated soil and I test the treatments ...
2
votes
1answer
805 views

Testing the significance of differences in frequencies across treatments using $\chi^2$ test

I've run a small experiment and need to test the data by comparing the frequencies of different treatments, specifically, whether they are significantly different. I think the chi-squared test is ...
2
votes
1answer
828 views

Standardized mean decomposition (Oaxaca-Blinder decomposition)

How does standardized mean decomposition differ from the simpler dummy variable regression? How does the average in mean outcomes or interpretation of results attributable to a particular treatment or ...
3
votes
2answers
274 views

Seasonality of treatment and Average Treatment Effect

I have panel data of sales for many stores in two comparable cities. One of the cities holds a special event once a month (the treatment) which is expected to boost sales across the board on that day. ...
1
vote
0answers
123 views

Testing endogeneity against decision probability

I am working with a model where the literature suggests there is potential endogeneity between the dependent variable and the primary independent variable of interest (a binary treatment). However, ...
0
votes
1answer
788 views

When can I suppress the intercept using treatreg?

Can I suppress the intercept if I know the treatment will be zero if the independent variables are zero. Also, can I suppress the intercept if I know the right hand side of the primary regression ...