Questions tagged [control-group]

In a comparative experiment a control group is one which does not receive the active treatment

Filter by
Sorted by
Tagged with
0 votes
1 answer
28 views

Comparing intervention/control group

I am planning to conduct a study which is based on an RCT design. I am intending to conduct an intervention. During this intervention, participants and control group enter some medical data on daily ...
user avatar
  • 3
1 vote
1 answer
32 views

How does one define what measure to use for a Regression Discontinuity design?

For example I am looking at the effectiveness of a reading learning program for 3rd graders. How do I define an acceptable cutoff measure? Do I look at accepted reading assessment tests, such as ...
user avatar
2 votes
1 answer
23 views

Limits to how many control and treatment subjects may be paired in propensity score matching?

I'm working on a difference-in-differences project where we're matching up to 5 control subjects to each treatment subject using a combination of techniques to estimate treatment effects (ATT): exact, ...
user avatar
  • 4,514
1 vote
1 answer
57 views

Difference-in-differences if the control group is treated later

Would a difference-in-differences analysis still tell me something important if the control group was treated later in time? Or, would I be better off only restricting my analysis to the time frame up ...
user avatar
  • 33
1 vote
3 answers
219 views

P-value of chi-square test of independence

I need help understanding chi2 independence test scipy.stats.chi2_contingency. Let's assume I have two samples (of different sizes) of a categorical variable with 3 possible outcomes (1, 2, 3): Counts ...
user avatar
  • 215
0 votes
0 answers
46 views

Matching fixed control group to multiple time-varying treatment events so that each control is only used once/uniquely assigned

you have helped me tremendously over the past years and so far, I could find an answer to any the question I had! Thanks to anyone active in this community, I don't know what I would have done without ...
user avatar
  • 1
0 votes
0 answers
33 views

Distinction between Treatment and Control Group

I am struggling to understand how to interpret the treatment and control group in the following case of DID regression. We need to estimate the causal effect of brick kilns on downwind PM2.5 monitor ...
user avatar
  • 1
1 vote
0 answers
15 views

Identifying groups with better response to treatment

We have tested a population (splitted in test 50% and control 50%) with a treatment. Overall, the treatment was effective - our test variable was significantly different in the treatment and control ...
user avatar
  • 11
0 votes
0 answers
18 views

Using same control in two figures in a publication

I have a single experiment with 1 control group and 3 different treatment groups. I wonder if it is legit to plot the results in two or multiple graphs with the same control group. I am only ...
user avatar
0 votes
0 answers
34 views

Should I include the control group on a correlation matrix?

I have a dataset of variables from a control group (healthy subjects) and patients with a disease. Some variables are greatly increased in the disease group in relation to the controls, however within ...
user avatar
  • 1
3 votes
1 answer
45 views

What is the best way to compare changes between two groups?

Given we have two equal-sized groups, each with a continuous pre and post-measure. E.g., in an RCT with a treatment and a placebo group and a pre and post-intervention outcome measure, and no drop-out....
user avatar
  • 133
4 votes
3 answers
174 views

Best way to compare two treatment groups to a control

I'm trying to compare two different fertilizer treatments to a control group (no fertilizer). I ran a model like this: ...
user avatar
  • 69
0 votes
0 answers
14 views

Binomial Proportion Test on test and control populations [duplicate]

I am new to statistical tests and request your help with the following question: A company wants to test the hypothesis that it's new ad will increase it's total number of subscribers (conversion rate)...
user avatar
0 votes
0 answers
7 views

What control should I use to compare to tumor growth in mice treated with IL-17A intratumorally?

I am conducting research to answer the question, at what concentration does esophageal squamous cell carcinoma begin using IL-17A for tumor proliferation? I plan to inject the tumors in the mice with ...
user avatar
0 votes
0 answers
24 views

How to select control group if I have limited data points

We're launching a campaign and want to see the impact in consumer behavior. This is the experimental group. For choosing the control group I was thinking into checking for past data to see which is ...
user avatar
0 votes
0 answers
32 views

Which tests should i do with a control group and a experimental group with pretest-posttest design ( 2 levels)

I have an experimental design with a Control Group and a Experimental Group, i have one pretest and one posttest ( 2 levels i think i´ts called) for 5 different variables. Which tests should i run on ...
user avatar
0 votes
0 answers
84 views

How to split a population in test and control group

I have a requirement to split a population in test and control group and we have to propose the groups in terms of percentages (i.e test = 80% control = 20%). For example: If I have a population of ...
user avatar
-1 votes
1 answer
54 views

Determining sample size for comparing rate of occurrence between two groups

Scenario: You are running a comparative clinical study. A test product is being used by one portion of the population (Group T) and a control product is being used by another (Group C). The Question: ...
user avatar
  • 3
2 votes
3 answers
45 views

In a RCT, what are the risk of selection bias if no allocation bias is present?

In the Wikipedia page about Randomized Controlled Trials (RCT), the procedures section states that RCT minimize selection bias and allocation bias. My understanding is that selection bias "occur ...
user avatar
0 votes
0 answers
182 views

Treatment group size vs. Control group size for difference-in-difference estimation

I am reading an unpublished paper that employs diff-in-diff to firm data containing a total of 2598 observations. Of these observations, 2474 are in the treatment group and 124 in the control group. I ...
user avatar
  • 135
0 votes
0 answers
10 views

Testing in a model with lagged variables and control/treatment groups

Say I conduct regression: y ~ x + t + lag(y) Where y is the independent variable, x is some explanatory variable, t is a dummy variable denoting 1 if the observation is from the treatment group and 0 ...
user avatar
1 vote
0 answers
61 views

MCMC fitting of Dirichlet Process or Polya Tree prior to residuals in (simple linear regression)/(2-independent-samples) problem

Consider a simple location-shift semi-parametric model with two mutually-independent samples (in what follows, $F$ is a cumulative distribution function (CDF) on $\mathbb{ R }$, the $C_i$ and $T_j$ ...
user avatar
0 votes
0 answers
9 views

Using opted-out customer list as a control group for targeted promotions

I have a targeted email promotion list and I want to create a control group. My friend wants me to use the "do not contact/opted out" list as a control group, but I would think that those ...
user avatar
  • 1
8 votes
2 answers
181 views

How can someone improve a synthetic control?

This is a broad question, I know, but I feel like it's ok to ask because I searched everywhere and I couldn't find the answer. So I was studying about synthetic control (here: https://matheusfacure....
user avatar
  • 727
3 votes
1 answer
1k views

How to plot the graph or perform a formal test of parallel trends for generalized DiD?

A. Background: Dasgupta, 2019, p. 2596-2597 create a baseline as below to study the impact of staggered design difference-in-differences (DiD): The baseline identification: $Y_{it}$ = $\alpha$ + $\...
user avatar
0 votes
1 answer
21 views

What is the RCT design where all participants get placebo first, then non-responders get randomized to treatment?

I'm trying to find a paper documenting an RCT design where all participants start by receiving the placebo only, and then participants who do not respond to the placebo get randomized to treatment/...
user avatar
  • 167
3 votes
1 answer
333 views

How to calculate effect size for a pretest-posttest-control design study?

I am trying to calculate the effect size of exercise on depression. So I have 2 groups (control and intervention) in an RCT setting. I have both mean values and standard deviation of groups at T0 (...
user avatar
  • 115
1 vote
1 answer
18 views

Does a large control group lead to violation of assumption made to use difference-in-difference methods

Does a large control group lead to violation of assumption made to use difference-in-difference method? The control group is around 10 times larger than the treatment group.
user avatar
5 votes
1 answer
83 views

Should I plan my AB testing accordingly to a minimum number of days or to the number of datapoints?

Here's the thing, I was planning to test a new strategy on my website. A typical AB test for a new homepage. One strategy is the current, the control; the other is the variant, the new strategy. I ...
user avatar
  • 727
0 votes
1 answer
20 views

Control group participants

I have read a lot especially on RCT design but this hasnt been explicitly answered anywhere. Does the control group participants have to have 'opted-in' to the intervention and failed/not been ...
user avatar
0 votes
1 answer
128 views

Regression Model to obtain ATET

I'm working on a problem where I have two groups that both received a different treatment and one controlgroup. The total number of people in this experiment is 10,000 and the participants where ...
user avatar
2 votes
1 answer
150 views

Minimum sample size and power test

Suppose I have access to data on the energy consumption of a city with a population of 30000 persons. Imagine I want to test a new technology of smart energy, i.e if the energy consumption decreases ...
user avatar
1 vote
1 answer
38 views

Hypothesis Testing the difference in two means - Is N just the number in each group or should it also include each observation in each group?

I am working on a problem where I will be using a hypothesis test to find the difference in two means; a control group, and a test group. Each group consists of several stores where observations are ...
user avatar
  • 23
1 vote
0 answers
21 views

How to compare score differences across time using unpaired data?

An anonymous school climate survey was administered to students in 10 schools in 2017. We have student-level data from that survey, which includes each student's overall satisfaction score (scale of 0 ...
user avatar
1 vote
1 answer
41 views

Control group within the country for national policy

I have a question about control group selection. I want to evaluate a private education suppression policy. The policy is that 70% of questions of a "national" university entrance test is ...
user avatar
  • 531
1 vote
1 answer
505 views

Should the choice of propensity score matching versus weighting depend on the degree of overlapping of PS distributions?

I heard some opinions that matching is no good since it excludes some subjects. However, if we use PS adjustment or PS inverse probability weighting, is there a requirement on the degree of ...
user avatar
  • 475
4 votes
2 answers
224 views

Is it worth redoing random split several times in order to draw the 'best' control group?

My customer performs targeted marketing campaigns on subscribers. For evaluation purposes he splits target audience into target and control groups (TG, CG). He says he does this splitting randomly, ...
user avatar
0 votes
1 answer
26 views

For retrospective observational studies how to determine the baseline of control subjects

I understand that for the active treatment group you can consider the start of treatment as baseline. How about the control group? It is difficulty to do matching without resolving this problem.
user avatar
  • 475
3 votes
2 answers
203 views

Significant difference between randomized groups at baseline?

A collegaue and I are conducting a pilot study in a school, the aim of which is to assess whether an "alternative" educational tool is more or less effective than traditional teaching ...
user avatar
1 vote
0 answers
35 views

1 factor, 1 covariate, single control group. Is ANCOVA possible?

Let's say in our experiment we have three drugs (factor), each in 3 doses (covariate), with a separate group of subjects assigned to every drug-dose combination, and a single control group (no drug). ...
user avatar
  • 11
1 vote
0 answers
18 views

Comparing the significance of multiple group frequencies in R

Suppose I have sum of frequencies from 4 groups with: ...
user avatar
  • 1,288
2 votes
1 answer
929 views

What does 'control' in controlled experiment refer to?

Does 'control' in controlled experiment refer to: Having a control group for comparison, i.e "an experiment or trial that uses controls, usually separating the subjects into one or more control ...
user avatar
0 votes
0 answers
74 views

In what situations is a one sample T-Test superior to a two sample T-Test?

I'm trying to make a case for more use and respect of one-sample t-test in medical studies (which are generally looked down upon, wrongfully so imo). I see that in general medical studies prefer at ...
user avatar
  • 111
1 vote
0 answers
397 views

Confidence interval around effect size for pre-test post-test control group design

I'm evaluating different experimental studies that all included an experimental group, a treatment group and a two measurements (pre-test, post-test) and usually report the mean, standard deviation ...
user avatar
1 vote
0 answers
45 views

How to compare 2 groups to show significant differences?

I am conducting an experimental study. I have 2 groups: The first group contains 3 healthy persons and the other one contains 3 patients (sick people). For each person of the study, we collect several ...
user avatar
  • 61
1 vote
0 answers
615 views

Meta-Analysis without a Control Group

I am conducting a systematic review and meta-analysis which is investigating health-related quality of life in a particular patient population. I am having difficulties with conducting the meta-...
user avatar
1 vote
0 answers
166 views

How to measure Sales lift for a campaign without experimental design?

I want to be able to calculate Sales Lift for a campaign conducted but prior to campaign no control group was established. So, I cannot measure the impact on Sales because of campaign to treatment ...
user avatar
0 votes
0 answers
33 views

How to treat a duration of chronic disease

I have a data set that contains information about healthy dogs; dogs that have chronic heart disease; and dogs that have the same disease, but are considered as a long-livers. (All dogs in this ...
user avatar
  • 87
2 votes
1 answer
788 views

Group By and Scale Data vs Scaling Data Without Grouping

I have a panel data set that covers 20 earnings dates for 50 companies. I would like to know if I should scale data by the ticker or just scale the data without grouping. What would be the pros and ...
user avatar
1 vote
1 answer
147 views

What is the name of the "test" for testing the similarity of control group and experiment group?

In a simple statistical analysis involving a control group and an experiment group, the research must demonstrate that before the experiment, the control group and the experiment group are the same or ...
user avatar
  • 709