Skip to main content

Questions tagged [randomized-tests]

A randomized test procedure makes a random decision when the test statistic is on the fence.

Filter by
Sorted by
Tagged with
2 votes
0 answers
34 views

Best way to address selection bias when outcome cannot be randomized

I have an (low incidence) binary outcome compared between 2 groups. The intervention for group 1 is coming from a specific type of center (academic) while group 2 from a different center. It is not ...
user213352's user avatar
1 vote
0 answers
18 views

Statistical Analysis help on Randomized Controlled Trial survey data, using JAMOVI. 4 groups, each with 6 repetitions, large observation size [closed]

I made this RCT survey to test whether any change of information presented/attached to a secondhand product might change the customer’s willingness to pay on higher price level. Control group (limited ...
梁Benedictus's user avatar
5 votes
2 answers
251 views

What is the null hypothesis for a randomisation (permutation) test, how should the p-value be interpreted and what conclusions can we draw?

Terminology: The terms permutation and randomisation tests often seem to be used interchangably, but in some cases they have distinct meanings - with the meanings not always consistent. In this post ...
8e9yQBKVlIDwoIVegfkJ's user avatar
2 votes
0 answers
167 views

Time-fixed effects in a randomized controlled trial?

When analyzing the results of an RCT, it is not uncommon to see a unit (e.g. cluster) fixed effects in the linear regression model but I have never seen time fixed effects while time FEs are pretty ...
user84681's user avatar
5 votes
1 answer
163 views

How to design a randomized test?

The manufacturers of a certain brand of electrical switches claim that at least $80\%$ of the boxes, containing 12 such switches each, will have no defective. Design a randomized test of exact size $0....
simran's user avatar
  • 377
1 vote
1 answer
93 views

How to calculate p-value from the expected correlation coefficient using randomisation in R?

Here, I want to estimate the p-value using randomization. Tests of correlations involving patterns like Y (a function of X) vs. X involve a shared term and the X term. Here I want to randomize (999 ...
slicer's user avatar
  • 603
-1 votes
0 answers
41 views

A modified Lady Tasting Tea problem [duplicate]

I don't really know how to approach the following problem. We flip a fair coin for each of the eight cups and we pour milk into that cup first if the coin lands heads, else we pour tea first. Then by ...
Waikiki's user avatar
0 votes
1 answer
258 views

A variation of the Lady Tea Tasting problem [closed]

I am quite stuck on this question. My intuition would have been to say that we would prefer to pour milk first on heads, but I am not sure. The setting is: the Lady guesses "milk first" in 2/...
Waikiki's user avatar
2 votes
1 answer
52 views

We know that someone identified correctly 3 out of 5 of wines he tasted. How can we answer if he can do that consistently with randomisation testing? [closed]

I don't know what should i choose as a control function for that problem. Thanks for your time.
Δημήτριος Φούντας's user avatar
2 votes
1 answer
524 views

Treatment and control group balance in ATE estimation with regression

I have a (probably) stupid question but I am still actively learning about causal inference and maybe I am not getting how the pieces do connect together. I came across different methods for ...
Andrea's user avatar
  • 21
2 votes
1 answer
154 views

Appropriate model choice for analyzing many repeated measurements in the context of a parallel arm randomized controlled trial

Background I am conducting a parallel-arm randomized controlled trial comparing Treatment A against a Control. Each week for 10 weeks I measure anxiety in each group each week (giving a total of 10 ...
pomodoro's user avatar
  • 803
1 vote
0 answers
100 views

Can I pool together data from two seperate RCTs of the same intervention when I have access to both datasets? If so, what analysis is appropriate?

Background I have available the data from: A parallel arm RCT of Intervention A compared to a control group that was conducted several years ago. The primary outcome is a difference in the post-...
pomodoro's user avatar
  • 803
0 votes
1 answer
30 views

Compute-intensive randomized *unpaired* t-test (without paired samples)

Yeh 2000 section 3.3 cites Noreen (1989) and Cohen (1995) for compute-intensive, versions of paired t-tests, which are stonger because they don't make parametric assumptions. However, these tests ...
Joseph Turian's user avatar
1 vote
2 answers
501 views

Bias of difference-in-means estimator for experiments randomized using Bernoulli trials

Under potential outcomes framework (Neyman-Rubin causal model), it is straighforward to show that difference-in-means is an unbiased estimator of average treatment effect under completely randomized ...
shomi's user avatar
  • 13
2 votes
1 answer
964 views

Estimating the Local Average Treatment Effect (LATE) and always-takers

I am new to statistics and am particularly interested in RCTs so this is a very basic question. If I have a program wherein 10% of my control group had access and used the treatment, how would that ...
Magic's user avatar
  • 21
1 vote
1 answer
88 views

Is it possible to to have more than 2 groups for biased coin randomization? If no, is there any modifications supporting multiple groups?

Is it possible to have more than 2 groups for biased coin randomization? If no, is there any modifications of biased coin randomization supporting multiple groups? This is my R code for generating ...
vasili111's user avatar
  • 1,079
0 votes
0 answers
19 views

D+R: How many randomized trials to determine the D value?

I have an unknown fixed integer D. N binary random variables R were added to D. In each randomized trial we can observe the sum D+R. But we don't know D and we don't know the R's outcome in each ...
B Abali's user avatar
  • 101
0 votes
2 answers
127 views

Using a randomization to compare frequencies in two groups?

I have a dataset of males and females and whether they dispersed (yes = 1). For example: Male 0 Male 0 Male 0 Male 0 Male 0 Female 0 Female 1 Female 0 I'...
Quinn's user avatar
  • 23
1 vote
0 answers
32 views

Is a group structure required for randomization tests?

In randomization tests (for example in Testing Statistical Hypothesis Theorem 15.2.1 Lehmann and Romano) it is required that we have a group of transformations $\mathbf{G}$ on which $X$ and $gX$ have ...
is it normal's user avatar
0 votes
0 answers
352 views

3 plants per pots - 6 pots per treatment - replicates and pseudoreplicates

I'm currently working on the statistical evaluation of an experiment. Certain products have been tested towards their influence on plant growth. Description There are 12 treatments in total and each ...
Ttam's user avatar
  • 1
4 votes
1 answer
79 views

A basic question about a randomized test involving the error type I

I have a basic question in the context of testing statistical hypotheses, more specifically, about randomized tests. Suposse that I have two actions (altenatives) about a certain unknown parameter $\...
Fam's user avatar
  • 1,007
3 votes
1 answer
798 views

AB testing with group level randomization

I am working on a consulting project where my client wants to perform AB testing in order to improve their service which involves outbound communication to clients. Their clients are (structurally) ...
user3903581's user avatar