Questions tagged [randomized-tests]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
20 views

Compute-intensive randomized *unpaired* t-test (without paired samples)

Yeh 2000 section 3.3 cites Noreen (1989) and Cohen (1995) for compute-intensive, versions of paired t-tests, which are stonger because they don't make parametric assumptions. However, these tests ...
0
votes
0answers
20 views

Hypothesis Testing for non parametric data

Suppose that for a website page, I would like to monitor the completeness of all the page request data I received, a percentage number. (ie. For all the requests we receive, how many of them are empty ...
0
votes
0answers
12 views

How to analyze treatment efficacy for small dataset

I have baseline and post-treatment questionnaire data on behavioural treatment and control groups. Each group has less than 10 participants. I have missing data both on baseline and posttreatment ...
0
votes
0answers
16 views

How to make phrases in experimental conditions as similar as possible?

In behavioral economics and psychology, there are many experiments where participants receive variations of a piece of text depending on the experimental condition they are assigned to. For example, ...
0
votes
1answer
23 views

Bias of difference-in-means estimator for experiments randomized using Bernoulli trials

Under potential outcomes framework (Neyman-Rubin causal model), it is straighforward to show that difference-in-means is an unbiased estimator of average treatment effect under completely randomized ...
0
votes
0answers
21 views

Objective Bayesian Two Sample Hypothesis Testing for Online Controlled Experiments - what am i missing in their reformulation of the Z-statistics?

I'm currently reading this paper. Part 3, they give two definitions of the Z-statistics. It seems to me that the two definitions are not equivalent. It's not really important for the rest of the paper,...
2
votes
1answer
87 views

Estimating the Local Average Treatment Effect (LATE) and always-takers

I am new to statistics and am particularly interested in RCTs so this is a very basic question. If I have a program wherein 10% of my control group had access and used the treatment, how would that ...
0
votes
0answers
19 views

Analytical power analysis of a binomial RCT

I have a certain population of users of my free app, with new ones installing every day. I want to run an RCT on them, specifically measuring the impact of some change on their conversion rate (i.e. ...
0
votes
1answer
32 views

Is it possible to to have more than 2 groups for biased coin randomization? If no, is there any modifications supporting multiple groups?

Is it possible to have more than 2 groups for biased coin randomization? If no, is there any modifications of biased coin randomization supporting multiple groups? This is my R code for generating ...
0
votes
0answers
18 views

D+R: How many randomized trials to determine the D value?

I have an unknown fixed integer D. N binary random variables R were added to D. In each randomized trial we can observe the sum D+R. But we don't know D and we don't know the R's outcome in each ...
0
votes
2answers
39 views

Using a randomization to compare frequencies in two groups?

I have a dataset of males and females and whether they dispersed (yes = 1). For example: Male 0 Male 0 Male 0 Male 0 Male 0 Female 0 Female 1 Female 0 I'...
1
vote
0answers
20 views

Is a group structure required for randomization tests?

In randomization tests (for example in Testing Statistical Hypothesis Theorem 15.2.1 Lehmann and Romano) it is required that we have a group of transformations $\mathbf{G}$ on which $X$ and $gX$ have ...
0
votes
0answers
59 views

3 plants per pots - 6 pots per treatment - replicates and pseudoreplicates

I'm currently working on the statistical evaluation of an experiment. Certain products have been tested towards their influence on plant growth. Description There are 12 treatments in total and each ...
4
votes
1answer
47 views

A basic question about a randomized test involving the error type I

I have a basic question in the context of testing statistical hypotheses, more specifically, about randomized tests. Suposse that I have two actions (altenatives) about a certain unknown parameter $\...
3
votes
1answer
504 views

AB testing with group level randomization

I am working on a consulting project where my client wants to perform AB testing in order to improve their service which involves outbound communication to clients. Their clients are (structurally) ...