# Questions tagged [two-sample]

The two-sample problem is: given samples X and Y from two distributions, test whether the two underlying distributions are the same. One of the most common classical nonparametric approach is the Kolmogorov-Smirnov test.

108 questions
Filter by
Sorted by
Tagged with
33 views

### Is bootstrapping inherently Frequentist? If so, how do we do a Bayesian non-parametric two-sample test?

I normally use frequentist statistics but I now want to use Bayesian statistics as I want to carry out a two-sample (randomised control trial) test that includes prior information. I have an existing ...
• 913
1 vote
43 views

### Deriving Sample Size for two samples t test

I am trying to figure out what sample size recommendations to make in this case when the samples have different sizes. Since their sizes are different the variance of each will be different. Suppose ...
• 345
1 vote
23 views

### Two-sample test of difference in probability mass at the extremes of the empirical distributions

I am running an experiment that will generate a dependent variable (DV) in two treatments, T1 and T2. One of the hypotheses I want to test is whether the distribution of the DV in T1 has more mass at ...
1 vote
63 views

### How to perform a 2 sample Kolmogorov-Smirnov test controlling for a type II error instead of type 1

I have four completely different sets of two samples and want to check for each set if both samples come from the same distribution, so four Kolmogorov-Smirnov tests total. If it's going to be ...
• 21
46 views

### How to Run a Standard Two-Sample t-test when given delta and not the two means

I am trying to find the p-value to test a null hypothesis using a Standard Two-Sample t-Test. Usually I would use ...
20 views

### Validity of Bootstrap Inference for Bounds

I am facing the following problem: I have access to iid $X_1,\dots ,X_{N_X}$ and $Y_1, \dots, Y_{N_Y}$ from $F_X$ and $F_Y$, respectively, where $X$ stochastically dominates $Y$. My goal is to conduct ...
11 views

### Two-sample statistical significance test taking into account group membership (proportions) and numeric comparison

Say I have two samples of observations, S1 and S2, which can be of unequal sizes. For each observation, I have two variables: G (a categorical group assignment, say it is binary with values A/B), and ...
• 171
1 vote
78 views

### Two sample proportions: How to test the hypothesis that the difference in proportions is less than a specified threshold?

Say I have treatment and control, perfectly randomized. I have 70000 conversions for treatment in 80000 users. I have 70100 converions for control in 800100 users. My null hypothesis is that there is ...
25 views

### Is two-sample Kolmogorov test working correctly?

I have two one-dimensional samples that I'm trying to quantifiably distinguish (or deny such distinction). I.e. the null-hypothesis is that they come from the same population (distribution?). The ...
1 vote
86 views

### Comparing means in Box-Cox transformed data

Deeply sorry as this wasn't really covered in my statistics classes. I am current comparing datasets for people divorcing vs. dissolving their marriages. I have two variables, length of marriage, and ...
• 11
1 vote
94 views

### Kolmogorov Smirnov Test Consistency

I was reading that the Kolmogorov Smirnov 2 sample test is consistent, that is Probability of rejection under $H_1$ is 1 for sample size going to infinity. Say we have 2 random variables X and Y. K-S ...
1 vote
268 views

### When transforming a dataset using the square root (or any other procedure), does the standard deviation of the dataset get transformed too?

Taking an introductory statistics course, and I am confused about the impact of a transformation on the df for a two-sample t-test. The df is dependent on n of each sample and SD of each sample, but I'...
• 11
72 views

### Compare two samples when each observation is a pair of dependent values

At an airport there is a company that offers a specific service for travellers (there are no competitors offering the same service at the location). They performed an experiment - they temporarily ...
• 157
1 vote
16 views

552 views

### Two-sample test + paired/independent samples

This might be an easy question but I got lost in my thinking so thank you for clarifying that for me. So I have some troubles with understanding the ideas of two-sample tests in addition to paired and ...
170 views

### The mean of natural log of some data

I have the following data in natural log: N = [0.929, -1.745, 1.677, 0.701, 0.128] O = [2.233, -2.513, 1.204, 1.938, 2.533] I want to calculate the mean ratio of ...
1 vote
211 views

• 11
1 vote
180 views

### Two-sample test when samples are not completely independent?

Let's say I measure the height of 100 individuals every week in both Illinois and Texas while allowing for the same individual to be measured multiple times in the following weeks. This way, my ...
1 vote
823 views

### Performing a two sample t-test for equal means on subset of a dataset

If I have a dataset that, of among other variables, contains the gender and wealth for a sample of a population with a year variable that represents the year the data about the individual was ...
• 11
114 views

### test whether two samples are from the same high dimensional multinomial distribution

I have two high dimensional vectors (~150 dims), assumed to be sampled from multinomial distributions. How can I test whether the two are from the same multinomial distribution or different ones? (...