Questions tagged [two-sample]

The two-sample problem is: given samples X and Y from two distributions, test whether the two underlying distributions are the same. One of the most common classical nonparametric approach is the Kolmogorov-Smirnov test.

48 questions
Filter by
Sorted by
Tagged with
18 views

Two sample multivariate t-test?

I am wondering if there is a relatively easy way to implement a multivariate t-test or something analogous in R. I am aware of Hotelling's T-squared test, but in my case p>n and I've read that this ...
40 views

Is Kolmogorov-Smirnov test known to fail in some special cases?

I would like to use two samples Kolmogorov-Smirnov test to check if two given samples are coming from different distributions. For that I use scipy implementation of the KS test. I have found out ...
17 views

How to use Bayesian methods to check if the dependence variable from two dataset follow the same regression pattern?

For instance, we have two datasets with the same columns but from different years: $$\text{x1 x2 x3 y}$$ And we know that $\text{y}$ is functional related to $\text{x1 x2 and x3}$, but we don't ...
30 views

Evaluating different methodologies for hypothesis testing

I have a campaign, with a target and holdout group, in which the target group is encouraged to make a purchase. I have the results from campaign - total revenue spent per member (for target & ...
9 views

Calculation of critical values

Are the critical values for the two-sample t-test with unequal variances calculated the same as for the two-sample z-test?
25 views

How to test mean differences in proportions that are dependent

I have an experimental setup where I have allowed groups consisting of about 50 animals to select between two environmental conditions. I.e. animals had the possibility to move between the two ...
21 views

How to test whether two conditionals are equal?

I have samples from distinct joint distributions $p(x,y)$ and $q(x,y)$ and I want to determine whether $p(y|x)=q(y|x)$. Is there an existing method for doing this?
61 views

How can you test two datasets to determine if they originate from the same generating process?

I have two feature matrices X_i and X_j, with identical features but their own n - is there a statistical test to determine if the latent data generating process behind X_i is indistinguishable from ...
27 views

Robust two-sample test with triplicate measurements?

When testing for a difference in mean between two conditions, biologists typically use a $t$-test, and wring their hands endlessly about how to justify removing outliers. Whereas I typically use a ...
26 views

p-value histogram of two-sample poisson tests on simulated data

I have two vectors (a and b), which are each a sample of n = 10000 from the poisson distribution with lambda = 10. ...
94 views

Earth Movers Distance and Maximum Mean Discrepency

By Kantorovich-Rubinstein duality the Earth Movers Distance (EMD)/Wasserstein Metric is equivalent to Maximum Mean Discrepancy (MMD) correct? See here for a more thorough explanation. Why then does ...
65 views

Kolmogorov Smirnov, CVM, AD all reject Null hypothesis - comparing two samples

I have an empirical sample (with N >10000) and I fit it to a beta-distribution. Now, as a goodness of fit, I first looked at the density function plots of the empirical and the estimated beta ...
23 views

two-sample $T^2$ testing with $n=1$

Assuming I have two populations $X\sim\mathcal{N}(\mu_X,\Sigma)$ and $Y\sim\mathcal{N}(\mu_Y,\Sigma)$ of sizes $n_X,n_Y$, the hypotheses for equivalence of means (each of length $p$, and assuming ...
30 views

Hypothesis Testing For Two Sample Mean Proportion

We've two samples of size n_1 and n_2 from two different normally distributed populations. We don't know their population means ...
60 views

Which statistic test should I use in this situation?

There are 10 questions in which we are comparing peoples' opinion about two conditions, "X"and "Y". Every question was answered by about 90 people who were different than other questions' respondents. ...
40 views

Violation of independence or still a valid test?

I have to test the the effect of two different treatments on a set of samples. On the surface, this seems an obvious option for a two sample test. The problem is that the samples being treated are ...
26 views

Using the D-statistic from 2-sample KS-tests

this my first attempt at applying a 2-sample KS-test. I have 3 sets of data; each comprises of control and treatment values, as follows and plotted in the image: Set 1: 10,849 values each for control ...
247 views

Testing difference in proportions with bootstrap

Summary: I want to perform a bootstrap test on the difference of proportions. I think this is equivalent to testing the difference between means using bootstrap, but I wanted to clarify some details. ...
90 views

Confidence Interval for ratio Between Two Means

I am trying to do something similar to what it is explained in this tutorial. The difference is that I want to obtain a 95% CI for the ratio between the means of two populations. In few words, I am ...
58 views

For a two sample t-test, what is the relationship between the p-value and the test statistic?

Suppose we have a two sample t-test where the data have unequal variances and different counts. Let $X_1, \ldots, X_{N_1}$ be the first set of data and $Y_1, \ldots, Y_{N_2}$ be the second set of data....
91 views

Estimating Sample Size with no Standard Deviation

I am conducting a one-sided, independent two-sample t-test for a gender study and I can guesstimate my effect size from previous studies. I want 95% significance, 80% power. I am looking to calculate ...
9 views

Looking at the plot of two sample's distribution of means which are compared cannot reveal significance? [duplicate]

In practice we sometimes used a wisdom that two overlapping CIs for sample mean distribution meant we could not reject Hull hypothesis, to get a quick answer. It looks though that this is a very raw ...
260 views

Comparing distribution of training and test dataset

When we fit a model to a training dataset, our basic assumption is that the test dataset will also come from the same (or similar) distribution. How to check if the distribution of the training and ...
65 views

Is there an equivalent to the Anderson-Darling test for categorical data?

I have categorical data of the following form: |Total|Pos|Neg In | 6 | 4 | 2 Out | 11 | 4 | 5 There are two categories: In/Out and Positive/Negative. All ...
125 views

population and subsamples : mean equality?

I want to perform a two sample test, to see whether theirs means are equals. One of the sample is rather big (#60000 values) and represents the scores of a whole population. This population is ...
25 views

Mean differences between a population and its subsamples [duplicate]

We would like to perform a statistical test to assess that a subsample of a global population has significantly a different mean than the global population. In this context, we are convinced that a ...
433 views

AB Testing and confidence intervals

Suppose I run an AB test with the goal of increasing the number of users who purchase a product. After running the test for "long enough" I get that 5% of control users purchase, and 10% of ...