# Questions tagged [t-test]

A test for comparing the means of two samples, or the mean of one sample (or even parameter estimates) with a specified value; also known as the "Student t-test" after the pseudonym of its inventor.

3,332 questions
Filter by
Sorted by
Tagged with
17 views

### How to check if improvement in search results is significant

I'm implementing a search engine in two different ways A and B, and I am comparing their accuracies. Accuracy of system A is measured as follows: Given a query, I check if system A gives me the result ...
1 vote
54 views

### Stat sig results on underpowered experiment

I ran an experiment that was powered enough to detect lifts of 1% on my 2-sample test. Make it really simple: I have two normal distributions and want to compare the means, so I ran a 2-sample t-test ...
• 97
7 views

### Outlier detection using VAE and multivariate T-test

I've seen this answer Outlier Detection Using VAE Latent Space about this question, however I'm not fully satisfied with the answer. Context: We have a fully trained VAE which maps $R^N$ into a $R^M$ ...
14 views

### Special scenario when the same participant acts as both the control group and the experimental group scenario, but at the same time

I would really appreciate any advice here on if there are any special parameters I need to use for this example. I am looking at the effect of an analgesic on pain level after ocular surgery. Both ...
50 views

### CLT for t-test with unequal sample size; one group < 30?

CrossValidated has many discussions on how unequal variances are not a practical issue for two-sample t-tests when Welch correction is used and on how normality assumptions do not play a role (in Type-...
• 7,717
7 views

### Statistical test for low treatment sample size, high nb of record and large control group

I am looking to analyse the efficiency of a treatment. The problem is that I have only 3 patients in the treatment group. However: I have thousand of measurement of the value of interest for these 3 ...
• 1,469
18 views

### I have a 2x2 crossover design comparing 2 treaments but don't have a clue what statistical analysis to use in SPSS

I have a 2x2 crossover design comparing 2 treaments with a washout period in between but don't have a clue what statistical analysis to use in SPSS. I am not that good at statistics since it is not my ...
29 views

### Approximate distribution of test statistic for weighted sample mean

Let $$R_{i}(t) \sim \mathcal{N}(\mu_i, \sigma_i^2),$$ denote the one period return distribution for asset $i$, from which we observe the iid samples $\{R_i(t)\}_{t=1}^{n_i}$. The MLE sample mean and ...
1 vote
26 views

### How many parameters in my mixed effect model (for t-tests)

I have the following mixed effect model; penicillin_model = lmer(yield ~ treat + (1 | blend), data = penicillin) Treat contains 4 categories ...
• 49
14 views

### Using a t-test on the whole population to infer impact of a feature on future population of feature adopters? [closed]

I would like to know whether the impact I observe in a population that has adopted a product feature is due to chance, or is significant. Say I have a whole population of 100 clients (and I make sure,...
15 views

### Different Number of Judges Scoring and how to Rank

I have looked everywhere and I am struggling to find a solution. Granted, I am no statistician but I do have some knowledge of basic statistics. Any help is truly appreciated! There are a number of ...
• 21
1 vote
27 views

### Why does the one-sided T-test reject the Null Hypothesis while the two-sided doesn't?

I'm not that familiar with statistics, especially not with T-tests, however I need to apply a T-test for my ...
• 11
35 views

### Interpreting coeftest results; z-test; t-test, unfamiliar with the output

I am using coeftest to run z- and t- tests on a few different pieces of data. The output comes in this form: fit <- lm(dest_flood ~ type_flag, data = runsample) coeftest(fit) ...
• 329
1 vote
29 views

### What statistical test should I use (biostatistics)

I am comparing sperm motility between 2 sets of samples (2 groups). Motility just means weather the sperm are alive or not, in this test I am just looking at that. If its moving, then its alive (I ...
• 11
15 views

### Testing accuracy of black-scholes model

What is the best way to assess the accuracy of the prices given by a Black-Scholes model? Taking into account that, for example, the model could be used to price binary options, and a binary option is ...
1 vote
31 views

### Comparison of total counts vs. comparison of mean counts per participant in exploratory data analysis

I already came across this question: Difference in means vs difference in proportions, but could not answer my question based on the answers and comments there. My question would be this: Suppose ...
• 13
45 views

### what statistical test should be used for testing number/proportion of people who agreed in 2 different years

I want to measure if the number of people who agreed on a likert scale (1 strongly disagree - 5 strongly agree), so responded with a 4 or 5 had a statistically significant increase from the previous ...
1 vote
8 views

### Is it possible to compare means of pre & post intervention questionnaire for only 3 participants?

I am completing my dissertation which was to determine if a 6-week expressive writing intervention would reduce aggressive behaviors & increase emotion regulation in students. My first variable (...
• 11
77 views

### Convergence Rate of $t$ Test Statistic (Regression)

Consider a simple regression model, $y=\beta^Tx+\epsilon$, say using the cars dataset. We get the following summary: ...
• 2,381
45 views

### How to use t-test with percentages

I have the following crosstab the percentages. how can I use ttest_ind to calculate individual cell's p-value. ...
28 views

### When are equivalent TOST test possible?

For my end-of-study work in architecture, i am comparing different reconstruction (~10) distances from reference 3D model. I'd like to test if reconstruction are different using statistical tests. On ...
1 vote
47 views

### Two not normal distributed samples & unequal sample size

I got two sample sets a training set around 32k rows and I have a test set of 16k rows. I want to test if the two sets are randomly split. I checked the normal distribution and it is not met for none ...
24 views

### Is my approach correct? Linear model, linear mixed model, or regular t.test?

The experiment: I am analyzing samples from patients presenting two different diseases (e.g.: Cond_A, and Cond_B). I have 50 samples from each group. I have additional information about these samples, ...
1 vote
22 views

### Very small sample size alternative to binary response logistic regression for evaluating single-species habitat associations

I'm interested in evaluating the relative importance of different habitat variables on presence/absence of a particular species in habitat patches. I was limited to surveying 20ish sites on account of ...
73 views

### What to do when comparing mean of two populations and one is not normal?

I have a dataset with two populations (unpaired). First one with 36 observations, second one 74. The first passes the Shapiro normality test with p-value = 0.1521, ...
• 23
20 views

### paired t-test for data with large variance

I'm making a research plan, but I don't know how to solve the following problems because I don't have enough statistical knowledge. Can I get some help? Assumption: let's assume that the red line in ...
1 vote
32 views

### Is a paired samples t-test suitable in this case?

I have 3 tasks and want to find out which one is more effective (that is, to find which task people performed better in). Just over 30 people have participated in all 3 tasks, and their performance ...
• 11
10 views

### Choosing the correct statistical test to compare different methods on the same population

In my study I have a single population of 8 participants. I am interested in looking at differences in behavioural data between each subject (the behavioural data being collected under the same ...
1 vote
23 views

### Comparing before and after survey using Likert Scale

We are trying to measure if there is a difference on the level of interests of participants before and after I let them play a game. The survey is in the form of Likert Scale where ...
27 views

### What test to compare two frequencies?

In my project I have to study the vigilance behaviour of birds, and I need to determine if adults start escaping from an approaching human more often than chicks. So I have the frequencies of adults ...
• 121
56 views

### Can someone please help me to understand the statistics used in this code in R?

I'm trying to compare the CCS class between two groups, which is a tool to assess chest pain severity graded by physicians on a scale of 1-4 with a higher number indicating greater severity.I was ...
30 views

• 11
1 vote