Questions tagged [statistical-significance]

Statistical significance is a characteristic of a statistic viewed in light of a null hypothesis and a given significance level. It reflects whether the statistic belongs to the rejection region (is statistically significant) or the acceptance region (is not statistically significant).

6,447 questions
Filter by
Sorted by
Tagged with
4 views

statistical test to compare a single value (mutation number) with a set of mutation numbers

I have a single mutation value of a pathogen for a specific country that is 6. This same pathogen has different values for other countries as 5,7,8,9, and 10. How can I compare the statistical ...
10 views

understanding fisheries model output tag and release

I am reviewing (for myself) a publication that has analysed data from an experiment to see what effect underwater seismic has on catchability of lobsters. de Lestang et al (2024) Fisheries Research ...
17 views

test for differences in empirical cumulative distribution functions between groups

What test could I use to test for differences in empirical cumulative distribution functions between two or more groups? Note that I am not looking for a test two compare two ecdf (Kolmogorov–Smirnov ...
• 43
412 views

Related low p-values that do not meet statistically significant thresholds

If I were to have multiple related measures, each with "low" p-values that do not quite meet the threshold of significance, could the fact that multiple measures produce a general trend with ...
14 views

Significance of the coefficients of a multinomial mixed regression built with npmlt function

I fitted (using npmlt function) a mixte multinomial regression model which ran without errors. I expected that the outputs of the model include p-values that I didn't find. My need now is that someone ...
21 views

Impact of variation in the total number of samples when performing multiple fisher exact tests

I have dataset of 2 time points. In each time point I have to compare the counts of different components at each position (number of positions =1000). I used fisher exact test to compare the if there ...
26 views

Dickey-Fuller test statistical significance

I recently read about the Dickey-Fuller test. Firstly about the transformation from $$y_t=\rho y_{t-1}+\epsilon_t$$ to: $$y_t-y_{t-1}=(\rho-1) y_{t-1}+\epsilon_t$$ I assumed it is to get the ...
31 views

Problem regarding False discovery rate correction for multiple comparison

I am conducting research to find association of a gene with a disease. It's a case-control study. I have divided the cases into groups A and B based on genotype and controls into groups C and D. I ...
10 views

Significance of factors/regressors on compositional data

Let's assume that I have composite data, similar to the "ArcticLake" example dataset in the DirichletReg package in R. Now, I would like to know whether various numeric variables and factors ...
• 159
342 views

confidence interval and rejection

Assume I have a data sample $X_{1}, \dots X_{n}$ from a normal distribution. Then, we consider the following hypothesis $$H_0: \quad \mu = \mu_{0}$$ and alternative $$H_1: \quad \mu \neq \mu_{0}$$ ...
• 676
8 views

using ranksum test within permutation test scipy

I am a bit confused with the definition of the permutation_test function provided by scipy. the following is what I wrote to calculate the p and null distribution ...
1 vote
20 views

Testing the difference between two Root Mean Square Error values for statistical significance [duplicate]

I would like to compare the predictive power of 2 models. The models are meant to model count data and respective probabilities. I am using two metrics as means of comparison: Root Mean Square Error ...
• 133
15 views

Help determining sample size without standard deviation

I need some help optimizing our website intercept survey sample sizes, but our online platform only provides us with the means (often mean of 5pt ordinal scales), sample sizes and denotes statistical ...
48 views

Testing for difference in trends of binary-parameter proportion/fraction versus continuous parameter between two (or more) different populations

I have three samples of objects: sample X (total = 138), sample Y (same basic class as X, but located in a different environment; total = 186), and sample Z (total = 996). For each object, I have a ...
• 153
8 views

Measuring statistical difference across two distributions of attention scores

For a study I'm conducting, I have two distributions of attention scores generated via a trained transformer model. I'm plotting the two distributions and I would like to run a statistical test to ...
• 637