Questions tagged [statistical-significance]

Statistical significance is a characteristic of a statistic viewed in light of a null hypothesis and a given significance level. It reflects whether the statistic belongs to the rejection region (is statistically significant) or the acceptance region (is not statistically significant).

6,313 questions
Filter by
Sorted by
Tagged with
1 vote
35 views

Can I use p-values without hypothesis?

I have been working on my Master's Thesis which included a survey and its results have been put through various tests. The unusual thing about my Thesis is that I have no hypotheses at all, making it ...
• 11
20 views

Does anyone recognize this significance test between two regression betas?

I came across the following test for statistical significance between two betas (predictors) from a multiple regression model. Note that $R^2$ is the model coefficient of determination, $r$ is the ...
• 121
11 views

What are the differences and similarities between Reductionism and Holism in data analysis in terms of data storage and data visualization?

I am currently studying Network Analysis and have met the terminologies of Reductionism and Holism and I have read many articles on the Internet about them but I wonder the differences as well as ...
• 3,175
20 views

How to statistically validate samplers? Is Chi-Square test relevant for synthetic data?

I am developing sampling procedures for different kinds of discrete objects (rankings, sets, etc.). In most cases I know the theoretical distribution of the objects I'm sampling. My idea is thus to ...
20 views

Chi-Square test for independence for field failure data

I'm analyzing the product field failure data where each product can have one or more failures (Failure A, Failure B, Failure C, Failure D etc.) My goal is to understand the correlation between failure ...
• 675
48 views

Which test to perform?

Design: We tested mixtures of 12 varieties of species A with species B in multiple growing seasons using an RCBD (Randomized Complete Block Design). The content of species B in the mixture was ...
46 views

Significant study is not shown as such in the meta-analysis [closed]

[] https://pubmed.ncbi.nlm.nih.gov/29300423/ significant results from this study. Seino 2018 1This caught my eye. In a meta for protein consumption and muscle mass gain in older adults, the study ...
• 101
121 views

Permutation test for exponential null hypothesis: really bad?

Having found nice formulas for testing the null hypothesis under exponentially-distributed samples, I wanted to see how well permutation tests could do the job. And the answer, assuming no mistakes, ...
• 1,044
3 views

Loan Data: Bucket recoveries 1-D array

Some context: When someone defaults on their loan, we keep track of the recoveries as a percentage of the exposure (loan amount), we have a limited time T (legally) to collect recoveries, those ...
120 views

How do I include these variables within my logistic regression analysis?

So my logistic regression model aims to predict the likelihood of a severe accident (yes/no) based on characteristics of drivers, car types and other factors. I have data which has all this ...
• 81
33 views

Statistical test for a biology experiment when plants were grown in 3 different solution concentrations

I have conducted an experiment for my Biology Internal Assessment in the IB Diploma Course where I grew Phaseolus coccineus beans for 14 days. This is the overview of my experiment: Independent ...
• 21
19 views

Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario

I am looking for the most suitable statistical test for the following situation: I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
• 1
29 views

GLM or GLMM design for different tasks

I am conducting a study involving 70 participants diagnosed with Mild Cognitive Impairment (MCI) and 75 without MCI. All participants were engaged in taxonomic semantic, thematic semantic, and ...
35 views

How to perform a 2 sample Kolmogorov-Smirnov test controlling for a type II error instead of type 1

I have four completely different sets of two samples and want to check for each set if both samples come from the same distribution, so four Kolmogorov-Smirnov tests total. If it's going to be ...
• 11
58 views

What's wrong with this statistical argument that Brexit caused COVID? [closed]

The innocent beginning I heard a joke that was something to the effect of, "The UK was in the EU for 27 years, then Brexit happens in 2020, and suddenly there's a pandemic - what are the odds?!&...
• 117
246 views

Can I perform logistic regression or any other type of regression on this dataset?

My data set contains information regarding the number of road accidents separated by gender, age, area, and other factors. Can I perform logistic regression analysis using this dataset to predict how ...
• 81
7 views

In APC-Detrended Analysis: Testing for Significant Difference in Cohort Variable Coefficients, Beyond Z-Test

I have conducted an APC-Detrended analysis. Among the results, I want to test whether there is a significant difference in the coefficient values of the Cohort variable especially between the two ...
50 views

Significance testing on Generalized Additive Mixed Models (GAMMs) - mgcv::gam

I am wondering whether anyone has any insight on comparing the performance of two GAMMs? Specifically, I want to compare two models: A "nested model", one with a smoothed age term ...
1 vote
67 views

Overlapping confidence intervals of two proportions

According to to G. Cumming and S. Finch in their paper "Inference by Eye" the 95% confidence intervals of two independent means can overlap and the difference between the two means can still ...
• 77
1 vote
49 views

FDR correction - different number of p-values and models/hypotheses being tested

I have $3$ predictors: $1$ binary (prenatal alcohol exposure) $1$ categorical with $4$ categories (drinking patterns e.g., light stable, heavy reducer) $1$ continuous (total drinks consumed during ...
• 11
1 vote
23 views

Can a t-test be used to compare means obtained from samples of the same batch but tested in two different labs? [closed]

I have two datasets containing size measurements. The initial dataset originates from six different aliquots drawn from a large batch of a product (a suspension with particles). Each sample was ...
• 11
101 views

Hypothesis tests for Rayleigh variables

Given samples from two Rayleigh-distributed random variables with unknown parameters, $X \sim R(\sigma_x), Y \sim R(\sigma_y)$, what tests can we use to determine if and to what extent their ...
• 1,044
41 views

Interpretation of Statistical Tests and the Importance of Statistical Power [duplicate]

I was planning on running a statistical test for hypothesis testing, but was confused if statistical power is important once a test is run. Looking at this confusion matrix, one would ideally set ...
752 views

Non-significant results when running Kruskal-Wallis, significant results when running Dwass-Steel-Critchlow-Flinger pairwise comparisons

I am writing my Master's thesis on adult's performance on cognitive and linguistic measures. I have four age groups and am investigating if there is an age difference in the performance on summarized ...
43 views

How to statistically discover significant process change effectiveness?

I am currently working on a project where I need to assess the effectiveness of changes made in a production process. Our initial success rate was 50%, and after making some alterations, we've ...
• 301
216 views

Are post-hoc adjusted analyses more valid than initial analyses?

Many papers design a methodology to detect a difference between $2$ groups regarding a primary outcome. This result is then given a $p$ value to denote statistical significance. Some papers then go on ...
• 353
61 views

How do I proof or disprove that the size of a document influences classification accuracy?

I have a multinomial Naive Bayes model that classifies a document into 1 of 178 classes. This goes well about 50% of the time, so it's pretty good (for my use case) considering the large set of ...
46 views

Hypothesis test on binary preference [duplicate]

I have two product designs and I want to see if there is a significant difference between which people like which design the best. I did a survey where I showed a photo of each design and asked ...
• 101
1 vote
34 views

Statistical significance of correlations from confidence intervals... making my brain hurt a little

Quick question (hopefully)... If you have a correlation of -0.256 with a 99% confidence interval of -0.541 to 0.185, OR, a correlation of -0.336 with a 99% CI of -0.597 to 0.125... That essentially ...
38 views

is my p-value significant at 3.9e-11? [duplicate]

I know that if it says < 3.9e-11 it is significant because it is less than. But this time it has no < symbol, just the value of 3.9-11. Does this mean its not less than or is it still ...
30 views

Sample size estimate for difference of hazard ratios

I'm planning a Kaplan-Meier analysis and need to determine an appropriate sample size for the study. I have two treatment arms and want to show that there is a differential biomarker effect depending ...
• 8,470
149 views

What do these Wilcoxon values tell me?

I did a pre and post-test with a small number of students ($n=12$).These values came after a science intervention that took $4$ weeks. I used a Wilcoxon test for 2 related samples as there was not a ...
34 views

Barnard's unconditional test gives different results when switching rows and columns?

I'm really new to statistical analysis, and I've been playing around with exact tests for 2x2 contingency tables. I've noticed that for the Barnard test (implementation with ...
• 23
259 views

Comparing the mean of biological replicates that are not normally distributed, low N for replicates

I work in cell biology where the field standard is now to do 3 biological replicates of experiments. However, each data point is extremely laborious to get and we receive very little statistics ...
1 vote
55 views

How to identify statistical significance in a difference between means of grouped survey questions

I'm looking at some survey data where the questions were on a Likert scale. For each question I get what percentage respond positive/neutral/negative. There are on the order of 30,000 survey ...
• 191
1 vote
9 views

1 vote
29 views

How to get plot of Ripley's K function (Kest) for temporal data in R? [closed]

I have the temporal data of Landslide events in CSV format. My data consists of Year, Month, and Day of events. I want to see if there is temporal clustering for events or not by using Ripley's K ...
12 views

How would I determine statistical significance on exponential data?

I'm trying to determine if there's a statistically significant difference between the O2 permeability into two different materials. The measurements are percentage of O2 (O2%), measured every 15 ...
16 views

Is there any statistical significance test similar to chi-square that penalizes small groups, making them less significant?

Let's imagine an NxM contingency table, where rows represent groups and the columns represent attributes, so the table describes the number of entities with given attributes belonging into given ...
• 75
66 views

How to interpret the p-value associated with the intercept?

I ran a gamlss to predict my response variable Y with 2 categorical factors PROTECTION and JOUR ...
1 vote
39 views

What statistical test do I use to compare two counts with several categories?

I'm trying to figure out how to test if the count of benthic species is significantly different between two transects. We have 13 species in this example, with two transects, each transect having a ...
• 11
50 views

Why don't deep learning-based computer vision studies utilize statistical tests for comparisons? [closed]

Many readers familiar with scientific articles in the field of deep learning-based computer vision might have observed a common practice: the absence of statistical significance tests for comparing ...
• 53
1 vote