Questions tagged [statistical-significance]
Statistical significance is a characteristic of a statistic viewed in light of a null hypothesis and a given significance level. It reflects whether the statistic belongs to the rejection region (is statistically significant) or the acceptance region (is not statistically significant).
6,313
questions
1
vote
2
answers
35
views
Can I use p-values without hypothesis?
I have been working on my Master's Thesis which included a survey and its results have been put through various tests. The unusual thing about my Thesis is that I have no hypotheses at all, making it ...
- 11
0
votes
0
answers
20
views
Does anyone recognize this significance test between two regression betas?
I came across the following test for statistical significance between two betas (predictors) from a multiple regression model. Note that $R^2$ is the model coefficient of determination, $r$ is the ...
- 121
0
votes
0
answers
11
views
What are the differences and similarities between Reductionism and Holism in data analysis in terms of data storage and data visualization?
I am currently studying Network Analysis and have met the terminologies of Reductionism and Holism and I have read many articles on the Internet about them but I wonder the differences as well as ...
- 3,175
0
votes
0
answers
20
views
How to statistically validate samplers? Is Chi-Square test relevant for synthetic data?
I am developing sampling procedures for different kinds of discrete objects (rankings, sets, etc.). In most cases I know the theoretical distribution of the objects I'm sampling. My idea is thus to ...
- 1
0
votes
0
answers
20
views
Chi-Square test for independence for field failure data
I'm analyzing the product field failure data where each product can have one or more failures (Failure A, Failure B, Failure C, Failure D etc.) My goal is to understand the correlation between failure ...
- 675
2
votes
0
answers
48
views
Which test to perform?
Design:
We tested mixtures of 12 varieties of species A with species B in multiple growing seasons using an RCBD (Randomized Complete Block Design). The content of species B in the mixture was ...
- 21
0
votes
0
answers
46
views
Significant study is not shown as such in the meta-analysis [closed]
[]
https://pubmed.ncbi.nlm.nih.gov/29300423/ significant results from this study. Seino 2018
1This caught my eye. In a meta for protein consumption and muscle mass gain in older adults, the study ...
- 101
6
votes
1
answer
121
views
Permutation test for exponential null hypothesis: really bad?
Having found nice formulas for testing the null hypothesis under exponentially-distributed samples, I wanted to see how well permutation tests could do the job. And the answer, assuming no mistakes, ...
- 1,044
0
votes
0
answers
3
views
Loan Data: Bucket recoveries 1-D array
Some context: When someone defaults on their loan, we keep track of the recoveries as a percentage of the exposure (loan amount), we have a limited time T (legally) to collect recoveries, those ...
4
votes
2
answers
120
views
How do I include these variables within my logistic regression analysis?
So my logistic regression model aims to predict the likelihood of a severe accident (yes/no) based on characteristics of drivers, car types and other factors. I have data which has all this ...
- 81
2
votes
1
answer
33
views
Statistical test for a biology experiment when plants were grown in 3 different solution concentrations
I have conducted an experiment for my Biology Internal Assessment in the IB Diploma Course where I grew Phaseolus coccineus beans for 14 days. This is the overview of my experiment:
Independent ...
- 21
0
votes
0
answers
19
views
Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario
I am looking for the most suitable statistical test for the following situation:
I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
- 1
0
votes
0
answers
29
views
GLM or GLMM design for different tasks
I am conducting a study involving 70 participants diagnosed with Mild Cognitive Impairment (MCI) and 75 without MCI. All participants were engaged in taxonomic semantic, thematic semantic, and ...
0
votes
1
answer
35
views
How to perform a 2 sample Kolmogorov-Smirnov test controlling for a type II error instead of type 1
I have four completely different sets of two samples and want to check for each set if both samples come from the same distribution, so four Kolmogorov-Smirnov tests total. If it's going to be ...
- 11
-2
votes
0
answers
58
views
What's wrong with this statistical argument that Brexit caused COVID? [closed]
The innocent beginning
I heard a joke that was something to the effect of, "The UK was in the EU for 27 years, then Brexit happens in 2020, and suddenly there's a pandemic - what are the odds?!&...
- 117
4
votes
2
answers
246
views
Can I perform logistic regression or any other type of regression on this dataset?
My data set contains information regarding the number of road accidents separated by gender, age, area, and other factors. Can I perform logistic regression analysis using this dataset to predict how ...
- 81
0
votes
0
answers
7
views
In APC-Detrended Analysis: Testing for Significant Difference in Cohort Variable Coefficients, Beyond Z-Test
I have conducted an APC-Detrended analysis.
Among the results, I want to test whether there is a significant difference in the coefficient values of the Cohort variable especially between the two ...
3
votes
1
answer
50
views
Significance testing on Generalized Additive Mixed Models (GAMMs) - mgcv::gam
I am wondering whether anyone has any insight on comparing the performance of two GAMMs?
Specifically, I want to compare two models:
A "nested model", one with a smoothed age term ...
- 61
1
vote
1
answer
67
views
Overlapping confidence intervals of two proportions
According to to G. Cumming and S. Finch in their paper "Inference by Eye" the 95% confidence intervals of two independent means can overlap and the difference between the two means can still ...
- 77
1
vote
1
answer
49
views
FDR correction - different number of p-values and models/hypotheses being tested
I have $3$ predictors:
$1$ binary (prenatal alcohol exposure)
$1$ categorical with $4$ categories (drinking patterns e.g., light stable, heavy reducer)
$1$ continuous (total drinks consumed during ...
- 11
1
vote
0
answers
23
views
Can a t-test be used to compare means obtained from samples of the same batch but tested in two different labs? [closed]
I have two datasets containing size measurements. The initial dataset originates from six different aliquots drawn from a large batch of a product (a suspension with particles). Each sample was ...
- 11
4
votes
1
answer
101
views
Hypothesis tests for Rayleigh variables
Given samples from two Rayleigh-distributed random variables with unknown parameters, $X \sim R(\sigma_x), Y \sim R(\sigma_y)$, what tests can we use to determine if and to what extent their ...
- 1,044
0
votes
0
answers
41
views
Interpretation of Statistical Tests and the Importance of Statistical Power [duplicate]
I was planning on running a statistical test for hypothesis testing, but was confused if statistical power is important once a test is run.
Looking at this confusion matrix, one would ideally set ...
8
votes
3
answers
752
views
Non-significant results when running Kruskal-Wallis, significant results when running Dwass-Steel-Critchlow-Flinger pairwise comparisons
I am writing my Master's thesis on adult's performance on cognitive and linguistic measures. I have four age groups and am investigating if there is an age difference in the performance on summarized ...
- 91
0
votes
1
answer
43
views
How to statistically discover significant process change effectiveness?
I am currently working on a project where I need to assess the effectiveness of changes made in a production process. Our initial success rate was 50%, and after making some alterations, we've ...
- 301
5
votes
3
answers
216
views
Are post-hoc adjusted analyses more valid than initial analyses?
Many papers design a methodology to detect a difference between $2$ groups regarding a primary outcome. This result is then given a $p$ value to denote statistical significance. Some papers then go on ...
- 353
0
votes
0
answers
61
views
How do I proof or disprove that the size of a document influences classification accuracy?
I have a multinomial Naive Bayes model that classifies a document into 1 of 178 classes. This goes well about 50% of the time, so it's pretty good (for my use case) considering the large set of ...
0
votes
1
answer
46
views
Hypothesis test on binary preference [duplicate]
I have two product designs and I want to see if there is a significant difference between which people like which design the best. I did a survey where I showed a photo of each design and asked ...
- 101
1
vote
1
answer
34
views
Statistical significance of correlations from confidence intervals... making my brain hurt a little
Quick question (hopefully)...
If you have a correlation of -0.256 with a 99% confidence interval of -0.541 to 0.185,
OR, a correlation of -0.336 with a 99% CI of -0.597 to 0.125...
That essentially ...
0
votes
0
answers
38
views
is my p-value significant at 3.9e-11? [duplicate]
I know that if it says < 3.9e-11 it is significant because it is less than. But this time it has no < symbol, just the value of 3.9-11. Does this mean its not less than or is it still ...
- 1
3
votes
1
answer
30
views
Sample size estimate for difference of hazard ratios
I'm planning a Kaplan-Meier analysis and need to determine an appropriate sample size for the study. I have two treatment arms and want to show that there is a differential biomarker effect depending ...
- 8,470
0
votes
1
answer
149
views
What do these Wilcoxon values tell me?
I did a pre and post-test with a small number of students ($n=12$).These values came after a science intervention that took $4$ weeks. I used a Wilcoxon test for 2 related samples as there was not a ...
2
votes
1
answer
34
views
Barnard's unconditional test gives different results when switching rows and columns?
I'm really new to statistical analysis, and I've been playing around with exact tests for 2x2 contingency tables. I've noticed that for the Barnard test (implementation with ...
- 23
6
votes
2
answers
259
views
Comparing the mean of biological replicates that are not normally distributed, low N for replicates
I work in cell biology where the field standard is now to do 3 biological replicates of experiments. However, each data point is extremely laborious to get and we receive very little statistics ...
- 61
1
vote
0
answers
55
views
How to identify statistical significance in a difference between means of grouped survey questions
I'm looking at some survey data where the questions were on a Likert scale. For each question I get what percentage respond positive/neutral/negative. There are on the order of 30,000 survey ...
- 191
1
vote
0
answers
9
views
heterogenous treatment effects - a question
So I conducted a framing experiment - 4000 people received either framing A or B, and donated $ to a charity if they wanted to.
Now I want to check if framing A or B had specific efffects on ...
0
votes
0
answers
44
views
Hypothesis Testing - Varying p-value issue in my MWU
I have two machines (A & B) in our production line. A is older, B is very new. Both perform the same tasks, except that machine B is advanced and will perform 1 task less than the no of tasks in ...
- 3
-2
votes
0
answers
21
views
accept reject function x 0<x<1 [duplicate]
hi everyone I'm trying to implement the code in r of accept and reject the function but I don't understand what I should do when my distribution function is not in 0 and 1 as in the case of fx(x)=x
...
1
vote
1
answer
28
views
Unsure of statistics needed while working with replicates
I apologize if the question is considered too broad, but I'm hoping to get at least a basic starting point as I'm somewhat stuck with how to approach this.
I am working with community ecological data-...
- 21
0
votes
0
answers
22
views
What is the best method for imputing binary (or integral/count) data?
I have a longitudinal dataset, and I want to create a composite score by including five healthy lifestyles to measure the overall lifestyle over time (use as predictor). Each lifestyle is a binary ...
- 113
1
vote
1
answer
34
views
Comparing the change in proportions across two time periods for two groups
I am running a test across two groups over a period of time and want to understand if the Change in proportions for my test group is significantly different to the change in proportions in the control ...
- 11
1
vote
6
answers
98
views
Regression model with good p-values but bad error
Suppose there is some data and all assumptions for regression are met. I fit 2 regression models now:
Case 1: Regression model where all coefficients have significant $p$ values but overall the model ...
1
vote
0
answers
29
views
How to get plot of Ripley's K function (Kest) for temporal data in R? [closed]
I have the temporal data of Landslide events in CSV format. My data consists of Year, Month, and Day of events. I want to see if there is temporal clustering for events or not by using Ripley's K ...
0
votes
0
answers
12
views
How would I determine statistical significance on exponential data?
I'm trying to determine if there's a statistically significant difference between the O2 permeability into two different materials.
The measurements are percentage of O2 (O2%), measured every 15 ...
0
votes
0
answers
16
views
Is there any statistical significance test similar to chi-square that penalizes small groups, making them less significant?
Let's imagine an NxM contingency table, where rows represent groups and the columns represent attributes, so the table describes the number of entities with given attributes belonging into given ...
- 75
2
votes
1
answer
66
views
How to interpret the p-value associated with the intercept?
I ran a gamlss to predict my response variable Y with 2 categorical factors PROTECTION and JOUR
...
1
vote
1
answer
39
views
What statistical test do I use to compare two counts with several categories?
I'm trying to figure out how to test if the count of benthic species is significantly different between two transects. We have 13 species in this example, with two transects, each transect having a ...
- 11
2
votes
0
answers
50
views
Why don't deep learning-based computer vision studies utilize statistical tests for comparisons? [closed]
Many readers familiar with scientific articles in the field of deep learning-based computer vision might have observed a common practice: the absence of statistical significance tests for comparing ...
- 53
1
vote
0
answers
31
views
How to test the importance of environmental variables to a crocodile when selecting a nest site (geographic location)
I don't have a background in stats so please bear with me. I'm developing a study on where saltwater crocodiles nest. I want to see how variables such as slope of the bank, sun exposure, vegetation ...
- 11
8
votes
3
answers
1k
views
Why is the sample size required peaking at 16600ish for higher levels of population size?
I was calculating the no. of people I need to survey to represent my fairly large population.
I used an online calculator: https://www.surveymonkey.com/mp/sample-size-calculator/
When I entered the ...
- 89