Questions tagged [statistical-significance]

Statistical significance is a characteristic of a statistic viewed in light of a null hypothesis and a given significance level. It reflects whether the statistic belongs to the rejection region (is statistically significant) or the acceptance region (is not statistically significant).

Filter by
Sorted by
Tagged with
1 vote
2 answers
35 views

Can I use p-values without hypothesis?

I have been working on my Master's Thesis which included a survey and its results have been put through various tests. The unusual thing about my Thesis is that I have no hypotheses at all, making it ...
Mel's user avatar
  • 11
0 votes
0 answers
20 views

Does anyone recognize this significance test between two regression betas?

I came across the following test for statistical significance between two betas (predictors) from a multiple regression model. Note that $R^2$ is the model coefficient of determination, $r$ is the ...
mvanaman's user avatar
  • 121
0 votes
0 answers
11 views

What are the differences and similarities between Reductionism and Holism in data analysis in terms of data storage and data visualization?

I am currently studying Network Analysis and have met the terminologies of Reductionism and Holism and I have read many articles on the Internet about them but I wonder the differences as well as ...
oceanus's user avatar
  • 3,175
0 votes
0 answers
20 views

How to statistically validate samplers? Is Chi-Square test relevant for synthetic data?

I am developing sampling procedures for different kinds of discrete objects (rankings, sets, etc.). In most cases I know the theoretical distribution of the objects I'm sampling. My idea is thus to ...
Siolan's user avatar
  • 1
0 votes
0 answers
20 views

Chi-Square test for independence for field failure data

I'm analyzing the product field failure data where each product can have one or more failures (Failure A, Failure B, Failure C, Failure D etc.) My goal is to understand the correlation between failure ...
Siddhesh's user avatar
  • 675
2 votes
0 answers
48 views

Which test to perform?

Design: We tested mixtures of 12 varieties of species A with species B in multiple growing seasons using an RCBD (Randomized Complete Block Design). The content of species B in the mixture was ...
Ales Kolma's user avatar
0 votes
0 answers
46 views

Significant study is not shown as such in the meta-analysis [closed]

[] https://pubmed.ncbi.nlm.nih.gov/29300423/ significant results from this study. Seino 2018 1This caught my eye. In a meta for protein consumption and muscle mass gain in older adults, the study ...
Snaut's user avatar
  • 101
6 votes
1 answer
121 views

Permutation test for exponential null hypothesis: really bad?

Having found nice formulas for testing the null hypothesis under exponentially-distributed samples, I wanted to see how well permutation tests could do the job. And the answer, assuming no mistakes, ...
feetwet's user avatar
  • 1,044
0 votes
0 answers
3 views

Loan Data: Bucket recoveries 1-D array

Some context: When someone defaults on their loan, we keep track of the recoveries as a percentage of the exposure (loan amount), we have a limited time T (legally) to collect recoveries, those ...
FaresDjerourou's user avatar
4 votes
2 answers
120 views

How do I include these variables within my logistic regression analysis?

So my logistic regression model aims to predict the likelihood of a severe accident (yes/no) based on characteristics of drivers, car types and other factors. I have data which has all this ...
Laura's user avatar
  • 81
2 votes
1 answer
33 views

Statistical test for a biology experiment when plants were grown in 3 different solution concentrations

I have conducted an experiment for my Biology Internal Assessment in the IB Diploma Course where I grew Phaseolus coccineus beans for 14 days. This is the overview of my experiment: Independent ...
Maja's user avatar
  • 21
0 votes
0 answers
19 views

Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario

I am looking for the most suitable statistical test for the following situation: I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
Tom 's user avatar
  • 1
0 votes
0 answers
29 views

GLM or GLMM design for different tasks

I am conducting a study involving 70 participants diagnosed with Mild Cognitive Impairment (MCI) and 75 without MCI. All participants were engaged in taxonomic semantic, thematic semantic, and ...
Franco Ferrante's user avatar
0 votes
1 answer
35 views

How to perform a 2 sample Kolmogorov-Smirnov test controlling for a type II error instead of type 1

I have four completely different sets of two samples and want to check for each set if both samples come from the same distribution, so four Kolmogorov-Smirnov tests total. If it's going to be ...
Frank's user avatar
  • 11
-2 votes
0 answers
58 views

What's wrong with this statistical argument that Brexit caused COVID? [closed]

The innocent beginning I heard a joke that was something to the effect of, "The UK was in the EU for 27 years, then Brexit happens in 2020, and suddenly there's a pandemic - what are the odds?!&...
krock's user avatar
  • 117
4 votes
2 answers
246 views

Can I perform logistic regression or any other type of regression on this dataset?

My data set contains information regarding the number of road accidents separated by gender, age, area, and other factors. Can I perform logistic regression analysis using this dataset to predict how ...
Laura's user avatar
  • 81
0 votes
0 answers
7 views

In APC-Detrended Analysis: Testing for Significant Difference in Cohort Variable Coefficients, Beyond Z-Test

I have conducted an APC-Detrended analysis. Among the results, I want to test whether there is a significant difference in the coefficient values of the Cohort variable especially between the two ...
YEJIN KELLY LIM's user avatar
3 votes
1 answer
50 views

Significance testing on Generalized Additive Mixed Models (GAMMs) - mgcv::gam

I am wondering whether anyone has any insight on comparing the performance of two GAMMs? Specifically, I want to compare two models: A "nested model", one with a smoothed age term ...
PhelsumaFL's user avatar
1 vote
1 answer
67 views

Overlapping confidence intervals of two proportions

According to to G. Cumming and S. Finch in their paper "Inference by Eye" the 95% confidence intervals of two independent means can overlap and the difference between the two means can still ...
Jam.Wil's user avatar
  • 77
1 vote
1 answer
49 views

FDR correction - different number of p-values and models/hypotheses being tested

I have $3$ predictors: $1$ binary (prenatal alcohol exposure) $1$ categorical with $4$ categories (drinking patterns e.g., light stable, heavy reducer) $1$ continuous (total drinks consumed during ...
Emma's user avatar
  • 11
1 vote
0 answers
23 views

Can a t-test be used to compare means obtained from samples of the same batch but tested in two different labs? [closed]

I have two datasets containing size measurements. The initial dataset originates from six different aliquots drawn from a large batch of a product (a suspension with particles). Each sample was ...
Bruce's user avatar
  • 11
4 votes
1 answer
101 views

Hypothesis tests for Rayleigh variables

Given samples from two Rayleigh-distributed random variables with unknown parameters, $X \sim R(\sigma_x), Y \sim R(\sigma_y)$, what tests can we use to determine if and to what extent their ...
feetwet's user avatar
  • 1,044
0 votes
0 answers
41 views

Interpretation of Statistical Tests and the Importance of Statistical Power [duplicate]

I was planning on running a statistical test for hypothesis testing, but was confused if statistical power is important once a test is run. Looking at this confusion matrix, one would ideally set ...
stillQuestioning's user avatar
8 votes
3 answers
752 views

Non-significant results when running Kruskal-Wallis, significant results when running Dwass-Steel-Critchlow-Flinger pairwise comparisons

I am writing my Master's thesis on adult's performance on cognitive and linguistic measures. I have four age groups and am investigating if there is an age difference in the performance on summarized ...
Samplename1's user avatar
0 votes
1 answer
43 views

How to statistically discover significant process change effectiveness?

I am currently working on a project where I need to assess the effectiveness of changes made in a production process. Our initial success rate was 50%, and after making some alterations, we've ...
Luxspes's user avatar
  • 301
5 votes
3 answers
216 views

Are post-hoc adjusted analyses more valid than initial analyses?

Many papers design a methodology to detect a difference between $2$ groups regarding a primary outcome. This result is then given a $p$ value to denote statistical significance. Some papers then go on ...
user356816's user avatar
0 votes
0 answers
61 views

How do I proof or disprove that the size of a document influences classification accuracy?

I have a multinomial Naive Bayes model that classifies a document into 1 of 178 classes. This goes well about 50% of the time, so it's pretty good (for my use case) considering the large set of ...
Jordy Weening's user avatar
0 votes
1 answer
46 views

Hypothesis test on binary preference [duplicate]

I have two product designs and I want to see if there is a significant difference between which people like which design the best. I did a survey where I showed a photo of each design and asked ...
Luis Dias's user avatar
  • 101
1 vote
1 answer
34 views

Statistical significance of correlations from confidence intervals... making my brain hurt a little

Quick question (hopefully)... If you have a correlation of -0.256 with a 99% confidence interval of -0.541 to 0.185, OR, a correlation of -0.336 with a 99% CI of -0.597 to 0.125... That essentially ...
Peter Wesley Odom's user avatar
0 votes
0 answers
38 views

is my p-value significant at 3.9e-11? [duplicate]

I know that if it says < 3.9e-11 it is significant because it is less than. But this time it has no < symbol, just the value of 3.9-11. Does this mean its not less than or is it still ...
camila's user avatar
  • 1
3 votes
1 answer
30 views

Sample size estimate for difference of hazard ratios

I'm planning a Kaplan-Meier analysis and need to determine an appropriate sample size for the study. I have two treatment arms and want to show that there is a differential biomarker effect depending ...
Nuclear Hoagie's user avatar
0 votes
1 answer
149 views

What do these Wilcoxon values tell me?

I did a pre and post-test with a small number of students ($n=12$).These values came after a science intervention that took $4$ weeks. I used a Wilcoxon test for 2 related samples as there was not a ...
jordanLeah's user avatar
2 votes
1 answer
34 views

Barnard's unconditional test gives different results when switching rows and columns?

I'm really new to statistical analysis, and I've been playing around with exact tests for 2x2 contingency tables. I've noticed that for the Barnard test (implementation with ...
spman's user avatar
  • 23
6 votes
2 answers
259 views

Comparing the mean of biological replicates that are not normally distributed, low N for replicates

I work in cell biology where the field standard is now to do 3 biological replicates of experiments. However, each data point is extremely laborious to get and we receive very little statistics ...
EndlessBlue's user avatar
1 vote
0 answers
55 views

How to identify statistical significance in a difference between means of grouped survey questions

I'm looking at some survey data where the questions were on a Likert scale. For each question I get what percentage respond positive/neutral/negative. There are on the order of 30,000 survey ...
jerH's user avatar
  • 191
1 vote
0 answers
9 views

heterogenous treatment effects - a question

So I conducted a framing experiment - 4000 people received either framing A or B, and donated $ to a charity if they wanted to. Now I want to check if framing A or B had specific efffects on ...
Guestquestion's user avatar
0 votes
0 answers
44 views

Hypothesis Testing - Varying p-value issue in my MWU

I have two machines (A & B) in our production line. A is older, B is very new. Both perform the same tasks, except that machine B is advanced and will perform 1 task less than the no of tasks in ...
AKK's user avatar
  • 3
-2 votes
0 answers
21 views

accept reject function x 0<x<1 [duplicate]

hi everyone I'm trying to implement the code in r of accept and reject the function but I don't understand what I should do when my distribution function is not in 0 and 1 as in the case of fx(x)=x ...
Filippooo's user avatar
1 vote
1 answer
28 views

Unsure of statistics needed while working with replicates

I apologize if the question is considered too broad, but I'm hoping to get at least a basic starting point as I'm somewhat stuck with how to approach this. I am working with community ecological data-...
user390865's user avatar
0 votes
0 answers
22 views

What is the best method for imputing binary (or integral/count) data?

I have a longitudinal dataset, and I want to create a composite score by including five healthy lifestyles to measure the overall lifestyle over time (use as predictor). Each lifestyle is a binary ...
zjppdozen's user avatar
  • 113
1 vote
1 answer
34 views

Comparing the change in proportions across two time periods for two groups

I am running a test across two groups over a period of time and want to understand if the Change in proportions for my test group is significantly different to the change in proportions in the control ...
Statseeker's user avatar
1 vote
6 answers
98 views

Regression model with good p-values but bad error

Suppose there is some data and all assumptions for regression are met. I fit 2 regression models now: Case 1: Regression model where all coefficients have significant $p$ values but overall the model ...
stats_noob's user avatar
1 vote
0 answers
29 views

How to get plot of Ripley's K function (Kest) for temporal data in R? [closed]

I have the temporal data of Landslide events in CSV format. My data consists of Year, Month, and Day of events. I want to see if there is temporal clustering for events or not by using Ripley's K ...
Khushboo Kumari's user avatar
0 votes
0 answers
12 views

How would I determine statistical significance on exponential data?

I'm trying to determine if there's a statistically significant difference between the O2 permeability into two different materials. The measurements are percentage of O2 (O2%), measured every 15 ...
Geordan Nicholson's user avatar
0 votes
0 answers
16 views

Is there any statistical significance test similar to chi-square that penalizes small groups, making them less significant?

Let's imagine an NxM contingency table, where rows represent groups and the columns represent attributes, so the table describes the number of entities with given attributes belonging into given ...
oliver.c's user avatar
2 votes
1 answer
66 views

How to interpret the p-value associated with the intercept?

I ran a gamlss to predict my response variable Y with 2 categorical factors PROTECTION and JOUR ...
Marie Guittonneau's user avatar
1 vote
1 answer
39 views

What statistical test do I use to compare two counts with several categories?

I'm trying to figure out how to test if the count of benthic species is significantly different between two transects. We have 13 species in this example, with two transects, each transect having a ...
Wilson's user avatar
  • 11
2 votes
0 answers
50 views

Why don't deep learning-based computer vision studies utilize statistical tests for comparisons? [closed]

Many readers familiar with scientific articles in the field of deep learning-based computer vision might have observed a common practice: the absence of statistical significance tests for comparing ...
ricber's user avatar
  • 53
1 vote
0 answers
31 views

How to test the importance of environmental variables to a crocodile when selecting a nest site (geographic location)

I don't have a background in stats so please bear with me. I'm developing a study on where saltwater crocodiles nest. I want to see how variables such as slope of the bank, sun exposure, vegetation ...
CharlieD's user avatar
8 votes
3 answers
1k views

Why is the sample size required peaking at 16600ish for higher levels of population size?

I was calculating the no. of people I need to survey to represent my fairly large population. I used an online calculator: https://www.surveymonkey.com/mp/sample-size-calculator/ When I entered the ...
user399553's user avatar

1
2 3 4 5
127