All Questions
Tagged with adjustment p-value
22 questions
3
votes
1
answer
759
views
Adjusting alpha for several models in which I am just using most variables to adjust
If I have a study in which I run four regression models, each containing 5 independent variables, this would result in 5*4 = 20 p-values.
However, let's say the first variable is what I predict has an ...
- 2,331
1
vote
1
answer
66
views
P-value adjustment for different classes each tested individually
Testing the effect of a certain gene on survival of two different but somehow related (brain cancer GBM and LGG) patients, with each cancer (GBM or LGG) having several subtypes, how should I adjust ...
- 137
4
votes
1
answer
2k
views
P-value correction for multiple testing using huge datasets
First of all I apologize without the question is very basic, I am taking my first steps in data science, statistics and bioinformatics.
Data information
We are evaluating the correlation (using the ...
- 163
0
votes
1
answer
872
views
Not understanding adjusted p values with Holm's method. Highest value in series divided by 1
I'm finding an issue while adjusting p-values with Holm's method I cannot understand.
It's not a problem in my actual data, but I would appreciate any help to understand the issue.
To show the ...
2
votes
0
answers
18
views
When do I have to correct for multiple comparison when computing different mutiple regression models?
I' ve got a problem with my thesis. I use a set of 3 bloodbiomarkers plus age as a covariate to predict Marker of Functional Connectivity on the one hand and Structural Connectivity on the other hand. ...
- 21
0
votes
0
answers
37
views
Highly significant t-test statistics, any way to correct this?
I have been performing several paired t-test, where I test whether the sample means are different between two groups.
For all of my tests (approx. 30), which all carries 13-14,000 observations, I ...
- 279
2
votes
1
answer
2k
views
Significance of correlation with range restriction in x
Background
Range restriction can happen in various study designs and it affects the results of bivariate correlation or in multiple regression, for example. In some cases the range restriction may be ...
user244721
0
votes
1
answer
59
views
Is this a valid method to adjust for multiple testing?
Assuming I have 100 variables and I do a t-test for each of them without adjusting the p-values, and get 8 significant p-values out of the 100 tests. If my alpha is 5% can I just say that since I ...
0
votes
0
answers
72
views
P value adjustments when subsetting dataframe
I'm analysing a dataset that contains different species. I first use the species ID as an independent variable but then I have to analyse the dataset separated for the different species (in total 3). ...
- 63
2
votes
1
answer
48
views
Multiple hypothesis test
I have some questions about multiple hypothesis test.
Situation 1: We have 1000 p-values, all of them are less than 0.0 5. We may say there are 50 false positive (1000*0.05) in these p-values.
...
- 29
0
votes
0
answers
120
views
Should the Kaplan-Meier p-value be adjusted if new data are added?
The event of interest is subscription purchase and the time variable is days since the creation of the subscription trial within an AB Test. The stakeholders want to monitor the progress each day as ...
- 141
1
vote
3
answers
5k
views
Bonfferroni correction of correlation p-values. What's my k?
I ran a series of Pearson correlations on my data and my supervisor told me to correct the p-values to account for the multiple comparisons I made. She told me to divide the p-value by the number of ...
- 25
2
votes
0
answers
434
views
Adjusting P-Values of one-tailed tests
I am running a large number of two-sample Wilcox tests and using Benjamini, Hochberg, and Yekutieli method to adjust the p-values.
The issue is that when I conduct a one-tailed test, the p-values ...
- 21
7
votes
1
answer
5k
views
Over-represented values in FDR-adjusted p-values
I have a vector of p-values that need correcting for multiple comparisons; based on reading Noble (2009), I am attempting to apply a Benjamini-Hochberg FDR-based correction.
My vector (sorted in ...
- 103
3
votes
1
answer
14k
views
Bonferonni versus FDR
My question is rather simple: When should you use the Bonferroni correction over the FDR correction?
I've read about that the Bonferroni correction applies a more conservative approach in comparison ...
- 63
1
vote
0
answers
124
views
What should be proper p value cutoff point for multiple comparison case?
I have 4 conditions, (Control, Stim-1, Stim-2, Stim-3) and 9 different proteins expression levels in each conditions. The sample number of each protein expression level in each conditions are about ...
- 21
0
votes
0
answers
140
views
How to adjust p-value to reject null hypothesis from sample size in Mann Whitney U test?
I am trying to test if the shape and median of two samples are significantly different using Mann Whitney U test (or wilcox.test in R). The two samples (A and B), ...
- 111
2
votes
0
answers
130
views
Adjust p-values for multiple comparisons
I want to evaluate if a proposed modification M* to a base classifier M is better in terms of accuracy. Both, the base classifiers M and their respective modifications M* are tested on N datasets.
To ...
- 309
8
votes
2
answers
22k
views
p-value correction for multiple t-tests?
My dataset consists of $n$ genes, each of them described by a vector of expression values, $5$ for "healthy" individuals, and $5$ for "unhealthy" individuals.
I am going to run $n$ t-tests (one for ...
- 251
2
votes
2
answers
402
views
Does filtering of data by effect size violate some assumption of P value adjustment methods?
I have pre- and post-treatment continuous data for a large number of variables that I am analyzing for treatment effect. Normally I would obtain the P values and then adjust them for multiple testing ...
- 555
3
votes
2
answers
2k
views
Adjusting a subset of P values to correct for multiple testing
I have a list of 300 $p$ values selected from all $p$ values obtained in multiple testing such that $p<.05$. I do not know the values of $p>.05$ or their number. The $p$ values are not corrected ...
- 555
0
votes
0
answers
1k
views
Adjust p-values for variance inflation factors
I'm fitting linear mixed models and I have slightly inflated p-values due to multicollinearity.
I deleted the factors with the highest VIFs until none of them was larger than 3.
The VIFs tell me, ...
- 115