The type-i-errors tag has no wiki summary.
0
votes
0answers
30 views
What is the type 1 error of rejecting samples with low p-values?
Consider an amateur statistician who will discard any sample which does not lead him to reject his null hypothesis at an alpha=.05 significance level with a two-sided test. What is this statisticians ...
1
vote
1answer
46 views
Correcting for Type 1 error in multiple paired t-tests?
I'm wondering whether or not I should adjust the significance level of paired t-tests due to multiple tests (to avoid the possibility of Type 1 error), although the tests are independent. Here's what ...
3
votes
1answer
88 views
On FDA guidance about Bayesian practice
US FDA authorizes the use of Bayesian statistics with informative priors (in certain contexts):
...
1
vote
0answers
59 views
Is a MANOVA justified?
I have to analyze the data from a study in which two groups of subjects (total sample = 30) were tested on 4 cognitive tasks, all realtive to executive functions. For each task, I have accuracy score ...
1
vote
1answer
104 views
Determining number of tests to correct for using Bonferroni
I am doing final revisions to my dissertation, which includes a large number of regressions. I have six outcome variables (DVs) and I am testing the effect of four primary (correlated) IVs, but I am ...
13
votes
2answers
236 views
Optional stopping rules not in textbooks
Stopping rules affect the relationship between P-values and the error rates associated with decisions. A recent paper by Simmons et al. 2011 coins the term researcher degrees of freedom to describe a ...
2
votes
1answer
94 views
Controlling type I error in permutation tests
I'm implementing a permutation test for a test statistic with unknown distribution. Apart from my concrete situation (see below), I'd like to know first
If and under what circumstances permutation ...
0
votes
0answers
175 views
Selection of n in a binomial distribution hypothesis testing problem
Was trying to solve this problem but have hit a wall.
A psychiatrist believes that more than 50% of the users of sleeping pills sleep better simply because of the psychological effect of taking ...
2
votes
2answers
49 views
Conditions under which the power curve is not smooth or continuous in Hypothesis testing
Not sure if this is a valid question.
I was wondering if there is are good answers to this question:
Under what conditions is the power curve not smooth or continuous in Hypothesis testing?
...
3
votes
3answers
215 views
Experiment or simulation to undestand type I and type II errors
I am studying Type I and Type II errors and basic concepts of testing hypotheses. To better develop my intuition I would like to write a few simple simulations.
What I'm hoping is to get a base ...
1
vote
1answer
81 views
Prove this theorem related with specification tests
I'm not a mathematician and I need to prove what this theorem says. I think is easy and I know how it works, but definitively I'm not too much rigorous to make a demonstration. Can anybody help me?
I ...
2
votes
1answer
134 views
The impact of non-normality (contaminated normal) on type 1 error and power when sigma is known
When sigma is unknown, contaminated normal distributions tend to have (1) the issue of the actual Type 1 error rate being lower than the nominal level and (2) the issue of reduced power. This pattern ...
3
votes
1answer
128 views
Overall type I error with dependent tests
Imagine we test 2 dependent samples: For example, we first test an overall sample (treatment vs. control) and then a subset of this overall sample (treatment sbg vs. control sbg). In this case, we are ...
1
vote
1answer
217 views
Frequentist properties of p-values in relation to type I error
This question is related to frequentist properties of p-values and their relation to type I error and why the results from an online simulation differ from what I would have expected.
Assume that I ...
1
vote
0answers
47 views
Relativization and tackling an overdispersed dataset
If there is a species that is hyperabundant in a dataset and makes up 284/1638 individuals yet originated from just 1 of 10 traps. Is a quassi-poisson GLM sufficient providing residual deviance is ...
0
votes
1answer
315 views
What type of error correction do I have to use after Wilcoxon matched pairs test?
Do I have to use Bonferroni's or Holm's corrections?
Please see this previous question for my example data and the design. (Shortly, I have three or more dependent groups.)
6
votes
2answers
1k views
How to test whether a regression coefficient is moderated by a grouping variable?
I have a regression done on two groups of the sample based on a moderating variable (say gender). I'm doing a simple test for the moderating effect by checking whether the significance of the ...
9
votes
1answer
426 views
Overall type I error when repeatedly testing accumulating data
I have a question about group sequential methods.
According to Wikipedia:
In a randomized trial with two treatment groups, classical group sequential testing is used in the following manner: If n ...
28
votes
23answers
6k views
Is there a way to remember the definitions of Type I and Type II Errors?
I'm not a statistician by education, I'm a software engineer. Yet statistics comes up a lot. In fact, questions specifically about Type I and Type II error are coming up a lot in the course of my ...
