# Questions tagged [type-i-and-ii-errors]

Type I: rejecting the null hypothesis when it is true. Type II: not rejecting the null hypothesis when the alternative is true.

201 questions
Filter by
Sorted by
Tagged with
9 views

### standard name for area under type 1 vs type 2 error curve?

we already have precision-recall, and roc curves, why aren't type 1-type 2 error curves more popular? Is there a standard name for the area under such plots?
66 views

### Should bootstrapping and collecting sample means from a series of binomial distributions result in standard normal?

I’m trying to better understand several statistical concepts (bootstrapping, central limit theorem, and confidence intervals) by applying them to a binomial distribution (you can think of it as a coin ...
101 views

### Is it possible to simultaneously call multiple regression coefficients significant?

Okay, this is a thought experiment: Suppose you have a dataset with 40 covariates. Suppose the data has every nice theoretical property you could want: randomly sampled, variables not correlated, etc....
7 views

### Errors if running multiple logistic models with same predictors but different dependent variables?

I have a number of predictors and dependent variables that I intend to run with logistic regression. The DVs are binary and IVs are binary and ordinal. My question is, if I run multiple models with ...
41 views

### “Optional stopping” to *reduce* type-I-error

I ran an experiment to test for some effects (which I indeed see evidence for), but in the analysis, also found a surprising effect that I could find no theoretical justification for. Specifically, ...
75 views

### Is it possible to find out the probability of a type 2 error in 2 sample t test?

I was wondering if it's possible to see what is the probability of getting a type 2 error in my investigation into whether there is a difference in length of time between cells in anaphase and ...
16 views

### Multilevel models and correcting for multiple comparisons

I am conducting a study where there are three different DVs. For each DV I will be conducting a multilevel model with 2 predictors and will be interested in both main effects and interactions between ...
20 views

### Interim analysis and alpha spending in group sequence design of clinical trials

In group sequential design, does the type of interim analysis affect the alpha spending for each look? I tested in ADDPLAN, with two interim analyses, specifying "stopping for futility" or not does ...
29 views

### Alpha and Hypothesis Testing [closed]

(The type I error, alpha) Which one of the statements about the alpha level is correct? a) The alpha level is the predefined probability of making a mistake when the null hypothesis is false. b) The ...
30 views

### What is the difference between type I error and type II error in default or non-default case?

What is the difference between type I error and type II error in forecasting default of a company? For example, I can set null hypothesis to be "The company will default next year", or I can set it to ...
68 views

### P-values in multiple comparison t-test

I'm a biologist trying to teach my college class about the issue of multiple comparisons with t-tests. I've explained that the alpha value must be "combined" so to speak from each of the related ...
12 views

### Deriving the experiment-wise error rate of testing all hypotheses at the same time

$\textbf{Q}$: Suppose that we are conducting the tests on the hypotheses $H_i , i = 1, \dots ,k$. For each hypothesis, a test statistic $T_i$ is formed, where each $T_i, i = 1, \dots , k$ are ...
29 views

### Nonlinear Wald Test

Say we have a bivariate distribution $~~~~~f(x,y|\theta=\{a,b,t,c\}).$ An event of interest is when ab=c, that is, $~~~~~H_0: g(\theta)=c-ab=0$ versus $H_1: g(\theta)=c-ab \neq 0.$ I attempt to ...
89 views

### In what sense does interim monitoring of clinical trials “cost” a Bayesian?

I have read (and will seek a specific reference on the subject) that unlike Frequentist trials, Bayesians can continually monitor data as it accrues. A Frequentist tries to control, and thus ...
129 views

### Family-wise Type I error OLS regression

Why is it advised to control the Type I error rate (e.g. Turkey's HSD) when conducting several pairwise comparisons, but not when assessing the significance of several coefficient estimates when ...
Consider performing a statistical hypothesis test and wants to achieve significance $\alpha$. What is a good rule of thumb for an allowable deviation from the desired confidence level? Say I want to ...