Questions tagged [false-positive-rate]

In a test for a condition (such as a disease) the false positive rate is the proportion of subjects incorrectly classified as having the condition.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Estimating false accept rates from imposter scores below a threshold

I have a system that compares two items and produces a match score. Scores below a threshold are manually inspected to determine if they match or don't(imposter). Scores above the threshold are ...
1
vote
1answer
98 views

Is most published research indeed false?

I have come across (Ioannidis, 2005) which explains several reasons (mainly statistics-related, that's why I post this question here) to justify the claim that most published research is indeed false. ...
0
votes
1answer
17 views

Optimal solution for false positive effect on business strategy

I am facing a challenge to reach an optimal solution. I will try to explain with an example : Suppose I have created an algorithm to predict if a customer will subscribe to bank deposit plan or not. ...
0
votes
1answer
31 views

Is it possible to estimate accuracy, precision and recall with the given data?

Background: I talked to my friend today and according to herm(him/her) I can calculate precision, recall and accuracy with the current information. Total instances T: 19,532. Instances belonging to ...
1
vote
0answers
32 views

Exclude areas of feature space without getting false negatives

I am using a decision tree classifier to split the feature space according to two classes ( A and B). Events of class A are important and I want to classify all of them correct, i.e. no false ...
0
votes
0answers
10 views

Test for unequal correlation coefficients inflates Type I error for non-uniform sample distribution. How to correct?

Aim I'm studying the hypothesis test which estimates the probablility of the null hypothesis: The difference between two correlation coefficients is 0. More exactly, I deal with the question ...
0
votes
0answers
15 views

Estimating true positive rate with a confidence interval given a classifier + unknown dataset truths

Let's say I've built a binary classifier - one that for instance, can classify whether a particular transaction is fraudulent or not. This classifier outputs a 1 or a 0, with a given degree of ...
1
vote
2answers
41 views

Is it the case that β+power=1?

In psychology papers that do prospective power analyses (example), one often notices the convention of assuming β values (false negative rates) of 0.20, and power levels of 0.80. In other words (if I ...
1
vote
0answers
59 views

What is the integral of the False Positive Rate over the False Positive Rate, compared to the AUC?

In machine learning the Area Under the Receiver Operating Characteristic Curve ($AUC$) can be illustrated in a plot of the True Positive Rate ($TPR$) against the False Positive Rate ($FPR$). Formally, ...
0
votes
0answers
89 views

Expected value for classifier evaluation (confusion matrix, expected rates and cost/benefit matrix)

I am currently doing a machine learning project based on historical data of a game. I am trying to predict which team will win, i.e. team one or team two, based on in-game happenings. The target value ...
0
votes
0answers
33 views

Double Mendelian Randomization: Reasonableness & False Positive Concerns

I've been interested in mendelian randomizations (a form of instrument variable analyses) as a method for gaining insight into causal relationships between risk factors and outcomes. An example i ...
1
vote
0answers
34 views

How to make really bad results from a machine learning model better by reversing predictions

I trained a classification model on some data with two classes and have really low accuracy. I have a false-positive rate of 86 % for both classes I am trying to predict. I was wondering if I could ...
0
votes
0answers
125 views

Statistical significance in an underpowered experiment

Its not clear me to what the correct decision is when statistical significance is reached in an underpowered study. I've seen Can statistical significance be obtained in an underpowered study? and Do ...
0
votes
1answer
26 views

Number of samples required to estimate a desired False Positive Rate

I have an algorithm that for each sample $x_i$ returns an anomaly score $0<s_i<1$. I use cross validation to set a threshold $th$ such that $x_i$ is anomalous if $s_i>th$. During cross ...
2
votes
1answer
72 views

How to tell the likelihood of getting a false positive? [closed]

Say we have a test for a disease we are comparing with the gold standard. You are given the prevalence of the disease, which is 1%, and sensitivity, 80%, and specificity, 90% and a total population of ...
0
votes
1answer
32 views

How are false positives possible? Since shouldn't mathematical methods be “exact”?

That is, it's not possible to have true as false, but isn't that basically what a false positive or a false negative does? That it gives a prediction of a condition existing, when it does not? So how ...
20
votes
2answers
7k views

FPR (false positive rate) vs FDR (false discovery rate)

The following quote comes from the famous research paper Statistical significance for genome wide studies by Storey & Tibshirani (2003): For example, a false positive rate of 5% means that on ...