# Questions tagged [false-positive-rate]

In a test for a condition (such as a disease) the false positive rate is the proportion of subjects incorrectly classified as having the condition.

17 questions
Filter by
Sorted by
Tagged with
8 views

### Estimating false accept rates from imposter scores below a threshold

I have a system that compares two items and produces a match score. Scores below a threshold are manually inspected to determine if they match or don't(imposter). Scores above the threshold are ...
98 views

### Is most published research indeed false?

I have come across (Ioannidis, 2005) which explains several reasons (mainly statistics-related, that's why I post this question here) to justify the claim that most published research is indeed false. ...
17 views

### Optimal solution for false positive effect on business strategy

I am facing a challenge to reach an optimal solution. I will try to explain with an example : Suppose I have created an algorithm to predict if a customer will subscribe to bank deposit plan or not. ...
31 views

### Is it possible to estimate accuracy, precision and recall with the given data?

Background: I talked to my friend today and according to herm(him/her) I can calculate precision, recall and accuracy with the current information. Total instances T: 19,532. Instances belonging to ...
32 views

### Exclude areas of feature space without getting false negatives

I am using a decision tree classifier to split the feature space according to two classes ( A and B). Events of class A are important and I want to classify all of them correct, i.e. no false ...
10 views

### Test for unequal correlation coefficients inflates Type I error for non-uniform sample distribution. How to correct?

Aim I'm studying the hypothesis test which estimates the probablility of the null hypothesis: The difference between two correlation coefficients is 0. More exactly, I deal with the question ...
15 views

### Estimating true positive rate with a confidence interval given a classifier + unknown dataset truths

Let's say I've built a binary classifier - one that for instance, can classify whether a particular transaction is fraudulent or not. This classifier outputs a 1 or a 0, with a given degree of ...
41 views

### Is it the case that β+power=1?

In psychology papers that do prospective power analyses (example), one often notices the convention of assuming β values (false negative rates) of 0.20, and power levels of 0.80. In other words (if I ...
59 views

### What is the integral of the False Positive Rate over the False Positive Rate, compared to the AUC?

In machine learning the Area Under the Receiver Operating Characteristic Curve ($AUC$) can be illustrated in a plot of the True Positive Rate ($TPR$) against the False Positive Rate ($FPR$). Formally, ...
89 views

### Expected value for classifier evaluation (confusion matrix, expected rates and cost/benefit matrix)

I am currently doing a machine learning project based on historical data of a game. I am trying to predict which team will win, i.e. team one or team two, based on in-game happenings. The target value ...
33 views

### Double Mendelian Randomization: Reasonableness & False Positive Concerns

I've been interested in mendelian randomizations (a form of instrument variable analyses) as a method for gaining insight into causal relationships between risk factors and outcomes. An example i ...
34 views

### How to make really bad results from a machine learning model better by reversing predictions

I trained a classification model on some data with two classes and have really low accuracy. I have a false-positive rate of 86 % for both classes I am trying to predict. I was wondering if I could ...
125 views

### Statistical significance in an underpowered experiment

Its not clear me to what the correct decision is when statistical significance is reached in an underpowered study. I've seen Can statistical significance be obtained in an underpowered study? and Do ...
26 views

### Number of samples required to estimate a desired False Positive Rate

I have an algorithm that for each sample $x_i$ returns an anomaly score $0<s_i<1$. I use cross validation to set a threshold $th$ such that $x_i$ is anomalous if $s_i>th$. During cross ...
72 views

### How to tell the likelihood of getting a false positive? [closed]

Say we have a test for a disease we are comparing with the gold standard. You are given the prevalence of the disease, which is 1%, and sensitivity, 80%, and specificity, 90% and a total population of ...