# Questions tagged [false-positive-rate]

In a test for a condition (such as a disease) the false positive rate is the proportion of subjects incorrectly classified as having the condition.

41 questions
Filter by
Sorted by
Tagged with
22 views

### Equal Error Rate (EER) Metric - Why is lower better?

With the Equal Error Rate (EER) Metric, why is the lower the value the better (more accurate binary classifier system)? Also, when finding the EER on the ROC curve, is it correct in saying the EER is ...
206 views

### Best way to reduce false positive of binary classification to exactly 0?

I'm working on a task that even a 0.00001 fp rate is not acceptable, because detecting something as a positive when its not will have very bad consequences in this task, so it needs to be exactly 0 ...
85 views

### Formula for expected false positive & negative rates in hiring decisions based on r

I would like to look at the size of the expected false positive and false negative rates in employment hiring decisions. Let's assume that it is useful to dichotomize job performance after hiring. ...
23 views

### Does up-sampling lead to lots of false positives in production?

Say we have a dataset with a binary outcome variable that takes the positive case (outcome = 1) roughly 20% of the time. Often, we would modify the training set by ...
9 views

### Sensitivity and specificity with multiple sequential tests

This has been on my mind for a while, and I would appreciate a statistician's view on the matter. Suppose that a given test has sensitivity $a$ and specificity $b$. Now, periodically apply this test ...
34 views

### Estimating positive and negative predictive value without knowing the prevalence

There is a lot of discussion about the positive predictive value of a test currently. I know that if I know specificity, sensitivity of a test and the prevalence $p$ in the sample, then I can easily ...
20 views

### Correlation between two non-independent samples (dichotomized data / multiple testing)

I've been looking through text books but unable to find a precise answer to this question, but it seems important so maybe I'm looking in wrong places. Imagine some population with a normal ...
13 views

### How do you cope with the risk of false-positives in exploratory analysis?

Let's say that I'm running exploratory analysis on a dataset. For instance, let's say that the dataset consists of several features and two groups and I want to see which features are significantly ...
7 views

### Any way to give a predicted value for FDR if you know the ⍺-level + the number of comparisons?

I'm writing a school paper on false positives and the multiplicity problem. I want to show that multiple testing inflates the false discovery rate (FDR) and that FDR increases with the number of ...
28 views

### False positive rate with multiple dichotomisation

There are reasons this is bad practice, but I want to try and calculate the following - if one takes a distribution (say a normal distribution) and applies $n$ multiple dichotomisations to it and chi ...
57 views

### Aren't all tests sensitive to the prevalence of a disease in the population?

I'm trying to understand the difference between the false-positive rates of two kinds of COVID-19 tests: PCR and antibody. The former indicates if someone is currently sick. The latter indicates if ...
36 views

### One-Class SVM threshold parameter

I have to implement metrics FPR at 95%TPR. In order to do that I have to look for the different decisions of OCSVM dependent on the threshold. If I execute this simple code: ...
133 views

### How can I fix type 1 error for my logistic regression model?

I am testing if the sound pressure levels(rms) of shipping noise affect the presence or absence of the fin whales by acoustic monitoring for 4 months of data from one location. Here my response ...
26 views

### How do you combine confidence intervals for antibody test estimates?

I would like to know how to combine the uncertainty related to the false positive rate of an antibody test with uncertainty due to sampling. As an example, let's use the recent New York State estimate ...
26 views

### How to bias against false positives given estimate and standard deviation?

For 1000 newsletter recipients, I crudely estimate the likelihood (p) of them reading the next email sent as: ...
19 views

### If a false positive rate of α is desired, what is the acceptable range of false positives one would expect from a sample size of n?

For instance, suppose I design a test to have a false positive rate of 5%. I am going to perform this test on what is assumed to be an all negative population. If my sample size was 20, I would expect ...
25 views

### How could one estimate the false positive rate of a deployed fraud detection system?

On a labeled dataset, the FPR of a classifier could easily be measured. However, after a fraud detection system is deployed, we lose the ability to gain a ground truth classification of the positives. ...
14 views

### Procedure to Smooth Noise for Threshold Values

Suppose I am looking at an estimate $\hat\beta$ in a clinical trial data. With $a=.05$, a patient with $\hat\beta>1$ is considered to have some medical condition. A daily example could be a 24-hr ...
118 views

### Base rate of accuracy after resampling for classification problems

If I had an imbalanced dataset with 10% positive instances and 90% negative ones, the base rate for accuracy before resampling is 90%. But what about I resampled the data such that I have an equal ...
31 views

### Deriving a loss function properly accounting for different error type costs

Consider a classification setting like a medical test: Not finding an existing health issue might be much worse (by a factor of 50) than assuming an issue when there is none. I.e. a setting in which ...
41 views

### What is “positive”?

I'm deeply confused by some concepts. We often hear the term true/false positive/negative. While it is straightforward to tell if the result is true or false, I ...
104 views

### FPR in Confusion Matrix

I was trying to manually calculate $\text{TPR}$ and $\text{FPR}$ for the given data. But unfortunately I dont have any false positive cases in my dataset and even no true positive cases. So I am ...
77 views

### Oversampling/Undersampling in respect to Train and Test - Isolation Forest

I've got a quite imbalanced data set. 144.496 : 162 -> ratio of 1000:1 I would like to use IsolationForest to detect the 162 anomalys. I've already split the data. However, the iForest doesn't ...
8 views

### Multiple hypothesis correction yields higher FDR on lower number of tests. Why?

I have a DF (df1) with thousands of rows, where each row has a test and associated P, and their corresponding corrected P values (FDR Benjamin-Hochberg). Under ...
97 views

### False positive/negative rate in ridge and lasso regressions

I have a confusion matrix of true and estimated $\boldsymbol{\beta}$ vectors of lasso and ridge models from a replicate of a simulation study, say. The following tables illustrate the scenario. \...
51 views

### How to make sense of both high FNR and NPV?

So, even though this is one of the most basic and already explained things about statistics I always seem to find way not to get it. Having this table which shows high Negative Predictive Value (352/...
87 views

### SVM probability output threshold as (1 - FPR)?

I have a binary SVM with probability output (via Platt scaling). I want to set a threshold on the probability outputs since I want to trade off making false positives/negatives. Is it possible to ...
48 views

### How to interpret a False Discovery Rate plot

It is the first time that I am trying to calculate the FDR and I use the fdrtool package in R. I want both, local and tail area graphs and I think the third ...
13 views

### Estimating false accept rates from imposter scores below a threshold

I have a system that compares two items and produces a match score. Scores below a threshold are manually inspected to determine if they match or don't(imposter). Scores above the threshold are ...
111 views

### Is most published research indeed false?

I have come across (Ioannidis, 2005) which explains several reasons (mainly statistics-related, that's why I post this question here) to justify the claim that most published research is indeed false. ...
17 views

### Optimal solution for false positive effect on business strategy

I am facing a challenge to reach an optimal solution. I will try to explain with an example : Suppose I have created an algorithm to predict if a customer will subscribe to bank deposit plan or not. ...
113 views

### Is it possible to estimate accuracy, precision and recall with the given data?

Background: I talked to my friend today and according to herm(him/her) I can calculate precision, recall and accuracy with the current information. Total instances T: 19,532. Instances belonging to ...
33 views

### Exclude areas of feature space without getting false negatives

I am using a decision tree classifier to split the feature space according to two classes ( A and B). Events of class A are important and I want to classify all of them correct, i.e. no false ...
20 views

### Estimating true positive rate with a confidence interval given a classifier + unknown dataset truths

Let's say I've built a binary classifier - one that for instance, can classify whether a particular transaction is fraudulent or not. This classifier outputs a 1 or a 0, with a given degree of ...
127 views

### Is it the case that β+power=1?

In psychology papers that do prospective power analyses (example), one often notices the convention of assuming β values (false negative rates) of 0.20, and power levels of 0.80. In other words (if I ...
123 views

### What is the integral of the False Positive Rate over the False Positive Rate, compared to the AUC?

In machine learning the Area Under the Receiver Operating Characteristic Curve ($AUC$) can be illustrated in a plot of the True Positive Rate ($TPR$) against the False Positive Rate ($FPR$). Formally, ...
40 views

### How to make really bad results from a machine learning model better by reversing predictions

I trained a classification model on some data with two classes and have really low accuracy. I have a false-positive rate of 86 % for both classes I am trying to predict. I was wondering if I could ...
154 views

### Number of samples required to estimate a desired False Positive Rate

I have an algorithm that for each sample $x_i$ returns an anomaly score $0<s_i<1$. I use cross validation to set a threshold $th$ such that $x_i$ is anomalous if $s_i>th$. During cross ...
112 views

### How to tell the likelihood of getting a false positive? [closed]

Say we have a test for a disease we are comparing with the gold standard. You are given the prevalence of the disease, which is 1%, and sensitivity, 80%, and specificity, 90% and a total population of ...