Questions tagged [threshold]

Used (1) for discrete classification (if an instance's predicted probability exceeds a threshold, classify as TRUE, otherwise FALSE), or (2) for discretizing/binning continuous data. *If you are tempted to use this tag, PLEASE read the tag wiki!*

Filter by
Sorted by
Tagged with
0
votes
0answers
7 views

Clmm: How can I constrain the first threshold to 0, to estimate the intercept in a cumulative link mixed model?

I am running a multilevel ordinal regression model that includes a random intercept, a random slope, and a cross-level interaction, in R with the ordinal package using the clmm function. The model ...
0
votes
0answers
23 views

Reverse engineering a censored model [on hold]

Provided a database with instances of X (but no y), and a score (between 0-1, not calibrated in probabilities), I am interested in "reverse engineering" it. Are there other approaches to it than ...
0
votes
0answers
16 views

Measuring the effect of a variable across a threshold

Within my data I am trying to assess whether the response variable increases as we move across different thresholds. The difficulty is that the response variable also increases exponentially as a ...
0
votes
0answers
8 views

Determining final TPR and FPR in staged classification model

I'm given pictorial dataset with 3 classes where I'm using the following scheme for classification (this scheme was chosen because classes 2 and 3 are close to each other, so this approach yields ...
0
votes
0answers
46 views

Precision/Recall against threshold curve not useful in improving model performance

I am doing fraud detection (binary classification) on an unbalanced credit dataset, using SVM. My current precision is 5% while recall is 90%. (I am using undersampling to train and test a model from ...
3
votes
0answers
36 views

MCMC in Gibbs: Threshold Multivariate Linear Regression

I have a problem regarding what I expected to be a rather straightforward modelling approach: I want to investigate multivariate linear regression parameters and a thresholding parameter which defines ...
0
votes
0answers
16 views

How can I use receiver operator curve in this SVM classification problem?

Short description of the learning task: I have a corpus containing voice segments annotated with the mean BPM obtained from heart rate recordings. For example, one sample would be like 5 s audio, ...
0
votes
0answers
11 views

how to parameter the gamess function?

i want to run gampackage to calculate threshold and semi parametric model, especialy partialy linear model like : Y = V1 + V2 + V3 + f(V4) where: Y is factor and dichotomic varible; V1 is continuous ...
0
votes
1answer
17 views

Does the threshold value of a logistic regression hypothesis has an effect on the accuracy?

It is true that the threshold value of a logistic regression hypothesis has an effect on the Precision/Recall metrics. Suppose you have trained a logistic regression classifier which is outputting $...
0
votes
1answer
87 views

How to implement thresholded softmax in Keras?

I would like to implement a threshold after the final softmax layer in a Keras-built classification problem so that class assignments with probability below some threshold alpha are disregarded (i.e. ...
0
votes
0answers
9 views

Placebo Thresholds in a Fuzzy Regression Discontinuity Design

Matsudaira (2008) used test scores to evaluate the impact of summer school attendance on students' performance. In this system, a student that scored less than an arbitrary grade was more likely to be ...
0
votes
0answers
16 views

How to find a threshold based on overlapping the histograms of two classes?

I want to perform thresholding to post-process the test data. I averaged the pixel intensity histograms of normal and abnormal cell images (grayscale, 8-bit, 256 * 256 images), overlapped them to ...
13
votes
5answers
2k views

Philosophical question on logistic regression: why isn't the optimal threshold value trained?

Usually in logistic regression, we fit a model and get some predictions on the training set. We then cross-validate on those training predictions (something like here) and decide the optimal threshold ...
0
votes
0answers
36 views

Threshold variable: Stationary?

Say I have an Logistic Smooth transition model (or even a "TAR" model): \begin{equation} \tilde{y}_{t}=x_{t}^{\prime }\beta _{1}(1-{g}(z_{t};\gamma ,\delta ))+x_{t}^{\prime }\beta _{2}{g}(z_{t};\gamma ...
0
votes
0answers
20 views

Justification for LST model

Let’s say I have a linear model specification but I believe that a logistic smooth transition model would be better. Is there any evidence I can take from the linear model that would point me in ...
0
votes
0answers
20 views

Multiclass classifier with undefined prediction, how to calculate metrices

I build a multiclass classifier. I want the classifier to predict a few samples with little false positives, rather then many samples with lots of false positives. Therefore I want to choose a ...
0
votes
0answers
10 views

Help inference results of a threshold regression model with multiple threshold variable

Just ran the package pdR, but i am having problems interpreting the results. Do i only check the p-values to validate results? what else do i have to look at? Output[[1]] #Formatted output of 1st ...
0
votes
0answers
23 views

Can I use logistic regression to calculate the optimal classification threshold between two class based on a single contiguous variable

I have a single contiguous variable, x, and there is two possible classes/labels y for n observations. I need to build a simple binary classifier with a threshold on x so that the number of ...
0
votes
0answers
21 views

What is the difference between finding the threshold and training a binary classifier?

I have 1-D data: the output of a Cosine similarity (COS) distance between two features. The data is bounded by [-1,1]. When I just try to find the optimum threshold for class labels - I get an ...
0
votes
1answer
165 views

Learn threshold for multi-label classification

I have a multi-label problem which I'm tackling with a NN. To get the multi-label scores, I use a tanh on the last layers (as suggested in the literature), and then selecting the ones corresponding to ...
2
votes
0answers
48 views

ROC curve for comparing probability of default models

I'm trying to compare two different probability of default models together by roc curve.I calculated the PD for 8 company by two different models.I know about the basic of roc curve and i can ...
1
vote
1answer
407 views

Adjust thresholds in multi-class classification [duplicate]

I have trained a random forest classifier on a (highly-imbalanced) 3-class problem (A 1% of the data, B 96%, C 3%) and obtained probabilities for each of the three classes. Currently I assign an ...
1
vote
0answers
34 views

Techniques for data thresholding

I had a query regarding one of the problems I am trying to solve. I have a few things in mind and would love if you could suggest and/ or point me in the right direction. Problem Statement - I have a ...
0
votes
0answers
17 views

Recommended tests to determine whether threshold autoregression is suitable

I was wondering if anyone had suggestions about the best sort of test to determine whether a SETAR model is a reasonable specification. I've come across some portmeanteau tests, but I'm not sure ...
2
votes
1answer
58 views

Soft thresholding (Donoho and Johnstone)

Donoho and Johnstone (1994) poses the following equality: $$ E((\eta_t(X) - \mu)^2) = 1 - 2\Pr(|X|\lt t) + E(\min(X^2,t^2)) $$ where $\eta_t(X) = \operatorname{sign}(x)\max(|X|-t,0)$ and $X \sim N(\...
1
vote
1answer
179 views

Calculate threshold value for Poisson distributed noise

I need to calculate a threshold value to get rid of Poisson distributed noise in an image to perform a cluster analysis on the image. The image is the representation of a signal, whose datapoints ...
0
votes
0answers
246 views

Determine the cutoff threshold for binary classification models using cross validation

I have a binary classification model which returns class probability scores as the outcome. I did the model parameter tuning using repeated k-fold cross-validation. I am wondering how can I decide the ...
1
vote
0answers
26 views

Multiple outputs quantile regression

I am building a model to determine upper and lower thresholds for multiple features with respect to multiple others. (Specifically, I want to see if certain pressure measurements in an HVAC system ...
0
votes
1answer
1k views

Threshold to build confusion matrix?

I a have data set with 10 sections of data and each section shows one day observation. I designed the training and test set as follows: 8 sections for training the data and the last two sections for ...
1
vote
0answers
35 views

How to determine the optimal threshold for my classification problem using fpr ,tpr values for each classification record?

The output of my prediction using classification algorithm is in dataframe that contains TPR and FPR value for each prediction. Suppose I have 100 records for prediction then in that cade my data ...
1
vote
0answers
203 views

Implementing a threshold for multiclass classification with softmax activation

We have a CNN where images are classified into between 7 and 30 classes, depending on the training set. The final output is via SoftMax activation, and thus all the probabilities add to one. I notice ...
0
votes
1answer
31 views

Statistical test for count data passing a given threshold

Apologies if this question is painfully basic. I have a df of count data in which each row represents a box of marbles, some of which are black, and some are white: ...
0
votes
0answers
53 views

How to create a binary threshold from Cosine distance between 1-D arrays?

I have a graph of the Cosine distance between the question and the sentence most similar to it when there is an answer and when there is none. I want to establish a threshold on the abscissa axis ...
2
votes
0answers
30 views

Whether and how to bin data beyond a certain threshold

I've seen many admonishments against binning and agreed with them in general, but I wonder it's advisable to do so under certain circumstances. To adapt an example from my actual project, let's say ...
1
vote
1answer
129 views

General rule uniform distributed classes

Given a classifier working with double values e.g. between 0 and 1. There are two classes with different ranges. Their distributions are uniform, however, one class is more likely. Is picking always ...
1
vote
3answers
104 views

Statistically prove classification accuracy is acceptable

I made a neural network to do binary classification with medical images. Since I evaluate test accuracy (x% accurate), is there any statistical method which can be ...
1
vote
0answers
231 views

Practically speaking, is the TF-IDF threshold universal across different corpus?

I would like to know the practical threshold of the TF-IDF (just like the practical p-value cutoff of 0.1 or 0.05 in hypothesis tests). I tried to look at it in some previous post, and some people ...
1
vote
0answers
31 views

estimating Threshold-Models in seperate equations

I´m currently dealing with threshold VECM models in time series. The basic idea behind a TVECM, according to Lo and Zivot 2001 is There is one point I don´t understand: As far as I see every ...
0
votes
1answer
30 views

Establish the proper prediction threshold

Suppose for a ML classification problem X, I have three labels, i.e. 1, 0 and -1. For some reasons, I obtained bad accuracy. So I decided to change the number of labels to two, i.e. 1 and -1. That way ...
0
votes
1answer
298 views

Finding an optimal class probability threshold for SVM

I've got an imbalanced data set on which I'm training an SVM using cross validation. I'd like to find the optimal class probability threshold that maximizes the F measure. I've tried doing this by ...
0
votes
0answers
26 views

What are the reasons to tune the prediction threshold of a model? [duplicate]

Intelligently thresholding your model should be done when one of the following situation occurs: Data is imbalanced. Different levels of the dependent variable have different real-world importances, ...
0
votes
0answers
49 views

How to determine optimal “threshold” for taking in averages of data?

Sorry in advance if this isn't the right place for this question. I'm working on a project to try to determine whether a particular object is is producing sound or not. I'm using a piece of hardware ...
1
vote
1answer
340 views

How many missing values in a dataset can Xgboost handle?

I have a dataset with a lot of missing values in the columns. I dropped all columns containing more than 70% of missing values. I'm considering using Xgboost for my prediction because it can handle ...
1
vote
0answers
47 views

Decision rule for Bayesian variable selection

I'm fitting a spike-and-slab regression model to sparse data and obtaining posterior probabilities of association (PPA). I now would like to 'declare' associations based on the latter. I'm concerned ...
1
vote
0answers
68 views

Find a cost-sensitive multiclass algorithm

I am working on decision trees which can directly work in a multiclass context. My aim is reduce the misclassification's errors of a decision tree by improving its ability to tackle imbalanced ...
-1
votes
1answer
78 views

Constructing feature vectors for clustering from row values

Thank you for some ideas regarding my question below. Background: I have an excel file with each row representing transactions (or transaction id's) in the format below and I am creating a feature ...
0
votes
0answers
110 views

Difference between using thresholds to classify and using a custom objective function

Suppose we are faced with a binary classification problem. The standard approach seems to be to fit a probability estimator using a loss function like log loss and then afterwards determine the ...
2
votes
0answers
172 views

Ordered Probit Model in R: Latent Variable and Threshold Parameters

I have recently started to improve my methodological skills and programming in R. For a study term paper I now want to run an ordered logit/probit model. The data I use are taken from the European ...
2
votes
0answers
186 views

What is the correct way to modify the bin-counts given a threshold for a chi-squared test?

When performing a chi-square test, one inputs the expected counts (via integrating probability distribution over respective bin bounds) and observed counts into the chi-square formula (denoted below). ...
2
votes
0answers
273 views

How to choose threshold in probabilistic multi-label classification?

My problem is to tag some texts with some labels. That is multi-label classification in ML. I did predict with Catboost classifier and get some results of binary ...