Questions tagged [binary-data]

A binary variable takes one of two values, typically coded as "0" and "1".

Filter by
Sorted by
Tagged with
2
votes
1answer
27 views

Performance metric for small, imbalanced, binary dataset?

I'm training an Elastic Net model on a small dataset with about 100 TRUE outcomes and 15 FALSE outcomes. I've been using ...
0
votes
2answers
25 views

What kind of analysis can I make in order to understand which variable impact the most my result?

Here's the thing, I have data from my products in a dataset just like this: ...
1
vote
0answers
19 views

Type of correlation between binary and ordinal variable [duplicate]

I have two variables. The first variable is binary (yes or no) and measures if a person is happy or not. The second variable consists of 5 integers from 1 to 5 and measures if an emotion is positive ...
4
votes
1answer
95 views

Probability: Binomial data

If the true success probability for binomial data is close to 0.50, why would you expect to have less certainty with your mean parameter estimate than if the true success probability were closer to 0 ...
2
votes
1answer
97 views

No Goodness-of-Fit for Binary Responses (GLM)

In this book, p.334 (348 for pdf) it says you can model a binomial regression in a few ways: response as an observed proportion, with weights. e.g. ...
0
votes
0answers
14 views

Test for whether a binomial outcome is associated with difference in rank in two lists

I have a number of items that are coded using a single dichotomous measure $x$ that reflects success or failure. I have two different rankings of all items ($R_1$ and $R_2$) and would like to conduct ...
0
votes
0answers
42 views

correlation between a continuous and a binary variable [duplicate]

I am interested between the correlation between a continuous variable and a binary variable (female=1/male=2). I think it doesn't really make sense to calculate it like this: ...
0
votes
1answer
39 views

Is it correct to use categorical inputs in a Neural Network to predict another categorical output?

Let's say we want to predict only whether next day's temperature is going up or down (so two classes as opposed to predicting the actual temperature). Would there be any issues with using another ...
1
vote
0answers
27 views

Using a binary variable (present/absent) and its continuous counterpart (amount)

I am working on a banking-related logistic regression problem. Several of my variables are whether someone has an account of some sort, and there is a subsequent variable with the balance of the ...
2
votes
0answers
35 views

Opposing effects in LME4 formulae (Bradley-Terry model)

Suppose I'm modelling a two-player game, and I want to estimate the probability $p$ of the first player winning, given the players involved. I want to do this using the formula $$p_{ij} = \textrm{...
2
votes
1answer
99 views

PCA and the train/test/validation split

I have a binary classification problem with 1149 observations and 13,454 predictors. I want to apply the methodology described by cbeleites unhappy with SX in PCA and the train/test split. In this ...
0
votes
1answer
32 views

Estimating binary response variable that is the result of thresholding on binomially distributed data in R?

Suppose that I have binomial data generated as $V \sim Bin(N,p)$ and a thresholding rule such that for $i \in \{1, \ldots, N\}$, $$ Y_i=\begin{cases} 1, & \text{if} \ \ V_i > m \\ ...
0
votes
1answer
75 views

Is it valid to use logistic regression for a dead or alive outcome variable?

Is it valid to run logistic regression on zero inflated data where the response variable is dead/alive?
0
votes
0answers
79 views

Model adjustment during cross-validation

I have an imbalanced dataset, with the following stats: Value Count Percent 0 133412 97.62% 1 3247 2.38% I have created a ...
1
vote
0answers
21 views

Pick Top 3 - Cochran's Q?

I am trying to determine which statistical test to use. Participants were asked to choose the top 3 most important statements from a set of 15. I have read that Cochran's Q can be used to compare ...
5
votes
1answer
103 views

multiple regression with continuous and binary regressors

How can I do a multiple regression if I have continuous and ordinal (binary) (eg. male and female) regressors. Can I just add them like this lm(y~x1+x2+x3+x4, data=data)?
0
votes
0answers
31 views

Logistic Regression with unbalanced data, intercept effect

In several papers I have read that when doing a logistic regression with unbalanced data, the entire effect of the imbalance is carried by the intercept. However, I cannot understand why this occurs, ...
0
votes
3answers
147 views

Suggestions on binary classifiers for high dimensional categorical data set?

I have a binary classification problem with 210 variables (2 levels 0/1) and I am wondering how should I approach this problem as algorithms which I used (logistic regression, random forests) did very ...
1
vote
0answers
21 views

How to determine data size is statistically efficient?

I have a question about the data size for probability of default model. For each consumer, I have a binary bit to indicate whether the client goes default or not (1 is default and 0 is current). And I ...
5
votes
1answer
67 views

In a parametric model, if I do not have enough data, can I estimate the parameter, and simulate data from the estimated model and estimate again?

Suppose I have a logistic regression model $Y_i=\mathbf{1}(X_i\beta>\epsilon_i)$ to estimate, where the distribution of $\epsilon_i$ is known, $X_i$ follows distribution $F_{\theta}$ with an ...
1
vote
1answer
104 views

Improving F1 scores using models with good precision and recall

I have a highly imbalanced dataset (0.21 percent positives, rest negatives) for which I am trying to build a classifier. I tried to improve the F1 scores using hyperparameter tuning but in all the ...
6
votes
1answer
211 views

How to get log odds from these results of logistic regression

I have performed logistic regression (using 'LOGIT') on variables from titanic dataset. The formula used is: survived ~ age + sex + pclass I have obtained results ...
1
vote
1answer
151 views

Which analysis to use for nominal (binary) dependent variable with multiple IVs of various types?

I have 1 dependent variable (DV) measured in binary (Exam, pass/fail), 3 independent variables (IV-1 is continuous (age, in years), IV-2 is binary (Country, Canada vs. US), and IV-3 is nominal, but ...
0
votes
0answers
36 views

Algorithm to identify variable that best explains other variables

I have a set of almost 100 binary variables. Some variables are highly correlated, others are not. They all have a similar meaning (signals of related trading strategies) but differ due to slightly ...
1
vote
1answer
435 views

Finding the p value for binary data

I have made an experiment with binary outcomes, and I struggle with calculating a p value to decide if it is significantly different than the control group. There were two sets of identical cells: one ...
1
vote
0answers
17 views

Description of how the count of binary patches and their size is affected by noise?

In acoustics, signals can be represented as a matrix $M$ in time, frequency, and amplitude. Obviously the signal we want to describe is always superposed over other noise, $N$: One way to analyze ...
2
votes
1answer
533 views

How can I plot presence/absence data on a time series?

I have some schedule data in the following format ...
0
votes
0answers
16 views

I am comparing the sex ratio of pheasants across Study Areas, (10), Release sites (26), and Years (13)

I am using Binary Logistic Regression and comparing Models using AIC. The Model is: sex ratio= study area + release site + years When I count the number of Parameters (K) in the Model -do I count ...
2
votes
0answers
14 views

Test of a binary endpoint in longitudinal design

Suppose I conduct a randomized, double-blind, placebo-controlled trial. I follow-up patients at weeks 4, 8, and 12. My primary endpoint is "treatment response" by week 12. In this case, even ...
0
votes
1answer
26 views

Categorical variable as independent variable [closed]

I am using the variable education level as a control variable and this variable consists of 7 education levels (1-7). Now I can't use it as it is converted in the data. My teacher has messaged me that ...
1
vote
0answers
328 views

Do I need to get dummies for “binary” categorical columns?

My question is about a multi-variate linear regression model. I am experimenting with Python's sklearn library with the Ames Housing data set: http://jse.amstat.org/...
0
votes
0answers
35 views

Binary And Continuous Data Regression

I have 37 different variables that were collected for a data set, and I'm predicting a continuous output variable. 3 of the variables are continuous so I've run independent linear regressions on all 3 ...
0
votes
1answer
351 views

Threshold ROC vs. Cut-Off in confusion matrix (binary regression)

I am trying to understand the link between the threshold in ROC-analysis and the threshold defined in classification table. Criterion is binary with 0 or 1. 1) Someone can determine a confusion ...
1
vote
1answer
373 views

How to interpret brms output for binary logistic regression

So I have a binary response variable: $SP(0=\text{seronegative}, 1=\text{seropositive}, SP = \text{disease state})$ and I have just been playing around with my variables to understand what the output ...
0
votes
0answers
54 views

How to compare the effect of a continuous predictor versus a binary predictor on a continuous variable?

How to compare the effect of a continuous predictor versus a binary predictor on another variable through regression? For example, we're predicting log(cd4) in the case of HIV infected patients. ...
0
votes
0answers
45 views

Binomial Regression and Grouping Data

I'm currently trying to model Data where the dependent variable is either 0 or 1. Binary outcome. This would be the same as to say the data comes from a binomial distribution B(1, p). So I could use ...
0
votes
1answer
1k views

Why are there two ways to calculate the standard deviation of a binary variable?

I've always been told that the standard deviation of a binary variable is sqrt(npq). However, there also appears to be a different way to calculate it: ...
1
vote
1answer
27 views

Is there a problem using a t-test of means to compare proportions from two samples?

If a binary variable is recoded into 0 and 1, then a mean of it tells us the proportions. A lot of people compare proportions using a t-test of means. For instance, proportion of people enrolled in ...
1
vote
0answers
35 views

Duplicate observations and complementarity in the outcome

Consider the following scenario. I have a data set with information on several bouts, for both boxers and for the three judges within each bout (we are speaking about boxing fights). I want to ...
0
votes
0answers
55 views

How to include longitudinal information in logistic regression?

I have a binary outcome $y_i \in \{0,1\}$, $i=1,\dots,n$, and some covariates $x_i\in{\mathbb R}^p$. I am planning to model these using a logistic regression model. However, I also have information ...
1
vote
1answer
134 views

How to calculate the relation between 2 lists of boolean/binary (true/false or 1/0) values?

We have performed analyses on REST API endpoints to detect if they violate REST linguistic principles (i.e. if the URIs are well designed) or if they violate other REST design principles (for example ...
0
votes
1answer
43 views

Pearson residues applied to the binary model

My question would be about Pearson residuals applied to the binary model. When we build confidence intervals for a proportion, p: we have a sample, and we count the number of individuals who have a ...
0
votes
0answers
40 views

can Durbin Watson be used for binary valued times series

I have multiple time series and for each time series, each series is either one or 0. So for example, it is like the following: ...
1
vote
1answer
60 views

Normalise different thresholds for binary prediction

I'm working in a module that outputs the risk of an event happening i.e. risk of a crime happening depending on the district of the city. What I've done is to calculate for each district a binary ...
1
vote
0answers
50 views

Interaction versus split sample

Let's say I want to do a linear regression with data on the dependent variable Y, a dummy variable D and one more binary ...
1
vote
0answers
5 views

What are some techniques to improve generalization for subsets with varied distributions?

Suppose I have a binary classification problem in which I have a set comprising subjects, and each subject contributes with a varied number of positive and negative samples to the whole set. The ...
1
vote
1answer
150 views

How to do statistical test for the difference between two very small proportions?

I have a typical A/B test setup where I have a control and treatment sample of equal size with very small success proportions. An example could be the following data with a sample size of 505000, ...
1
vote
0answers
14 views

What statistical test to compare reader binary classification metrics with and without aid?

I have a dataset of MR images of 50 patients with either benign or malignant liver lesions. I asked 3 readers to read the dataset and tell for each case if they thought it was benign or malignant. Two ...
1
vote
0answers
47 views

Binary classification statistical significance

Consider a binary classification task and a trained model (e.g. logistic regression) gives predicted labels. The predictions can be done on a hold out test set or obtained using a cross-validation ...
2
votes
0answers
211 views

Poisson Regression for binary outcomes - why is legitimate?

I have learned - and taught - that to build a regression model for a binary outcome one should use a logistic regression, for a outcome that has discrete counts one should use the Poisson regression, ...

1 2 3
4
5
24