Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [binary-data]

A binary variable takes one of two values, typically coded as "0" and "1".

1
vote
1answer
32 views

Is the accuracy equal if the true positive and false positive rates are equal between two groups?

I was reading the paper "Equality of Opportunity in Supervised Learning" (link). In that paper there is a feature $A \in \{0,1\}$ and a binary outcome $y \in \{0,1\}$. The population is divided into ...
0
votes
0answers
10 views

Trends in sighting records over time [on hold]

Let's say I have a sighting record (binary sequence) for a species over time in some region, with a 1 indicating presence and 0 ...
0
votes
0answers
21 views
+50

How to binarize data for FP Growth in Weka?

I have a CSV file where all comlumns contains numerical values except for the quality column which contains nominal values. I want to use FP Growth Weka algorithm ...
0
votes
0answers
25 views

Finding outliers in binary data

Say you have data from 10 different sensors about the occurrence of some event - e.g. motion sensors. Each sensor records 1 if they detected the motion sensors and 0 if they didn't. If you have 10 ...
0
votes
0answers
5 views

Methods to predict a binary outcome with ordinal covariates

Just a very general question: what are the most efficient methods to predict one single binary variable $Y$ using a set of ordinal covariates? In my precise case, I have around twenty ordinal ...
0
votes
0answers
4 views

Number of ones in Binary matrix multiplication [migrated]

Consider a binary matrix $\mathbf A_n$ corresponding to values $0$ to $2^n-1$ where each row represents a length $n$ binary representation of a real number. For example, for $n=3$ we have $\mathbf ...
0
votes
0answers
8 views

Binary classification with uncertain class

Suppose we have a two-class problem (C1 and C2) where in C1 the label is certain, that is, you know 100% sure of the label but in C2 you don't. To be more precise, observations from C2 may have a ...
0
votes
2answers
37 views

Logistic regression with missing data: which rows/columns to eliminate? What is the most simple method?

I have a large dataset (501 rows and 39 columns) with a lot of missing data. I have already deleted all the rows where the (binary) response variable is missing as well as three columns that were ...
0
votes
0answers
16 views

Correlation between discrete and binary variables

I have a binary variable representing happiness. This variable can take binary values of 0 (not happy) and 1 (happy). I have another discrete variable representing valence (representing if emotion is ...
0
votes
0answers
19 views

Statistical Significance of a Binary Event

Consider a retail bank that makes loans to consumers. Some consumers will default on their loans. Modeling the default event would typically be modeled with a logistic regression if I am not ...
0
votes
0answers
12 views

Comparing distribution of two dependant binary variables different sample size

I have been searching for solution for my problem but keeps running into more questions so decided to finally ask for a bit of help. I am working with a dataset in which I want to compare efficiency ...
0
votes
1answer
16 views

Understanding the logistic regression model from glmnet in R when the binary response is -1 or 1

I compared the results for the cases with y = {0,1} and y = {-1,1}. The estimated coefficients and probability from the method are different. How to understand these results? ...
0
votes
1answer
18 views

Similarity between n >> 2 binary vectors

I have $n$ binary vectors $x_i, ..., x_n$ of length $d$. I wish to compute a similarity measure between all $n$ of them. My initial thought was to use the Jaccard Index, since each binary element $x_{...
0
votes
0answers
8 views

Counting the number of ones in a binary matrix multiplication [migrated]

Consider a binary matrix $\mathbf A$ corresponding to values $0$ to $2^n-1$ where each row represents a length $n$ binary representation of a real number. For example, for $n=3$ we have $\mathbf A=\...
1
vote
2answers
55 views

Mixed Effects Logistic Regression w/ Repeated Measures for Observational Data

I am working on a study of how different scholarship programs at a university may influence student retention (i.e., if students are still enrolled at the university one year later). Each student can ...
0
votes
0answers
8 views

Multi-class machine learning classification on binary data - setting a class for unclassifiable

I have a large dataset of binary genomic data (i.e. mutation Y/N) A proportion of the samples have been classified into clusters based on presence of key mutations. I would like to use this ...
0
votes
0answers
25 views

Huge Exp(B) value in categorical binary logistic regression

If I run a binary logistic regression with a categorical explanatory variable my results are as below. When I set the variable to last Variables in the Equation the values for line I are $B= 17....
0
votes
0answers
22 views

Recommender system with extra variables

I would like to to create a recommendation engine that makes use of a utility matrix (user-item interactions) as well as supplementary features (user features, item features and time-based features). ...
1
vote
0answers
10 views

Is there a way to intuitively think about AUC associated with an ROC plot in the case where our predictions are binary?

Suppose we have a true set of labels, which are either $0,1$, and we have a set of predicted labels that are also either $0,1$. In this case, a possible ROC plot has one point connecting the line, ...
0
votes
0answers
10 views

Binary Dependent Variable Regression

I'm struggling with part (b) of the above question. If I use the probit model, then $P(Y_i|X_i=x,W_i=w,A_i=a)=\Phi(\beta_0+\beta_1x+\beta_2w+\beta_3a)$. Not sure how to proceed with the variance ...
0
votes
1answer
25 views

Is it valid to use ROC calculated during test/validation to interpret results of final production model?

I've trained a binary classification model which outputs a "probability" between (0,1). During testing and validation, I use the ROC to measure the performance of the model. Also, I use the ROC to ...
0
votes
1answer
42 views

Can regression trees outperform classification trees?

I'm learning about trees in my data science class recently and I know that the convention is to use regression trees when the response is continuous and classification trees when the response is ...
0
votes
0answers
10 views

Testing interaction of 2 binary variables on a binary outcome with repeated measurement

I have a study with repeated measurement. The outcome was measured at the baseline, prior, and after the baseline (i.e. 3 time points) The variables are as follow: outcome Y: Binary; with ...
0
votes
0answers
12 views

stratified binary predictor in logistic regression

As part of an assignment, I was working with a dataset containing a breastcancer-related dependent variable (HG) against three independent variables representing ...
2
votes
1answer
414 views

Imbalanced dataset binary classification

I am new in ML & DS and i have a dataset with an imbalance of 9:1 for Binary Classification,as an assignment. Could you please guide me in this regard? Also Which classifier is best for Imbalanced ...
0
votes
1answer
39 views

Binary Classification of Numeric Sequences with Keras and LSTMs [duplicate]

I'm attempting to use a sequence of numbers (of fixed length) in order to predict a binary output (either 1 or 0) using Keras and a recurrent neural network. Each training example/sequence has 10 ...
0
votes
0answers
16 views

How to estimate the probability of an infrequent binary event

I have an on-going periodic time series of either zeros or ones, nothing else. Mostly I get zeros, but the probability of getting ones varies over time. What is the best way to estimate the ...
1
vote
1answer
42 views

Finding patterns in various-length binary sequences

I have a large number of binary sequences of different lengths (time-series of observations of the occurrence (1) and non-occurence (0) of some thing) and I am wondering how I could find patterns that ...
1
vote
2answers
77 views

How to explain the utility of binomial logistic regression when the predictors are purely categorical

The resources that I have seen feature graphs such as the following This is fine if the predictor $x$ is continuous, but if the predictor is categorical and just has a few levels it's not clear to ...
2
votes
0answers
17 views

Binary Classification for Customer Dataset without Customer ID

My dataset is a log of phone calls. Each row represents a customer interaction with attributes such as customer age, customer job, and interaction outcome ('buy' vs 'no buy'). EDIT: the interaction ...
0
votes
0answers
24 views

What test to use to compare two sets of data. One only knowing mean and quantity

I have two methods that generate either a pass or a fail on input data. I want to know if statistically there is any difference between the two? For the first method I only have the mean (0.75) and ...
0
votes
1answer
21 views

What is the best method of visualising binary classification preditcions?

I have 2 columns in a dataset, "Device" and "Classification". I want to plot a graph that shows how well the "Classification" result is predicted given the data in the "Device" column. Both columns ...
2
votes
1answer
12 views

Test that predicts group membership from multi-variate data?

Context: Zoology undergrad dissertation. The format of my results will be % time individual birds spent doing certain activities (and possibly number of times an activity such as pecking was performed)...
1
vote
1answer
37 views

Can I use Wilcoxon Signed-Rank paired Test to compare binary data?

I have two series of binary outcomes: Series1 Series2 Test1 0 1 Test2 1 1 Test3 1 1 Test4 0 1 Test5 0 0 ... I want to know ...
0
votes
0answers
17 views

How to obtain all the true positives given two sets of precision and recall values?

Given that I have a dataset with some number of 1s (positives) and 0s (negatives), and the following two sets of precision and recall values: Set A: Positive precision: 0.51 Positive recall: 0.8 ...
0
votes
0answers
24 views

Regression Discontinuity with binary / categorial outcomes and covariates

I want to conduct a regression discontinuity analysis on various outcomes and covariates. Some of the outcomes and almost all of the covariates of interest are binary. Furthermore 3 of my dependent ...
0
votes
0answers
12 views

Highly unbalanced data set .Minority Class 1 %

I want to optimize precision and recall i.e f-score but I want to keep high precision . What are the possible ways of doing binary classification on such imbalanced data set [Minority class 1 %]. I'...
1
vote
1answer
35 views

Can a linear and logit model have the same shape?

While I was working on an exercise based this book, I discovered something interesting. When I fit a logit and simple linear probability model on the data (see code below), the predictions are almost ...
0
votes
0answers
165 views

Jaccard Index for Binary Data in R using dist function

I have a presence/absence table of 0s and 1s and I would like to cluster this data. I want to create a pairwise matrix using R's dist function which has a binary ...
0
votes
1answer
25 views

Compare results: dependent variable continuous vs binary

I'm using an R package to run interaction between genes using genetic markers (SNPs - single nucleotide polymorphisms). The package allows functions for phenotype (dependent variable) continuous and ...
0
votes
0answers
8 views

which statistical test to use (5 binary IVs and 1 ratio DV)

I'm conducting a study where I have data that include 5 Binary independent variables (0 or 1) and a ratio dependent variable (performance 0.0 to 1.0). I want to check the effect of the IVs on the DV ...
0
votes
0answers
28 views

How can you meta-analyse continuous and binary repeated measures outcome data?

Context: the random effects meta-analysis is of studies that measure visits to the doctor (visits), as a continuous variable (by reporting mean visits and respective standard deviations) or as a ...
0
votes
0answers
6 views

Evaluating individual Open-Rates in Email Marketing

at my company, we use email marketing to engage with our users, and I want to evaluate their performance. The standard metrics for that would be Open Rate, Click Rate, and Click-to-Open Rate. Take ...
1
vote
0answers
12 views

Comparison effects of regressors for several dependent variables

I want to study the effect of two explanatory variables $X$ and $Z$ on four different outcomes (which are binary variables, i.e. equal 1 if satisfied and 0 if disatisfied): $Y_1$, $Y_2$, $Y_3$ and $...
1
vote
1answer
100 views

Fitting the Poisson distribution to binary data

I'm studying several time series. The variables of interests are dummy variables which take value 1 when a certain event happened, 0 otherwise. I want to find the best distribution to describe these ...
1
vote
0answers
24 views

How can i calculate Covariance between numeric attributes and Binary attributes?

I want to calculate covariance between binary attribute and numeric attribute For example: if x is numeric attribute, y is binary attribute. Then how can i calculate cov(x,y)?
1
vote
1answer
82 views

multiple logistic regressions with binary predictors vs single logistic regression with categorical predictors

I would like to know which is statistically more advisable and what are the advantages and disadvantages of each approach. My data frame data has ...
0
votes
0answers
14 views

Statistical test to measure significant difference between 4 binary classifiers?

I have four versions of a neural network hardware. I am testing the hardwares to classify a single binary input into a binary output. The ANN hardwares are trained using a very simple relation, the ...
1
vote
1answer
27 views

Comparison of the mean of a binary variable from two independent sets

I have two sets of data, one is akin to high performing companies, and the other contains low performing companies. I want to compare the mean of a binary value. For instance, "CEO has a bachelor ...
1
vote
0answers
57 views

How to get the right correlation matrix for correlated binary data [closed]

I am trying to generate correlated binary data in high dimensional in R using bindata lib given marginal probabilites and correlation matrix, but it give me always error ...