Questions tagged [binary-data]

A binary variable takes one of two values, typically coded as "0" and "1".

Filter by
Sorted by
Tagged with
1
vote
1answer
7k views

Finding statistical significance between two binary tests

I have two sets of data. One with a sample size of 82 with 53 "hits" and 29 "Misses." And a second sample of 105 with 67 "hits" and 38 "misses" Given that the second set of data is a control, is ...
4
votes
2answers
4k views

similarity measures with missing values

How to handle missing values when computing similarity (or distances)? (I have binary feature values and do use the simple matching coefficient, but I feel that the answer to this question may be more ...
1
vote
1answer
148 views

Goodness of Fit Test for Logistic Regression with small n_i

I would like to test how well my model fits the data. The response is binary and the Chi-Squared Test cannot be applied for the residual deviance because the $n_i$ are $1$. To use the Chi-Squared GOF ...
1
vote
1answer
301 views

Steps followed when Binary logistic regression when both dependent and independent variables are binary

I had set of binary variables. To apply logistic regression, I have checked association between dependent and independent variables and considered only those independent variables in the model which ...
1
vote
4answers
2k views

Classifier or regression for binary system?

Lets say you want to create a random forest model that predicts whether a user will click on your search engine ad. Lets say the training data set marks the independent variable (i.e. whether the user ...
0
votes
0answers
165 views

binarization of variable - experimental threshold choice. Is it good approach?

I have some ratings averages values from 1 to 5(users were rating on 1,2,3,4,5 scale). I would like to split them into two classes: credible, ...
12
votes
4answers
7k views

Logistic Regression and Inflection Point

We have data with a binary outcome and some covariates. I used logistic regression to model the data. Just a simple analysis, nothing extraordinary. The final output is supposed to be a dose-response ...
0
votes
0answers
557 views

Comparing two time period of same binary variables

We are a financial institution which falls under this ‘Big Bank’ category. As a part of our routine analysis on input variables that feed several of our risk models, we would like to setup an input ...
1
vote
1answer
784 views

Calculating and using factor scores

I have performed a factor analysis of 14 binary items (Satisfactory vs Not Satisfactory) which yielded 2 factors with 7 items each. I am interested in creating simple factor scores by summing ...
0
votes
1answer
97 views

Binary classification to evaluate a object classifer. How to merge two samples/groups (different size)?

I'm evaluating a classifier to detect objects. For example: I have a set1 with 50 pictures with the object to detect. And set2 with 100 pictures without the object. I determine the true positves (0 ...
1
vote
0answers
235 views

Which statistical tool can compare binary and ordinal data?

My research question is whether aptitude tests are a good indicator on how students will perform on course exams. I have already performed an analysis on total exam score compared with total aptitude ...
0
votes
0answers
55 views

how to interpret the result of significant regression of binary logistic yet all predictor is insignificant [duplicate]

I am performing research on Product attributes of mineral water toward purchase decision. However, the result of -2log likelihood test showed that my model is fit enough yet my result of Hosmer and ...
1
vote
1answer
314 views

How can I analyze "win rate" over time (i.e. on/off data over time)?

I have a series of data points that consist of 1) a time, and 2) a win or a loss. I would like to be able to determine the aggregate win rate for particular time periods, and graph it. For instance, ...
7
votes
1answer
1k views

2D binary classification

Background A laboratory wants to evaluate whether a certain form of gel electrophoresis is suited as a classification method for the quality of a certain substance. Several gels were loaded, each ...
3
votes
0answers
968 views

Using R and hidden Markov models to predict pseudorandom binary sequences better than P > .5?

I would to predict a pseudo-random binary sequence of 0's and 1's. I am thinking of using the HMM package in R. I have a binary sequence like ... 0 1 0 0 1 1 0 1 x(n+1)? with thousands of values. ...
8
votes
1answer
3k views

Visualizing longitudinal data with binary outcome

For longitudinal data with a numeric outcome, I can use spaghetti plots to visualize the data. For example something like this (taken from the UCLA Stats site): ...
3
votes
2answers
1k views

What are the most commonly used predictive models when dealing with binary data?

I know everybody uses logistic regression as the starting point, but I'm curious to know: What are the other commonly used predictive models when data is primarily binary?
1
vote
2answers
832 views

Interpreting logit regression with both continuous and categorical variables

I have a logistic regression like this: ...
3
votes
2answers
1k views

Unsupervised Dimensional reduction for mixed data types

I have a data set with about 50K rows and 100 columns. You can consider every row to be representing one restaurant. My goal is to calculate dissimilarities between all the restaurants - Gower's ...
0
votes
1answer
2k views

Transform multiclass classification to binary - benefits?

I have 400 instances which must be categorized into 4 classes. Using WEKA, I tried out a couple of multiclass classifiers like J48 and Random Forests, but never made it above Kappa 0.6 and ~65% ...
3
votes
0answers
96 views

Correlation of one binary input series and continous response series

I have one input series of type 0/1 (it is an intervention time series) and some metric response series. I need to have a look at cross correlations. Normally I would use Box-Jenkins-technique. But ...
0
votes
1answer
55 views

Comparing two survey items with a third variable

I want to compare the results of two items by age category and do not really know what test to use. I tried a Cochran–Mantel–Haenzel–test at first, but I don't think it is testing what I really want ...
4
votes
1answer
2k views

Can logistic regression estimates suffering from subsample abuse be salvaged?

Suppose we have some logistic regression modelling problem; $f(X) = Y$, where $Y$ is binary and $X$ is a vector of normally distributed variables. In industry it is sometimes the case that ...
2
votes
0answers
1k views

Prediction based on repeated measure with binary outcome

I'd like to make a prediction about a subject's likelihood that a certain outcome will occur based on a series of measurements taken over time. The easiest way to explain the problem is as follows. ...
1
vote
0answers
252 views

Binary features for prediction

I have a set of relatively long ($\sim 1000$) binary features with scalar values $[0-10]$ attached to them. My aim is to write a predictor that learns to map the features to the $[0-10]$ interval to ...
5
votes
2answers
328 views

Concerns about the size of odds-ratio estimates in binary logistic regression model

I am creating some binary regressions and am wondering if I should be surprised by the size of the odds ratios. In this particular example, the dependent variable indicates whether a student can ...
1
vote
0answers
277 views

Trusting the results of a binary vector comparison

I have two pretty long binary vectors ($\sim 3$ mi positions), and I found the distance between then using Jaccard's Index $J=\frac{a}{a + b + c}$. After getting the result, I asked myself how much ...
1
vote
1answer
84 views

Testing association with 0-1 independent variable - how?

I'm looking to demonstrate an association between penalty (overtime) payments and absenteeism. The dependent variable is overtime payments ($0-$highval) for a shift, and the outcome variable is 'was ...
4
votes
1answer
1k views

Cluster large boolean dataset

I got a dataset with about 5,000 columns and about 135,000 rows - all fields contain boolean (binary) data. I am looking to classify each of these columns into one of 50 groups, based on similarity. ...
1
vote
0answers
452 views

How can I measure the association between 40 binary variables?

I have 40 binary (0/1) variables with 70 observations and would like to measure the association of occurrences between them. Is the presence or absence of a variable is associated with the presence / ...
7
votes
1answer
510 views

PAC learning theory and lower bound on the amount of input samples

I am trying to answer the following question: "How much (binary) data do I need for my learner to have seen every variable of the dataset at least once?" In my set-up I am feeding my algorithm binary ...
4
votes
1answer
9k views

(Multiple) Correspondence Analysis for count data entered as binary variables

I have a data set, 1014 cases and 55 variables which are binary and is in the form of ...
3
votes
1answer
3k views

Coefficient of determination for binary responses

D.R. Cox and Nanny Wermuth seem to suggest that the coefficient of determination (R squared) is misleading when you have binary responses, in fact if I am understanding well, they are saying that the ...
0
votes
1answer
207 views

Two different methods....different results?

I have a response variable and 10 predictor variables (all ordinal). I wanted to see if there was any evidence of a relationship between the response and predictors. I used a two proportion z-test to ...
2
votes
0answers
122 views

Ways to compare ordered binary datasets?

This question regards the best way to compare ordered binary data. My situation is as follows: I'm interested in evaluating how well a model conforms to human performance data on a set of validation ...
1
vote
0answers
49 views

Confidence with probability values

I am constructing a predictive model for a binary outcome, which gives me results in a "probability-prediction" fashion such as "0.3-YES" or "0.4-NO". The model is working perfectly. My question ...
1
vote
1answer
2k views

PLS-DA with binary predictors in R (package mixOmics)

I am trying to analyse a dataset with at minimum 50 explanatory variables coded as 0 and 1 for presence/absence and a binary response variable (case/control). The goal is to see how the variables can ...
0
votes
1answer
865 views

Binary logistic regression on SPSS 20 - output seems inconsistent and illogical

I have one categorical dichotomous dependent variable (yes/no - retention of newly learned words) and two independent variables - both are categorical. One independent variable is "delay between ...
4
votes
1answer
8k views

Variance and covariance of binary data

The variance of a set of $n$ binary variables $D = <x_1, \ldots, x_n>$ is $$ {\rm var(D)} = \frac{k(n-k)}{n^2}, $$ where $k$ denotes the number of $1$s in $D$ (see http://capone.mtsu.edu/dwalsh/...
8
votes
2answers
8k views

Prediction of a binary variable

I am establishing a model for prediction of a binary variable (Yes/No) depending on three continuous variables ($A$,$B$,$C$). I applied logistic regression analysis for a learning dataset vith the ...
9
votes
5answers
7k views

How to measure a classifier's performance when close to 100% of the class labels belong to one class?

In my data, I have a class variable, denoted as $C$. This class variable values are ${0, 1}$ (binary). Almost all observations of $C$ are 0 (close to 100%, more precisely, 97%). I would like a "...
2
votes
0answers
564 views

How to measure the strength of association between binary variables where the majority of values is zero?

I have two binary variables, $X_1$ and $X_2$, which take value in {0, 1}. The overwhelming majority of their values are 0. I wanted to know if there is a way to appropriately measure their association ...
5
votes
2answers
2k views

Partitioning Around Medoids (PAM) with Gower distance matrix

My data is is mostly continuous but has one binary variable. I tried the pam algorithm in R with the Gower index, but the number of clusters that give the best ...
1
vote
1answer
473 views

Binary or multinomial logit?

I am having some doubts on whether I should use binary or multinomial logit. I am modelling product choice. The dependent variable is the choice of either shampoo or toothpaste. Although my dependent ...
3
votes
0answers
43 views

How to enhance the performance of naive CMDS?

I'm performing Classical MDS on the distance over columns of binary matrix. The result is like this: The points lies on two lines vertical to each other. I don't think useful information is shown in ...
5
votes
0answers
769 views

Normalize binary features for logistic regression

I am applying logistic regression and I am using a mixture of continuous and binary features. My question would be how do you go about binary features when trying to normalize. I would very much ...
1
vote
0answers
134 views

Determining influence of continuous variable on binary outcome

I'm running data analysis for an online marketplace. I want to determine the influence of the time a perishable good (say a concert ticket) is online versus the probability of a sale. I have made a ...
1
vote
2answers
82 views

Highly significant positive binary IV: Interaction always positive too

I'm working on a project where the main independent variable is binary. We then interact this variable with different continuous variables. The binary variable is by far the most significant variable ...
1
vote
0answers
380 views

Principal Component Analysis (PCA) for binary data [duplicate]

First of all, I would like to note that I have read similar topics in CrossValidated but I am not fully satisfied. I have a dataset which consists of an $N\times M$ binary matrix. 1 means that an ...
2
votes
3answers
586 views

How can I tell if my binary classifier is any good?

Say I have a data set with 10,000 rows and the target is a binary variable with 1500 positives (1's) and 8500 negatives (0's). I run a model and get predictions on the 0-1 interval. My question is ...