# Questions tagged [separation]

Separation occurs when some classes of a categorical outcome can be perfectly distinguished by a linear combination of other variables.

173 questions
Filter by
Sorted by
Tagged with
19 views

### High frequency zero-inflated negative binomial model with Hauck-Donner effect

I have high-frequency (daily) data with overdispersion and a high amount of zeros. I know that a zero-inflated negative binomial is my best option for a model. I am using the library ...
2k views

### Do neural networks create a separating hyperplane?

https://colah.github.io/posts/2014-03-NN-Manifolds-Topology/ mentions that neural networks learn a representation of the data so as to make the classes linearly separable. What I fail to see is how ...
• 101
26 views

### How to find a mapping to a higher dimension that separates the data, given a data set

We have the following dataset: $$\begin{bmatrix} x_1 & x_2 & y\\ +1 & 0 & +1\\ -1 & 0 & +1\\ 0 & +2 & +1\\ 0 & +1 & -1 \end{bmatrix}$$ I was asked to find ...
1 vote
38 views

### Logistic regression difficulty with multi-level factor and many 0 outcomes

My dataset describes the presence/absence of an animal in a number of different plant species. Below is a table of plant species Vs animal presence/absence, i.e each row show the number of animal ...
• 749
46 views

### Logistic regression - Exp (B) = 0? and sig is 0.999 or 1? [duplicate]

I'm having an issue with binary logistic regression for a project I'm working on. For some of the variables, I'm receiving a significance value of 0.999 and exp(B) of 0. Is this normal?
509 views

### Proportion data with number of trials known (and separation?): GLM or beta regression?

I perform a lot of bioassays in which I score mortality not on individuals, but on groups of individuals as a proportion (the denominator, i.e., number of trials, is known): Sample Data: ...
101 views

### Unexpected weights in Gradient descent algorithm (linear classification) in python

I am attempting to implement a back propagation algorithm that can efficevley read from a file of features and there targets and predict there outputs correctly, however for sake of testing I am hard ...
1 vote
185 views

### Hauck-Donner effect in ordinal generalized regression

I am running a series of ordinal regressions on a rather large data set (n=3640). With some predictors I had issues with violations of parallel lines assumptions, so I decided to run those with a ...
• 11
1 vote
24 views

### Pooling Profile Penalised LTRs in multiple imputation

I am analysizing data from a clinical trial. I used multiple imputation to impute the (binary) outcome variable, which is the only variable with missing data. All of the covariates are categorical and ...
• 11
1 vote
120 views

### Binomial (1/0) response, Factor explanatory variable: why can't GLM estimate effect when one factor level has all 1s in response?

I have a dataset with a binomial response variable (1/0) and a single explanatory categorical variable with 2 levels. For one level, the response is all 1s and no 0s (e.g. ...
• 202
208 views

### For the Logistic model, why is the objective function unbounded below if two sets are linearly seperated?

I am reading Approximate linear discrimination via logistic modeling in the Section 8.6.1 of B & V's Convex Optimization book. On Page 428, $$\operatorname{minimize} \ -l(a, b) \tag{8.27}$$ ...
• 123
89 views

### Why PCA is not considered in the taxonomy of blind source separation approaches?

Blind source separation (BSS) approaches are divided in the literature into four methods, including independent component analysis (ICA), sparse component analysis (SCA), and non-negative matrix ...
• 176
1 vote
22 views

### Cold Start and First Price Auctions

I have the following contrived scenario... I've participated on various auction platforms where I bid on widgets. Assume that win/loss outcomes on individual platforms are well-separated such that for ...
• 11
1 vote
51 views

### Is the sum of 3 bits a linearly separable task?

In other words can a linear classifier learn to correctly assign a class (label 0 to 3) for an input of 3 bits? Intuitively this cannot work, since the half-adder circuit contains an XOR block, which ...
• 111
177 views

### Hidden vs Firth vs Shen-Gao logistic regression: dealing with the Hauck-Donner effect

In 1993 a version of penalized logistic regression was introduced by Firth in order to reduce the bias due to outliers and/or (quasi-)perfect prediction in logistic regression: Bias Reduction of ...
29 views

### On the use of the sampling year as fixed-effect

I have my database in temporal blocks (so I have my occurrence sites into the year of sampling of a few years with maximum 7 years). In order to fix the complete separation problem that I also have, ...
• 135
40 views

### Is there any impact on the results of random forest if we have perfect separation in the database?

I'm having a perfect separation in my database. One of the solutions is to switch randomly some of the values of the dependent variable to the opposite for the variables that cause the problem this ...
• 135
315 views

### Dealing with quasi-complete separation in General Additive Model?

I am modelling influence of fire on occurrence of certain bird species (count response variable) in Before/after control/impact experiment design. I've got intact and burned sites and count data both ...
1 vote
58 views

### How many percentage to randomize and how many iterations in a "what-if analysis"?

I've got complete separated data as such: ...
• 1,861