Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 113777

Separation occurs when some classes of a categorical outcome can be perfectly distinguished by a linear combination of other variables.

0 votes

Why is it desirable to have linear separability in SVM?

Not directly answer your question but, It is important to keep in mind the difference between basis expansion and Kernel method / SVM. We can "expand data" using basis expansion in different ways. …
Haitao Du's user avatar
  • 37.3k
4 votes

How does perfect separation in logistic regression affect the AUC?

@gung had a great answer. I just want to add more explanations on why "no matter what threshold you use, you will have perfect accuracy" If we add one more line to @gung's code to check the predicted …
Haitao Du's user avatar
  • 37.3k
3 votes

When does logistic regression not work properly?

@gung had a good answer. Logistic regression is a linear model, so it may not work well on non-linear cases. But as I mentioned in the comment, it might be some ways to transform data into another spa …
Haitao Du's user avatar
  • 37.3k
46 votes
Accepted

Is there any intuitive explanation of why logistic regression will not work for perfect sepa...

A 2D demo with toy data will be used to explain what was happening for perfect separation on logistic regression with and without regularization. … No matter how much separation the data has. …
Haitao Du's user avatar
  • 37.3k