Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 290553

Machine learning algorithms build a model of the training data. The term "machine learning" is vaguely defined; it includes what is also called statistical learning, reinforcement learning, unsupervised learning, etc. ALWAYS ADD A MORE SPECIFIC TAG.

1 vote

Wrong predictions with imbalanced binary data (regression logistic)

"And I found a few variables that are 99% correlated with the dependent variable" Are you sure you're not using variable you shouldn't have in the time of your prediction ? Example, if in your dataset …
Adept's user avatar
  • 176
2 votes

Why is ROC insensitive to class distributions?

Compared to the others, my answer is focused on understanding how you use ROC and AUC in Data Science cases. If you need the mathematical / statistical part, my answer won't help you. Basically, ROC c …
Adept's user avatar
  • 176
1 vote

Should I run a machine learning model many times?

Computing it multiple times can be more useful for specific algorithms. Let's take an example : while a regression will do the same thing if you use it on the exact same data (ie if you split your tra …
Adept's user avatar
  • 176
1 vote

Encoding ID variables for machine learning

That's one of the important things in Data Science : you have to create your variables, good enough so your model can predict well. Here, you pointed well, that you can't directly use IDs, but with pr …
Adept's user avatar
  • 176
0 votes

Improving Random Forest Classifier Design Python

Having too many variables can be a huge issue : if you have variables with less direct impact, they'll impact your Random Forest and make it less efficient. You have to find the right balance. Just so …
Adept's user avatar
  • 176
0 votes
Accepted

Smart Statistics vs Unsupervised Learning for Anomaly Detection

1-3 : Many things are possible, from unsupervised machine learning to stats : you can make really simple things (put thresholds by your own, calculate point distance from neighbours once you normalize …
Adept's user avatar
  • 176
0 votes

How does one ensure Machine Learning doesn't come to correct classifications via the wrong w...

This is the purpose of the Validation Set. Split your dataset in 3 : Train, Test and Validation. Never touch your Validation set again until the last phase. Create your model using Train and Test, tra …
Adept's user avatar
  • 176
0 votes
1 answer
44 views

Time Series : Caracterize how a time series differ from its past behaviour

I'm working with multiple time-series. Each time series is a record of a value (let's say a price) per month. In each time-series, I have a reference period (let's say, 9 months, making it 9 records), …
Adept's user avatar
  • 176
0 votes

Training data size requirements for imbalanced class classification

AUC is not changing with class balancing, so unbalanced class won't lower your AUC value. First, note than many models in sklearns have the option class_weight='balanced' that allows the model dealing …
Adept's user avatar
  • 176
0 votes

Should we use AUC as an indicator of overfitting when dataset is highly imbalanced?

One way to check if you're overfitting using AUC is also to apply it directly on your train data, and compare it to your validation. If you have a huge difference (with a train AUC way better, meaning …
Adept's user avatar
  • 176