Skip to main content
Imran's user avatar
Imran's user avatar
Imran's user avatar
Imran
  • Member for 14 years, 3 months
  • Last seen more than a month ago
revised
Loading…
Loading…
awarded
awarded
comment
Why does feature engineering work ?
I have updated my answer to make this more explicit.
revised
Why does feature engineering work ?
added 335 characters in body
Loading…
comment
Why does feature engineering work ?
For example if you tried the same thing with linear regression then a and d would suffice and adding a+d as a feature wouldn't make a difference.
revised
Why does feature engineering work ?
added 89 characters in body
Loading…
comment
Why does feature engineering work ?
This is exactly the point. Choice of features and choice of model must be considered together. It is a common pitfall to try and reason about feature selection without considering the type of model being used.
answered
Loading…
awarded
comment
Meaning of the linear transformation in sigmoid output for Bernoulli parameter estimation
The output is not binary, it is any number in [0,1]. It only becomes either 0 or 1 if you apply a threshold afterwards, which is what you would do for classification, but not for probability estimation as we have here. I'm not sure about any way to guarantee that your sigmoid won't saturate. The typical advice is to "be careful with weight initialization" and to keep an eye on them to see if they saturate and try something different (weight initialization, learning rate, etc.) if that happens.
awarded
awarded
revised
Loading…
revised
Loading…
revised
Loading…
revised
Loading…
Loading…