Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 112095

Machine learning algorithms build a model of the training data. The term "machine learning" is vaguely defined; it includes what is also called statistical learning, reinforcement learning, unsupervised learning, etc. ALWAYS ADD A MORE SPECIFIC TAG.

4 votes
Accepted

Why increasing lambda parameter in L2-regularization makes the co-efficient values converge ...

Yep, that is one way to think about it, although it seems a tad obscure to me. I think it's simpler to just look at your $\text{cost}$ equation: $\text{cost}(\hat{w_1}, \lambda) = (y - \hat{w_1} \cd …
nlml's user avatar
  • 982
19 votes

How is Spatial Dropout in 2D implemented?

This response is a bit late, but I needed to address this myself and thought it might help. Looking at the paper, it seems that in Spatial Dropout, we randomly set entire feature maps (also known as …
nlml's user avatar
  • 982
4 votes

Struggling to make a neural network mimic a basic if statement

The curvature of the cost surface with these particular inputs and outputs makes this a bit of a pathological example. A 'good' solution can be found by just outputting 0.333 all the time, and if you …
nlml's user avatar
  • 982
3 votes
Accepted

Stochastic gradient descent for neural networks with tied weights

First of all, shouldn't your equation (1) be the following? $$ \frac{\partial E}{\partial w_{tied}} = \frac{\partial E}{\partial f}(\frac{\partial f}{\partial h_1}\frac{\partial h_1}{\partial w_1}+\fr …
nlml's user avatar
  • 982
2 votes

Image classification, narrow domain with custom labels

Here's one tutorial on training a deep convnet from scratch in Keras. There should be plenty of other examples on the web. You could still use a pre-trained model for this, and just re-train some of …
nlml's user avatar
  • 982