User Tom Hale

1

8

votes

2

answers

419

views

Etymology of multi-armed bandit

reinforcement-learning multiarmed-bandit

May 19 at 11:45 Tim♦ 78.4k

2

10

votes

2

answers

6k

views

Difference between pooling and subsampling

neural-networks conv-neural-network computer-vision

May 8 at 10:29 KeepItSimple 1

3

10

votes

4

answers

3k

views

Regularisation: why multiply by 1/2m?

regularization

Nov 24 at 23:37 Keyan P 101

33

39

votes

4

answers

27k

views

Why is tanh almost always better than sigmoid as an activation function?

machine-learning neural-networks backpropagation sigmoid-curve

Jul 27 at 9:41 Ricardo Cruz 1,035

2

votes

1

answer

513

views

Is a GAN's discriminator loss expected to be twice the generator's?

machine-learning neural-networks loss-functions gan

Apr 13 '19 at 8:43 shimao 14.6k

5

votes

0

answers

329

views

Usage of dropout in convolutional GANs with batch norm?

neural-networks gan dropout batch-normalization

Apr 9 '19 at 6:51 Tom Hale 1,521

6

votes

2

answers

1k

views

Etymology of “Adam” algorithm for gradient descent

terminology gradient-descent history adam

Sep 21 '18 at 11:55 amoeba 79.5k

1

2

votes

0

answers

1k

views

Skip connections: Benefits of skipping extra layers

machine-learning neural-networks conv-neural-network

Aug 4 '18 at 9:12 Tom Hale 1,521

1

6

votes

3

answers

4k

views

Convolution with a non-square kernel

neural-networks conv-neural-network image-processing computer-vision

Jun 15 '18 at 9:54 Jakub Bartczuk 4,857

1

6

votes

1

answer

2k

views

Transfer learning: How and why retrain only final layers of a network?

machine-learning neural-networks backpropagation transfer-learning

May 31 '18 at 9:36 user20160 23k

1

vote

1

answer

99

views

Notation to represent the batch-normalised value of x

machine-learning neural-networks normalization notation batch-normalization

May 11 '18 at 11:34 Peter Flom♦ 88.6k

0

votes

1

answer

149

views

Error in converting activation function from ReLU to ELU

neural-networks python

Mar 16 '18 at 11:40 Jim 1,535

4

18

votes

1

answer

21k

views

What is the derivative of the ReLU activation function?

self-study neural-networks

Mar 15 '18 at 17:28 Jim 1,535

5

votes

2

answers

496

views

Why is two-sided gradient checking more accurate? [closed]

optimization gradient-descent gradient numerics

Feb 26 '18 at 16:21 Sycorax says Reinstate Monica 55.9k

2

votes

1

answer

2k

views

Working for Logistic regression partial derivatives

logistic backpropagation derivative gradient

Feb 24 '18 at 13:32 Tom Hale 1,521

1

vote

0

answers

91

views

Intuitive understanding of Extreme Learning Machine [duplicate]

machine-learning neural-networks references intuition

Feb 2 '18 at 10:09 kjetil b halvorsen 45.3k

1

0

votes

1

answer

1k

views

Should one-hot output encoding be used in backpropagation?

neural-networks backpropagation categorical-encoding

Dec 22 '17 at 20:20 user0 4,272

2

votes

3

answers

1k

views

Backward propagation without a loop over training examples

machine-learning neural-networks matlab backpropagation

Sep 20 '17 at 9:45 asterio gonzalez 121

3

8

votes

1

answer

641

views

Why is sqrt(6) used to calculate epsilon for random initialisation of neural networks?

machine-learning neural-networks random-generation

Jul 23 '17 at 14:13 seanv507 3,504

0

votes

1

answer

59

views

Simplification of case-based logistic regression cost function

logistic

Jun 29 '17 at 8:58 Tom Hale 1,521

Stack Exchange Network

current community

your communities

more stack exchange communities

Next privilege

Next badge

20 Questions

Etymology of multi-armed bandit

Difference between pooling and subsampling

Regularisation: why multiply by 1/2m?

Why is tanh almost always better than sigmoid as an activation function?

Is a GAN's discriminator loss expected to be twice the generator's?

Usage of dropout in convolutional GANs with batch norm?

Etymology of “Adam” algorithm for gradient descent

Skip connections: Benefits of skipping extra layers

Convolution with a non-square kernel

Transfer learning: How and why retrain only final layers of a network?

Notation to represent the batch-normalised value of x

Error in converting activation function from ReLU to ELU

What is the derivative of the ReLU activation function?

Why is two-sided gradient checking more accurate? [closed]

Working for Logistic regression partial derivatives

Intuitive understanding of Extreme Learning Machine [duplicate]

Should one-hot output encoding be used in backpropagation?

Backward propagation without a loop over training examples

Why is sqrt(6) used to calculate epsilon for random initialisation of neural networks?

Simplification of case-based logistic regression cost function