Stack Exchange Network

Stack Exchange network consists of 176 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Loading…
  1. 0
  2. +0
    • Tour Start here for a quick overview of the site
    • Help Center Detailed answers to any questions you might have
    • Meta Discuss the workings and policies of this site
    • About Us Learn more about Stack Overflow the company
    • Business Learn more about hiring developers or posting ads with us
  3. Log in Sign up
  4. current community

    • Cross Validated
      help chat
    • Cross Validated Meta

    your communities

    Sign up or log in to customize your list.

    more stack exchange communities

    company blog
Cross Validated
Sponsored by
Sponsored logo
  1. Home
    1. Questions
    2. Tags
    3. Users
    4. Unanswered
Profile Activity
Meta user
Network profile
Tom Hale

Reputation

1,791
  • 1.8k
  • 1.5k
  • 1.3k
  • Apr
  • Jul
  • Oct
  • Jan

Top tag

backpropagation

Next privilege

2,000 Rep.
Edit questions and answers

Badges

2
11
29

Newest

 Good Question

Next badge

0/1
Custodian

Impact

~100k
people reached
1 post edited
0 helpful flags
61 votes cast
Summary Answers Questions Tags Badges Bookmarks Bounties Reputation All actions

20 Questions

Votes Activity Newest Views
3
11
votes
4
answers
6k
views

Convolution with a non-square kernel

neural-networks conv-neural-network image-processing computer-vision
Dec 4 at 4:38 Taro Kiritani 141
37
47
votes
5
answers
37k
views

Why is tanh almost always better than sigmoid as an activation function?

machine-learning neural-networks backpropagation sigmoid-curve
Aug 21 at 0:42 Osama El-Ghonimy 21
 
10
votes
2
answers
453
views

Etymology of multi-armed bandit

reinforcement-learning multiarmed-bandit
May 19 at 11:45 Tim♦ 88.4k
3
10
votes
2
answers
8k
views

Difference between pooling and subsampling

neural-networks conv-neural-network computer-vision
May 8 at 10:29 KeepItSimple 1
3
10
votes
4
answers
4k
views

Regularisation: why multiply by 1/2m?

regularization
Nov 24 '19 at 23:37 Keyan P 101
 
2
votes
1
answer
562
views

Is a GAN's discriminator loss expected to be twice the generator's?

machine-learning neural-networks loss-functions gan
Apr 13 '19 at 8:43 shimao 17.1k
 
5
votes
0
answers
409
views

Usage of dropout in convolutional GANs with batch norm?

neural-networks gan dropout batch-normalization
Apr 9 '19 at 6:51 Tom Hale 1,791
 
6
votes
2
answers
1k
views

Etymology of “Adam” algorithm for gradient descent

terminology gradient-descent history adam
Sep 21 '18 at 11:55 amoeba 85.3k
1
2
votes
0
answers
1k
views

Skip connections: Benefits of skipping extra layers

machine-learning neural-networks conv-neural-network
Aug 4 '18 at 9:12 Tom Hale 1,791
1
6
votes
1
answer
2k
views

Transfer learning: How and why retrain only final layers of a network?

machine-learning neural-networks backpropagation transfer-learning
May 31 '18 at 9:36 user20160 25.5k
 
1
vote
1
answer
124
views

Notation to represent the batch-normalised value of x

machine-learning neural-networks normalization notation batch-normalization
May 11 '18 at 11:34 Peter Flom 91k
 
0
votes
1
answer
152
views

Error in converting activation function from ReLU to ELU

neural-networks python
Mar 16 '18 at 11:40 Jim 1,684
5
28
votes
1
answer
32k
views

What is the derivative of the ReLU activation function?

self-study neural-networks
Mar 15 '18 at 17:28 Jim 1,684
 
5
votes
2
answers
659
views

Why is two-sided gradient checking more accurate? [closed]

optimization gradient-descent gradient numerics
Feb 26 '18 at 16:21 Sycorax♦ 64.7k
 
2
votes
1
answer
2k
views

Working for Logistic regression partial derivatives

logistic backpropagation derivative gradient
Feb 24 '18 at 13:32 Tom Hale 1,791
 
1
vote
0
answers
92
views

Intuitive understanding of Extreme Learning Machine [duplicate]

machine-learning neural-networks references intuition
Feb 2 '18 at 10:09 kjetil b halvorsen♦ 51.9k
1
0
votes
1
answer
1k
views

Should one-hot output encoding be used in backpropagation?

neural-networks backpropagation categorical-encoding
Dec 22 '17 at 20:20 user0 4,577
 
3
votes
3
answers
1k
views

Backward propagation without a loop over training examples

machine-learning neural-networks matlab backpropagation
Sep 20 '17 at 9:45 asterio gonzalez 121
5
8
votes
1
answer
785
views

Why is sqrt(6) used to calculate epsilon for random initialisation of neural networks?

machine-learning neural-networks random-generation
Jul 23 '17 at 14:13 seanv507 3,754
 
0
votes
1
answer
67
views

Simplification of case-based logistic regression cost function

logistic
Jun 29 '17 at 8:58 Tom Hale 1,791
Cross Validated
  • Tour
  • Help
  • Chat
  • Contact
  • Feedback
  • Mobile
Company
  • Stack Overflow
  • For Teams
  • Advertise With Us
  • Hire a Developer
  • Developer Jobs
  • About
  • Press
  • Legal
  • Privacy Policy
  • Terms of Service
  • Cookie Settings
Stack Exchange
Network
  • Technology
  • Life / Arts
  • Culture / Recreation
  • Science
  • Other
  • Stack Overflow
  • Server Fault
  • Super User
  • Web Applications
  • Ask Ubuntu
  • Webmasters
  • Game Development
  • TeX - LaTeX
  • Software Engineering
  • Unix & Linux
  • Ask Different (Apple)
  • WordPress Development
  • Geographic Information Systems
  • Electrical Engineering
  • Android Enthusiasts
  • Information Security
  • Database Administrators
  • Drupal Answers
  • SharePoint
  • User Experience
  • Mathematica
  • Salesforce
  • ExpressionEngine® Answers
  • Stack Overflow em Português
  • Blender
  • Network Engineering
  • Cryptography
  • Code Review
  • Magento
  • Software Recommendations
  • Signal Processing
  • Emacs
  • Raspberry Pi
  • Stack Overflow на русском
  • Code Golf
  • Stack Overflow en español
  • Ethereum
  • Data Science
  • Arduino
  • Bitcoin
  • Software Quality Assurance & Testing
  • Sound Design
  • Windows Phone
  • more (28)
  • Photography
  • Science Fiction & Fantasy
  • Graphic Design
  • Movies & TV
  • Music: Practice & Theory
  • Worldbuilding
  • Video Production
  • Seasoned Advice (cooking)
  • Home Improvement
  • Personal Finance & Money
  • Academia
  • Law
  • Physical Fitness
  • Gardening & Landscaping
  • Parenting
  • more (10)
  • English Language & Usage
  • Skeptics
  • Mi Yodeya (Judaism)
  • Travel
  • Christianity
  • English Language Learners
  • Japanese Language
  • Chinese Language
  • French Language
  • German Language
  • Biblical Hermeneutics
  • History
  • Spanish Language
  • Islam
  • Русский язык
  • Russian Language
  • Arqade (gaming)
  • Bicycles
  • Role-playing Games
  • Anime & Manga
  • Puzzling
  • Motor Vehicle Maintenance & Repair
  • Board & Card Games
  • Bricks
  • Homebrewing
  • Martial Arts
  • The Great Outdoors
  • Poker
  • Chess
  • Sports
  • more (16)
  • MathOverflow
  • Mathematics
  • Cross Validated (stats)
  • Theoretical Computer Science
  • Physics
  • Chemistry
  • Biology
  • Computer Science
  • Philosophy
  • Linguistics
  • Psychology & Neuroscience
  • Computational Science
  • more (10)
  • Meta Stack Exchange
  • Stack Apps
  • API
  • Data
  • Blog
  • Facebook
  • Twitter
  • LinkedIn
  • Instagram

site design / logo © 2021 Stack Exchange Inc; user contributions licensed under cc by-sa. rev 2021.1.20.38359

By clicking “Accept all cookies”, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy.