Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 222577

Use this tag for any use of optimization within statistics.

0 votes

Why is gradient descent and it's variants used instead of BFGS and L-BFGS for training neura...

You can use L-BFGS for optimization, it is included in some libraries as an optimizer, however it is very memory expensive algorithm, so many times it is more reasonable to use the gradient descent family …
Stepan Ulyanin's user avatar