Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 58450

Use this tag for any use of optimization within statistics.

10 votes
4 answers
6k views

What exactly is a "solver" in optimization?

I am really confused by the usage of solver in computational optimization. … What differentiate optimization softwares and solvers? I know this sounds like a really rudimentary question, but I have only done optimization in MATLAB. …
Fraïssé's user avatar
  • 1,630
8 votes
1 answer
2k views

Are there any "convex neural networks"?

Are there any neural network training procedure that involves solving a convex problem? Note that I am referring more to MLPs, instead of (multi-class) logistic regression which is a neural network wi …
Fraïssé's user avatar
  • 1,630
22 votes
2 answers
28k views

What does "vanilla" mean?

This term is literally never seen in any optimization textbooks. For instance, in this post, it says: This is the simplest form of gradient descent technique. …
Fraïssé's user avatar
  • 1,630
1 vote
2 answers
314 views

Can someone come up with a concrete example of ML estimation with uniformly distributed noise?

I am currently reading Boyd's book on convex optimization of maximum likelihood estimation problem http://web.stanford.edu/class/ee364a/lectures/stat.pdf I have zero background in statistics so I am totally …
Fraïssé's user avatar
  • 1,630
5 votes
1 answer
1k views

Online convex optimization: Why use strongly convex regularizer for regularized-follow-the-l...

I've read through Hazan's paper on online convex optimization. I don't quite understand why the regularization term must be strongly convex instead of more relaxed condition such as strictly convex. …
Fraïssé's user avatar
  • 1,630
2 votes
0 answers
634 views

What is GloVe model's loss function actually minimizing?

First of all, this is an optimization problem, where our loss function is $J$. … But unlike a standard optimization problem, $\min_{x \in \mathbb{R}^n} f(x)$, no argument of $J$ is supplied, so that we do not know is our objective variable (nor the domain of these parameters, which …
Fraïssé's user avatar
  • 1,630
8 votes
2 answers
4k views

In online convex optimization, what is a leader in FTL algorithm?

I am currently reading into online convex optimization. Can someone please explain me what exactly is a leader in the Follow-The-Leader algorithm and its variants? …
Fraïssé's user avatar
  • 1,630