I know the differences between stochastic gradient descent and gradient descent, also the advantages of stochastic gradient descent over gradient descent like the performance of algorithm, not converting to local minima etc..
However can we say that SGD is complete replacement for gradient descent or are there any scenarios where SGD doesn't work well?