I am very new and beginner in the machine learning world, and I would like to ask if someone could simply explain to me how does the scaled conjugate gradient method work in neural network training? Especially in comparison with the gradient descent method, because I already understand that one.

I know exactly the steps on how to train a neural network with gradient descent, but in relation to scaled gradient I can only find far too advanced explanations that I can't yet understand.

  • $\begingroup$ Can you link a paper or the sources you're talking about? $\endgroup$ – Tinu Aug 19 '20 at 11:05
  • $\begingroup$ For example here neuralnetworksanddeeplearning.com/chap2.html and Andrew Ng's Coursera course "Machine Learning" $\endgroup$ – Johanna Aug 19 '20 at 11:46

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.