I'm trying to learn about neural networks using data series prediction as case study. I've set up a small application to try different configurations of data smoothing and input neuron count. However... No matter what I do I observe a delay in the neural nets output. As the picture below illustrates quite good, the outputs from the network (red) is very well predicted and is nicely matching the actual value (blue), only a bit late...

I've even tried to use the training data as test data to make sure there wasn't any problems with my test data preparation.

Anyone know what the problem might be?

enter image description here

I'm using 1 output neuron and training with Back Propagation. Bipolar sigmoid is used as activation function.


I solved it by rewriting my normalization algorithm. must have been some sort of error in there. I was trying to use a scaling formula i found in a paper about neural networks. When falling back to plain feature scaling the offset in output was gone.


  • $\begingroup$ Can you elaborate a bit more (on the plain feature scaling)? I'm using standard normalization and I still get the lag, no matter what I do... $\endgroup$ – Molasar Dec 1 '16 at 20:00
  • $\begingroup$ @Molasar, Sorry about the late reply to your question, and It's probably too late, but for future reference I've included a link in my answer. $\endgroup$ – palaslet Apr 20 '17 at 8:02

protected by Community Apr 21 '17 at 11:01

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.