I am new to NN. I am trying to train a network where the loss is defined by the Covariance between the first 10 samples and the last 10 samples. I am able to achieve a working model, but this is how the loss function through 500 epochs looks like
As can be seen, it looks like the loss gradually decreases until it reaches a minimum and then increases again. How should I interpret this result?