So, While building a simpel neural net (MLP) for recognizing digits, I ordered my function to print me both the mean cost overall off the train dataset and %currect answers, also over the train dataset (even though the function doing this is called val()
). the cost kept going down for an hour and a half, but the %currect answers stayed the same as the beginning.
the wierd thing is that while the cosr is constantly going down, the train accurasy do not change AT ALL from the very beggining.
Any ideas why this is happening?
Here is the nootbook, if needed.