I'm using a k-fold cross validation to select the best parameter set of a Deep-Network based Classifier. The activation function of the last layer is a softmax function, while one-hot encoding is used for data labels. I'm looking for a good measure of fit for cross validation.
I think that Brier score could be a valid alternative to MSE or MAE, but I'm not sure which of them is the best choice as model fit function.
What do you suggest? Can you provide any reference to a comparison of model fit functions? What are the main guidelines to choose an appropriate model fit function?