I am working in a classification problem in which I use RBF with a single hidden layer. I want to use SoftMax activation function for the output layer. I already read some documents about the activation function of the output layer but can't find my answer. I try to write the equation for softmax and linear activation function and compare them. in my opinion yes they are different, but after I saw some documents I become confused so to become sure about I decide to ask it here.
is there any difference between linear and nonlinear activation function in a single hidden network?