Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

In Andrew Ng's online machine learning course in the part about neural nets for classification the following convex cost function is given:$$cost = -y.log(h_o(x)) - (1-y).log(1-h_o(x))$$which is predicated on the output labels being either 1 or 0 ( a sigmoid activation function ). I would like to code a NN classifier using a hyperbolic tangent activation function, particularly that given in Le Cun 1998, shown below:$$1.7159tanh((2/3)x)$$ which will take on values between >1 and < 0 in the limit. Obviously the above cost function would not be suitable for this activation function so could anyone let me know what sort of similar cost function for this hyperbolic tangent activation I should be looking for? So far my web search has been fruitless.

share|improve this question
So what is your hypothesis function. How you decide a instance is class A in what case and with what confidence, and in Class B as same. – Erogol Oct 16 '12 at 23:10
@Erogol I will use labelled data to train the NN, with 1 being a positive case of the class and -1 being negative. – babelproofreader Oct 18 '12 at 15:49
so what is the point to use a function that gives a value x <0 or >1 – Erogol Oct 18 '12 at 17:40

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.