Typically one uses a RBM in an unsupervised fashion. But it is stated that we can do otherwise. As the title says how does one train a supervised RBM?
My idea is the following: by clamping feature and class information to the visible units we let the RBM associate the features with the labels. In the end the RBM should be able to reconstruct the class label simply by seeing the features.
Concretely I mean the following:
Assume you have two features f1, f2 and a binary class label c1 - we clamp f1,f2,c1 for every train example to the visibles and proceed with our training (CD1 or whatever).
Is this a valid procedure or not? If not please tell me why not and where I can find more information about my problem!
Thank you very much