I have the following question, and it is (for me) an open research question. I really don't have a feeling if it is a difficult question or a trivial one, getting a better feeling for approaches I might take by your feedback would be much appreciated. I won't explain what I have done so far to not make it too complicated/biased, but would be happy to give more details if anything is unclear.
This is the behavioral experiment: A subject receives simultaneously vibration to a finger from the left hand as well as to a finger of the right hand. What the participant has to do is to indicate where the stronger* stimulation is (*or the weaker stimulation is, these two questions are randomized, and it is randomized as well which side receives the stronger stimulation).
There are three difficulty levels: The two stimulations the subject receives can have a very different intensity, s.t. subject can answer the question 100% correctly.
There is a medium level where participants can identify the stronger/weaker stimulation with 75% accuracy, and a difficulty level where the two stimuli are so similar that subjects accuracy gets close to (theoretical) chance level.
We do this experiment in the fMRI scanner. The goal is to predict from this neuroimaging data, how certain participants are (100%, 75%, 50%?).
The question sounds rather simple, however I have some quite basic questions regarding what to use as classes for the classification, what as labels (subjects perception of where they are being stimulated more strongly, or the effective side, or something completely else...?).