I am currently working on a project that involves classifying each image as Good/Bad/Failed. We have a working convolutional neural network approach that works decent.
I also have trained a Fully convolutional neural network to do segmentation. THe labels for the segmentation are the actual objects in the image. So the FCN can tell me which pixels are what. Part of segmentation is identifying damaged areas which contribute to the good/bad/failed criteria.
My questions is what is best way to create a classifier that basically segments the image (tells me what and where everything is) but also put a single meta-class on top of that. Given that I have segmentation labels and full image classification images (not the same images though). Is there a way to train a single network to do both?
I do not know the relationship between damaged areas and Bad/Failed criteria besides that if an image contains damage it is not good. Beyond that I do not know. It may be as simple as damage > Threshold -> Failed but I doubt it is that easy.
I am using Caffe for everything