I'm beginning network construction for a problem that I feel could have a far more insightful loss function than a simple MSE regression.
My problem deals with multi-category classification (see my question on SO for what I mean by this), where there is a defined distance or relation between categories that should be taken into account.
Another point is that the error should not be effected by the number of firing categories present. I.e. the error for 5 firing categories each off by 0.1, should be the same as 1 firing category off by 0.1. (by firing I mean that they are non-zero, or above some threshold)
- multi-category classification (multiple firing at once)
- relationships between categories
- count of firing categories should not effect loss:
Mean Squared Error seems like a good place to start:
This is simply considering category-by-category, which is still valuable in my problem but misses a large portion of the picture.
Here is my attempt to rectify the idea of distance between categories. Next I would like to take into account the number of categories firing (call it: v)
I have a very weak background in statistics; as a result, I don't have many tools in my belt to broach a problem like this. The umbrella topic of what I'm asking would appear to be "When forming a cost function, how does one go about combining multiple measure of cost? Or what techniques can one apply to do so?". I would also appreciate having any flaws in my thought process exposed and improved upon.
I value being taught why my mistakes are mistakes, as opposed to having someone solely correct them without explanation.
If any piece of this question lacks clarity or could be improved, please let me know.