What are the measure for accuracy of multilabel data? Consider a scenario where you are provided with KnownLabel Matrix and PredictedLabel matrix. I would like to measure the goodness of the PredictedLabel matrix against the KnownLabel Matrix.
But the challenge here is that KnownLabel Matrix have few rows only one 1 and other few rows have many 1's (those instance are multi labeled). An example of KnownLabel Matrix is given below.  
A =[1 0 0 0
    0 1 0 0
    0 1 1 0
    0 0 1 1
    0 1 1 1]

In the above matrix, data instance 1 and 2 are single label data, data instance 3 and 4 are two label data and data instance 5 is the three label data.
Now I have PredictedLabel Matrix of data instance using an algorithm.
I would like to know various measure which can be used to measure the goodness of the PredictedLabel Matrix against KnownLabel Matrix.
I can think of frobeinus norm difference between them as one of the measure.
But im looking for the measure such as accuracy $(=  \frac{\text{Correctly_predicted_instance}}{\text{total_instance}})$
Here how do can we define the $\rm Correctly\_predicted$ for multiple data instance?
 A: (1) gives a nice overview:


The Wikipedia page n multi-label classification contains a section on the evaluation metrics as well.
I would add a warning that in the multilabel setting, accuracy is ambiguous: it might either refer to the exact match ratio or the Hamming score (see this post). Unfortunately, many papers use the term "accuracy".

(1) Sorower, Mohammad S. "A literature survey on algorithms for multi-label learning." Oregon State University, Corvallis (2010).
A: Correctly Predicted is the intersection between the set of suggested labels and the set expected one. Total Instances is the union of the sets above (no duplicate count).
So given a single example where you predict classes A, G, E and the test case has E, A, H, P as the correct ones you end up with Accuracy = Intersection{(A,G,E), (E,A,H,P)} / Union{(A,G,E), (E,A,H,P)} = 2 / 5
A: The Hamming Loss is probably the most widely used loss function in multi-label classification. 
Have a look at Empirical Studies on Multi-label Classification and Multi-Label Classification: An Overview, both of which discuss this. 
