I have a question regarding which test I should run on some data. I have small groups of people who answered questions. The answers to these questions have been classified as correct or incorrect. The N of the total number of questions asked is fairly large, however, the N of the total number of groups is quite small.
I'd like to analyse the accuracy based on group size. My initial thought was an ANOVA would be appropriate as I would divide the groups into size 1-2, 3-4, and 5+ and use overall group accuracy for each instance. However, as I said, the N is small. A colleague suggested that this is incorrect and a Chi Squared would be more appropriate where the N in question would be the instances of all the correct/incorrect responses instead of the overall group accuracy. Is either one of these or another test more appropriate?