Basically what I want to achieve is to take loads of data from a certain game's tournaments and compare it to chance, i.e., I want to see whether a "coin flipping tournament" would have similar results. Or in other words, whether any given player has ~50% chance to win against any other given player, and at the start all of them have equal chance to win a tournament (due to equal skill level, too much randomness in the game, or other reasons, doesn't matter).
We have players that became champions once, more than once, or never. I assume that would happen in a coin flipping tournament as well. My understanding of statistics is rudimentary at best, so first question is, is this even possible to check whether we have a real skill differences and can predict some players to be more likely to win in the future? Or do we only have pure 50/50 chance? If yes, what would be the method? Or perhaps, what do I need to read up on before starting it?