5
$\begingroup$

I am currently trying to better understand probabilistic skill ranking systems for games, but I find that I have trouble properly understanding the basic concept of how skill as a pairwise comparison can be generalized.

For instance, if all you know is that player C wins player B 80% of the time, while that same player B wins player A 80% of the time, would this be enough data to determine how often C would win against A? How would those calculations work?

Of course it might even be possible for a game to have different styles of play where A might win specifically against C, which would completely confuse the issue, but I am talking about general ranking systems such as ELO or Trueskill that only take winning into account.

$\endgroup$
3
  • $\begingroup$ By generalizing drunken rock-paper-scissors I'd say C wins 20% of the time over A. $\endgroup$ Commented Feb 4, 2014 at 15:03
  • 12
    $\begingroup$ Winning is not necessarily transitive. Even in games of chance that is not the case: see Efron's intransitive dice. These ranking systems adopt particular models of winning but they are not appropriate for all forms of competition! (This is particularly true where contests are decided by a voting procedure.) Thus it's possible that your 80%, 80% numbers would be consistent with any winning probability for C against A. $\endgroup$
    – whuber
    Commented Feb 4, 2014 at 15:14
  • $\begingroup$ If there's a single underlying thing (a single overall skill, like 'general ability at chess') that determines win probability and which is transitive, you may be able to get somewhere (it's still not enough to pin it down completely, you need more assumptions). If it's based on multiple separate abilities (or on one thing which isn't transitive), then you really can't say anything from the available information. $\endgroup$
    – Glen_b
    Commented Feb 4, 2014 at 16:44

2 Answers 2

6
$\begingroup$

this information is not enough. Let's look more precisely what I mean by the lack of information. An event $CA$ means that $C$ wins against $A$ and event $\overline{CA}$ for when $C$ looses against $A$. Then we have:

\begin{equation} p(CB) = p(CB|CA)p(CA) + p(CB|\overline{CA})p(\overline{CA}) \end{equation}

and following that we have,

\begin{equation} p(CB|CA) = p(CB|CA,BA)P(BA) + p(CB|CA,\overline{BA})P(\overline{BA}) \end{equation}

however you don't have information on the conditional probabilities, having the prior probabilities such as $p(CA)$ and $p(BA)$ is not logically sufficient to infer $p(CB)$.

$\endgroup$
1
$\begingroup$

In the Elo model, C would be over one class interval (+240) stronger. B the average player (=0) and A over one class interval weaker -(240). The Elo model predicts a win for C against A with 95% probability (rating diff = 480).

See here for the rating probabilities: https://www.fide.com/docs/regulations/FIDE%20Rating%20Regulations%202022.pdf.

In a real world example, A, B and C could be equally strong. Where C is the "fear opponent" of B and B is the "fear opponent" of A.

$\endgroup$
0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.