This sounds like you want to use the McNemar test which is inteded for paired nominal (boolean) data.
There seems to be a python implementation in the statsmodel libary. See also this question.
user_na
- 121
- 3