This is actually exactly the problem that ROC curves were originally constructed to solve! The basic idea of a classifier that returns some "confidence" score (like a posterior predictive probability) is that by adjusting the threshold that you use to take an action, you directly influence the TPR and the FPR for your procedure.
A ROC curve is a diagram that explicitly shows the tradeoff: if you accept a higher FPR, you'll get a higher TPR. If you're constrained to only accept at most a specific FPR, then the only relevant statistic is the TPR at that FPR. So if your particular application can only accept at most some FPR, then you should choose a threshold that corresponds to that FPR. Full stop.
This arises in all sorts of real-world situations. If the cost of a false positive is high, you'll want to have a lower FPR.
So if you're constrained to only accept a specific FPR, your choices are obvious: either you pick the model with the highest TPR at that FPR, or you choose a model with a lower TPR. Clearly, any lower TPR is (probably*) worse, because you'll achieve fewer true positives at that FPR.
* The one caveat here is that FPR and TPR are statistics, and like every other statistic, they are subject to random variation. The only factor that you can control is the choice of threshold. The FPR and TPR at that threshold are naturally estimated with error, so the best practice would be to estimate the error bounds on TPR and FPR at your choice of threshold and then make the comparison. This is easy enough to do, since all of these statistics are binomial proportions, and tests of binomial proportions are well-studied.
