I am currently studying the textbook In All Likelihood -- Statistical Modelling and Inference Using Likelihood by Yudi Pawitan. Section Repeated sampling principle: the frequentists of chapter 1 says the following:
True frequentism states that measures of uncertainties are to be interpreted only in a repeated sampling sense. In areas of statistical application, such as medical laboratory science or industrial quality control, where procedures are naturally repeated many times, the frequentist measures are very relevant. The problem arises as the requirement of repeat experimentation is allowed to be hypothetical. There are many areas of science where experiments are unlikely to be repeated, for example in archaeology, economics, geology, astronomy, medicine, etc. A reliance on repeated sampling ideas can lead to logical paradoxes that appear in common rather than esoteric procedures.
It is this last part that I am curious about:
A reliance on repeated sampling ideas can lead to logical paradoxes that appear in common rather than esoteric procedures.
How do such paradoxes come about, and what are some specific examples?
I would greatly appreciate it if people would please take the time to elaborate on this.