I am wondering why it is said that multiple testing corrections are ''arbitrary'' and that they are based on a incoherent philosophy that
the veracity of one statement depends on which other hypotheses are entertained
see e.g. answers and comments to What's wrong with Bonferroni adjustments? and in particular the discussion between @FrankHarrell and @Bonferroni.
Let us (for simplicity and for the ease of the exposition) assume that we have two (independent) normal populations, independent and with known standard deviations but unknown means. Let (just as an example) say that these standard deviations are resp. $\sigma_1=2, \sigma_2=3$.
Joint test
Assume we want to test the hypothesis $H_0: \mu_1 = 2 \& \mu_2=2$ versus $H_1: \mu_1 \ne 2 | \mu_2 \ne 2$ at a significance level of $\alpha=0.05$ (the symbol $\&$ meaning 'and' while $|$ means 'or').
We also have a random outcome $x_1$ from the first population and $x_2$ from the second population.
if $H_0$ is true then the first random variable $X_1 \sim N(\mu_1=2,\sigma_1=2)$ and the second one $X_2 \sim N(\mu_2=2,\sigma_2=3)$ as we assumed independence it holds that the random variable $X^2 = \frac{(X_1-\mu_1)^2}{\sigma_1^2} + \frac{(X_2-\mu_2)^2}{\sigma_2^2}$ is $\chi^2$ with $df=2$. We can use this $X^2$ as a test statistic and we will accept $H_0$ if, for the observed outcomes $x_1$ and $x_2$ it holds that $\frac{(x_1-\mu_1)^2}{\sigma_1^2} + \frac{(x_2-\mu_2)^2}{\sigma_2^2} \le \chi^2_\alpha$. In other words the acceptance region for this test is an ellipse centered at $(\mu_1, \mu_2)$ and we have a density mass of $1-\alpha$ ''on top'' of this ellipse.
Multiple tests
With multiple testing we will do two independent tests and ''adjust'' the significance level. So we will perform two independent tests $H_0^{(1)}: \mu_1 = 2$ versus $H_1^{(1)}: \mu_1 \ne 2$ and a second test $H_0^{(2)}: \mu_2 = 2$ versus $H_1^{(2)}: \mu_2 \ne 2$ but with an adjusted significance level $\alpha^{adj.}$ that is such that $1-(1-\alpha^{adj.})^2=0.05$ or $(1-\alpha^{adj.})^2=0.95$ or $1-\alpha^{adj.}=\sqrt{0.95}$ or $\alpha^{adj.}=1-\sqrt{0.95}$ which yields $\alpha^{adj.}=0.02532057$.
In this case we will accept $H_0^{(1)}$ and $H_0^{(1)}$ (and both together are equivalent to our ''original'' $H_0: \mu_1 = 2 \& \mu_2=2$) whenever $\frac{x_1 - \mu_1}{\sigma_1} \le z_{\alpha^{adj.}} $ and $\frac{x_2 - \mu_2}{\sigma_2} \le z_{\alpha^{adj.}} $
So we conclude that, with multiple testing, the acceptance region for $x_1,x_2$ has become a rectangle with center $(\mu_1,\mu_2)$ and with a probability mass of $1-\alpha$ on top of it.
Conclusion
So we find that, for a joint ($\chi^2$) test the geometrical shape of the acceptance region is an ellipse, while with multiple testing it is a rectangle. The density mass ''on top'' of the acceptance region is in both cases 0.95.
Questions
So what is then the problem with multiple testing ? If there exists such a problem, then (see supra) the same problem should exist for joint tests or not ? The reason can not be that we prefer ellipses over rectangles does it ?