Bonferroni Correction for Post Hoc Analysis in ANOVA & Regression As we know, if we are doing many tests or multiple comparison, we don't use the same $\alpha$ value and use some $\alpha$ correction methods like Bonferroni. This is done because when we do multiple tests, we have higher chance of getting something as significant compared to doing for fewer numbers of tests. 
But my main question is this: 
1) It is said if you are comparing multiple sample means using ANOVA and once you find there is some significant difference then you can do a post hoc analysis by doing pairwise comparison. But now you don't have to actually do a Bonferroni correction. Why is that? Isn't this post hoc analysis same as other pairwise t test where we use Bonferroni correction?
2) If Bonferroni correction is required because more tests leads to more chances of getting something significant then why we don't use the same thing, where we are doing something like regression where we are testing significance of $\beta$ estimates, or whether a variable is significant or not for feature selection using p value/F score? In that case also we are doing multiple comparison in checking whether each variable is significant or not. Then why don't we use Bonferroni correction on critical $\alpha$ there?
Please advise.
 A: Preface: There are many different was to adjust for multiple comparisons. Olive Dunn proposed the Bonferroni adjustment in 1961, and the multiple comparisons literature (see, for example, Shaffer, 1995) has grown to a variety of family-wise error rate adjustment methods (of which Bonferroni is the simplest), and the more recent false discovery rate adjustment methods. Moreover, adjustments can either be made to $\alpha$, or the math may be inverted and instead applied to adjust p-values (sometimes adjusted p-values are called q-values)—my own preference is to adjust $\alpha$, since adjustments to p may need a clumsy upper-truncation at 1.0 to retain interpretability as a probability. Your question, and my answer applies regardless of which of these methods you choose, and whether you apply the adjustment to $\alpha$ or to the p-values.


*

*You would apply the Bonferroni to post hoc multiple comparisons following rejection of a one-way ANOVA. In fact that is a canonical example of when to apply the Bonferroni adjustment. These pairwise tests are not quite the same thing as a bunch of standard t tests, because following rejection of an ANOVA the t test statistics are calculated using the pooled variance implicit in the ANOVA's null hypothesis, rather than variance from the two specific groups compared for a single test statistic.

*You are correct: we would use multiple comparisons adjustments when make many statistical tests, as in the case of the t tests for the $\beta$ estimates in multiple regression, or in feature selection of N-way ANOVA.
References
Dunn, O. J. (1961). Multiple comparisons among means. Journal of the American Statistical Association, 56(293):52–64.
Shaffer, J. P. (1995). Multiple hypothesis testing. Annual Review of Psychology, 46:561–584.
