Post hoc power analysis I have an experiment with 3 equal group sizes and 4 measures. I think the simple null hypothesis is that the three groups will be the same. Most people, however, believe that group A should do best in measure 1, group B should do best in measure 2, group 3 should do best in measure C, and they should all be the same in measure 4, both when comparing within and between groups. It is quite possible my group size is too small to come to any conclusions. I base this on the tried and true approach that my N is smaller than their N.
I started off by doing a multivariate GLM (using SPSS) and found that the effect group is not significant (F = 1.8, p = 0.1). Looking at the data suggests that even if there is a difference between the groups, that it doesn't likely follow what is expected (e.g., group A does not do the best in measure 1 and is best in measure 2). My thinking is that maybe a post hoc power analysis might tell me something useful. SPSS spits out an observed power of 0.69. At this point I am lost. Does the observed power tell me anything useful? Am I going about this all wrong?
 A: Post hoc power analyses are at best useless and are often misleading, read "The Abuse of Power" (Hoenig and Heisey, American statistician, vol 55, issue 1, 2001) for more details.
What might be more useful is confidence intervals on your measures, they can tell you if your original ideas could still be meaningful and if the plausible differences are large enough to care about.  These will be much more meaningful than a transformation of the p-value (which is all that the post hoc power is) that is usually interpreted wrongly.
A: SPSS observed power analysis for ANOVA with more than 2 groups provides misleading information about power. This can be easily seen by the fact that you obtained a non-significant result, p = .1, and observed power greater than .50.  Power should equal 50% when the observed test-statistic matches the criterion. 
Aside from this specific problem, observed power based on an observed effect size is problematic because effect sizes can vary widely due to sampling error.  It is better to examine power for a theoretically interesting a priori effect size (e.g., d = .2 small effect, or d = .5 moderate effect). 
https://replicationindex.wordpress.com/tag/observed-power/
