Can $p<0.5$ be interpreted as providing at least some weak evidence against null hypothesis? I have been recently doing two-sample analysis and have a little trouble interpreting the resulting $p$-value. The $p$-value was 0.12, thus at the risk rate of 5% I cannot say the samples are different.
However, does $p=0.12$ still mean I can say there is a detectable difference between samples, just not as obvious?
My current intuition is that until $p<0.5$ the interpretation that the datasets are different is more plausible that they are the same, yet of course at e.g 0.4 the risk of that claim is very high and thus maybe not useful.
 A: The wikipedia for p-value should give you a precise definition. Essentially, it's the probability how your null hypothesis would be inconsistent to your data.
With a p-value of 0.12, you would need a large significance level to reject your hypothesis.


*

*You can think like there is some difference between the samples, but not as inconsistent as you might have thought. If you have no or very little difference, your p-value should be close to 1.

*Do you mean p < 0.05? 0.5 is simply too big.

*You should never think your groups are different or same, because they will never be the same. If they were the same, you wouldn't have to do a statistical test at all. You should ask yourself, is a p-value of 0.12 enough to convince you that two groups are statistically different enough such that you can call them significant? The answer is no, we usually reject the hypothesis when the p-value is less than 0.05.
Your results indicate your groups are not statistically significant unless you want a significance level 12%.
A: If you want an interpretation that corresponds to the posterior probability of the alternative hypothesis being true, then you would likely want a Bayesian analysis. A frequentist analysis (as you had conducted) may or may not have the Bayesian properties one "intuitively desires" (such as allowing such an interpretation in the absence of prior information). Often a p < 0.5 will offer some  (often extremely weak) support for the alternative, but that is not necessarily so.
A: When you achieve a certain significance level, whatever it is 0.001, 0.01, 0.4, you are saying that either (a) there is something real going on or (b) something unusual has happened. So in your case either there is a real difference or something that would happen roughly once in every six attempts by chance has happened. How unusual do you want to be? Most people want more unusual than that.
