I'd like to know if there is a method for defining significant level based on a pilot study e.g. 73% successful rate. The background problem of my current study is at a very small sample size (N=9), which always yields non significant results when testing against the standard 0.10, 0.05 or 0.01 alpha values.
Any pointer is much appreciated.
Edited: In the pilot study where 11 left-handed people were recruited to test a new mouse invention. The test outcome resulted in 8/11 people said the new mouse was helpful to their computing tasks and the rest (3/11) said it was not helpful. I roughly calculated the success rate as (8/11)*100 = 72.72% or ~73%.
In the second study for which the improved version of the mouse was tested, 9 people were asked to repeat some computing tasks twice, one time using the new mouse invention and another time using an ordinary mouse decided for right-handed people. I have done some hypothesis tests (against 0.05 significance level) that resulted in Type II error as mentioned in ssdecontrol's answer below and would like to know how to assign a new significance level based on the pilot study result, instead of using 0.05 significance level.