Procedure to devise Questionnaire I understand that the reliability and validity are key while constructing a questionnaire. Kindly advise if the following procedures are appropriate to devise a questionnaire:


*

*After creating all the items in the questionnaire, I plan to test the question with a sample of 25 participants. Next, I will re-test the same questionnaire with the same sample group, at some other time. To check internal consistencies, I will run a regression analysis to find the value of Cronbach alpha or Rho.


Please advise.
 A: These procedures aren't bad, but they don't say anything about validity and don't fully address reliability.
Your first sentence "after creating all the items" covers a lot of ground. How will you write the items? How will you review them? How will you revise them?
"I plan to test the the question" what about pilot testing? 
Testing and re-testing on a group is good, that gives you test-retest reliability. What will you do if it is low? How low is too low?
Chronbach alpha is a measure of internal consistency, that's also good. But, again, what is too low? What will you do if alpha is low? What about item analysis? 
And what about validity? What constructs, tests, measures etc will you compare your results to? How will you be sure that your questions cover all the areas you want to cover? Will you do a factor analysis to see if there is evidence of multiple factors?
How extensive your questionnaire development should be depends partly on your budget and partly on what you intend to do with the questionnaire, but getting a fully validated questionnaire is a long and complex process. 
