An instrument is valid if it measures what it purports to measure. This is different from reliability, which means that an instrument measures (whatever it measures) in a way that is repeatable.
0
votes
0answers
14 views
Discriminant validity issue. Can this be improved?
I have some issues with my discriminant validity, as some of the factor variance correlations are greater than the Average Variance Extracted.
Can this be improved at all?
Many thanks
0
votes
0answers
27 views
Chi-square difference test for assessing discriminant validity
I would like to understand about the concepts and methods of chi-square difference test to test discriminant validity for measurement model in SEM.
Pleas tell me and you can raise the examples that ...
1
vote
0answers
52 views
How to test relative validity statistically?
I am trying to understand a) what relative validity is, and b) how to test it statistically. So far I have gathered, from sources such as this that relative validity is a larger reliability in ...
0
votes
0answers
45 views
Reliability of a rating scale
My aim is to evaluate the reliability and validity of a new observation rating scale (likert-type, with points 1 to 5) of items, representing different behaviours. The sample does not meet parametric ...
1
vote
2answers
142 views
Under what circumstances is an N < 30 acceptable?
I am doing some research in which I want to expose subjects to an "unusual" event and record their response. I am recording the subjects' responses via a sensitive brain instrument, so I've been told ...
1
vote
0answers
255 views
How to validate a survey when using Likert scale?
I have developed a very simple survey to measure the attitudes of students toward science fairs. It makes use of the Likert Scale and Open Ended Questions. Do you have a recommendation for the type ...
1
vote
1answer
82 views
Valid IV for panel?
In a panel regression using fixed effects, is it correct to use an instrument that does not vary by year? To use an old but simple example, Angrist and Kruger 1991 use quarter of birth to instrument ...
0
votes
0answers
12 views
can we use validity coefficient as a population correlation in a structural model?
I have doubt, the measure of validity or $\rho$ may be usefully applied in case of structural modeling based on fixed effects assumption.
4
votes
1answer
845 views
How to reduce number of items using factor analysis, internal consistency, and item response theory in conjunction?
I am in the process of empirically developing a questionnaire and I will be using arbitrary numbers in this example to illustrate. For context, I am developing a psychological questionnaire aimed at ...
1
vote
0answers
105 views
validity coefficient & $\rho$
Is the validity coefficient the same thing as $\rho$, where $\rho = \frac{COV_{XY}}{SD_X SD_Y}$?
4
votes
3answers
211 views
Looking for a good online resource about survey design and analysis
What is a good and relatively brief overview of good practice for getting valid results from surveys.
I'm particularly interested in something about good survey design and analysis.
3
votes
3answers
665 views
Can I delete excessive number of multivariate outliers, like over 10% in sample?
I have a dataset with around 9000 cases, I'm running a factor analysis and I have found that 1100 cases are identified as being a multivariate outlier. Is it alright for me to got ahead and delete ...
3
votes
2answers
216 views
Reliability and validity of a standard survey
I had eleven people play five versions of a video game in single sessions, for a total of 55 sessions (11x5). I used the Task Evaluation Questionnaire from the Intrinsic Motivation Inventory to ...
2
votes
2answers
485 views
References for creating Neuropsychological composite scores
I am a doctoral student in clinical neuropsychology, and am in the process of creating z-unit weighted composite scores based on a battery of ability tests (i.e., attention/executive functions ...
