Psychometrics has evolved as a subfield of psychology to become the science of measurement of unobservable individual characteristics.

learn more… | top users | synonyms

0
votes
2answers
764 views

Error message from grm() in ltm: subscript out of bounds

I am analyzing a survey data set. One of the items in the survey is: ...
3
votes
1answer
82 views

Validation of a questionnaire in a new population

I have 400 responses to a 20 item questionnaire which purports to measure an attitudinal constuct in medical students. The instrument was validated in the US for a single year of medical students and ...
3
votes
1answer
120 views

Omega H asymptotic

In the omega function in the psych package for R, we have several outputs including Hierarchical omega, Asymptotic omega and Total omega. I was reading about the outputs, but I find nothing about ...
1
vote
1answer
80 views

Using Ltm package to calclate 3PL some lines of data seem to go missing

I am hoping someone can help with the following: I have been trying to use the ltm package in R to get person fit estimates using a 3PL model. The problem I have been having is that I start off ...
0
votes
1answer
25 views

Correlations within Factor in a pscyhometric instrument

I am working with results of a psychometric test. There are twelve factors and each have three subfactors. My problem is that one of the subfactors correlates very highly 0.3 to 0.7 with subfactors of ...
3
votes
0answers
39 views

How can IRT-Models be understood in GLM/ SEM Framework? (Predict Learning with added Paradata-Covariates)

I'll be working with data from an intelligent tutor system similar to one studied in the KDD-Cup 2010 on student performance prediction and plan to use IRT models to infer item and ability parameters. ...
3
votes
0answers
101 views

Should I run measurement invariance if confirmatory factor analysis is not affirmative?

I have a repeated measures design for a Likert scale with 10 items. This scale is assumed to be unidimensional and this is one of the research questions along with the scales measurement invariance ...
3
votes
0answers
540 views

Can I combine several ordinal questions to create an index and/or composite measure?

I am using a survey that contains several questions about various dimensions of performance for policy research institutes. Here, performance in the policy arena is unpacked into things like: ...
3
votes
0answers
293 views

Dealing with poor fit in an Item Response Theory model

I'm studying an online course with about 3000 students who each took several quizzes and I'm trying to apply Item Response Theory (using the ltm package in R) to model the questions, determine which ...
3
votes
0answers
1k views

How to carry out a Likert scale analysis?

Context: My research aims to assess whether parents who have been involved in a relationship with a social worker are at higher risk of child abuse/neglect. I am trying to establish whether there ...
2
votes
0answers
39 views
+50

What is the relationship between scale reliability measures (Cronbach's alpha etc.) and component/factor loadings?

Let's say I have a dataset with scores on a bunch of questionnaire items, which are theoretically comprised of a smaller number of scales, like in psychology research. I know a common approach here ...
2
votes
0answers
63 views

Is it appropriate to assess internal consistency on related items measured with different response formats within the same instrument?

In my survey, I grouped 67 unique counseling techniques that I thought were related to one another (based on theory and conceptual similarity) into six "counseling domains" using fairly intuitive, ...
2
votes
0answers
117 views

Testing graded response model thresholds for significance?

I have a data set in which two raters have each rated N samples using a 5-point ordinal rating scale. My primary interest is in whether these two raters make significantly different use of those ...
2
votes
0answers
281 views

Maximizing Cronbach alpha to select the number of variables that define a given construct

I can't seem to find this anywhere on the internet or in my books. I'm putting together a construct for an underlying variable. Is it acceptable to have a construct with two variables if that ...
2
votes
0answers
385 views

Fixing error variance in a path analysis to model measurement error in scales using sem package

I want to construct a path analysis model that can account for measurement error in totally aggregated parcels, which refer to parcels where all of the items in a scale are summed or averaged. If I am ...
1
vote
0answers
12 views

Is there an extension of multinomial process models that can model several dependent variables?

In the setting of psychological experiments, where a categorical response has to be given, the same response can, in theory, be generated by different latent processes. For example, in an experiment ...
1
vote
0answers
44 views

How to calculate differential item functioning when factor structure differs between groups?

I want to test for differential item functioning on a self-report measure between two groups (i.e., one with a disease one without). Differential item functioning refers to a measurement bias wherein ...
1
vote
0answers
204 views

Intra- and inter- observer error, and the intra-class correlation coefficient (ICC)

I have 3 observers, who each perform multiple observations in which they count a phenomenon. I'm trying to quantify both inter- and intra- observer error for this study. I'm new to this and am finding ...
1
vote
0answers
42 views

Map a normal distribution N(x,s) to an ordinal response variable

I am working on a simulation. I am going to extract a series of normally distributed values from a distribution $N(x,s)$ whose mean $x$ and variance $s$ is known. I want to pretend that such ...
1
vote
0answers
106 views

Confirmatory factor analysis for a newly constructed questionnaire

I am about to develop a new questionnaire with 142 questions I have performed exploratory factor analysis and 30 latent factors were extracted. I was wondering if it is necessary to perform ...
1
vote
0answers
240 views

Doing CFA on a known theoretical model, but having problems with convergent and discriminant validity

I did a survey based on the UTAUT model / theory with standard questions used. The N was 150. I am trying to validate the model for my survey with structural equation modeling (via the AMOS software). ...
1
vote
0answers
77 views

how to analyze necessary/sufficient relationship?

Good day! I'm a second year psych grad student. From my fascination with formal logic, I wondered (just personal; not homework) about how to statistically establish necessary/sufficient ...
1
vote
0answers
87 views

What coefficient could I use to calculate the relative difficulty of a test in relation to others using only mean and population standard deviation?

I have a series of tests, all of them of different difficulty, and from each of them I get an average score and a population standard deviation; e.g: ...
1
vote
0answers
346 views

Which correlation analysis is appropriate for binary and ordinal variables?

Violin players were asked to rate 5 violins from least to most rich on a [0 1], 0.05-increment scale, ...
1
vote
0answers
480 views

How to validate a survey when using Likert scale?

I have developed a very simple survey to measure the attitudes of students toward science fairs. It makes use of the Likert Scale and Open Ended Questions. Do you have a recommendation for the type ...
1
vote
0answers
238 views

Obtaining factor scores from a factor analysis of mixed types (both ordinal and scale) variables

I have to analyze a data set having both ordinal and scale variables. What I was trying to do was to factor analyze the data. The data was in SPSS. But I think SPSS factor analyzes the data by ...
1
vote
0answers
249 views

How is the proof that the Quartimax/Varimax-rotation converges?

Empirically the quartimax-/varimax-rotation has proven useful and it was always converging in my applications. But from my readings years ago I have a vague remembering, that the fact of a proof of ...
0
votes
0answers
14 views

Testing face validity of a questionnaire

I would like to validate a questionnaire for my population, using a "think-aloud" (protocol analysis) method. The study looks at IT user satisfaction. Do you think my participants have to use the ...
0
votes
0answers
26 views

Principal component analysis, psychometrics, and number of items required

I saw that questions regarding sample sizes and PCA are asked here quite frequently. However, I was not able to find exactly the information I need. I plan to do a psychometric study and conduct a ...
0
votes
0answers
37 views

Correlation significance test with standardized z scores

I am using spss I am looking at a criterion-validity concurrent design. I had to transform two groups performance ratings into z scores because there were differences in how raters rated them on the ...
0
votes
0answers
14 views

theoretical profile correlation

My data (n > 4000) contains the results of two separate tests (instruments). I have a profile made from likert scales for one of the instruments (S1, S2, ... S20). I want to find the corresponding ...
0
votes
0answers
43 views

How to test measurement invariance with PLS?

I have two questions about structural equations modeling: To perform comparisons of model estimates for different groups (3 clusters), do I always have to analize measurement invariance first? If ...
0
votes
0answers
393 views

Using Rasch model to explain relationships between a set of dependent and independent variables

My research study is in development economics. My data consist of more than one independent variables (continuous and categorical) as well as more than one dependent variables (categorical 5-point ...