Psychometrics has evolved as a subfield of psychology to become the science of measurement of unobservable individual characteristics.

learn more… | top users | synonyms

6
votes
2answers
273 views

Estimating the probability of a person getting a question right

We need to estimate the probability of a person getting a question right for a given content area given his history of getting questions in the same content area right in the past. We would also ...
8
votes
4answers
1k views

Can one validly reduce the numbers of items in a published Likert-scale?

[edits made in response to feedback- thanks :-) ] Doh! More edits! Sorry! Hello- I am doing some rather rough and ready data collection with a survey sent out to healthcare staff using a published ...
10
votes
3answers
4k views

Validating questionnaires

I am designing a questionnaire for my dissertation. I am in the process of validating the questionnaire I have applied a Cronbach's alpha test to the initial sample group. The responses to the ...
6
votes
2answers
1k views

Item Analysis for an R newbie

I am trying to assess a 20-item multliple choice test. I want to perform an item analysis such as can be found in this example. So for each question I want the P-value and the correlation with the ...
4
votes
1answer
2k views

Data transformation for Principal Components Analysis from different Likert scales

I have data from a survey comprised of several measures that used different Likert-type scaling (4-, 5-, and 6-point scales). I would like to run a principal components analysis using the data from ...
3
votes
2answers
361 views

The best measure of reliability for interval data between 0 and 1 [closed]

I have 6 sets of interval data each of which between 0 and 1. Each set, calculated by a computer program, is related to the degree of similarity between some sounds (pairwise). What do you think in ...
16
votes
2answers
12k views

Inter-rater reliability for ordinal or interval data

Which inter-rater reliability methods are most appropriate for ordinal or interval data? I believe that "Joint probability of agreement" or "Kappa" are designed for nominal data. Whilst "Pearson" and ...
3
votes
1answer
645 views

R package ltm: How to manipulate title on item response category characteristic curve plot

I have conducted an IRT analysis using package ltm in R 2.10. fit1 <- grm(data) When producing plots of item response characteristic curves (ICCs), ...
6
votes
3answers
3k views

Differences between tetrachoric and Pearson correlation

Currently I'm analysing around 300 items in the field of education. I'm interested in the dimensionality of the dataset. So I compute a matrix of tetrachoric correlation. The goal is to do a factor ...
2
votes
2answers
943 views

Confidence intervals on differences in choices in a GEE framework: methods and alternatives?

Say we have 5 items, and people are asked which item they like. Multiple answers are possible, but also no answer is possible. The people are categorized according to factors like gender, age, and so ...
3
votes
3answers
2k views

Classification after factor analysis

I have analysed several dimensions in a survey. Each part of the survey represents a theoretical dimension and is analysed with factorial analysis. I want to use scores from factor analysis to do a ...
10
votes
5answers
1k views

Is it appropriate to treat n-point Likert scale data as n trials from a binomial process?

I've never liked how people typically analyze data from Likert scales as if error were continuous & Gaussian when there are reasonable expectations that these assumptions are violated at least at ...
11
votes
3answers
5k views

Factor analysis of questionnaires composed of Likert items

I used to analyse items from a psychometric point of view. But now I am trying to analyse other types of questions on motivation and other topics. These questions are all on Likert scales. My initial ...
5
votes
3answers
360 views

Quantitative methods and statistics conferences in psychology?

What are the most significant annual conferences focusing on quantitative methods in psychology? This could include but is not limited to psychometrics, mathematical psychology, and statistical ...
5
votes
4answers
790 views

FA: Choosing Rotation matrix, based on “Simple Structure Criteria”

One of the most important issues in using factor analysis is its interpretation. Factor analysis often uses factor rotation to enhance its interpretation. After a satisfactory rotation, the rotated ...
7
votes
2answers
743 views

Reliability in Elicitation Exercise

I am trying to calculate the reliability in an elicitation exercise by analysing some test-retest questions given to the experts. The experts elicited a series of probability distributions which were ...