The Item Response Theory framework encompasses a wide range of psychometric methods and mathematical models (latent trait models) to study individual responses to items defining a measurement instrument (multi-item scales such as questionnaires or tests) that is used to assess a specific construct ...

learn more… | top users | synonyms

1
vote
0answers
12 views

Longitudinal data format in WinBUGS or OpenBUGS, different number of items per time point

I am working with longitudinal data, where there are a different number of "items" per time point. I am working with the MCMCdynamicIRT1d function in ...
1
vote
1answer
25 views

Interpreting discrimination values in IRT polytomous (grm) models. Are there any cut-offs or anchors?

I am working on a project that is looking at the discriminative properties of 6, 5-point Likert items in a scale. I am using the ltm package in R to examine this within a item response theory (irt) ...
0
votes
1answer
53 views

How to obtain Item Information Curves for the Partial Credit Model?

I have estimated a Partial Credit Model in Stata following Zheng, X. and Rabe-Hesketh, S. (2007) "Estimating parameters of dichotomous and ordinal item response models using gllamm". I'd like to ...
1
vote
0answers
29 views

Multigroup Longitudinal Item Response WinBUGS OpenBUGS

I was able to fit the Longitudinal IRT model in Winbugs for an ordinal response by extending the BUGS code I took from the paper by Curtis in JSS http://www.jstatsoft.org/v36/c01/paper/ However, I am ...
1
vote
1answer
59 views

Implementing nominal model from Polytomous Item Response Theory

I am attempting to map out the probabilities of observing different categories given different person ability using the Nominal Model. From the handbook of Polymous Item Response Theory 2010, the ...
4
votes
1answer
92 views

Longitudinal item response theory models in R

I'm trying to fit longitudinal item response theory (IRT) models in R. I have a test that was administered at multiple measurement occasions. I'd like to examine individuals' growth curves of factor ...
1
vote
0answers
58 views

Is it possible to fit a Graded Response Model in Stata?

I've been reading about Item Response Theory during the past few weeks and I'd like to use it to examine how my scales are functioning. The response categories are ordinal. If I understood well, the ...
0
votes
0answers
27 views

Item Response Theory alternatives

What are other approaches than Item Response Theory to model learning of students in standardised tests?
0
votes
0answers
17 views

Splines, latent variables and model identification

For $J$ units of observations my basic model contains latent variables $\theta_j, j = 1, ..., J$ identified by the marginal assumption $\theta \sim N(0,1)$. The latent variables are connected to a ...
1
vote
0answers
11 views

Datasets for exploring Cognitive Diagnosis Modelling [closed]

I recently became interested in Cognitive Diagnosis Modelling, which classifies respondents to skill profiles based on their responses and a hypothesized relation between skills and items (Q- or ...
1
vote
0answers
49 views

BUGS/JAGS for Nominal Response Model

I am a beginner with BUGS/JAGS and I was hoping to gather the opinion of you, experts. I am trying to implement a Nominal Item Response Analysis (Polytomous, not ordered, like a multiple-choice exam) ...
2
votes
1answer
78 views

How to check goodness of fit for a graded response model in R

I am using the grm function in the ltm package in R. There is no function to check the goodness of fit of the output. How can I ...
1
vote
1answer
85 views

Mixing dichotomous and polytomous items in one test

I have to evaluate a test paper which contains both dichotomous and polytomous items. I am currently using R. But in R IRT models for scoring of dichotomous and polytomous items are different and I ...
6
votes
1answer
92 views

Item reliability or fit in IRT-based adaptive tests?

My background is in machine learning and statistics, but I am relatively new to psychometrics and testing. Nearly all of the literature I've found on item reliability refers to Chronbach's alpha or ...
1
vote
1answer
48 views

Change in output depending on mirt version

I have a matrix which I'm trying to run through the mirt function of the mirt package: ...
1
vote
1answer
32 views

Inferring testlet structure in item response theory

Is it possible to infer the testlet structure in a set of items using item response theory? Specifically, I've created a lot of variations on the story recall task, each variation being scored on 25 ...
2
votes
1answer
64 views

How can I handle missing values when fitting IRT model?

I am conducting a study for analyzing male involvement in Family planning. It is of interest to develop an index for the involvement of male. I am currently having difficulties fitting an IRT model ...
2
votes
1answer
65 views

Calculating the space/distance between scale points (IRT)?

I am working with a seven item Likert Scale (1, 2......6, 7) for a classroom management. How can I calculate the distance between these seven scale points? This is for instrument reliability ...
1
vote
0answers
27 views

Comparing the Goodness of fit of two polytomous set of items not nested

I'm working on two identical set of items that only differ in their frequency-of-occurence dimension (in the first is max.7 while in the second is max.4). They are both fit with the Generalised ...
1
vote
1answer
84 views

Using Ltm package to calclate 3PL some lines of data seem to go missing

I am hoping someone can help with the following: I have been trying to use the ltm package in R to get person fit estimates using a 3PL model. The problem I have been having is that I start off ...
0
votes
1answer
116 views

Machine learning with trinomial features

I have 100,000 students who have each answered some multiple choice questions. Given their performance I want to work out what the chances are of a particular student answering the next question ...
1
vote
1answer
112 views

Computationally singular error using MIRT package

We've got a 524*40 data frame of responses to a likert-type scale questionnaire (7 response categories on 40 items). We want to do exploratory multidimensional IRT using the MHRM method to identify ...
1
vote
2answers
96 views

Applications of Item Response Theory

As far as I know, item response theory is mainly used within psychology to analyse survey data, personality questionaires or in educational setting. Are there other areas (possibly outside of ...
0
votes
0answers
46 views

Calculating point AND uncertainty estimates for IRT factor scores

I have a survey dataset that includes items designed to measure several latent variables. There are around 3-5 items per latent variable. The items generally use 5-point response sets, so I would like ...
3
votes
2answers
80 views

Dealing with least and maximum score in IRT

Generally when I do IRT modelling (using R software, 2PL model, ltm package) I remove records of students who have scored either 0 or 100%. The logic being that we do not have enough information about ...
3
votes
1answer
170 views

Item response theory vs. summative Likert scale

If the items to be "summed" or combined to create an overall index are collectively the underlying construct (i.e. I am trying to measure compliance to an intervention which has different ...
2
votes
1answer
437 views

How is a bifactor IRT model different from a factor analysis?

I am sorry for a more basic question, but I was unable to find any good sources on google. How is a bifactor IRT model different from a factor analysis? How would you describe their key differences? ...
1
vote
3answers
258 views

Is R output reliable (specially IRT package ltm)

This may seem like a foolish question, but it is critical for me to have some expert advice on this. I am doing some research on students' learning levels in India. I am using R software (...
1
vote
0answers
111 views

Overall goodness-of-fit/p-value for multiple items IRT model in R (ltm)

The data set which I am trying to analyse is Student Test Data. I have a data of responses (either 1/correct response or 0/incorrect response) on some questions of a set of students. I have fitted a ...
2
votes
1answer
275 views

IQ adaptive test items in 1pl, 2pl or 3pl IRT model?

Some adapative test systems (e.g. school assessment tools) use the 1pl IRT model, while others use the 2pl or the 3pl. When developing an adaptive IQ test, is there a rule of thumb about which model ...
1
vote
1answer
158 views

How to select next item in polytomous CAT / MIRT?

To make a Computerized Adaptive Test out of a sample of 20 dichotomous items a typical course of action would be to: 1) calibrate respondent data with a R package like mirt or ltm using Rasch, 2PL ...
0
votes
1answer
79 views

IRT model and ceiling effect

I did some experiment in which tests are taken twice, pretest and posttest. I found there might be ceiling effect because the average of posttest is close to maximum test score possible. If I assume ...
5
votes
1answer
135 views

IRT/Rasch modeling with very large N

I want to fit a 1-parameter IRT model on a questionaire with 15 questions and about six million people. Considering the large N, standard errors aren't essential. It looks like the IRT world is sort ...
5
votes
1answer
757 views

IRT in R: Does anyone know of an IRT item calibration function that can cope with NA's?

I have a dataset that looks like this. ...
3
votes
0answers
145 views

How to extract factor scores for each observation in IRT?

library(ltm) fit <- rasch(LSAT) factor.scores(fit) This code can generate latent trait scores for response patterns. How can I extract latent trait scores for ...
0
votes
2answers
833 views

Error message from grm() in ltm: subscript out of bounds

I am analyzing a survey data set. One of the items in the survey is: ...
1
vote
1answer
215 views

Error using ltm R package

I'm using the R package ltm to create a 2-parameter logistic regression. The input matrix is sparse - many users have taken a small subset of the items in the item bank. For some of my data sets i'm ...
1
vote
0answers
40 views

How do I extract difficulty and discrimination from a non-parametric IRT model

I've been using the KernSmoothIRT module in R to do non-parametric analysis of some items. I'm trying to find a way to quantify the difficulty and discrimination ...
2
votes
1answer
172 views

Item information in IRT with item covariates (linear logistic test model)

Short question: How does the calculation and interpretation of IRT item information and test information change in the presence of item properties? Long question: There's a variation on IRT called ...
3
votes
1answer
146 views

Item information in IRT

According to item information curves, item information for a 2PL IRT model is $I(\theta)=a^2_i p_i(\theta) q_i(\theta)$ To determine $p_i(\theta)$ and $q_i(\theta)$, do you just use the observed ...
4
votes
1answer
526 views

Internal consistency reliability in item response theory models

How can internal consistency reliability of a test and of individual test items be quantified in Item Response Theory models? I know I can resort to Classical Test Theory, Cronbach's alpha, and other ...
1
vote
1answer
472 views

How to calculate absolute fit indices (RMSEA, GFI…) from relative ones (AIC, BIC…)?

I have conducted an IRT analysis with Conquest in order to compare two models (1-dimensional vs. 8-dimensional) applied to a given data set (41 items of a questionnaire, N=195). Comparing the ...
2
votes
0answers
121 views

Testing graded response model thresholds for significance?

I have a data set in which two raters have each rated N samples using a 5-point ordinal rating scale. My primary interest is in whether these two raters make significantly different use of those ...
4
votes
3answers
241 views

Are discrimination parameters in two-parameter IRT models only specific to items?

Discrimination parameters in two-parameter model from IRT are usually considered item parameters. But I've come to doubt it. Think about psychophysics; for example, detecting luminance. I don't ...
3
votes
0answers
301 views

Dealing with poor fit in an Item Response Theory model

I'm studying an online course with about 3000 students who each took several quizzes and I'm trying to apply Item Response Theory (using the ltm package in R) to model the questions, determine which ...
3
votes
1answer
429 views

Estimating ability using IRT when the model parameters are known

I have 3PL model parameters (guessing, difficulty and discrimination item parameters). Is there any function with which I can estimate individual ability from item response data? I tried the function ...
2
votes
1answer
105 views

Pros/cons of estimating parameters for missing observations?

Some people are playing a game online. Every time a person plays, a new game board is generated randomly. On generation of a new board, the player can also choose a special weapon. (The choice of ...
4
votes
4answers
443 views

Simulating responses to a test for item-response theory

I am developing an online assessment system and I need to calibrate the bank of questions but I do not have enough people to implement a pilot test. That is why I decided to simulate the responses of ...
14
votes
4answers
5k views

How to get started with applying item response theory and what software to use?

Context I have been reading about item response theory, and I find it fascinating. I believe I understand the basics, but I am left wondering how to apply statistical techniques related to the area. ...
1
vote
3answers
926 views

Is there an R package which implements weighted maximum likelihood for Rasch models?

Is there a package in R which implements the weighted maximum likelihood method (Warm, 1996) for estimating the person parameters in Rasch Models?