Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [irt]

The Item Response Theory framework encompasses a wide range of psychometric methods and mathematical models (latent trait models) to study individual responses to items defining a measurement instrument (multi-item scales such as questionnaires or tests) that is used to assess a specific construct (e.g., examinee proficiency or liability to depression).

0
votes
0answers
15 views

Why won't a 3PL IRT run?

I'm running some IRT models on test data and encountered a new problem. There are 36 items (scored as "correct" and "incorrect") and 287 participants with no missing data. I'm using Stata (not by ...
0
votes
0answers
24 views

Poisson adaptation of IRT model: how to interpret parameters?

for my work I made an assessment in which users have to stack blocks in a certain configuration in as few steps as possible. If the user does this in the minimally required number of steps, they get ...
3
votes
2answers
133 views

In 1PL model, zero ability equals average ability, or change accuracy? [closed]

In a test evaluation scenario, latent variable analyses are used to represent the ability of the test-taker and the difficulty of the question. A 1PL model uses a latent, random log-odds threshold, $\...
0
votes
1answer
20 views

Ceiling effect of data-IRT Rasch EFA

Can you do IRT, CFA and/or Rasch if your data has items with large ceiling effects (i.e., no one was choosing the last two options of a 5-point likert scale)? Is it appropriate to do?
2
votes
1answer
28 views

How to proceed when collapsing ordinal items with levels that got no answer?

I have a set of 8 Likert-type items with 9 levels each. In no case do we have an item for which responses fill all possibilities and this has shown to be an issue for the SEM I'm trying to run (as ...
0
votes
0answers
43 views

Performance metric for math tasks

I have several math items which are varying in terms of difficulty. The difficulty ranges from zero to one, where zero is the most difficult one. Let's say users are solving such math tasks. I would ...
0
votes
1answer
27 views

IRT: Standard errors for intercepts vs. locations

In item response theory (IRT), the argument of the logit function can be expressed using a discrimination (a) and an intercept (b) as $a \theta + b$ or using a discrimination and location (c) as $a ( \...
0
votes
1answer
50 views

Convert ordinal to interval data with mirt package in R [closed]

I have ordinal data from 2 questionnaires. One questionnaire has a scale of 1:7 and the other of 1:5. I would like to convert these data to interval using polytomous item response theory. I can ...
0
votes
0answers
31 views

Extended Rasch analysis in R (PCM)

I am trying to replicate a previous piece of work using Rasch analysis to categorise respondents to a 8-item questionnaire in 3 groups. In the work I'm replicating, the Rasch analysis is used to get a ...
1
vote
1answer
51 views

Measure of fit to simulated data for item response theory model

Starting with randomly generated person ability parameters $\textbf{z}$ and item parameters $(\boldsymbol \alpha,\boldsymbol{\beta})$, I simulated data representing correct/incorrect responses of $N$ ...
7
votes
2answers
141 views

What is the probability that a student gets a better score than another on a test with randomly selected questions?

Suppose there is a set $S$ of $100$ questions and there are $2$ students $a$ and $b$. Let $P_{ai}$ be the probability that $a$ answers the question $i$ correctly, and $P_{bi}$ the same for $b$. All $...
0
votes
1answer
397 views

Guessing Factor in Item Response Theory

I'm currently trying to learn basics (nah who am i joking I'm only trying to learn the concept) of IRT since i have a high stake test (college entrance exam) coming in a few months that used IRT but i ...
0
votes
0answers
12 views

Similar questions across similar samples at different times - reliability?

I'm working with pilot data where there exist several versions of the same questionnaires that were administered to different participants across various time points. I'd like to get a better sense of ...
0
votes
0answers
38 views

what does a negative slope mean in a 2-PL model?

i'm an IRT novice. in classical test theory, negative discrimination occurs when high test performers score lower on an item than low test performers. is this synonymous to a negative slope in the 2-...
0
votes
0answers
200 views

Comparing AIC and BIC of CFA and IRT

I was wondering does it make sense to compare AIC and BIC values of confirmatory factor analysis models and item response theory models? In many cases, goodness of fit indices for item response theory ...
0
votes
1answer
102 views

What do I do with local dependence in a polytomous IRT model?

I have built an GPCM IRT model using survey data, but have found significant local dependence (in violation of the LID assumption) using residuals() in R. I've found information online for dealing ...
0
votes
0answers
29 views

Handful of IRT scores all exactly the same value

I am using the mirt package in R to model some latent variables. They seem to be working fine, except that a bunch of the scores generated are exactly the same. Most of the scores are within two or ...
3
votes
0answers
156 views

Is Item Response Theory (IRT) a form of reinforcement learning?

I was doing studies in reinforcement learning and trying to apply it in Computerised Adaptive Testing (CAT). While learning IRT, I felt it is similar to behaviour of RL setting - receiving feedback ...
0
votes
0answers
36 views

Factor Scores from Generalised Partial Credit Model in IRT versus Confirmatory Factor Analysis

I have run a CFA on a questionair with 25 item and calculated the corresponding Factor Scores (5 dimensions) for each case (in R with the package 'lavaan'). I also have run 5 generalised partial ...
0
votes
0answers
20 views

Mixed Model IRT (MMIRT) versus Factor Mixture Modeling (FMM)

I wonder if my following description about MMIRT and FMM is correct. This will help me check my understanding of the two statistical techniques: MMIRT is a hybrid between latent class analysis (LCA) ...
0
votes
1answer
148 views

constraining item difficulty in 2PL estimation using “ltm”

I was planning to bridge IRT estimations of different tests using one particular item as an anchor. Currently, I am using the ltm package in R and am planning to do it using the option ...
0
votes
0answers
30 views

IRT diferences in using callibrated itens and doing the callibration

Recently I applied a mathematics test for ensino fundamental (the Brazilian elementary school) composed by 24 items previously calibrated under a 3 parameters logistic model. The calibration of these ...
2
votes
0answers
39 views

Bayesian Model Fit for Binary Data

I am looking for methods (and preferably references) for assessing model fit for Bayesian analyses of binary data. Specifically, I am fitting Bayesian parametric and nonparametric item response models ...
1
vote
0answers
21 views

IRT vs proportion/frequency

Lets say I have response data from a multiple choice exam question and I want to understand whether the item was too difficult, or if I should change it somehow to improve it What benefits do I get ...
2
votes
0answers
36 views

When to use which ability estimates method?

There are several methods in IRT ability estimation,such as : expected a-posteriori ("EAP"), Bayes modal ("MAP"), weighted likelihood estimation ("WLE"), maximum likelihood ("ML"), expected a-...
1
vote
0answers
96 views

How to do unidimension test for graded response model?

Is there any method or R function can be used to check whether data is unidimensional with graded response model (grm)?
1
vote
0answers
66 views

Can IRT supersede CTT nowadays?

CTT is Classical Test Theory, IRT is Item Response Theory. IRT can handle anything CTT can. But I am curious why IRT is seldom mentioned on this site. Can IRT supersede CTT nowadays?
0
votes
0answers
50 views

Should I use both CTT and IRT to analysis data?

Theses questions are about competence of 2 analysis systems. 1.Is there any analysis can be done within CTT but not IRT? 2.If I done analysis within IRT, should I use CTT to check again? According to ...
-1
votes
1answer
75 views

What's the criteria of deleting item? [closed]

What's the recognized criteria in statistics world?
0
votes
0answers
203 views

Reporting LRT(log likelihood ratios) from anova()

I' ve got two logistic models/ based on IRT that I wanted to compare them using the log likelihoodratio test, so I used anova(model1, model2) in R. My output looks like following: ...
1
vote
1answer
38 views

IRT Model for number of attempts before correct response

I have a test where respondents are able to attempt each item as many times as required until they get it correct. I am looking to fit an IRT model to data from this test in order to look at the ...
1
vote
1answer
37 views

Is location and scale of IRT parameter estimates arbitrary?

There is a thing I’ve never understood in IRT completely. Packages in R such as mirt or ltm are usually consistent in their ...
2
votes
1answer
88 views

Item information for 4PL under IRT

What is the item information curve for 4PL model under item response theory (IRT)? the information of 3PL has quite a neat form: But what it is like if I add parameter of carelessness "d"?
2
votes
1answer
192 views

Item Response Theory vs Rasch Model

1) What's the difference between Item Response Theory and Rasch model? 2) What's the pros and cons between them? To me, they seem to be very similar as in they both analyze the performance of ...
0
votes
1answer
42 views

Estimating user ability (success or fail) using maximum likelihood and Item response theory

I am trying to estimate the user ability (success or fail) using item response theory. So, I am re-implementing an algorithm from this paper but I can not understand the following line: In the ...
0
votes
2answers
39 views

Item Response Models with Few Measures

Are there any problems with using Item Response Theory models such as the Graded Response Model when the number of measures is small? I don't know if there are any asymptotic results that would make a ...
1
vote
1answer
38 views

Interdependence of hyperparameters of bernouilli laws [closed]

Suppose that you have $N$ people passing an exam having 2 type of questions (type A and type B) which all have correct/uncorrect outcomes. After seeing the results, I want to modelize the probability ...
0
votes
1answer
57 views

Dependency in IRT with pseudoitems as a testlet

I'm curious whether a testlet IRT model would be appropriate for a situation where polytomous responses on a 1-5 scale are decomposed into pseudoitems indicating whether the response is $\ge X$ ...
1
vote
1answer
73 views

Joint estimation of item and ability parameters

Most Common Approach of estimation is Marginal Maximum Likelihood. Other procedures: 1) Joint Maximum Likelihood (Rasch only); 2) Markov Chain Monte Carlo(MCMC): Typically only used for highly ...
2
votes
1answer
310 views

IRT monotonicity

I am trying to analyse data from a questionnaire containing 24 items using a 2pl IRT. Responses are provided on yes-no format. How can I examine the assumption of monotonicity in IRT for binary data?...
2
votes
2answers
634 views

theta parameter in R's LTM package

I am curious whether there is an intuitive way in ltm package in R to display person's estimated latent trait after fitting the ...
0
votes
1answer
143 views

Estimating of item difficulty in IRT

Which approaches are exist for the estimation of a item difficulty from the statistical data? Are they measure objective item's complexity?
2
votes
1answer
137 views

How can I rate the question according to the difficulty?

I have a set of problems to analyze from a programming contest. My work is to rate the question according to its difficulty (easy,medium,hard) by analyzing the ...
2
votes
1answer
97 views

Meaning of several peaks of information curves in GRM

I fitted my data to GRM, got the information curves and try to interprete the pictures. I'm new to IRT and still don't get a lot of things. Here I can observe that the items are pretty good and ...
0
votes
0answers
64 views

Quantifying rater consistency

I have a test in which students must give scores to 3+ items, for which we can compute distances from "true" (instructor) scores. ...
7
votes
1answer
874 views

Similarities and differences between IRT model and Logistic regression model

Despite the basic similarities like both of these model the probability of success rather than modelling the response variable directly; I believe that there are more reliable answers which point out ...
1
vote
0answers
121 views

Quantifying internal consistency with multiple raters and continuous rating scales

I have data from an assessment where people are rated by multiple raters on a set of criteria using a rating scale that is (essentially) interval. All people are rated by all raters. I believe that ...
2
votes
0answers
31 views

Evaluation of experiment based on Multidimensional Item Response Theory?

For my master thesis within Educational Science and Technology, I have an experimental design with students divided over a control and an experimental group based on an educational intervention, and ...
0
votes
0answers
102 views

If I know difficulty and thresholds of all items can I build a Rasch model and calculate the ability of new patients

I'm trying to "reverse engineer" a statistal model used in this article: ACTIVLIM : A Rasch-built measure of activity limitations in children and adults with neuromuscular disorders In this article a ...
1
vote
0answers
78 views

Longitudinal IRT estimation - wrong approaches?

I have been fitting longitudinal IRT models, checking for measurement invariance over time, constraining item parameters not to change over time, as recommended in the literature, and had good ...