Search Results
Search type | Search syntax |
---|---|
Tags | [tag] |
Exact | "words here" |
Author |
user:1234 user:me (yours) |
Score |
score:3 (3+) score:0 (none) |
Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
Views | views:250 |
Code | code:"if (foo != bar)" |
Sections |
title:apples body:"apples oranges" |
URL | url:"*.example.com" |
Saves | in:saves |
Status |
closed:yes duplicate:no migrated:no wiki:no |
Types |
is:question is:answer |
Exclude |
-[tag] -apples |
For more details on advanced search visit our help page |
A measure is said to have a high reliability if it produces similar results under consistent conditions. DO NOT confuse reliability with validity (see tag wiki). DO NOT use for inter-rater reliability which has its own tag inter-rater
2
votes
Which test to see if two set of continuous data are comparable
Reliability/random measurement error: Observers disagreeing randomly on any particular measure while, on average, none of them reports systematically higher or lower measures. … Note than none of this directly addresses the issue of reliability. …
5
votes
Accepted
Reliability and validity of a standard survey
Regarding your first question (computing reliability estimates on your own data vs. rely on published reliabilities), several methodologists recommend using your own data, in particular because reliability … In the long term, reporting reliability estimates is also useful for things like reliability generalization studies.
Vacha-Haase, T., Kogan, L.R., & Thompson, B. (2000). …
7
votes
Accepted
How can reliability and validity of content analysis be quantified when there is only one pe...
Usual reliability indices (Cronbach $\alpha$, Cohen $\kappa$, etc.) only ever quantify the influence of a single source of error. … Stated that way, it might sound obvious but talk of “estimating the reliability” often obscures this basic point. …
2
votes
Reliability engineering: Measuring the proportion of defective products at several time poin...
For example, you should not:
Simulate two years of product life, notice that two units fail after 20 months and compute a confidence interval at 19 months purporting to show that reliability is high …
13
votes
Accepted
Where do the descriptors for Cronbach's alpha values come from (e.g., poor, excellent)?
The following two papers discuss cut-off values for reliability indices:
Lance, C.E., Butts, M.M., & Michels, L.C. (2006). … Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34 (3), 177-189. …
10
votes
Cronbach's alpha negative result
Even if the assumptions are met and the reliability is decent, an estimate computed from a particular sample can be negative, just as a sample mean is not equal to the population mean. … One reason is that their authors assume that any scale development effort will have at the very least hundreds of observations but there is some sampling variability in reliability estimates anyway. …
5
votes
Using existing questionnaire
Regarding reliability, there are some authors who indeed recommend computing reliability estimates on your own data instead of relying on published estimates, see Reliability and validity of a standard … The idea is that reliability is not so much a property of a scale per se as it a property of the scores (i.e. a set of measures on a specific population). …