Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 6029

A measure is said to have a high reliability if it produces similar results under consistent conditions. DO NOT confuse reliability with validity (see tag wiki). DO NOT use for inter-rater reliability which has its own tag inter-rater

2 votes

Which test to see if two set of continuous data are comparable

Reliability/random measurement error: Observers disagreeing randomly on any particular measure while, on average, none of them reports systematically higher or lower measures. … Note than none of this directly addresses the issue of reliability. …
Gala's user avatar
  • 8,581
5 votes
Accepted

Reliability and validity of a standard survey

Regarding your first question (computing reliability estimates on your own data vs. rely on published reliabilities), several methodologists recommend using your own data, in particular because reliability … In the long term, reporting reliability estimates is also useful for things like reliability generalization studies. Vacha-Haase, T., Kogan, L.R., & Thompson, B. (2000). …
Gala's user avatar
  • 8,581
7 votes
Accepted

How can reliability and validity of content analysis be quantified when there is only one pe...

Usual reliability indices (Cronbach $\alpha$, Cohen $\kappa$, etc.) only ever quantify the influence of a single source of error. … Stated that way, it might sound obvious but talk of “estimating the reliability” often obscures this basic point. …
Gala's user avatar
  • 8,581
2 votes

Reliability engineering: Measuring the proportion of defective products at several time poin...

For example, you should not: Simulate two years of product life, notice that two units fail after 20 months and compute a confidence interval at 19 months purporting to show that reliability is high …
Gala's user avatar
  • 8,581
13 votes
Accepted

Where do the descriptors for Cronbach's alpha values come from (e.g., poor, excellent)?

The following two papers discuss cut-off values for reliability indices: Lance, C.E., Butts, M.M., & Michels, L.C. (2006). … Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34 (3), 177-189. …
Gala's user avatar
  • 8,581
10 votes

Cronbach's alpha negative result

Even if the assumptions are met and the reliability is decent, an estimate computed from a particular sample can be negative, just as a sample mean is not equal to the population mean. … One reason is that their authors assume that any scale development effort will have at the very least hundreds of observations but there is some sampling variability in reliability estimates anyway. …
Gala's user avatar
  • 8,581
5 votes

Using existing questionnaire

Regarding reliability, there are some authors who indeed recommend computing reliability estimates on your own data instead of relying on published estimates, see Reliability and validity of a standard … The idea is that reliability is not so much a property of a scale per se as it a property of the scores (i.e. a set of measures on a specific population). …
Gala's user avatar
  • 8,581