Statements in which the resource exists as a subject.
PredicateObject
rdf:type
lifeskim:mentions
pubmed:issue
9
pubmed:dateCreated
2006-4-12
pubmed:abstractText
A reliability study in which multiple raters evaluate multiple subjects was assumed in order to confirm the inter-rater reliability of rating scales. The two-way ANOVA model defining subjects and raters as random effects was applied, and the combination of the number of subjects and the number of raters that minimizes variance of the intraclass correlation coefficient (ICC) with a fixed total number of ratings (number of subjects x number of raters) was studied. The results revealed that the optimal combination depends on the relative ratio (between-rater variance/error variance), and that large number of raters brings the high precision of estimation of the ICC when the relative ratio was greater. It was concluded that when information concerning the relative ratio is unreliable, the use of identical numbers of raters and subjects minimizes variance when the relative ratio is substantially large and variance is maximized, providing a good study design from the viewpoint of 'maximin'.
pubmed:language
eng
pubmed:journal
pubmed:citationSubset
IM
pubmed:status
MEDLINE
pubmed:month
May
pubmed:issn
0277-6715
pubmed:author
pubmed:issnType
Print
pubmed:day
15
pubmed:volume
25
pubmed:owner
NLM
pubmed:authorsComplete
Y
pubmed:pagination
1547-60
pubmed:dateRevised
2006-11-15
pubmed:meshHeading
pubmed:year
2006
pubmed:articleTitle
Effective number of subjects and number of raters for inter-rater reliability studies.
pubmed:affiliation
Data Management and Biostatistics Department, Janssen Pharmaceutical K.K., Nishi-kanda 3-5-2, Tokyo 101-0065, Japan. ysaito2@janjp.jnj.com
pubmed:publicationType
Journal Article, Research Support, Non-U.S. Gov't