Sampling behaviour of kappa and weighted kappa in the null case

Gordon Rae

    Research output: Contribution to journalArticle

    Abstract

    Kappa and weighted kappa are widely used statistics for measuring inter-rater agreement. New formulas for their asymptotic standard errors are proposed under the condition that their population values are zero, and their behaviours compared to that of previous formulas used to test the null hypothesis that these population measures are zero. The results indicate that critical ratios based on the new formulas provide better control of Type I errors. The implications of these findings for the prediction analysis of cross-classification are also considered.
    LanguageEnglish
    Pages1-7
    JournalBRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY
    Volume50
    Issue numberPart 1
    Publication statusPublished - May 1997

    Fingerprint

    Null
    Type I error
    Zero
    Standard error
    Null hypothesis
    Statistics
    Prediction

    Cite this

    @article{b2008f66a048406a846292b62253db6e,
    title = "Sampling behaviour of kappa and weighted kappa in the null case",
    abstract = "Kappa and weighted kappa are widely used statistics for measuring inter-rater agreement. New formulas for their asymptotic standard errors are proposed under the condition that their population values are zero, and their behaviours compared to that of previous formulas used to test the null hypothesis that these population measures are zero. The results indicate that critical ratios based on the new formulas provide better control of Type I errors. The implications of these findings for the prediction analysis of cross-classification are also considered.",
    author = "Gordon Rae",
    year = "1997",
    month = "5",
    language = "English",
    volume = "50",
    pages = "1--7",
    journal = "British Journal of Mathematical and Statistical Psychology",
    issn = "0007-1102",
    number = "Part 1",

    }

    Sampling behaviour of kappa and weighted kappa in the null case. / Rae, Gordon.

    In: BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, Vol. 50, No. Part 1, 05.1997, p. 1-7.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Sampling behaviour of kappa and weighted kappa in the null case

    AU - Rae, Gordon

    PY - 1997/5

    Y1 - 1997/5

    N2 - Kappa and weighted kappa are widely used statistics for measuring inter-rater agreement. New formulas for their asymptotic standard errors are proposed under the condition that their population values are zero, and their behaviours compared to that of previous formulas used to test the null hypothesis that these population measures are zero. The results indicate that critical ratios based on the new formulas provide better control of Type I errors. The implications of these findings for the prediction analysis of cross-classification are also considered.

    AB - Kappa and weighted kappa are widely used statistics for measuring inter-rater agreement. New formulas for their asymptotic standard errors are proposed under the condition that their population values are zero, and their behaviours compared to that of previous formulas used to test the null hypothesis that these population measures are zero. The results indicate that critical ratios based on the new formulas provide better control of Type I errors. The implications of these findings for the prediction analysis of cross-classification are also considered.

    M3 - Article

    VL - 50

    SP - 1

    EP - 7

    JO - British Journal of Mathematical and Statistical Psychology

    T2 - British Journal of Mathematical and Statistical Psychology

    JF - British Journal of Mathematical and Statistical Psychology

    SN - 0007-1102

    IS - Part 1

    ER -