Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study

RM Warren, D Thompson, LJ Pointon, [Unknown] MARIBS Study Group, John Winder

    Research output: Contribution to journalArticle

    24 Citations (Scopus)

    Abstract

    Purpose: To evaluate prospectively the accuracy of a lesion classification system designed for use in a magnetic resonance (MR) imaging high-breast-cancer-risk screening study. Materials and Methods: All participating patients provided written informed consent. Ethics committee approval was obtained. The results of 1541 contrast material–enhanced breast MR imaging examinations were analyzed; 1441 screening examinations were performed in 638 women aged 24–51 years at high risk for breast cancer, and 100 examinations were performed in 100 women aged 23–81 years. Lesion analysis was performed in 991 breasts, which were divided into design (491 breasts) and testing (500 breasts) sets. The reference standard was histologic analysis of biopsy samples, fine-needle aspiration cytology, or minimal follow-up of 24 months. The scoring system involved the use of five features: morphology (MOR), pattern of enhancement (POE), percentage of maximal focal enhancement (PMFE), maximal signal intensity–time ratio (MITR), and pattern of contrast material washout (POCW). The system was evaluated by means of (a) assessment of interreader agreement, as expressed in κ statistics, for 315 breasts in which both readers analyzed the same lesion, (b) assessment of the diagnostic accuracy of the scored components with receiver operating characteristic curve analysis, and (c) logistic regression analysis to determine which components of the scoring system were critical to the final score. A new simplified scoring system developed with the design set was applied to the testing set. Results: There was moderate reader agreement regarding overall lesion outcome (ie, malignant, suspicious, or benign) (κ = 0.58) and less agreement regarding the scored components. The area under the receiver operating characteristic curve (AUC) for the overall lesion score, 0.88, was higher than the AUC for any one component. The components MOR, POE, and POCW yielded the best overall result. PMFE and MITR did not contribute to diagnostic utility. Applying a simplified scoring system to the testing set yielded a nonsignificantly (P = .2) higher AUC than did applying the original scoring system (sensitivity, 84%; specificity, 86.0%). Conclusion: Good diagnostic accuracy can be achieved by using simple qualitative descriptors of lesion enhancement, including POCW. In the context of screening, quantitative enhancement parameters appear to be less useful for lesion characterization.
    LanguageEnglish
    Pages677-685
    JournalRadiology
    Volume239
    Issue number3
    DOIs
    Publication statusPublished - Jun 2006

    Fingerprint

    Breast
    Contrast Media
    Magnetic Resonance Imaging
    Area Under Curve
    ROC Curve
    Breast Neoplasms
    Ethics Committees
    Fine Needle Biopsy
    Informed Consent
    Early Detection of Cancer
    Cell Biology
    Logistic Models
    Regression Analysis

    Keywords

    • MRI
    • breast scoring

    Cite this

    Warren, RM., Thompson, D., Pointon, LJ., MARIBS Study Group, U., & Winder, J. (2006). Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study. Radiology, 239(3), 677-685. https://doi.org/10.1148/radiol.2393042007
    Warren, RM ; Thompson, D ; Pointon, LJ ; MARIBS Study Group, [Unknown] ; Winder, John. / Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study. In: Radiology. 2006 ; Vol. 239, No. 3. pp. 677-685.
    @article{06b592b5ede045f2837a209429847b33,
    title = "Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study",
    abstract = "Purpose: To evaluate prospectively the accuracy of a lesion classification system designed for use in a magnetic resonance (MR) imaging high-breast-cancer-risk screening study. Materials and Methods: All participating patients provided written informed consent. Ethics committee approval was obtained. The results of 1541 contrast material–enhanced breast MR imaging examinations were analyzed; 1441 screening examinations were performed in 638 women aged 24–51 years at high risk for breast cancer, and 100 examinations were performed in 100 women aged 23–81 years. Lesion analysis was performed in 991 breasts, which were divided into design (491 breasts) and testing (500 breasts) sets. The reference standard was histologic analysis of biopsy samples, fine-needle aspiration cytology, or minimal follow-up of 24 months. The scoring system involved the use of five features: morphology (MOR), pattern of enhancement (POE), percentage of maximal focal enhancement (PMFE), maximal signal intensity–time ratio (MITR), and pattern of contrast material washout (POCW). The system was evaluated by means of (a) assessment of interreader agreement, as expressed in κ statistics, for 315 breasts in which both readers analyzed the same lesion, (b) assessment of the diagnostic accuracy of the scored components with receiver operating characteristic curve analysis, and (c) logistic regression analysis to determine which components of the scoring system were critical to the final score. A new simplified scoring system developed with the design set was applied to the testing set. Results: There was moderate reader agreement regarding overall lesion outcome (ie, malignant, suspicious, or benign) (κ = 0.58) and less agreement regarding the scored components. The area under the receiver operating characteristic curve (AUC) for the overall lesion score, 0.88, was higher than the AUC for any one component. The components MOR, POE, and POCW yielded the best overall result. PMFE and MITR did not contribute to diagnostic utility. Applying a simplified scoring system to the testing set yielded a nonsignificantly (P = .2) higher AUC than did applying the original scoring system (sensitivity, 84{\%}; specificity, 86.0{\%}). Conclusion: Good diagnostic accuracy can be achieved by using simple qualitative descriptors of lesion enhancement, including POCW. In the context of screening, quantitative enhancement parameters appear to be less useful for lesion characterization.",
    keywords = "MRI, breast scoring",
    author = "RM Warren and D Thompson and LJ Pointon and {MARIBS Study Group}, [Unknown] and John Winder",
    year = "2006",
    month = "6",
    doi = "10.1148/radiol.2393042007",
    language = "English",
    volume = "239",
    pages = "677--685",
    journal = "Radiology",
    issn = "0033-8419",
    number = "3",

    }

    Warren, RM, Thompson, D, Pointon, LJ, MARIBS Study Group, U & Winder, J 2006, 'Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study', Radiology, vol. 239, no. 3, pp. 677-685. https://doi.org/10.1148/radiol.2393042007

    Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study. / Warren, RM; Thompson, D; Pointon, LJ; MARIBS Study Group, [Unknown]; Winder, John.

    In: Radiology, Vol. 239, No. 3, 06.2006, p. 677-685.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Evaluation of a prospective scoring system designed for a multicentre breast MR imaging screening study

    AU - Warren, RM

    AU - Thompson, D

    AU - Pointon, LJ

    AU - MARIBS Study Group, [Unknown]

    AU - Winder, John

    PY - 2006/6

    Y1 - 2006/6

    N2 - Purpose: To evaluate prospectively the accuracy of a lesion classification system designed for use in a magnetic resonance (MR) imaging high-breast-cancer-risk screening study. Materials and Methods: All participating patients provided written informed consent. Ethics committee approval was obtained. The results of 1541 contrast material–enhanced breast MR imaging examinations were analyzed; 1441 screening examinations were performed in 638 women aged 24–51 years at high risk for breast cancer, and 100 examinations were performed in 100 women aged 23–81 years. Lesion analysis was performed in 991 breasts, which were divided into design (491 breasts) and testing (500 breasts) sets. The reference standard was histologic analysis of biopsy samples, fine-needle aspiration cytology, or minimal follow-up of 24 months. The scoring system involved the use of five features: morphology (MOR), pattern of enhancement (POE), percentage of maximal focal enhancement (PMFE), maximal signal intensity–time ratio (MITR), and pattern of contrast material washout (POCW). The system was evaluated by means of (a) assessment of interreader agreement, as expressed in κ statistics, for 315 breasts in which both readers analyzed the same lesion, (b) assessment of the diagnostic accuracy of the scored components with receiver operating characteristic curve analysis, and (c) logistic regression analysis to determine which components of the scoring system were critical to the final score. A new simplified scoring system developed with the design set was applied to the testing set. Results: There was moderate reader agreement regarding overall lesion outcome (ie, malignant, suspicious, or benign) (κ = 0.58) and less agreement regarding the scored components. The area under the receiver operating characteristic curve (AUC) for the overall lesion score, 0.88, was higher than the AUC for any one component. The components MOR, POE, and POCW yielded the best overall result. PMFE and MITR did not contribute to diagnostic utility. Applying a simplified scoring system to the testing set yielded a nonsignificantly (P = .2) higher AUC than did applying the original scoring system (sensitivity, 84%; specificity, 86.0%). Conclusion: Good diagnostic accuracy can be achieved by using simple qualitative descriptors of lesion enhancement, including POCW. In the context of screening, quantitative enhancement parameters appear to be less useful for lesion characterization.

    AB - Purpose: To evaluate prospectively the accuracy of a lesion classification system designed for use in a magnetic resonance (MR) imaging high-breast-cancer-risk screening study. Materials and Methods: All participating patients provided written informed consent. Ethics committee approval was obtained. The results of 1541 contrast material–enhanced breast MR imaging examinations were analyzed; 1441 screening examinations were performed in 638 women aged 24–51 years at high risk for breast cancer, and 100 examinations were performed in 100 women aged 23–81 years. Lesion analysis was performed in 991 breasts, which were divided into design (491 breasts) and testing (500 breasts) sets. The reference standard was histologic analysis of biopsy samples, fine-needle aspiration cytology, or minimal follow-up of 24 months. The scoring system involved the use of five features: morphology (MOR), pattern of enhancement (POE), percentage of maximal focal enhancement (PMFE), maximal signal intensity–time ratio (MITR), and pattern of contrast material washout (POCW). The system was evaluated by means of (a) assessment of interreader agreement, as expressed in κ statistics, for 315 breasts in which both readers analyzed the same lesion, (b) assessment of the diagnostic accuracy of the scored components with receiver operating characteristic curve analysis, and (c) logistic regression analysis to determine which components of the scoring system were critical to the final score. A new simplified scoring system developed with the design set was applied to the testing set. Results: There was moderate reader agreement regarding overall lesion outcome (ie, malignant, suspicious, or benign) (κ = 0.58) and less agreement regarding the scored components. The area under the receiver operating characteristic curve (AUC) for the overall lesion score, 0.88, was higher than the AUC for any one component. The components MOR, POE, and POCW yielded the best overall result. PMFE and MITR did not contribute to diagnostic utility. Applying a simplified scoring system to the testing set yielded a nonsignificantly (P = .2) higher AUC than did applying the original scoring system (sensitivity, 84%; specificity, 86.0%). Conclusion: Good diagnostic accuracy can be achieved by using simple qualitative descriptors of lesion enhancement, including POCW. In the context of screening, quantitative enhancement parameters appear to be less useful for lesion characterization.

    KW - MRI

    KW - breast scoring

    U2 - 10.1148/radiol.2393042007

    DO - 10.1148/radiol.2393042007

    M3 - Article

    VL - 239

    SP - 677

    EP - 685

    JO - Radiology

    T2 - Radiology

    JF - Radiology

    SN - 0033-8419

    IS - 3

    ER -