Grading gems: appraising the quality of research for social work and social care

Brian Taylor, Martin Dempster, Michael Donnelly

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

The impetus towards basing practice and policy decisions more explicitly on sound research requires tools to facilitate the systematic appraisal of the quality of research encompassing a diverse range of methods and designs. Five exemplar tools were developed and assessed in terms of their usefulness in selecting studies for inclusion in a systematic review. The widely used ‘hierarchy of evidence’ was adapted and used to appraise internal validity. Four tools were then developed to appraise the external validity dimensions of generalisability (two scales) and methods of data collection (two scales). Methods of combining the scores generated by each tool were explored. Qualitative and quantitative studies were appraised not separated into two spheres but by using complementary tools developed to appraise different aspects of rigour.
There was a high level of agreement between researchers in applying the tools to 22 studies on decision-making by professionals about the long-term care of older people. The scales for internal validity and generalisability discriminated between the qualities of studies appropriately. The two tools to appraise data collection gave diverse results. Excluding studies that scored in the lowest category on any scale appeared to be the scoring system that was most justifiable. This approach is presented to stimulate debate about the practical application of the evidence-based initiative to social work and social care. This study may assist in developing clearer definitions and common language about appraising rigour that should further the process of selecting robust research for synthesis to inform practice and policy decisions.
LanguageEnglish
Pages335-354
Number of pages20
JournalBritish Journal of Social Work
Volume37
Issue number2
Publication statusPublished - 31 Mar 2007

Fingerprint

grading
Social Work
social work
Research
Long-Term Care
Decision Making
Language
Research Personnel
evidence
inclusion
decision making
language

Keywords

  • Appraisal of research, systematic review, evidence based practice.

Cite this

Taylor, Brian ; Dempster, Martin ; Donnelly, Michael. / Grading gems: appraising the quality of research for social work and social care. In: British Journal of Social Work. 2007 ; Vol. 37, No. 2. pp. 335-354.
@article{67c985ccc3f1483cb55ccd2b8e1210c3,
title = "Grading gems: appraising the quality of research for social work and social care",
abstract = "The impetus towards basing practice and policy decisions more explicitly on sound research requires tools to facilitate the systematic appraisal of the quality of research encompassing a diverse range of methods and designs. Five exemplar tools were developed and assessed in terms of their usefulness in selecting studies for inclusion in a systematic review. The widely used ‘hierarchy of evidence’ was adapted and used to appraise internal validity. Four tools were then developed to appraise the external validity dimensions of generalisability (two scales) and methods of data collection (two scales). Methods of combining the scores generated by each tool were explored. Qualitative and quantitative studies were appraised not separated into two spheres but by using complementary tools developed to appraise different aspects of rigour.There was a high level of agreement between researchers in applying the tools to 22 studies on decision-making by professionals about the long-term care of older people. The scales for internal validity and generalisability discriminated between the qualities of studies appropriately. The two tools to appraise data collection gave diverse results. Excluding studies that scored in the lowest category on any scale appeared to be the scoring system that was most justifiable. This approach is presented to stimulate debate about the practical application of the evidence-based initiative to social work and social care. This study may assist in developing clearer definitions and common language about appraising rigour that should further the process of selecting robust research for synthesis to inform practice and policy decisions.",
keywords = "Appraisal of research, systematic review, evidence based practice.",
author = "Brian Taylor and Martin Dempster and Michael Donnelly",
year = "2007",
month = "3",
day = "31",
language = "English",
volume = "37",
pages = "335--354",
journal = "British Journal of Social Work",
issn = "0045-3102",
number = "2",

}

Grading gems: appraising the quality of research for social work and social care. / Taylor, Brian; Dempster, Martin; Donnelly, Michael.

In: British Journal of Social Work, Vol. 37, No. 2, 31.03.2007, p. 335-354.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Grading gems: appraising the quality of research for social work and social care

AU - Taylor, Brian

AU - Dempster, Martin

AU - Donnelly, Michael

PY - 2007/3/31

Y1 - 2007/3/31

N2 - The impetus towards basing practice and policy decisions more explicitly on sound research requires tools to facilitate the systematic appraisal of the quality of research encompassing a diverse range of methods and designs. Five exemplar tools were developed and assessed in terms of their usefulness in selecting studies for inclusion in a systematic review. The widely used ‘hierarchy of evidence’ was adapted and used to appraise internal validity. Four tools were then developed to appraise the external validity dimensions of generalisability (two scales) and methods of data collection (two scales). Methods of combining the scores generated by each tool were explored. Qualitative and quantitative studies were appraised not separated into two spheres but by using complementary tools developed to appraise different aspects of rigour.There was a high level of agreement between researchers in applying the tools to 22 studies on decision-making by professionals about the long-term care of older people. The scales for internal validity and generalisability discriminated between the qualities of studies appropriately. The two tools to appraise data collection gave diverse results. Excluding studies that scored in the lowest category on any scale appeared to be the scoring system that was most justifiable. This approach is presented to stimulate debate about the practical application of the evidence-based initiative to social work and social care. This study may assist in developing clearer definitions and common language about appraising rigour that should further the process of selecting robust research for synthesis to inform practice and policy decisions.

AB - The impetus towards basing practice and policy decisions more explicitly on sound research requires tools to facilitate the systematic appraisal of the quality of research encompassing a diverse range of methods and designs. Five exemplar tools were developed and assessed in terms of their usefulness in selecting studies for inclusion in a systematic review. The widely used ‘hierarchy of evidence’ was adapted and used to appraise internal validity. Four tools were then developed to appraise the external validity dimensions of generalisability (two scales) and methods of data collection (two scales). Methods of combining the scores generated by each tool were explored. Qualitative and quantitative studies were appraised not separated into two spheres but by using complementary tools developed to appraise different aspects of rigour.There was a high level of agreement between researchers in applying the tools to 22 studies on decision-making by professionals about the long-term care of older people. The scales for internal validity and generalisability discriminated between the qualities of studies appropriately. The two tools to appraise data collection gave diverse results. Excluding studies that scored in the lowest category on any scale appeared to be the scoring system that was most justifiable. This approach is presented to stimulate debate about the practical application of the evidence-based initiative to social work and social care. This study may assist in developing clearer definitions and common language about appraising rigour that should further the process of selecting robust research for synthesis to inform practice and policy decisions.

KW - Appraisal of research, systematic review, evidence based practice.

M3 - Article

VL - 37

SP - 335

EP - 354

JO - British Journal of Social Work

T2 - British Journal of Social Work

JF - British Journal of Social Work

SN - 0045-3102

IS - 2

ER -