Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies

KNL Avery, PR Williamson, C Gamble, EOC Francischetto, C Metcalfe, P Davidson, H Williams, JM Blazeby, N Blencowe, C Bugge, M Campbell, M Collinson, C Cooper, J Darbyshire, M Dimairo, C Dore, S Eldridge, A Farrin, N Foster, S Gilbody & 10 others S Goodacre, L Hampson, AG Kolias, S Lamb, A Lane, L Maguire, J Norrie, R Pickering, GW Shorter, S Treweek

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

Objectives: Designing studies with an internal pilotphase may optimise the use of pilot work to informmore efficient randomised controlled trials (RCTs).Careful selection of preagreed decision or ‘progression’criteria at the juncture between the internal pilot andmain trial phases provides a valuable opportunity toevaluate the likely success of the main trial andoptimise its design or, if necessary, to make thedecision not to proceed with the main trial. Guidanceon the appropriate selection and application ofprogression criteria is, however, lacking. This paperoutlines the key issues to consider in the optimaldevelopment and review of operational progressioncriteria for RCTs with an internal pilot phase.Design: A structured literature review and explorationof stakeholders’ opinions at a Medical ResearchCouncil (MRC) Hubs for Trials Methodology Researchworkshop. Key stakeholders included triallists,methodologists, statisticians and funders.Results: There is considerable variation in the use ofprogression criteria for RCTs with an internal pilotphase, although 3 common issues predominate: trialrecruitment, protocol adherence and outcome data.Detailed and systematic reporting around the decisionmakingprocess for stopping, amending or proceedingto a main trial is uncommon, which may hamperunderstanding in the research community about theappropriate and optimal use of RCTs with an internalpilot phase. 10 top tips for the development, use andreporting of progression criteria for internal pilotstudies are presented.Conclusions: Systematic and transparent reporting ofthe design, results and evaluation of internal pilot trialsin the literature should be encouraged in order tofacilitate understanding in the research community andto inform future trials.
LanguageEnglish
Pagese013537
JournalBMJ Open
Volume7
Issue number2
DOIs
Publication statusAccepted/In press - 19 Jan 2017

Fingerprint

Randomized Controlled Trials
Research

Keywords

  • randomised control trials
  • randomized control trials
  • pilot studies
  • guidance

Cite this

Avery, KNL., Williamson, PR., Gamble, C., Francischetto, EOC., Metcalfe, C., Davidson, P., ... Treweek, S. (Accepted/In press). Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open, 7(2), e013537. https://doi.org/10.1136/bmjopen-2016-013537
Avery, KNL ; Williamson, PR ; Gamble, C ; Francischetto, EOC ; Metcalfe, C ; Davidson, P ; Williams, H ; Blazeby, JM ; Blencowe, N ; Bugge, C ; Campbell, M ; Collinson, M ; Cooper, C ; Darbyshire, J ; Dimairo, M ; Dore, C ; Eldridge, S ; Farrin, A ; Foster, N ; Gilbody, S ; Goodacre, S ; Hampson, L ; Kolias, AG ; Lamb, S ; Lane, A ; Maguire, L ; Norrie, J ; Pickering, R ; Shorter, GW ; Treweek, S. / Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies. In: BMJ Open. 2017 ; Vol. 7, No. 2. pp. e013537.
@article{783dbdf64cf449de8868fd832720f02e,
title = "Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies",
abstract = "Objectives: Designing studies with an internal pilotphase may optimise the use of pilot work to informmore efficient randomised controlled trials (RCTs).Careful selection of preagreed decision or ‘progression’criteria at the juncture between the internal pilot andmain trial phases provides a valuable opportunity toevaluate the likely success of the main trial andoptimise its design or, if necessary, to make thedecision not to proceed with the main trial. Guidanceon the appropriate selection and application ofprogression criteria is, however, lacking. This paperoutlines the key issues to consider in the optimaldevelopment and review of operational progressioncriteria for RCTs with an internal pilot phase.Design: A structured literature review and explorationof stakeholders’ opinions at a Medical ResearchCouncil (MRC) Hubs for Trials Methodology Researchworkshop. Key stakeholders included triallists,methodologists, statisticians and funders.Results: There is considerable variation in the use ofprogression criteria for RCTs with an internal pilotphase, although 3 common issues predominate: trialrecruitment, protocol adherence and outcome data.Detailed and systematic reporting around the decisionmakingprocess for stopping, amending or proceedingto a main trial is uncommon, which may hamperunderstanding in the research community about theappropriate and optimal use of RCTs with an internalpilot phase. 10 top tips for the development, use andreporting of progression criteria for internal pilotstudies are presented.Conclusions: Systematic and transparent reporting ofthe design, results and evaluation of internal pilot trialsin the literature should be encouraged in order tofacilitate understanding in the research community andto inform future trials.",
keywords = "randomised control trials, randomized control trials, pilot studies, guidance",
author = "KNL Avery and PR Williamson and C Gamble and EOC Francischetto and C Metcalfe and P Davidson and H Williams and JM Blazeby and N Blencowe and C Bugge and M Campbell and M Collinson and C Cooper and J Darbyshire and M Dimairo and C Dore and S Eldridge and A Farrin and N Foster and S Gilbody and S Goodacre and L Hampson and AG Kolias and S Lamb and A Lane and L Maguire and J Norrie and R Pickering and GW Shorter and S Treweek",
year = "2017",
month = "1",
day = "19",
doi = "10.1136/bmjopen-2016-013537",
language = "English",
volume = "7",
pages = "e013537",
journal = "BMJ Open",
issn = "2044-6055",
number = "2",

}

Avery, KNL, Williamson, PR, Gamble, C, Francischetto, EOC, Metcalfe, C, Davidson, P, Williams, H, Blazeby, JM, Blencowe, N, Bugge, C, Campbell, M, Collinson, M, Cooper, C, Darbyshire, J, Dimairo, M, Dore, C, Eldridge, S, Farrin, A, Foster, N, Gilbody, S, Goodacre, S, Hampson, L, Kolias, AG, Lamb, S, Lane, A, Maguire, L, Norrie, J, Pickering, R, Shorter, GW & Treweek, S 2017, 'Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies', BMJ Open, vol. 7, no. 2, pp. e013537. https://doi.org/10.1136/bmjopen-2016-013537

Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies. / Avery, KNL; Williamson, PR; Gamble, C; Francischetto, EOC; Metcalfe, C; Davidson, P; Williams, H; Blazeby, JM; Blencowe, N; Bugge, C; Campbell, M; Collinson, M; Cooper, C; Darbyshire, J; Dimairo, M; Dore, C; Eldridge, S; Farrin, A; Foster, N; Gilbody, S; Goodacre, S; Hampson, L; Kolias, AG; Lamb, S; Lane, A; Maguire, L; Norrie, J; Pickering, R; Shorter, GW; Treweek, S.

In: BMJ Open, Vol. 7, No. 2, 19.01.2017, p. e013537.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Informing efficient randomised controlled trials: Exploration of challenges in developing progression criteria for internal pilot studies

AU - Avery, KNL

AU - Williamson, PR

AU - Gamble, C

AU - Francischetto, EOC

AU - Metcalfe, C

AU - Davidson, P

AU - Williams, H

AU - Blazeby, JM

AU - Blencowe, N

AU - Bugge, C

AU - Campbell, M

AU - Collinson, M

AU - Cooper, C

AU - Darbyshire, J

AU - Dimairo, M

AU - Dore, C

AU - Eldridge, S

AU - Farrin, A

AU - Foster, N

AU - Gilbody, S

AU - Goodacre, S

AU - Hampson, L

AU - Kolias, AG

AU - Lamb, S

AU - Lane, A

AU - Maguire, L

AU - Norrie, J

AU - Pickering, R

AU - Shorter, GW

AU - Treweek, S

PY - 2017/1/19

Y1 - 2017/1/19

N2 - Objectives: Designing studies with an internal pilotphase may optimise the use of pilot work to informmore efficient randomised controlled trials (RCTs).Careful selection of preagreed decision or ‘progression’criteria at the juncture between the internal pilot andmain trial phases provides a valuable opportunity toevaluate the likely success of the main trial andoptimise its design or, if necessary, to make thedecision not to proceed with the main trial. Guidanceon the appropriate selection and application ofprogression criteria is, however, lacking. This paperoutlines the key issues to consider in the optimaldevelopment and review of operational progressioncriteria for RCTs with an internal pilot phase.Design: A structured literature review and explorationof stakeholders’ opinions at a Medical ResearchCouncil (MRC) Hubs for Trials Methodology Researchworkshop. Key stakeholders included triallists,methodologists, statisticians and funders.Results: There is considerable variation in the use ofprogression criteria for RCTs with an internal pilotphase, although 3 common issues predominate: trialrecruitment, protocol adherence and outcome data.Detailed and systematic reporting around the decisionmakingprocess for stopping, amending or proceedingto a main trial is uncommon, which may hamperunderstanding in the research community about theappropriate and optimal use of RCTs with an internalpilot phase. 10 top tips for the development, use andreporting of progression criteria for internal pilotstudies are presented.Conclusions: Systematic and transparent reporting ofthe design, results and evaluation of internal pilot trialsin the literature should be encouraged in order tofacilitate understanding in the research community andto inform future trials.

AB - Objectives: Designing studies with an internal pilotphase may optimise the use of pilot work to informmore efficient randomised controlled trials (RCTs).Careful selection of preagreed decision or ‘progression’criteria at the juncture between the internal pilot andmain trial phases provides a valuable opportunity toevaluate the likely success of the main trial andoptimise its design or, if necessary, to make thedecision not to proceed with the main trial. Guidanceon the appropriate selection and application ofprogression criteria is, however, lacking. This paperoutlines the key issues to consider in the optimaldevelopment and review of operational progressioncriteria for RCTs with an internal pilot phase.Design: A structured literature review and explorationof stakeholders’ opinions at a Medical ResearchCouncil (MRC) Hubs for Trials Methodology Researchworkshop. Key stakeholders included triallists,methodologists, statisticians and funders.Results: There is considerable variation in the use ofprogression criteria for RCTs with an internal pilotphase, although 3 common issues predominate: trialrecruitment, protocol adherence and outcome data.Detailed and systematic reporting around the decisionmakingprocess for stopping, amending or proceedingto a main trial is uncommon, which may hamperunderstanding in the research community about theappropriate and optimal use of RCTs with an internalpilot phase. 10 top tips for the development, use andreporting of progression criteria for internal pilotstudies are presented.Conclusions: Systematic and transparent reporting ofthe design, results and evaluation of internal pilot trialsin the literature should be encouraged in order tofacilitate understanding in the research community andto inform future trials.

KW - randomised control trials

KW - randomized control trials

KW - pilot studies

KW - guidance

U2 - 10.1136/bmjopen-2016-013537

DO - 10.1136/bmjopen-2016-013537

M3 - Article

VL - 7

SP - e013537

JO - BMJ Open

T2 - BMJ Open

JF - BMJ Open

SN - 2044-6055

IS - 2

ER -