Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

Chrianna Bharat; Meyer D. Glantz; Sergio Aguilar‐gaxiola; Jordi Alonso; Ronny Bruffaerts; Brendan Bunting; José Miguel Caldas‐de‐almeida; Graça Cardoso; Stephanie Chardoul; Peter De Jonge; Oye Gureje; Josep Maria Haro; Meredith G. Harris; Elie G. Karam; Norito Kawakami; Andrzej Kiejna; Viviane Kovess‐masfety; Sing Lee; John J. Mcgrath; Jacek Moskalewicz; Fernando Navarro‐mateu; Charlene Rapsey; Nancy A. Sampson; Kate M. Scott; Hisateru Tachimori; Margreet Ten Have; Gemma Vilagut; Bogdan Wojtyniak; Miguel Xavier; Ronald C. Kessler; Louisa Degenhardt

doi:10.1111/add.16122

Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

Chrianna Bharat
, Meyer D. Glantz
, Sergio Aguilar‐gaxiola
, Jordi Alonso
, Ronny Bruffaerts
, Brendan Bunting
, José Miguel Caldas‐de‐almeida
, Graça Cardoso
, Stephanie Chardoul
, Peter De Jonge
, Oye Gureje
, Josep Maria Haro
, Meredith G. Harris
, Elie G. Karam
, Norito Kawakami
, Andrzej Kiejna
, Viviane Kovess‐masfety
, Sing Lee
, John J. Mcgrath
, Jacek Moskalewicz

Fernando Navarro‐mateu, Charlene Rapsey, Nancy A. Sampson, Kate M. Scott, Hisateru Tachimori, Margreet Ten Have, Gemma Vilagut, Bogdan Wojtyniak, Miguel Xavier, Ronald C. Kessler, Louisa Degenhardt

Research output: Contribution to journal › Article › peer-review

10 Citations (Scopus)

97 Downloads (Pure)

Abstract

Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost‐effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM‐IV AD onset by age 25 years using an ensemble machine‐learning algorithm known as ‘Super Learner’. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life‐time DSM‐IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision‐recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20% of people with highest risk would identify 49% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.

Original language	English
Pages (from-to)	954-966
Number of pages	13
Journal	Addiction
Volume	118
Issue number	5
Early online date	7 Jan 2023
DOIs	https://doi.org/10.1111/add.16122
Publication status	Published (in print/issue) - 31 May 2023

Bibliographical note

Funding Information:
In the past 3 years, L.D. has received investigator‐initiated untied educational grants for studies of opioid medications in Australia from Indivior, Mundipharma and Seqirus. M.G.H. reports consulting fees from RAND Corporation outside the submitted work. N.K. reports grants and consulting fees outside the submitted work. He received grants from Fujitsu Japan, Ltd and SBAtWork Corporation and consulting fees from Occupational Health Foundation, Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center and Osaka Chamber of Commerce and Industry. R.C.K. and N.A.S. report research grants from National Institute of Mental Health, USA (Grants: R01 MH070884; U01 MH60220); John D. and Catherine T. MacArthur Foundation; Pfizer Foundation; US Public Health Service (Grants: R13‐MH066849, R01‐MH069864 and R01 DA016558); Fogarty International Center (Grant: R03‐TW006481); Pan American Health Organization; Eli Lilly and Company; Ortho‐McNeil Pharmaceutical; GlaxoSmithKline; Bristol‐Myers Squibb; National Institute of Drug Abuse; Substance Abuse and Mental Health Services Administration, USA; Robert Wood Johnson Foundation (Grant 044708); and John W. Alden Trust. In the past 3 years, R.C.K. was a consultant for Datastat, Inc., Holmusk, RallyPoint Networks, Inc. and Sage Therapeutics. He has stock options in Mirah, PYM and Roga Sciences. H.T. reports research grants from the Ministry of Health, Labour and Welfare, Japan. All other authors report no conflicts of interest.

Publisher Copyright:
© 2023 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Funding

Funding Information: In the past 3 years, L.D. has received investigator‐initiated untied educational grants for studies of opioid medications in Australia from Indivior, Mundipharma and Seqirus. M.G.H. reports consulting fees from RAND Corporation outside the submitted work. N.K. reports grants and consulting fees outside the submitted work. He received grants from Fujitsu Japan, Ltd and SBAtWork Corporation and consulting fees from Occupational Health Foundation, Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center and Osaka Chamber of Commerce and Industry. R.C.K. and N.A.S. report research grants from National Institute of Mental Health, USA (Grants: R01 MH070884; U01 MH60220); John D. and Catherine T. MacArthur Foundation; Pfizer Foundation; US Public Health Service (Grants: R13‐MH066849, R01‐MH069864 and R01 DA016558); Fogarty International Center (Grant: R03‐TW006481); Pan American Health Organization; Eli Lilly and Company; Ortho‐McNeil Pharmaceutical; GlaxoSmithKline; Bristol‐Myers Squibb; National Institute of Drug Abuse; Substance Abuse and Mental Health Services Administration, USA; Robert Wood Johnson Foundation (Grant 044708); and John W. Alden Trust. In the past 3 years, R.C.K. was a consultant for Datastat, Inc., Holmusk, RallyPoint Networks, Inc. and Sage Therapeutics. He has stock options in Mirah, PYM and Roga Sciences. H.T. reports research grants from the Ministry of Health, Labour and Welfare, Japan. All other authors report no conflicts of interest. Publisher Copyright: © 2023 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

alcohol dependence
childhood
predictive modelling
machine learning
Adolescence
alcohol use
dependence
discrimination
METHODS AND TECHNIQUES
calibration

Access to Document

10.1111/add.16122Licence: CC BY

Final Publishes VersionFinal published version, 1.3 MBLicence: CC BY

Cite this

Bharat, C., Glantz, M. D., Aguilar‐gaxiola, S., Alonso, J., Bruffaerts, R., Bunting, B., Caldas‐de‐almeida, J. M., Cardoso, G., Chardoul, S., De Jonge, P., Gureje, O., Haro, J. M., Harris, M. G., Karam, E. G., Kawakami, N., Kiejna, A., Kovess‐masfety, V., Lee, S., Mcgrath, J. J., ... Degenhardt, L. (2023). Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use. Addiction, 118(5), 954-966. https://doi.org/10.1111/add.16122

@article{9a43a36c9aa34def9b4502824b918172,

title = "Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use",

abstract = "Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost‐effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM‐IV AD onset by age 25 years using an ensemble machine‐learning algorithm known as {\textquoteleft}Super Learner{\textquoteright}. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life‐time DSM‐IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1\% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95\% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision‐recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05\%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20\% of people with highest risk would identify 49\% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.",

keywords = "alcohol dependence, childhood, predictive modelling, machine learning, Adolescence, alcohol use, dependence, discrimination, METHODS AND TECHNIQUES, calibration",

author = "Chrianna Bharat and Glantz, \{Meyer D.\} and Sergio Aguilar‐gaxiola and Jordi Alonso and Ronny Bruffaerts and Brendan Bunting and Caldas‐de‐almeida, \{Jos{\'e} Miguel\} and Gra{\c c}a Cardoso and Stephanie Chardoul and \{De Jonge\}, Peter and Oye Gureje and Haro, \{Josep Maria\} and Harris, \{Meredith G.\} and Karam, \{Elie G.\} and Norito Kawakami and Andrzej Kiejna and Viviane Kovess‐masfety and Sing Lee and Mcgrath, \{John J.\} and Jacek Moskalewicz and Fernando Navarro‐mateu and Charlene Rapsey and Sampson, \{Nancy A.\} and Scott, \{Kate M.\} and Hisateru Tachimori and \{Ten Have\}, Margreet and Gemma Vilagut and Bogdan Wojtyniak and Miguel Xavier and Kessler, \{Ronald C.\} and Louisa Degenhardt",

note = "Funding Information: In the past 3 years, L.D. has received investigator‐initiated untied educational grants for studies of opioid medications in Australia from Indivior, Mundipharma and Seqirus. M.G.H. reports consulting fees from RAND Corporation outside the submitted work. N.K. reports grants and consulting fees outside the submitted work. He received grants from Fujitsu Japan, Ltd and SBAtWork Corporation and consulting fees from Occupational Health Foundation, Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center and Osaka Chamber of Commerce and Industry. R.C.K. and N.A.S. report research grants from National Institute of Mental Health, USA (Grants: R01 MH070884; U01 MH60220); John D. and Catherine T. MacArthur Foundation; Pfizer Foundation; US Public Health Service (Grants: R13‐MH066849, R01‐MH069864 and R01 DA016558); Fogarty International Center (Grant: R03‐TW006481); Pan American Health Organization; Eli Lilly and Company; Ortho‐McNeil Pharmaceutical; GlaxoSmithKline; Bristol‐Myers Squibb; National Institute of Drug Abuse; Substance Abuse and Mental Health Services Administration, USA; Robert Wood Johnson Foundation (Grant 044708); and John W. Alden Trust. In the past 3 years, R.C.K. was a consultant for Datastat, Inc., Holmusk, RallyPoint Networks, Inc. and Sage Therapeutics. He has stock options in Mirah, PYM and Roga Sciences. H.T. reports research grants from the Ministry of Health, Labour and Welfare, Japan. All other authors report no conflicts of interest. Publisher Copyright: {\textcopyright} 2023 The Authors. Addiction published by John Wiley \& Sons Ltd on behalf of Society for the Study of Addiction.",

year = "2023",

month = may,

day = "31",

doi = "10.1111/add.16122",

language = "English",

volume = "118",

pages = "954--966",

journal = "Addiction",

issn = "0965-2140",

publisher = "Wiley-Blackwell Publishing Ltd",

number = "5",

}

Bharat, C, Glantz, MD, Aguilar‐gaxiola, S, Alonso, J, Bruffaerts, R, Bunting, B, Caldas‐de‐almeida, JM, Cardoso, G, Chardoul, S, De Jonge, P, Gureje, O, Haro, JM, Harris, MG, Karam, EG, Kawakami, N, Kiejna, A, Kovess‐masfety, V, Lee, S, Mcgrath, JJ, Moskalewicz, J, Navarro‐mateu, F, Rapsey, C, Sampson, NA, Scott, KM, Tachimori, H, Ten Have, M, Vilagut, G, Wojtyniak, B, Xavier, M, Kessler, RC & Degenhardt, L 2023, 'Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use', Addiction, vol. 118, no. 5, pp. 954-966. https://doi.org/10.1111/add.16122

TY - JOUR

T1 - Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

AU - Bharat, Chrianna

AU - Glantz, Meyer D.

AU - Aguilar‐gaxiola, Sergio

AU - Alonso, Jordi

AU - Bruffaerts, Ronny

AU - Bunting, Brendan

AU - Caldas‐de‐almeida, José Miguel

AU - Cardoso, Graça

AU - Chardoul, Stephanie

AU - De Jonge, Peter

AU - Gureje, Oye

AU - Haro, Josep Maria

AU - Harris, Meredith G.

AU - Karam, Elie G.

AU - Kawakami, Norito

AU - Kiejna, Andrzej

AU - Kovess‐masfety, Viviane

AU - Lee, Sing

AU - Mcgrath, John J.

AU - Moskalewicz, Jacek

AU - Navarro‐mateu, Fernando

AU - Rapsey, Charlene

AU - Sampson, Nancy A.

AU - Scott, Kate M.

AU - Tachimori, Hisateru

AU - Ten Have, Margreet

AU - Vilagut, Gemma

AU - Wojtyniak, Bogdan

AU - Xavier, Miguel

AU - Kessler, Ronald C.

AU - Degenhardt, Louisa

N1 - Funding Information: In the past 3 years, L.D. has received investigator‐initiated untied educational grants for studies of opioid medications in Australia from Indivior, Mundipharma and Seqirus. M.G.H. reports consulting fees from RAND Corporation outside the submitted work. N.K. reports grants and consulting fees outside the submitted work. He received grants from Fujitsu Japan, Ltd and SBAtWork Corporation and consulting fees from Occupational Health Foundation, Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center and Osaka Chamber of Commerce and Industry. R.C.K. and N.A.S. report research grants from National Institute of Mental Health, USA (Grants: R01 MH070884; U01 MH60220); John D. and Catherine T. MacArthur Foundation; Pfizer Foundation; US Public Health Service (Grants: R13‐MH066849, R01‐MH069864 and R01 DA016558); Fogarty International Center (Grant: R03‐TW006481); Pan American Health Organization; Eli Lilly and Company; Ortho‐McNeil Pharmaceutical; GlaxoSmithKline; Bristol‐Myers Squibb; National Institute of Drug Abuse; Substance Abuse and Mental Health Services Administration, USA; Robert Wood Johnson Foundation (Grant 044708); and John W. Alden Trust. In the past 3 years, R.C.K. was a consultant for Datastat, Inc., Holmusk, RallyPoint Networks, Inc. and Sage Therapeutics. He has stock options in Mirah, PYM and Roga Sciences. H.T. reports research grants from the Ministry of Health, Labour and Welfare, Japan. All other authors report no conflicts of interest. Publisher Copyright: © 2023 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

PY - 2023/5/31

Y1 - 2023/5/31

N2 - Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost‐effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM‐IV AD onset by age 25 years using an ensemble machine‐learning algorithm known as ‘Super Learner’. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life‐time DSM‐IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision‐recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20% of people with highest risk would identify 49% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.

AB - Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost‐effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM‐IV AD onset by age 25 years using an ensemble machine‐learning algorithm known as ‘Super Learner’. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life‐time DSM‐IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision‐recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20% of people with highest risk would identify 49% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.

KW - alcohol dependence

KW - childhood

KW - predictive modelling

KW - machine learning

KW - Adolescence

KW - alcohol use

KW - dependence

KW - discrimination

KW - METHODS AND TECHNIQUES

KW - calibration

UR - https://onlinelibrary.wiley.com/doi/10.1111/add.16122

UR - https://www.scopus.com/pages/publications/85147387102

U2 - 10.1111/add.16122

DO - 10.1111/add.16122

M3 - Article

C2 - 36609992

SN - 0965-2140

VL - 118

SP - 954

EP - 966

JO - Addiction

JF - Addiction

IS - 5

ER -

Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

Abstract

Bibliographical note

Funding

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this