Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil

Reza de Souza Brümmer; Karolin Rose Krause; Giovanni Abrahão Salum; Marcelo Pio de Almeida Fleck; Ighor Miron Porto; João Villanova do Amaral; João Pedro Gonçalves Pacheco; Bettina Moltrecht; Eoin McElroy; Mauricio Scopel Hoffmann

doi:10.1037/pas0001323

Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil

Reza de Souza Brümmer
, Karolin Rose Krause
, Giovanni Abrahão Salum
, Marcelo Pio de Almeida Fleck
, Ighor Miron Porto
, João Villanova do Amaral
, João Pedro Gonçalves Pacheco
, Bettina Moltrecht
, Eoin McElroy
, Mauricio Scopel Hoffmann

Research output: Contribution to journal › Article › peer-review

40 Downloads (Pure)

Abstract

Assessment tools for depression and anxiety usually inquire about frequency of symptoms. However, evidence suggests that different question framings might trigger different responses. Our aim is to test if asking about symptom’s context, ability, duration and botherement adds validity to PHQ-9, GAD-7 and PROMIS depression and anxiety. Participants came from two cross-sectional convenience-sampled surveys (N=1,871) of adults (66% females, aged 33.4 ± 13.2), weighted to approximate with the state-level population. We examined measurement invariance across the different question frames, estimated whether framing affected mean scores, and tested their independent validity using covariate-adjusted and sample-weighted structural equation models. Validity was tested using tools assessing general disability, alcohol use, loneliness, well-being, grit, and frequency-based questions from depression and anxiety questionnaires. A bifactor model was applied to test the internal consistency of the question-frames under the presence of a general factor (i.e., depression or anxiety). Measurement invariance was supported across the different frames. Framing questions as ability (i.e., “how easily…”) produced a higher score, compared with framing by context (i.e., “in which daily situations…”). Construct and criterion validity analysis demonstrate that variance explained using multiple question frames were similar to using only one. We detected a strong overarching factor for each instrument, with little variances left to be explained by the question frame. Therefore, it is unlikely that using different adverbial phrasings can help clinicians and researchers to improve their ability to detect depression or anxiety.
Key words: PHQ-9, GAD-7, PROMIS, mental health questionnaire, question frame.

Original language	English
Pages (from-to)	488-504
Number of pages	17
Journal	Psychological Assessment
Volume	36
Issue number	8
Early online date	27 Jun 2024
DOIs	https://doi.org/10.1037/pas0001323
Publication status	Published (in print/issue) - 1 Aug 2024

Bibliographical note

Publisher Copyright:
© 2024 American Psychological Association

Funding

Reza de Souza Br\u00FCmmer was supported by the Pesquisa do Fundo de Incentivo \u00E0 Pesquisa/Universidade Federal de Santa Maria 2022 J\u00FAnior scholarship, granted to Mauricio Scopel Hoffmann. Ighor Miron Porto was supported by PROBIC/FAPERGS 2022 scholarship (22/2551-0000764-3: Mauricio Scopel Hoffmann) and is supported by Programa Institucional de Bolsas de Inicia\u00E7\u00E3o Cient\u00EDfica/Conselho Nacional de Desenvolvimento Cient\u00EDfico e Tecnol\u00F3gico 2023 scholarship (application call 21/2022 CNPq) at Universidade Federal de Santa Maria, granted to Mauricio Scopel Hoffmann. Mauricio Scopel Hoffmann is supported by the U.S. National Institutes of Health grant R01MH120482 under his postdoctoral fellowship at Universidade Federal do Rio Grande do Sul and by the Wellcome Mental Health Data Prize, granted by the Wellcome Trust (Grant 84494R). During the development of this project, Mauricio Scopel Hoffmann was supported by the Newton International Fellowship (Ref: NIF\\R1\\181942), awarded by the Academy of Medical Sciences through the U.K. Government\u2019s Newton Fund Programme. Karolin Rose Krause received fees from the International Consortium for Health Outcomes Measurement for work as a research fellow on a project that aimed to develop a standard set of outcomes for child and youth anxiety and depression (October 2018 through March 2020). Karolin Rose Krause was a member of the International Alliance of Mental Health Research Funders\u2019 Common Measures Advisory Board from 2021 to 2022 and provided advice on the establishment of common measures in mental health research, including the Patient Health Questionnaire\u20139 and General Anxiety Disorder\u20137.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

Generalized Anxiety Disorder–7
Patient Health Questionnaire–9
Patient-Related Outcome Measurement Information Systems
mental health questionnaire
question fram

Access to Document

10.1037/pas0001323

PAS_Final_SubmissionAuthor Accepted Manuscript, 1.37 MB

Fingerprint

Dive into the research topics of 'Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil'. Together they form a unique fingerprint.

Cite this

de Souza Brümmer, R., Krause, K. R., Abrahão Salum, G., Pio de Almeida Fleck, M., Miron Porto, I., Villanova do Amaral, J., Pedro Gonçalves Pacheco, J., Moltrecht, B., McElroy, E., & Scopel Hoffmann, M. (2024). Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil. Psychological Assessment, 36(8), 488-504. https://doi.org/10.1037/pas0001323

de Souza Brümmer, Reza ; Krause, Karolin Rose ; Abrahão Salum, Giovanni et al. / Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil : Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil. In: Psychological Assessment. 2024 ; Vol. 36, No. 8. pp. 488-504.

@article{5608ba4a14a44fa78664f0c1d28050c3,

title = "Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil",

abstract = "Assessment tools for depression and anxiety usually inquire about frequency of symptoms. However, evidence suggests that different question framings might trigger different responses. Our aim is to test if asking about symptom{\textquoteright}s context, ability, duration and botherement adds validity to PHQ-9, GAD-7 and PROMIS depression and anxiety. Participants came from two cross-sectional convenience-sampled surveys (N=1,871) of adults (66\% females, aged 33.4 ± 13.2), weighted to approximate with the state-level population. We examined measurement invariance across the different question frames, estimated whether framing affected mean scores, and tested their independent validity using covariate-adjusted and sample-weighted structural equation models. Validity was tested using tools assessing general disability, alcohol use, loneliness, well-being, grit, and frequency-based questions from depression and anxiety questionnaires. A bifactor model was applied to test the internal consistency of the question-frames under the presence of a general factor (i.e., depression or anxiety). Measurement invariance was supported across the different frames. Framing questions as ability (i.e., “how easily…”) produced a higher score, compared with framing by context (i.e., “in which daily situations…”). Construct and criterion validity analysis demonstrate that variance explained using multiple question frames were similar to using only one. We detected a strong overarching factor for each instrument, with little variances left to be explained by the question frame. Therefore, it is unlikely that using different adverbial phrasings can help clinicians and researchers to improve their ability to detect depression or anxiety. Key words: PHQ-9, GAD-7, PROMIS, mental health questionnaire, question frame. ",

keywords = "Generalized Anxiety Disorder–7, Patient Health Questionnaire–9, Patient-Related Outcome Measurement Information Systems, mental health questionnaire, question fram",

author = "\{de Souza Br{\"u}mmer\}, Reza and Krause, \{Karolin Rose\} and \{Abrah{\~a}o Salum\}, Giovanni and \{Pio de Almeida Fleck\}, Marcelo and \{Miron Porto\}, Ighor and \{Villanova do Amaral\}, Jo{\~a}o and \{Pedro Gon{\c c}alves Pacheco\}, Jo{\~a}o and Bettina Moltrecht and Eoin McElroy and \{Scopel Hoffmann\}, Mauricio",

note = "Publisher Copyright: {\textcopyright} 2024 American Psychological Association",

year = "2024",

month = aug,

day = "1",

doi = "10.1037/pas0001323",

language = "English",

volume = "36",

pages = "488--504",

journal = "Psychological Assessment",

issn = "1040-3590",

publisher = "American Psychological Association",

number = "8",

}

de Souza Brümmer, R, Krause, KR, Abrahão Salum, G, Pio de Almeida Fleck, M, Miron Porto, I, Villanova do Amaral, J, Pedro Gonçalves Pacheco, J, Moltrecht, B, McElroy, E & Scopel Hoffmann, M 2024, 'Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil', Psychological Assessment, vol. 36, no. 8, pp. 488-504. https://doi.org/10.1037/pas0001323

Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil. / de Souza Brümmer, Reza; Krause, Karolin Rose; Abrahão Salum, Giovanni et al.
In: Psychological Assessment, Vol. 36, No. 8, 01.08.2024, p. 488-504.

Research output: Contribution to journal › Article › peer-review

TY - JOUR

T1 - Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil

T2 - Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil

AU - de Souza Brümmer, Reza

AU - Krause, Karolin Rose

AU - Abrahão Salum, Giovanni

AU - Pio de Almeida Fleck, Marcelo

AU - Miron Porto, Ighor

AU - Villanova do Amaral, João

AU - Pedro Gonçalves Pacheco, João

AU - Moltrecht, Bettina

AU - McElroy, Eoin

AU - Scopel Hoffmann, Mauricio

PY - 2024/8/1

Y1 - 2024/8/1

N2 - Assessment tools for depression and anxiety usually inquire about frequency of symptoms. However, evidence suggests that different question framings might trigger different responses. Our aim is to test if asking about symptom’s context, ability, duration and botherement adds validity to PHQ-9, GAD-7 and PROMIS depression and anxiety. Participants came from two cross-sectional convenience-sampled surveys (N=1,871) of adults (66% females, aged 33.4 ± 13.2), weighted to approximate with the state-level population. We examined measurement invariance across the different question frames, estimated whether framing affected mean scores, and tested their independent validity using covariate-adjusted and sample-weighted structural equation models. Validity was tested using tools assessing general disability, alcohol use, loneliness, well-being, grit, and frequency-based questions from depression and anxiety questionnaires. A bifactor model was applied to test the internal consistency of the question-frames under the presence of a general factor (i.e., depression or anxiety). Measurement invariance was supported across the different frames. Framing questions as ability (i.e., “how easily…”) produced a higher score, compared with framing by context (i.e., “in which daily situations…”). Construct and criterion validity analysis demonstrate that variance explained using multiple question frames were similar to using only one. We detected a strong overarching factor for each instrument, with little variances left to be explained by the question frame. Therefore, it is unlikely that using different adverbial phrasings can help clinicians and researchers to improve their ability to detect depression or anxiety. Key words: PHQ-9, GAD-7, PROMIS, mental health questionnaire, question frame.

AB - Assessment tools for depression and anxiety usually inquire about frequency of symptoms. However, evidence suggests that different question framings might trigger different responses. Our aim is to test if asking about symptom’s context, ability, duration and botherement adds validity to PHQ-9, GAD-7 and PROMIS depression and anxiety. Participants came from two cross-sectional convenience-sampled surveys (N=1,871) of adults (66% females, aged 33.4 ± 13.2), weighted to approximate with the state-level population. We examined measurement invariance across the different question frames, estimated whether framing affected mean scores, and tested their independent validity using covariate-adjusted and sample-weighted structural equation models. Validity was tested using tools assessing general disability, alcohol use, loneliness, well-being, grit, and frequency-based questions from depression and anxiety questionnaires. A bifactor model was applied to test the internal consistency of the question-frames under the presence of a general factor (i.e., depression or anxiety). Measurement invariance was supported across the different frames. Framing questions as ability (i.e., “how easily…”) produced a higher score, compared with framing by context (i.e., “in which daily situations…”). Construct and criterion validity analysis demonstrate that variance explained using multiple question frames were similar to using only one. We detected a strong overarching factor for each instrument, with little variances left to be explained by the question frame. Therefore, it is unlikely that using different adverbial phrasings can help clinicians and researchers to improve their ability to detect depression or anxiety. Key words: PHQ-9, GAD-7, PROMIS, mental health questionnaire, question frame.

KW - Generalized Anxiety Disorder–7

KW - Patient Health Questionnaire–9

KW - Patient-Related Outcome Measurement Information Systems

KW - mental health questionnaire

KW - question fram

UR - https://www.scopus.com/pages/publications/85200013126

U2 - 10.1037/pas0001323

DO - 10.1037/pas0001323

M3 - Article

C2 - 38934900

SN - 1040-3590

VL - 36

SP - 488

EP - 504

JO - Psychological Assessment

JF - Psychological Assessment

IS - 8

ER -

de Souza Brümmer R, Krause KR, Abrahão Salum G, Pio de Almeida Fleck M, Miron Porto I, Villanova do Amaral J et al. Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil. Psychological Assessment. 2024 Aug 1;36(8):488-504. Epub 2024 Jun 27. doi: 10.1037/pas0001323

Beyond frequency: Evaluating the validity of assessing the context, duration, ability and botherement of depression and anxiety symptoms in south Brazil: Evaluating the validity of assessing the context, duration, ability, and botherment of depression and anxiety symptoms in South Brazil

Abstract

Bibliographical note

Funding

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this