Psychology and Research Assessment in the United Kingdom

What can we learn about psychology research in the UK, and its perceived quality, from examining manuscripts submitted to the psychology, psychiatry and neuroscience subpanel of the 2021 Research Excellence Framework (REF2021)? Using a latent Dirichlet allocation topic modelling approach, we identified 33 topics which collectively summarised the content of the journal articles returned to the subpanel. We found that the composition of submissions to the subpanel, in terms of these topics, explained a large proportion of the variance in the quality assessments they received from the expert peer review subpanel. Our model identified topics which were typically associated with receiving higher and lower unit-level quality assessments. In our discussion we pay particular attention to the fate of qualitative research, and discuss possible accounts for why units who returned a large amount of qualitative work tended to receive lower quality assessments than those who did not.