Responsible Research Assessment

Felix Schönbrodt; Per Pippin Aspaas

doi:10.7557/19.7344

Authors

Felix Schönbrodt Ludwig-Maximilians-Universität
Per Pippin Aspaas UiT The Arctic University of Norway https://orcid.org/0000-0002-6760-9617

DOI:

https://doi.org/10.7557/19.7344

Keywords:

Open Science, Research Assessment, CoARA, DORA, Reproducibility

Abstract

Felix Schönbrodt, Professor of Psychology at Ludwig-Maximilians-Universität (LMU) in Munich, tells about an initiative that he coordinates within the Deutsche Gesellschaft für Psychologie (German Psychological Society). Motivated by the Reproducibility Crisis and a rising frustration with the publishers of high-ranking journals, Schönbrodt has co-authored three position papers on the theme of responsible research assessment. The suggestion is to develop a two-stage evaluation system for hiring, the first of which will use responsible metrics with emphasis on open data, pre-registration and several aspects of reproducibility, whereas the second stage will focus on a qualitative (content-oriented) evaluation of selected candidates. The propositions of Schönbrodt’s group have so far led to published feedback from more than 40 different scholars. Besides his nation-wide work within the German Psychological Society, Schönbrodt is the managing director of LMU’s Open Science Centre, where scholars from different disciplines convene for workshops on various aspects of Open Science. Under the nickname «nicebread» (Schön = nice, Brodt = bread), he also runs a personal blog and a project webpage on GitHub.

Interview recorded in Munich, October 2023. First published online: November 29, 2023.

Author Biographies

Felix Schönbrodt, Ludwig-Maximilians-Universität

Professor of Psychology at Ludwig-Maximilians-Universität in Munich, Germany.

Per Pippin Aspaas, UiT The Arctic University of Norway

Head of Library Research and Publishing Support, UiT The Arctic University of Norway.

References

Brembs, Björn; Philippe Huneman; Felix Schönbrodt; Gustav Nilsonne; Toma Susi; Renke Siems; Pandelis Perakakis; Varvara Trachana; Lai Ma; Sara Rodriguez-Cuadrado (2023). «Replacing academic journals», Royal Society Open Science 10: 230206. https://doi.org/10.1098/rsos.230206

CoARA Commitment: https://coara.eu/

DORA Declaration: https://sfdora.org/

Gärtner, Anne; Daniel Leising; Felix Schönbrodt (2022). «Responsible Research Assessment II: A specific proposal for hiring and promotion in psychology». PsyArXiv Preprints 25 Nov 2022. https://doi.org/10.31234/osf.io/5yexm

Gärtner, Anne; Daniel Leising; Felix Schönbrodt (2023). «Empfehlungen zur Bewertung wissenschaftlicher Leistungen bei Berufungsverfahren in der Psychologie». Psychologische Rundschau, 74(3) 27 July 2023, pp. 166–174. https://doi.org/10.1026/0033-3042/a000630 (accompanied by a series of comments from peers in the same issue of the journal)

Peer Community In (a scholar-led non-profit organisation organising publishing recommendations based on preprints): https://peercommunityin.org/

RESQUE Project on GitHub: https://github.com/nicebread/RESQUE

Schönbrodt, Felix; Markus Maier; Moritz Heene; Michael Zehetleitner (2012). «Our Commitment to Research Transparency and Open Science». http://www.researchtransparency.org/

Schönbrodt, Felix; Anne Gärtner; Maximilian Frank; Mario Gollwitzer; Malika Ihle; Dorothee Mischkowski; Le Vy Phan; Manfred Schmitt; Anne M. Scheel; Anna-Lena Schubert; Ulf Steinberg; Daniel Leising (2022). «Responsible Research Assessment I: Implementing DORA for hiring and promotion in psychology». PsyArXiv Preprints 25 Nov 2022. https://doi.org/10.31234/osf.io/rgh5b

Schönbrodt’s personal blog and website: https://www.nicebread.de/