Open Science workshop for early-career researchers on 16 September 2018 at Goethe University in Frankfurt
Organisation
On 16 September 2018, an Open Science workshop for early-career researchers took place at Goethe University in Frankfurt am Main in the run-up to the 51st DGP Congress. The workshop was organised by the Developmental Psychology Division of the German Psychological Society. The course, attended by 17 participants, was organised by the representatives of early-career researchers within the Division of Developmental Psychology (Jan-David Freund & Ina Faßbender) and led by Jun.-Prof. Dr Malte Elson (Ruhr University Bochum).
Morning programme
In the morning, Malte Elson introduced the participants to the workshop topic in an interactive manner. Questionable research practices were identified and discussed. Whilst it was obvious in many cases why these practices undermine the scientific value of studies, there were also some practices which the participants had previously encountered mainly as practical recommendations. The findings presented regarding the prevalence and scope of these dubious techniques also caused great astonishment. Using a published study as an example, Malte Elson demonstrated that the problems often only become apparent upon closer examination of the measures and methods used. Indeed, the workshop participants were unable to correctly assign the items from the published study to the correct one of the two central constructs in even half of the cases.
Workshop lunch
During the lunch break, all participants and the research officer were invited to a brunch buffet at the ‘Strum und Drang’ restaurant on the Westend campus. This provided an opportunity for informal discussion.
Afternoon session
After the lunch break, the focus shifted to potential solutions and, in particular, how the scientific community could put a stop to questionable research methods. Various formats of open science, such as pre-registration and registered reports, were discussed, and a tool for identifying inconsistent tests in manuscripts was presented and tested. This also gave rise to repeated discussions about concepts of science and knowledge, as well as about practical obstacles – both experienced and anticipated – in implementing these approaches (such as project durations that are too short and expectations that are too high regarding the volume and speed of publications). Malte Elson emphasised that many studies are actually exploratory rather than confirmatory in nature, and that the problem in such cases lies primarily in the misrepresentation and over-interpretation of the results.
Acknowledgements
We would like to extend our special thanks to Jun-Prof. Dr Malte Elson for his engaging and professional facilitation of the workshop, which provided ample opportunity for questions, interaction and discussion. We would also like to thank the Developmental Psychology Division of the German Psychological Society for its financial support. Finally, we would like to thank all the participants for their lively involvement and the pleasant atmosphere.
Jan-David Freund & Ina Faßbender
Back to the section on promotion of early-career researchers »