Good Research Practices

Semester

Semester 1, 2026-2027

Type of course

Basic Courses

Date

January 22, 2027

Location

Utrecht University

---

Duration

1 day

Maximum number of participants

24

ECTS

0.5 EC will be appointed for participation in the complete course

Staff

Daniel Lakens (TU/e)

Content

Recent discussions in psychology have led researchers to acknowledge that there is room to improve our research practices. In this workshop, we will discuss state-of-the-art statistical and methodological insights that will teach you how to draw better inferences from the scientific literature, and design more reliable and efficient experiments. I will explain why the scientific literature is biased, and how you can detect this bias. We will discuss why researchers contribute to bias in the scientific literature, and how these research practices conflict with the Code of Conduct for Research Integrity. We will reflect on the strange state of affairs where the code of conduct instructs us to abide by certain practices, but how we instead rely on cultural norms within our research community that determine how we do our job. How do we need to organize our science such that we are following the code of conduct? Which changes do we need to make to make sure our research is reliable, that we communicate our findings honestly, and that we hold each other accountable?

Reading material

VSNU code of conduct for research integrity

13.1 to 13.6 from https://lakens.github.io/statistical_inferences/13-prereg.html

15.1 tot 15.6 from https://lakens.github.io/statistical_inferences/15-researchintegrity.html

Evaluation of the course

Please fill in the evaluation of the course through the link below:

https://www.formdesk.com/universiteitutrecht-fsw/KLI_Eva

Program

09:30-09:40 

Welcome and Introduction

09:40-11:00 

Type 1 and Type 2 error control. Why error inflation quickly destroys the evidence in your data, and how to prevent you from fooling yourself.

Error inflation when simulating optional stopping, and correcting error rates through sequential analysis.

11:00 – 12:00

Scientific Integrity in Practice. A short overview of why we know (psychological) science is biased. A comparison of current research practices with the VSNU scientific code of conduct.

Discussion: Where do we deviate from the Code of Conduct in Practice. What would be needed to adhere to the code of conduct?

Bias detection: How can we detect simple mistakes in reported results. How can we catch these mistakes in our own work?

Using tools such as Statcheck to detect mistakes.

12:00-13:00

Lunch Break

13:00-14:30

What do real research lines look like? Explanation of why you will observe mixed results in the research lines you perform in your PhD.

Reflect on likelihood mixed Results.

14:30-16:30

How do we design informative studies, both to show the presence as the absence of effects? How can we publish null results?

Discussion: How can we prevent publication bias?