Readings
Measuring the prevalence of questionable research practices in psychology
The prevalence of statistical reporting errors in psychology (1985-2013).
Podcasts and links
Reproducibilitea Podcast 2 - Examining Analytic Flexibility - This week the team discuss analytic flexibility in “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant” from Simmons, Nelson, & Simonsohn (2011) - available above in Readings.
Reproducibilitea Podcast 3 - Questionable Research Practices - This week the team discuss the prevalence of questionable research practices in John, Lowenstein, & Prelec “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling” (available in the Readings section)
QRP: The Board Game! A fun board game developed collaboratively at SIPS (Society for Improving Psychological Science) this year. Designed to help you learn about the incentives for truth-telling in science. If you play it, please fill in the feedback form and send back to the developers!
Essay Topic - The Reproducibility Crisis in Psychology
In recent years there has been increasing attention on the failure of some well-publicised effects in Psychology to replicate. Although the most recent crisis might be said to have begun with Daryl Bem’s infamous Psi experiments, published in Psychological Science, alarm bells began ringing decades earlier. In this essay you will explore the history of the Reproducibility Crisis in Psychology, the questionable research practices that may have led to it, and what the implications are for the future of Psychology. Starter readings are in the Topic 2 section.
Some questions to consider:
- Is there a clear line between data fraud and questionable research practices?
- Are some QRPs are worse than others?
- Do we need to reform the way we conduct research in Psychology?
- There have been suggestions that some fields of psychology might be more affected by this than others. Discuss these suggestions and evaluate their validity.
Forum
Before posting here, read the assigned readings and listen to the podcast.
- Do you think there’s a clear line between data fraud and questionable research practices?
- Do you think some QRPs are worse than others?
- Do you think some fields of psychology might be more affected by this than others?
- Please add your own thoughts and questions below!