A list (in progress) of useful introductory resources to the issues around reproducibility (with a focus on Psycholgy and Neuroscience) and open science that I put together whilst preparing a lecture for undergraduate students of Social Pscychology. This list is far from comprehensive so please feel free to share any useful links/ideas in the comments.

Presentations:

• Slides by  Jim Grange. The reproducibility crisis in psychological science: One year later. Invited speaker at the “Psychologist in the Pub” event, Stoke-on-Trent. [Slides]
• Slides by Tom Hardwicke. Science as a Human Edeavour/ Building a Reproducilbe Research Workflow [Slides]
• Slides by Courtney Soderberg. Practical Steps for Increasing Openness and Reproducibility. [Slides]
• Materials by Courtney Soderberg and Jennifer Freeman Smith. COS Reproducibility Workshops. [Slides]
• Replicability and Reproducibility Debate organized by the BPS ath the Royal Society on 26 May 2016, with presentations from Marcus Munafò, Roger Watt, Dorothy Bishop, Chris Chambers, Kathryn Sharples, Nick Brown and Prateek Buch.

Demonstrations:

• FiveThirtyEight’s Hack Your Way To Scientific Glory : striking online demonstration of p-hacking in action!

Publications:

• Chambers, C. D., Dienes, Z., McIntosh, R. D., Rotshtein, P. and Willmes, K. (2015). Registered reports: realigning incentives in scientific publishing. Cortex, 66, A1-A2. (10.1016/j.cortex.2015.03.022)
• Hardwicke, T. E., Jameel, L., Jones, M., Walczak, E. J., & Magis-Weinberg, L. (2014). Only human: Scientists, systems, and suspect statistics. Opticon1826, (16):25, 1-12. [doi] [pdf]
• Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2: e124 (link)
• Leek, Jeffrey T. and Jager, Leah R., Is Most Published Research Really False? (March 2017). Annual Review of Statistics and Its Application, Vol. 4, Issue 1, pp. 109-122, 2017. Available at SSRN: https://ssrn.com/abstract=2937743 or http://dx.doi.org/10.1146/annurev-statistics-060116-054104
• Morey, R. D., Chambers, C. D., Etchells, P. J., Harris, C. R., Hoekstra, R., Lakens, D., Lewandowsky, S., Morey, C. C., Newman, D. P., Schönbrodt, F. D., Vanpaemel, W., Wagenmakers, E. and Zwaan, R. A. (2016). The Peer Reviewers’ Openness Initiative: incentivizing open research practices through peer review. Royal Society Open Science, 3(1) (10.1098/rsos.150547)
• Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (in press). A manifesto for reproducible science. Nature Human Behaviour.
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251). Doi: 10.1126/science.aac4716
• Wagenmakers, E.-J. (2015). A perfect storm: The record of a revolution. In-Mind Magazine.

Timelines/overviews:

• Bastian, H. (2016). Reproducibility Crisis Timeline: Milestones in Tackling Research Reliability. [Blog] Absolutely Maybe. Available at: http://blogs.plos.org/absolutely-maybe/2016/12/05/reproducibility-crisis-timeline-milestones-in-tackling-research-reliability/ [Accessed 23 Mar. 2017].
• Gelman, A. (2016). What has happened down here is the winds have changed. [Blog] Statistical Modeling, Causal Inference, and Social Science. Available at: http://andrewgelman.com/2016/09/21/what-has-happened-down-here-is-the-winds-have-changed/ [Accessed 23 Mar. 2017].

Tools/general resouces

• OpenStats Lab (@openstatslab) : OSL is a free resource for the teaching of introductory statistics. OSL activities use open data from Psych Science papers. Created by Kevin McIntyre, Ph.D.
• Science Together  (@SciTog)  : Looking for the tools and rules to enable making science with people across the world.
• Software Carpentry (@swcarpentry): We teach basic lab skills for scientific computing so that researchers can get more done in less time and with less pain.
• Data Carpentry (@datacarpentry): Data Carpentry is teaching researchers basic concepts, skills and tools for working more effectively with data. Take a workshop or help us develop or teach!
• Open Science Framework (@OSFramework) : Center for Open Science promotes openness, integrity, and reproducibility in science. Supports Open Science Framework.
• Open Science Federation (@openscience)
• Berkeley Initiative for Transparency in the Social Sciences (@UCBITSS): The Berkeley Initiative for Transparency in the Social Sciences (BITSS) promotes openness and integrity in empirical social science research.
• Society for the Improvement of Psychological Science (@improvingpsych) ‏