Contents
Open Research across Disciplines
How the principles of open research can be applied to your disciplinePsychology
To suggest improvements or additions to this page, please use this form.
Case Studies
UKRN case study: Experimental psychology and cognitive neuroscience
University of Glasgow case study: Open research in psychology
University of Glasgow case study: Working in the Psychological Science Accelerator
University of Surrey case study: Open research principles for depression diagnosis with machine learning
University of Surrey case study: Using Automatic Analysis to improve neuroimaging
University of Reading case study: Practical Paths to Open Research in Neuroimaging
University of Bristol case study: Psychology – Group authorship to increase researcher engagement. Video.
University of York case study: Dissociating memory accessibility and precision in forgetting: writing a Registered Report – York Open Research – York Wiki Service
University of Manchester case study: #BeeWell, a programme that aims to make the wellbeing of young people everybody’s business
University of Sheffield case study: Claudia von Bastian on Training studies in Psychology. Video
Examples of open research practices
Open Methods: Hoch, O’Grady and Adolph (2019) studied locomotion exploration in infants and found their movement to be instigated by the journey of exploration instead of a particular destination (https://onlinelibrary.wiley.com/doi/abs/10.1111/desc.12740). Their data were obtained from Datavyu (http://datavyu.org/), an open-source video coding and data visualization software which incorporates machine learning algorithms that can be used to annotate videos. It also generates paths taken by individuals as well as identifying people in videos which allows behaviour coding inputs to be conducted in real time. Datavyu has the aim of making behavioural data accessible to increase transparency in research and to instigate the use of videos as raw data. By using openly shared videos for data and documentation, the preserved data create an opportunity to ask new research questions and accelerate progress in the field.
Open Methods: The Many Babies project (https://manybabies.github.io/) aims to use an open approach to research into early development. The project works collaboratively with labs around the world to make all key project decisions (e.g., the research question, data collection, and the analysis). Their first project explored infants’ preferences for infant-directed speech, compared to adult-directed speech (https://manybabies.github.io/MB1/). The study involved 69 laboratories, from 16 countries, with a total of 2,329 infants studied, with each lab using one of three methods to measure the infants’ discrimination: the head-turn preference, central fixation, or eye-tracking. Through collaboration, this project was able to replicate a well-known finding from developmental research, in infants around the world. The materials used in this study and the data collected are all openly accessible on GitHub (https://github.com/manybabies/mb1-analysis-public) and the Open Science Framework (https://osf.io/re95x/). The collaborative projects undertaken by the Many Babies Project allow standardized replication of developmental research around the world whilst being as open and transparent as possible.
Open Methods and Open Data: PLAY (Play & Learning Across a Year) is a project that aims to explore infants and their mother’s natural behaviours in their homes, across 50 universities in the United States. All materials, home visit protocols and the video and questionnaire data collected are all openly available on their website (https://www.play-project.org/index.html).
Open Data: Anne Urai focuses on the neural basis of decision-making across mammalian species, the interaction between learning and perception, and the neural basis of cognitive aging. The International Brain Laboratory (IBL, https://www.internationalbrainlab.com/) is a collaboration of ~20 laboratories worldwide. Its researchers are dedicated to standardizing mouse decision-making behavior, coordinating measurements of neural activity across the brain, and using theoretical approaches to formalize the neural computations that support decision-making. In contrast to traditional neuroscientific practice, in which individual laboratories each probe different behaviors and record from a few select brain areas, IBL aims to deliver a standardized, high-density approach to behavioral and neural assays. This approach relies on a highly distributed, collaborative network of ~50 researchers – postdocs, graduate students, and scientific staff – who coordinate the intellectual, administrative, and sociological aspects of the project. IBL has a data portal that provides tools and solutions they adopted and developed at IBL which are open-sourced and accessible on GitHub.
Resources
General Resources
- Nosek, B. A. (2014, February 28). Improving my lab, my science with the open science framework. APS Observer, 27(3). https://www.psychologicalscience.org/observer/improving-my-lab-my-science-with-the-open-science-framework
- Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., … Frank, M. C. (2018). A Practical Guide for Transparency in Psychological Science. Collabra:Psychology, 4(1): 20. https://doi.org/10.1525/collabra.158
- Dashboard resource containing neuroscience research outputs and brain imaging databases. https://ni.openaire.eu/
- Crüwell, S., van Doorn, J., Etz, A., Makel, M. C., Moshontz, H., Niebaum, J. C., … Schulte-Mecklenbeck, M. (2019). Seven easy steps to open science: An annotated reading list. Zeitschrift für Psychologie, 227(4), 237-248. https://econtent.hogrefe.com/doi/10.1027/2151-2604/a000387
- Kathawalla, U. K., Silverstein, P., & Syed, M. (2021). Easing into open science: A guide for graduate students and their advisors. Collabra: Psychology, 7(1). https://doi.org/10.1525/collabra.18684
- Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … and Contestabile, M. (2015). Promoting an open research culture. Science, 348(6242), 1422-1425. https://doi.org/10.1126/science.aab2374
- Baldwin, J. R., Pingault, J. B., Schoeler, T., Sallis, H. M., & Munafò, M. R. (2022). Protecting against researcher bias in secondary data analysis: challenges and potential solutions. European Journal of Epidemiology, 37(1), 1-10. https://doi.org/10.1007/s10654-021-00839-0
- Baldwin, J. R., Pingault, J. B., Schoeler, T., Sallis, H. M., & Munafò, M. R. (2022). Protecting against researcher bias in secondary data analysis: challenges and potential solutions. European Journal of Epidemiology, 37(1), 1-10. https://doi.org/10.1007/s10654-021-00839-0
- Duncan, G. J., Engel, M., Claessens, A., & Dowsett, C. J. (2014). Replication and robustness in developmental research. Developmental Psychology, 50(11), 2417-2425. https://doi.org/10.1037/a0037996
- Davis-Kean, P. E., & Ellis, A. (2019). An overview of issues in infant and developmental research for the creation of robust and replicable science. Infant Behavior and Development, 57, 101339.
https://doi.org/10.1016/j.infbeh.2019.101339 - Syed, M. (2022), Special issue on reliability of infant research. Inf Child Dev, 31: e2382. https://doi.org/10.1002/icd.2382
- Educational Psychology in the Open Science Era. https://www.tandfonline.com/toc/hedp20/56/2?nav=tocList
- Open Research Practices in Autism Research. https://sites.google.com/york.ac.uk/openautismresearch/home?authuser=0
- Introduction to Open Science in Psychology Reading List. https://t.co/NAkOaCh7oz
- Lakens, D. (2019). The value of preregistration for psychological science: A conceptual analysis. Japanese Psychological Review, 62(3), 221-230. Retrieved 21 September 2022, from https://www.jstage.jst.go.jp/article/sjpr/62/3/62_221/_pdf.
- Kalandadze, T., & Hart, S. (2022). Open developmental science: An overview and annotated reading list. Infant And Child Development. https://doi.org/10.1002/icd.2334
- Farran, E. K., & Scerif, G. (2022). Genetic syndromes, neuroconstuctivism, and replicable research; challenges and future directions. Infant and Child Development. https://doi.org/10.1002/icd.2307
- Pownall, M., Azevedo, F., Aldoh, A., Elsherif, M., Vasilev, M., & Pennington, C. et al. (2021). Embedding open and reproducible science into teaching: A bank of lesson plans and resources. Scholarship Of Teaching And Learning In Psychology. https://doi.org/10.1037/stl0000307
Open Methods
- Task repositories. https://expfactory.github.io/
- Neuroimaging tool repository. https://www.nitrc.org
- NIRO: Guideline resource for systematic reviews. https://osf.io/erkwa/
- Pipeline tools. Automatic Analysis, NiPype. Neuroimaging in Python – Pipelines and Interfaces — nipy pipeline and interfaces package (nipype.readthedocs.io)
- Mullen, L. B. (2019, February 7). Scholarly Communication and Open Access in Psychology: Current Considerations for Researchers. PsyArXiv. https://doi.org/10.31234/osf.io/2d7um
- Havron, N., Bergmann, C., & Tsuji, S. (2020). Preregistration in infant research-A primer. Infancy, 25(5), 734-754. https://doi.org/10.1111/infa.12353
- Flake, J., & Fried, E. (2020). Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them. Advances In Methods And Practices In Psychological Science, 3(4), 456-465. https://doi.org/10.1177/2515245920952393
- Hobson, H., Poole, D., Pearson, A., & Fletcher-Watson, S. (2022). Opening up autism research: Bringing open research methods to our field. Autism, 26(5), 1011-1013. https://doi.org/10.1177/13623613221105385
- Govaart, G., Schettino, A., Helbling, S., Mehler, D., Ngiam, W., & Moreau, D. et al. (2022). EEG ERP Preregistration Template. https://antonio-schettino.com/publication/govaart-eeg-erp-prereg-template-2022/
- Schroeder, P., Artemenko, C., Kosie, J., Cockx, H., Stute, K., & Pereira, J. et al. (2022). Using preregistration as a tool for transparent fNIRS study design. https://europepmc.org/article/MED/36908680
- Petersen, I., Apfelbaum, K., & McMurray, B. (2022). Adapting open science and pre‐registration to longitudinal research. Infant And Child Development. https://doi.org/10.1002/icd.2315
- Kwasnicka, D., Keller, J., Perski, O., Potthoff, S., ten Hoor, G., & Ainsworth, B. et al. (2022). White Paper: Open Digital Health – accelerating transparent and scalable health promotion and treatment. Health Psychology Review, 1-17. https://doi.org/10.1080/17437199.2022.2046482
- University of Sheffield discipline-specific guidance on how to make research data and software FAIR (findable, accessible, interoperable & reusable). This pilot was conducted in seven departments across the University: Architecture, Biosciences, English, Geography, Mechanical Engineering, Psychology, and the School of Health and Related Research. You can find the full set of checklists from the pilot departments at: https://doi.org/10.15131/shef.data.20496855.v2
- Pennington, C. R. (2023). A Student’s Guide to Open Science: Using the Replication Crisis to Reform Psychology. Open University Press. https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
Open Data
- Open platform for sharing MRI, MEG, EEG, iEEG, and ECoG data. https://openneuro.org
- UK data service list of longitudinal cohort study data. https://www.ukdataservice.ac.uk/get-data/key-data/cohort-and-longitudinal-studies.aspx
- Twins Early Development Study (TEDS) data. http://www.teds.ac.uk/researchers/teds-data-access-policy
- Repository for unthresholded statistical maps, parcellations, and atlases of the brain.
- https://neurovault.org/
- Open video data software. https://datavyu.org
- Databrary supports data sharing of video and audio recordings among researchers in the behavioural, social, educational, developmental, neural, and computer sciences. https://nyu.databrary.org/
- TalkBank is a data repository of 14 research areas, focusing on spoken language. https://talkbank.org/
- Meyer, M. (2018). Practical Tips for Ethical Data Sharing. Advances In Methods And Practices In Psychological Science, 1(1), 131-144. https://doi.org/10.1177/2515245917747656
- Data archive and repository for Psycholinguistics. The Language Archive (mpi.nl)
- Andrea S. Towse, David A. Ellis & John N. Towse (2021) Making data meaningful: guidelines for good quality open data, The Journal of Social Psychology, 161:4, 395-402. https://doi.org/10.1080/00224545.2021.1938811
Open Outputs
- Preprint repository. https://psyarxiv.com
- Guide to licensing your work on PsyArXiv. http://blog.psyarxiv.com/2018/05/14/licensing-work-psyarxiv/
- Syed, M. (2020, May 7). Managing Preprints across the Publication Pipeline. Get Syeducated. https://getsyeducated.blogspot.com/2020/05/managing-preprints-across-publication.html
This page is adapted and extended from: Farran, E. K., Silverstein, P., Ameen, A. A., Misheva, I., & Gilmore, C. (2020, December 15). Open Research: Examples of good practice, and resources across disciplines. https://doi.org/10.31219/osf.io/3r8hb