Contents
METEOR - METa-research for the Enhancement Of Research culture
November 2023 - December 2024Project Overview
Research culture has taken a more prominent place in the strategic priorities of the UK Higher Education sector since the 2000s as meta-research (research-on-research) studies have identified a need for improvement to ensure the health, diversity and sustainability of UK research. This has sparked both sector-wide and individual institutional initiatives aimed at cultural improvement.
Drawing on interview data from 14 decision-makers, such as Pro Vice Chancellors of Research, Heads of Department and Professional Services Leaders, and 7 meta-researchers from 14 diverse institutions, this study has explored the role of research evidence in decisions affecting research culture in English High Education Institutions (HEIs).
Ethics approval was obtained from the School of Psychological Science Research Ethics Committee at the University of Bristol (approval code: 17685).
What is meta-research?
Currently the UKRN working definition of meta-research, also known as research on research, is the study of research methods, practices and environments with the aim of evaluating and improving research or research culture.
What do we mean by research culture?
The Royal Society defines research culture as ‘the behaviors, values, expectations, attitudes and norms of our research communities’.
Objectives
Explore how and to what extent meta-research informs decisions around research culture in English HEIs.
Identify the factors which enable or hinder the use and impact of research evidence by decision-makers
Achieve consensus on examples of good practice for the use of meta-research evidence in institutional decisions.
“The headline answer is that we’re not informed by research nearly as much as we should be.”
Key findings
“I think there is definitely scope for evidence to play a greater role in the decision-making process. A lot of it percolates in through people’s expertise at the moment, rather than explicitly.”
“We have to collaborate as a sector if we’re going to move the dial on this.”
The study explored how meta-research has played an indirect role in shaped institutional strategies, often through advocates or external pressures like funding mandates, within the 14 institutions who participated. The ‘institutional meta-research’ that some universities are conducting to understand their own cultures was also highlighted.
It has also demonstrated that evidence-informed decision-making on issues affecting research culture is not yet embedded in institutions. Instead, research evidence has influenced activities in an ad hoc manner, often via specific individuals involved in discussions due to their roles. The actions taken by individual institutions to improve research culture remain largely uninformed by meta-research.
The study also found that the evaluation of culture-improvement initiatives has been minimal, which aligns to the findings of UKRI (2024) and Nair and Kita (2024). Participants identified resource limitations, the challenge of how to evaluate initiatives and the relative infancy of many of the initiatives as barriers to evaluation.
The factors which enable or hinder the use and impact of research evidence within such decision-making were also examined by the study. It found the engagement of decision-makers through consultation and co-creation at the beginning of the research process enhanced meta-research impact. Career stage, reputation, and personal and professional connections were also identified as factors that could influence a researchers’ ability to drive change. Barriers to the use and impact of research evidence in institutional decision-making included difficulties in producing evidence of sufficient quality to inform decisions, often linked to limited resources, and resistance to findings that reflected poorly on institutions or individuals.
Cross-institutional networks like N8, GW4, GuildHE, and ARMA (Association of Research Managers and Administrators) were highlighted by most interviewees as valuable for sharing knowledge and fostering collaboration. However competitive pressures between HEIs were noted to sometimes undermine these efforts.
It is suggested that the sector should strengthen collaboration through formal and informal networks, sharing research, successes, challenges and lessons learnt, to support and encourage an evidence-informed approach across the sector. Networks should promote knowledge exchange, expertise sharing, and cross-institutional approaches to initiatives. To maximise benefits, collaboration should span multiple networks rather than remaining siloed within individual networks.
Outputs
Outcomes
The research highlights the need to rigorously evaluate research culture policies and initiatives. It encourages sector-wide collaboration and the sharing of findings to maximize the impact of meta-research on research culture to improve outcomes for universities and researchers alike.
It has demonstrated that evidence-informed decision-making around research culture is not widely embedded within HEIs, despite recognition that there is a body of work that could, in principle be drawn from. Therefore, the Wellcome-funded COMET study (led by University of Bristol / UK Reproducibility Network and University of Sussex / Science Policy Research Unit) aims to build on this work and improve the use of evidence in institutional decision-making affecting research cultures.
Funders
We gratefully acknowledge the funding and support of a consortium of UKRN institutions, who funded this project by pooling their ‘Enhancing Research Culture’ funds from Research England. The contributing institutions are:
Project Updates
UKRN STAR and METEOR projects achieve significant milestone with completion of first interviews
Two UK Reproducibility Network (UKRN) research projects have reached significant milestones. The first interviews for STAR (Sustainable and TrAnsparent open Research data) and METEOR (METa-research for the Enhancement Of Research culture) have been completed. Setting...
STAR & METEOR Projects Introduced at UKRN Webinar
The STAR and METEOR projects were introduced at the most recent UKRN Webinar: Nurturing change through growing UKRN projects. Project Coordinator Rosalind Strang spoke about our plans for the projects, including why these projects are vital in the current environment...
UKRN Launches STAR and METEOR Projects
The UK Reproducibility Network is pleased to announce the launch of two new projects, working towards our vision of the UK research system being outstanding in conducting and promoting rigorous and transparent research. STAR – Sustainable & TrAnsparent Research...