Mechanisms and pathways to impact in public health research: a preliminary analysis of research funded by the National Institute for Health Research (NIHR).

BACKGROUND: The mechanisms and pathways to impacts from public health research in the UK have not been widely studied. Through the lens of one funder (NIHR), our aims are to map the diversity of public health research, in terms of funding mechanisms, disciplinary contributions, and public health impacts, identify examples of impacts, and pathways to impact that existing reporting mechanisms may not otherwise have captured, and provide illustrations of how public health researchers perceive the generation of non-academic impact from their work. METHODS: A total of 1386 projects were identified as 'public health research' by the NIHR and listed in the NIHR Public Health Overview database (2000-2016). From these, a subset of 857 projects were matched as potentially having begun reporting impacts via an external data-gathering platform (Researchfish). Data on the 857 projects were analyzed quantitatively, and nine projects were selected to investigate further through semi-structured interviews with principal investigators. Two workshops took place to validate emerging and final findings and facilitate analysis. RESULTS: In addition to the NIHR School for Public Health Research and the NIHR Public Health Research Programme, 89% of projects contained in the NIHR Public Health Overview portfolio as 'public health research' are funded via other NIHR research programmes, suggesting significant diversity in disciplines contributing to public health research and outcomes. The pathways to impact observed in our in-depth case studies include contributing to debates on what constitutes appropriate evidence for national policy change, acknowledging local 'unintended' impacts, building trusted relationships with stakeholders across health and non-health sectors and actors, collaborating with local authorities, and using non-academic dissemination channels. CONCLUSIONS: Public health as a discipline contributes substantially to impact beyond academia. To support the diversity of these impacts, we need to recognise localized smaller-scale impacts, and the difference in types of evidence required for community and local authority-based impacts. This will also require building capacity and resources to enable impact to take place from public health research. Finally, support is required for engagement with local authorities and working with non-health sectors that contribute to health outcomes.

How do organisations implement research impact assessment (RIA) principles and good practice? A narrative review and exploratory study of four international research funding and administrative organisations.

BACKGROUND: Public research funding agencies and research organisations are increasingly accountable for the wider impacts of the research they support. While research impact assessment (RIA) frameworks and tools exist, little is known and shared of how these organisations implement RIA activities in practice. METHODS: We conducted a review of academic literature to search for research organisations' published experiences of RIAs. We followed this with semi-structured interviews from a convenience sample (n = 7) of representatives of four research organisations deploying strategies to support and assess research impact. RESULTS: We found only five studies reporting empirical evidence on how research organisations put RIA principles into practice. From our interviews, we observed a disconnect between published RIA frameworks and tools, and the realities of organisational practices, which tended not to be reported. We observed varying maturity and readiness with respect to organisations' structural set ups for conducting RIAs, particularly relating to leadership, skills for evaluation and automating RIA data collection. Key processes for RIA included efforts to engage researcher communities to articulate and plan for impact, using a diversity of methods, frameworks and indicators, and supporting a learning approach. We observed outcomes of RIAs as having supported a dialogue to orient research to impact, underpinned shared learning from analyses of research, and provided evidence of the value of research in different domains and to different audiences. CONCLUSIONS: Putting RIA principles and frameworks into practice is still in early stages for research organisations. We recommend that organisations (1) get set up by considering upfront the resources, time and leadership required to embed impact strategies throughout the organisation and wider research 'ecosystem', and develop methodical approaches to assessing impact; (2) work together by engaging researcher communities and wider stakeholders as a core part of impact pathway planning and subsequent assessment; and (3) recognise the benefits that RIA can bring about as a means to improve mutual understanding of the research process between different actors with an interest in research.

The National Institute for Health Research at 10 Years: An Impact Synthesis: 100 Impact Case Studies.

The National Institute for Health Research (NIHR) funds and supports world-leading clinical and applied health and social care research, as well as research infrastructure in the NHS. Providing £1 billion of funding each year, NIHR aims to: drive the faster translation of new treatments, technologies and diagnostics to improve outcomes for health and care services; promote the wealth of the nation, including via inward investment from the health research community; pull basic science discoveries through into tangible benefits for patients and the public; and provide research evidence to support more effective and cost-effective NHS delivery. To mark its tenth anniversary, the Department of Health commissioned the Policy Research in Science and Medicine unit to consider the question: "What are the ways in which NIHR has benefited the health research landscape in the past ten years?" This study identifies and celebrates 100 examples of positive change resulting from NIHR's support of research. A synthesis of 100 case studies is provided, which highlights the benefits and wider impacts of research, capacity building, and other activities undertaken with NIHR's support since its creation in 2006. The study concludes with a reflection of how the NIHR has transformed R&D in and for the NHS and wider health service, and the people they serve. The study draws together---for the first time---examples of the breadth of NIHR's impacts in a single resource. It will be of interest to healthcare professionals involved in research, academics working in health and social care, and members of the public wishing to understand the value of research in the NHS and the wider health and care system.