Table of Contents
Comments
Commenters1
[1.] This annex provides further details of the evidence about impact that we propose should be included in submissions. We propose that each submission provide an impact statement (using a standard template) to describe the range of impacts and supporting activities of the submitted unit as a whole; and a number of case studies (using a common template) detailing specific examples of impact achieved by the submitted unit. Both the impact statement and the case studies should include appropriate indicators of impact as supporting evidence.
[1.] This annex provides further details of the evidence about impact that we propose should be included in submissions. We propose that each submission provide an impact statement (using a standard template) to describe the range of impacts and supporting activities of the submitted unit as a whole; and a number of case studies (using a common template) detailing specific examples of impact achieved by the submitted unit. Both the impact statement and the case studies should include appropriate indicators of impact as supporting evidence. 2
[2.] This annex provides an initial template for the case studies and menu of indicators of impact. These are presented as work in progress, and we invite comments and feedback to help refine these. We will develop them further through the impact pilot exercise.
[2.] This annex provides an initial template for the case studies and menu of indicators of impact. These are presented as work in progress, and we invite comments and feedback to help refine these. We will develop them further through the impact pilot exercise. 4
[3.] Through the pilot exercise we will develop a generic template for the impact statement, with sections to cover the following key issues:
[3.] Through the pilot exercise we will develop a generic template for the impact statement, with sections to cover the following key issues:5
- how the submitted unit identifies opportunities to exploit its research findings across the full range of its research
- how the submitted unit identifies opportunities to exploit its research findings across the full range of its research 9
[4.] We propose that the impact statement will include a small number of key indicators of impact that help to describe the full range of impacts and supporting activity of the unit as a whole. We propose that these are:
[4.] We propose that the impact statement will include a small number of key indicators of impact that help to describe the full range of impacts and supporting activity of the unit as a whole. We propose that these are:10
- indicators of research income generated from key categories of research users (business, government departments, medical research charities)
- indicators of research income generated from key categories of research users (business, government departments, medical research charities) 13
[5.] We will test and develop these through the impact pilot exercise (see paragraph 57 of the main text).
[5.] We will test and develop these through the impact pilot exercise (see paragraph 57 of the main text). 15
[6.] We propose that each submitted unit would provide one case study, using the generic template, for every 5 to 10 FTE staff included in the submission.
[6.] We propose that each submitted unit would provide one case study, using the generic template, for every 5 to 10 FTE staff included in the submission.16
[7.] Each case study should explain a specific impact on the economy, society, public policy, culture or quality of life, to which the submitted unit has made a significant research-driven contribution. The impact must have become evident within the period of assessment of the REF (2008 to 2012), though the underpinning research could have been undertaken earlier.
[7.] Each case study should explain a specific impact on the economy, society, public policy, culture or quality of life, to which the submitted unit has made a significant research-driven contribution. The impact must have become evident within the period of assessment of the REF (2008 to 2012), though the underpinning research could have been undertaken earlier.17
[8.] The template below has been designed to enable panels to make judgements about the reach and significance of the impact and to identify the specific research-driven contribution of the submitted unit research towards achieving the impact. It has also been designed to keep the burden on institutions to the minimum that is necessary for this purpose.
[8.] The template below has been designed to enable panels to make judgements about the reach and significance of the impact and to identify the specific research-driven contribution of the submitted unit research towards achieving the impact. It has also been designed to keep the burden on institutions to the minimum that is necessary for this purpose. 20
[9.] Both the impact statement for the submitted unit as a whole and the case studies would comprise narrative explanations, with indicators provided as supporting evidence. We aim to develop a common menu of indicators that can be drawn on and used within the impact statement and case studies, as appropriate. An initial menu – to be developed further – is provided below.
[9.] Both the impact statement for the submitted unit as a whole and the case studies would comprise narrative explanations, with indicators provided as supporting evidence. We aim to develop a common menu of indicators that can be drawn on and used within the impact statement and case studies, as appropriate. An initial menu – to be developed further – is provided below. 21
[10.] Other than a small number of standard indicators to be included in the impact statement, we do not envisage specifying or defining the indicators in detail. Panels may wish to provide further guidance on particular indicators that they would want to emphasise, or on how specific indicators should be presented, as may be appropriate to their disciplines. Otherwise the onus will be on institutions in their submissions to provide evidence by drawing on a small number of indicators as appropriate to the context of each case study.
[10.] Other than a small number of standard indicators to be included in the impact statement, we do not envisage specifying or defining the indicators in detail. Panels may wish to provide further guidance on particular indicators that they would want to emphasise, or on how specific indicators should be presented, as may be appropriate to their disciplines. Otherwise the onus will be on institutions in their submissions to provide evidence by drawing on a small number of indicators as appropriate to the context of each case study. 22
[11.] It should be noted that some indicators in the common menu below relate to outcomes (for example, improved health outcomes or growth in business revenue). Others provide an indication that the submitted unit’s research has value to user communities (such as research income), or that there is clear evidence of progress towards positive outcomes (such as the take-up or application of new products, policy advice, medical interventions and so on; or a change in policy, practice or behaviours). This reflects the practical difficulties in measuring outcomes, and the role of indicators in providing supplementary (rather than definitive) evidence to inform the assessment by panels.
[11.] It should be noted that some indicators in the common menu below relate to outcomes (for example, improved health outcomes or growth in business revenue). Others provide an indication that the submitted unit’s research has value to user communities (such as research income), or that there is clear evidence of progress towards positive outcomes (such as the take-up or application of new products, policy advice, medical interventions and so on; or a change in policy, practice or behaviours). This reflects the practical difficulties in measuring outcomes, and the role of indicators in providing supplementary (rather than definitive) evidence to inform the assessment by panels. Tags: healthcare training, improved health services, improved public services, National Institute for Health and Clinical Excellence, NHS, products/services, public services, security technologies