1. Creating the University of the Highlands and Islands

2. Research Excellence Framework
(REF) 2014
Michael Rayner – Dean of Research
Shirley Leckie – Research Data and
Information Manager
Creating the University of the Highlands and Islands

3. Introduction
Creating the University of the Highlands and Islands
Background Information:
RAE 2008
UHI Performance
Sector Performance
REF 2014
New Rules and Approaches
UHI Approach to REF 2014
Research Impact – Practical Session
REF 2014 Hints and Tips

4. What is research
assessment?
Creating the University of the Highlands and Islands
• Research assessment began in the UK in the 1980’s
• Originally this exercise was NOT related to funding – focussed on
volume of outputs
• Developed into RAE in 1986 and was based on quality
• Run approximately every 5 years – 1986, 1989, 1992, 1996, 2001
and 2008
• RAE undertaken by the four UK higher education funding councils
• Each UoA given a rank/score with this used to inform allocation of
quality weighted research funding

5. RAE 2008
Creating the University of the Highlands and Islands
Four star Quality that is world-leading in terms of originality, significance
and rigour.
Three star Quality that is internationally excellent in terms of originality,
significance and rigour but which nonetheless falls short of the highest
standards of excellence.
Two star Quality that is recognised internationally in terms of originality,
significance and rigour.
One star Quality that is recognised nationally in terms of originality,
significance and rigour.
Unclassified Quality that falls below the standard of nationally recognised
work. Or work which does not meet the published definition of research for the
purposes of this assessment.

6. Building a Quality Profile
Creating the University of the Highlands and Islands

7. UHI Performance in RAE
2008
Creating the University of the Highlands and Islands
Unit of Assessment Cat A Staff World
Leading
Internat’ly
Excellent
Internat’ly
Recognised
Nationally
Recognised
u/c
4* 3* 2* 1* 0
15 Pre-clinical and Human
Biological Sciences
2 0 10 55 35 0
16 Agriculture, Veterinary
and Food Science
3 0 5 35 60 0
17 Earth Systems and
Environmental Sciences
42 5 35 45 15 0
31 Town and Country
Planning
7.5 0 10 35 40 15
33 Archaeology 3.3 5 15 40 40 0
50 European Studies 4 0 5 15 60 20
56 Celtic Studies 4 5 10 35 30 20
61 Theology, Divinity and
Religious Studies
3.6 0 10 30 50 10
per cent 2 13 36 41 8

8. UHI Performance in RAE
2008
Creating the University of the Highlands and Islands
RAE 2008 THE BASIC DATA
Interpretation
41 % Nationally recognised
36% Internationally recognised
13% Internationally excellent
2% World leading
•UHI is 96/132 in the UK, above 4 other Scottish institutions
•RAE fundable disciplines increased from 1 in 2001 to 8 in 2008
•RAE funded staff increased from 13 in 2001 to 75 in 2008
•Three disciplines contained world leading research
•Largest UoA, 13th
UK, 2nd
largest in Scotland behind Edinburgh
•ARC contributed half of the growth. Other half from UHI internal growth
•Boost to culture and confidence

9. RAE 2008 Results
Creating the University of the Highlands and Islands
2008 Research Assessment Exercise Results : Scotland
Overall quality profile
Note: In this table, joint submissions are shown split by their constituent institutions.
(% of research activity at each quality
level)
Institution name UoA No. Unit of assessment name
FTE
Category
A staff
submitted 4* 3* 2* 1* u/c
University of Aberdeen 15 Pre-clinical and Human Biological Sciences 35.00 5 35 35 15 10
UHI Millennium Institute 15 Pre-clinical and Human Biological Sciences 2.00 0 10 55 35 0
University of Aberdeen 16 Agriculture, Veterinary and Food Science 20.00 20 35 40 5 0
University of Edinburgh 16 Agriculture, Veterinary and Food Science 107.24 20 35 25 10 10
University of Glasgow 16 Agriculture, Veterinary and Food Science 74.90 5 50 35 10 0
Heriot-Watt University 16 Agriculture, Veterinary and Food Science 12.70 5 35 35 25 0
University of Stirling 16 Agriculture, Veterinary and Food Science 32.90 5 45 40 10 0
UHI Millennium Institute 16 Agriculture, Veterinary and Food Science 3.00 0 5 35 60 0

10. RAE 2008 Results
Creating the University of the Highlands and Islands
2008 Research Assessment Exercise Results : Scotland
Overall quality profile
Note: In this table, joint submissions are shown split by their constituent institutions. (% of research activity at each quality level)
Institution name
UoA
No. Unit of assessment name
FTE
Category
A staff
submitted 4* 3* 2* 1* u/c
University of Aberdeen 17 Earth Systems and Environmental Sciences 14.53 10 50 35 5 0
University of Abertay Dundee 17 Earth Systems and Environmental Sciences 12.00 10 35 40 15 0
University of Edinburgh 17 Earth Systems and Environmental Sciences 77.14 15 55 25 5 0
University of Glasgow 17 Earth Systems and Environmental Sciences 36.00 5 50 35 10 0
Heriot-Watt University 17 Earth Systems and Environmental Sciences 10.90 0 25 55 20 0
Napier University 17 Earth Systems and Environmental Sciences 13.00 0 20 45 30 5
University of Stirling 17 Earth Systems and Environmental Sciences 19.80 5 35 50 10 0
UHI Millennium Institute 17 Earth Systems and Environmental Sciences 42.00 5 35 45 15 0
University of the West of Scotland 17 Earth Systems and Environmental Sciences 7.00 0 15 50 35 0
University of Aberdeen 31 Town and Country Planning 7.90 20 40 30 10 0
University of Glasgow 31 Town and Country Planning 17.39 15 45 35 5 0
Heriot-Watt University 31 Town and Country Planning 13.80 20 30 35 10 5
UHI Millennium Institute 31 Town and Country Planning 7.50 0 10 35 40 15

11. RAE 2008 Results
Creating the University of the Highlands and Islands
2008 Research Assessment Exercise Results : Scotland
Overall quality profile
Note: In this table, joint submissions are shown split by their constituent institutions.
(% of research activity at each quality level)
Institution name
UoA
No. Unit of assessment name
FTE
Category
A staff
submitted 4* 3* 2* 1* u/c
University of Glasgow 33 Archaeology 20.86 10 40 35 15 0
UHI Millennium Institute 33 Archaeology 3.30 5 15 40 40 0
University of Glasgow 50 European Studies 9.00 5 35 45 10 5
Heriot-Watt University 50 European Studies 13.20 10 20 40 30 0
University of Stirling 50 European Studies 12.03 5 25 45 20 5
University of Strathclyde 50 European Studies 4.40 10 10 40 40 0
UHI Millennium Institute 50 European Studies 4.00 0 5 15 60 20
University of the West of Scotland 50 European Studies 4.00 0 5 45 45 5

12. RAE 2008 Results
Creating the University of the Highlands and Islands
2008 Research Assessment Exercise Results : Scotland
Overall quality profile
Note: In this table, joint submissions are shown split by their constituent institutions.
(% of research activity at each quality level)
Institution name
UoA
No. Unit of assessment name
FTE
Category
A staff
submitted 4* 3* 2* 1* u/c
University of Aberdeen 56 Celtic Studies 5.00 0 15 45 35 5
University of Edinburgh 56 Celtic Studies 12.00 20 30 35 10 5
University of Glasgow 56 Celtic Studies 6.00 10 50 30 5 5
UHI Millennium Institute 56 Celtic Studies 4.00 5 10 35 30 20
University of Aberdeen 61 Theology, Divinity and Religious Studies 18.00 15 65 20 0 0
University of Edinburgh 61 Theology, Divinity and Religious Studies 30.00 30 30 25 15 0
University of Glasgow 61 Theology, Divinity and Religious Studies 16.50 10 35 35 15 5
University of St Andrews 61 Theology, Divinity and Religious Studies 16.00 20 30 45 5 0
UHI Millennium Institute 61 Theology, Divinity and Religious Studies 3.60 0 10 30 50 10

13. UHI Compared to Scottish
Average
Creating the University of the Highlands and Islands
UHI RAE 2008 results compared to Scottish average
0
5
10
15
20
25
30
35
40
45
World Leading (4*) Internationally Excellent
(3*)
Internationally
Recognised (2*)
Nationally Recognised
(1*)
Percent(%)
UHI
Scottish Average

14. REF 2014
Creating the University of the Highlands and Islands
Official (Funding Councils) Timetable for REF 2014
• 8th October 2010 : Deadline for nominating panel members
• October 2010 : Sub-panel chairs appointed
• November 2010 : Reports from the impact pilot exercise
• December 2010 : Panel members appointed
• Early 2011 : Panels begin meeting
• Mid 2011 : Panels consult on criteria
• Mid 2011 : Guidance on submissions published
• Late 2011 : Panel criteria and methods published
• Early 2013 : Submission system operational
• Late 2013 : Submissions deadline
• 2014 : Panels assess submissions
• December 2014 : Outcomes published

15. REF 2014 - Differences from RAE
2008
Creating the University of the Highlands and Islands
Evolution, not Revolution
Panels and UoA’s
For further details please refer to HEFCE website
http://www.hefce.ac.uk/research/ref/
No of panels No of sub
panels/UoA’s
RAE 2008 15 67
REF 2014 4 36

16. REF 2014 - Differences from
RAE 2008
RAE 2008
• Research outputs – 70% (min
50%)
• Research Environment – 20%
(min 5%)
• Esteem Indicators – 10% (min
5%)
REF 2014
• Research Outputs – 60%
• Research Environment – 15%
• Impact – 25% ?
• Tweaked definitions of Quality
Descriptions:
• 4* = Exceptional
• 3* = Excellent
• 2* = Very Good
• 1* = Good
Creating the University of the Highlands and Islands

17. REF 2014
Creating the University of the Highlands and Islands
Particular stress on the economic and societal benefits
of research
• Outputs - Greater use of citations to inform peer review
• Environment – Development of structured template to
cover key issues, appropriate ‘level definitions’ and a
consistent approach for panels to produce environment
profiles. Also greater use of metrics (drawing from
HESA statistics).
• Impact – This has been introduced for the first time , in
line with the government’s ‘economic impact’ agenda

18. REF 2014
Creating the University of the Highlands and Islands
Initial Questions

19. UHI Preparation for REF
2014
Creating the University of the Highlands and Islands
What are the main issues for UHI?
• Approach
• Focus
• Staff Engagement
• UHI Strategic Plan
• Timescale

20. REF 2014 – UHI Draft
Timeline
Creating the University of the Highlands and Islands
Key events July Aug Sept Oct Nov Dec
2010
Main Panel Chairs Designate appointed
Announce panel structure and start recruitment of expert panels
Prepare outline guidance/discussion paper for Res Cttee on managing REF preparations
Discuss outline plans with RPG members and Res Cttee
Secure names and details of potential nominees for sub-panel membership
Engage with Deans and Academic partners re. approach to REF preparation and support
Establish REF Internet/intranet site for UHI
Start to identify - with partners - main REF contacts in Academic Partner locations
Deadline for applications for sub-panel chairs
Arrange for REF stock-take/audit
Begin to secure names for potential 'critical friends' for UoA submission development
Deadline for nominating panel members
Sub-panel chairs appointed
UHI research conf. - EO to provide advice and info. on the REF and Dean of Res. to lead a
workshop
Reports from the impact pilot exercise
Undertake REF stock-take/audit
Analyse information and advice following impact pilot exercise
Panel members appointed

21. Research Impact
Creating the University of the Highlands and Islands
• HEFCE currently developing an approach to recognising the wider
contribution of high quality research to society
• Embracing a wide definition of impact – economy, society, public policy,
culture or quality of life
• The impact must be evident during the REF assessment period, but the
research may have been undertaken earlier
• Impact arising from the unit’s portfolio of research as a whole – not the
impact of each researcher
• Assessment by expert panels, against criteria that are deemed appropriate
for each discipline group
• Assessment not measurement – impact statement, case studies

22. Impact Pilot
Creating the University of the Highlands and Islands
• 29 UK HEIs, each submitting to 2 panels
• Submissions based on case studies
• Pilot panels include a mix of practicing researchers and beneficiaries and
users of research
• Criteria reflecting the ‘breadth and depth’ of impacts

23. Impact Pilot
Creating the University of the Highlands and Islands
• Definitions and types of impact
• Criteria for assessment
• How to frame evidence of impact:
• Refining the case study approach
• What are appropriate indicators?
• How to establish the link with high quality research, and over what timeframe?
• ‘Overlap’ with environment
• Role of ‘users and beneficiaries’ in the assessment
• Burden implications
• Reports from the pilot due to be released during seminars from November
18th

24. Practical Segment
Creating the University of the Highlands and Islands
• In small groups think about how you would go about
creating a case study for a particular piece of research
and showcasing the impact the research has had.
• Make notes and each group can briefly recap their
thoughts

25. Research Impact
Creating the University of the Highlands and Islands

26. Help and Advice
Creating the University of the Highlands and Islands
• Early Preparation is Key – good data management
• Be Smart and Strategic
• Regional focus but international applicability
• Researcher Portal
• Research Networks
• Mentoring
• Partnerships and Collaboration
• Research Office
• Make use (as permitted) of UoA Panel Members