Research Assessment Exercise 2005
Total Page:16
File Type:pdf, Size:1020Kb
Research Assessment Exercise 2005 Summary Report University of Helsinki Research Assessment Exercise 2005 Summary Report University of Helsinki Publisher: University of Helsinki Authors: Prof. Marja Makarow Director of the Research Assessment Exercise 2005 Vice-Rector Dr. Katri Haila Coordinator Evaluation Offi ce University of Helsinki Title: Type of publication: Research Assessment Exercise 2005 Evaluation report Summary Report University of Helsinki Summary: See p. 7 Keywords: research, assessment, evaluation, peer review, university, Helsinki, Finland Title and number of publication series: University of Helsinki Administrative Publications 17/2006 Evaluations ISSN: 1795-5408 ISBN: 952-10-2875-0 ISSN: 1795-5513(PDF) ISBN: 952-10-2876-9 (PDF) Total no. of pages: Language: 77 English Additional information: Available online at: University Printing House, 2006 www.helsinki.fi /research2005 CONTENTS FOREWORD ..............................................................................................................5 EXECUTIVE SUMMARY .............................................................................................. 7 1. INTRODUCTION TO THE RESEARCH ASSESSMENT EXERCISE 2005 .................... 8 1.1. The university system in Finland ........................................................... 8 1.2. The University of Helsinki in brief ........................................................ 8 1.3. Evaluation of the quality of research ...................................................10 1.4. The third mission ....................................................................................12 1.5. Motivation for the Research Assessment Exercise ..............................13 2. ORGANISATION OF THE EXERCISE ......................................................................14 2.1. Governance and fl ow chart of the Exercise .........................................14 2.2. Objectives ...............................................................................................14 2.3. Evaluation process ................................................................................14 2.3.1. Evaluation documents .............................................................14 2.3.2. Research-active staff ...............................................................16 2.3.3. Evaluation criteria ..................................................................17 2.3.4. Scientifi c quality of research ..................................................17 2.3.5. Interaction between research and society ............................17 2.3.6. Recommendations for the future ..........................................19 2.3.7. Evaluation of concepts ............................................................19 2.4. Evaluators and panels ............................................................................21 2.5. Site visits .................................................................................................21 2.6. Evaluation reports ............................................................................... 23 3. SUMMARY OF RESULTS .......................................................................................24 3.1. Summary of ratings of quality of research ...........................................24 3.2. Comparison of results of 2005 and 1999 ............................................24 4. FINANCIAL REWARDS ......................................................................................... 29 5. CONCLUDING REMARKS ..................................................................................... 32 APPENDICES ............................................................................................................ 33 1. Research Council, Steering Group and Evaluation Offi ce ..................... 34 2. Terms of Reference for panels and sub-panels ...................................... 35 3. Guidance for the units of assessment .................................................... 43 4. Submission Form .......................................................................................52 5. Panels and evaluators ...............................................................................61 6. Grouping of units of assessment under panels and sub-panels ......... 68 7. Examples of site visit programmes .......................................................... 72 FOREWORD Research-intensive universities as centres of excellence and innovation are crucial to the competitiveness and cultural development of societies. The capacity of research universities lies in their breadth allowing the pursuit of interdisciplinary opportunities, in the investigator-driven approach enabling the emergence of new research themes and unleashing individual talent, and in research-based teaching guaranteeing a fl ow of new knowledge to the next generation. In Finland, the research mission of universities began to be realized in the eighties. In the middle of the nineties, public funding of research and development started to be signifi cantly increased, leading to a rapid improvement in the quality of research. The current challenges our universities are facing include building on strengths to develop internationally competitive spearheads of research, internationalising the researcher base, and transferring to society intellectual capital obtained through research. The Research Assessment Exercise 2005 reveals strengths, weaknesses and potential in the research activities of the University of Helsinki. Moreover, the evaluators have given valuable advice on key issues, such as structures that best foster quality research, novel collaborative alliances, development and sharing of state-of-the-art infrastructure, positions for new principal investigators, equal opportunities and leadership. The Assessment provides us a unique view of ourselves, and gives advice on how we can improve ourselves and reach strategic decisions to meet forthcoming challenges. I take this opportunity to thank the staff of the units of assessment and central administration units for dedicating their time and efforts to produce the evaluation documents and organise the site visits of the panels, the Research Council of the University of Helsinki for supervising the Exercise, and the personnel of the Evaluation Offi ce for their excellent work. It is my special pleasure, on behalf of the University of Helsinki, to thank the evaluators for their outstanding work and remarkable commitment. Marja Makarow Director of the Research Assessment Exercise 2005 Professor of Applied Biochemistry and Molecular Biology Vice-Rector for Research and Researcher Training 5 EXECUTIVE SUMMARY In order to consolidate its position amongst Almost half of the 75 units of assessment leading research universities in Europe, the improved their rating from 1999. In 2005, University of Helsinki has decided to subject the average grade of all units, on a scale its research to international assessments of 1–7, was 5.8, wherease in 1999 it was every sixth year. The assessment was carried 4.6. One-fourth of the units obtained the out for the fi rst time in 1999, and the second maximum grade, 7. Thus, according to the time in 2005. The Research Assessment criteria of the grades, the majority of the Exercise 2005 covered the research activities works submitted by each of these units of 70 faculty departments and fi ve research for evaluation was of a high international institutes during the years 1999–2004. The level. quality of research was assessed numerically by comparing it to the European level. The The units that obtained the maximum grade concepts of 13 fi eld stations and research will be rewarded fi nancially for 6 years. networks, in total, and the research Those units that increased their rating to activities of 6 research programmes were 6 by at least two grades will be rewarded commented on verbally. The third mission, for 3 years, and the best faculties also for 3 a legal obligation of universities in Finland years. The rewards per unit of assessment since 2005, was included in the assessment will be about EUR 30,000–300,000 per year, as a pilot project. The units of assessment depending on the number of research-active chose the activities that they perceived as staff. The investment by the University of third-mission accomplishments, and the Helsinki in the rewards during 2007–2012 evaluators commented on them verbally. will amount to EUR 15–18 million. The evaluation was performed by peer In addition to assessing the quality review, and conducted by 148 mostly of research, commenting on third- international experts. They worked in 21 mission accomplishments and giving panels, which spent one working week on recommendations for the future to the site visits in Helsinki. The research-active units, the evaluators have given valuable staff comprised annually about 4,000 advice to the leadership of the university researchers and Ph.D. students. Thus, the to promote internationally competitive work resulting from 24,000 person years research. of research was assessed. The scientifi c output was published in 21,000 articles in refereed journals, 27,000 other scientifi c publications, 2,000 Ph.D. theses, 10,000 popularised work and 600 text books. 7 1. INTRODUCTION TO THE RESEARCH ASSESSMENT EXERCISE 2005 1.1. The university system of Finland designation for the Research Councils, and funds fundamental research, whereas the The higher education sector of Finland, National Technology Agency funds strategic which has a population of 5.2 million, research