Internationalisation Index – Methodology, Results and Reactions

Hans Pohl (PhD) Programme Director at STINT ECA meeting in Stockholm, October 2019 Outline 1. Introduction: • About STINT • Why an internationalisation index? 2. Methodology 3. Results: • Index results • Use of the index 4. International use of the index? 5. Conclusions Introduction • STINT’s mission is to internationalise Swedish Higher Education and Research • We fund mobility and international collaboration at all levels, from individuals to (groups of) HEIs • We also develop knowledge about internationalisation STINT’s portfolio of programmes 1. Start-up of international projects – Initiation Grants 2. Supporting internationalisation of education • Grants for Double Degree Programs • Teaching Sabbatical • Grants for Teaching Sabbaticals 3. Establishing excellent international collaborations • Mobility Grants for Internationalisation • Chile – Sweden Research Cooperation • Joint Brazilian-Swedish Research Collaboration • Joint China-Sweden Mobility • Joint Japan-Sweden Research Collaboration • Korea-Sweden Research Cooperation • South Africa-Sweden Bilateral Scientific Research Cooperation 4. Supporting the university leadership’s internationalisation efforts - Strategic Grants 5. Scholarships – Capstone Awards Status of the Index • After five years of development the STINT Internationalisation Index was launched in 2016 • It was warmly welcomed(!) • One five-star HEI was awarded • Since then, new results have been presented annually Why an index? • Helps the system of higher education and research to understand and monitor internationalisation • Makes the internationalisation aspects more visible • Increases the involvement in internationalisation

• Supports STINT’s strategy and planning: o How does internationalisation develop? o Where are the needs? Challenges

• Internationalisation of higher education and research is not clearly defined • Methods to capture similar but different aspects (eg. rankings) are criticized by the HEIs and sometimes based on relatively trivial indicators • The HEI system is tired of delivering data Methodology Methodology – guiding principles • Measure internationalisation only, not quality • Strive for a breadth in the index, cover research, education and staff • Focus on results rather than ambitions • Use data from established actors, avoid questionnaires • Develop indicators using data more efficiently • Give absolute results, not relative • Offer overview through star ratings • Be transparent • HEIs in alphabetical order, no ranking Limitations / challenges • Data is available for 2011 - 2017 • 28 Swedish HEIs with substantial research are covered • There is no given way to combine the dimensions and define star rating thresholds Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad Research – new indicator • STINT initiated the development of a new indicator, with the aim to give HEIs focusing on less international disciplines a fair treatment when looking at the share of international co-publications • STINT and Elsevier developed the indicator jointly and it is available in SciVal since 2014 • The Field-Weighted Internationalization Score normalises in three dimensions: • Scientific discipline • Type of publication • Year

Pohl H, Warnan G, and Baas J (2014) Level the playing field in scientific international collaboration with the use of a new indicator: Field-Weighted Internationalization Score, Research Trends 39, 3-8. Discipline: Share of int’l co-publications Type of publication

Share of international co-publications Scientific field All types Articles Conference Reviews proceedings Medicine 16.8% 18.8% 17.1% 17.7%

Chemistry 19.6% 20.9% 17.7% 19.3%

Social Sciences 12.0% 12.6% 12.4% 8.3%

Global 18.2% 20.2% 14,9% 17.5%

Year: global trend towards higher shares Elsevier SciVal® extracted June 2019 June 3, SciVal®Elsevier extracted International co-publications (FWIS) Elsevier SciVal® extracted June 2019 June 3, SciVal®Elsevier extracted

GLOBAL AVERAGE = 1 Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad Students (S)

Indicator for mobile students. S = (Incoming + Outgoing)/Total [numbers of students] Data from the Swedish Higher Education Authority (UKÄ). Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad PhD students (P) Indicator for incoming PhD students. P = Foreign/Total [numbers of PhD students] Data from the Swedish Higher Education Authority (UKÄ) Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad Education (E) Indicator for courses and programmes in other tuition languages than Swedish (typically English).

E = Non-Swedish /Total [credits offered]

Data from www.universityadmissions.se (UHR). Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad Staff with research abroad Indicator is the share of researchers with at least one publication with a foreign affiliation among all researchers. Based on active researchers at the HEI: • Active = at least 1 publication the during last 5 years and at least 1 per three-year period since first publication • Home HEI is where the majority of affiliations in the publications has been during the last 3 (or 5) years. Data purchased from Elsevier based on Scopus publications from 1996 until and including the year of the index. Staff with PhD from abroad

Indicator is the share of staff with PhD from abroad in relation to all staff with PhD. Data purchased from Statistics Sweden (SCB) combining two registers: • Education register (UREG) • Staff at HEI register. International academic experience of staff

The shares of • Research with an affiliation abroad • PhD from abroad are normalised and combined into one indicator using the mean value. Dimensions of the STINT index • Research • Student mobility (in/out) • PhD students (in) • Courses/programmes in English • Staff with PhD and/or publications from abroad • Leadership with PhD and/or publications from abroad International academic experience of leadership

The HEI leadership is defined as the vice chancellor and the pro- vice chancellor. Otherwise definition of the indicator as for staff. Data from manual search in CVs and SciVal/Scopus. Six dimensions - summary Indicator Description Data source R Research Field-weighted share of international co- Elsevier/Scopus/ publications SciVal S Students Share of crossborder students in/out Swedish Higher Education Authority P PhD students Share of international PhD students Swedish Higher Education Authority E Education Share of credits given in other languages Underlying than Swedish (typically English) database for www.universityadmi ssions.se (Sw. Council for HE) F Faculty Share of staff with completed PhD studies SCB for education and/or research at a foreign higher (unique dataset) education institution Elsevier/Scopus (unique dataset) L Leadership As for Faculty but only for the vice- Manual chancellor and the provice-chancellor search/Scopus Weights and thresholds • The weights reflect STINT’s view on the importance of each dimension • Thresholds use a linear scale and were set to have a spread from 1 to 5 stars in each dimension

Dimension Weight International research 40% Mobile students 20% International PhD students 8% Education in English 12% Staff with international academic experiences 15% Leadership with international academic experiences 5% Results - data International research (2017) Blekinge Institute of Technology 1,31 Mid Sweden University 1,33 Chalmers University of Technology 1,45 Mälardalen University 1,33 Dalarna University 0,93 Stockholm School of Economics 1,18 Halmstad University 1,06 Stockholm University 1,44 Jönköping University 1,28 Swedish U. of Agricultural Sciences 1,45 Karlstad University 1,42 Södertörn University 1,15 Karolinska Institutet 1,62 Umeå University 1,33 Kristianstad University 0,71 University of Borås 1,33 KTH Royal Institute of Technology 1,57 University of Gothenburg 1,41 Linköping University 1,33 University of Gävle 1,24 Linneaus University 1,15 University of Skövde 1,10 Luleå University of Technology 1,66 University West 1,04 Lund University 1,42 Uppsala University 1,40 Malmö University 1,29 Örebro University 1,29 Field-Weighted Internationalization Score All 28: 1.53 (1.53) Mobile students (2017) Blekinge Institute of Technology 17,8% Mid Sweden University 5,5% Chalmers University of Technology 19,4% Mälardalen University 5,9% Dalarna University 10,2% Stockholm School of Economics 46,2% Halmstad University 9,7% Stockholm University 13,5% Jönköping University 25,5% Swedish U. of Agricultural Sciences 13,5% Karlstad University 5,8% Södertörn University 6,8% Karolinska Institutet 13,4% Umeå University 10,8% Kristianstad University 5,3% University of Borås 8,0% KTH Royal Institute of Technology 26,7% University of Gothenburg 10,5% Linköping University 13,2% University of Gävle 5,2% Linneaus University 12,8% University of Skövde 7,0% Luleå University of Technology 9,3% University West 5,3% Lund University 21,5% Uppsala University 15,6% Malmö University 10,5% Örebro University 5,6% Mobile in/out in relation to all All 28: 12.9% (12.3%) International PhD students (2017) Blekinge Institute of Technology 56,6% Mid Sweden University 27,2% Chalmers University of Technology 46,4% Mälardalen University 35,2% Dalarna University 40,9% Stockholm School of Economics 51,9% Halmstad University 46,7% Stockholm University 39,1% Jönköping University 32,8% Swedish U. of Agricultural Sciences 45,7% Karlstad University 24,7% Södertörn University 17,2% Karolinska Institutet 33,3% Umeå University 27,2% Kristianstad University 0,0% University of Borås 45,9% KTH Royal Institute of Technology 57,8% University of Gothenburg 20,8% Linköping University 26,8% University of Gävle 17,1% Linneaus University 23,3% University of Skövde 36,6% Luleå University of Technology 53,0% University West 29,1% Lund University 31,6% Uppsala University 36,1% Malmö University 20,2% Örebro University 19,3% International PhD students in relation to all All 28: 35.5% (35.5%) Education in English (2017) Blekinge Institute of Technology 14,3% Mid Sweden University 15,3% Chalmers University of Technology 43,8% Mälardalen University 18,2% Dalarna University 15,5% Stockholm School of Economics 71,2% Halmstad University 10,1% Stockholm University 26,3% Jönköping University 33,5% Swedish U. of Agricultural Sciences 36,6% Karlstad University 10,6% Södertörn University 11,1% Karolinska Institutet 16,4% Umeå University 17,1% Kristianstad University 10,7% University of Borås 15,0% KTH Royal Institute of Technology 46,1% University of Gothenburg 11,0% Linköping University 9,9% University of Gävle 15,4% Linneaus University 19,5% University of Skövde 20,9% Luleå University of Technology 10,2% University West 9,0% Lund University 31,0% Uppsala University 22,0% Malmö University 19,0% Örebro University 8,5% Credits offered in English in relation to all All 28: 19.7% (18.2%) Staff with int’l academic experience (2017)

Research PhD Research PhD abroad abroad. abroad abroad . Blekinge Institute of Technology 22,7% 9,1% Mid Sweden University 20,5% 6,4% Chalmers University of Technology 27,2% 21,6% Mälardalen University 21,5% 7,9% Dalarna University 19,1% 14,2% Stockholm School of Economics 29,3% 20,0% Halmstad University 20,8% 7,2% Stockholm University 29,4% 16,9% Jönköping University 23,6% 9,5% Swedish U. of Agricultural Sciences 27,9% 15,3% Karlstad University 21,1% 9,0% Södertörn University 24,7% 11,2% Karolinska Institutet 30,5% 19,3% Umeå University 26,9% 10,3% Kristianstad University 20,7% 4,3% University of Borås 22,4% 7,1% KTH Royal Institute of Technology 27,7% 16,8% University of Gothenburg 27,0% 11,1% Linköping University 26,2% 12,3% University of Gävle 19,8% 4,7% Linneaus University 23,1% 9,7% University of Skövde 21,6% 26,2% Luleå University of Technology 24,8% 9,5% University West 19,7% 4,9% Lund University 29,1% 12,3% Uppsala University 29,2% 15,4% Malmö University 23,4% 6,7% Örebro University 22,7% 10,6% • Researchers with publications with foreign affiliation in relation to all researchers. All 28: 27.9% (28.4%) • Staff with PhD from abroad in relation to all with a PhD. All 28: 13.5% (12.1%) Leadership’s int’l academic experience (2017) Research PhD Research PhD abroad abroad abroad abroad Blekinge InstituteofTechnology 50% 0% MalmoUniversity 100% 0% Chalmers University of Technology 50% 0% Mid Sweden University 50% 0% Dalarna University 0% 0% OrebroUniversity 100% 0% GoteborgUniversity 100% 0% Royal InstituteofTechnology 50% 0% Halmstad University 50% 0% Stockholm School of Economics 100% 0% Jönköping University 50% 0% Stockholm University 50% 0% Karlstad University 0% 0% Swedish U. of Agricultural Sciences 100% 0% Karolinska Institutet 0% 0% Södertörn University 0% 0% Kristianstad University 50% 0% Umea University 100% 0% Linkoping University 0% 0% University College ofBoras 0% 0% LinneausUniversity 100% 0% University of Gavle 100% 50% LuleaUniversity ofTechnology 100% 0% University of Skovde 50% 50% Lund University 50% 0% University West 50% 0% MalardalenUniversity 0% 0% Uppsala University 0% 0%

• Leaders with publications with foreign affiliation in relation to all. All 28: 51.8% (57.1%) • Leaders with PhD from abroad in relation to all with a PhD. All 28: 3.6% (3.6%) Data for 2017 Total Blekinge Institute of Technology *** Chalmers University of Technology ***** Dalarna University ** Halmstad University ** STINT Internationalisation Jönköping University **** Karlstad University *** Index Karolinska Institutet **** Kristianstad University * KTH Royal Institute of Technology ***** Linköping University *** Linneaus University *** Luleå University of Technology **** Lund University **** Malmö University ** Mid Sweden University *** Mälardalen University *** Stockholm School of Economics ***** Stockholm University **** Swedish U. of Agricultural Sciences **** Södertörn University ** Umeå University *** University of Borås *** University of Gothenburg *** University of Gävle ** Arrows indicate changes University of Skövde *** since previous year. University West ** Overall +3 stars Uppsala University **** Örebro University ** Data for 2017 Research Students PhDs Education Faculty Leadership Total Blekinge Institute of Technology *** **** ***** ** *** ** *** Chalmers University of Technology **** **** ***** ***** ***** ** ***** Dalarna University * ** **** ** *** * ** Halmstad University ** ** ***** ** ** *** ** STINT InternationalisationJönköping University *** ***** *** ***** *** ** **** Karlstad University **** * ** ** ** ** *** Karolinska Institutet ***** *** *** *** ***** * **** Index Kristianstad University * * - ** * * * KTH Royal Institute of Technology **** ***** ***** ***** ***** ** ***** Linköping University *** *** *** ** **** * *** Linneaus University ** *** ** *** *** *** *** Luleå University of Technology ***** ** ***** ** *** *** **** Lund University **** ***** *** ***** **** ** **** Malmö University *** ** ** *** ** * ** Mid Sweden University *** * *** ** ** *** *** Mälardalen University *** * **** *** ** ** *** Stockholm School of Economics *** ***** ***** ***** ***** *** ***** Stockholm University **** *** **** **** ***** ** **** Swedish U. of Agricultural Sciences **** *** ***** ***** **** *** **** Södertörn University ** ** ** ** *** ** ** Umeå University *** ** *** *** *** *** *** University of Borås *** ** ***** ** ** * *** University of Gothenburg **** ** ** ** *** *** *** University of Gävle *** * ** ** * * ** University of Skövde ** ** **** *** ***** ***** *** University West ** * *** ** * *** ** Uppsala University **** *** **** *** ***** ** **** Örebro University *** * ** * *** * ** Co-variation? RSPEFL R 0,20 0,43 0,20 0,40 0,04 S 0,52 0,89 0,54 0,13 P 0,49 0,44 0,29 E 0,61 0,20 F 0,22 L

Pearson coefficient Results – use of the index STINT’s web (www.stint.se/en) HEIs use it Media attention International use of the index? International use? • Research Globally available! • Student mobility (in/out) National and/or institutional data • PhD students (in) often available • Courses/programmes in English English not relevant in all countries. Institutional data probably available • Staff with PhD and/or publications from abroad Publications from abroad • Leadership with PhD and/or publications available @Elsevier. PhD origin probably available on from abroad institutional level

Relatively easy to collect data Conclusions STINT Internationalisation Index supports strategic internationalisation of HEIs Success factors: • New informative metrics introduced Photo: Camilla Cherry • No need for extra data input from HEIs • No changes in methodology since the launch 2016 One clear improvement would be a development of similar indices in other countries Hans Pohl [email protected] +46 708402740