Chile’s National Innovation Council for Competitiveness Interim Assessment and Outlook April 2009 TABLE OF CONTENTS FOREWORD .................................................................................................................................................. 3 CONCLUSIONS AND RECOMMENDATIONS ......................................................................................... 4 Background ................................................................................................................................................. 4 The National Innovation Council for Competitiveness ............................................................................... 4 Achievements .............................................................................................................................................. 5 Weaknesses and challenges ......................................................................................................................... 6 Recommendations ....................................................................................................................................... 7 Recommendations for the Government ................................................................................................... 7 Recommendations for the Council .......................................................................................................... 8 BACKGROUND .......................................................................................................................................... 11 CHAPTER 1 - THE NATIONAL INNOVATION COUNCIL FOR COMPETITIVENESS...................... 14 The context of the Council ........................................................................................................................ 14 The interim Council .................................................................................................................................. 16 The Council and the first volume of its White Paper ................................................................................ 18 The second volume of the White Paper..................................................................................................... 22 The Clusters Programme ........................................................................................................................... 24 Strategic intelligence ................................................................................................................................. 26 Implementation.......................................................................................................................................... 26 CHAPTER 2 - INTERNATIONAL EXPERIENCE OF INNOVATION GOVERNANCE AND ADVISORY COUNCILS ............................................................................................................................. 29 Innovation governance .............................................................................................................................. 29 OECD experience with science and innovation councils .......................................................................... 32 Eight councils in OECD Member countries .......................................................................................... 32 Lessons from OECD experience ........................................................................................................... 36 Tentative implications for the Council ...................................................................................................... 39 CHAPTER 3 - SELECTIVITY AND CLUSTERS ...................................................................................... 41 Selectivity .................................................................................................................................................. 41 Instruments ................................................................................................................................................ 44 Cluster policy ............................................................................................................................................ 47 Choice of selective instruments ................................................................................................................. 50 CHAPTER 4 - THE COUNCIL’S PERFORMANCE TO DATE ............................................................... 52 Assessing the Council according to its intervention logic......................................................................... 52 Inputs, activities ..................................................................................................................................... 54 Outputs................................................................................................................................................... 55 Outcomes ............................................................................................................................................... 55 The Council’s performance in the light of international experience ......................................................... 57 Arena ..................................................................................................................................................... 58 1 Legitimacy ............................................................................................................................................. 58 Consensus .............................................................................................................................................. 59 Strategic intelligence ............................................................................................................................. 59 Long-term strategy ................................................................................................................................ 59 Co-ordination ......................................................................................................................................... 60 Profile .................................................................................................................................................... 60 Independence ......................................................................................................................................... 60 Interface to government ......................................................................................................................... 61 The Clusters Programme ........................................................................................................................... 62 The Council’s performance in the light of the findings of the OECD Review ......................................... 63 CHAPTER 5 - OUTLINE EVALUATION SYSTEM ................................................................................. 65 Introduction ............................................................................................................................................... 65 The Council’s evaluation ambitions .......................................................................................................... 65 International developments in using common evaluation frameworks ..................................................... 66 United States .......................................................................................................................................... 68 United Kingdom .................................................................................................................................... 70 The Netherlands ..................................................................................................................................... 72 Canada ................................................................................................................................................... 73 Lessons from international experience .................................................................................................. 75 Organising evaluation – international practice .......................................................................................... 76 The ‘waterfall’ principle ........................................................................................................................ 76 Separating evaluation from line management ....................................................................................... 76 Making sure evaluators are independent ............................................................................................... 78 Evaluation culture .................................................................................................................................. 78 Embedded evaluation ............................................................................................................................ 79 Designing an evaluation architecture ........................................................................................................ 79 The need for an architecture .................................................................................................................. 79 Using logic models to hold the system together .................................................................................... 80 Performance indicators .........................................................................................................................