The Value of Vision in Radical Technological Innovation A
Total Page:16
File Type:pdf, Size:1020Kb
THE VALUE OF VISION IN RADICAL TECHNOLOGICAL INNOVATION A DISSERTATION SUBMITTED TO THE DEPARTMENT OF MECHANICAL ENGINEERING AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Tammy L. Carleton September 2010 © 2011 by Tammy Lee Carleton. All Rights Reserved. Re-distributed by Stanford University under license with the author. This dissertation is online at: http://purl.stanford.edu/mk388mb2729 ii I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Larry Leifer, Primary Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Riitta Katila I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Chuck House Approved for the Stanford University Committee on Graduate Studies. Patricia J. Gumport, Vice Provost Graduate Education This signature page was generated electronically upon submission of this dissertation in electronic format. An original signed hard copy of the signature page is on file in University Archives. iii THE VALUE OF VISION IN RADICAL TECHNOLOGICAL INVENTION ABSTRACT Is a technological vision needed to drive radical or disruptive innovations? Few studies have discussed a possible relationship between the formation of a technological vision and the sustained creation of radical innovation. Even fewer have analyzed a relationship systematically, and finding a suitable data set has proven to be a challenge to scholars. Since 1958, the U.S. Defense Advanced Research Projects Agency (DARPA) has sponsored high risk, high reward research and development that bridge the gap between fundamental discoveries and their military uses. The agency’s sole charter has been radical innovation, providing 52 years of sustained practice. This study draws on 59 interviews with DARPA personnel and funding recipients, whose time at the agency spans 45 of those years. Historical interviews and agency documents further validated the data set. Using grounded theory methodology, this study identifies the importance of vision in radical technological innovation, synthesizing prior studies from organizational innovation, technology management, visionary leadership, and industrial research and development. Four major findings are discussed, which address the timing and criteria for innovation visions, specific mechanisms for the formation of visions, the role of socialization on envisioning, and the corresponding governance model. These findings, supported by empirical evidence, add to the current understanding of technological visions and radical innovation research. iv THE VALUE OF VISION IN RADICAL TECHNOLOGICAL INVENTION ACKNOWLEDGEMENTS I would like to thank the following individuals, who have supported my research with extraordinary contributions: Chuck House, Riitta Katila, and especially Larry Leifer for being willing to think boldly in the spirit of DARPA Hard; John Cockayne for his generosity of spirit and funds; William Cockayne for his steadfast faith and provocation; and Jon and Suni Carleton for ensuring the final chapters were drafted. v THE VALUE OF VISION IN RADICAL TECHNOLOGICAL INVENTION TABLE OF CONTENTS Abstract.........................................................................................................................iv List of Tables ..............................................................................................................viii List of Illustrations.......................................................................................................ix Chapter 1 Introduction ................................................................................................ 1 Research Opportunity..............................................................................................................2 Research Plan ..........................................................................................................................5 Research Contribution.............................................................................................................7 Chapter 2 Literature Review ....................................................................................... 9 Radical Technological Innovation...........................................................................................9 A Time for Discovery & Invention...................................................................................12 Processes of Radical Innovation .......................................................................................13 Organizational Sustainability............................................................................................17 Visions of Technology ..........................................................................................................17 Visionaries and Other Innovation Roles................................................................................21 Innovation and DARPA ........................................................................................................23 Organizational Structure ...................................................................................................24 Processes of Innovation.....................................................................................................29 Measures of Program Success...........................................................................................35 Conclusion.............................................................................................................................36 Chapter 3 Methodology.............................................................................................. 37 Grounded Theory Methodology............................................................................................37 Iterative Process of Data Collection and Analysis ................................................................39 Theoretical Sampling.............................................................................................................43 Method Limitations ...............................................................................................................44 Conclusion.............................................................................................................................45 Chapter 4 Data Set...................................................................................................... 47 Data Sources..........................................................................................................................49 Subject Profile .......................................................................................................................53 DARPA Personnel ............................................................................................................54 Funding Recipients............................................................................................................58 DARPA Office Affiliation ................................................................................................59 Conclusion.............................................................................................................................60 Chapter 5 Analysis...................................................................................................... 62 Process Model of Radical Innovation....................................................................................62 Stage 1: Recruitment.........................................................................................................63 Stage 2: Vision Formulation .............................................................................................63 Stage 3: Program Launch..................................................................................................64 Stage 4: Portfolio Management.........................................................................................64 Stage 5: Technology Transfer ...........................................................................................65 Vision and Recruitment.........................................................................................................67 Recruiting Criteria and Evaluation....................................................................................70 Channels for Recruiting Technology Visionaries.............................................................74 Vision Formulation................................................................................................................76 Sources of Technology Visions ........................................................................................77 vi THE VALUE OF VISION IN RADICAL TECHNOLOGICAL INVENTION Criteria of a Radical Vision...............................................................................................78 Advancing Partial Visions of Technology ............................................................................81 Expert Workshops.............................................................................................................83 Proof-of-Concepts.............................................................................................................84