Reconfigurable Supercomputing Means to Brave the Paradigm Chasm
Total Page:16
File Type:pdf, Size:1020Kb
Reiner Hartenstein, TU Kaiserslautern, Germany [email protected] http://hartenstein.de 13 September 2012 TU Kaiserslautern Preface (1) The ubiquitous everlasting crisis of computing Reiner Hartenstein Stonewalled Progress The dominant reductionist tunnel vision mind set SDPS fellow, IEEE fellow, FPL fellow of Computing Efficiency http://hartenstein.de Why we must Reinvent Computing [email protected] (keynote) http://xputer.de/UnB/Reiner-1SBCCI -12.pdf © 2012, [email protected] 2 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf FPL2013 at Porto, Portugal September 2 – 4, 2013 TU Kaiserslautern Tunnel Vision …. TU Kaiserslautern Preface (2) See here: http://fpl.org/FPL2013-PreliminaryCFP.pdf 23rd International Conference On Field Programmable Logic And Applications The ubiquitous everlasting crisis of computing A dominant reductionist tunnel vision mind set PRELIMINARY CALL FOR PAPERS kind of „anti tunnel General Chair: João M. P. Cardoso, University of Porto, Portugal vision Program Co-Chairs: Katherine (Compton) Morrow, University of Wisconsin-Madison, USA society“ Pedro Diniz, INESC-ID, Portugal http://www.sdpsnet.org © 2012, [email protected] 3 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 4 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf TU Kaiserslautern Preface (3) TU Kaiserslautern Outline The ubiquitous everlasting crisis of computing The ubiquitous everlasting Computing Crisis The von Neumann Syndrome and its history A dominant reductionist tunnel vision mind set Datastream-based Computing is not new Paradigm shifts leading into the wrong direction The sustained Language Selection problem Stonewalls preventing very urgent improvements We must Reinvent Programmer Education What we urgently have to change Conclusions © 2012, [email protected] 5 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 6 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf Keynote Chip in Brasilia - SBCCI 2012, 25th Symposium on Integrated Circuits and System Design, August 30 – September 2, 2012, Brasilia, Brasil 1 Reiner Hartenstein, TU Kaiserslautern, Germany [email protected] http://hartenstein.de 13 September 2012 The Productivity Paradox Banking with computers? TU Kaiserslautern TU Kaiserslautern (an example) Robert Solow Nobel Prize 1987 From early 1970s to early 1990s a massive slow-down in economic growth The Productivity Paradox of IT: “discrepancy between IT investment and output”… … at company level, national economy, and worldwide Literature. Robert Solow: We'd better watch out; NYT Book Review, July 12, 1987, Brynjolfsson, Erik: The productivity paradox of information technology; Comm. ACM 36 (12), 1993 Jack E. Triplett: The Solow productivity paradox; Can. J. of Economics, 32,2, 1999 http://xputer.de/CJE/ took 10 minutes © 2012, [email protected] 7 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 8 http://hartenstein.de 45 years Software Crisis So many Experts ??? TU Kaiserslautern TU Kaiserslautern F. L. Bauer 1968: All software developers know that projects „Software Crisis“ typically run over budget and behind schedule. >10% projects abandoned >30% not successful >50% late or over budget Before multi-core crisis: rapdily growing clock speed: Wirth‘s Law “software is slowing faster [Niklaus Wirth] than hardware is accelerating“ … much more SE conferences …. © 2012, [email protected] 9 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 10 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf „Software“ stands for extremely memory-cycle-hungry instruction streams Scientific Revolutions TU Kaiserslautern TU Kaiserslautern Science does not progress continuously - about the uglyness of this term: Thomas S. Kuhn 1960: It proceeds as a series of The Structure of revolutionary upheavals Patterson’s Law: Nathan’s Law: Scientific Revolutions bandwidth gap grows 50% / year Software is a gas. It expands http://xputer.de/Kuhn/ Shortcomings in an established Dave - has reached >1000x to fill all its containers ... Patterson paradigm produce a crisis … until being limited by Moore’s Law that may lead to a revolution to Nathan [& Kryder’s Law] “The Memory Wall” Myhrvold replace the established paradigm coined by Sally McKee (& co-author) . But sometimes an enduring massive “The von Neumann overhead piles up to code sizes crisis does not lead to a revolution C.V. Syndrome” Ramamoorthy, of astronomic dimensions However, some „revolutions“ may even UC Berkeley introduce much worse shortcomings MLOC = Million Windows Vista: > 50 MLOC SAP NetWeaver : >250 MLOC Lines Of Code An example: Marvin Minsky 1969 © 2012, [email protected] 11 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 12 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf Keynote Chip in Brasilia - SBCCI 2012, 25th Symposium on Integrated Circuits and System Design, August 30 – September 2, 2012, Brasilia, Brasil 2 Reiner Hartenstein, TU Kaiserslautern, Germany [email protected] http://hartenstein.de 13 September 2012 A long time no Revolution The Catastrophe Gap TU Kaiserslautern TU Kaiserslautern [Harold „Bud“ Lawson] Unsolved Multicore, HPC and FPGA Programming dilemma unnecessary complexity inside Decades of tunnel vision – e.g. Software Engineering*: *) Ernst Denert, “from fashion to fashion, but no real improvements” founder sd&m complexity Fundamental misconceptions in the theory of algorithmic complexity block further progress**. We have to rethink the basic assumptions**. ** catastrophe gap We cannot afford further dominance of reductionism ) James Larus We must radically reinvent computing and its education framework year © 2012, [email protected] 13 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 14 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf How Societies Chose Shut down Data Stations? TU Kaiserslautern to Fail or Succeed TU Kaiserslautern computers in this context: COMPUTER, August 2008 G. Fettweis, E. Zimmermann: Power consumption by internet: ICT Energy Consumption - Trends and Challenges; WPMC'08, x30 til 2030 if trends continue Lapland, Finland, 8 –11 Sep 2008 Will our IT culture partly destroy itself ? or our economy? e. g. Flash Crash © 2012, [email protected] 15 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 16 © Newhttp://hartenstein.de York Times Affordability of Computing TU Kaiserslautern TU Kaiserslautern Outline [datacenterknowledge.com] Google causing 2% electricity consumption worldwide ? The ubiquitous everlasting Computing Crisis The von Neumann Syndrome and its history Datastream-based Computing is not new The sustained Language Selection problem „The possibility of computer equipment We must Reinvent Programmer Education power consumption spiraling out of control could have serious consequences PELAMIS wave power Conclusions for the overall affordability of computing” Google sells electricity 17 [L. A. Barroso, Google] © 2012, [email protected] http://hartenstein.de © 2012, [email protected] 18 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf Keynote Chip in Brasilia - SBCCI 2012, 25th Symposium on Integrated Circuits and System Design, August 30 – September 2, 2012, Brasilia, Brasil 3 Reiner Hartenstein, TU Kaiserslautern, Germany [email protected] http://hartenstein.de 13 September 2012 The History of Computing The History of Computing TU Kaiserslautern (1) TU Kaiserslautern Prototype 1884: Herman Hollerith (2) the first reconfigurable computer (picture from earlier talks) datastream-based ! The 1st electrical computer, ready prototyped for mass production ? Guess: which year, which company ? non-volatile !! The LUT (lookup table) first Xilinx FPGA 100 years later © 2012, [email protected] 19 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf © 2012, [email protected] 20 http://hartenstein.de Punched Card Data Memory „Dataflow“ Machine TU Kaiserslautern … state of the art ….. TU Kaiserslautern Bizarre architecture motivated by loving dataflow graphs Not yet invented in 1884: arbiter-driven queue machine: fully indeterministic operation • magnetic tape (1898), principles (no program counter) • the vacuum tube (1904), despite of highest ranking US universities‘ support efforts • magnetic drum (1932), the scene is dead, meanwhile • the transistor (1934), Data-Flow* DFM: Execution Models new for Extreme Scale • ferrite core memory (1949), Computing workshop (DFM 2012) series • hard disc (1956). *) bad name: it‘s on datastream computing http://www.cs.ucy.ac.cy/dfmworkshop/ 22 © 2012, [email protected] 21 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf http://arch© 2012, [email protected]/conferences/83 http://xputer.de/UnB/Reiner-http://hartenstein.deSBCCI-12.pdf the ENIAC Electronic Numerical Another Bizarre „Programming“ the ENIAC Integrator and Computer TU Kaiserslautern „Paradigm Shift TU Kaiserslautern 167 m2 30 tons, 178 kW no datastream computer 17468 vacuum tubes no stored-program computer data input © 2012, [email protected] 23 http://hartenstein.de © 2012, [email protected] 24 http://hartenstein.de Keynote Chip in Brasilia - SBCCI 2012, 25th Symposium on Integrated Circuits and System Design, August 30 – September 2, 2012, Brasilia, Brasil