Parallel Processing: Past, Present and Future
Total Page:16
File Type:pdf, Size:1020Kb
Parallel Processing: Past, Present and Future Dr. G. Young CS 370 Dr. Young 1 What is a Supercomputer? Let us run a contest. Who gives the most updated explanation? CS 370 Dr. Young 2 Supercomputer (AllWords.com) A very fast, powerful mainframe computer, used in advanced military and scientific applications. CS 370 Dr. Young 3 Supercomputer (M-W.com, Merriam-Webster's Collegiate Dictionary) A large very fast mainframe used especially for scientific computations CS 370 Dr. Young 4 Supercomputer (Dictionary.com) A mainframe computer that is among the largest, fastest, or most powerful of those available at a given time. CS 370 Dr. Young 5 Supercomputer (FOLDOC.doc.ic.ac.uk) A broad term for one of the fastest computers currently available. Such computers are typically used for number crunching including scientific simulations, (animated) graphics, analysis of geological data (e.g. in petrochemical prospecting), structural analysis, computational fluid dynamics, physics, chemistry, electronic design, nuclear energy research and meteorology. Perhaps the best known supercomputer manufacturer is Cray Research. A less serious definition, reported from about 1990 at The University Of New South Wales states that a supercomputer is any computer that can outperform IBM's current fastest, thus making it impossible for IBM to ever produce a supercomputer. CS 370 Dr. Young 6 Supercomputer (ComputerUser.com) A very fast and powerful computer, outperforming most mainframes, and used for intensive calculation, scientific simulations, animated graphics, and other work that requires sophisticated and high- powered computing. Cray Research and Intel are well-known producers of supercomputers. CS 370 Dr. Young 7 Supercomputer (PCWebopaedia.com) The fastest type of computer. Supercomputers are very expensive and are employed for specialized applications that require immense amounts of mathematical calculations. For example, weather forecasting requires a supercomputer. Other uses of supercomputers include animated graphics, fluid dynamic calculations, nuclear energy research, and petroleum exploration. The chief difference between a supercomputer and a mainframe is that a supercomputer channels all its power into executing a few programs as fast as possible, whereas a mainframe uses its power to execute many programs concurrently. CS 370 Dr. Young 8 Supercomputer (PrenHall.com) The category that includes the largest and most powerful computers. CS 370 Dr. Young 9 Supercomputer (Geek.com) This refers to a computer that is able to operate at a speed that places it at or near the top speed of currently produced computers. Most supercomputers cost millions of dollars, and the traditional model of using one large computer with proprietary hardware is being challenged by using a cluster of cheaper computers with more standard hardware. CS 370 Dr. Young 10 Supercomputer Contest Who is the winner? AllWords.com M-W.com, Merriam-Webster's Collegiate Dictionary Dictionary.com FOLDOC.doc.ic.ac.uk ComputerUser.com PCWebopaedia.com PrenHall.com Geek.com CS 370 Dr. Young 11 Contest Winner geek.com @ 2001 (Led by Chief Geek - Joel Evans ) Used to tell people all about Geek. For example, to check out if you’re Beginner Geek, Intermediate Geek, Advanced Geek or Super Geek CS 370 Dr. Young 12 Winner Highlight (Geek.com@2001) This refers to a computer that is able to operate at a speed that places it at or near the top speed of currently produced computers. Most supercomputers cost millions of dollars, and the traditional model of using one large computer with proprietary hardware is being challenged by using a cluster of cheaper computers with more standard hardware. CS 370 Dr. Young 13 CS 370 Dr. Young 14 Topics of Discussion Introduction Computer Networks Parallel and Distributed Processing Affordable Supercomputer Future Trend and Challenge Conclusion Q&A CS 370 Dr. Young 15 Introduction Why we need Supercomputers? Supercomputer Vendors Supercomputer Products Top Supercomputers How to evaluate the power of a supercomputer? Top 10 Supercomputers Theoretical Implication of Parallel machines Areas of Research in Supercomputing Supercomputing Journals CS 370 Dr. Young 16 Why we need Supercomputers? Even though processor speed has been increased dramatically, but still not fast enough to our needs. Use multiple processors is the way to go. Areas need supercomputers: Generally involves intensive computation Aerospace, Weather, Finance, Defense, Energy, Internet, Government, Chemistry, Geophysics, Telecom, Academic, Database, Mechanics, Automotive,Transportation, Electronics, Manufacturing, Fluid Dynamic, Petroleum CS 370 Dr. Young 17 Supercomputer Vendors CS 370 Dr. Young 18 Supercomputer Products The Avalon A12 The Cambridge Parallel Processing Gamma II Plus. The Compaq AlphaServer SC Series. The Fujitsu AP3000 The Fujitsu VPP5000 series The Hitachi SR8000 system The HP Exemplar V2600 The IBM RS/6000 SP The NEC Cenju-4 The NEC SX-5 The SGI Origin 2000 series The Sun E1000 Starfire The Tera/Cray SV1 The Tera/Cray T3E They use different technologies: Processor, OS, Connection structure, Proprietary hardware and Software CS 370 Dr. Young 19 How to evaluate the power of a supercomputer? Peak-performance Theoretical Run-time Benchmarks Linpack benchmark (Top500) Finding Largest Mersenne Prime Number CS 370 Dr. Young 20 How to evaluate the power of a supercomputer? Benchmarks LINPACK Benchmark (introduced by Jack Dongarra) is to solve a dense system of linear equations. Rank Top500 supercomputers This performance does not reflect the overall performance of a given system, as no single number ever can. Since the problem is very regular, the performance achieved is quite high, and the performance numbers give a good correction of peak performance. CS 370 Dr. Young 21 How to evaluate the power of a supercomputer? Prime Number Greek mathematician Euclid proved that there are an infinite number of prime numbers. do not occur in a regular sequence no formula for generating them. Discovery of new primes requires randomly generating and testing millions of numbers. CS 370 Dr. Young 22 How to evaluate the power of a supercomputer? Largest known Mersenne Prime Numbers* before 2000 Prime Digits Year Name 2^21701-1 6533 1978 Landon Curt Noll (with Laura Nickel, Ariel Glenn) 2^23209-1 6987 1979 Landon Curt Noll 2^44497-1 13395 1979 David Slowinski (with Harry Nelson) 2^86243-1 25962 1982 David Slowinski 2^132049-1 39751 1983 David Slowinski 2^216091-1 65050 1985 David Slowinski 2^756839-1 227832 1992 David Slowinski Paul Gage 2^859433-1 258716 1994 David Slowinski Paul Gage 2^1257787-1 378632 1996 David Slowinski Paul Gage 2^1398269-1 420921 1997 David Slowinski Paul Gage 2^2976221-1 895932 1997 David Slowinski Paul Gage 2^3021377-1 909526 1998 David Slowinski Paul Gage 2^6972593-1 2098960 # 1999 David Slowinski Paul Gage * Mersenne Prime Numbers are Prime Numbers in the form of 2^<Integer> -1 # 67 pages long if printed on Newspaper CS 370 Dr. Young 23 How to evaluate the power of a supercomputer? The current largest known Mersenne Prime Numbers (in the form of 2n – 1) can be found at http://www.mersenne.org/ $$$ The Electronic Frontier Foundation is offering a $100,000 award for discovering the next largest (ten million digits) prime number CS 370 Dr. Young 24 How to evaluate the power of a supercomputer? Finding the Largest Mersenne Prime Number Slowinski: (SGI, Cray) "The prime finder program rigorously tests all elements of a system -- from the logic of the processors, to the memory, the compiler and the operating and multitasking systems. For high performance systems with multiple processors, this is an excellent test of the system's ability." CS 370 Dr. Young 25 Top 10 Supercomputers Country 2006 2007 2008 USA 6 8 6 Japan 2 Spain 1 India 1 Germany 1 1 1 France 1 2 CS 370 Dr. Young 26 Top 10 Supercomputers Country 2012 2013 2013 (Nov) (June) (Nov) USA 5 5 5 China 1 2 1 Japan 1 2 1 Germany 2 1 2 Italy 1 Switzerland 1 CS 370 Dr. Young 27 Top Supercomputers Timeline http://www.top500.org/timeline/ Top #1 System http://www.top500.org/featured/to p-systems/ CS 370 Dr. Young 28 Theoretical Implication of Parallel machines Parallel machine with infinite number of processors means we have a Non-deterministic Machine Statement like Guess({S1,S2}) can be added to our familiar deterministic program. Suddenly, those NP-hard problems (e.g. Traveling Salesman Problem) can be solved in Linear time CS 370 Dr. Young 29 Areas of Research in P&D Computing Parallel and Distributed Architectures Parallel and Distributed Algorithms Parallel Programming Languages Scientific Computing Signal & Image Processing Systems Special Purpose Processors VLSI and Configurable Logic Systems Performance Modeling/Evaluation Memory Hierarchy Issues in Parallel and Distributed Processing Programming Environments and Tools for Parallel and Distributed Platforms Compilers and Optimizations for Parallel and Distributed Processing Operating System and Runtime Support for Parallel and Distributed Computing Parallel and Distributed Network Protocols and Implementations Applications of Parallel and Distributed Computing Nontraditional Processor Technologies (Optical, Quantum, DNA, etc.) CS 370 Dr. Young 30 Supercomputing Journals International J. of Parallel ACM J. of Experimental Algorithmics Programming J. of Interconnection Networks BIT J. of Parallel and Distributed Cluster Computing Computing Computing and