DOCSLIB.ORG

NASA Big Data Challenges: Ames Perspective

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
NASA Big Data Challenges: Ames Perspective NASA Big Data Challenges: Ames Perspective Dr. Piyush Mehrotra Chief, NASA Advanced Supercomputing (NAS) Division [email protected] Agenda • Ames Overview • Big Data Challenges for Users • NASA Supercomputing – HECC project • Big Data related projects @ NAS National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 2 • Occupants: ~1130 civil servants; ~2,100 contractors;1,650 tenants Ames Research Center ~1344 summer students in 2015 • FY2016 Budget: ~$915M (including reimbursable/EUL) • ~1,900 acres (400 acres security perimeter); 5M building ft2 • Airfield: ~9,000 and 8,000 ft runways National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 Partnerships at Ames • Partnering with external organizations to access capabilities under collaborative agreements • Entering into reimbursable agreements for partner access to NASA capabilities • Expanding overall landscape of space activity (maximizing public and private sector growth) • Spurring innovation International Commercial Virtual Institutes Interagency NAI: the Community Military NASA Research Park Academia NASA Centers National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 Core Competencies at Ames Today Space and Earth Sciences Intelligent/ Air Traffic Entry Adaptive Management Systems Systems Advanced Computing Cost-Effective Astrobiology and Life Space Missions Aerosciences & IT Science Systems National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 National Strategic Computing Initiative Executive Order -- Creating a National Strategic Computing Initiative, July 2015 Objectives: 1. Accelerate delivery of a capable exascale computing system delivering approximately 100 times the performance of current systems across a range of applications. 2. Increase coherence between the technology base used for modeling and simulation and that used for data analytic computing. 3. Establish a viable path forward for future HPC systems even after the limits of current semiconductor technology are reached (the "post-Moore's Law era"). 4. Increase the capacity and capability of an enduring national HPC ecosystem. 5. Develop an enduring public-private collaboration to ensure that the benefits of the research and development advances are shared among government, industrial, and academic sectors. National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 6 High-End Computing Capability (HECC) NASA’s Premier Supercomputer Center Resources have broad mission impact across all of NASA’s Mission Directorates Over 500 science & engineering projects with more than 1,500 users (hosted by the NASA Advanced Supercomputing (NAS) Division at Ames) • Pleiades – 7.25 PF peak – Distributed memory cluster SGI Altix ICE – 246K-core; 11472 nodes; 4 Xeon generations – #15 (#7 in US) on TOP500; #9 in HPCG list (06/2016) • Specialized Hardware – Endeavour: shared memory nodes – 1024 core 4 TB & 512 core 2 TB – GPGPU nodes: 64 nodes NVIDIA Tesla K40 2 bldgs, 4 floors – Xeon Phi: 20 many-integrated core nodes 26,600 sq. ft. – NVIDIA DGX-1: 8 Tesla Pascale GPUs for machine learning 6.25 MW elec. power • Storage: ~30 PB disk; ~500 PB tape capacity 2160 tons cooling • Networking: 10 Gb/s external peering National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 7 Integrated Spiral Support for MS&A Develop and deliver the most productive integrated supercomputing environment in the world, enabling NASA to extend technology, expand knowledge, and explore the universe NASA Mission Challenges Outcome: Dramatically enhanced understanding and Scientists and engineers plan computational insight, accelerated science and engineering, and analyses, selecting the best-suited codes to increased mission safety and performance address NASA’s complex mission challenges Performance Data Analysis Optimization and Visualization NAS visualization experts apply advanced data analysis and rendering techniques to help users explore and understand NAS software experts large, complex computational utilize tools to parallelize results and optimize codes, dramatically increasing simulation performance Computational Modeling, while decreasing turn-around time Simulation, & Analysis NAS support staff help users to productively utilize NASA’s supercomputing environment (hardware, software, networks, and National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 storage) to rapidly solve large computational problems Big Data Challenges for NASA Users Data Discovery – finding what data is available and where NASA supports • Indexing, federated metadata service and semantic reasoning enormous collections of Data management – transferring very large data sets from archives to big data sets: computational resources • Increased WAN bandwidth • Fault tolerant and resilient hardware/software infrastructure Observational Data Estimate 100+ active Tools/models/algorithms - developing analytics/analysis software at scale satellites producing 50PBs • Mechanisms for sharing software to reduce duplication per year Analysis workflow – increasing complexity of processing pipelines have multiple components requiring heterogeneous resources Model Data • Software for workflow description and management to tie all components together and NAS has 30 PBs of online facilitate re-use storage- MITGcm run produced > 3PBs Analysis/Analytics infrastructure – inadequacy of available resources • I/O infrastructure Experimental Data • Large memory spaces for in-core analysis • Support for the heterogeneous resources in an integrated environment: distributed Wind tunnel tests projected memory & shared memory systems, hadoop cluster, accelerators, FPGAs etc. to produce 100 TBs per test Data Dissemination– difficult to share knowledge across a wider community • Support for dissemination and sharing of code, data products, results, etc….. National Aeronautics and Space Administration BasedNASA on Big a HECCData Task survey Force,: NAS September Technical 2016 Report: NAS-2014-02.pdf 9 Big Data Challenges for NASA Users Data Discovery – finding what data is available and where NASA supports • Indexing, federated metadata service and semantic reasoning enormous collections of Data management – transferring very large data sets from archives to big data sets: computational resources Fun Fact: The term “Big• Data”Increased WANwas bandwidth first used by Michael Cox & David • Fault tolerant and resilient hardware/software infrastructure ObservationalEllsworth Data of the NAS Division at Ames in their paper: Estimate 100+ active Tools/models/algorithms - developing analytics/analysis software at scale “Visualizingsatellites producing flow 50PBs around an• Mechanismsairframe for” sharing Visualization software to reduce 97, duplication Phoenix AZ. per- yearBiggest data set consideredAnalysis workflow 7.5 GB – increasing; high -complexityend analysis of processing machines pipelines have had multiple components requiring heterogeneous resources Model Dataless than 1GB memory• Software for workflow description and management to tie all components together and NAS has 30 PBs of online facilitate re-use storage- MITGcm run produced > 3PBs Analysis/Analytics infrastructure – inadequacy of available resources •I/O infrastructure Experimental Data • Large memory spaces for in-core analysis • Support for the heterogeneous resources in an integrated environment: distributed Wind tunnel tests projected memory & shared memory systems, hadoop cluster, accelerators, FPGAs etc. to produce 100 TBs per test Data Dissemination– difficult to share knowledge across a wider community • Support for dissemination and sharing of code, data products, results, etc….. National Aeronautics and Space Administration BasedNASA on Big a HECCData Task survey Force,: NAS September Technical 2016 Report: NAS-2014-02.pdf 10 Merging HPC and Data Analysis @ NAS: Data Intensive Supercomputing Environment Collaboration / User Portals Cloud-based data servers, web servers Data Resources Large-scale Compute Analytics/Analysis Data Rces1 Platforms Pleiades Endeavour • Optimized for analytics/analysis Optimized for large-scale - Visualization engines • User & community Datasets simulation and analysis - Accelerators • Shared across platforms - FPGAs • Tools for data/workflow High-speed WAN connection management; machine learning External • Data Repositories Data Resources • Experimental sources(labs, wind tunnels, etc.) National Aeronautics and Space Administration NASA Big Data Task Force, September 2016 11 Big Data Related Projects @ NAS • Mining network flows for cyber-security risk assessment Applications • Tree cover classification for continental US • … • Machine learning algorithms using GPUs/Xeon Phis/FPGAs Analytics • Large scale analytics on distributed and shared memory architectures • Collaboration platform for scientists (NASA Earth eXchange - NEX) Support Software • Ontology-based data search environment for observational data • Data tagging for security and data discovery • Workflow management system with automated provenance capture • Optimization of Lustre calls to improve QOS for applications System Software • Support for caching using SSDs - Lustre - target metadata and/or user access - Analysis – as local disks or fast global “file” system (RDMA over IB) • SSDs for I/O optimization – linux-based block device software Hardware Infrastructure • Specialized clusters for data analytics § Xeon PHI,
Load more

Recommended publications
  • Performance Evaluation of the Intel Sandy Bridge Based NASA
    Performance Evaluation of the Intel Sandy Bridge Based NASA Pleiades Using Scientific and Engineering Applications Subhash Saini, Johnny Chang, Haoqiang Jin NASA Advanced Supercomputing Division NASA Ames Research Center Moffett Field, California 94035-1000, USA {subhash.saini, johnny.chang, haoqiang.jin}@nasa.gov Abstract — We present a performance evaluation of Pleiades based based on the Many Integrated Core (code-named Knight’s on the Intel Xeon E5-2670 processor, a fourth-generation eight-core Corner) architecture and Yellowstone [1, 5, 6]. New and Sandy Bridge architecture, and compare it with the previous third extended features of Sandy Bridge architecture are: generation Nehalem architecture. Several architectural features have been incorporated in Sandy Bridge: (a) four memory channels as a) A ring to connect on-chip L3 cache with cores, system opposed to three in Nehalem; (b) memory speed increased from 1333 agent, memory controller, and QPI agent and I/O MHz to 1600 MHz; (c) ring to connect on-chip L3 cache with cores, controller to increase the scalability. L3 cache per core system agent, memory controller, and QPI agent and I/O controller to has been increased from 2 MB to 2.5 MB. increase the scalability; (d) new AVX unit with wider vector registers of 256 bit; (e) integration of PCI-Express 3.0 controllers into the I/O b) New micro-ops (L0) cache that caches instructions as subsystem on chip; (f) new Turbo Boost version 2.0 where base they are decoded. The cache is direct mapped and can frequency of processor increased from 2.6 to 3.2 GHz; and (g) QPI link store 1.5 K micro-ops.
    [Show full text]
  • President Lands at Moffett Field During Silicon Valley Visit by Huong Nguyen and Jessica Culler President Barack Obama’S Arrival Onboard Air Force One on Sunday, Sept
    Fall 2011 - A Quarterly Publication Thousands turn out to tour airborne observatory at Ames The Stratospheric Observatory for In- frared Astronomy (SOFIA) visited NASA Ames and provided a rare opportunity to tour the airborne observatory in October. News media and Ames employees were invited to tour on Friday, Oct. 14 and the public on Saturday, Oct. 15. On Friday, an estimated 2,500 people, including representatives from CNET, Fox News, KQED (PBS), New Scientist, Space. com, Mountain View Patch and the San Mateo Daily Journal attended the event. On Saturday, an estimated 5,500 people visited Ames to tour SOFIA. See page 6 for a feature about the SOFIA visit. NASA photo by Doiminic Hart President lands at Moffett Field during Silicon Valley visit BY HUONG NGUYEN AND JESSICA CULLER President Barack Obama’s arrival onboard Air Force One on Sunday, Sept. 25, 2011, at Moffett Federal Airfield marked his first land- ing at NASA Ames. Center Director Pete Worden met President Barack Obama upon his arrival. "I had the honor to meet President Obama when he arrived at Moffett Federal Airfield," said Worden, who along with San Jose Mayor Chuck Reed and Mountain View Mayor Jac Siegel, greeted the president. "It was fitting that the president came to Silicon Valley to talk about his job creation plan, given how critical Silicon Valley is to the future of the U.S. economy," Worden said. NASA Ames is an integral com- ponent of the world-renowned inno- vation economy and actively partici- pates in the valley’s technological Photo credit: Official White House Photo by Pete Souza and scientific evolution.
    [Show full text]
  • The Outer Limits
    Welcome to the outer limits Budapest, March 19, 2013 M.Sc. Ji ří Hlavá č HPC consultant + sales manager for CEE [email protected] ©2012 Silicon Graphics International Corp. / Presented Only Under Non-Disclosure Agreement 1 Jiri Hlavac (by Czech Ji ří Hlavá č) 51 years old, 4 children … • MSc. Computers (1986) • Development of PC OSs for Tesla Czech (1986-1989) • Own SW company (1986-1991) • Owner SGI Distributor @ Czechoslovakia (1991-1995) • Employee @ SGI Czech office (1995-now) • Technical Director, Academic Sales, Enterprise Sales • HPC Consultant (2001-2011) • Sales Manager for Central + East Europe (2005-now) ©2012 Silicon Graphics International Corp. / Presented Only Under Non-Disclosure Agreement 2 SGI = Experts @ HPC Structural Mechanics Structural Mechanics Computational Fluid Electro-Magnetics Implicit Explicit Dynamics Computational Chemistry Computational Chemistry Computational Biology Seismic Processing Quantum Mechanics Molecular Dynamics Reservoir Simulation Rendering / Ray Tracing Climate / Weather Data Analytics Ocean Simulation ©2012 Silicon Graphics International Corp. / Presented Only Under Non-Disclosure Agreement 3 SGI = Focus on every detail (here Power Consumption) ©2012 Silicon Graphics International Corp. / Presented Only Under Non-Disclosure4 Agreement 4 SGI = Frontier @ Research SGI = Winner of last HPCwire Readers' Choice Award (Nov 2012) for "Top Supercomputing Achievement" for SGI contribution to the NASA Ames Pleiades supercomputer. SGI = Winner of last HPCwire Editor's Choice Award (Nov 2012) for "Best use of HPC in 'edge HPC‘ application" for Wikipedia historical mapping and exploration on UV 2000. SGI stock is growing 5 ©2012 Silicon Graphics International Corp. / Presented Only Under Non-Disclosure5 Agreement 5 Advanced Energy Exploration and Production Total: World's Largest Commercial HPC System (2.3 PF) SGI ICE ©2012 Silicon Graphics International Corp.
    [Show full text]
  • NASA Announces a New Approach to Earth Science Data Analysis 20 April 2010
    NASA Announces A New Approach To Earth Science Data Analysis 20 April 2010 (PhysOrg.com) -- The way we analyze planet Earth than ten hours. will never be the same, thanks to a new initiative at NASA that integrates supercomputers with global NEX uses a new approach for collaboration among satellite observations and sophisticated models of scientists and science teams working to model the the Earth system in an online collaborative Earth system and analyze large Earth observation environment. As part of its celebration of Earth datasets. Using on-line collaboration technologies, Week, NASA unveiled the NASA Earth Exchange NEX will bring together geographically dispersed (NEX) at a “Green Earth” public forum held at the multi-disciplinary groups of scientists focused on NASA Exploration Center, Moffett Field, Calif. global change research. Scientists will be able to build custom project environments containing the By making NEX available, NASA expects to better datasets and software components needed to solve enable scientists to collaboratively conduct complex Earth science problems. These project research and address the impacts of changes in environments, built using virtualization technology, climate and land use patterns on ecosystems. NEX will be highly portable and reusable and will will link NASA’s supercomputing resources with automatically capture the entire analysis process, massive Earth system data sets, and provide a including the data and processing steps required to collection of tools for analysis and visualization. replicate the results in an open and transparent way. For example, results from the processing of "Currently, it can require months for scientists to the global Landsat data would be available to gather and analyze global-scale data sets, due to scientists with the additional expertise required to computing limitations, data storage requirements analyze rates of urbanization, deforestation, or and network bandwidth constraints”, said biodiversity impacts.
    [Show full text]
  • Performance Evaluation of the Intel Sandy Bridge Based NASA
    NAS Technical Report: NAS-2015-05 Performance Evaluation of the Intel Sandy Bridge Based NASA Pleiades Using Scientific and Engineering Applications Subhash Saini, Johnny Chang, Haoqiang Jin NASA Advanced Supercomputing Division NASA Ames Research Center Moffett Field, California 94035-1000, USA {subhash.saini, johnny.chang, haoqiang.jin}@nasa.gov Abstract — We present a performance evaluation of Pleiades based based on the Many Integrated Core (code-named Knight’s on the Intel Xeon E5-2670 processor, a fourth-generation eight-core Corner) architecture and Yellowstone [1, 5, 6]. New and Sandy Bridge architecture, and compare it with the previous third extended features of Sandy Bridge architecture are: generation Nehalem architecture. Several architectural features have been incorporated in Sandy Bridge: (a) four memory channels as a) A ring to connect on-chip L3 cache with cores, system opposed to three in Nehalem; (b) memory speed increased from 1333 agent, memory controller, and QPI agent and I/O MHz to 1600 MHz; (c) ring to connect on-chip L3 cache with cores, controller to increase the scalability. L3 cache per core system agent, memory controller, and QPI agent and I/O controller to has been increased from 2 MB to 2.5 MB. increase the scalability; (d) new AVX unit with wider vector registers of 256 bit; (e) integration of PCI-Express 3.0 controllers into the I/O b) New micro-ops (L0) cache that caches instructions as subsystem on chip; (f) new Turbo Boost version 2.0 where base they are decoded. The cache is direct mapped and can frequency of processor increased from 2.6 to 3.2 GHz; and (g) QPI link store 1.5 K micro-ops.
    [Show full text]
  • Project Status Report High End Computing Capability Strategic Capabilities Assets Program December 10, 2014
    Project Status Report High End Computing Capability Strategic Capabilities Assets Program December 10, 2014 Dr. Rupak Biswas – Project Manager NASA Ames Research Center, Moffett Field, CA [email protected] (650) 604-4411 www.nasa.gov Pleiades Achieves 3.38 Petaflops, Ranks 7th in U.S. and 11th Worldwide on TOP500 List • On the November 2014 TOP500 list of the world’s Mission Impact: Enhancing NASA’s most powerful most power supercomputers, Pleiades ranked 7th in supercomputer and running subsequent diagnostic the U.S. and 11th worldwide, with an impressive tests enables HECC to validate the entire system, improving stability for all jobs. efficiency of 84.6%. The new list was released on November 17 at the SC14 conference in New Orleans (see slide 11). • The HECC Systems team worked with SGI engineers to complete system-wide testing on Pleiades, including a LINPACK benchmark run, prior to the release of new Intel Haswell processors for general production on October 27. • During the LINPACK run, Pleiades delivered a sustained performance of 3.38 petaflops using 73% of its compute nodes, representing 89% of the theoretical peak of the overall system. The benchmark was run on 1,024 Haswell nodes, 5,365 Pleiades’ increased LINPACK benchmark performance since 2008, when Ivy Bridge nodes, and 1,792 Sandy Bridge nodes. the original system was installed at the NASA Advanced Supercomputing (NAS) facility. The initial configuration achieved a sustained performance • In addition to measuring performance, the of 0.487 petaflops and 80% efficiency in benchmark testing. With the latest LINPACK run helped the Systems team detect upgrade, Pleiades achieved 84.6% efficiency on the LINPACK benchmark.
    [Show full text]
  • Pleiades • the NASA Workload • System Build Strategy • Operational Strategy • Tools and Analysis Software • Issues Do We See • Whats Lustre Does • What We Want
    NASA SuperComputing A Ground Based Instrument for Exploration and Discovery LUG 2015 Bob Ciotti Chief Architect/Supercomputing Systems Lead LUG 2015 - Denver LUG - Denver Apr 2015 Discussion • What is Pleiades • The NASA Workload • System Build Strategy • Operational Strategy • Tools and Analysis Software • Issues Do We See • Whats Lustre Does • What We Want LUG - Denver Apr 2015 Supercomputing Support for NASA Missions Jet aircraft wake vortices Jet engine • Agency wide resource noise • Production Supercomputing emissions • Focus on availability • Machines mostly run large ensembles • Some very large calculations (50k) Orbiting, Spinning – Typically o500 jobs running Detailed CLV Black Holes Geometry • Example applications • ARMD – LaRC: Jet wake vortex simulations, to increase airport capacity and safety – GRC: Understanding jet noise simulations, to decrease airport noise • ESMD – ARC: Launch pad flame trench simulations for Ares vehicle safety analysis – MSFC: Correlating wind tunnel tests and simulations of Solar surface Ares I-X test vehicle – ARC/LaRC: High-fidelity CLV flight simulation with convection detailed protuberances • SMD – Michigan State: Ultra-high-resolution solar surface convection simulation – GSFC: Gravity waves from the merger of orbiting, spinning black holes • SOMD – JSC/ARC: Ultra-high-resolution Shuttle ascent analysis • NESC – KSC/ARC: Initial analysis of SRB burn risk in Vehicle 2-SRB Burn Assembly Building in VAB Shuttle Ascent Configuration 3 LUG - Denver Apr 2015 LUG - Denver Apr 2015 ECCO – Ocean Modeling
    [Show full text]
  • NASA Advanced Supercomputing Division
    Fold here Fold here CMYK logo 8.5 x 17 Trifold Modeling & Simulation NAS High-End Computing Environment Facts National Aeronautics and Space Administration NAS expertise in fundamental and applied Pleiades modeling and simulation is essential to creating • Primary production system for all NASA mission directorates large-scale simulations supporting critical • SGI ICE X cluster connected via InfiniBand in an 11D hypercube topology NASA engineering and design decisions. Our • 126,720 cores (Intel Xeon quad-, six-, and eight-core processors) fundamental research advances numerical • 1.75 petaflop/s peak; 1.24 petaflop/s sustained performance (June 2012) methods, algorithms, and code development • 233 terabytes total memory for aeronautics research, while applied • 64 nodes enhanced with Nvidia graphics processing units modeling enables large-scale numerical simulations in several important mission areas. hyperwall-2 • 128-screen, tiled LCD wall displays, processes, and shares data—can display a single image across In support of NASA’s project to design the all screens, or can display unique images in selected “cells” heavy-lift Space Launch System, NAS compu- • Custom Colfax International system connected to Pleiades via InfiniBand NASA ADVANCED SUPERCOMPUTING DIVISION tational fluid dynamics experts developed (over 100 gigabytes-per-second connectivity) specialized software and performed thousands • 128 nodes; 2 quad-core (AMD Opteron 2354) processors per node of simulations to analyze aerodynamic • 136 Nvidia Fermi GTX 480 processors
    [Show full text]
  • Interconnect Your Future Enabling the Best Datacenter Return on Investment
    Interconnect Your Future Enabling the Best Datacenter Return on Investment TOP500 Supercomputers, June 2017 InfiniBand Accelerates Majority of New Systems on TOP500 . InfiniBand connects 2.5 times more new systems versus OmniPath . EDR InfiniBand solutions grew 2.5X in six months . Mellanox accelerates the fastest supercomputer in the world . InfiniBand provides 1.7X Higher ROI for Petascale Platforms . Mellanox connects 39% of overall TOP500 systems (192 systems, InfiniBand and Ethernet) . InfiniBand connects 36% of the total TOP500 systems (179 systems) . InfiniBand connects 60% of the HPC TOP500 systems . InfiniBand accelerates 48% of the Petascale systems . Mellanox connects all of 40G Ethernet systems, connects the first 100G Ethernet system on the list InfiniBand is the Interconnect of Choice for HPC Infrastructures Enabling Machine Learning, High-Performance, Web 2.0, Cloud, Storage, Big Data Applications © 2017 Mellanox Technologies 2 Mellanox Connects the World’s Fastest Supercomputer National Supercomputing Center in Wuxi, China #1 on the TOP500 List . 93 Petaflop performance, 3X higher versus #2 on the TOP500 . 41K nodes, 10 million cores, 256 cores per CPU . Mellanox adapter and switch solutions * Source: “Report on the Sunway TaihuLight System”, Jack Dongarra (University of Tennessee) , June 20, 2016 (Tech Report UT-EECS-16-742) © 2017 Mellanox Technologies 3 InfiniBand Accelerates Artificial Intelligence (AI) and Deep Learning Facebook AI Supercomputer #31 on the TOP500 List NVIDIA AI Supercomputer #32 on the TOP500 List . EDR InfiniBand In-Network Computing technology key for scalable Deep Learning systems . RDMA accelerates Deep Learning performance by 2X, becomes de-facto solution for AI © 2017 Mellanox Technologies 4 Mellanox In the TOP500 .
    [Show full text]
  • NASA, Intel, SGI Plan to 'Soup Up' Supercomputer
    May 7, 2008 NASA, Intel, SGI Plan to 'Soup Up' Supercomputer MOFFETT FIELD, Calif.--(BUSINESS WIRE)-- NASA, Intel Corp., and SGI today announced the signing of an agreement establishing intentions to collaborate on significantly increasing the space agency's supercomputer performance and capacity. Under the terms of a Space Act Agreement, NASA will work closely with Intel and SGI to increase computational capabilities for modeling and simulation at the NASA Advanced Supercomputing (NAS) facility at NASA's Ames Research Center, Moffett Field, Calif. "Achieving such a monumental increase in performance will help fulfill NASA's increasing need for additional computing capacity and will enable us to provide the computational performance and capacity needed for future missions," said Ames Director S. Pete Worden. "This additional computational performance is necessary to help us achieve breakthrough scientific discoveries." NASA Ames, Intel and SGI will work together on a project called Pleiades to develop a computational system with a capacity of one Petaflops peak performance (1,000 trillion operations per second) by 2009 and a system with a peak performance of 10 Petaflops (10,000 trillion operations per second) by 2012. "Throughout its history, NASA has sought to explore the most compelling questions about mankind, Earth, and the worlds that await our discovery," said Robert "Bo" Ewald, chief executive officer of SGI. "SGI is proud to be part of this effort. These groundbreaking new systems powered by SGI and fueled by the latest multi-core Intel processors, offer a platform for new discoveries that will help us all achieve the most promising future for the human race.
    [Show full text]
  • An Automated Bolide Detection Pipeline for GOES GLM
    Highlights An Automated Bolide Detection Pipeline for GOES GLM Jeffrey C. Smith,Robert L. Morris,Clemens Rumpf,Randolph Longenbaugh,Nina McCurdy,Christopher Henze,Jessie Dotson • GOES Geostationary Lightning Mappers can be used to detect bolides. • A Random Forest detection algorithm has been deployed on the NASA Advanced Supercomputing facility Pleiades supercomputer. • Bolide light curves are promptly published on a NASA hosted publicly accessible website, https://neo-bolide.ndc.nasa.gov. arXiv:2106.09189v1 [astro-ph.EP] 17 Jun 2021 An Automated Bolide Detection Pipeline for GOES GLM a,b < a,b b,c d Jeffrey C. Smith , , Robert L. Morris , Clemens Rumpf , Randolph Longenbaugh , b b b Nina McCurdy , Christopher Henze and Jessie Dotson aThe SETI Institute, 189 Bernardo Ave, Suite 200, Mountain View, CA 94043, USA bNASA Ames Research Center, Moffett Field, CA 94035, USA cSTC, NASA Research Park, Moffett Field, CA 94035, USA dSandia National Laboratories, Albuquerque, NM 87185, USA ARTICLEINFO ABSTRACT Keywords: The Geostationary Lightning Mapper (GLM) instrument onboard the GOES 16 and 17 satellites Bolide detection has been shown to be capable of detecting bolides (bright meteors) in Earth’s atmosphere. Due to GOES GLM its large, continuous field of view and immediate public data availability, GLM provides a unique Random forest classifier opportunity to detect a large variety of bolides, including those in the 0.1 to 3 m diameter range and complements current ground-based bolide detection systems, which are typically sensitive to smaller events. We present a machine learning-based bolide detection and light curve generation pipeline being developed at NASA Ames Research Center as part of NASA’s Asteroid Threat Assessment Project (ATAP).
    [Show full text]
  • 33Rd TOP500 List
    33rd TOP500 List ISC’ 09, Hamburg Agenda • Welcome and Introduction (H.W. Meuer) • TOP10 and Awards (H.D. Simon) • Hig hlig hts of the 30th TOP500 (E. ShiStrohmaier) • HPC Power Consumption (J. Shalf) • Multicore and Manycore and their Impact on HPC (J. J. Dongarra) • Discussion 33rd List: The TOP10 Rmax Power Rank Site Manufacturer Computer Country Cores [Tflops] [MW] Roadrunner 1 DOE/NNSA/LANL IBM USA 129,600 1,105.0 2.48 BladeCenter QS22/LS21 Oak Ridge National Jaguar 2 Cray Inc. USA 150,152 1,059.0 6.95 Laboratory Cray XT5 QC 2.3 GHz Forschungszentrum Jugene 3 IBM Germany 294,912 825.50 2.26 Juelich (FZJ) Blue Gene/P Solution NASA/Ames Pleiades 4 Research SGI USA 51,200 487.0 2.09 SGI Altix ICE 8200EX Center/NAS BlueGene/L 5 DOE/NNSA/LLNL IBM USA 212,992 478.2 2.32 eServer Blue Gene Solution University of Kraken 6 Cray USA 66,000 463.30 Tennessee Cray XT5 QC 2.3 GHz ANtilArgonne National ItIntrep id 7 IBM USA 163,840 458.61 1.26 Laboratory Blue Gene/P Solution Ranger 8 TACC/U. of Texas Sun USA 62,976 433.2 2.0 SunBlade x660420 Dawn 9 DOE/NNSA/LANL IBM USA 147,456 415.70 1.13 Blue Gene/P Solution Forschungszentrum JUROPA 10 Sun/Bull SA Germany 26,304 274.80 1.54 Juelich (FZJ) NovaScale /Sun Blade The TOP500 Project • Listing the 500 most powerful computers in the world • Yardstick: Rmax of Linpack – Solve Ax=b, dense problem, matrix is random • Update twice a year: – ISC’ xy in June in Germany • SCxy in November in the U.S.
    [Show full text]