DOCSLIB.ORG

CLOUD COMPUTING – It's About the Data

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text

Load more

CLOUD COMPUTING > – It's about the data Dr. Jim Baty Distinguished Engineer Chief Architect, VP / CTO Global Sales & Services, Sun Microsystems CClloouudd CCoommppuuttiinngg –– –– iitt''ss aabboouutt nnootthhiinngg nneeww – it changes everything – it changes everything New York Times, June 14, 2006 Jan. 22, 2009 Sun Microsystems 2009 2 Cloud Computing – “... data is mostly resident on servers 'somewhere on the Internet' and the application runs on both the 'cloud servers' and the user's browser.” Eric Schmidt The Information Factories • George Gilder • Wired 14.10 2006 • The desktop is dead. Welcome to the Internet cloud... Jan. 22, 2009 Sun Microsystems 2009 3 chmod 777 s e – petascale-content, tribal-knowledge: driving future infrastructure c i v e d Web 4.0 / The Intelligent Web s t n e Web 3.0 g a The Semantic Web A.I. (read-write-execute) e.g. Cycorp Semantics Web 2.0 e.g. Metaweb The Social Web Tagging s n (read-write) e.g. Technorati Linguistics a e.g. Attensity m u Web 1.0 Statistics h The World Wide Web t e.g. Google s (read-only) u j just 'data' social content / execution Web 1-4.0 ala Nova Spivak Internet pop. – 2000=360M, 2008=1.2B, 2010=2B they won't use PCs, they will be 'programmers' Jan. 22, 2009 Sun Microsystems 2009 4 'Pay by the Drink'(N. Carr, the Big Switch) – But how are you going to measure, control, pay? As in .... app • SaaS – SW as a service (Salesforce, GoogleApps) platform svc S containers a a • PaaS – Platform as a Service P guest (Google App Engine) OS • IaaS – Infrastructure as a Service host OS S (AWS - EC2/S3) a a I CPU disk Jan. 22, 2009 Sun Microsystems 2009 5 Business models & Use cases – Set clear, focussed, few priorities Rent or Build? Use How? • Use the cloud, > don't own hardware, > start-ups, development / research projects • Leverage the Cloud > temporary on-demand load > functional off-load • Build an 'internal' cloud > enterprise infrastructure grid (internal 'AWS') > standardized dev env / services (internal 'Google Apps) • Be the cloud > new businesses offering clouds or cloud services Jan. 22, 2009 Sun Microsystems 2009 6 How / Why do clouds form? – Balancing 'Infrastructure' and 'Platform' ● Minimize costs – ● convert IT costs from capex to opex ● Cloud computing begins as a way to improve infrastructure resource deployment and utilization ● Maximize return – ● IT as a competitive weapon ● Cloud computing begins as a way to transform application development Jan. 22, 2009 Sun Microsystems 2009 7 Key Cloud Tech - Virtualization Type 1 Hypervisor •runs on bare metal •e.g. VMware ESX, xVM xVM – a Xen-based type 1 hypervisor – built in a Solaris container – providing unique capabilities Type 2 hypervisor multi-threaded CPUs, • runs inside an OS 10GbE links & • e.g. VMware Server, Virtual Box QoS control Jan. 22, 2009 Sun Microsystems 2009 8 Cloud Services / Developer Continuum – lock-in vs. choice decisions – generic API ?? Google App Engine Developer Developer lock-in independence Google App Engine Sun Project Caroline AWS EC2 – AMIs Compute Model HTTP Request Handler Process Linux OS Instance Service Creation Java, Ruby, PHP, Perl, any (including native Python (no native code) Language Python,(no native code) code) network ZFS S3, network block Storage: Files local read-only local tempFS storage, local tempFS Storage: DB BigTable PostgreSQL SimpleDB Network Hidden Private Network Shared Network Net. Protocols HTTP/S, SMTP TCP, UDP TCP, UDP NAT (static & dynamic) Internet Hidden VPN, direct NAT (static) Connectivity L4 & L7 Load Bal. DNS static dynamic fixed Jan. 22, 2009 Sun Microsystems 2009 9 What's running in the Cloud? – A shifting development model but which do I write to? 1998 2008 ? Jan. 22, 2009 Sun Microsystems 2009 10 Cloud Space Ecosytem – it's about the partners & services added value on-ramps, services n o i t c a r t s b A f o l e v e L core infrastructure providers Developer vs Enterprise Jan. 22, 2009 Sun Microsystems 2009 11 Super-scale Cloud Architectures – It's about 'components' & patterns Load Balancing Moving to open sourcing Unstructured enterprise patterns Sessions Data ● L7 HW – hi perf but expensive Keep thin for scalability Moving from local to ● Local Sessions (PHP, APC) == bad global FS ● Centralized Sessions (DB) good ● replication is hard ● No sessions == awesome Structured Data Caching Scale out while Application server, watching database server or complexity both ● tough to scale / ● modPerl – vertical is best invalidation hard ● typical apps 80% ● query cache – read Data Set Intensive low performance ● ● design schema to Computing memcached – needs app logic avoid collision Exploding area ● becoming the new 'value' Derived from Cal Henderson's 'Building Scalable Web Sites' Jan. 22, 2009 Sun Microsystems 2009 12 What's New / Next ? – Data Intensive Computing FOSS Analytics Semi Structured 'Data' The End of Science • Chris Anderson • Wired 16.07 2008 • The quest for knowledge now begins with massive amounts of data. Jan. 22, 2009 Sun Microsystems 2009 13 the Data 'Tsunami' – ingest, archive, distributed, fast, open..... MORE • 281 exabytes • 45GB /person • 10X growth in 5 years • 50% thrown away • excess 'halo' effect ➢ 1.1 MB email to 4 people = 51.5 MB Data From IDC 'Digital Universe' Jan. 22, 2009 Sun Microsystems 2009 14 Refactoring Storage as a Service – Critical for Data Intensive computing ? General Purpose Storage 'Servers' – Combine server with disk & networking – Specialized software enables general purpose systems designs to provide high performance data services Sun's Open Storage Platform direction • Sun Fire X4500/4540 – Thumper/Thor 2 dual-core Opteron, 64GB, 48 hot-plug SATA drives, 48TB in 4 RU • Sun Storage 7000 Unified Storage System Hybrid ready architecture High performance analytics data functionality moves to the infrastructure Jan. 22, 2009 Sun Microsystems 2009 15 Three Product Units – What's our 'Cloud' strategy? –The Network is the Computer Cloud Computing & Developer Platforms • DDeevveelloopp cclloouudd--eennaabblliinngg tteecchhnnoollooggiieess && sseerrvviicceess • HHeellpp ccuussttoommeerrss bbuuiilldd && Application Platform Software ooppeerraattee cclloouuddss > ffoorr oowwnn uussee oorr aass aa sseerrvviiccee • OOppeerraattee aa ppuubblliicc cclloouudd sseerrvviiccee Systems Platforms > ssttaarrtt wwiitthh IIaaaaSS && mmoovvee uupp • DDrriivvee ooppeenn ssttaannddaarrddss aanndd xVM ccoommmmuunniittiieess Jan. 22, 2009 Sun Microsystems 2009 16 Which is the “cloud computer”? Jan. 22, 2009 Sun Microsystems 2009 17 > THANK YOU.
Recommended publications
  • System Administration Storage Systems Agenda

    System Administration Storage Systems Agenda

    System Administration Storage Systems Agenda Storage Devices Partitioning LVM File Systems STORAGE DEVICES Single Disk RAID? RAID Redundant Array of Independent Disks Software vs. Hardware RAID 0, 1, 3, 5, 6 Software RAID Parity done by CPU FakeRAID Linux md LVM ZFS, btrfs ◦ Later Hardware RAID RAID controller card Dedicated hardware box Direct Attached Storage SAS interface Storage Area Network Fiber Channel iSCSI ATA-over-Ethernet Fiber Channel Network Attached Storage NFS CIFS (think Windows File Sharing) SAN vs. NAS PARTITIONING 1 File System / Disk? 2 TB maybe… 2TB x 12? 2TB x 128 then? Partitioning in Linux fdisk ◦ No support for GPT Parted ◦ GParted Fdisk Add Partition Delete Partition Save & Exit Parted Add Partition Change Units Delete Partition No need to save Any action you do is permanent Parted will try to update system partition table Script support parted can also take commands from command line: ◦ parted /dev/sda mkpart pri ext2 1Mib 10Gib Resize (Expand) 1. Edit partition table ◦ Delete and create with same start position 2. Reload partition table ◦ Reboot if needed 3. Expand filesystem Resize (Shrink) 1. Shrink filesystem ◦ Slightly smaller than final 2. Edit partition table ◦ Delete and create with same start position 3. Reload partition table ◦ Reboot if needed 4. Expand filesystem to fit partition No Partition Moving LOGICAL VOLUME MANAGER What is LVM? A system to manage storage devices Volume == Disk Why use LVM? Storage pooling Online resizing Resize any way Snapshots Concepts Physical Volume ◦ A disk or partition Volume Group ◦ A group of PVs Logical Volume ◦ A virtual disk/partition Physical Extent ◦ Data blocks of a PV Using a partition for LVM Best to have a partition table 1.
  • ORACLE MAGAZINE Jonathan Vincenzo, Dan Vlamis Is PROVIDED on an “As Is” Basis

    ORACLE MAGAZINE Jonathan Vincenzo, Dan Vlamis Is PROVIDED on an “As Is” Basis

    JULY/AUGUST 2010 Oracle Enterprise Manager 11g New release delivers business-driven IT management / 21 Deriving and Sharing BI Metadata Integrate Oracle Warehouse Builder 11g Release 2 information with Oracle Business Intelligence Enterprise Edition / 59 Automating Parallelism Take the guesswork out of setting the degree of parallelism for queries / 63 On Connecting, Pivoting, and Learning New Things Our technologist bypasses TNSNAMES.ORA, turns rows to columns, and ORACLE.COM/ORACLEMAGAZINE meets the NO_DATA_FOUND exception / 69 THE VIRTUAL ENTERPRISE From desktop to datacenter, Oracle o ers a complete virtualization solution Strategize. Plan. Execute. Gain more insight with Oracle’s enhanced enterprise performance management solution Java Hits the Road Learn the latest from Java luminaries as the Java Bus goes from code to coast One City, One Week, Three Conferences Oracle OpenWorld, JavaOne, and Oracle Develop converge on San Francisco September 19–23 JA10_cover_R1.indd 2 5/25/10 2:30:41 PM Untitled-2 1 3/22/10 8:42 PM Untitled-2 2 3/22/10 8:42 PM Oracle development PL/SQL Developer by Allround Automations. everywhere... PL/SQL Developer is the Oracle development tool that gives you maximum productivity, ease of use and all the features you need, for a reasonable price. Visit our website for additional details: www.allroundautomations.com/plsqldev 4 FEATURED CONTENT VOLUME XXIV - ISSUE 4 CONTENTS THE VIRTUAL ENTERPRISE /36 Virtualization—of desktop, server, or storage resources—requires a reliable infrastructure, solid plan, and strategic management. The payoffs include IT flexibility and efficiency, as well as server consolidation and lower energy costs. Learn how Oracle’s desktop-to-datacenter solutions can virtualize your enterprise.
  • Mysql Network

    Mysql Network

    MySQL Bests practices on Linux Serge Frezefond [email protected] Dir. Technique SUN / MySQL France Solution Linux 2009 Paris, 02-04-2009 Copyright 2006 MySQL AB The World’s Most Popular Open Source Database 1 Agenda • Architecture MySQL • DRBD Heartbeat • IO / File systems / ZFS • LVM for backups • Secure replication : checksum through SSL • Virtualization • Monitoring / Tuning • Linux memory : locking , swappiness • Dev MySQL on Linux. • Conclusion / Q&A Copyright 2009 SUN MySQL The World’s Most Popular Open Source Database 2 MySQL Architecture Copyright 2009 SUN MySQL The World’s Most Popular Open Source Database 3 MySQL : Storage Engines Partenaires InnoDB SolidBD for MySQL En cours : InfoBright – Brighthouse DWH ScaleDB NitroEDB AmazonS3 MemCache PrimeBase XT Moteur de stockage de Thinking Networks OpenOLAP Communautaire Copyright 2009 SUN MySQL The World’s Most Popular Open Source Database 4 MySQL easy install on linux • Rpm + repo • Yum install • Apt-get install • Or install from a tar.gz – allow any case of installation : multiple base dir / multiple instances per base dir • Automatic startup : – /etc/init.d/ + chkconfig (gestion des niveaux de rcx.d) Copyright 2009 SUN MySQL The World’s Most Popular Open Source Database 5 MySQL, Heartbeat & DRBD Cluster IP Management Active Passive DRBD DRBD Server Server Synchronous Block Replication Copyright 2009 SUN MySQL The World’s Most Popular Open Source Database 6 DRBD Service Service File System File System Buffer Cache Raw Device Raw Device Buffer Cache DRBD DRBD TCP/IP TCP/IP
  • Sun SPARC Enterprise T5440 Servers

    Sun SPARC Enterprise T5440 Servers

    Sun SPARC Enterprise® T5440 Server Just the Facts SunWIN token 526118 December 16, 2009 Version 2.3 Distribution restricted to Sun Internal and Authorized Partners Only. Not for distribution otherwise, in whole or in part T5440 Server Just the Facts Dec. 16, 2009 Sun Internal and Authorized Partner Use Only Page 1 of 133 Copyrights ©2008, 2009 Sun Microsystems, Inc. All Rights Reserved. Sun, Sun Microsystems, the Sun logo, Sun Fire, Sun SPARC Enterprise, Solaris, Java, J2EE, Sun Java, SunSpectrum, iForce, VIS, SunVTS, Sun N1, CoolThreads, Sun StorEdge, Sun Enterprise, Netra, SunSpectrum Platinum, SunSpectrum Gold, SunSpectrum Silver, and SunSpectrum Bronze are trademarks or registered trademarks of Sun Microsystems, Inc. in the United States and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the United States and other countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc. UNIX is a registered trademark in the United States and other countries, exclusively licensed through X/Open Company, Ltd. T5440 Server Just the Facts Dec. 16, 2009 Sun Internal and Authorized Partner Use Only Page 2 of 133 Revision History Version Date Comments 1.0 Oct. 13, 2008 - Initial version 1.1 Oct. 16, 2008 - Enhanced I/O Expansion Module section - Notes on release tabs of XSR-1242/XSR-1242E rack - Updated IBM 560 and HP DL580 G5 competitive information - Updates to external storage products 1.2 Nov. 18, 2008 - Number
  • Rethink Storage with Sun Storage 7000 Systems

    Rethink Storage with Sun Storage 7000 Systems

    An Oracle White Paper January 2010 Rethink Storage with Sun Storage 7000 Unified Storage Systems Oracle White Paper⎯Rethink Storage with Sun Storage 7000 Unified Storage Systems Introduction ......................................................................................... 1 Open Storage...................................................................................... 3 What Is Open Storage?................................................................... 3 Advantages of Open Source Software............................................ 4 Sun Storage 7000 Unified Storage Systems....................................... 4 Breaking Through Economic and Performance Barriers................. 5 Taking Advantage of Solid-State Disks with Oracle Solaris ZFS .... 6 Hybrid Storage Pools ...................................................................... 6 Radically Simple Storage ................................................................ 7 Most Comprehensive Self-Healing Storage System ....................... 8 Business Value of Hybrid Storage Pools ........................................ 9 Sun Storage 7000 Unified Storage Systems Configurations......... 10 Conclusion ........................................................................................ 12 Oracle White Paper⎯Rethink Storage with Sun Storage 7000 Unified Storage Systems Introduction The rapid growth of new digital data demands new storage architectures that offer more flexibility and radically different storage economics. IDC, a technology research firm, estimates
  • Sun Fire X4500 Server Linux and Solaris OS Installation Guide

    Sun Fire X4500 Server Linux and Solaris OS Installation Guide

    Sun Fire X4500 Server Linux and Solaris OS Installation Guide Sun Microsystems, Inc. www.sun.com Part No. 819-4362-17 March 2009, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, Java, Netra, Solaris, Sun Ray and Sun Fire X4500 Backup Server are trademarks or registered trademarks of Sun Microsystems, Inc., and its subsidiaries, in the U.S. and other countries. This product is covered and controlled by U.S. Export Control laws and may be subject to the export or import laws in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities identified on U.S. export exclusion lists, including, but not limited to, the denied persons and specially designated nationals lists is strictly prohibited. Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S. export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited. Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés. Cette distribution peut incluire des élements développés par des tiers. Sun, Sun Microsystems, le logo Sun, Java, Netra, Solaris, Sun Ray et Sun Fire X4500 Backup Server sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc., et ses filiales, aux Etats-Unis et dans d'autres pays.
  • Repository Design Report with Attached Metadata Plan

    Repository Design Report with Attached Metadata Plan

    National Digital Information Infrastructure and Preservation Program Preserving Digital Public Television Project REPOSITORY DESIGN REPORT WITH ATTACHED METADATA PLAN Prepared by Joseph Pawletko, Software Systems Architect, New York University With contributions by Nan Rubin, Project Director, Thirteen/WNET-TV Kara van Malssen, Senior Research Scholar, New York University 2010-03-19 Table of Contents Executive Summary ………………………………………………………………………………………… 2 1. Background ……………………………………………………………………………………………..... 3 2. OAIS Reference Model and Terms …………………………………………………………………… 3 3. Preservation Repository Design ……………………………………………………………………….. 3 4. Core Archival Information Package Structure …………………………………………………….. 11 5. PDPTV Archival Information Package Structure …………………………………………………... 14 6. PDPTV Submission Information Packages …………………………………………………………... 17 7. PDPTV Archival Information Package Generation and Metadata Plan ……………………... 18 8. Content Transfer to the Library of Congress .……………………………………………………….. 22 9. Summary …………………………………………………………………………………………………… 23 10. Remaining Work …………………………………………………………………………………………. 30 11. Acknowledgements ……………………………………………………………………………………. 31 Appendix 1 Glossary and OAIS Operation ……………………………………………...…………… 32 Appendix 2 WNET NAAT 002405 METS File ……………………………………………………………. 37 Appendix 3 WNET NAAT 002405 PBCore File …………………………………………………………. 41 Appendix 4 WNET NAAT 002405 SD Broadcast Master PREMIS File ...……………………………. 46 Appendix 5 WNET NAAT 002405 SD Broadcast Master METSRights File …………………………. 48 Appendix 6 WGBH
  • Repository and Preservation Storage Architecture

    Repository and Preservation Storage Architecture

    Repository and Preservation Storage Architecture Keith Rajecki Sun Microsystems, Inc. 15 Network Circle Menlo Park, CA 94025 USA [email protected] Abstract enables digital workflow and the content archive provides While the Open Archive Information System (OAIS) model permanent access to digital content files. has become the de facto standard for preservation archives, the With SAM software, the files are stored, tracked, and retrieved design and implementation of a repository or reliable long term based on the archival requirements. Files are seamlessly and archive lacks adopted technology standards and design best transparently available to other services. SAM software creates practices. This paper is intended to provide guidelines and virtually limitless capacity. Its scalability allows for continual recommendations for standards implementation and best growth throughout the archive with support for all data types. practices for a viable, cost effective, and reliable repository and The policy based SAM software stores and manages data for preservation storage architecture. This architecture is based on compliance and non-compliance archives using a tiered storage a combination of open source and commercially supported approach with integrated disk and tape into a seamless storage software and systems. solution, SAM software simplifies the archive storage. Allows you to automate data management policies based on file Although several operating systems currently exist, the logical attributes. You can manage data according to the storage and choice for an archive storage system is an open source access requirements of each user on the system and decide how operating system, of which there are two primary choices data is grouped, copied, and accessed based on the needs of the today: Linux and Solaris.
  • Новые Системы Sun+Intel+AMD

    Новые Системы Sun+Intel+AMD

    Новые системы Sun+Intel+AMD Ратмир Трошин Менеджер по развитию бизнеса Sun Microsystems 1 • Быстрое развертывание: “Запустив единожды, используй где угодно” • Высокая вычислителльная плотность: более 500 процессоров , 2000 ядер или 8000 потоков! • Многообразие и гибкость: “Что угодно, где угодно, когда угодно”. • Экономичный и экологичный • Быстрое развертывание: “Запустив единожды, используй где угодно” • Высокая вычислителльная плотность: более 500 процессоров , 2000 ядер или 8000 потоков! • Многообразие и гибкость: “Что Серверы угодно, где угодно, когда угодно”. + Архивация • Экономичный и экологичный + Сеть + Питание + Охлаждение + ПО Sun Proprietary/Confidential: Internal Use Only = Project Blackbox Sun на рынке x86 – стремимся выше! IDC Server Factory Revenue Rank 2003 2004 2005 2006 As of June 2007 #1 HP HP HP HP HP #2 Dell Dell Dell Dell IBM #3 IBM IBM IBM IBM Dell #4 Fujitsu/FS Fujitsu/FS Fujitsu/FS Fujitsu/FS Sun #5 NEC WW NEC WW NEC WW NEC WW Fujitsu/FS #6 Unisys NCR Sun Sun #7 NCR Unisys #8 Hitachi Hitachi #9 Acer Sun #10 Toshiba #11 Gateway #12 Lenovo #13 Maxdata #14 Groupe Bull Source: IDC WW Quarterly Server Tracker, Q2CY07 – all x86 revenue. Not approved by IDC for external use. Includes Thumper and Blades Уникальные системы Sun Sun Fire Открытая Sun SPARC Система X4600 платформа Enterprise на открытых Платформа M9000 стандартах виртуали- Blade зации Sun Blade 6000 Сервер Sun Fire X4450 хранения данных Sun Fire X4500 Высочайшая Основа для Высочайшая произв-сть сверхмощ- выч. обработки ных плотность видео кластеров Сервер
  • Sun HPC Software, Linux Edition 1.0, Installation Guide

    Sun HPC Software, Linux Edition 1.0, Installation Guide

    SunTM HPC Software, Linux Edition 1.0 Installation Guide Sun Microsystems, Inc. www.sun.com Part No. 820-5451-10 July 2008 Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. U.S. Government Rights - Commercial software. Government users are subject to the Sun Microsystems, Inc. standard license agreement and applicable provisions of the FAR and its supplements. This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, and Lustre are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other countries. Products covered by and information contained in this service manual are controlled by U.S. Export Control laws and may be subject to the export or import laws in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities identified on U.S. export exclusion lists, including, but not limited to, the denied persons and specially designated nationals lists is strictly prohibited. DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. This product includes source code for the Berkeley Database, a product of Sleepycat Software, Inc. Your development of software that uses the Berkeley Database application programming interfaces is subject to additional licensing conditions and restrictions imposed by Sleepycat Software Inc.
  • Solving the HPC I/O Bottleneck: Sun Lustre Storage System

    Solving the HPC I/O Bottleneck: Sun Lustre Storage System

    SOLVING THE HPC I/O BOTTLENECK: SUN™ LUSTRE™ STORAGE SYSTEM Sean Cochrane, Global HPC Sales Ken Kutzer, HPC Marketing Lawrence McIntosh, Engineering Solutions Group Sun BluePrints™ Online Part No 820-7664-20 Revision 2.0, 11/12/09 Sun Microsystems, Inc. Table of Contents Solving the HPC I/O Bottleneck: Sun Lustre Storage System ...............................1 Target Environments ........................................................................................... 1 The Lustre File System ......................................................................................... 2 Lustre File System Design ................................................................................ 3 Sun and Open Storage..................................................................................... 4 Sun Lustre Storage System Overview .................................................................... 5 Design Considerations ..................................................................................... 6 Hardware Components.................................................................................... 8 HA MDS Module ......................................................................................... 8 Standard OSS Module ................................................................................. 9 HA OSS Module ........................................................................................ 11 Software Components .................................................................................. 14 Performance
  • Oracle Solaris and Sun SPARC Systems—Integrated and Optimized for Enterprise Computing

    Oracle Solaris and Sun SPARC Systems—Integrated and Optimized for Enterprise Computing

    An Oracle White Paper June 2010 Oracle Solaris and Sun SPARC Systems— Integrated and Optimized for Enterprise Computing Oracle Solaris and Sun SPARC Systems—Integrated and Optimized for Enterprise Computing Executive Overview ............................................................................. 1 Introduction—Oracle Datacenter Integration ....................................... 1 Overview ............................................................................................. 3 The Oracle Solaris Ecosystem ........................................................ 3 SPARC Processors ......................................................................... 4 Architected for Reliability ..................................................................... 7 Oracle Solaris Predictive Self Healing ............................................ 8 Highly Reliable Memory Subsystems .............................................. 9 Oracle Solaris ZFS for Reliable Data ............................................ 10 Reliable Networking ...................................................................... 10 Oracle Solaris Cluster ................................................................... 11 Scalable Performance ....................................................................... 14 World Record Performance ........................................................... 16 Sun FlashFire Storage .................................................................. 18 Network Performance ..................................................................