SUSE® and ARM ARM and 64-bit ARM Update 2014
Andrew Wafaa Dirk Müller Principal Engineer openSUSE ARM Team ARM Ltd SUSE [email protected] [email protected] openSUSE® Runs on ...
… your laptop
… your desktop
… your server
2 openSUSE® Runs on ...
x86 … your laptop
… your desktop
x86 x86 … your server
3 Is There More? (open)SUSE® Runs on ...
155,656 x86_64 Cores with 300 TB of RAM
5 SUSE® Runs on ...
9728 ia64 Cores, 30 TB RAM
6 SUSE® Also Runs on ...
2880 Power7 (ppc64) cores
7 SUSE® Runs on Mainframe
IBM zSeries
8 Nothing More? openSUSE® on This?
10 What About openSUSE® on This?
CuBox-I Cortex A9 (IMX.6), 1GB RAM
11 openSUSE® on “Supercomputers” ;-)
•
12 ARM and Servers?
13 Data Centers are Evolving
Today Next 3 Years 5 Years +
Data center workload characteristics are scaling out
Total cost Throughput Workload of optimized ownership
14 ARM and Servers?
•
15 What is ARM? What is ARM?
• Most popular CPU architecture:
‒ More than 40,000,000,000 CPUs are ARM based
‒ 16,000,000 processors sold every day
• “Low power leadership”
• Optimized for “System on a Chip”
17 System on Chip
18 System On Chip
19 System On Chip
20 System On Chip
21 System On Chip
22 System On Chip SoC
23 ARM's “Cortex – A“ Series
ARMv8 (A57/A53)
ARMv7 (A15/A7)
ARMv7 (A8/A9)
24 ARM v5/6/7/8
CRYPTO CRYPTO
VFPv3/v4 Key feature NEON ARMv7-A Adv SIMD compatibility Thumb-2 A32+T32 ISAs A64 ISA TrustedZone Including: Including: • Scalar FP • Scalar FP SIMD (SD and DP) (SD and DP)
• Adv SIMD • Adv SIMD VFPv2 (SP Float) (SP & DP Float) AArch32 AArch64 Jazelle
ARMv5 ARMv6 ARMv7-A/R ARMv8-A
25 ARM in the Enterprise Target Workloads
• Storage
– SDS (Ceph/OrangeFS) • Scale out (Hyperscale)
– Cloud
– Big Data
– HPC • Networking
– NFV
– SDN
– Base stations
– Routers • Web
– Gateways/Frontends
27 Faster CPU is Better!
• High CPU power is not needed everywhere
‒ Static web serving/CDN, caching
‒ Batch analytics / “Big data”
‒ Cloud, dynamic web content serving (to some extend)
‒ Block storage, warehousing/cold,
28 Pick Your Battles One Size Does Not Fit All
Web NoSQL/Big Data
Hosting – Static content
Hosting – Dynamic content IO MEM CPU
Caching
Front-end Load Balancing, Proxy
Social Media Content
Web: Light SQL
Distributed Block Storage
Cold Storage
0% 25% 50% 75% 100%
29 Server Ecosystem - ODM
30 Server Ecosystem - OEM
31 Does My Workload Run on ARM?
• Java - OpenJDK & Oracle JVM
• Web - Apache / NGINX / NodeJS*
• Virtualization - KVM & Xen
• DataBase - Postgres / MariaDB / MySQL / MongoDB* / CouchDB
• Containers - LXC & Docker*
• Big Data - Hadoop
• Storage - Ceph
32 Is It A Pipe Dream?
• Used in the real world on HP Moonshot by:
– Paypal - Distributed Apache Flume
– Sandia National Labs - Green Exascale HPC
33 ARM Server Hardware Overview Why ARM Servers ? Why now?
http://www.google.com/about/datacenters/
35 Why ARM Servers? Why now?
• Workload optimized solutions significantly increased TCO
– One size doesn’t fit all (anymore) – TCO is king at large scale
– New workloads and scale forced re-evaluation of what’s optimal
http://www.google.com/about/datacenters/
36 Why ARM Servers? Why now?
• Value chain is seeking increased innovation and choice
– Many ARM solutions coming to market - competition is healthy!
– Faster innovation needed by cloud & web leaders
http://www.google.com/about/datacenters/
37 Why ARM Servers? Why now?
• ARM business model enables innovation & differentiation
– It’s not just about a low power core – it’s what you put around it
– ARM cores already used in networking & storage components
– Experts in those fields can leverage their existing IP
http://www.google.com/about/datacenters/
38 ARM Server Hardware Overview
39 AMD ‚Seattle‘ @ OCP V - 01/2014
40 HP Moonshot System
The new style of IT drives business revenue
Mobile Apps eCommerce, Online gaming Static & dynamic web Online sharing and Data mining, analytics eBusiness Streaming media collaboration
HP Moonshot System
Software defined servers 45 individually serviceable hot-plug cartridges
Moonshot 1500 Chassis Supports shared components including power, cooling, and management and fabric
42 Increased Density – Reduced TCO
8.27”
2.9”
26”
19”
43 Cavium „Thunder-X“
• Up to 48 64-bit ARM cores @ 2.5 GHz
• Up to 1 TB RAM
40 GbE/ 40 GbE/ 100 GbE Up to 100 10/40GbE 16MB Ethernet Up to 48 4x 72-bit 100GbE Cache Fabric 2.5GHz DDR3/4 Sub ARM64 Controller Syste Cores s PCIe Gen3 m PCIe Gen3 PCIe Gen3 Security
Cavium SATAv3 Coherent Processor Interconne Other IO Workload Accelerators ct (CCPI™)
44 Cavium „Thunder-X“
Cloud, Web Serving
Distributed Storage
Telecommunication Servers
Secure Web Frontend Servers
45 Hardware Working for You
• ThunderX_CP™: Up to 48 highly efficient cores along with integrated virtSOC, dual socket coherency, multiple 10/40 GbE and high memory bandwidth. This family is optimized for private and public cloud web servers, content delivery, web caching, search and social media workloads.
• ThunderX_ST™: Up to 48 highly efficient cores along with integrated virtSOC, multiple SATAv3 controllers, 10/40 GbE & PCIe Gen3 ports, high memory bandwidth, dual socket coherency, and scalable fabric for east-west as well as north-south traffic connectivity. This family includes hardware accelerators for data protection/ integrity/security, user to user efficient data movement (RoCE) and compressed storage. This family is optimized for Hadoop, block & object storage, distributed file storage and hot/warm/cold storage type workloads.
• ThunderX_SC™: Up to 48 highly efficient cores along with integrated virtSOC, 10/40 GbE connectivity, multiple PCIe Gen3 ports, high memory bandwidth, dual socket coherency, and scalable fabric for east-west as well as north-south traffic connectivity. The hardware accelerators include Cavium’s industry leading, 4th generation NITROX and TurboDPI technology with acceleration for IPSec, SSL, Anti-virus, Anti-malware, firewall and DPI. This family is optimized for Secure Web front-end, security appliances and Cloud RAN type workloads.
• ThunderX_NT™: Up to 48 highly efficient cores along with integrated virtSOC, 10/40/100 GbE connectivity, multiple PCIe Gen3 ports, high memory bandwidth, dual socket coherency, and scalable fabric with feature rich capabilities for bandwidth provisioning , QoS, traffic Shaping and tunnel termination. The hardware accelerators include high packet throughput processing, network virtualization and data monitoring. This family is optimized for media servers, scale-out embedded applications and NFV type workloads.
46 SUSE® and ARM openSUSE® Runs on ...
48 openSUSE® Runs on ...
x86 … your laptop
… your desktop
x86 x86 … your server
49 ARM-based Machines
Tablets Tiny laptops
Smartphones Netbooks
Cloud nodes and Low-Energy Servers
50 ARM-based Machines
Tablets Tiny laptops
Smartphones Netbooks
Cloud nodes and Low-Energy Servers
51 openSUSE® on ARM Team
Virtual team of technical experts from
SUSE® and the openSUSE community
Strong collaboration with technology providers
GO! Started in Q3/2011
52 openSUSE® on ARM Timeline
openSUSE 12.3 openSUSE 13.2 ARM release ARM release
April 10 Nov 2013 2014 2015 March 5 Nov 19th
openSUSE 12.3 openSUSE 13.1 AArch64 (port) ARMv7 and ARMv8
53 openSUSE® Enabled Platforms
Foundation Model
54 Challenges
• Booting
• Deployment
55 Booting on x86
Firmware Bootloader
Grub 2
Kernel
OS
56 Booting on ARM
• Firmware is part of OS, not of hardware
• Sometimes hardware specific kernel
• Operating system with customizations
57 32-bit ARM Booting
UU--BootBoot UU-Boot-Boot UU-Boot-Boot • Many U-Boots
KernelKernel KernelKernel KernelKernel • Many Kernels
OS OSOS OS • One Repository OSOS
58 32-bit ARM Booting with Multiarch
UU-Boot-Boot ++ FDTFDT UU-Boot-Boot ++ FDTFDT UU-Boot-Boot ++ FDTFDT • Many U-Boots • Many FDTs
KernelKernel • One Kernel KernelKernel KernelKernel • One Repository OSOS OSOS OSOS
59 64-bit ARM Booting
UEFI • One Kernel
• One Repository
• One Distribution Kernel
OS
60 Challenges
• Booting
• Deployment
61 openSUSE®, ARM, and Kiwi Deployment Challenges
• Most ARM hardware does not have a CD drive
63 Deployment Challenges
• Single install media is currently not possible
‒ Special bootloader for each SoC needed
‒ Kernel is also often still device specific
64 Deployment Solution
• Extended KIWI with extra targets for ARM
‒ “Generic” Chroot target
‒ SoC specific u-boot based Appliances
65 Challenges
• Booting
• Deployment
66 Does It Run? YES! +
http://www.flickr.com/photos/alorenzi/6277701171
67 Raspberry Pi
68 Samsung “Chromebook”
69 BeagleBoard.org
70 Pandaboard.org
71 Exynos 5 boards
72 64 bit ARM Server
73 Anything Else?
We're working on some other devices as well
You can help!
‒ Test our machine images
‒ Provide us test hardware
‒ Help us with missing pieces for your individual device!
75 openSUSE® on ARM Status and Outlook openSUSE® 13.2
• ARMv6, ARMv7 and AArch64 is available
• Ready-to-use images are available for a few boards
• More will be added over the coming weeks
77 Question & Answer Call to action line one and call to action line two www.calltoaction.com
79 Thank you
http://en.opensuse.org/Portal:ARM
80
Unpublished Work of SUSE. All Rights Reserved. This work is an unpublished work and contains confidential, proprietary, and trade secret information of SUSE. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability.
General Disclaimer This document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.