Openstack on Aarch64

Total Page:16

File Type:pdf, Size:1020Kb

Openstack on Aarch64 OpenStack on AArch64 Marcin Juszkiewicz About me ● ARM developer since 2004 ● AArch64 developer since 2012 ● Had own consulting company ○ OpenEmbedded related services ● Worked for Canonical ○ Assigned to Linaro since April 2010 to June 2013 ● Currently Senior Software Engineer Red Hat ○ Assigned to Linaro since April 2016 ● Developer in several distributions ○ OpenZaurus, Debian, Ubuntu, Fedora, RHEL, CentOS Agenda ● AArch64? ● OpenStack: what is it? ● OpenStack and Debian/CentOS ● Deploying OpenStack ● Linaro Developer Cloud AArch64 ● 64-bit ARM architecture ○ Also called ARMv8, ARM64 ■ But there are ARMv8 32-bit only processors ● 32-bit ARM support is optional ● Virtualization support is mandatory ○ Requires GIC2 or newer OpenStack: what is it OpenStack and Debian/CentOS ● Debian ○ Packages for several versions ○ Done by Debian OpenStack team ● CentOS ○ Packages for several versions ○ Done by RDO project developers ● RDO ○ RPM Distribution of OpenStack. It's a group of Rediculously Dedicated OpenStackers who are here to help you Rapidly Deploy OpenStack, in a way that is Really Darned Obvious. RDO is Rebuilt Daily, Regularly Delivered, OpenStack. Deploying OpenStack ● Devstack ○ Upstream way ○ Ugly shell script ○ Grabs source code, builds, installs ● Packstack ○ RDO way ○ Another shell script ○ Uses RDO packages ● Automation ○ Ansible etc Test configuration Linaro Developer Cloud v1.0 ● Based on OpenStack ‘Liberty’ ● Manually setup on Debian ‘jessie’ ○ Used Debian packages ○ Moved to virtualenvs ● No API or Horizon access ● Basic networking ● Direct kernel/initrd boot ● VMs managed by Linaro admins Linaro Developer Cloud v2.0 ● Based on OpenStack ‘Newton’ ● Debian ‘jessie’ based ○ Our virtualenv packages used ● Setup done using Ansible ● API and Horizon access ● OpenVSwitch based networking ● UEFI support ● Users can admin their VMs ● Shared storage with Ceph ● Live migration ● Docs: http://bit.ly/LEG-ERP Reference architecture Internet ovs_agent keystone mysql l3_agent glance rabbitmq dhcp_agent memcached ceph-mon metadata_agent nova-api data controller ceph-mon nova-computenova-compute neutron-server network controller cinder-volumenova-compute cinder-volumenova-compute horizon cinder-volume ceph-OSD cinder ceph-OSDcinder-volume ceph-OSD ceph-mon computecomputeceph-OSD node node compute node api controller compute node management net tenants private net Linaro Developer Cloud (plans) ● Move to OpenStack ‘Pike’ ● Debian ‘stretch’ based ● Containers for OpenStack components ○ Using Kolla for building ● Automated tests ● Better documentation ● Setup CI to automate OpenStack tests on AArch64 TripleO? ● No nested virtualization ○ Available in ARMv8.3 specification ■ No cpus yet ○ TCG emulation is slow ● Workarounds ○ Deploy on bare metal ○ Use TCG emulation from Qemu ■ Usable only for development Questions? Thank You.
Recommended publications
  • Linux on the Road
    Linux on the Road Linux with Laptops, Notebooks, PDAs, Mobile Phones and Other Portable Devices Werner Heuser <wehe[AT]tuxmobil.org> Linux Mobile Edition Edition Version 3.22 TuxMobil Berlin Copyright © 2000-2011 Werner Heuser 2011-12-12 Revision History Revision 3.22 2011-12-12 Revised by: wh The address of the opensuse-mobile mailing list has been added, a section power management for graphics cards has been added, a short description of Intel's LinuxPowerTop project has been added, all references to Suspend2 have been changed to TuxOnIce, links to OpenSync and Funambol syncronization packages have been added, some notes about SSDs have been added, many URLs have been checked and some minor improvements have been made. Revision 3.21 2005-11-14 Revised by: wh Some more typos have been fixed. Revision 3.20 2005-11-14 Revised by: wh Some typos have been fixed. Revision 3.19 2005-11-14 Revised by: wh A link to keytouch has been added, minor changes have been made. Revision 3.18 2005-10-10 Revised by: wh Some URLs have been updated, spelling has been corrected, minor changes have been made. Revision 3.17.1 2005-09-28 Revised by: sh A technical and a language review have been performed by Sebastian Henschel. Numerous bugs have been fixed and many URLs have been updated. Revision 3.17 2005-08-28 Revised by: wh Some more tools added to external monitor/projector section, link to Zaurus Development with Damn Small Linux added to cross-compile section, some additions about acoustic management for hard disks added, references to X.org added to X11 sections, link to laptop-mode-tools added, some URLs updated, spelling cleaned, minor changes.
    [Show full text]
  • The GNU/Linux "Usbnet" Driver Framework
    T he GNU/Linux "usbnet" Driver http://www.linux-usb.org/usbnet/ The GNU/Linux "usbnet" Driver Framework David Brownell <[email protected]> Last Modified: 27 September 2005 USB is a general purpose host-to-device (master-to-slave) I/O bus protocol. It can easily carry network traffic, multiplexing it along with all the other bus traffic. This can be done directly, or with one of the many widely available USB-to-network adapter products for networks like Ethernet, ATM, DSL, POTS, ISDN, and cable TV. There are several USB class standards for such adapters, and many proprietary approaches too. This web page describes how to use the Linux usbnet driver, CONFIG_USB_USBNET in most Linux 2.4 (or later) kernels. This driver originally (2.4.early) focussed only on supporting less conventional types of USB networking devices. In current Linux it's now a generalized core, supporting several kinds of network devices running under Linux with "minidrivers", which are separate modules that can be as small as a pair of static data tables. One type is a host-to-host network cable. Those are good to understand, since some other devices described here need to be administered like those cables; Linux bridging is a useful tool to make those two-node networks more manageable, and Windows XP includes this functionality too. Linux PDAs, and other embedded systems like DOCSIS cable modems, are much the same. They act as Hosts in the networking sense while they are "devices" in the USB sense, so they behave like the other end of a host-to-host cable.
    [Show full text]
  • Yocto Project and Embedded OS
    Yocto Project and Jeffrey Osier-Mixon Embedded OS •What is the Yocto Project and why is it important? •Working with an open source collaborative project & community Kevin McGrath •Yocto Project concepts in a nutshell: environment, metadata, tools • Using Yocto cross-compiler • Running kernel via qemu th • Module installation, virtio, etc. July 28 2015 • Lessons learned, capabilities 11:00 PDT (GMT -7) 1 Yocto Project and Embedded OS Our guests Jeffrey Osier-Mixon: Jeff "Jefro" Osier-Mixon works for Intel Corporation in Intel's Open Source Technology Center, where his current role is community manager for the Yocto Project.. Jefro also works as a community architect and consultant for a number of open source projects and speaks regularly at open source conferences worldwide. He has been deeply involved with open source since the early 1990s. Kevin McGrath : Instructor at Oregon State University. I primarily teach the operating systems sequence and the senior capstone project sequence, but have taught architecture, assembly programming, introductory programming classes, and just about anything else that needs someone to teach it. While my background is in network security and high performance computing (computational physics), today I mostly live in the embedded space, leading to the “ECE wannabe” title in my department. Oleg Verge (Moderator): Technical Program Manager Intel Higher Education, System Engineer MCSE,CCNA, VCP Intel® IoT Developer Kit v1.0 Hardware components = + + Helpful Linux* tools (GCC tool chain, perf, oProfile, Software image + etc.), required drivers (Wi-Fi*, Bluetooth®, etc.), useful = API libraries, and daemons like LighttPD and Node.js. + Intel XDK Support for various IDEs = + + + For C/C++ For java, For Arduino* For Visual + node.js.,html5 sketches Programming Cloud services = Intel IoT Analytics includes capabilities for data collection, + storage, visualization, and analysis of sensor data.
    [Show full text]
  • Porting an Interpreter and Just-In-Time Compiler to the Xscale Architecture
    Porting an Interpreter and Just-In-Time Compiler to the XScale Architecture Malte Hildingson Dept. of Informatics and Mathematics University of Trollhättan / Uddevalla, Sweden E-mail: [email protected] Abstract code conformed to the targeted environment, the makefiles had to be adjusted accordingly. This task was hugely sim- This exploratory study covers the work of porting an in- plified by tools such as autoconf and automake which per- termediate language interpreter to the ARM-based XScale formed the necessary routines for the target platform given architecture. The interpreter is part of the Mono project, an required input parameters, and created makefiles which en- open source effort to create a .NET-compatible development sured that the code was compiled properly. framework. We cover trampolines together with the proce- dure call standard, discuss memory protection and present a 2. Background complete implementation of atomic operations for the ARM architecture. The Mono [11] project, launched in July 2001 by Ximian Inc. [12], is an effort to create an open source imple- mentation of the .NET [13] development framework. The 1. Introduction project includes the Common Language Infrastucture (CLI) [14] virtual machine, a class library for any programming The biggest problem with porting software is finding language conforming to the Common Language Runtime which parts of the software reflect architectural features of (CLR) [15] and compilers that target the CLR. The virtual the hardware that it runs on [1]. The open source movement machine consists of a class loader, garbage collector and has been a benefactor in the sense that standards for porting an interpreter or a just-in-time (JIT) compiler, depending open software have been in demand and developed.
    [Show full text]
  • Meeting the Yocto Project
    Meeting the Yocto Project In this chapter, we will be introduced to the Yocto Project. The main concepts of the project, which are constantly used throughout the book, are discussed here. We will discuss the Yocto Project history, OpenEmbedded, Poky, BitBake, and Metadata in brief, so fasten your seat belt and welcome aboard! What is the Yocto Project? The Yocto Project is a "The Yocto Project provides open source, high-quality infrastructure and tools to help developers create their own custom Linux distributions for any hardware architecture, across multiple market segments. The Yocto Project is intended to provide a helpful starting point for developers." The Yocto Project is an open source collaboration project that provides templates, tools, and methods to help us create custom Linux-based systems for embedded products regardless of the hardware architecture. Being managed by a Linux Foundation fellow, the project remains independent of its member organizations that participate in various ways and provide resources to the project. It was founded in 2010 as a collaboration of many hardware manufacturers, open source operating systems, vendors, and electronics companies in an effort to reduce their work duplication, providing resources and information catering to both new and experienced users. Among these resources is OpenEmbedded-Core, the core system component, provided by the OpenEmbedded project. Meeting the Yocto Project The Yocto Project is, therefore, a community open source project that aggregates several companies, communities, projects, and tools, gathering people with the same purpose to build a Linux-based embedded product; all these components are in the same boat, being driven by its community needs to work together.
    [Show full text]
  • Linux on Cellphones
    Linux on cellphones Pavel Machek Phones are everywhere ● everyone has their cellphone ● and carries it whereever they go ● cellphones are not just phones any more ● they browse web ● can read mail ● play mp3s and videos ● play radio ● they show maps, and you can use them for navigation Phones are sensitive ● They contain your contacts ● ...your passwords ● ...your emails ● ...can eavesdrop on you ● ...can steal your money and transfer them to attacker ● Backups are important because they break down ● non-smart phones do not have adequate ways to backup more than contacts Phones are working against their owner ● Cellphone operators have „interesting“ requirements before they'll sell a cellphone ● Branded phones are actively evil here ● right button takes you right into provider's portal, and you pay for it ● without confirmation ● without chance to change that ● branding is non-removable, so you are stuck with looking at red wallpaper ● you can't use it with other operator ● MMS / push to talk are designed to be expensive ● Voice-over-IP is a big no-no for a phone Phones are working against their owner ● You can only transfer pictures out of a phone using MMS ● You can only download applications using GPRS ● You can't transfer pictures/apps/songs between phones ● Have to confirm actions even of your own apps Phones are limited ● (but maybe that's a good thing?) ● Java applications work everywhere ● but they can't do interresting stuff ● usually can't access microphone, camera ● can't go background ● can't interact with one another ● Symbian
    [Show full text]
  • Diogo Duarte Comparação De Ferramentas De Desenvolvimento
    Departamento de Eletrónica, Universidade de Aveiro Telecomunicações e Informática 2020 Diogo Comparação de Ferramentas de Desenvolvimento de Duarte Linux Embutido Comparison of Embedded Linux Development Tools Departamento de Eletrónica, Universidade de Aveiro Telecomunicações e Informática 2020 Diogo Comparação de Ferramentas de Desenvolvimento de Duarte Linux Embutido Comparison of Embedded Linux Development Tools Dissertação apresentada à Universidade de Aveiro para cumprimento dos requisi- tos necessários à obtenção do grau de Mestre em Engenharia de Computadores e Telemática, realizada sob a orientação científica do Doutor João Manuel de Oliveira e Silva Rodrigues, Professor auxiliar do Departamento de Eletrónica, Tele- comunicações e Informática da Universidade de Aveiro, e coorientação empresarial do Mestre Sérgio Paulo Santos Silva, Diretor Técnico da empresa Globaltronic - Electrónica e Telecomunicações, SA. o júri / the jury presidente / president Prof. Doutor Tomás António Mendes Oliveira e Silva professor associado da Universidade de Aveiro vogais / examiners committee Prof. Doutor António Manuel de Jesus Pereira professor coordenador c/ agregação do Instituto Politénico de Leiria Prof. Doutor João Manuel de Oliveira e Silva Rodrigues professor auxiliar da Universidade de Aveiro (orientador) agradecimentos / Sem dúvida de que todas as pessoas que conheci e com quem interagi contribuiram acknowledgements de alguma forma para a maneira com que eu cheguei a esta etapa da minha vida, e em consequência, a este trabalho. Contudo, gostava de dirigir umas palavras dire- tas de agradecimento às pessoas que contribuiram mais de perto para este projeto. Ao meu professor e orientador João Rodrigues, pela exelente orientação e paciência, mesmo quando ia perdendo o focus com projetos paralelos. Ao meu co-orientador empresarial Sérgio Silva, antes de mais pela oportunidade de poder desenvolver este projeto tão de perto na empresa, assim como pelo suporte e ajuda mesmo para coisas fora do projeto em si.
    [Show full text]
  • Embedded Mobile Linux
    Embedded Mobile Linux UIs: The Faces of Embedded Mobile Linux Brief Survey of Distros Ångström Flashing Package Installation Tips and Caveats Links Ångström GPE Demo UI: Qtopia Trolltech's commercial implementation of Qt Closed source, but Qt is an open spec Not X11 compatible UI: GPE ”Boxy, but good.” --paraphrasing Crazy People X11 compatible: You can run GPE apps on the PDA and display on your desktop (and probably vice-versa). UI: Opie Open implementation of Qt UI: Qtopia on X11 OpenMoko's UI; allows Qt apps to display on X11 UI: Clutter One UI for Ubuntu MID Unsure about compatibility UI: Flash The second UI for Ubuntu MID Flash-based UI: Android I'm not sure what the underlying technology is, and the look & feel seems to be in flux. Brief Survey of Distros (1) SharpROM (latest release ~03/2006) Sharp's commercial Linux ROM, in Japanese Supports ~16 models of PDAs (Zaurus only) Qtopia Cacko (defunct; latest release ~2001-2002) Compatible version of the Sharp ROM in English Brief Survey of Distros (2) OpenZaurus (defunct; latest release 09/2006) Incompatible with Sharp ROM but 100% open. GPE Opie Familiar (defunct; last release 08/2006) GPE Opie emdebian (no releases) seems to focus on enabling distro builders, rather than being a distro Brief Survey of Distros (3) pdaXrom (latest release 04/2007) Only for a few Zauri: SL-5000D/5500, SL-6000, SL- C1000/C3100, SL-C7x0/860/7500 GPE OpenSimpad (defunct) Port of Familiar for SIMpad OpenEmbedded (defunct) First attempt at unifying other distros
    [Show full text]
  • The Yocto Project Accelerating Embedded Product Development
    Introduction to the Yocto Project Accelerating Embedded Product Development Rudolf J Streif [ yoc-to ] The smallest unit of measure, equal to one septillionth (10-24). The Yocto Project Ecosystem What it is, who we are, and why you should care... 3/64 © 2015 The Yocto Project The Yocto Project is not an Embedded Linux Distribution. It creates a custom one for You! The Yocto Project is not Single Open Source Project. It is an Ecosystem. The Yocto Project combines the convenience of a ready-to-run Linux Distribution with the flexibility of a custom Linux operating system stack. 4/61 © 2015 The Yocto Project Embedded Linux – Why is it Challenging? • DIY/Roll-Your-Own or Modify Mainstream Distro • Long Term Maintenance is difficult • Upstream Changes are difficult to track • Not embedded friendly • Licensing issues • No commercial embedded support • Build System and Cross Toolchain Challenges • Commercial/Community Embedded Linux • Too many competing systems • Incompatible distributions/build systems Developers spend lots of time porting or making build systems Leaves less time and resources to develop value- adding software features 5/61 © 2015 The Yocto Project Embedded Linux Landscape (1) Android – http://source.android.com ● Great for systems with ARM-based SoCs and touch screens ● Build system and development tools Ångström Distribution – http://www.angstrom-distribution.org ● Community distribution with a growing list of supported development boards ● Yocto Project build environment ● Online builder Narcissus Buildroot – http://buildroot.uclibc.org
    [Show full text]
  • Yocto Project on the Gumstix Overo Board
    Technische Universität München Chair for Data Processing Prof. Dr.-Ing. Klaus Diepold Yocto Project on the Gumstix Overo Board Author: Phanuel Hieber Advisors: Johannes Feldmaier, Martin Knopp and Dominik Meyer Abstract—Ångström Linux is no longer supported for the it is also possible to download the latest version of a pre-build Gumstix Overo Board. Therefore, Yocto Project is used to build a Yocto Project distribution from www.gumstix.com. custom Linux distribution. The changes between the old operating The major difference between Ångström Linux and Yocto system Ångström Linux and the new Yocto Project will be elab- Project is that Ångström is a distribution and Yocto Project is orated in this paper. The most significant advantage of the Yocto a build system like OpenEmbedded. It can generate many dif- Project is its ability to port the customized Linux distribution on ferent Linux distributions, including the Ångström distribution. many different platforms and to create customizable distributions. Furthermore, Yocto Project has a newer kernel than Ångström Figure1 shows the build process for a Linux distribution with Linux. Unfortunately, with the high flexibility of Yocto Project Yocto Project or OpenEmbedded. Both build systems are using distribution, the complexity of the build process to build the the same build tools and receipts to build a Linux distribution. distribution is also increasing. Keywords—Gumstix Overo Board, ARM, Linux, Yocto Project, Ångström Linux Build Systems I. INTRODUCTION Yocto Project OpenEmbedded INUX is a commonly used operating system for em- L bedded systems. In addition, to support more computer architectures than any other operating system, it is lightweight and cheap (mostly open source), making it a perfect platform Build Tools for embedded systems.
    [Show full text]
  • Debian, Ubuntu, and 101 Other Derivatives
    Debian, Ubuntu, and 101 other derivatives Stefano Zacchiroli Debian Project Leader 20 November 2010 Ubuntu Party — Toulouse, France Stefano Zacchiroli (Debian) Debian, Ubuntu & co. Ubuntu Party, Toulouse 1 / 27 Outline 1 Debian What’s so special about it? 2 Ubuntu Relationship with Debian Debian $ Ubuntu collaboration 3 Free Software The distro ecosystem Stefano Zacchiroli (Debian) Debian, Ubuntu & co. Ubuntu Party, Toulouse 2 / 27 Outline 1 Debian What’s so special about it? 2 Ubuntu Relationship with Debian Debian $ Ubuntu collaboration 3 Free Software The distro ecosystem Stefano Zacchiroli (Debian) Debian, Ubuntu & co. Ubuntu Party, Toulouse 3 / 27 Debian: once upon a time Fellow Linuxers, This is just to announce the imminent completion of a brand-new Linux release, which I’m calling the Debian Linux Release. [. ] Ian A Murdock, 16/08/1993 comp.os.linux.development make GNU/Linux competitive with commercial OS easy to install built collaboratively by software experts 1st major distro developed “openly in the spirit of GNU” GNU-supported for a while trivia: named after DEBra Lynn and IAN Ashley Murdock Stefano Zacchiroli (Debian) Debian, Ubuntu & co. Ubuntu Party, Toulouse 4 / 27 Debian: the operating system completely Free Software ñ DFSG ñ contrib, non-free a dozen architectures alpha, amd64, arm(el), hppa, i386, ia64, mips(el), powerpc, s390, sparc 2 non-Linux ports upcoming features miscellanea. ports, stability, packaging system, documentation, old hw support, smooth upgrades, i18n/l10n, the testing suite, runs anywhere, The largest GNU/Linux distro technical policy, a lot of packages, porting platform ... 29’000 packages (Squeeze) Stefano Zacchiroli (Debian) Debian, Ubuntu & co.
    [Show full text]
  • Debian: 17 Ans De Logiciel Libre, ``Do-Ocracy'' Et Démocratie
    Debian: 17 ans de logiciel libre, “do-ocracy” et démocratie Stefano Zacchiroli Debian Project Leader 24 février 2010 Télecom & Management SudParis Évry, France Stefano Zacchiroli (Debian) Debian: do-ocracy et démocratie Évry, France 1 / 43 Outline 1 What is Debian? History A system, a project, a community 2 What’s so special about Debian? 3 More in-depth Commitments Decision making Processes 4 Derivatives 5 Contribute to Debian Stefano Zacchiroli (Debian) Debian: do-ocracy et démocratie Évry, France 2 / 43 Prelude — the notion of “distribution” distributions are meant to ease software management key notion: the abstraction of package offer coherent collections of software killer application: package managers Stefano Zacchiroli (Debian) Debian: do-ocracy et démocratie Évry, France 3 / 43 Outline 1 What is Debian? History A system, a project, a community 2 What’s so special about Debian? 3 More in-depth Commitments Decision making Processes 4 Derivatives 5 Contribute to Debian Stefano Zacchiroli (Debian) Debian: do-ocracy et démocratie Évry, France 4 / 43 Debian: once upon a time Fellow Linuxers, This is just to announce the imminent completion of a brand-new Linux release, which I’m calling the Debian Linux Release. [. ] Ian A Murdock, 16/08/1993 comp.os.linux.development make GNU/Linux competitive with commercial OS easy to install built collaboratively by software experts 1st major distro developed “openly in the spirit of GNU” FSF-supported for a while trivia: named after DEBra Lynn and IAN Ashley Murdock Stefano Zacchiroli (Debian)
    [Show full text]