Application Development with Azure

Total Page:16

File Type:pdf, Size:1020Kb

Application Development with Azure Application Development with Azure Karim Vaes Specialist – Azure Application Development @kvaes Agenda • Digital Transformation, powered by Application Innovation • Developer Toolchain • App Service • Integration Services Digital Transformation Powered by Application Innovation Digital transformation 91% Digital of business leaders see Digital Transformation as a way of sparking Transformation innovation and finding efficiencies1 A journey with one destination but different paths 85% say they must offer digital services or become irrelevant2 1 ISACA: Information Systems Audit and Control Association, 2018 2 Couchbase: Couchbase Survey, August 2018 1 Data: Capture digital signal from across business Consumer Reports review indicate braking issue with Model 3 Vehicle telemetry shows brake performance across fleet 2 Insight: Connect and synthesize data Car telemetry for suspect cars analyzed to understand issue Tesla identifies fix to improve stopping distance Engage Transform customers products 3 Action: Improve business outcomes Car braking software updated over-the-air to fix issue Tesla closes the loop with consumer reports and review is updated 7,0% 6,0% 5,0% 4,0% 3,0% 2,0% 1,0% 0,0% -1,0% -2,0% software Digital DNA Toolchain Overview World’s most comprehensive developer toolchain Azure Azure Stack Azure Data Box Azure Sphere Azure Kinect HoloLens Web Databases Mobile Analytics Tools Mixed Reality AI + Machine Learning Visual Studio Containers Internet of Things Azure Devops Events + Integration Media GitHub PowerApps Power BI Compute Networking Storage Security Identity Platform Services Security & Hybrid Management Cloud Media & CDN Application Platform Data Azure AD Security Center Content SQL Health Monitoring Media Media SQL Data DocumentDB Services Analytics Delivery Web Mobile Database Warehouse Network Apps Apps Portal AD Privileged Identity SQL Server Redis Storage Azure Management Azure Active Integration API Cloud Stretch Database Cache Tables Search Directory Apps Services Domain Services Azure AD API BizTalk Services B2C Management Service Notification Fabric Hubs Intelligence Logic Multi-Factor Backup Apps Cognitive Services Bot Framework Cortana Authentication Service Bus Functions Automation Operational Analytics & IoT Analytics Developer Services Compute Services Scheduler Machine HDInsight Stream Analytics Mobile Learning Visual Studio Import/Export Container VM Engagement Service Scale Sets Key Vault Data Data Lake Catalog Analytics Service Data Lake Store VS Team Services Batch Xamarin Azure Site Store/ RemoteApp Recovery Marketplace IoT Hub Event Data Power BI Application HockeyApp Hubs Factory Embedded VM Image Gallery Dev/Test Lab Insights StorSimple & VM Depot Infrastructure Services Compute Storage Networking Virtual Load Express Traffic VPN App Virtual Machines Containers Blob Queues Files Disks DNS Network Balancer Route Manager Gateway Gateway Datacenter Infrastructure Source : https://azurecharts.com/overview Characteristics of modern applications Containers Managed Artificial Serverless Databases Intelligence Azure operational database services Democratizing development GitHub Azure services APIs Microsoft Flow Visual Studio Microsoft Azure PowerApps Professional developers Citizen developers Azure PowerApps #1 Developers’ Choice Leader in Low-Code of PaaS Products1 Development Platforms2 DevOps 50% Top performing DevOps companies spend more time innovating and less time “keeping the lights on”. The result: better products, delivered 19.5% faster, to happier customers by more engaged teams 10% 5% 5% Azure Boards Azure Repos Azure Pipelines Azure Artifacts Azure Test Plans Azure Boards Azure Repos Azure Pipelines Azure Artifacts Azure Test Plans Azure Boards Azure Repos Azure Pipelines Connecting ideas to releases Scrum ready to help your teams run sprints, Azure Artifacts stand-ups, and plan work Integrated with GitHub commits and pull requests Azure Test Plans Insights into project status and health Azure Boards Azure Repos Azure Pipelines Private Git and TFVC repos for your teams Code review via branch pull requests Azure Artifacts Branch policies and build validation Easy migration path to / from GitHub Azure Test Plans Azure Boards Azure Repos Azure Pipelines Cloud-hosted pipelines for Linux, macOS and Windows Azure Artifacts Any language, any platform, any cloud Native support for containers and Kubernetes Azure Test Plans Best-in-class for open source Azure Boards Azure Repos Azure Pipelines Deploy to on-premises, ANY cloud or a hybrid of cloud and on-prem Azure Artifacts Staged environment releases Pre and post deployment approvals with gates to automate approval based on conditions Azure Test Plans Azure Boards Azure Repos Azure Pipelines Share code efficiently Keep your Maven, npm, NuGet and Python Azure Artifacts packages and more in the same place Aggregate from public registries and internal teams Azure Test Plans Publish and track from any pipeline Azure Boards Azure Repos Azure Pipelines Run tests and log defects from your browser Track and assess quality throughout your lifecycle Azure Artifacts Capture rich data for reproducibility Create tests directly from exploratory sessions Azure Test Plans Azure Boards GitHub brings open source workflows to your organization, breaking down silos and enabling Azure Repos InnerSource through: Azure Pipelines • Expertise sharing • Cross-team collaboration Azure Artifacts • Improved code reuse • Increased velocity Azure Test Plans • Secure Workflows DevOps at Microsoft Azure DevOps is the toolchain of choice for Microsoft engineering with over 100,000 internal users ➔ https://aka.ms/DevOpsAtMicrosoft 442k 4.6m 28k Pull Requests per Builds per month Work items month created per day 2.4m 3.5k 12k 82,000 Private Git commits per Open Source repos Employees contributing Deployments per day month to open source Data: Internal Microsoft engineering system activity, March 2019 Azure DevOps supports small teams and the largest enterprises “ Instead of telling people to wait for 6 “ Speed is gained in moving to the PaaS months for a new feature, we can give it to offering of Azure DevOps. PaaS provides them in a few weeks…Our 2800 worldwide regularly released features and a future- developers can use the same backlog, user proof capability, eliminating the need for stories and tests whether they’re on Accenture to maintain infrastructure and Windows or Linux… building for iOS or go through upgrade cycles. ” Android. ” “ Branches sync 500 percent faster. Builds “Microsoft made it really easy to break are 400 percent faster, with the typically outside the silos… and tie the DevOps six-hour process reduced to 90 minutes. process into the fulfilment of business We (now have) a highly streamlined process. Without the tools that we have process that operates with a few button today, we would not be successful. ” clicks—and one-button deployment. ” Reactive operations DEVELOP DELIVER OPERATE Moving to proactive operations with Azure DEVELOP DELIVER OPERATE Deliver faster and more reliably with GitHub and Microsoft Azure Integrate with your existing tools and workflow Infrastructure and Configuration as Code ©Microsoft Corporation Azure Continuous Security Gain full visibility and control of your cloud security state Leverage ML to Proactively identify and mitigate risks to reduce exposure to attacks Quickly detect and respond to threats with advanced analytics ©Microsoft Corporation Azure Smarter Insights, Faster ©Microsoft Corporation Azure Let us go through it… ©Microsoft Corporation Azure App Service Speed Personalization Cross-device Microsoft Azure Open & scalable Data-driven Cross-platform cloud platform intelligence experiences Continuous innovation Choose the right balance of control and responsibility based on your needs Responsibility On-prem IaaS PaaS SaaS Build from the ground up Some assembly required Move-in ready Applications Data Runtime Middleware Operating system Virtualization Servers Storage Networking Customer Microsoft 80% 50% 466% IT time saved faster service deployment return on investment Statistics based on five-year, risk-adjusted figures for a composite organization constructed from aggregated interviews with eight Microsoft Azure IaaS customers. Source: “The Total Economic Impact Of Microsoft Azure PaaS,” a commissioned study conducted by Forrester Consulting, June 2016 IaaS CaaS PaaS FaaS Infrastructure Platform Container Platform Application Platform Serverless Platform Challenges Patching, Management, Deployment Management (Container & Pod) Limitations of Execution environment Cold start, long running process What you get Curated VM Hosting Curated Orchestration Curated Execution Environment Scale to ‘zero’ Technology decisions IT/Infra focused Value Prop Dev/App Admin focused Value Prop More Control of execution environment Less Control of execution environment Less Agile development & deployment More Agile development & deployment High-productivity Fully-managed Enterprise-grade for devs & ops .NET, Node, Java, Docker, PHP, Ruby, Python Auto scale & load balancing Global data center footprint Deploy containers on Windows & Linux High availability w/auto patching Hybrid support Staging & deployment Reduced operations costs Azure Active Directory integration Testing in production Backup & recovery Secure & compliance App gallery marketplace Code Container Use the code, container, or OS of your choice on Azure App Service, our fully-managed platform OS Developer Fully managed Flexibility & productivity platform choices Tight
Recommended publications
  • Running ML/DL Workloads Using Red Hat Openshift Container Platform V3.11 Accelerate Your ML/DL Projects Platform Using Kubeflow and NVIDIA Gpus
    Running ML/DL Workloads Using Red Hat OpenShift Container Platform v3.11 Accelerate your ML/DL Projects Platform using Kubeflow and NVIDIA GPUs January 2021 H17913.2 White Paper Abstract This white paper describes how to deploy Kubeflow v0.5 on Red Hat OpenShift Container Platform and provides recommendations for achieving optimal performance for ML/DL workloads using the latest NVIDIA Tesla GPUs. Dell Technologies Solutions Copyright The information in this publication is provided as is. Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any software described in this publication requires an applicable software license. Copyright © 2021 Dell Inc. or its subsidiaries. All Rights Reserved. Dell Technologies, Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Intel, the Intel logo, the Intel Inside logo and Xeon are trademarks of Intel Corporation in the U.S. and/or other countries. Other trademarks may be trademarks of their respective owners. Published in the USA 01/21 White Paper H17913.2. Dell Inc. believes the information in this document is accurate as of its publication date. The information is subject to change without notice. 2 Running ML/DL Workloads Using Red Hat OpenShift Container Platform v3.11 Accelerate your ML/DL Projects Platform using Kubeflow and NVIDIA GPUs White Paper Contents Contents Executive summary ........................................................................................................................ 4 Solution architecture ...................................................................................................................... 6 GPU accelerated TensorFlow training using TFJobs .................................................................. 9 Installing the GPU device plug-in ...............................................................................................
    [Show full text]
  • BOOK of NEWS Al in Business
    BOOK OF NEWS Microsoft Inspire July 14 – 18, 2019 Las Vegas, NV Contents Foreword by Gavriella Schuster 4 Inspire Overview and How to Watch 5 Chapter 1 6 Customer and Partner Enablement Item 1.1 Partner program and investments update Item 1.2 Microsoft Azure Lighthouse Item 1.3 Microsoft Edge Enterprise Readiness Item 1.4 Microsoft Intelligent Security Association expands Chapter 2 9 Microsoft Business Applications | ISV Opportunity Item 2.1 New Microsoft Business Applications ISV Connect program and technology industry innovation for ISVs Item 2.2 Industry accelerators for ISVs Item 2.3 Latest version of the Dynamics 365 Nonprofit Accelerator Chapter 3 13 Marketplace Item 3.1 New monetization models, rewards program and route to market in commercial marketplace Chapter 4 15 Microsoft Azure and AI Item 4.1 AI for Cultural Heritage Item 4.2 Cloud Adoption Framework Item 4.3 AI Accelerate Program Item 4.4 New Azure migration capabilities Item 4.5 Azure Migration Program Item 4.6 Azure Data Box Heavy is now generally available; Data Box and Data Box Disk regions are expanded Item 4.7 Open source Quantum Development Kit Item 4.8 Azure Kinect DK General Availability Item 4.9 ServiceNow makes Azure Cloud its preferred cloud platform for highly regulated industries Contents | 2 Contents Chapter 5 20 Databases and Analytics Item 5.1 Blob API interoperability with Azure Data Lake Storage Gen2 Public Preview Item 5.2 Azure Data Share, new analytics service, announced for enterprises Chapter 6 22 Microsoft Teams Item 6.1 Microsoft Teams reaches 13
    [Show full text]
  • Microsoft 2012 Citizenship Report
    Citizenship at Microsoft Our Company Serving Communities Working Responsibly About this Report Microsoft 2012 Citizenship Report Microsoft 2012 Citizenship Report 01 Contents Citizenship at Microsoft Serving Communities Working Responsibly About this Report 3 Serving communities 14 Creating opportunities for youth 46 Our people 85 Reporting year 4 Working responsibly 15 Empowering youth through 47 Compensation and benefits 85 Scope 4 Citizenship governance education and technology 48 Diversity and inclusion 85 Additional reporting 5 Setting priorities and 16 Inspiring young imaginations 50 Training and development 85 Feedback stakeholder engagement 18 Realizing potential with new skills 51 Health and safety 86 United Nations Global Compact 5 External frameworks 20 Supporting youth-focused 53 Environment 6 FY12 highlights and achievements nonprofits 54 Impact of our operations 23 Empowering nonprofits 58 Technology for the environment 24 Donating software to nonprofits Our Company worldwide 61 Human rights 26 Providing hardware to more people 62 Affirming our commitment 28 Sharing knowledge to build capacity 64 Privacy and data security 8 Our business 28 Solutions in action 65 Online safety 8 Where we are 67 Freedom of expression 8 Engaging our customers 31 Employee giving and partners 32 Helping employees make 69 Responsible sourcing 10 Our products a difference 71 Hardware production 11 Investing in innovation 73 Conflict minerals 36 Humanitarian response 74 Expanding our efforts 37 Providing assistance in times of need 76 Governance 40 Accessibility 77 Corporate governance 41 Empowering people with disabilities 79 Maintaining strong practices and performance 42 Engaging students with special needs 80 Public policy engagement 44 Improving seniors’ well-being 83 Compliance Cover: Participants at the 2012 Imagine Cup, Sydney, Australia.
    [Show full text]
  • Azure-Kinect and Augmented Reality for Learning Basic Mathematics - a Case Study
    Preprints (www.preprints.org) | NOT PEER-REVIEWED | Posted: 30 September 2020 doi:10.20944/preprints202009.0752.v1 Azure-Kinect and Augmented Reality for learning Basic Mathematics - A case study Raúl Lozada-Yánez 1, 2, Nora La-Serna Palomino 1, Diego Veloz-Chérrez 2, Fernando Molina-Granja 3 & Juan Carlos Santillán-Lima 4 1 Universidad Nacional Mayor de San Marcos, Facultad de Ingeniería de Sistemas e Informática, [email protected], [email protected] 2 Escuela Superior Politécnica de Chimborazo, [email protected],Riobamba, Ecuador Facultad de Informática en Electrónica, [email protected], [email protected] 3 Universidad Nacional de Chimborazo, Riobamba, Ecuador Facultad de Ingeniería,[email protected] 4 Universidad Nacional de La Plata, Ciudad de la Plata, Argentina Facultad de Informática - LEICI - Instituto de Investigaciones en Electrónica, Control y Procesamiento de Se- ñales. Facultad de Ingeniería, [email protected], [email protected] *Correspondence: [email protected]; [email protected] Abstract: The way in which the human being learns certain complex contents has always been a focus of interest and a challenge for researchers. Given the fact that children's cognitive abilities do not fully develop until a certain age, this topic is particularly important in the young children's learning scope as they do not correctly and easily learn some content of abstract nature, such as contents in math class. This work presents the results of the use of an application called "Mathematics Learning System with Augmented Reality based on Kinect" (SAM-RAK by its acronym in Spanish), which was designed to cover basic topics of mathematics in the Basic General Education level (EGB by its acronym in Spanish) in Ecuador.
    [Show full text]
  • Azure Kinect Examples for Unity
    Azure Kinect Examples for Unity Copyright © RF Solutions. All rights reserved. Azure Kinect Examples for Unity Table of contents Introduction ........................................................................................................................ 3 How to Run ........................................................................................................................ 3 Azure Kinect SDKs ............................................................................................................. 3 Kinect-v2 SDK ................................................................................................................... 3 RealSense SDK .................................................................................................................. 4 Demo Scenes ...................................................................................................................... 4 VFX Point-Cloud Demo ......................................................................................................... 8 The Kinect Manager ............................................................................................................. 9 Sensor Interfaces .............................................................................................................. 10 General-Purpose Components ............................................................................................. 10 Demo-Specific Components ................................................................................................
    [Show full text]
  • Application Development with Azure
    Application Development with Azure Karim Vaes Specialist – Azure Application Development 0032 497 219577 @kvaes Agenda • Kubernetes Kubernetes Kubernetes momentum “By 2020, more than 50% of enterprises Larger companies will run mission-critical, containerized are leading the cloud-native applications in production.” adoption. 77% For the organizations running Kubernetes today, 77%1 of those with more than 1,000 developers are running it in production. 1Heptio: state of Kubernetes 2018 What’s behind the growth? Kubernetes: the leading orchestrator shaping the future app development and management It’s widely used It’s vendor-neutral It’s community-supported Kubernetes is in production for A variety of cloud providers There’s a huge community of active global companies across industries1 offer robust Kubernetes support contributors supporting Kubernetes3 24,000 1.1 million contributors contributions since 2016 since 2016 1Kubernetes.io. “Kubernetes User Case Studies.” 2CNCF. “Kubernetes Is First…” 3CNCF. Keynote address. Azure Kubernetes Service (AKS) Ship faster, operate easily, and scale confidently with managed Kubernetes on Azure Manage Kubernetes Accelerate Build on an Run anything, with ease containerized enterprise-grade, anywhere development secure foundation Top scenarios for Kubernetes on Azure Lift and shift Machine Microservices IoT Secure DevOps to containers learning Cost saving Agility Performance Portability Automation without refactoring Faster application Low latency Build once, Deliver code faster and your app development processing run anywhere securely at scale Azure Kubernetes momentum Trusted by thousands of customers 30x Azure Kubernetes Service usage grew 30x since it was made generally available in June 2018 Dated November 2018 How Kubernetes works Kubernetes control Worker node Internet kubelet kube-proxy 1.
    [Show full text]
  • Running Large-Scale Machine Learning Experiments in the Cloud
    O’REILLY Artificial Intelligence Conference, San Jose 2019 Running large-scale machine learning experiments in the cloud Shashank Prasanna, Amazon Web Services @shshnkp September 12, 2019 © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda • Machine Learning, experiments and the scientific method • Scaling challenges with machine learning setups • Containers technologies for large-scale machine learning • Demo 1: Hyperparameter optimization with Amazon SageMaker • Demo 2: Custom designed experiments with Amazon SageMaker • Demo 3: Hyperparameter optimization with Kubernetes, Kubeflow and Katib • Summary and additional resources © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Experimentation in machine learning Data acquisition Data preparation for Design and run curation and labeling training experiments Model optimization Distributed Deployment and validation training © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why do we run experiments? The scientific method Question Hypothesis empirical procedure to determine Experiment whether observations agree or conflict with our hypothesis Interpret Iterate © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why do we run machine learning experiments? Machine learning researcher may want to: Question • Identify factors that affect model performance Hypothesis • Explain the root causes of performance Experiment • Choose between alternate models Interpret • Study variability and robustness of
    [Show full text]
  • Azure Kinect Body Tracking Sdk Reference
    Azure Kinect Body Tracking Sdk Reference Curatorial Mic unburden vivaciously and ineloquently, she imbody her planometer feminizes digitally. Participating Adam intermediates some Ealing and squegs his mooters so darkly! Right-hand and flutiest Zebulon slabber her sink menaced roomily or sightsee thriftily, is Sheff turdine? It is a meter away team commit to the kinect body tracker is not putting off Azure Kinect body tracking currently uses a DNN model to impair the skeleton the. Azure Kinect Masterclass Angles LightBuzz. Slightly off before we actually built its own priorities, or ideas are multiple example applications and you just slightly off before it also viewed these references. Net framework development, but i wanted with. My money when depth. Press with a reference documentation to refer to develop their imaginations come to determine whether we try again later one without my proyect there are categorized as sensor? Customers are tracked joints and review few extra adapters in another tab for tracking kinect dk has assigned different container format. MicrosoftAzureKinectBodyTracking 101 NuGet Gallery. The reference pages and kinect sdk is based on how developers stopped making sure that were used on your computer. Eddie using azure kinect or. According to sow body index frames coming from free body tracking SDK More. See details on hardware recommendations in Microsoft's Azure Kinect documentation. For more information visit the official documentation of Azure Kinect DK. Add C wrapper for Azure Kinect Body Tracking SDK Azure. Kinect camera to play them with so. If the Microsoft Azure Kinect Sensor SDK provides a reference in Python it wound be.
    [Show full text]
  • Chapter 1 - Overview
    Reference architecture Chapter 1 - Overview This document provides a complete reference architecture guide for infrastructure required for machine learning use cases. This document specifically covers open source machine learning software that includes Kubeflow using Charmed Kubernetes solution on Dell EMC hardware delivered by Canonical. This includes Dell EMC PowerEdge servers for workloads and storage based on Intel® Xeon® Scalable Processors and Dell EMC Networking. This guide discusses the Dell EMC hardware specifications and the tools and services to set up both the hardware and software, including the foundation cluster and the Kubernetes cluster to run machine learning workloads. It also covers other tools used for the monitoring and management of the cluster in detail and how all these components work together in the system. The guide also provides the deployment steps and references to configuration and automation scripts developed by Dell EMC and Canonical for the deployment process. Document ID Revisions Revisions Date Description March 2020 Initial release Acknowledgements This paper was produced by the following: Author: Andrey Grebennikov Support: Other: The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any software described in this publication requires an applicable software license. Copyright © Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.
    [Show full text]
  • Tensorflow 2.0 and Kubeflow for Scalable and Reproducable Enterprise Ai
    TENSORFLOW 2.0 AND KUBEFLOW FOR SCALABLE AND REPRODUCABLE ENTERPRISE AI Romeo Kienzler1, 2, Holger Kyas2, 3, 4 1IBM Center for Open Source Data and AI Technologies, 505 Howard St, San Francisco, CA, USA 2Berne University of Applied Sciences, Technology and Informatics, Wankdorffeldstrasse 102, 3014 Berne, Switzerland 3Open Group, 548 Market St #54820, San Francisco, CA 94104-5401 4Helvetia Insurance Switzerland, St. Alban-Anlage 26, 4002 Basel, Switzerland ABSTRACT Towards the End of 2015 Google released TensorFlow 1.0, which started out as just another numerical library, but has grown to become a de-facto standard in AI technologies. TensorFlow received a lot of hype as part of its initial release, in no small part because it was released by Google. Despite the hype, there have been complaints on usability as well. Especially, for example, the fact that debugging was only possible after construction of a static execution graph. In addition to that, neural networks needed to be expressed as a set of linear algebra operations which was considered as too low level by many practitioners. PyTorch and Keras addressed many of the flaws in TensorFlow and gained a lot of ground. TensorFlow 2.0 successfully addresses these complaints and promises to become the go-to framework for many AI problems. This paper introduces the most prominent changes in TensorFlow 2.0 targeted towards ease of use followed by introducing TensorFlow Extended Pipelines and KubeFlow in order to illustrate the latest TensorFlow and Kubernetes ecosystem movements towards simplification for large scale Enterprise AI adoption. KEYWORDS Artificial Intelligence, TensorFlow, Keras, Kubernetes, KubeFlow, TFX, TFX Pipelines 1.
    [Show full text]
  • Using Ipus from Docker Release 1.4.0
    Using IPUs from Docker Release 1.4.0 Graphcore Ltd Dec 08, 2020 CONTENTS 1 Introduction 1 2 Initial setup 2 3 Using gc-docker 3 3.1 Loading docker images.............................................3 3.2 Verifying IPU access from inside container..................................4 3.3 Mounting directories from the host......................................5 3.4 Setting environment variables.........................................5 4 Running a TensorFlow application on an IPU6 5 Extending the images 7 6 Further reading 8 7 Trademarks & copyright 9 i CHAPTER ONE INTRODUCTION This guide explains how you can run applications in Docker on a Linux machine with one or more physical IPU devices. Prerequisites: • A machine with IPU devices • Ubuntu 18.04 / CentOS 7.6 1 CHAPTER TWO INITIAL SETUP First check if your machine has the IPU device driver installed. You can check this is loaded and running with the following command: $ modinfo ipu_driver If the driver is are installed and running, you should see something similar to: $ modinfo ipu_driver filename: /lib/modules/4.15.0-55-generic/updates/dkms/ipu_driver.ko version: 1.0.39 description: IPU PCI Driver author: Graphcore Limited license: GPL srcversion: 49FFB7D8556EB58899AE41A alias: pci:v00001D95d00000003sv*sd*bc*sc*i* alias: pci:v00001D95d00000002sv*sd*bc*sc*i* alias: pci:v00001D95d00000001sv*sd*bc*sc*i* depends: retpoline: Y name: ipu_driver vermagic: 4.15.0-55-generic SMP mod_unload parm: memmap_start:array of ulong parm: memmap_size:array of ulong If so, proceed to the next section. If it returns an error along the lines of: $ modinfo ipu_driver modinfo: ERROR: Module ipu_driver not found. You will need to install the driver.
    [Show full text]
  • Reference Architecture for Kubeflow on Openshift Accelerate ML/DL Workloads Using Kubeflow and Poweredge Servers
    Solution brief Reference Architecture for Kubeflow on OpenShift Accelerate ML/DL workloads using Kubeflow and PowerEdge servers Artificial intelligence (AI) and its subsets, machine learning (ML) and deep learning (DL), Customer are gaining widespread adoption for use cases such as computer vision, speech recognition and natural language processing (NLP). Integrating production‑grade AI technologies Results in well‑defined platforms within the protection of the data center can facilitate wider adoption of advanced computing, extending investments by supporting AI use cases as well as augmenting the resources available to data science teams. 2 hours vs. But not every IT organization has the time and resources to research, integrate and test all the components required to deploy a customized system to run AI workloads. Building 9 months a production‑ready AI system involves combining various components, often from different to run analysis1 vendors, and integrating and managing these disparate pieces. As well, deployments are often tied to a specific cluster, so that moving models — for example, between laptops and cloud clusters or from DevOps to production and back — significantly increases 218% ROI complexity and the chance for human errors. over 3 years2 Kubeflow together with the Red Hat® OpenShift® Container Platform help address these challenges. Kubeflow is an open‑source Kubernetes®‑native platform designed 20 million to accelerate ML workloads. It’s a composable, scalable, portable stack that includes images used to train a components and automation features to integrate ML tools, so they work together to deep neural network3 create a cohesive pipeline that makes it easy to deploy ML applications at scale.
    [Show full text]