Webos LSM for Automotive

Total Page:16

File Type:pdf, Size:1020Kb

Webos LSM for Automotive webOS LSM for Automotive Jaeyoon Jung LG Electronics webOS Connectivity Content Provider Apps Linux Wayland Web App Manager System Application Manager SDK Enact Luna Surface Manager HTML5 Yocto Chromium GStreamer LS2 Bus system Qt/QML I18N AI 2 LSM: Luna Surface Manager • Window management of application surfaces and System UI • Input event routing from various devices • Virtual Keyboard • Qt/QML Wayland compositor 3 LSM Architecture Control Qt/QML WAM Others Rendering data Native Bus Wayland adaptation Wayland protocol Wayland EGL LSM LSM LSM webOS LSM components bus Luna QML Wayland Compositor QPA DRM / KMS / EVDEV 4 LSM Core Qt/QML WAM Others • QML Wayland Compositor Native – QML application that handles Wayland surfaces Wayland adaptation – Renders system UI elements Wayland protocol and Wayland surfaces together Wayland EGL LSM QML Wayland • QPA Compositor – Platform abstraction plugin in Qt QPA – Depends on hardware DRM / KMS / EVDEV 5 Wayland and Hardware Integration Qt/QML • Wayland WAM Others Native – Display server and client protocol – EGL, OpenGL Wayland adaptation Wayland protocol • Wayland EGL Wayland – EGL layer for buffer sharing EGL LSM between client and server QML Wayland Compositor • Graphics / Input HW QPA – DRM/KMS or SoC specific – Evdev or proprietary input stack DRM / KMS / EVDEV 6 Client Integration Qt/QML • Various Wayland clients WAM Others Native – WAM • Web app manager Wayland adaptation • Provides Wayland integration for web applications Wayland protocol Wayland – Qt/QML EGL • Runs on top of Qtwayland client LSM QML Wayland plugin Compositor – Others • SDL native clients QPA • Clients compatible with standard wayland protocol can run DRM / KMS / EVDEV 7 LSM for Various Products • Challenges – Various GPUs and input devices – Extend Wayland protocol while keeping compatibility to standard protocols – Commonize core compositor features and modularize extensions – Differentiate user interfaces 8 Various GPUs and input devices • Use different QPAs – Proprietary QPA for LG in-house SoC – Open-sourced QPA • eg. EGLFS for DRM-based platforms • Abstraction for Input devices – webOS proprietary input device stack – Evdev for EGLFS 9 Wayland Protocol Extension • WebOSCompositorExtension – Provides Qt plug-in interfaces to Wayland protocol extension – A plug-in that implements a particular Wayland protocol extension can be loaded as needed – Defined as a Qt module QT += weboscompositorextension 10 Core Compositor and Extensions (1/2) • Compositor Base Architecture – Defines the baseline of webOS compositor and common System UI that can be extended or replaced by a product extension as needed – Key architecture • Plug-in interface for native core compositor • QML module interface that overrides the baseline QML views, controllers and types. 11 Core Compositor and Extensions (2/2) • webOS Compositor Plug-in Interface – Plug-in for core class overrides – Extend WebOSCoreCompositor and WebOSCompositorWindow so that it can re-implement methods in a product-specific way • QML Compositor base and Extension – WebOSCompositorBase • Defines the baseline of QML scene based on the common webOS UX • Provides QML types that can be re-defined by a product extension – WebOSCompositor • Implements product-specific layout of views • Re-defines controllers for views including new ones • Re-uses types in the baseline unless re-defined 12 webOS for Automotive • Automotive Experiences – Cluster – In-Vehicle Infotainment in Center stack – Rear Seat Entertainment • Specialties of webOS – Multiple display supports – Quick prototyping of window layouts and system UIs – DRM-enabled media stack – Integration with Content provider applications IVI and RSE 13 LSM for IVI and RSE • Requirements – Multiple displays – Touchscreen per display – Integration with various applications – Customizable window layout and system UI 14 Multiple Displays • Hardware interface App 1 App 1 App 1 App 1 – DRM with multiple connectors • QPA – Platform screens/windows per display • DRM connector – Platform screen – Compositor Platform window Window 0 Window 1 • Compositor QPA – Has multiple compositor windows per display Screen 0 Screen 1 • Platform window – compositor window – One compositor window covers the screen Connector 0 Connector 1 of the display associated DRM 15 Touchscreen per Display • Hardware interface App 1 App 1 App 1 App 1 – /dev/input/eventX • QPA – Delivers touch inputs to an Compositor associated window Window 0 Window 1 • Match touchscreen devices to each window • Send an event in a local coordinate of QPA the target window Screen 0 Screen 1 • Compositor Touchscreen 0 Touchscreen 1 – Handler events per window Linux Input Device 16 Apps and System UI • Integration with Apps – Supports various application types – Media integration • Punch-through • Textured video • Customizable window layout and system UI – Custom WebOSCompositor implementation as per spec – Reuse common features and UI elements from the compositor base 17 Prototype: LSM for IVI 18 Prototype: LSM for RSE 19 Summary • webOS is Linux based and open-sourced platform constructed on the flexible and extensible architecture. • LSM is the Wayland compositor and window manager in webOS that inherits extensibility. • webOS and LSM have specialties for automotive experiences such as IVI and RSE. 20 Find more in http://webosose.org https://github.com/webosose .
Recommended publications
  • Global Journal of Engineering Science And
    [ICRTCET-2018] ISSN 2348 – 8034 Impact Factor- 5.070 GLOBAL JOURNAL OF ENGINEERING SCIENCE AND RESEARCHES SUBJECTIVE EVALUATION OF SMART TELEVISION PLATFORM TECHNOLOGIES FOR ARCHITECTURAL AND PERFORMANCE COMPARISON Druvika Pandita*1, Swastik Gupta2, Ashish Suri3 & S.B Kotwal4 *1,2,3&4School of Electronics and Communication Engineering Shri Mata Vaishnodevi University, Katra, Jammu and Kashmir, India ABSTRACT Consumer electronics has been recognized with advanced possibility with the advancement in computing trends and technology. Almost all the consumer electronics like smart television, stereo systems, telephones, mobiles now run on the smart operating systems that profiles internet access, multitasking, streaming media live, audio video playbacks and a broad range of applications. A smart television entitles an operating systems or platform that enables the user to access and view network based and online multimedia content eliminating the need to connect to an extra box hardware. There is a strict need for comparison for being acquainted with variations present in content access, possible privacy concerns and for developer concerns, the software development kit (SDK), the integrated development environment (IDE) framework and the supported codecs. Above all there is a need for balancing the physical attractiveness of a smart television platform, with other important factors like native applications, web support and playback. This paper recognizes several such smart television platforms for television and presents a subjective comparison among them by means of contrasted parameters of application framework, developer SDK, web support, multitasking, playback, schedulers and others. The results are noted and evaluated.[1] Keywords: operating systems, memory, multitasking, kernels, tizen, webOS, android, framework, software development kit, system manager, legacy television, native playback, device driver web support I.
    [Show full text]
  • Webos Interview Questions and Answers Guide
    WebOS Interview Questions And Answers Guide. Global Guideline. https://www.globalguideline.com/ WebOS Interview Questions And Answers Global Guideline . COM WebOS Job Interview Preparation Guide. Question # 1 What is webOS? Answer:- WebOS also known as LG webOS, Open webOS or HP webOS, is a Linux kernel-based operating system for smart TVs, and formerly a mobile operating system. Initially developed by Palm, which was acquired by Hewlett-Packard, HP made the platform open source, and it became Open WebOS. The operating system was later sold to LG Electronics. Read More Answers. Question # 2 Explain what are the different membership levels and options? Answer:- There are two levels of membership, as follows: To post to our forums, you need to register as a Community Member. No registration is required to read forum content. This type of membership does not expire. If you wish to distribute applications, you need to become a full member of the HP webOS Developer Program. This level includes Community Membership and lasts for one year. When you sign up for the Developer Program, there is a special option for open source developers which gives you the full benefits of the Developer Program and avoids the annual fees (though this is currently waived). Read More Answers. Copyright © https://www.GlobalGuideline.COM Page 2/4 Smartphone OS Most Popular Interview Topics. 1 : Windows Phone Frequently Asked Interview Questions and Answers Guide. 2 : iOS Frequently Asked Interview Questions and Answers Guide. 3 : Blackberry OS Frequently Asked Interview Questions and Answers Guide. 4 : Nokia Asha Frequently Asked Interview Questions and Answers Guide.
    [Show full text]
  • Industry Consolidation
    the power and the danger Industry Consolidation By Russ McGuire - [email protected] his past month brought some major industry news. On August 15, Google announced its intention to Tacquire Motorola Mobility. The primary reason identified for the $12.5B purchase price is for Google to gain access to Motorola’s intellectual property rights for use in the patent wars that have been threatening the ongoing viability of the Android mobile operating system. On August 18, Hewlett Packard announced that The explosive mobile growth expanded even it was shutting down development of the WebOS more with the launch of the iPad in April 2010. An- mobile operating system, and that it was seeking to droid tablets were quickly launched to compete, and sell its PC business. HP had gained WebOS when it HP announced the acquisition of Palm, primarily to acquired Palm in July 2010 for $1.2B. gain the WebOS operating system, with HP’s Touch- Pad tablet being a high priority target for WebOS. What’s going on here? The success of tablets has put a noticeable dent in Mobility is the growth engine for the computing sales of netbook and notebook computers. industry (and other industries). Other competitors in the mobile space have Growth in mobility exploded with the launch of struggled to retain relevance and have lost significant Apple’s iPhone in 2007. At the end of 2007, Google, market share, including Nokia (formerly the global along with a large consortium of industry players smartphone leader), Research in Motion (owner of (the Open Handset Alliance) introduced Android the Blackberry brand), and Microsoft.
    [Show full text]
  • Download Android Os for Phone Open Source Mobile OS Alternatives to Android
    download android os for phone Open Source Mobile OS Alternatives To Android. It’s no exaggeration to say that open source operating systems rule the world of mobile devices. Android is still an open-source project, after all. But, due to the bundle of proprietary software that comes along with Android on consumer devices, many people don’t consider it an open source operating system. So, what are the alternatives to Android? iOS? Maybe, but I am primarily interested in open-source alternatives to Android. I am going to list not one, not two, but several alternatives, Linux-based mobile OSes . Top Open Source alternatives to Android (and iOS) Let’s see what open source mobile operating systems are available. Just to mention, the list is not in any hierarchical or chronological order . 1. Plasma Mobile. A few years back, KDE announced its open source mobile OS, Plasma Mobile. Plasma Mobile is the mobile version of the desktop Plasma user interface, and aims to provide convergence for KDE users. It is being actively developed, and you can even find PinePhone running on Manjaro ARM while using KDE Plasma Mobile UI if you want to get your hands on a smartphone. 2. postmarketOS. PostmarketOS (pmOS for short) is a touch-optimized, pre-configured Alpine Linux with its own packages, which can be installed on smartphones. The idea is to enable a 10-year life cycle for smartphones. You probably already know that, after a few years, Android and iOS stop providing updates for older smartphones. At the same time, you can run Linux on older computers easily.
    [Show full text]
  • Introduction
    CS307 Operating Systems Introduction Fan Wu Department of Computer Science and Engineering Shanghai Jiao Tong University Spring 2020 Operating Systems Operating Systems 2 Operating Systems UNIX-family: BSD(Berkeley Software Distribution), System-V, GNU/Linux, MINIX, Nachos, OS X, iOS BSD-family: FreeBSD, NetBSD, OpenBSD System-V-family: AIX, HP-UX, IRIX, Solaris Linux-family: Red Hat, Debian, Ubuntu, Fedora, openSUSE, Linux Mint, Google's Android, WebOS, Meego MS-DOS, Microsoft Windows, Windows Mobile, Win-CE, WP8 AmigaOS Symbian, MeeGo Google Chrome OS OS/2 XrossMediaBar(XMB) for PS3, Orbis OS for PS4 Input Output System for Wii Tiny-OS, LynxOS, QNX, VxWorks Operating Systems 3 Four Components of a Computer System People, machines, other computers Application programs define the ways in which theSystem system programs resources are arecomputer used to software solve the computingdesigned to problems operate theof thecomputer users hardware and toControls provide and a platformcoordinates for runninguse of hardware application among programsvarious applications and users provides basic computing resources Operating Systems 4 Computer System Structure Hardware – provides basic computing resources CPU, memory, I/O devices Operating system – Controls and coordinates use of hardware among various applications and users System programs – are computer software designed to operate the computer hardware and to provide a platform for running application programs BIOS and device drivers Application programs – define the ways in
    [Show full text]
  • Survey on Security Threats for Various Mobile Operating Systems
    International Journal of Scientific Research and Review ISSN NO: 2279-543X SURVEY ON SECURITY THREATS FOR VARIOUS MOBILE OPERATING SYSTEMS D.Roseline Selvarani M.Sc., M.Phil1 A.Thamizh Priya2 I.Roseline Jecintha M.C.A., M.Phil.3 1Assistant Professor, PG&Research Department of Computer Science, Holy Cross College (Autonomous), Trichy. 2M.Phil Scholar Department of Computer Science, St-Joseph’s College of Arts & Science (Autonomous), Cuddalore. 3Assistant Professor, Department of Computer Application, St-Joseph’s College of Arts & Science (Autonomous), Cuddalore. ABSTRACT The main objective of the paper is to propose security policies and mechanisms for mobile phones that fulfil the user expectations ensure the data privacy for mobile users. The main reason of mobile phone growing ratio will be increased in recent years due to improved memory, processor and optimize the size of mobile devices. Nowadays smart phone usage will be increased because of the reason is optimized size, functionality enhancement, capable of host many useful and attractive applications. However, this vast amount of mobile platform usage makes these smart devices a soft target for security attacks and privacy breach. This paper examines the various types of mobile operating systems and its security threats. In this paper comparison of Smartphones like Android, Blackberry, Apple iOS, Symbian, Window Mobile, BADA, PALM OS (Garnet OS), Open WebOs, Maemo and Meego based on the specific evaluation criterions used for assessing the security level. Keywords Smartphone, Security, Malware, Attack, Operating System I.INTRODUCTION A working framework will be introduced for each PC. Customary working frameworks are WindowsOS, macOS, UNIX, and Linux.
    [Show full text]
  • Palm Webos Implementation Guide
    Palm webOS Implementation Guide First edition, for webOS version 1.4 © Copyright 2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. This manual may not be copied, in whole or in part, without written consent. Every effort has been made to ensure that the information in this manual is accurate. Palm is not responsible for printing or clerical errors. Palm, Inc., 950 W. Maude Ave., Sunnyvale CA 94085-2801 palm.com Palm, Mojo, Palm OS, Pixi, Pre, Synergy, and webOS are trademarks of Palm, Inc., a subsidiary of Hewlett Packard Company. Facebook is a registered trademark of Facebook, Inc. Google, Gmail, and Google Talk are trademarks of Google, Inc. LinkedIn and the LinkedIn logo are registered trademarks in the United States and/or other countries. Microsoft, ActiveSync, Excel, Outlook, and PowerPoint are trademarks of the Microsoft group of companies. Yahoo! and Yahoo! Mail are registered trademarks of Yahoo! Inc. Mention of third- party products is for informational purposes only and constitutes neither an endorsement nor a recommendation. Palm assumes no responsibility with regard to the performance or use of these products. Palm webOS Implementation Guide i What’s in this guide? This guide provides best practices for deploying, configuring, and managing Palm® webOS™ phones in enterprise environments.
    [Show full text]
  • Forensic Acquisition and Analysis of Palm Webos on Mobile Devices
    digital investigation 8 (2011) 37e47 available at www.sciencedirect.com journal homepage: www.elsevier.com/locate/diin Forensic acquisition and analysis of palm webOS on mobile devices Eoghan Casey*, Adrien Cheval, Jong Yeon Lee, David Oxley, Yong Jun Song The Johns Hopkins University Information Security Institute, 216 Maryland Hall, Baltimore, MD 21218, USA article info abstract Article history: The emergence of webOS on Palm devices has created new challenges and opportunities Received 23 October 2010 for digital investigators. With the purchase of Palm by Hewlett Packard, there are plans to Received in revised form use webOS on an increasing number and variety of computer systems. These devices can 24 February 2011 store substantial amounts of information relevant to an investigation, including digital Accepted 27 April 2011 photographs, videos, call logs, SMS/MMS messages, e-mail, remnants of Web browsing and much more. Although some files can be obtained from such devices with relative ease, the Keywords: majority of information of forensic interest is stored in databases on a system partition Mobile device forensics that many mobile forensic tools do not acquire. This paper provides a methodology for Palm forensics acquiring and examining forensic duplicates of user and system partitions from a device webOS forensics running webOS. The primary sources of digital evidence on these devices are covered with illustrative examples. In addition, the recovery of deleted items from various areas on webOS devices is discussed. ª 2011 Elsevier Ltd. All rights reserved. 1. Introduction on mobile devices, tablet computers, and “web-aware” appliances. The newest operating system created by Palm, called webOS, The primary test device used for this work was webOS presents challenges and opportunities for digital investiga- 1.4.1.1 on the Dual Band 3G CDMA “Palm Pre Plus” cell phone.
    [Show full text]
  • Muuglines the Manitoba UNIX User Group Newsletter
    MUUGLines The Manitoba UNIX User Group Newsletter Volume 30 No. 8, April 2018 Editor: Tyhr Trubiak Next Meeting: April 10, 2018 This M$nth’s Meeting 7:30pm 1M28 Manitoba ,all, - $f . 7eetings are held in RTFM: true/false wit Brad V$ke& the Universit( of Win- Learn how to avoid the following: nipeg’s Manito"a Hall, in the east end if [ "$brad_vokey_present" = true ]; then of the Univer- echo 'RTFM time with Brad!' else sity Co&plex, while true;do near Bal&oral St. echo 'Extra long roundtable...' done !e can be found in fi roo& 17:). #oors are usuall( open b( 7:<< p& with the meeting starting at Presentation: Checkpoint Firewalls ;:=< p&. Parking is available on the sur- Wyatt Zacharias will present Checkpoint rounding streets. See Next-Gen Firewalls. Checkpoint firewalls fea- uwinnipeg.ca/maps ture next-gen features such as IPS, Application for further infor&ation and We" control, Download Sand"oxing, H%%PS about parking and access to the campus. deep inspection, and advanced central manage- &ent capabilities. Checkpoint so'ware is avail- /$urt $0erturns Oracle 03 4$$gle able on a variety of platfor&s, including their US federal court has overturned the jur(-s de- own hardware appliances and any standard x)* cision in favour of Google fro& 2<3*. platfor&. W(att will de&onstrate how to install and setup the so'ware in a virtual environment, 2e Federal Circuit has made a ver( controver- and how to get started with the next-gen features sial decision on the divided issue of “fair use/.
    [Show full text]
  • Digital Devices and the Information on Them
    Devices as Witnesses Greg Kelley, EnCE, DFCP Vestige Digital Investigations NALS of Northeast Ohio About Me • B.S. in Computer Engineering from CWRU • Computer forensics since 2001 • Examined thousands of computers for hundreds of matters • Testified in State and Federal Cases for plaintiff, prosecution and defense 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd Digital Evidence 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd More Digital Evidence! 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd What to do? • It is quite daunting • You don’t know what you don’t know • Lack of resources 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd Witnesses • Understand that digital devices are witnesses • Won’t lie • See things you may not realize • Can be misinterpreted 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd What you can expect from Computers • Content • Keyword search for content/communication • ALL correspondence • Hidden information • Deleted information • Orphaned information • Encrypted information 800.314.4357 | www.VestigeLtd.com | Responsiveness, Speed & Availability Reliability Knowledge | Copyright ©2016 Vestige Ltd • Correspondence • Memos
    [Show full text]
  • Developing a Cross-Platform Mobile Smart Meter Application Using Html5, Jquery Mobile and Phonegap
    DEVELOPING A CROSS-PLATFORM MOBILE SMART METER APPLICATION USING HTML5, JQUERY MOBILE AND PHONEGAP Alexander Zibula1 and Tim A. Majchrzak2 1Best Practice Consulting AG (bpc), Munster,¨ Germany 2Department of Information Systems, University of Munster,¨ Munster,¨ Germany Keywords: App, Mobile Application, Cross-platform, iOS, Android, HTML5, PhoneGap, jQuery Mobile, Smart Meter, iPhone, Apache Cordova, Apache Callback. Abstract: Mobile computing devices are becoming more prevalent. Mobile applications extend their scope and utility. Developing such apps introduces a problem: developers are being forced to develop their applications to target each mobile platform from scratch or to rely on Web-based solutions that do not provide a “native” look and feel. In order to investigate novel methods of multi-platform app development and to review HTML5, we built an app using several cutting-edge development frameworks. Our scenario—a smart meter tool—is an active area of research in itself. We present approaches in the field of multi-platform app development and illustrate the technological background. We provide an overview of our development process. Finally, we evaluate our app and discuss our findings in order to provide generalizable results. 1 INTRODUCTION ers’ perception. The third category are native apps that have been written for a specific platform—either Since the advent of the Internet as a universal technol- a virtual machine or a mobile (device) operating sys- ogy, mobile computing has continuously increased in tem. importance. Beginning with smartphones, in partic- Developing apps is far from hassle-free. Due to ular the iPhone in 2007 (Macedonia, 2007), mobile rapid progress in hardware development, software de- Internet usage has greatly increased.
    [Show full text]
  • Webos: the Long Journey to Webos Open Source Edition AGENDA
    webOS: The Long Journey to webOS Open Source Edition AGENDA webOS : History and Evolution Overview of webOS Open Source Edition (OSE) webOS OSE: Architecture webOS OSE: Roadmap webOS OSE: Contribution Introduction to Enact (Web App Framework) webOS : History and Evolution Joseph Park Encounter Why web based Platform Upcoming web era… Mobile Embedded HTML5 Internet Chipset Standard 2Mbps in ’02 Performance ↑ Price ↓ 25Gbps in ’18 3GHz … 1MHz … 2018 Why web based Platform Best solution to deliver contents ▪ TV is a device to show contents delivered from outside ▪ The contents used to be linear video, but are becoming complicated Best solution to satisfy all stakeholders ▪ Many manufacturers, and service providers ▪ Web is based on open standards ▪ OTT services on the web webOS TV in CES 2014 “For LG, this isn’t just another smart TV platform, but a rebirth for the company, not unlike WebOS itself.” Jared Newman. TIME “It's the best smart TV UI we've ever used.” Michael Gorman, Engadget “I can say without question that it's the best smart TV interface I've ever seen. It was actually smart!“ Brent Rose, Gizmodo webOS based products `15.2 `14.6 `14.2 webOS Open • To build up ecosystem in the emerging areas • To leverage external capabilities to enrich webOS • webOS is now a mature, stable and ready to move beyond TV webOS Next Robot Auto Home Come change the world together! Overview of webOS Open Source Edition (OSE) Lokesh Kumar Goel webOS OSE: why open source Overview Build strong developer community Feature-rich Compatible Roadmap 100M+
    [Show full text]