DOCSLIB.ORG

Collabora 2017 16X9

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Collabora 2017 16X9 GStreamer in the world of Android Camera 3 Olivier Crête Open First Who am I ? ● GStreamer at Collabora since 2007 ● Started with VVoIP: Telepathy & Farstream ● Helps our customers use GStreamer – Many hardware integration projects 2 What is Camera 3? ● New Camera API style ● Introduced by Android 5.0 in 2004 ● Exposes modern SoC cameras 3 Modern SoCs? ● Used in all phones ● Multiple hardware blocks ● Configurable hardware pipeline ● Signal level transfer 4 Features ● Multiple streams from same sensor – Different characteristics for each ● Request based – Pull instead of push 5 What is a Request? ● Request to capture one frame ● Per request parameters ● Enables – HDR – Burst captures – Traditional video: timed requests 6 Existing APIs ● Linux: Media Controller – Requires per-hardware userspace code ● Android has HAL for this – Generic Linux has nothing – Intel has icamerasrc ● Android Java/NDK Camera2 API 7 Our design ● New base class – Not GstBaseSrc ● We tried, it was a huge pain ● Multiple source pads – Request pads – Stream APIs on pads 8 Pad API ● Per stream properties using GObject Properties ● Two types based on Caps frame rate 9 Caps frame rate = 0 / 1 ● Manual request using action signal or Ginterface ● Start/Stop method to start bursts – Possibly infinite bursts 10 Caps Frame rate > 0 ● Automatic timed requests based on framerate ● Stop on not-linked – Restart on reconfigure 11 Limitations ● Media Controller not dynamic – Only allow caps change in the READY→ PAUSED transition – Maybe only if more than one stream (pad) ● Some “” stream properties apply globally ¯\_( )_/¯ ツ 12 Android HAL limitations ● Requires single threaded access ● Recommendation: – One thread to interact – Queues frames for each pad – Streaming threads pick up from there ● Specific to Android HAL 13 Implementation status ● Only horribly prototype ● Code has no value – Based on GstBaseSrc – Tested with a single Android HAL ● Will not publish ● Code by Nicolas, Vincent P and Wonchul 14 Thank you!.
Load more

Recommended publications
  • Libghc-Gtk-Prof Libghc-Gio-Prof 0. Libghc-Pango-Prof 0. Zorp
    linphone-common libhugs-base-bundled jlex libmono-security2.0-cil 0. libkonq5-templates libxfixes-dev php5-tidy ruby-magic python-peak.util 0. 0. libisc83 python-async 0. 0. linphone kvirc-modules libjaxe-java syncache 3.23886639676 gcj-4.6-jre-lib 0.0. 0. 0. liblua50-dev 0. 0. 0. libgdkcutter-pixbuf-dev 0. libavahi-common-data libbind9-80 kget gir1.2-cogl-1.0 0. 0. 0. hugs libblacs-mpi-dev 0. python-syfi 0. 0. 0. 0. libhttp-exception-perl 0. 0. libmono-posix2.0-cil libkonq-common 0. 0.877192982456 0. 0.78125 libxcursor-dev 0.31919744642 0. docvert-libreoffice pdf2svg 0. python-peak.rules 2.17391304348 0. 0. 0. librasqal3-dev 0. 0. libxsltc-java libgretl1 gretl gretl-common 0.877192982456 python-passlib python-keystone python-pam kvirc kvirc-data python-cl python-celery python-mailer python-radix zorp python-kzorp libjutils-java libjinput-java libjinput-jni 0. samizdat ecj-gcj libecj-java-gcj linphone-nogtk 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. geany-common 4.04858299595 0. 0. 0. 0. paw 0. python 0. 0. 0. 0. 0. 0. libisccc80 python-gitdb python-git 0. 0. 0. llvm-3.1 0. 0. 0. 0. cl-alexandria 0. liblua50 liblualib50 0. cutter-gtk-support gir1.2-clutter-1.0 0.0227272727273 libavahi-client3 0. 0. 0. libmumps-dev 1.06382978723 0. 0. 0. libtie-shadowhash-perl ruby-graffiti libkonq5abi1 libkvilib4 docvert ruby-whitewash python-turbojson x11proto-fixes-dev libhugs-haskell98-bundled ecj libmono-system2.0-cil 0.
    [Show full text]
  • Libreoffice 10Th Anniversary Digital Sovereignty & Open
    LibreOffice 10th Anniversary Digital Sovereignty & Open Document Standards Italo Vignoli 10 Years / 20 Years July 19, 2000: Sun announces OpenOffice.org Sept 28, 2010: OpenOffice.org community announces LibreOffice Timeline 35 years since Marco Börries releases the first version of StarWriter in 1985 2009: Oracle acquires Sun OpenOffice vs LibreOffice SEPTEMBER 28, 2010 OpenOffice.org Community announces The Document Foundation The community of volunteers developing and promoting OpenOffice.org sets up an independent Foundation to drive the further growth of the project The brand "LibreOffice" has been chosen for the software going forward Gamalielsson, J. and Lundell, B. (2011) Open Source communities for long-term maintenance of digital assets: what is offered for ODF & OOXML?, in Hammouda, I. and Lundell, B. (Eds.) Proceedings of SOS 2011: Towards Sustainable Open Source, Tampere University of Technology, Tampere, ISBN 978-952-15-2718-0, ISSN 1797-836X. LibreOffice 3.3 at FOSDEM 2011 Roadmap to the Future … • Time based, six-monthly release train … • Synchronised with the Linux distributions cadence • i.e. a normal Free Software project • Rapid fire, (monthly) bug-fix release on stable branch The Document Foundation The Document Foundation Founding Principles COPYLEFT LICENSE NO CONTRIBUTOR AGREEMENT MERITOCRACY COMMUNITY GOVERNANCE VENDOR INDEPENDENCE LibreOffice Main Asset Incredible Easy Hacks Huge Mentoring Effort 100 200 300 400 500 600 0 Sep 10 Oct 10 Nov 10 CumulativeNumber of LibreOffice New Code Committers New Hackers New Dec
    [Show full text]
  • Project Proposal Service Architecture for Multimedia Based Communication
    Seite 1/8 Project Proposal Service Architecture for Multimedia Based Communication Dipl.-Ing. Eva Brucherseifer Dipl.-Ing. Stefan Eilers 02/01/06 Contents 1.The Situation......................................................................................................................... ...............2 2.The Vision............................................................................................................................... .............2 3.Related Projects...................................................................................................................... .............4 3.1.Telepathy..................................................................................................................................... 4 3.2.MOTUIM/DesktopIntegrationSIPIM .................................................................................... ..........4 3.3.KCall.......................................................................................................................................... ..4 3.4.OpenTAPI Prototype..................................................................................... ................................5 4.OpenCDI Project: Description and Bias........................................................................ .........................5 4.1.Roadmap................................................................................................. .....................................6 5.License..........................................................................................................
    [Show full text]
  • Yocto Project Reference Manual Is for the 1.6.3 Release of the Yocto Project
    Richard Purdie, Linux Foundation <[email protected]> by Richard Purdie Copyright © 2010-2015 Linux Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the Creative Commons Attribution-Share Alike 2.0 UK: England & Wales [http://creativecommons.org/licenses/by-sa/2.0/uk/] as published by Creative Commons. Manual Notes • This version of the Yocto Project Reference Manual is for the 1.6.3 release of the Yocto Project. To be sure you have the latest version of the manual for this release, go to the Yocto Project documentation page [http://www.yoctoproject.org/documentation] and select the manual from that site. Manuals from the site are more up-to-date than manuals derived from the Yocto Project released TAR files. • If you located this manual through a web search, the version of the manual might not be the one you want (e.g. the search might have returned a manual much older than the Yocto Project version with which you are working). You can see all Yocto Project major releases by visiting the Releases [https://wiki.yoctoproject.org/wiki/Releases] page. If you need a version of this manual for a different Yocto Project release, visit the Yocto Project documentation page [http://www.yoctoproject.org/ documentation] and select the manual set by using the "ACTIVE RELEASES DOCUMENTATION" or "DOCUMENTS ARCHIVE" pull-down menus. • To report any inaccuracies or problems with this manual, send an email to the Yocto Project discussion group at [email protected] or log into the freenode #yocto channel.
    [Show full text]
  • Ofono Open-Source Telephony
    oFono Open-source telephony R´emiDenis-Courmont Aki Niemi Nokia Devices R&D Maemo Software Maemo summit 2009 - October 10th 2009 R´emiDenis-Courmont Nokia oFono Outline 1 A brief history of Linux telephony 2 Nokia N900 3 oFono R´emiDenis-Courmont Nokia oFono A brief history of Linux telephony Nokia N900 oFono Outline 1 A brief history of Linux telephony 2 Nokia N900 3 oFono R´emiDenis-Courmont Nokia oFono voice calls Short Message Service (SMS) location supplementary services General packet radio service (GPRS) ... A brief history of Linux telephony Nokia N900 oFono What's (cellular) telephony? network status network selection SIM security (PIN, PUK. ) SIM phone book R´emiDenis-Courmont Nokia oFono A brief history of Linux telephony Nokia N900 oFono What's (cellular) telephony? network status network selection SIM security (PIN, PUK. ) SIM phone book voice calls Short Message Service (SMS) location supplementary services General packet radio service (GPRS) ... R´emiDenis-Courmont Nokia oFono designed in the seventies. originally for 300 bauds fixed serial line ASCII awkward multiplexing PPP (binary) for backward-compatibility A brief history of Linux telephony Nokia N900 oFono The standard (?) Hayes commands set ITU V.250 3GPP 27.007 better known as AT commands R´emiDenis-Courmont Nokia oFono awkward multiplexing PPP (binary) for backward-compatibility A brief history of Linux telephony Nokia N900 oFono The standard (?) Hayes commands set ITU V.250 3GPP 27.007 better known as AT commands designed in the seventies. originally for 300 bauds fixed serial line ASCII R´emiDenis-Courmont Nokia oFono A brief history of Linux telephony Nokia N900 oFono The standard (?) Hayes commands set ITU V.250 3GPP 27.007 better known as AT commands designed in the seventies.
    [Show full text]
  • Presents : Coreboot for Dummies
    Coreboot for Dummies By Youness Alaoui This adventure has been sponsored by : What are we gonna talk about? •Who am I ? •Getting started with coreboot! •Getting an existing port to build and work •Testing and finishing the Librem 13 v1 port •Starting a new port from scratch •Debug output, how hard can it be? •Summary of doing a port •It's question time! Who am I ? ● Youness Alaoui, a.k.a KaKaRoTo ● aMSN developper ● libnice, Farstream, GStreamer, Meego ● PS3 reverse-engineer ● Freelance consultant ● Most importantly: a coreboot newbie Getting started with coreboot! ● What is coreboot? How does it work ? ● Looking at the entry point… Bad ideas ● The Three Stooges ● Lack of documentation ● Excessive documentation ● Getting started tutorial How to brick a laptop quickly and painlessly! ● Just kidding, it will be painful to the laptop. ● At first glance, most wiki information is about desktop motherboards ● Backup the rom before doing anything else! ● Don’t solder to the motherboard! Dumping the flash on v2 hardware ● Used a Logic Analyzer ● Dump trace data into CSV ● Script to analyze SPI commands and reconstitute the image from reads ● Realize the image is corrupted ● Adjust for <2ns spikes to ignore cross talk ● Give up Dumping the flash on v2 hardware Dumping the flash on v1 hardware ● Don't trust AFULNX, AFUDOS, AFUWIN ● Flashrom to the rescue! ● Laptops and EC ● Use a SOIC clip, instead of a chip socket ● Understanding the Intel Flash Descriptor ● Powering the flash chip and hardware magical nonsense First coreboot build ● The first build tutorial is an excellent start ● Missing microcode ● Missing blobs and descriptors Binary blobs, gotta catch them all! ● How to dump the VGA Bios properly ● Where to get the MRC.bin file ? ● What about the refcode.bin ? ● IFD Descriptor and ME binaries The importance of debugging ● Getting USB debug to work was easy, thank you! ● With no debug output, you can’t properly do a port.
    [Show full text]
  • Red Hat Enterprise Linux 7 7.8 Release Notes
    Red Hat Enterprise Linux 7 7.8 Release Notes Release Notes for Red Hat Enterprise Linux 7.8 Last Updated: 2021-03-02 Red Hat Enterprise Linux 7 7.8 Release Notes Release Notes for Red Hat Enterprise Linux 7.8 Legal Notice Copyright © 2021 Red Hat, Inc. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/ . In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux ® is the registered trademark of Linus Torvalds in the United States and other countries. Java ® is a registered trademark of Oracle and/or its affiliates. XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and other countries. Node.js ® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
    [Show full text]
  • Red Hat Enterprise Linux 7 7.9 Release Notes
    Red Hat Enterprise Linux 7 7.9 Release Notes Release Notes for Red Hat Enterprise Linux 7.9 Last Updated: 2021-08-17 Red Hat Enterprise Linux 7 7.9 Release Notes Release Notes for Red Hat Enterprise Linux 7.9 Legal Notice Copyright © 2021 Red Hat, Inc. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/ . In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, the Red Hat logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux ® is the registered trademark of Linus Torvalds in the United States and other countries. Java ® is a registered trademark of Oracle and/or its affiliates. XFS ® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL ® is a registered trademark of MySQL AB in the United States, the European Union and other countries. Node.js ® is an official trademark of Joyent. Red Hat is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
    [Show full text]
  • Debian and Ubuntu
    Debian and Ubuntu Lucas Nussbaum lucas@{debian.org,ubuntu.com} lucas@{debian.org,ubuntu.com} Debian and Ubuntu 1 / 28 Why I am qualified to give this talk Debian Developer and Ubuntu Developer since 2006 Involved in improving collaboration between both projects Developed/Initiated : Multidistrotools, ubuntu usertag on the BTS, improvements to the merge process, Ubuntu box on the PTS, Ubuntu column on DDPO, . Attended Debconf and UDS Friends in both communities lucas@{debian.org,ubuntu.com} Debian and Ubuntu 2 / 28 What’s in this talk ? Ubuntu development process, and how it relates to Debian Discussion of the current state of affairs "OK, what should we do now ?" lucas@{debian.org,ubuntu.com} Debian and Ubuntu 3 / 28 The Ubuntu Development Process lucas@{debian.org,ubuntu.com} Debian and Ubuntu 4 / 28 Linux distributions 101 Take software developed by upstream projects Linux, X.org, GNOME, KDE, . Put it all nicely together Standardization / Integration Quality Assurance Support Get all the fame Ubuntu has one special upstream : Debian lucas@{debian.org,ubuntu.com} Debian and Ubuntu 5 / 28 Ubuntu’s upstreams Not that simple : changes required, sometimes Toolchain changes Bugfixes Integration (Launchpad) Newer releases Often not possible to do work in Debian first lucas@{debian.org,ubuntu.com} Debian and Ubuntu 6 / 28 Ubuntu Packages Workflow lucas@{debian.org,ubuntu.com} Debian and Ubuntu 7 / 28 Ubuntu Packages Workflow Ubuntu Karmic Excluding specific packages language-(support|pack)-*, kde-l10n-*, *ubuntu*, *launchpad* Missing 4% : Newer upstream
    [Show full text]
  • Moblin Architecture Overview Linux Foundation – Moblin Seminar
    Moblin Architecture Overview Linux Foundation – Moblin Seminar Sunil Saxena Open Source Technology Center Software & Services Group Legal information INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL® PRODUCTS. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER , AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY RELATING TO SALE AND/OR USE OF INTEL PRODUCTS, INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE,,, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT, OR OTHER INTELLECTUAL PROPERTY RIGHT. Intel mayygp,pp,p make changes to specifications, product descriptions, and plans at any time, without notice. All dates provided are subject to change without notice. IliIntel is a tra demar kfIlCk of Intel Corporat iihUSdhion in the U.S. and other countr ies. *Other names and brands may be claimed as the property of others. Copyright © 2007-2009, Intel Corporation . All rights are protected. Linux Foundation – Moblin Seminar 2 2 2 Agenda Moblin Platform Usages Moblin Architecture Overview Summary / Call-to-Action Linux Foundation – Moblin Seminar 3 3 3 MID Platform Usages INFORMATION COMMUNICATION ENTERTAINMENT Social Networking Video, TV, Games EU Genera te d Con ten t Pic tures Directions Blog, IM/Chat Music POI, LBS Voice (VoIP, CSV) Internet Browsing News, Shop, Sports Internet Browsing Internet Browsing Video Conferencing GenY GenY Gen Y Digital Parents Mobile Professionals Digital Parents Mobile Professionals
    [Show full text]
  • COPYRIGHT NOTE: This Source Code, and All of Its Derivations, Is Subject to the "ITU-T General Public License"
    COPYRIGHT NOTE: This source code, and all of its derivations, is subject to the "ITU-T General Public License". Please have it read in the distribution disk, or in the ITU-T Recommendation G.191 on "SOFTWARE TOOLS FOR SPEECH AND AUDIO CODING STANDARDS". This code has (C) Copyright by AT&T Corp. ** Copyright (C) 2010 David Schleef <[email protected]> Copyright (C) 2010 Sebastian Dröge <[email protected]> Copyright (C) <2011> Intel Corporation Copyright (C) <2011> Collabora Ltd. Copyright (C) <2011> Thibault Saunier <[email protected]> &copy; Panasonic System Networks Co., Ltd. 2012 &copy; Panasonic System Networks Co., Ltd. 2013 (c) 2003 Ronald Bultje <[email protected]> (c) 2003 Ronald Bultje <[email protected]> (c) 2005 Michal Benes <[email protected]> (c) 2003 Ronald Bultje <[email protected]> (c) 2005 Michal Benes <[email protected]> (c) 2008 Sebastian Dröge <[email protected]> (c) 2011 Mark Nauwelaerts <[email protected]> (C) 2003 Ronald Bultje <[email protected]> (C) 2006 Tim-Philipp Müller <tim centricular net> (c) 2003 Ronald Bultje <[email protected]> (c) 2006 Tim-Philipp Müller <tim centricular net> (c) 2008 Sebastian Dröge <[email protected]> (c) 2011 Debarshi Ray <[email protected]> (c) 2003 Ronald Bultje <[email protected]> (c) 2011 Debarshi Ray <[email protected]> (c) 2004 Arwed v. Merkatz <[email protected]> (c) 2004 Ronald Bultje <[email protected]> (c) 2005 Arwed v. Merkatz <[email protected]> (c) 2005 Ronald S. Bultje <[email protected]> (c) 2005 Ronald S.
    [Show full text]
  • Real-Time Communications Framework
    Real-time Communications Framework 1 Robert McQueen, Collabora Limited <[email protected]> 2 Rationale ● A new approach to real-time communications ● Unifying IM, VOIP and collaboration ● A brief look at desktop clients... 3 The Unix Way Do one thing and do it well IM Client 4 The Unix Way two Do one thing and do it well UI Protocol 5 The Unix Way six Do one thing and do it well Contact List Chats Logging AIM MSN XMPP 6 The Unix Way twelve Do one thing and do it well? Contact File Voice Chats Logging Avatars List Transfer Call AIM MSN XMPP SIP ICQ IRC 7 Heading The Same Way • Gaim users want voice calls... 8 Heading The Same Way • Ekiga users want IM... 9 Heading The Same Way • Gossip users want more protocols... 10 This Sucks ● Massive duplication of effort ● Fragmentation of APIs ● Integration suffers badly ● Few reusable components for embedded devices 11 The Big Idea ● Move away from the monolithic client ● Split stuff into separate processes ● Run protocols as services on the desktop ● Create a standard API for clients to use presence, messaging, media, etc... 12 The Big Idea VOIP Client Chat Client Logger D-Bus IPC SIP Backend XMPP Backend MSN Backend 13 Benefits ✔ Do one thing and do it well ✔ Re-usable components ✔ Interchangeable user interfaces ✔ Share connections between UI programs ✔ Language (and license) independence ✔ Only run what you need 14 What we're doing... ● Telepathy is a Freedesktop project ● Massively Important: well-documented D-Bus API ● Some protocol backends ● Libraries so you can use them 15 Specification Connection Manager Connection Connection Media Contact List IM Channel Channel Channel 16 Specification ● Connection manager objects give you connection objects ● Connections have interfaces: presence, aliases, avatars..
    [Show full text]