Understanding EXR Data Compression
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Fundamentals of Digital Video
FUNDAMENTALS OF DIGITAL VIDEO Digital Video Compression © 2016 Pearson Education, Inc., Hoboken, NJ. All 1 rights reserved. In this lecture, you will learn: • Basic ideas of video compression • General types of compression methods © 2016 Pearson Education, Inc., Hoboken, NJ. All 2 rights reserved. Compression • Basic idea: Want to represent the same content by using less data © 2016 Pearson Education, Inc., Hoboken, NJ. All 3 rights reserved. Compression and Decompression • Compression: – To reduce file size – Takes time – Often takes more time for higher compression • Decompression: – A compression video file must be decompressed before it is played. – The decompression method or algorithm depends on how it is originally compressed. © 2016 Pearson Education, Inc., Hoboken, NJ. All 4 rights reserved. Compression and Decompression • Compression and decompression always go together as a pair. • Codec : compressor/decompressor © 2016 Pearson Education, Inc., Hoboken, NJ. All 5 rights reserved. Types of Compression Methods • Spatial compression • Temporal compression • Lossless vs. lossy compression • Symmetrical and asymmetrical compression © 2016 Pearson Education, Inc., Hoboken, NJ. All 6 rights reserved. Spatial Compression • Compact individual frames as if they are independent digital images • Examples of algorithms: – Run-length encoding (RLE) – JPEG compression • Example codecs: – QuickTime Animation – QuickTime PlanarRGB – Microsoft RLE © 2016 Pearson Education, Inc., Hoboken, NJ. All 7 rights reserved. Spatial Compression • Types of video that spatial compression is good for: • contain large areas of solid colors, such as cartoon animation • Disadvantage: • Less compressed, i.e., relatively large file size compared to other types of compression © 2016 Pearson Education, Inc., Hoboken, NJ. All 8 rights reserved. Temporal Compression • Exploits the repetitious nature of image content over time in video • Saving more information for selected frames, i.e. -
Hardware Based Compression in Ceph OSD with BTRFS
Hardware Based Compression in Ceph OSD with BTRFS Weigang Li ([email protected]) Tushar Gohad ([email protected]) Data Center Group Intel Corporation 2016 Storage Developer Conference. © Intel Corp. All Rights Reserved. Credits This work wouldn’t have been possible without contributions from – Reddy Chagam ([email protected]) Brian Will ([email protected]) Praveen Mosur ([email protected]) Edward Pullin ([email protected]) 2 2016 Storage Developer Conference. © Intel Corp. All Rights Reserved. Agenda Ceph A Quick Primer Storage Efficiency and Security Features Offload Mechanisms – Software and Hardware Compression in Ceph OSD with BTRFS Compression in BTRFS and Ceph Hardware Acceleration with QAT PoC implementation Performance Results Key Takeaways 3 2016 Storage Developer Conference. © Intel Corp. All Rights Reserved. Ceph Open-source, object-based scale-out storage system Software-defined, hardware-agnostic – runs on commodity hardware Object, Block and File support in a unified storage cluster Highly durable, available – replication, erasure coding Replicates and re-balances dynamically 4 Image source: http://ceph.com/ceph-storage 2016 Storage Developer Conference. © Intel Corp. All Rights Reserved. Ceph Scalability – CRUSH data placement, no single POF Enterprise features – snapshots, cloning, mirroring Most popular block storage for Openstack use cases 10 years of hardening, vibrant community 5 Source: http://www.openstack.org/assets/survey/April-2016-User-Survey-Report.pdf 2016 Storage Developer Conference. © Intel Corp. All Rights Reserved. Ceph: Architecture OSD OSD OSD OSD OSD btrfs xfs ext4 POSIX Backend Backend Backend Backend Backend Bluestore KV DISK DISK DISK DISK DISK Commodity Servers M M M 6 2016 Storage Developer Conference. -
GNUPG Open Source Encryption on HP Nonstop
GNUPG Open Source Encryption on HP NonStop Damian Ward NonStop Solutions Architect / BITUG Vice Chairman Confidential Introduction What am I going to talk about today • About Me • About VocaLink • History of encryption • PGP to GNUPG • PGP encryption walkthrough • Installing GNUPG • Use Case • Questions..? Please feel free to ask as we go through the presentation. Confidential 2 Introduction About your presenter • Damian Ward • 20+ years HP NonStop and Payments experience • Career spanning: − Operations, Application Programming, System Management, Programme Management, Technical Specialist, Solutions Architect, Enterprise Architect, Infrastructure Architect • Specialities: − HP NonStop systems and architecture, Enterprise Architecture, Encryption, Availability Management, ATM Systems, Payments Processing, Capacity Planning, System modelling, Fraud, Mobile and Internet technologies, Programming, Emerging Technologies and Robotics • BITUG Vice Chairman 2011 • BITUG Chairman 2012 Confidential 3 Introduction VocaLink: cards processing landscape Direct connection to in house processing system Indirect ATM acquirer and card issuer connection (via VocaLinkCSB) FIS Connex Advantage Connections to Mobile Switch with resillient Operators Indirect ATM connection (via third telecommunication party processor) connections to each customer Connections to Direct connection overseas to Post Office via TNS CSB schemes and systems ATM and POS international banks acquiring and issuing connections via gateway connections to international schemes Confidential -
Intel® Quick Sync Video and Ffmpeg Installation and Validation Guide
White paper Intel® Quick Sync Video and FFmpeg Installation and Validation Guide Introduction Intel® Quick Sync Video technology on Intel® Iris™ Pro Graphics and Intel® HD graphics provides transcode acceleration on Linux* systems in FFmpeg* 2.8 and later editions. This paper is a detailed step-by-step guide to enabling h264_qsv, mpeg2_qsv, and hevc_qsv hardware accelerated codecs in the FFmpeg framework. For a quicker overview, please see this article. Performance note: The *_qsv implementations are intended to provide easy access to Intel hardware capabilities for FFmpeg users, but are less efficient than custom applications optimized for Intel® Media Server Studio. Document note: Monospace type = command line inputs/outputs. Pink = highlights to call special attention to important command line I/O details. Getting Started 1. Install Intel Media Server Studio for Linux. Download from software.intel.com/intel-media-server- studio. This is a prerequisite for the *_qsv codecs as it provides the foundation for encode acceleration. See the next chapter for more info on edition choices. Note: Professional edition install is required for hevc_qsv. 2. Get the latest FFmpeg source from https://www.FFmpeg.org/download.html. Intel Quick Sync Video support is available in FFmpeg 2.8 and later editions. The install steps outlined below were verified with ffmpeg release 3.2.2 3. Configure FFmpeg with “--enable –libmfx –enable-nonfree”, build, and install. This requires copying include files to /opt/intel/mediasdk/include/mfx and adding a libmfx.pc file. More details below. 4. Test transcode with an accelerated codec such as “-vcodec h264_qsv” on the FFmpeg command line. -
Adobe Photoshop® TIFF Technical Note 3 April 8, 2005
Adobe Photoshop® TIFF Technical Note 3 April 8, 2005 Adobe Photoshop® TIFF Technical Note 3 April 8, 2005 This document describes additions to the TIFF specification to improve support for floating point values. Readers are advised to cross reference terms and discussions found in this document with the TIFF 6.0 specification (TIFF6.pdf), the TIFF Technical Note for Adobe PageMaker® 6.0 (TIFF-PM6.pdf), and the File Formats Specification for Adobe Photoshop® (Photoshop File Formats.pdf). Page 1 of 5 Adobe Photoshop® TIFF Technical Note 3 April 8, 2005 16 and 24 bit Floating Point Values Introduction This section describes the format of floating point data with BitsPerSample of 16 and 24. Field: SampleFormat Tag: 339 (153.H) Type: SHORT Count: N = SamplesPerPixel Value: 3 = IEEE Floating point data Field: BitsPerSample Tag: 258 (102.H) Type: SHORT Count: N = SamplesPerPixel Value: 16 or 24 16 and 24 bit floating point values may be used to minimize file size versus traditional 32 bit or 64 bit floating point values. The loss of range and precision may be acceptable for many imaging applications. The 16 bit floating point format is designed to match the HALF data type used by OpenEXR and video graphics card vendors. Implementation 16 bit floating point values 16 bit floating point numbers have 1 sign bit, 5 exponent bits (biased by 16), and 10 mantissa bits. The interpretation of the sign, exponent and mantissa is analogous to IEEE-754 floating-point numbers. The 16 bit floating point format supports normalized and denormalized numbers, infinities and NANs (Not A Number). -
Proexr Manual
ProEXR Advanced OpenEXR plug-ins 1 ProEXR by Brendan Bolles Version 2.5 November 4, 2019 fnord software 159 Jasper Place San Francisco, CA 94133 www.fnordware.com For support, comments, feature requests, and insults, send email to [email protected] or participate in the After Effects email list, available through www.media-motion.tv. Plain English License Agreement These plug-ins are free! Use them, share them with your friends, include them on free CDs that ship with magazines, whatever you want. Just don’t sell them, please. And because they’re free, there is no warranty that they work well or work at all. They may crash your computer, erase all your work, get you fired from your job, sleep with your spouse, and otherwise ruin your life. So test first and use them at your own risk. But in the fortunate event that all that bad stuff doesn’t happen, enjoy! © 2007–2019 fnord. All rights reserved. 2 About ProEXR Industrial Light and Magic’s (ILM’s) OpenEXR format has quickly gained wide adoption in the high-end world of computer graphics. It’s now the preferred output format for most 3D renderers and is starting to become the standard for digital film scanning and printing too. But while many programs have basic support for the format, hardly any provide full access to all of its capabilities. And OpenEXR is still being developed!new compression strategies and other features are being added while some big application developers are not interested in keeping up. And that’s where ProEXR comes in. -
FPGA-Based ZLIB/GZIP Compression As an Nvme Namespace
FPGA-Based ZLIB/GZIP Compression as an NVMe Namespace Saeed Fouladi Fard Eideticom 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 1 Why NVMe ❒ NVMe: A standard specification for accessing non-volatile media over PCIe ❒ High-speed and CPU efficient ❒ In-box drivers available for major OSes ❒ Allows peer-to-peer data transfers ❒ Reduces system memory access ❒ Frees CPU time 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 2 Why NVMe, Cont’d Host ❒ NVMe can be used as a high speed Memory CPU platform for using PCIe and sharing NVMe SSD NVMe SSD NVMe SSD NVMe accelerators with Accelerator Accelerator Accelerator NVMe NVMe NVMe low overhead ❒ Easy to use Accels 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 3 Hardware Platform TM ❒ Called NoLoad = NVMe Offload TM ❒ NoLoad can present FPGA accelerators as NVMe namespaces to the host computer or peers ❒ Accelerator integration, verification, and discovery is mostly automated ❒ Host software can be added to use the accelerator Streamlined Accelerator Integration 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 4 NoLoadTM Software Management Applications ❒ Userspace: both kernel nvme-cli & userspace frameworks nvme-of supported etc libnoload SPDK ❒ OS: use inbox NVMe driver (no changes) TM ❒ Hardware: NoLoad Hardware Eval Kits 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 5 Accelerators as NVMe devices NVMe NSs: 3 Optane SSDs, 3 Compression Accels, 1 RAM-Drive 2018 Storage Developer Conference. © Eidetic Communications Inc. All Rights Reserved. 6 Peer-to-Peer Access ❒ P2P Transfers bypass DRAM DRAM CPU memory and other DDR DDR PCIe subsystems CPU CPU ❒ P2P uses PCIe EP’s memory (e.g., CMB,BAR) PCIe PCIe PCIe PCIe NoLoad NVMe NVMe NVMe ❒ A P2P capable Root CMB Complex or PCIe switch is needed SSD A SSD B SSD A NoLoad with Compression Legacy Datapath Peer-2-Peer Datapath 2018 Storage Developer Conference. -
Scripting the Openssh, SFTP, and SCP Utilities on I Scott Klement
Scripting the OpenSSH, SFTP, and SCP Utilities on i Presented by Scott Klement http://www.scottklement.com © 2010-2015, Scott Klement Why do programmers get Halloween and Christmas mixed-up? 31 OCT = 25 DEC Objectives Of This Session • Setting up OpenSSH on i • The OpenSSH tools: SSH, SFTP and SCP • How do you use them? • How do you automate them so they can be run from native programs (CL programs) 2 What is SSH SSH is short for "Secure Shell." Created by: • Tatu Ylönen (SSH Communications Corp) • Björn Grönvall (OSSH – short lived) • OpenBSD team (led by Theo de Raadt) The term "SSH" can refer to a secured network protocol. It also can refer to the tools that run over that protocol. • Secure replacement for "telnet" • Secure replacement for "rcp" (copying files over a network) • Secure replacement for "ftp" • Secure replacement for "rexec" (RUNRMTCMD) 3 What is OpenSSH OpenSSH is an open source (free) implementation of SSH. • Developed by the OpenBSD team • but it's available for all major OSes • Included with many operating systems • BSD, Linux, AIX, HP-UX, MacOS X, Novell NetWare, Solaris, Irix… and yes, IBM i. • Integrated into appliances (routers, switches, etc) • HP, Nokia, Cisco, Digi, Dell, Juniper Networks "Puffy" – OpenBSD's Mascot The #1 SSH implementation in the world. • More than 85% of all SSH installations. • Measured by ScanSSH software. • You can be sure your business partners who use SSH will support OpenSSH 4 Included with IBM i These must be installed (all are free and shipped with IBM i **) • 57xx-SS1, option 33 = PASE • 5733-SC1, *BASE = Portable Utilities • 5733-SC1, option 1 = OpenSSH, OpenSSL, zlib • 57xx-SS1, option 30 = QShell (useful, not required) ** in v5r3, had 5733-SC1 had to be ordered separately (no charge.) In v5r4 or later, it's shipped automatically. -
Zlib Home Site
zlib Home Site http://zlib.net/ A Massively Spiffy Yet Delicately Unobtrusive Compression Library (Also Free, Not to Mention Unencumbered by Patents) (Not Related to the Linux zlibc Compressing File-I/O Library) Welcome to the zlib home page, web pages originally created by Greg Roelofs and maintained by Mark Adler . If this page seems suspiciously similar to the PNG Home Page , rest assured that the similarity is completely coincidental. No, really. zlib was written by Jean-loup Gailly (compression) and Mark Adler (decompression). Current release: zlib 1.2.6 January 29, 2012 Version 1.2.6 has many changes over 1.2.5, including these improvements: gzread() can now read a file that is being written concurrently gzgetc() is now a macro for increased speed Added a 'T' option to gzopen() for transparent writing (no compression) Added deflatePending() to return the amount of pending output Allow deflateSetDictionary() and inflateSetDictionary() at any time in raw mode deflatePrime() can now insert bits in the middle of the stream ./configure now creates a configure.log file with all of the results Added a ./configure --solo option to compile zlib with no dependency on any libraries Fixed a problem with large file support macros Fixed a bug in contrib/puff Many portability improvements You can also look at the complete Change Log . Version 1.2.5 fixes bugs in gzseek() and gzeof() that were present in version 1.2.4 (March 2010). All users are encouraged to upgrade immediately. Version 1.2.4 has many changes over 1.2.3, including these improvements: -
Using Dragonframe 4.Pdf
Using DRAGONFRAME 4 Welcome Dragonframe is a stop-motion solution created by professional anima- tors—for professional animators. It's designed to complement how the pros animate. We hope this manual helps you get up to speed with Dragonframe quickly. The chapters in this guide give you the information you need to know to get proficient with Dragonframe: “Big Picture” on page 1 helps you get started with Dragonframe. “User Interface” on page 13 gives a tour of Dragonframe’s features. “Camera Connections” on page 39 helps you connect cameras to Drag- onframe. “Cinematography Tools” on page 73 and “Animation Tools” on page 107 give details on Dragonframe’s main workspaces. “Using the Timeline” on page 129 explains how to use the timeline in the Animation window to edit frames. “Alternative Shooting Techniques (Non Stop Motion)” on page 145 explains how to use Dragonframe for time-lapse. “Managing Your Projects and Files” on page 149 shows how to use Dragonframe to organize and manage your project. “Working with Audio Clips” on page 159 and “Reading Dialogue Tracks” on page 171 explain how to add an audip clip and create a track reading. “Using the X-Sheet” on page 187 explains our virtual exposure sheet. “Automate Lighting with DMX” on page 211 describes how to use DMX to automate lights. “Adding Input and Output Triggers” on page 241 has an overview of using Dragonframe to trigger events. “Motion Control” on page 249 helps you integrate your rig with the Arc Motion Control workspace or helps you use other motion control rigs. -
20.1 Data Sheet - Supported File Formats
20.1 Data Sheet - Supported File Formats Target release 20.1 Epic Document status DRAFT Document owner Dieter Van Rijsselbergen Designer Not applicable Architecture Dieter Van Rijsselbergen QA Assumptions Implementation of Avid proxy formats produced by Edge impose a number of known Avid-specific conversions. Avid proxies are under consideration and will be included upon binding commitment. Implementation of ingest through rewrapping (instead of transcoding) of formats with Avid-supported video and audio codecs are under consideration and will be included upon binding commitment. Implementation of ingest through transcoding to Avid-supported video codecs other than DNxHD or DNxHR are under consideration and will be included upon binding commitment. Limecraft Flow and Edge - Ingest File Formats # File Codecs and Variants Edge Flow Status Notes Container ingest ingest 1 MXF MXF OP1a Deployed No P2 spanned clips supported at the Sony XDCAM (DV25, MPEG moment. IMX codecs), XDCAM HD and Referencing original OP1a media from Flow XDCAM HD 422 AAFs is possible using AMA media linking in also for Canon Avid. C300/C500 and XF series AAF workflows for P2 are not implemented end-to-end yet. Sony XAVC (incl. XAVC Intra and XAVC-L codecs) ARRI Alexa MXF (DNxHD codec) AS-11 MXF (MPEG IMX/D10, AVC-I codecs) MXF OP-atom Deployed. P2 (DV codec) and P2 HD Only (DVCPro HD, AVC-I 50 and available AVC-I 100 codecs) in Edge. 1.1 MXF Sony RAW and X-OCN (XT, LT, Deployed. Due to the heavy data rates involved in ST) Only processing these files, a properly provisioned for Sony Venice, F65, available system is required, featuring fast storage PMW-F55, PMW-F5 and NEX in Edge. -
Input Formats & Codecs
Input Formats & Codecs Pivotshare offers upload support to over 99.9% of codecs and container formats. Please note that video container formats are independent codec support. Input Video Container Formats (Independent of codec) 3GP/3GP2 ASF (Windows Media) AVI DNxHD (SMPTE VC-3) DV video Flash Video Matroska MOV (Quicktime) MP4 MPEG-2 TS, MPEG-2 PS, MPEG-1 Ogg PCM VOB (Video Object) WebM Many more... Unsupported Video Codecs Apple Intermediate ProRes 4444 (ProRes 422 Supported) HDV 720p60 Go2Meeting3 (G2M3) Go2Meeting4 (G2M4) ER AAC LD (Error Resiliant, Low-Delay variant of AAC) REDCODE Supported Video Codecs 3ivx 4X Movie Alaris VideoGramPiX Alparysoft lossless codec American Laser Games MM Video AMV Video Apple QuickDraw ASUS V1 ASUS V2 ATI VCR-2 ATI VCR1 Auravision AURA Auravision Aura 2 Autodesk Animator Flic video Autodesk RLE Avid Meridien Uncompressed AVImszh AVIzlib AVS (Audio Video Standard) video Beam Software VB Bethesda VID video Bink video Blackmagic 10-bit Broadway MPEG Capture Codec Brooktree 411 codec Brute Force & Ignorance CamStudio Camtasia Screen Codec Canopus HQ Codec Canopus Lossless Codec CD Graphics video Chinese AVS video (AVS1-P2, JiZhun profile) Cinepak Cirrus Logic AccuPak Creative Labs Video Blaster Webcam Creative YUV (CYUV) Delphine Software International CIN video Deluxe Paint Animation DivX ;-) (MPEG-4) DNxHD (VC3) DV (Digital Video) Feeble Files/ScummVM DXA FFmpeg video codec #1 Flash Screen Video Flash Video (FLV) / Sorenson Spark / Sorenson H.263 Forward Uncompressed Video Codec fox motion video FRAPS: