DOCSLIB.ORG

Arxiv:1811.03021V1 [Eess.AS] 7 Nov 2018 from Typical Blind Bandwidth Extension Artifacts (The Wavenet-Based Described in Section 3

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv:1811.03021V1 [Eess.AS] 7 Nov 2018 from Typical Blind Bandwidth Extension Artifacts (The Wavenet-Based Described in Section 3 HIGH-QUALITY SPEECH CODING WITH SAMPLE RNN Janusz Klejsa ? Per Hedelin ? Cong Zhou y Roy Fejgin y Lars Villemoes ? ? Dolby Sweden AB, Stockholm, Sweden y Dolby Laboratories, San Francisco, CA, USA ABSTRACT into higher quality conditioning, which allows for fixed dimension- ality of the conditioning irrespectively of the operating bitrate. The We provide a speech coding scheme employing a generative model signal sample modeling and synthesis are based on a discretized lo- based on SampleRNN that, while operating at significantly lower gistic mixture [13] instead of the 8-bit µ-law domain used in [1, 11]. bitrates, matches or surpasses the perceptual quality of state-of-the- Perhaps one of the most interesting questions related to the art classic wide-band codecs. Moreover, it is demonstrated that the proposed scheme is whether its performance generalizes to unseen proposed scheme can provide a meaningful rate-distortion trade-off speech signals. While it is relatively straightforward to avoid model without retraining. We evaluate the proposed scheme in a series of overfitting within the selected dataset by using a state-of-the-art listening tests and discuss limitations of the approach. training approach (e.g., [14, 15]) the issue of robustness of the cod- Index Terms— speech coding, deep neural networks, vocoder, ing algorithm remains unclear. In order to facilitate comparison to SampleRNN [11] we carried our experiments with the same multi-speaker dataset, namely the Wall Street Journal set WSJ0 [16]. However, it com- 1. INTRODUCTION prises only American English, and seems to have been created with capture devices of limited quality. Hence, we cross-validated the Generative modeling for audio based on deep neural networks, such performance of the proposed approach on another publicly available as WaveNet [1] and SampleRNN [2], has provided significant ad- dataset (clean speech from the VCTK corpus [17]). We demonstrate vances in natural-sounding speech synthesis. The main application how the performance of the coding scheme degrades on signals has been in the field of text-to-speech [3, 4, 5] where the models from the new data set and then improves again with retraining on an replace the vocoding component. extended dataset. Moreover, generative models can be conditioned by global and This paper is structured as follows. First, the vocoder and its local latent representations [1]. In the context of voice conversion, quantization scheme are described in Section 2 along with the em- this facilitates natural separation of the conditioning into a static bedding approach. Next, we describe our SampleRNN model and speaker identifier and dynamic linguistic information [6]. provide the details of its vocoder conditioning in Section 3. The ex- In this paper we develop a wide-band conditioning from the perimental setup and the listening test results are presented in Sec- vocoder [7] with parameters quantized to 5.6, 6.4 and 8 kb/s and tion 4. Finally, conclusions are presented in Section 5. use these to condition a SampleRNN model. We benchmark our re- 2. VOCODER WITH QUANTIZED PARAMETERS sulting speech coding scheme against AMR-WB [8] at 23.05 kb/s and SILK [9] at 16 kb/s, which, at this bitrate, is a state-of-the-art The encoder scheme is based on a wide-band version of a linear pre- classic speech codec providing good to excellent quality [10]. diction coding (LPC) vocoder [7]. Signal analysis is performed on While it was shown in [11] that the subjective quality of AMR- a per-frame basis, and it results in the following parameters: i) an WB at 23.05 kb/s can be approached at only 2.4 kb/s by using M-th order LPC filter, ii) an LPC residual RMS level s, iii) pitch WaveNet synthesis conditioned on narrowband vocoder parameters, f0, and, iv) a k-band voicing vector v. A voicing component v(i), the quality gap to classic speech coding schemes was not closed. i = 1; : : : ; k gives the fraction of periodic energy within a band. Furthermore, the reconstructed waveforms occasionally suffered All these parameters are used for conditioning of SampleRNN, as arXiv:1811.03021v1 [eess.AS] 7 Nov 2018 from typical blind bandwidth extension artifacts (the WaveNet-based described in Section 3. We note the signal model used by the en- decoder used narrow-band conditioning but synthesized wide-band coder aims at describing only clean speech (without background or speech). The purpose of this paper is two-fold. First, we demonstrate that the approach of [11] is reproducible with another generative network Encoder architecture. Second, we investigate the scalability of such a scheme Vocoder Entropy in terms of rate-quality trade-off. In particular, we demonstrate that samples bitstream higher reconstruction quality can be achieved by allowing a higher analysis encoding bitrate for the conditioning. The subjective quality is evaluated with a methodology based on MUSHRA[12]. Decoder The speech coder structure considered in this paper is shown Entropy Sample in Fig. 1 at a high level. It includes an encoder based on a vocod- bitstream samples decoding RNN ing structure governed by a parametric signal model that facilitates quantization constrained by bitrate. The decoder scheme uses a four- tier SampleRNN architecture. The conditioning parameters are de- Fig. 1. Block diagrams of the vocoder-based encoder and the Sam- signed in a way that lower quality conditioning can be embedded pleRNN decoder. Tier 4 Table 1. Operating points of the encoder (k = 6) 1 1 x (4) , . , x i FS i 1 conv× rnominal M spectral n bits n bits − − 1 1 + conv× [kb/s] dist. [dB] s vw 8.0 22 0.754 1 + 9 9 GRU 6.4 16 0.782 1 + 8 9 5.6 16 1.33 1 + 8 9 Learned upsampling Tier 3 x (3) , . , x 1 1 i FS i 1 conv× simultaneously active talkers). − − 1 1 + conv× The analysis scheme operates on 10 ms frames of a signal sam- pled at 16 kHz. In the proposed encoder design, the order of the GRU LPC model, M, depends on the operating bitrate. Standard combi- Learned upsampling nations of source coding techniques are utilized to achieve encoding hf efficiency with appropriate perceptual consideration, including vec- tor quantization (VQ), predictive coding and entropy coding [18]. In Tier 2 x (2) , . , x 1 1 i FS i 1 conv× this paper, for all experiments, we define the operating points of the − − 1 1 + × encoder as in Table 1. We used standard tuning practices. For exam- conv ple, the spectral distortion for the reconstructed LPC coefficients is GRU kept close to 1 dB [19]. The LPC model is coded in the line spectral pairs (LSP) domain Learned upsampling utilizing prediction and entropy coding. For each LPC order, M, 1 1 a Gaussian mixture model (GMM) was trained on the WSJ0 train conv× set, providing probabilities for the quantization cells. Each GMM component has a Z-lattice according to the principle of union of Z- xi FS(1) , . , xi 1 MLP Tier 1 lattices [20, 21]. The final choice of quantization cell is according to − − a rate-distortion weighted criterion. The residual level s is quantized in the dB domain using a hybrid p(xi x<i, hf ) approach similar to that in [22]. Small level inter-frame variations | are detected, signalled by one bit, and coded by a predictive scheme Fig. 2. Conditioning of the SampleRNN. using fine uniform quantization. In other cases the coding is memo- ryless with a larger, yet uniform, step-size covering a wide range of levels. bility of a sequence of audio samples via factorization of the joint Similar to level, pitch is quantized using a hybrid approach of distribution into the product of the individual audio sample distri- predictive and memoryless coding. Uniform quantization is em- butions conditioned on all previous samples. The joint probability ployed but executed in a warped pitch domain. Pitch is warped by distribution of a sequence of waveform samples X = fx1; : : : ; xT g fw = cf0=(c + f0) where c = 500 Hz and fw is quantized and can be written as coded using 10 bit/frame. T Voicing is coded by memoryless VQ in a warped domain. Each Y 1−v(i) p(X) = p(xijx1; : : : ; xi−1): (1) voicing component is warped by vw(i) = log( 1+v(i) ).A 9 bit VQ i=1 was trained in the warped domain on the WSJ0 train set. A feature vector hf for conditioning SampleRNN is constructed At inference time, the model predicts one sample at a time by ran- as follows. The quantized LPC coefficients are converted to reflec- domly sampling from p(xijx1; : : : ; xi−1). Recursive conditioning tion coefficients. The vector of refection coefficients is concatenated is then be performed using the previously reconstructed samples. with the other quantized parameters, i.e. f0, s, and v. In the remain- der of the paper we use either of two constructions of the condition- 3.1. Conditioning ing vector. The first construction is the straightforward concatena- tion described above. For example, for M = 16, the total dimension Without conditioning information, SampleRNN is only capable of of the vector hf is 24; for M = 22 it is 30. The second construction “babbling”. Hence, we provide decoded vocoder parameters, hf , as is an embedding of lower-rate conditioning into a higher-rate format. conditioning information to the model. Eq. 1 thus becomes M = 16 22 For example, for , an -dimensional vector of the reflec- T 16 Y tion coefficients is constructed by padding the coefficients with p(XjH) = p(x jx ; : : : ; x ; h ); (2) 6 zeros. The remaining parameters are replaced with their coarsely i 1 i−1 f i=1 quantized (low bitrate) versions, which is possible since their loca- tions within hf are now fixed.
Load more

Recommended publications
  • Optimized Bitrate Ladders for Adaptive Video Streaming with Deep Reinforcement Learning
    Optimized Bitrate Ladders for Adaptive Video Streaming with Deep Reinforcement Learning ∗ Tianchi Huang1, Lifeng Sun1,2,3 1Dept. of CS & Tech., 2BNRist, Tsinghua University. 3Key Laboratory of Pervasive Computing, China ABSTRACT Transcoding Online Stage Video Quality Stage In the adaptive video streaming scenario, videos are pre-chunked Storage Cost and pre-encoded according to a set of resolution-bitrate/quality Deploy pairs on the server-side, namely bitrate ladder. Hence, we pro- … … pose DeepLadder, which adopts state-of-the-art deep reinforcement learning (DRL) method to optimize the bitrate ladder by consid- Transcoding Server ering video content features, current network capacities, as well Raw Videos Video Chunks NN-based as the storage cost. Experimental results on both Constant Bi- Decison trate (CBR) and Variable Bitrate (VBR)-encoded videos demonstrate Network & ABR Status Feedback that DeepLadder significantly improvements on average video qual- ity, bandwidth utilization, and storage overhead in comparison to Figure 1: An Overview of DeepLadder’s System. We leverage prior work. a NN-based decision model for constructing the proper bi- trate ladders, and transcode the video according to the as- CCS CONCEPTS signed settings. • Information systems → Multimedia streaming; • Computing and solve the problem mathematically. In this poster, we propose methodologies → Neural networks; DeepLadder, a per-chunk video transcoding system. Technically, we set video contents, current network traffic distributions, past KEYWORDS actions as the state, and utilize a neural network (NN) to deter- Bitrate Ladder Optimization, Deep Reinforcement Learning. mine the proper action for each resolution autoregressively. Unlike the traditional bitrate ladder method that outputs all candidates ACM Reference Format: at one step, we model the optimization process as a Markov Deci- Tianchi Huang, Lifeng Sun.
    [Show full text]
  • Cube Encoder and Decoder Reference Guide
    CUBE ENCODER AND DECODER REFERENCE GUIDE © 2018 Teradek, LLC. All Rights Reserved. TABLE OF CONTENTS 1. Introduction ................................................................................ 3 Support Resources ........................................................ 3 Disclaimer ......................................................................... 3 Warning ............................................................................. 3 HEVC Products ............................................................... 3 HEVC Content ................................................................. 3 Physical Properties ........................................................ 4 2. Getting Started .......................................................................... 5 Power Your Device ......................................................... 5 Connect to a Network .................................................. 6 Choose Your Application .............................................. 7 Choose a Stream Mode ............................................... 9 3. Encoder Configuration ..........................................................10 Video/Audio Input .......................................................12 Color Management ......................................................13 Encoder ...........................................................................14 Network Interfaces .....................................................15 Cloud Services ..............................................................17
    [Show full text]
  • How to Encode Video for the Future
    How to Encode Video for the Future Dror Gill, CTO, Beamr Abstract The quality expectations of viewers paired with the ever-increasing shift to over-the-top (OTT) and mobile video consumption, are driving today’s networks to be more congested with video than ever before. To counter this congestion, this paper will cover advanced techniques for applying content-adaptive encoding and optimization methods to video workflows while lowering the bitrate of encoded video without compromising quality. Intended Audience: Business decision makers Video encoding engineers To learn more about optimized content-adaptive encoding, email [email protected] ©Beamr Imaging Ltd. 2017 | beamr.com Table of contents 3 Encoding for the future. 3 The trade off between bitrate and quality. 3 Legacy approaches to encoding your video content. 3 What is constant bitrate (CBR) encoding? 4 What about variable bitrate encoding? 4 Encoding content with constant rate factor encoding. 4 Capped content rate factor encoding for high complexity scenes. 4 Encoding content for the future. 5 Manually encoding content by title. 5 Manually encoding content by the category. 6 Content-adaptive encoding by the title and chunk. 6 Content-adaptive encoding using neural networks. 7 Closed loop content-adaptive encoding by the frame. 9 How should you be encoding your content? 10 References ©Beamr Imaging Ltd. 2017 | beamr.com Encoding for the future. how it will impact the file size and perceived visual quality of the video. The standard method of encoding video for delivery over the Internet utilizes a pre-set group of resolutions The rate control algorithm adjusts encoder parameters and bitrates known as adaptive bitrate (ABR) sets.
    [Show full text]
  • Why “Not- Compressing” Simply Doesn't Make Sens ?
    WHY “NOT- COMPRESSING” SIMPLY DOESN’T MAKE SENS ? Confidential IMAGES AND VIDEOS ARE LIKE SPONGES It seems to be a solid. But what happens when you squeeze it? It gets smaller! Why? If you look closely at the sponge, you will see that it has lots of holes in it. The sponge is made up of a mixture of solid and gas. When you squeeze it, the solid part changes it shape, but stays the same size. The gas in the holes gets smaller, so the entire sponge takes up less space. Confidential 2 IMAGES AND VIDEOS ARE LIKE SPONGES There is a lot of data that are not bringing any information to our human eyes, and we can remove it. It does not make sense to transport, store uncompressed images/videos. It is adding data that have an undeniable cost and that are not bringing any additional valuable information to the viewers. Confidential 3 A 4K TV SHOW WITHOUT ANY CODEC ▪ 60 MINUTES STORAGE: 4478.85 GB ▪ STREAMING: 9.953 Gbit per sec Confidential 4 IMAGES AND VIDEOS ARE LIKE SPONGES Remove Remove Remove Remove Temporal redundancy Spatial redundancy Visual redundancy Coding redundancy (interframe prediction,..) (transforms,..) (quantization,…) (entropy coding,…) Confidential 5 WHAT IS A CODEC? Short for COder & DECoder “A codec is a device or computer program for encoding or decoding a digital data stream or signal.” Note : ▪ It does not (necessarily) define quality ▪ It does not define transport / container format method. Confidential 6 WHAT IS A CODEC? Quality, Latency, Complexity, Bandwidth depend on how the actual algorithms are processing the content.
    [Show full text]
  • Adaptive Bitrate Streaming Over Cellular Networks: Rate Adaptation and Data Savings Strategies
    Adaptive Bitrate Streaming Over Cellular Networks: Rate Adaptation and Data Savings Strategies Yanyuan Qin, Ph.D. University of Connecticut, 2021 ABSTRACT Adaptive bitrate streaming (ABR) has become the de facto technique for video streaming over the Internet. Despite a flurry of techniques, achieving high quality ABR streaming over cellular networks remains a tremendous challenge. First, the design of an ABR scheme needs to balance conflicting Quality of Experience (QoE) metrics such as video quality, quality changes, stalls and startup performance, which is even harder under highly dynamic bandwidth in cellular network. Second, streaming providers have been moving towards using Variable Bitrate (VBR) encodings for the video content, which introduces new challenges for ABR streaming, whose nature and implications are little understood. Third, mobile video streaming consumes a lot of data. Although many video and network providers currently offer data saving options, the existing practices are suboptimal in QoE and resource usage. Last, when the audio and video arXiv:2104.01104v2 [cs.NI] 14 May 2021 tracks are stored separately, video and audio rate adaptation needs to be dynamically coordinated to achieve good overall streaming experience, which presents interesting challenges while, somewhat surprisingly, has received little attention by the research community. In this dissertation, we tackle each of the above four challenges. Firstly, we design a framework called PIA (PID-control based ABR streaming) that strategically leverages PID control concepts and novel approaches to account for the various requirements of ABR streaming. The evaluation results demonstrate that PIA outperforms state-of-the-art schemes in providing high average bitrate with signif- icantly lower bitrate changes and stalls, while incurring very small runtime overhead.
    [Show full text]
  • Comments on `Area and Power Efficient DCT Architecture for Image
    Cintra and Bayer EURASIP Journal on Advances in Signal EURASIP Journal on Advances Processing (2017) 2017:50 DOI 10.1186/s13634-017-0486-8 in Signal Processing RESEARCH Open Access Comments on ‘Area and power efficient DCT architecture for image compression’ by Dhandapani and Ramachandran Renato J. Cintra1* and Fábio M. Bayer2 Abstract In [Dhandapani and Ramachandran, “Area and power efficient DCT architecture for image compression”, EURASIP Journal on Advances in Signal Processing 2014, 2014:180] the authors claim to have introduced an approximation for the discrete cosine transform capable of outperforming several well-known approximations in literature in terms of additive complexity. We could not verify the above results and we offer corrections for their work. Keywords: DCT approximations, Low-complexity transforms 1 Introduction 2 Criticisms In a recent paper [1], a low-complexity transformation 2.1 Inverse transformation was introduced, which is claimed to be a good approxima- The authors of [1] claim that inverse transformation T−1 tion to the discrete cosine transform (DCT). We wish to is given by evaluate this claim. ⎡ ⎤ The introduced transformation is given by the following 10001000 ⎢ ⎥ matrix: ⎢ −1100−11 0 0⎥ ⎢ ⎥ ⎢ 00100010⎥ ⎡ ⎤ ⎢ ⎥ 1 ⎢ 00−11 0 0−11⎥ 10000001 · ⎢ ⎥ . ⎢ ⎥ 2 ⎢ 00−11 0 0 1−1 ⎥ ⎢ 11000011⎥ ⎢ ⎥ ⎢ ⎥ ⎢ 001000−10⎥ ⎢ 00100100⎥ ⎣ ⎦ ⎢ ⎥ −11001−10 0 ⎢ 00111100⎥ T = ⎢ ⎥ . 1000−10 0 0 ⎢ 00 1 1−1 −10 0⎥ ⎢ ⎥ ⎢ 00 1 0 0−10 0⎥ ⎣ ⎦ However, simple computation reveal that this is not 110000−1 −1 accurate, being the actual inverse given by: 1000000−1 ⎡ ⎤ 10000001 ⎢ ⎥ We aim at analyzing the above matrix and showing that ⎢ −1100001−1 ⎥ ⎢ ⎥ it does not consist of a meaningful approximation for ⎢ 00100100⎥ ⎢ ⎥ the8-pointDCT.Inthefollowing,weadoptedthesame − 1 ⎢ 00−11 1−10 0⎥ T 1 = · ⎢ ⎥ .
    [Show full text]
  • Lec 15 - HEVC Rate Control
    ECE 5578 Multimedia Communication Lec 15 - HEVC Rate Control Guest Lecturer: Li Li Dept of CSEE, UMKC Office: FH560E, Email: [email protected], Ph: x 2346. http://l.web.umkc.edu/lizhu slides created with WPS Office Linux and EqualX LaTex equation editor Z. Li, ECE 5578 Multimedia Communciation, 2020 Outline 1 Background 2 Related Work 3 Proposed Algorithm 4 Experimental Results 5 Conclusion Rate control introduction Assuming the bandwidth is 2Mbps, the encode parameters should be adjusted to reach the bandwidth Loss of data > 2 2 X Unable to make full use of the < 2 bandwidth How to reach the bandwidth accurately and provide the best video quality ? min D s.t. R £ Rt paras Optimal Rate Control Rate control applications Rate control can be used in various scenarios CBR: Constant Bitrate VBR: Variable Bitrate wire wireless Rate control storage ABR: Average Bitrate Rate distortion optimization Rate distortion optimization min D s.t. R £ Rt Û min D + l(Rt )R paras paras λ determines the optimization target λ Background Rate control Non-normative part of video coding standards Quite widely used: of great importance Considering its importance , rate control algorithm is always included in the reference software of standards MPEG2: TM5 H.263: VM8 H.264: Q-domain rate control HEVC: λ-domain rate control (JCTVC K0103, M0036) Outline 1 Background 2 Related Work 3 Proposed Algorithm 4 Experimental Results 5 Conclusion Related work Q-domain rate control algorithm Yaqin Zhang：Second-order R-Q model The improvement of RMSE in model prediction diminishes as the degree exceeds two.
    [Show full text]
  • Soundstream: an End-To-End Neural Audio Codec Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, Marco Tagliasacchi
    1 SoundStream: An End-to-End Neural Audio Codec Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, Marco Tagliasacchi Abstract—We present SoundStream, a novel neural audio codec that can efficiently compress speech, music and general audio at bitrates normally targeted by speech-tailored codecs. 80 SoundStream relies on a model architecture composed by a fully EVS convolutional encoder/decoder network and a residual vector SoundStream quantizer, which are trained jointly end-to-end. Training lever- ages recent advances in text-to-speech and speech enhancement, SoundStream - scalable which combine adversarial and reconstruction losses to allow Opus the generation of high-quality audio content from quantized 60 embeddings. By training with structured dropout applied to quantizer layers, a single model can operate across variable bitrates from 3 kbps to 18 kbps, with a negligible quality loss EVS when compared with models trained at fixed bitrates. In addition, MUSHRA score the model is amenable to a low latency implementation, which 40 supports streamable inference and runs in real time on a smartphone CPU. In subjective evaluations using audio at 24 kHz Lyra sampling rate, SoundStream at 3 kbps outperforms Opus at 12 kbps and approaches EVS at 9.6 kbps. Moreover, we are able to Opus perform joint compression and enhancement either at the encoder 20 or at the decoder side with no additional latency, which we 3 6 9 12 demonstrate through background noise suppression for speech. Bitrate (kbps) Fig. 1: SoundStream @3 kbps vs. state-of-the-art codecs. I. INTRODUCTION Audio codecs can be partitioned into two broad categories: machine learning models have been successfully applied in the waveform codecs and parametric codecs.
    [Show full text]
  • Bachelor Thesis
    Charles University in Prague Faculty of Mathematics and Physics BACHELOR THESIS Ján Dupej Komprese zvuku Audio Coding Department of Software Engineering Consultant: Mgr. Jan Lánský Specialization: Programming 2009 I would like to thank my consultant, Mgr. Jan Lánský for his invaluable assistance with writing this thesis. Prohlašuji, že jsem svou bakalářskou práci napsal samostatně a výhradně s použitím citovaných pramenů. Souhlasím se zapůjčováním práce. V Praze dne 28.05.2009 Ján Dupej 2 Table of Contents Table of Contents 3 List of Figures 5 List of Tables 5 List of Abbreviations 6 Introduction 8 1. Basic Concepts 10 1.1. Physical Concept of Sound 10 1.2. Digital Representation and Sampling 11 1.3. A-law and µ-law 12 1.4. Linear Predictive Coding 13 2. Psychoacoustics 15 2.1. Absolute Threshold of Hearing 15 2.2. Critical Bands 16 2.3. Simultaneous Masking 17 2.4. Temporal Masking 20 2.5. Perceptual Entropy 20 3. Inside a Perceptual Encoder 22 3.1. Time-to-Frequency Domain Mapper 22 3.2. Mode Switching 26 3.3. Stereo Representation 28 3.4. Psychoacoustic Model 30 3.5. Quantizer 31 3.6. Entropy Coder 32 4. Comparing Modern Codecs 33 4.1. MPEG-1 Layer 3 (MP3) 33 4.2. MPEG-4 Advanced Audio Coding (AAC) 34 4.3. Dolby Digital (AC-3) 35 4.4. Vorbis I 36 4.5. Windows Media Audio 9 (WMA9) 37 4.6. Summary 38 3 References 39 4 List of Figures Figure 1 Audibility Threshold ................................................................................................................ 16 Figure 2 Noise Masking Tone (8) ........................................................................................................... 18 Figure 3 Tone Masking Noise (8) ..........................................................................................................
    [Show full text]
  • Adobe Media Encoder
    UNIVERSITY OF HOUSTON | SCHOOL OF ART | GRAPHIC DESIGN Spring 2018 ADOBE MEDIA ENCODER WORKING WITH DIGITAL VIDEO Digital video formats are different than other types of digital files you are used to working with. They are stored in what are called container formats. These are files with a variety of file extensions, Extra Reading like .mov .mpg .mkv, and features in order to combine different types of data into a single file. Rodrigues, Ana. 2016. “H.264 vs H.265 — A Technical Comparison. When Will H.265 Dominate the Market?” Inside that file, audio and video data types are encoded—packed up and compressed—withcodecs , Medium. June 9, 2016. https://medium.com/advanced- like H.264 or MPEG-2 for video and MP3 or AAC for audio. There are many types of codecs, but H.264 is computer-vision/h-264-vs-h-265-a-technical- comparison-when-will-h-265-dominate-the-market- the current reigning standard—and the one we will be using—with HEVC (H.265) expected to replace 26659303171a. it in the coming years as 4k devices and 4k media streaming become more common. Digital video editing requires a lot of hard drive space—enough space to store your video multiple times! That’s for the source media, “scratch space” which is used to store on-the-fly previews, and finally enough room to output the final video. You can prepare for this by moving large files off your computer. It is not preferable to actively edit video from an external harddrive, due to their slower throughput, though you may find it workable.
    [Show full text]
  • Ts 103 190 V1.1.1 (2014-04)
    ETSI TS 103 190 V1.1.1 (2014-04) Technical Specification Digital Audio Compression (AC-4) Standard 2 ETSI TS 103 190 V1.1.1 (2014-04) Reference DTS/JTC-025 Keywords audio, broadcasting, codec, content, digital, distribution ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° 7803/88 Important notice The present document can be downloaded from: http://www.etsi.org The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http://portal.etsi.org/tb/status/status.asp If you find errors in the present document, please send your comment to one of the following services: http://portal.etsi.org/chaircor/ETSI_support.asp Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI.
    [Show full text]
  • Constant Bitrate Control for a Distributed Video Coding System
    CONSTANT BITRATE CONTROL FOR A DISTRIBUTED VIDEO CODING SYSTEM Mariusz Jakubowski1, João Ascenso2 and Grzegorz Pastuszak1 1Institute of Radioelectronics, Warsaw University of Technology, 15/19 Nowowiejska Str., Warsaw, Poland 2Instituto Superior de Engenharia de Lisboa – Instituto de Telecomunicaçőes R. Conselheiro Emídio Navarro, 1, Lisbon, Portugal Keywords: Wyner-Ziv coding, distributed video coding, rate control. Abstract: In some distributed video coding (DVC) systems, the total bitrate depends mainly on the key frames (Intra coded) quality and on the side information accuracy. In this paper, a rate control (RC) mechanism is proposed to achieve and maintain a certain target bitrate for the overall Intra and WZ bitstream, mainly by adjusting online the Intra frames quality through the quantization parameter (QP). In order to obtain a similar decoded quality of Intra and WZ frames, the relevant parameters: QP for the key frames and the quantization index (QIndex) for WZ frames are controlled jointly. The major novelty of this work is a statistical model that expresses the relationship between QIndex and WZ frames bitrate. The proposed rate control solution is integrated into the VISNET2 WZ codec and the experimental results demonstrate the efficiency of the proposed algorithm to reach and maintain the target bitrate. 1 INTRODUCTION Y is explored at the decoder with reference to the case where joint encoding is performed (i.e. X and Y Around 2002, a new video coding paradigm known are available at the encoder). This interesting result as distributed video coding (DVC) has emerged, opens the possibility to design a system where two inspired by two Information Theory results from the statistically dependent signals are compressed in a 70’s: the Slepian-Wolf theorem (Slepian and Wolf, distributed way (separate encoding, joint decoding) 1973) and the Wyner-Ziv theorem (Wyner and Ziv, while still achieving the coding efficiency of 1976).
    [Show full text]