ANALYSIS OF 360 VIDEO FILES ACROSS MULTIPLE RESOLUTIONS AND CAMERAS by NICHOLAS JAMES PELC B.S., University of Colorado Denver, 2015 A thesis submitted to the Faculty of the Graduate School of the University of Colorado in partial fulfillment of the requirements for the degree of Master of Science Recording Arts Program 2019 © 2019 NICHOLAS JAMES PELC ALL RIGHTS RESERVED ii This thesis for the Master of Science degree by Nicholas James Pelc has been approved for the Recording Arts Program by Catalin Grigoras, Chair Jeff M. Smith Jeff Merkel Date: May 18, 2019 iii Pelc, Nicholas James (M.S., Recording Arts Program) Analysis of 360 Video Files Across Multiple Resolutions and Cameras Thesis directed by Associate Professor Catalin Grigoras ABSTRACT Forensic experts rely on the validity and reliability of data consistent with Daubert standards and Federal rules of evidence for identifying findings and formulating opinions about evidence in legal proceedings. Digital forensic experts have an acute awareness of possible distortions or manipulations of electronically recorded or transmitted data. A critical aspect of analyzing digital evidence is to inspect the reliability, absence of, degradation, or alteration of data used in forensic evaluation. New recording devices are constantly being developed. One such new tool is the 360 video available for GoPro players and, often, for broadcast on YouTube. 360 video provides an opportunity to capture, record, and review multi-dimensional digital information. For this study, several test patterns are analyzed using the 360 video process. The purpose of the research is to identify any potential degradation, distortion, manipulation, or data loss when 360 evidence is transferred from an originating device to a secondary device. The form and content of this abstract are approved. I recommend its publication. Approved: Catalin Grigoras iv This thesis is dedicated to my entire family. Thank you to my father who, when I was at an early age, showed me the world of forensic sciences and to my mom whose patience is unheard of. v ACKNOWLEDGMENTS Thank you to Jeff and Catalin for allowing me to “cd” from the directory of recording arts and into the world of digital forensics. The information I gathered while in this Master’s program is incredible and extremely relevant. I am looking forward to continuing this educational journey and learning more. Jeff, thank you for allowing me to work in the lab and on the DARPA project. Hopefully, all the work that we have done and continue to do will help many people. Thank you, Leah, for helping keep us all on track, and Emma in Leah’s absence. A thank you is due to Jeff Merkel for helping with your knowledge of Ambisonics in this evolving world of audio. Finally, thank you to my mom, dad, and dogs. vi TABLE OF CONTENTS CHAPTER I. INTRODUCTION ............................................................................................................................................ 1 Problem Statement .............................................................................................................................. 1 Literature Review ................................................................................................................................. 1 II. METHODOLOGY ........................................................................................................................................... 3 Go Pro Fusion ....................................................................................................................................... 6 YouTube-dl ............................................................................................................................................ 6 Matlab .................................................................................................................................................. 6 010 Editor ............................................................................................................................................. 7 MediaInfo ............................................................................................................................................. 7 Exif tool ................................................................................................................................................. 8 FFmpeg ................................................................................................................................................. 8 AtomicParsley ....................................................................................................................................... 8 Go Pro VR player ................................................................................................................................... 8 360Fly app ............................................................................................................................................ 8 GoPro app ............................................................................................................................................. 8 Fly360 Director ..................................................................................................................................... 8 VLC ........................................................................................................................................................ 8 Paint Shop Pro ...................................................................................................................................... 8 III. RESULTS .................................................................................................................................................... 12 YouTube Up Down .............................................................................................................................. 23 PRNU Results ...................................................................................................................................... 25 Audio Results ...................................................................................................................................... 31 IV. DISCUSSION .............................................................................................................................................. 34 Conclusion .......................................................................................................................................... 35 REFERENCES .................................................................................................................................................... 36 vii LIST OF TABLES TABLE 1. Metadata ...................................................................................................................................................... 12 2. Video ............................................................................................................................................................. 13 3. Audio ............................................................................................................................................................. 16 4. Other 1 .......................................................................................................................................................... 18 5. Other 2 .......................................................................................................................................................... 19 6. Other 3 .......................................................................................................................................................... 19 7. Atoms of the Original Recording ................................................................................................................... 22 8. Atoms of the 360 Recompressed Video ........................................................................................................ 22 viii LIST OF FIGURES FIGURE 1. Illustration of GoPro Fusion Different Resolutions ........................................................................................ 3 2. GoPro Fusion Diagram ................................................................................................................................... 4 3. Diagram of 360Fly .......................................................................................................................................... 5 4. MDCT Equation .............................................................................................................................................. 6 5. Hex Analysis: Original .................................................................................................................................. 20 6. Hex Analysis of the Files Rendered out of the GoPro Fusion Studio Software ............................................ 21 7. Hex Analysis of the Files Downloaded from YouTube in the MKV File Type...............................................23 8. Hex Analysis of the Files Downloaded from YouTube in the MP4 File Type ............................................... 24 9. GoPro Rendered File Comparison to GoPro. ............................................................................................... 26 10. GoPro Comparison to Sony Falcon. ............................................................................................................. 26 11. GoPro Comparison to Canon PowerShot. ..................................................................................................