VQMT3D Project Overall Movie Comparison Report 10

Home , Jack the Giant Slayer, Piranha 3DD, Saw 3D, The Legend of Hercules, Wrath of the Titans

More than 100 movies tested, including:

• Gravity • Alice in Wonderland • The Great Gatsby • Pirates of the Caribbean: On • Oz the Great and Powerful Stranger Tides • Stalingrad • The Avengers • Iron Man 3 • The Amazing Spiderman • Man of Steel • World War Z • Paciﬁc Rim • Thor • Jack the Giant Slayer • The Last Airbender • The Hobbit: An Unexpected • Life of Pi Journey • TRON: Legacy • The Legend of Hercules • Hugo

October 27, 2020

https://videoprocessing.ml/stereo_quality CS MSU Graphics & Media Lab http://graphics.cs.msu.ru Current report contains results that are great news for the following individuals: • 3D enthusiasts. We show that the technical quality of 3D movies has consistently improved over the years, heralding a new surge of interest in 3D. • 3D producers. Shooting high-quality 3D with up to a 15x lower budget is now possible. • 3D professionals. New, inexpensive technologies make achiev- ing high technical quality faster and easier.

105 Blu-ray discs that were analyzed in this report “I will find it very interesting to go through your report in detail, film by film. I had always thought that a major factor holding back the greater success of stereo 3D cinema could be technical problems like those your group has enumerated.” John Merritt, Senior Consulting Scientist at The Merritt Group, Founding Chair of the Stereoscopic Displays & Applications Conference Foreword

For 11 years our laboratory has researched stereo quality as well as stereo artifacts that cause viewer discomfort. During this time we’ve created about 20 quality metrics, some of which have undergone considerable improvement. For example, our metric for detecting swapped channels is in its fourth generation, having delivered greater accuracy with each update. At the same time, the computational eﬃciency of these metrics has exceeded what our competitors have oﬀered, allowing us to analyze real movies.

This work received valuable support from professional stereographers. In total, we corresponded with about 100 stereographers, 32 of whom visibly contributed to our reports. The most notable is Jon Karafin, former VP of Production Technology at RealD. All told, his ideas, suggestions and comments were almost as numerous and beneficial as those from all the others combined. Many stereographers asked us, for example, whether the MSU Scale Mismatch metric value of 4% is high or low for a given movie an excellent question. Originally, we lacked a clear answer. So we undertook a deliberate effort to directly connect metric values with perceived discomfort, conducting what could be the largest-scale study of real-movie fragments containing artifacts. Also, thanks to the Movie Research Company, we had the unique opportunity to use their impressive test hallincluding seats equipped with electroencephalo- graphs (EEGs), eye trackers, high-speed cameras and polygraphs to collect scads of valuable data. We explored many new aspects of stereoscopic perception, but we also came to recognize how complicated and multidimensional this task is. A primary reason for its complexity is that different people perceive both individual artifacts and combinations thereof in different ways.

We tried to solve this problem from another angle as well. With support from Intel, Cisco and Verizon, we bought more than 150 Blu-ray 3D movies and analyzed them using our metrics. Although this project was complex both technically and organizationally, we obtained a clear picture of how diﬀerent metrics depend on a movie’s release date, budget and production technology.

I thought it important to give a reason why we published this report almost four years after completing our work. We’ve cooperated with multiple companies and organizations, but their support in recent years has dwindled to zero. Moreover, although several companies whose business depends heavily on the success of 3D movies promised to aid our efforts,these promises went unfulfilled. We’re nevertheless happy to finally present you with our 10th Anniversary Report, the first that will be free to download.

We’re positive that all current stereoscopic problems will soon be resolved (and we can clearly see how to solve them), yielding a noticeable reduction in viewer discomfort due to stereoscopic movies. And this success will in turn lead to a new surge in stereo’s popularity.

Dr. Dmitriy Vatolin Head of Video Group @ CS MSU Graphics & Media Lab Feedback from Industry Professionals on the VQMT3D Project

Scott Willman (Freelance Stereographer, Stereo Supervisor) I think your work is very interesting and I truly hope it enlightens as many 3D professionals as possible.

“ Bill White (CEO at the 3D Camera Company) Thank you for these studies. I think that they are very comprehensive and good.

Patrick Almanza (Finisher - Comp/Paint at Stereo D) What an enormous undertaking! This is very useful training information for recognizing and identifying digital imaging artifacts, among other things. I think back to all the ﬁlms we restored with Lowry Digital, including just about everything great, and if there were such a document detailing everything we had to correct to pristine image restoration, training artists would have been so much easier. You folks deserve kudos!

Jon Karaﬁn (Senior Scientist and Director of Production Technology at RealD) It is a really great piece of research.

Jon Karaﬁn (Senior Scientist and Director of Production Technology at RealD) I believe that the strongest section of this document (report #1) is Potential Causes of Visual Discomfort when Viewing Stereo Movies. It is one of the most concise and comprehensive reviews of all of the existing research performed in this ﬁeld that I have read to date. Well done, and I suggest using this as your opening chapter, as it clearly articulates the underlying thresholds and limits that all stereoscopic metrics have been derived based upon the biology of the visual system.

You are extremely well positioned and have a significant opportunity to truly push the boundaries of this research and be the first to create compelling stereoscopic metrics that accurately define the methodology to clearly articulate quality differentials between differing stereoscopic images.

Paul Taylor (Supervising Sterographer) I started doing stereoscopic movies twenty ﬁve years ago when we shot on ﬁlm. The 3D business has changed a lot since then and I must say that your project sounds like something we could really use today in our S3D business.

Robert Black (3D R&D and Experimental Psychology, University of Liverpool) I think the reports are fantastic. MSU Stereo-Film Quality Analysis Report 10

Andrew Parke (Director of Photography, Camera Operator, and Stereographer at DimensionWerks) Your evaluation was comprehensive and useful in the pursuit of quality Stereoscopic 3D exhibition.

“ Clyde DeSouza (Stereographer and Creative Technology Evangelist) If you are an industry professional involved in Stereoscopic 3D ﬁlms, This is a “MUST HAVE” report.

Tim Baier (Supervising Stereoscopic Technical Director) The software your team is working on and these reports are a valuable asset to the industry, thank you!

Tim Baier (Supervising Stereoscopic Technical Director) I’m quite impressed and appreciative of the significant effort that has been invested by MSU to improve the quality of stereoscopic films! Thank you, the industry definitely needs it.

Jordi Alonso (CEO at cine3D.com) I want to say thank you for those periodical reports, which are brilliant.

Andrew Enyart (Technical Director of Stereography at Sony Pictures Imageworks) Keep up your hard work. The industry needs people like you.

David Mattingly (Author of The Digital Matte Painting Handbook) I thought the analysis was fascinating, and very well done. Great, very informative information.

Pawel Achtel (Producer Achtel Pty Limited Stereoscopic 3D Underwater Cinematog- raphy) Thank you for the report. I read them with great interest. It is great reference and educational material. I think you are doing fantastic job for the industry!

Wesley Sewell (Stereographic Supervisor on Marvel’s The Avengers) I found all of your diagnoses very interesting. I wish you all the best!

Alaric Hamacher (Professor for 3D Contents at Kwangwoon University) I am impressed. Since the ﬁrst reports I saw. You have really gotten a nice amount of data.

CS MSU Graphics & Media Lab 5 https://videoprocessing.ml/stereo_quality/ MSU Stereo-Film Quality Analysis Report 10

Jill Smolin (Director of Production Education 3ality Digital LLC) Really extensive work, congratulations. I really wanted to thank you all for the eﬀorts you’ve put into creating this extensive evaluation of stereoscopic ﬁlms. Ultimately, this is an awesome report.

“ Zsolt Magyari (Stereographer & Cinematographer, Germany) It is of great importance that you are doing! This can lead to the standardization of stereoscopic quality, that is absolutely necessary for the future of 3D technology.

Adriene Hurst (Editor at Digital Media World) Well done to you and your team for doing so much work. Everyone can learn a lot from this report.

Brian Gardner (Lead Stereographer on director Ang Lee’s Life Of Pi) Well done to you and your team for doing so much work. Everyone can learn a lot from this report.

CS MSU Graphics & Media Lab 6 https://videoprocessing.ml/stereo_quality/ Acknowledgements

We would like to thank all the stereographers and 3D professionals who contributed to the project by providing comments that we included in the ﬁrst nine reports.: • Marcus Alexander, Stereoscopic Designer, 3D Producer • Tim Baier, Freelance Stereographer & Pipeline TD • Ido Banai, Stereographer, Stereo Production Consultant, Filmmaker, Storyteller • Robert Black, 3D R&D, 3D Consultant / Stereographer • Nick Brown, Stereographer, Stereo Supervisor • Olivier Cahen, Stereoscopic Consultant, Author • Ross Copeland, Online Editor / Stereographer & Colourist, Post-Production Consultant • Deepak Dalal, Associate Stereoscopic Supervisor at Prime Focus World • Clyde DeSouza, Author, Stereographer and Creative Technology Evangelist • Lluis Dubreuil, Stereographer, Stereoscopic Consultant • Andrew Enyart, Stereographer, VFX Supervisor • Alfredo Gonzalez, Stereoscopic Consultant / Stereographer • Alaric Hamacher, Stereographer, Director, Professor at Kwangwoon University • Buzz Hays, 3D producer, director • Srboljub Hetlerovic, Stereographer, VFX supervisor • Takashi Kawai, Professor in the Department of Intermedia Art and Science at Waseda University • Markus Lanxinger, Stereographer, Stereoscopic Supervisor • Ed W. Marsh, Filmmaker • John Merritt, Senior Consulting Scientist at The Merritt Group • Julian Napierr, Director, Editor, Stereographer • Greg Passmore, Director, PassmoreLab • Enrico Perei, On-Set/Post Production Stereographer, VFX Supervisor • Daniele Pugni, 3D-Motion Graphic Designer Freelancer for Sky 3D Channel • Fabien Remblier, S3D and 4K Director, Stereographer, Producer • Wesley Sewell, Stereographic Supervisor • Jill Smolin, Director of Production Education for 3ality Technica • Paul Taylor, Supervising Stereographer • Celine Tricart, Independent Filmmaker and Stereographer • Pan Vafeiadis, Senior Lecturer in Visual Eﬀects, Nuke Trainer, Senior Stereoscopic Compositor • Thomas Villepoux, Director, Stereographer

Special thanks go to Jon Karaﬁn, who oﬀered numerous remarks and suggestions while working as a Senior Scientist and Director of Production Technology at RealD. His feedback and ideas were invaluable early in the project’s development.

7 Our 2019 project "Development of a system for automatic objective quality assessment and correction of stereoscopic video and video in VR180 format" received support under the START program of the State Fund for Support of Small Enterprises in the Scientiﬁc-Technical Fields. Contents

Page

Disclaimer 11

1 Introduction 12 1.1 Movie Selection ...... 12 1.2 Document Organization ...... 12

2 Overall Comparison Charts 13 2.1 Depth Budget ...... 13 2.2 Depth Continuity ...... 25 2.3 Vertical Parallax ...... 34 2.4 Scale and Rotation Mismatch ...... 44 2.5 Color Mismatch ...... 63 2.6 Sharpness Mismatch ...... 73 2.7 Stereo Window Violation ...... 82 2.8 Temporal Shift ...... 99 2.9 Channel Mismatch ...... 109 2.10 Crosstalk ...... 119 2.11 Average Brightness ...... 128

3 Movie Ratings 135 3.1 Vertical Parallax ...... 136 3.1.1 Budget Categories ...... 136 3.1.2 Release Date Categories ...... 138 3.1.3 Overall Categories ...... 141 3.2 Scale Mismatch ...... 143 3.2.1 Budget Categories ...... 143 3.2.2 Release Date Categories ...... 145 3.2.3 Overall Categories ...... 148 3.3 Rotation Mismatch ...... 150 3.3.1 Budget Categories ...... 150 3.3.2 Release Date Categories ...... 152 3.3.3 Overall Categories ...... 155 3.4 Color Mismatch ...... 157 3.4.1 Budget Categories ...... 157 3.4.2 Release Date Categories ...... 159 3.4.3 Overall Categories ...... 162 3.5 Sharpness Mismatch ...... 164 3.5.1 Budget Categories ...... 164 3.5.2 Release Date Categories ...... 165 3.5.3 Overall Categories ...... 167 3.6 Stereo Window Violation ...... 168 3.6.1 Budget Categories ...... 168 3.6.2 Release Date Categories ...... 170 3.6.3 Overall Categories ...... 173 3.7 Overall Technical Quality ...... 175 3.7.1 Disclaimer ...... 175 3.7.2 Budget Categories ...... 176 3.7.3 Release Date Categories ...... 178 3.7.4 Overall Categories ...... 181

4 Movie Nominations 183 4.1 Disclaimer ...... 183 4.2 Movies With Best Technical Quality ...... 183 4.3 Natively Captured Movies With Best Technical Quality ...... 194

5 Unsolved Problems and Possible Next Steps 201 5.1 Universal Fatigue Metric ...... 201 5.2 Objective Fatigue-Estimation and Improvement of Artifact Metrics ...... 203 5.3 Developing a Tool for S3D-Video Quality Assessment ...... 204 5.4 Performance Comparison of S3D-Artifact-Correction Tools ...... 205 5.5 Improving Analysis of 2D-to-3D Conversion ...... 206 5.6 VR180 Analysis ...... 207

List of publications 208 Disclaimer

1. Metric values make possible to claim that one movie is better on average than another movie according to this particular metric only. Comparing two movies with average metric values, one cannot be sure that a movie with better metric value is indeed better for a viewer. We are striving to measure viewer’s perception, but there is still a lot of work to be done. The presented metrics have limitations, and they are to be improved. The metrics may be improved by VQMT3D team as well as by any researcher or research team. Despite the existing shortcomings the metrics deﬁnitely enable quality assessment of S3D video and may be beneﬁcial.

2. The object of this evaluation is a set of movie copies which were bought at Amazon store as Blu-ray discs. It is possible that detected problems exist only in a particular Blu-ray release and did not aﬀect viewers in a cinema theatre. However, the nature of many problems makes it problematic to believe that they might be introduced in any presumptive post-production stage done exclusively for a Blu-ray release.

3. Readers should note that the comparison of converted and captured S3D movies presented in this report is generally unfair, as it doesn’t take into account problems speciﬁc to converted movies. But it clearly shows how 2D-3D conversion approach helps eliminate some of the artifacts that commonly appear in captured S3D movies. 2D-3D conversion introduces, however, speciﬁc artifacts that are beyond the scope of this report. Some of these artifacts were analyzed in the previous reports [3,5].

4. The movie ratings presented in this report compare movies only in terms of technical quality measured with our set of metrics. Higher ranking of a movie in some category doesn’t necessarily mean that this movie is indeed better for a viewer.

5. All necessary movie information (release date and budget) is taken from the IMDb website (http: //www.imdb.com). Note that provided movie budget may be somewhat deceptive, as we do not know how much of the budget was spent on S3D postproduction (capturing or conversion).

6. The movie type classiﬁcation was made based on information from public sources. Thus, it may contain some inaccuracies. Also, the majority of evaluated movies contain elements of CGI. Therefore, we avoid distinguishing capturing+CGI and conversion+CGI as separate movie types. Chapter 1

Introduction

This document is the tenth report from the Video Quality Measurement Tool for 3D (VQMT3D) project. It’s unusual in that it provides a more thorough and detailed overall comparison of stereo-3D (S3D) movies and omits all individual-movie evaluation results (artifact visualizations, per-frame analysis charts and so on). The CS MSU Graphics & Media Lab (Moscow, Russia) team leads the project.

1.1 Movie Selection

This report addresses all types of S3D movies (natively captured, post-converted, hybrid and fully rendered in 3D). We tried to cover as many Blu-ray 3D movies as possible (our evaluation took place in the spring of 2014), with a main criterion for our selection being based on budget data from the IMDb website. We found and evaluated 98 such movies, as well as 7 movies that lacked a speciﬁed budget. The present work evaluates the Blu-ray releases of these ﬁlms. Therefore, the comparison is fair, as each one we analyzed is intended for viewing on home stereoscopic-cinema systems.

1.2 Document Organization

The report comprises four main parts. The second section presents an overall comparison of the movies we evaluated. It includes charts depicting the average metric values relative to a movie’s release date and budget, as well as charts illustrating metric-value distributions.

In the third section we rate movies on the basis of our metrics for multiple categories. Diﬀerent metrics correspond to diﬀerent categories, as do low- versus high-budget movies and movies with distinct release years. We also present an overall technical-quality comparison that combines all the relevant results for the various quality metrics.

The fourth section sums up the ratings in the previous section by concisely listing movies by their total number of nominations. The ﬁnal part describes our plans for continuing this project. Chapter 2

Overall Comparison Charts

2.1 Depth Budget

ggggg ggg g ggAvatar

C gg g g

ggg

gg g

ggggg ggg g ggAvatar

Figure 2.1: Example of a depth budget chart where average extreme negative and positive disparities are depicted

We use four types of diagrams to illustrate and compare the depth budgets of S3D films. The first depicts average extreme negative and positive disparities for each movie relative to its release date (Figure 2.1). Each movie therefore has two corresponding points; a line connecting these points represents the movie’s average depth budget. The second diagram is a bar chart that sorts movies by average depth budget in ascending order. Also, we provide two stacked bar charts to clarify the depth-budget-value distributions for different films. The first one sorts movies by the number of small-depth-budget scenes and the second sorts them by the number of large-depth-budget scenes. And, finally, we provide a chart depicting average disparity distributions, highlighting each film’s most commonly occurring disparity values. We measure horizontal disparity values in percent of frame width (0.5% equals ∼ 10 pixels in Full HD). A more thorough description of this metric appears in [10].

See Excessive Horizontal Disparity Examples in Our Previous Reports (1578 pages and 1879 figures in total, 3 years of preparation and publication) A lot of excessive horizontal disparity examples in captured and converted movies (385 figures in total) and per-frame analysis charts can be found here: • MSU VQMT3D Report 1 “5 Natively Captured Movies” (March 2013, 246 pages, 295 figures) [1] • MSU VQMT3D Report 2 “5 Natively Captured Movies” (May 2013, 342 pages, 442 figures) [2] • MSU VQMT3D Report 3 “5 Converted Movies” (August 2013, 305 pages, 336 figures) [3] • MSU VQMT3D Report 4 “5 Natively Captured Movies” (October 2013, 301 pages, 402 figures) [4] • MSU VQMT3D Report 5 “5 Converted Movies” (April 2014, 384 pages, 404 figures) [5] Depth Budget vs. Release Date 1 2 3

2 38

27 45 96

68 50%15 7029 1 35 71 43 74 53 9 64 7 84 75 100 26 25 81 48 Avatar 50 6 23 87 6197 65 80 4 104 16 62 69 92 5 88 54 90 12 21 22 60 63 33 99 2 11 8666 58 10 76 1 101 67 3 57 20 40 47 55 9859 72 42 41 44 13 82 18 78 3985 94 36 56 77 24 103 79 52 830 14 37 73 32 91 46 93 83 105 0 49 31 95 51 89 44 17 34 28 87 89 2 32 98 7214 4879 13 10 91 60 63 78 25 59 35 103 80 40 47 73 8277 86 58 45101 3 28 4 51 102 62 37 33 56 31 3493 20 46 26 65 83 105 54 30 99 9 81 18 74 97 8 36 5 75 95 100 76 61 49 88 66 67 7 24 41 69 52 39 94 1 104 70 84 85 53 90 1 42 12 92 68 50 6 64 21 27 11 22 55 57 19 Avatar 96 23 2971 38 Percent of screen width Percent Natively Captured 50% 43 2 2D-3D Conversion 16 15 17 CGI Hybrid (native+conversion) 102 Reference lines 3 Trend lines

Feb 1945May 1959Jul 1973Jul 1987Oct 2001Jan 2009May 2009Sep 2009Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.2: Diagram illustrating average depth budget of movies relative to release date. Magniﬁed fragments of the diagram are presented in the following Figures: 2.2a, 2.2b, 2.2c Depth Budget vs. Release Date (1/3) 1

2 38

68 50% 70 29 1 15 71 43 9 Avatar25 50

12 92

0 49 17

25 102 9 49 1 70 12 92 68 50 27 19Avatar 29 71 38 Percent of screen width Percent 50% 43 2 CGI 15 17 Natively Captured 2D-3D Conversion 102 Reference lines 3 Trend lines

Sep 1948 Nov 1962 Feb 1977 Feb 1991 Mar 2005 Feb 2009 Jun 2009 Release Date

Figure 2.2a: First magniﬁed fragment of the diagram in Figure 2.2 Depth Budget vs. Release Date (2/3) 2

45 96

1 35 64 84 75 50% 81 Avatar 6 23 65 16 62 5 88 22 66 21 11 86 1 58 10 67 98 59 101 72 3 13 82 55 18 56 77 24 14 37 91 32 83 0 31 93 95 89 34 89 32 98 14 72 13 10 91 59 35 82 77 86 58 45 101 3 62 37 56 31 34 93 83 81 65 18 5 75 95 50% 88 66 67 1 24 1 84 6 64 21 11 55 22 Avatar 96 23 Percent of screen width Percent 2 Natively Captured 16 2D-3D Conversion Hybrid (native+conversion) Reference lines 3 Trend lines

Nov 2009 Mar 2010 Jul 2010 Nov 2010 Mar 2011 Jul 2011 Nov 2011 Release Date

Figure 2.2b: Second magniﬁed fragment of the diagram in Figure 2.2 Depth Budget vs. Release Date (3/3) 3

1 74 53 7 100 48 26 Avatar 61 87 104 97 80 4 69 54 33 99 2 90 50% 60 76 63 57 40 47 42 41 44 20 78 39 85 94 36 103 79 52 8 30 46 73 105 0 51 44 28 87

48 79 2 60 63 78 103 40 47 73 28 80 4 51 50% 33 20 46 26 105 54 8 30 99 36 76 74 97 100 7 61 41 69 52 39 94 85 104 53 90 1 42 57 Avatar Percent of screen width Percent 2 Natively Captured 2D-3D Conversion Hybrid (native+conversion) Reference lines 3 Trend lines

Apr 2012 Aug 2012 Dec 2012 Apr 2013 Aug 2013 Dec 2013 Apr 2014 Release Date

Figure 2.2c: Third magniﬁed fragment of the diagram in Figure 2.2 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Depth Budget Bar Chart 4.0 Natively Captured 2D-3D Conversion 38

Hybrid (native+conversion) 19 3.5 CGI

3.0 15 96

2.5 43 16 27 29 71 68 2.0 70 17 45 23 102

Avatar 64 53 84 6 50 7 74 9 22 75

1.5 57 35 11 92 21 100 104 Titanic 12 81 55 61 90 69 26 97 42 1 88 5 65 66 25 67 85 54 41 76 4 99 48 39 80 94 Percent of screen width Percent

1.0 62 24 33 52 18 20 36 86 8 58 3 30 63 60 49 47 56 101 40 10 87 2 82 59 37 95 77 46 83 105 78 93 98 31 103 13 72 0.5 73 79 91 51 14 34 32 28 44 89 0.0

Figure 2.3: Bar chart with movies sorted by average depth budget in ascending order Depth Budget Stacked Bar Chart (sorted by small-depth-budget scenes) 100 1 7 3 9 8 6 5 2 4 11 71 31 81 51 91 61 21 41 12 14 10 16 17 13 19 18 15 72 74 70 32 76 82 52 92 77 34 30 79 78 73 36 62 54 90 84 80 94 50 96 38 39 37 56 86 75 33 60 57 53 58 87 88 93 89 59 83 99 98 97 64 35 66 67 63 85 69 68 55 95 22 20 65 24 26 23 29 28 27 25 42 44 40 46 47 49 48 43 45 101 102 104 100 103 105

20 Percentage of scenes Percentage

0.15 0.50 2.00 3.50 Percent of screen width

Figure 2.4: Stacked bar chart with movies sorted by the amount of scenes with small depth budget Depth Budget Stacked Bar Chart (sorted by large-depth-budget scenes) 100 1 7 3 8 9 6 2 5 4 11 71 31 81 91 51 61 21 41 12 14 10 16 17 19 13 18 15 72 74 70 32 92 82 52 76 73 34 79 77 78 30 36 94 54 80 62 90 50 84 37 86 33 39 56 75 96 38 88 57 53 64 98 89 99 87 93 59 58 83 97 60 66 35 95 63 55 85 22 69 67 68 24 65 20 26 23 29 27 28 25 42 44 40 46 47 48 49 43 45 101 102 104 100 103 105

20 Percentage of scenes Percentage

0.15 0.50 2.00 3.50 Percent of screen width

Figure 2.4a: Stacked bar chart with movies sorted by the amount of scenes with large depth budget Average Depth Distribution Chart(1/2) 1 7 9 5 2 4 11 71 81 21 41 10 13 19 15 74 92 70 76 54 50 62 84 33 96 75 56 97 53 64 58 87 38 60 35 63 69 65 27 26 23 29 25 40 44 43 46 47 49 48 45 100

Percent of screen width Percent 2 Natively Captured 2D-3D Conversion Hybrid (native+conversion) CGI 3

Figure 2.5: First part of a diagram illustrating average disparity distributions of diﬀerent movies. Most commonly occurring disparity values (throughout a whole movie) are highlighted with white color Average Depth Distribution Chart(2/2) 3 8 6 31 91 51 61 12 14 17 16 18 72 32 52 82 73 77 30 94 34 78 90 79 80 57 36 37 93 39 83 59 86 98 99 88 89 67 95 22 55 66 68 85 20 24 28 42 101 102 104 103 105

Percent of screen width Percent 2 Natively Captured 2D-3D Conversion Hybrid (native+conversion) CGI 3

Figure 2.5a: Second part of a diagram illustrating average disparity distributions of diﬀerent movies. Most commonly occurring disparity values(throughout a whole movie) are highlighted with white color Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy 4: Abraham Lincoln: Vampire Hunter 2: 47 Ronin 5: Alice in Wonderland 3: A Very Harold & Kumar 3D Christmas 10: Captain America: The First Avenger 6: Avatar 11: Cats & Dogs: The Revenge of Kitty Galore 7: Bait 13: Clash of the Titans 8: Battle of the Year 14: Conan the Barbarian 12: Cirque du Soleil: Journey of Man 25: G-Force 15: Creature from the Black Lagoon 26: G.I. Joe: Retaliation 16: Dark Country 28: Ghost Rider: Spirit of Vengeance 17: Dial M for Murder 30: Gravity 18: Dolphin Tale 31: Green Lantern 19: Dolphins and Whales 3D: Tribes of the Ocean 32: Gulliver’s Travels 20: Dredd 34: Harry Potter and the Deathly Hallows: Part 2 21: Drive Angry 36: I, Frankenstein 22: Final Destination 5 37: Immortals 23: Flying Swords of Dragon Gate 39: Iron Man 3 24: Fright Night 41: John Carter 27: Galapagos: The Enchanted Voyage 47: Man of Steel 29: Ghosts of the Abyss 48: Men in Black 3 35: Hugo 49: Mummies: Secrets of the Pharaohs 38: Into the Deep 53: Paciﬁc Rim 40: Jack the Giant Slayer 54: Percy Jackson: Sea of Monsters 42: Journey 2: The Mysterious Island 56: Piranha 3D 43: Journey to the Center of the Earth 59: Priest 44: Katy Perry: Part of Me 61: R.I.P.D. 45: Legends of Flight 72: Spy Kids: All the Time in the World in 4D 46: Life of Pi 74: Star Trek Into Darkness 50: My Bloody Valentine 80: The Avengers 51: One Direction: This Is Us 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful 86: The Green Hornet 55: Pina 89: The Last Airbender 57: Piranha 3DD 91: The Nutcracker in 3D 58: Pirates of the Caribbean: On Stranger Tides 93: The Smurfs 60: Prometheus 94: The Smurfs 2 62: Resident Evil: Afterlife 97: The Wolverine 63: Resident Evil: Retribution 98: Thor 64: Sanctum 99: Thor: The Dark World 65: Saw 3D: The Final Chapter 100: Titanic 66: Sea Rex 3D: Journey to a Prehistoric World 104: World War Z 67: Shark Night 3D 105: Wrath of the Titans 68: Sharks 3D 69: Silent Hill: Revelation 3D 70: Space Station 3D CGI 71: Spy Kids 3-D: Game Over 9: Bolt 73: Stalingrad 92: The Polar Express 75: Step Up 3D 76: Step Up Revolution 77: TRON: Legacy 78: Texas Chainsaw 3D 79: The Amazing Spiderman 81: The Child’s Eye 83: The Darkest Hour 84: The Final Destination 85: The Great Gatsby 87: The Hobbit: An Unexpected Journey 88: The Hole 90: The Legend of Hercules 95: The Three Musketeers 96: The Ultimate Wave Tahiti 102: Ultimate G’s 103: Underworld: Awakening

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters 101: Transformers: Dark of the Moon Overall Comparison Charts Depth Continuity MSU Stereo-Film Quality Analysis Report 10

2.2 Depth Continuity

sj sj sss

ssssss ssssss sss

sss

sssss sssss sssss ssss

sss

sssss sssss ssss ssssss

sss

Figure 2.6: Illustration of the depth continuity metric on several examples. Brighter areas on the chart correspond to more common disparity values in a shot

In this section we compare movies by depth continuity. A widely known fact is that avoiding major depth- jump cuts (sudden depth changes in a frame’s salient regions) is crucial to a pleasant viewing experience. We developed a metric that estimates these depth jumps, assuming a simple visual-saliency model based on two cues: center prior and defocus. The metric’s ﬁnal value is dimensionless; higher values indicate more-frequent and more-intense depth-jump cuts throughout a ﬁlm.

We provide three straightforward diagrams to examine the depth continuity of diﬀerent movies. The ﬁrst two illustrate metric values relative to release date and budget. The last one is a simple bar chart that ranks movies by depth continuity.

CS MSU Graphics & Media Lab 25 https://videoprocessing.ml/stereo_quality/ Depth Continuity vs. Release Date

14 30 89 32 98 93 91 79 13 77 66 55 34 95 37 105 44 46 87 40 85 47 51 8 73 99 2 0 86 58 31 24 83 103 41 60 36 5 88 59 10 72 18 28 100 20 54 6 82 101 22 76 97 48 63 78 52 33%17 3 42 39 61 62 64 94 68 81 7 38 11 49 90 12 75 67 23 4 9 69 33 1 25 74 50 104 84 45 35 80 65 1 26 53 27 56 2 21 16 70 96 57 92 19 102 3 66% 15

t 5

e 71

6 Natively Captured

MSU-DepthContinuity-2015 2D-3D Conversion

CGI

7 Avatar Hybrid (native+conversion) 29 Reference lines Trend lines 8

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.7: Diagram illustrating depth continuity metric value relative to movie release date Depth Continuity vs. Release Date

30 89 32 14 91 79 0.0 13 77 93 95 37 47 73 2 66 98 34 44 46 51 8 99 86 55 24 60 87 40 85 41 59 83 103 105 10 36 58 31 72 18 100 28 20 54 5 88 101 6 22 97 82 76 63 78 48 52 42 17 3 39 61 62 64 0.5 33% 94 68 7 81 11 38 90 49 67 23 12 75 4

69 9 33 1.0 25 74 50

104

t 80 t 1.5 45 35 53 e 65 1 26

Natively Captured

MSU-DepthContinuity-2015 2D-3D Conversion

CGI 2.0 Hybrid (native+conversion)

16 Avatar 66% Reference lines 70 Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.7a: Magniﬁed fragment of the diagram in Figure 2.7 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Depth Continuity vs. Movie Budget

44 73 14 37 95 91 93 30 13 32 77 89 2 99 79 0 55 51 66 8 24 83 85 46 34 86 60 98 47 40 87 103 10 41 72 18 28 59 36 54 105 31 58 33% 88 22 20 97 101 6 5 76 82 78 63 52 42 48 17 3 61 39 64 62 94 81 68 7 11 67 90 49 23 4 75 69 33 9 25 1 50 74 66% 104 84 80 45 35 1 65 26 53 56 21 2 16

57 96 92 19 3

B 5

MSU-DepthContinuity-2015 6 Natively Captured 43 2D-3D Conversion 7 CGI Avatar Hybrid (native+conversion) 29 Reference lines Trend lines 8 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.8: Diagram illustrating depth continuity metric value relative to movie budget (per minute) Depth Continuity vs. Movie Budget

73 14 95 91 30 32 89 0.0 93 13 77 2 79 44 8 37 98 99 47 55 51 24 46 34 60 66 85 86 40 87 83 103 41 105 59 10 36 18 31 58 72 54 20 28 88 101 5 22 97 6 33% 76 82 63 78 52 48

42 3 17 61 39 64 0.5 62 94 68 7 81

49 67 23 4

69 33 r 1.0 9 25 e 74

t t 50

B 104

66%

MSU-DepthContinuity-2015

80 Natively Captured 1.5 45 35 2D-3D Conversion 53 1 65 26 CGI Avatar Hybrid (native+conversion) 56 Reference lines Trend lines 21 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.8a: Magniﬁed fragment of the diagram in Figure 2.8 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Depth Continuity Bar Chart

Natively Captured 29 2D-3D Conversion 7 Hybrid (native+conversion) CGI 43

6 71

4 15 3 102 19 92 96 57 70 16

2 21 27 MSU-DepthContinuity-2015 56 1 26 65 53 35 45 80

Avatar 84 104 50 74 9 25 33 69 4 75 12 23 1 67 49 90 38 11 81 7 68 94 62 64 61 3 39 17 42 48 52 78 63 76 6 82 5 22 97 88 20 28 101 54 72 31 18 58 36 10 59 100 41 83 105 8 40 85 87 103 86 2 51 55 66 24 60 34 46 99 44 98 47 77 79 93 13 37 91 95 32 89 14 73 0 30

Figure 2.9: Bar chart with movies sorted by depth continuity metric value in ascending order Depth Continuity Bar Chart (Logarithmic Scale) 101 Natively Captured

2D-3D Conversion 29 43

Hybrid (native+conversion) 71 CGI 15 19 102 92 96 57 70 16 21 27 56 1 26 65 53 35 45 0 80 84

10 104 50 74 9 25 33 69 4 75 12 23 67 49 90 38 11 81 7 68 94 62 64 61 39 3 17 42 48

Avatar 52 78 63 76 82 6 22 97 5 88 101 20 28 54 72 31 18 100 58 36 -1 10 59

10 105 83 103 41 40 85 87 86 55 66 24 60 51 34 46 99 44 8 98 47 77 93 79 2 37 95 13 -2 32 10 89 73 91 14 MSU-DepthContinuity-2015 (logarithmic scale) (logarithmic MSU-DepthContinuity-2015 30

Figure 2.9a: Bar chart with movies sorted by depth continuity metric value in ascending order (logarithmic scale) Overall Comparison Charts Vertical Parallax MSU Stereo-Film Quality Analysis Report 10

2.3 Vertical Parallax

Figure 2.10: Schematic illustration of a stereo pair with vertical parallax

We provide two straightforward diagrams illustrating the average vertical-parallax metric values of each ﬁlm relative to its release date and budget. The ranking by average vertical parallax is clearer in the following bar chart: vertical-disparity distributions appear in a stacked bar chart that sorts movies by the number of scenes with signiﬁcant vertical parallax. Here we measure vertical parallax in permil of the frame width (0.5%equals one pixel in Full HD). Our decision to use frame width may seem counterintuitive, however. Generally, most video captured nowadays has a wide aspect ratio that is, 16:9 or greater. Nearly all home-cinema displays also have a 16:9 ratio. Thus, an examination of Blu-ray 3D releases for home cinemas should use the frame width; the vertical-parallax value then corresponds to the actual display size. A more thorough description of this metric appears in [12].

Worth noting is that vertical parallax which is ostensibly speciﬁc to natively captured S3D movies also occurs in movies converted to S3D format during postproduction. Our reports dedicated to analyzing 2D-to-3D conversion provide several examples [3,5].

See Vertical Parallax Examples in Our Previous Reports (889 pages and 1139 figures in reports dedicated to native S3D, 689 pages and 740 figures in reports dedicated to 2D-3D conversion) A lot of vertical parallax examples in captured movies (230 figures in total) and per-frame analysis charts can be found here: • MSU VQMT3D Report 1 (March 2013, 246 pages, 295 figures) [1] • MSU VQMT3D Report 2 (May 2013, 342 pages, 442 figures) [2] • MSU VQMT3D Report 4 (October 2013, 301 pages, 402 figures) [4] Several examples of vertical parallax in 2D-3D conversion (44 figures in total) can be found here: • MSU VQMT3D Report 3 (August 2013, 305 pages, 336 figures) [3] • MSU VQMT3D Report 5 (April 2014, 384 pages, 404 figures) [5]

CS MSU Graphics & Media Lab 34 https://videoprocessing.ml/stereo_quality/ Vertical Parallax vs. Release Date

9 10 97 94 89 14 10580 60 4 39 47 99 92 25 5 13 56 82 32 86 98 59 31 34 93 37 91 28 41 48 26 74 104 73 36 0.0 49 72 100 79 44 87 52 61 54 6 33 30 65 101 85 51 2 77 40 103 46 78 71 58 3 76 35 23 90 66 95 83 68 8 24 20 45 63 62 55 22 70 42 69 53

84 7 0.5 29 64 88 67 96 81 18 38 50 12 102 75 27 43 16 21 19 57

1 1.0 33%

e t 17

t e 1.5

Permil of screen width Permil of screen 66%

Natively Captured

2D-3D Conversion

CGI

2.0 Avatar Hybrid (native+conversion) 15 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.11: Diagram illustrating vertical parallax metric value relative to movie release date Vertical Parallax vs. Release Date

9 10 97 94 5 89 82 32 98 31 14 37 28 4110580 4 26 39 74 47104 99 36 0.0 25 13 59 34 93 48 61 73 92 56 86 91 100 60 54 49 72 44 79 87 52 33 30 6 85 51 101 2 65 77 40 46 78 58 103 71

3 76 35 23 90 95 0.2 66 83

8 68 20 24 45 63 62 22 55

70 42 69 0.4 53

r 84 7 e 29 64

t 67 e 88

96 18

Permil of screen width Permil of screen

0.6 81

Natively Captured

38 50 2D-3D Conversion

33%

12 CGI

Hybrid (native+conversion) 75 66% 102 Avatar 27 43 Reference lines 16 21 Trend lines 0.8 19

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.11a: Magniﬁed fragment of the diagram in Figure 2.11 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Vertical Parallax vs. Movie Budget

37 10539 28 14 4 36 54 97 94 93 10 26 98 32 61 82 74 89 9 47 104 25 31 5 41 0.0 73 56 91 34 13 99 80 92 48 49 44 72 59 86 60 79 87 30 52 33 6 51 85 101 65 77 2 40 78 46 103 58 71 3 76 23 90 35 0.2 33% 66 83 95 8 68 20 24 45 63 22 62 55

69 42 0.4 53

7 84 29 64 67 88

96 18 0.6 66% 81 50

43 16 21 0.8 19

r 57

t t 1

1.0

Permil of screen width Permil of screen

1.2 Natively Captured 11 2D-3D Conversion CGI 1.4 Avatar Hybrid (native+conversion) 17 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.12: Diagram illustrating vertical parallax metric value relative to movie budget (per minute) Vertical Parallax vs. Movie Budget

37 36 97 26 10539 9 28 14 4 54 94 93 10 98 32 61 82 74 89 47 104 31 5 41 0.0 34 13 99 80 25 48 73 56 59 91 92 72 86 60 49 44 79 87 30 52 33 6 51 85 101 2 65 77 40 0.1 46 78 103 58 71

3 76

35 23 90 95 0.2 66 83 33% 8 68

24 0.3 45 63 22

r 42 69

e t 53

t 0.4

7 84

Permil of screen width Permil of screen 29

0.5 64

67 88 Natively Captured 2D-3D Conversion 96 18 CGI 0.6 66% 81 Avatar Hybrid (native+conversion) 50 Reference lines Trend lines 0.7 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.12a: Magniﬁed fragment of the diagram in Figure 2.12 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Vertical Parallax Bar Chart

Natively Captured 15 2D-3D Conversion 2.0 Hybrid (native+conversion) CGI

1.5 17 11

1.0 1 57 19 21 16 43 27 102 75 12 50 38 81 Permil of screen width Permil of 18 96 88 67 64 7 29 0.5 84 53 69 42 70 55 62 Avatar 22 63 45 24 20 8 68 83 66 95 23 90 35 3 76 71 58 78 103 46 40 2 77 65 51 85 6 101 33 30 52 87 79 44 49 72 86 60 92 91 5 9 4 56 73 48 13 25 31 59 34 98 61 32 14 41 10 26 82 54 74 28 100 93 37 80 36 39 99 94 97 89 47 104 0.0 105

Figure 2.13: Bar chart with movies sorted by average vertical parallax metric value in ascending order Vertical Parallax Bar Chart (Logarithmic Scale) Natively Captured

2D-3D Conversion 15

0 17 10 Hybrid (native+conversion) 11 CGI 1 57 19 21 16 43 27 75 102 12 50 38 81 18 96 88 67 7 64 29 84 53 69 42 70 55 62 22 63 45 24 20 8 68 83 66 95 23 90 35 3 76

-1 71

10 58 103 78 46

Avatar 40 77 2 65 51 85 101 6 33 30 52 87 79 44 49 72 86 -2 60 92

10 56 100 91 73 48

Metric Precision Threshold 25 13 59 98 34 32 26 5 28 14 -3 82 54 93

10 74 37 31 80 36 4 9 61 10 41 39 104 99 105 94 97 Permil of screen width (logarithmic scale) screen width Permil of 10-4 47 89

Figure 2.13a: Bar chart with movies sorted by average vertical parallax metric value in ascending order (logarithmic scale) Vertical Parallax Stacked Bar Chart 100 1 7 3 9 8 6 5 2 4 11 71 31 51 91 81 61 21 41 12 10 14 16 18 19 17 13 15 72 70 32 74 82 52 92 76 30 73 79 34 78 77 90 62 84 50 36 54 94 80 37 39 33 86 56 38 96 75 89 93 98 99 97 60 59 87 58 83 88 64 57 53 35 66 85 95 55 63 22 68 69 67 65 20 24 26 28 23 27 29 25 42 44 40 46 47 48 49 43 45 101 102 100 104 103 105

40 Percentage of scenes Percentage

0.10 0.50 2.00 Permil of screen width

Figure 2.14: Stacked bar chart with movies sorted by the amount of low-technical-quality scenes Overall Comparison Charts Scale and Rotation Mismatch MSU Stereo-Film Quality Analysis Report 10

2.4 Scale and Rotation Mismatch

(a) Scale mismatch (b) Rotation mismatch

Figure 2.15: Schematic illustration of stereopairs with scale and rotation mismatch

Taking into account a wider range of geometric inconsistencies, we also provide an overall ﬁlm comparison in terms of scale and rotation mismatch. It includes the same set of diagrams as in the previous section (Vertical Parallax).

We measure scale mismatch as a percentage. For example, if the metric value is 0.3, the image in the right view is 1.003× “bigger” than the image in the left view. We measure rotation mismatch in degrees.

Scale and rotation mismatch also occasionally arise in 2D-to-3D conversion; examples appear in our eighth VQMT3D report [8].

See Scale/Rotation Mismatch Examples in Our Previous Reports A lot of scale/rotation mismatch examples in captured movies (249 figures in total) and several in converted movies (18 figures in total) alongside with per-frame analysis charts can be found here: • MSU VQMT3D Report 8 (June 2015, 366 pages, 361 figures) [8]

CS MSU Graphics & Media Lab 44 https://videoprocessing.ml/stereo_quality/ Scale Mismatch vs. Release Date

100 10 14 48 97 94 30 25 5 89 82 32 98 59 31 93 37 28 41 4 26 39 47104 99 36 0.00 9 13 86 34 91 10580 74 61 54 73 92 72 60 79 87 49 65 33 52 68 56 44 2 38 85 101 46 51 58 24 6 77 40 76 0.05 95 103 78 8 3 66 23 53 35 63 12 45 62 90 19 0.10 33% 22 83 17 29 71 50 64 70 11

81 20 55 102 27 0.15 42

21 88

66% 96 69 r 0.20 e 57

t 7

Percent (x100) 18 15

e 1

0.25

Natively Captured

67 2D-3D Conversion

CGI

0.30 Avatar Hybrid (native+conversion) 75 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.16: Diagram illustrating scale mismatch metric value relative to movie release date Scale Mismatch vs. Release Date

10 14 100 97 94 25 5 89 82 98 31 37 28 41 48 26 39 47104 30 99 36 0.00 13 32 59 93 10580 4 74 61 54 9 86 34 72 91 60 73 92 79 87 49 65 33 52 44 68 56 85 2 38 101 46 58 51 24 6 77 40 76 8 0.05 95 103 78 3

23 66 53 35 63

12 45 62 90

19 22 83 0.10 33%

17 29

71 50 64 r 70 11

e t 20

t 81 Percent (x100) 55 e 102

27 0.15 42

Natively Captured

2D-3D Conversion

CGI

21 88 Hybrid (native+conversion) 66% Avatar 96 69 Reference lines 0.20 Trend lines 57 7

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.16a: Magniﬁed fragment of the diagram in Figure 2.16 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Scale Mismatch vs. Movie Budget

36 26 99 39 28 14 37 54 97 94 93 30 10 98 61 82 89 47 104 25 31 5 41 48 0.00 73 72 4 91 32 74 10580 59 34 86 60 13 9 92 79 49 87 65 33 52 68 44 56 85 2 46 101 51 24 58 6 77 40 76 8 0.05 78 95 103 33% 3 66 23 53 63 35 45 62 90 19 0.10 83 22 17 29 50 64 71 66% 11 81 20 55

0.15 42

r 88 21

e t 96 69 t 0.20 e 57

Percent (x100) 7

B 18

0.25

84 Natively Captured 67 2D-3D Conversion CGI 0.30 Avatar Hybrid (native+conversion) 75 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.17: Diagram illustrating scale mismatch metric value relative to movie budget (per minute) Scale Mismatch vs. Movie Budget

99 39 14 37 36 54 97 94 93 30 10 26 98 61 89 47 104 31 5 41 48 0.00 28 4 32 82 10580 25 73 72 59 91 13 74 9 34 86 60 79 92 87 49 65 33 52 68 44 56 2 85 101 46 51 58 24

77 40 76 8 0.05 78 95 103 33% 3 23 53 66 63 35

45 62 90

19 83 22

0.10

r 17 29

e 50 64 71

t 11

e Percent (x100) 66% 20 B 81

0.15 42

Natively Captured 16 2D-3D Conversion

21 88 CGI Avatar Hybrid (native+conversion) 69 96 Reference lines 0.20 Trend lines 57 7 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.17a: Magniﬁed fragment of the diagram in Figure 2.17 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Scale Mismatch Bar Chart

Natively Captured 75 2D-3D Conversion 0.30 Hybrid (native+conversion) CGI 67 84 0.25 43 1 15 18 7 57

0.20 96 69 88 21 16 42

0.15 27 102 55 81 20 11 70 50 71 64 Percent (x100) Percent 17 29 22 0.10 83 19 90 62

Avatar 45 12 35 63 66 53 23 3 95 8 78 103

0.05 76 40 77 6 24 58 51 46 101 38 2 85 56 68 44 33 52 65 49 87 92 79 60 86 9 34 91 4 73 13 72 74 5 32 59 25 82 80 28 98 41 61 31 37 54 14 93 30 10 26 36 39 94 99 89 97 47 48 104 105 0.00 100

Figure 2.18: Bar chart with movies sorted by average scale mismatch metric value in ascending order Scale Mismatch Bar Chart (Logarithmic Scale) Natively Captured

2D-3D Conversion 75 67 84 1 43 15 7 18 57

Hybrid (native+conversion) 96 69 21 88 16 42 -1 27 55 81 102

CGI 20 11 70 71 50

10 64 17 29 22 83 19 90 62 45 12 35 63 66 53 Avatar 23 3 8 95 78 103 76 40 77 6 24 58 51 46 101 38 85 2 56 68 -2 44 33 65 10 52 49 87 92 79 60 86 34 73 91 9 13 72 74 Metric Precision Threshold 4 32

-3 59 10 25 82 28 80 98 37 54 93 41 30 61 14 26 31 5 36

10-4 104 39 105 100 Percent (x100) (logarithmic scale) (x100) (logarithmic Percent 47 94 10 48

-5 99 10 89 97

Figure 2.18a: Bar chart with movies sorted by average scale mismatch metric value in ascending order (logarithmic scale) Scale Mismatch Stacked Bar Chart 100 1 7 3 9 8 6 5 2 4 11 71 31 91 51 81 61 21 41 12 10 14 16 17 13 19 18 15 72 70 32 74 92 52 82 76 30 73 79 34 77 78 50 62 90 84 36 54 94 80 56 38 96 75 37 39 86 33 60 87 89 93 97 99 98 59 58 83 88 53 64 57 66 35 95 55 22 69 67 85 63 68 20 65 24 26 28 23 27 29 25 42 40 44 46 47 48 49 43 45 101 102 100 104 103 105

40 Percentage of scenes Percentage

0.10 0.40 0.65 Percent (x100)

Figure 2.19: Stacked bar chart with movies sorted by the amount of low-technical-quality scenes Rotation Mismatch vs. Release Date

10 94 9 100 4 47 61 30 92 25 5 13 89 56 82 32 98 59 31 34 14 37 28 41 48 26 39 74 104 54 99 36 0.0 11 93 91 10580 79 53 97 73 49 86 72 44 87 52 68 60 33 65 85 2 101 51 58 46 38 103 6 24 78 40 77 3 76 66 83 0.2 8 70 90 95 23 96 64 35 20 29 102 55 42 12 45 0.4 22 16 81 50 63 71 43 19 88 62 69 0.6 33% 67

17 27 18

r e 0.8 84

Degrees (x10) 75

B 21

66%

1.0 Natively Captured

1 2D-3D Conversion

CGI

1.2 Avatar Hybrid (native+conversion) 15 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.20: Diagram illustrating rotation mismatch metric value relative to movie release date Rotation Mismatch vs. Release Date

10 100 47 61 97 94 30 92 25 5 89 56 82 98 59 31 34 14 37 28 41105 48 4 26 39 74 99 36 0.0 9 13 32 93 80 10453 54 11 91 79 73 49 86 87 44 68 72 60 52 33

65 85 2 101 51

0.1 58 46

38 103 24 78 6 40 77 3 76 66 83 0.2 8 90 70

95 23

64 0.3 96 35

29 55 r 102 e 42

t Degrees (x10) t 0.4 12 45

e 22 16

81 50 63 Natively Captured

33% 2D-3D Conversion 0.5

CGI 43 19 88 62 69 Hybrid (native+conversion) 66% Avatar 67 Reference lines 0.6 Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.20a: Magniﬁed fragment of the diagram in Figure 2.20 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Rotation Mismatch vs. Movie Budget

59 26 74 89 99 39 56 28 14 4 36 54 97 34 94 93 30 10 98 61 82 9 47 10492 25 31 5 41 48 0.0 73 37 91 11 13 32 53 105 49 86 80 79 87 44 72 60 52 68 33 65 85 2 51 101 46 58

24 103 78 6 40 77 33% 3 76 66 83 0.2 8 90 95 23 64 96 35 20 29 55 42 0.4 45 22 66% 16 81 50 63

88 19 69 43

r 0.6

t 7

Degrees (x10) 17 18

0.8 84

Natively Captured 21 2D-3D Conversion 1.0 CGI Avatar Hybrid (native+conversion) 1 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.21: Diagram illustrating rotation mismatch metric value relative to movie budget (per minute) Rotation Mismatch vs. Movie Budget

59 26 89 99 28 14 4 54 97 34 94 30 10 98 61 74 39 47 10492 25 31 5 41 48 0.0 56 37 36 93 82 105 9 73 13 32 53 80 91 11 79 49 86 87 44 60 68 72 52 33

65 85 2 51 101

58 0.1 46

103 24 78 6 40 77 33% 3 76 66 83 0.2 8 90

96 35

0.3

r 20

t 29 55

e Degrees (x10)

B 42

45 0.4

66%

81 50 63 Natively Captured 0.5 2D-3D Conversion 71 CGI

43 Avatar Hybrid (native+conversion) 88 19 69 62 Reference lines 67 Trend lines 0.6 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.21a: Magniﬁed fragment of the diagram in Figure 2.21 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Rotation Mismatch Bar Chart

Natively Captured 15 1.2 2D-3D Conversion Hybrid (native+conversion) CGI 1

1.0 21 75 84 0.8 57 27 18 17 7

0.6 67 62 19 69 88 43 71 50 63 81 Degrees (x10) Degrees 16 22 12 45

0.4 42 102 55 29 Avatar 20 35 96 64 23 95 70 90 8 66 83 0.2 3 76 77 6 40 78 24 38 103 46 58 51 101 2 85 65 33 68 52 72 60 44 87 86 49 79 11 91 9 73 5 4 13 80 32 93 41 82 31 56 37 98 61 14 53 25 92 39 54 59 10 34 30 74 36 28 94 99 89 97 26 48 47 100 104 0.0 105

Figure 2.22: Bar chart with movies sorted by average rotation mismatch metric value in ascending order Rotation Mismatch Bar Chart (Logarithmic Scale) Natively Captured 0

10 15 2D-3D Conversion 1 21 75 84

Hybrid (native+conversion) 57 27 18 7 17 67 19 62 69 88 43 CGI 71 50 63 81 16 22 12 45 42 55 102 29 20 35 96 64

Avatar 23 95 70 90 8 66 83 3 76 77 6

-1 40 78 24 38 10 103 46 58 51 101 2 85 65 33 68 52 72 60 44 87 86 49 -2 10 79 91 11 73 80 32 Metric Precision Threshold 13 93 9 56 82 37 98 25 -3 53 92 10 39 54 5 41 59 4 34 14 30 31 36 74 28 100 94 104 61 -4 Degrees (x10) (logarithmic scale) (x10) (logarithmic Degrees

10 26 10 99 48 47 105 89 97

Figure 2.22a: Bar chart with movies sorted by average rotation mismatch metric value in ascending order (logarithmic scale) Rotation Mismatch Stacked Bar Chart 100 1 7 3 8 9 6 5 2 4 11 71 31 91 51 81 61 21 41 12 10 14 16 13 17 18 19 15 72 70 74 32 92 52 82 76 30 34 79 73 78 77 90 50 62 84 36 54 94 80 33 96 38 75 39 86 56 37 53 59 89 93 97 99 98 87 58 60 83 64 88 57 35 66 55 22 67 69 63 68 85 95 65 20 24 26 28 23 29 27 25 42 44 40 46 47 48 49 43 45 101 102 100 104 103 105

40 Percentage of scenes Percentage

0.10 0.70 2.00 Degrees (x10)

Figure 2.23: Stacked bar chart with movies sorted by the amount of low-technical-quality scenes Overall Comparison Charts Color Mismatch MSU Stereo-Film Quality Analysis Report 10

2.5 Color Mismatch

Figure 2.24: Schematic illustration of a stereo pair with color mismatch

As with vertical parallax, we provide for color mismatch two straightforward diagrams illustrating a movie’s average metric value relative to its release date and budget, as well as a bar chart with average color- mismatch values and a stacked bar chart that sorts movies by number of scenes containing signiﬁcant color mismatch. The color-mismatch values are dimensionless; the important thing is that we produced them using the MSU-3Dcolor-2011 metric. They represent the strength of the color diﬀerence between the two views of a stereoscopic frame. Higher values indicate greater color mismatch. A more thorough description of this metric appears in [9].

Owing to various errors introduced during postproduction, color mismatch can also arise in 2D-to-3D conversion. Our reports dedicated to analyzing 2D-to-3D conversion include several examples [3,5].

See Color Mismatch Examples in Our Previous Reports (889 pages and 1139 figures in reports dedicated to native S3D, 689 pages and 740 figures in reports dedicated to 2D-3D conversion) A lot of color mismatch examples in captured movies (416 figures in total) and per-frame analysis charts can be found here: • MSU VQMT3D Report 1 (March 2013, 246 pages, 295 figures) [1] • MSU VQMT3D Report 2 (May 2013, 342 pages, 442 figures) [2] • MSU VQMT3D Report 4 (October 2013, 301 pages, 402 figures) [4] Several examples of color mismatch in 2D-3D conversion (64 figures in total) can be found here: • MSU VQMT3D Report 3 (August 2013, 305 pages, 336 figures) [3] • MSU VQMT3D Report 5 (April 2014, 384 pages, 404 figures) [5]

CS MSU Graphics & Media Lab 63 https://videoprocessing.ml/stereo_quality/ Color Mismatch vs. Release Date

82 59 34 93 100 79 97 54 0 5 13 31 14 37 28 105 39 47104 73 99 36 92 49 25 89 11 56 32 86 98 91 41 80 48 4 87 94 77 10 33 26 61 9 101 24 72 46 74 30 2 58 35 103 60 44 40 52 51 8 68 85 53 95 83 50 66 6 22 64 29 81 78 10 3 23 63 33%17 69 90 42 20 16 1 57 76 62 96 55 71 88 66% 12 21 43 84 20 15 75 67 27 70 45

38 30 18

r 40 102

B MSU-3DColor-2011

Natively Captured

2D-3D Conversion

CGI 60 Avatar Hybrid (native+conversion) 19 Reference lines Trend lines 70

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.25: Diagram illustrating color mismatch metric value relative to movie release date Color Mismatch vs. Release Date

0 13 59 34 37 100 39 47 31 28 79 97 54 99 82 10 93 105 104 92 5 98 91 80 48 4 61 94 73 36 49 25 89 77 86 14 41 11 56 32 87 72 33 26 30 9 24 74 2 101 46 58 103 60 44 35 40 52 51 8

68 85 53 95 5 83

50 66

6 22

64 78 29 81

10 3 63 23

33% 42 20

t t 16 1

B 15 76 MSU-3DColor-2011 57

Natively Captured 62

96 55 2D-3D Conversion

71 12 88 CGI

21 Hybrid (native+conversion) 66% 43 15 84 Avatar 67 20 75 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.25a: Magniﬁed fragment of the diagram in Figure 2.25 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Color Mismatch vs. Movie Budget

59 39 28 54 34 13 61 82 105 47 79 0 73 4 37 97 94 93 10 98 104 31 5 48 49 56 14 36 91 86 11 32 89 99 80 92 25 41 87 72 33 30 26 77 24 46 101 74 2 9 51 44 8 103 60 35 52 40 58 68 85 53 83 95 33% 66 50 22 6 64 81 78 29 3 10 23 63 17 69 90 66% 20 42 1 16 57 76 62 55 96 88 71 21 67 43 84 20 75 45

30 18

t 40

MSU-3DColor-2011

Natively Captured 2D-3D Conversion 60 CGI Avatar Hybrid (native+conversion) 19 Reference lines Trend lines 70 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.26: Diagram illustrating color mismatch metric value relative to movie budget (per minute) Color Mismatch vs. Movie Budget

0 37 59 34 13 39 28 54 105 47 79 31 97 10 82 99 104 73 4 36 94 93 98 61 5 91 80 92 25 48 49 14 86 77 89 41 56 11 32 87 72 33 30 26 2 24 74 9 46 101 60 58 44 8 103 51 35 52 40

68 85 53 95 5 83

50 66

33% 22 6

64 78 81 29

10 3 63

r 69

e 90 17

t 42 e 20

MSU-3DColor-2011

1 16

66%

15 76

Natively Captured 62 2D-3D Conversion 55 96 CGI 71 88 Avatar Hybrid (native+conversion) 21 Reference lines 43 84 20 67 Trend lines 75 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.26a: Magniﬁed fragment of the diagram in Figure 2.26 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Color Mismatch Bar Chart

Natively Captured 19 2D-3D Conversion 60 Hybrid (native+conversion) CGI

40 102 65

30 18 38 7 70 45 27 MSU-3DColor-2011 75 67 15 84 43

20 21 12 88 71 96 55 62

Avatar 57 76 1 16 20 42 17 90 69 23 3 63 81 10 29

Titanic 78 64 6 22 66 50 83 95 85 53 68 8 51 52 40 35 44 58 60 9 103 2 46 24 101 74 30 33 26 72 11 87 32 56 5 4 41 14 89 86 77 91 49 25 92 61 80 48 98 36 73 94 93 82 31 10 97 99 79 54 47 28 34 13 39 37 59 104 105 0 100

Figure 2.27: Bar chart with movies sorted by average color mismatch metric value in ascending order Color Mismatch Bar Chart (Logarithmic Scale) Natively Captured

2D-3D Conversion 19 Hybrid (native+conversion) CGI 102 65 18 38 7 70 45 27 75 67 15 84 43 21 12 88 71 96 55 62 57 76 1 16 20 1 42 17 90 10 69 23 3 Avatar 63 81 29 78 64 6 22 66 50 83 95 85 53 68 51 52 40 8 35 44 103 58 60 101 46 9 24 2 74 30 33 26 72 87 32 56 Metric Precision Threshold 11 0 89 86 14 77 10 41 49 25 91 92 48 80 98 61 5 4 36 73 94 93 82 104 MSU-3DColor-2011 (logarithmic scale) (logarithmic MSU-3DColor-2011 Titanic 97 10 99 31 105 79 54 47 100 28 34 39 37 13 59

Figure 2.27a: Bar chart with movies sorted by average color mismatch metric value in ascending order (logarithmic scale) Color Mismatch Stacked Bar Chart 100 1 7 3 9 8 6 5 2 4 11 71 31 91 51 81 61 21 41 12 10 14 16 17 18 19 13 15 72 70 32 74 82 92 52 76 30 79 34 77 73 78 50 90 84 62 54 94 36 80 39 37 86 33 56 96 75 38 59 87 97 93 99 58 98 89 60 83 53 64 88 57 66 35 95 85 68 22 63 69 55 67 20 65 24 26 28 29 23 27 25 42 44 40 46 47 49 48 43 45 101 102 100 104 103 105

40 Percentage of scenes Percentage

4.00 12.00 40.00 MSU-3DColor-2011

Figure 2.28: Stacked bar chart with movies sorted by the amount of low-technical-quality scenes Overall Comparison Charts Sharpness Mismatch MSU Stereo-Film Quality Analysis Report 10

2.6 Sharpness Mismatch

Figure 2.29: Schematic illustration of a stereo pair with sharpness mismatch

As with previous types of artifacts, we provide average sharpness-mismatch values for our selected ﬁlms in four diagrams: two scatterplots (one relative to movie release date and one relative to movie budget), one bar chart and one stacked bar chart. Sharpness-mismatch values are dimensionless; we obtained them using the MSU-3Dsharpness-2012 metric. Each one represents the diﬀerence in sharpness between two views of a stereoscopic frame. The value indicates sharpness-mismatch noticeability, which depends on the size of the region containing the sharpness mismatch and on the mismatch strength. We provide a more thorough description of this metric in [9].

A particular case of sharpness mismatch commonly arises in converted S3D movies: edge-sharpness mismatch (see [13] for more details). Owing to imperfections during postproduction, some sharpness mismatchbeyond common edge-sharpness mismatchcan still occur during 2D-to-3D conversion. Ex- amples appear in [3,5]. Our general-purpose sharpness-mismatch metric, however, lacks suﬃcient accuracy to properly capture the subtle edge-sharpness-mismatch issues that prevail in converted S3D movies. Thus, the diagrams in this section only include natively captured 3D ﬁlms.

See Sharpness Mismatch Examples in Our Previous Reports (889 pages and 1139 figures in reports dedicated to native S3D, 689 pages and 740 figures in reports dedicated to 2D-3D conversion) A lot of sharpness mismatch examples in captured movies (137 figures in total) and per-frame analysis charts can be found here: • MSU VQMT3D Report 1 (March 2013, 246 pages, 295 figures) [1] • MSU VQMT3D Report 2 (May 2013, 342 pages, 442 figures) [2] • MSU VQMT3D Report 4 (October 2013, 301 pages, 402 figures) [4] A lot of examples of edge-sharpness mismatch (155 figures in total) and several examples of general-case sharpness mismatch (22 figures in total) in 2D-3D conversion can be found here: • MSU VQMT3D Report 3 (August 2013, 305 pages, 336 figures) [3] • MSU VQMT3D Report 5 (April 2014, 384 pages, 404 figures) [5]

CS MSU Graphics & Media Lab 73 https://videoprocessing.ml/stereo_quality/ Sharpness Mismatch vs. Release Date

44 51 46 5 77 79 73 66 24 40 60 87 52 2 68 95 63 83 85 8 10 58 103 27 71 35 45 90 22 23 76 78 6 42

70 62 67 18 20 3 29 88 96 15 75 69 84 12 57 81 64 38 55 102 19 43

50 20 65 16 1 7 21

e 33% t 25

MSU-3DSharpness-2012 30

66%

Avatar 35 15 Reference lines Trend lines

Dec 1944Jun 1959Jan 1974Mar 1988Sep 2002Feb 2010Jun 2010Oct 2010Feb 2011Jun 2011Oct 2011Feb 2012Jun 2012Oct 2012Feb 2013Jun 2013Oct 2013Feb 2014 Release Date

Figure 2.30: Diagram illustrating sharpness mismatch metric value relative to release date Sharpness Mismatch vs. Release Date

44 51

5 46 77 79

66 24 40

87 52 60 63 2 68 95

83 85 8 58 103 10 71 35 27 45

23 76 90 22 6 78 42

70 67 18

20 3

r 88 96 29 e 69 t 15 75

e 84 57 12 B 81 64

38 102 55

MSU-3DSharpness-2012 43

50 33% Avatar 20 66% 65 Reference lines Trend lines 16 1 7

Dec 1944Jun 1959Jan 1974Mar 1988Sep 2002Feb 2010Jun 2010Oct 2010Feb 2011Jun 2011Oct 2011Feb 2012Jun 2012Oct 2012Feb 2013Jun 2013Oct 2013Feb 2014 Release Date

Figure 2.30a: Magniﬁed fragment of the diagram in Figure 2.30 Natively Captured 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 2: 47 Ronin (Dec 2013) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 6: Avatar (Dec 2009) 7: Bait (Sep 2012) 8: Battle of the Year (Sep 2013) 12: Cirque du Soleil: Journey of Man (May 2000) 15: Creature from the Black Lagoon (Mar 1954) 16: Dark Country (Oct 2009) 17: Dial M for Murder (May 1954) 18: Dolphin Tale (Sep 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 20: Dredd (Sep 2012) 21: Drive Angry (Feb 2011) 22: Final Destination 5 (Aug 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 24: Fright Night (Aug 2011) 27: Galapagos: The Enchanted Voyage (Oct 1999) 29: Ghosts of the Abyss (Apr 2003) 35: Hugo (Nov 2011) 38: Into the Deep (Nov 1994) 40: Jack the Giant Slayer (Mar 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 43: Journey to the Center of the Earth (Jul 2008) 44: Katy Perry: Part of Me (Jul 2012) 45: Legends of Flight (Jun 2011) 46: Life of Pi (Nov 2012) 50: My Bloody Valentine (Jan 2009) 51: One Direction: This Is Us (Aug 2013) 52: Oz the Great and Powerful (Mar 2013) 55: Pina (Feb 2011) 57: Piranha 3DD (May 2012) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 60: Prometheus (Jun 2012) 62: Resident Evil: Afterlife (Sep 2010) 63: Resident Evil: Retribution (Sep 2012) 64: Sanctum (Feb 2011) 65: Saw 3D: The Final Chapter (Oct 2010) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 67: Shark Night 3D (Sep 2011) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) 71: Spy Kids 3-D: Game Over (Jul 2003) 73: Stalingrad (Oct 2013) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012) Sharpness Mismatch vs. Movie Budget

51 44 46 5 77 79

73 66 24 40 87 60 52 63 2 68 95 8 83 85 58 10 103 71 35 33% 45 23 76 90 78 22 42 6

67 18 62 20 3 96 88 29 15 69 75 66% 57 84 81 64 55

19 43

e 50 t 20 65

e 1 16 7

B 21

MSU-3DSharpness-2012

Avatar 17 30 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.31: Diagram illustrating sharpness mismatch metric value relative to movie budget (per minute) Sharpness Mismatch vs. Movie Budget

51 44

5 46 77 79

24 66 40

52 87 60 63 2 68 95

8 83 85 103 58 10 71 35

90 33% 23 76 22 78 6 42

67 18 62

r 20 e 3

t 96 88 29 e 69 15 75

57 84

66% 81 64

MSU-3DSharpness-2012 55

19 43

50 Avatar 20 65 Reference lines Trend lines 16 1 7 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.31a: Magniﬁed fragment of the diagram in Figure 2.31 Natively Captured 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 2: 47 Ronin ($1470K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 6: Avatar ($1462K/min) 7: Bait ($301K/min) 8: Battle of the Year ($181K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 15: Creature from the Black Lagoon ($n/a K/min) 16: Dark Country ($45K/min) 17: Dial M for Murder ($13K/min) 18: Dolphin Tale ($327K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 20: Dredd ($520K/min) 21: Drive Angry ($480K/min) 22: Final Destination 5 ($434K/min) 23: Flying Swords of Dragon Gate ($286K/min) 24: Fright Night ($283K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 29: Ghosts of the Abyss ($213K/min) 35: Hugo ($1349K/min) 38: Into the Deep ($n/a K/min) 40: Jack the Giant Slayer ($1710K/min) 42: Journey 2: The Mysterious Island ($840K/min) 43: Journey to the Center of the Earth ($483K/min) 44: Katy Perry: Part of Me ($127K/min) 45: Legends of Flight ($66K/min) 46: Life of Pi ($944K/min) 50: My Bloody Valentine ($148K/min) 51: One Direction: This Is Us ($93K/min) 52: Oz the Great and Powerful ($1653K/min) 55: Pina ($40K/min) 57: Piranha 3DD ($60K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 60: Prometheus ($1048K/min) 62: Resident Evil: Afterlife ($618K/min) 63: Resident Evil: Retribution ($677K/min) 64: Sanctum ($277K/min) 65: Saw 3D: The Final Chapter ($222K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 67: Shark Night 3D ($277K/min) 68: Sharks 3D ($98K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) 73: Stalingrad ($229K/min) 75: Step Up 3D ($280K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min) Sharpness Mismatch Bar Chart

35 15

30 17

25 21 1 7 20 16 65 50 43 19 55 102 38 81 64 12 57 15 84 75 69 29 88 96 3

Avatar 20 18 62 67 70 6 42 78 22 76 23 90 45 27

10 71 35 MSU-3DSharpness-2012 58 8 103 85 83 95 68 2 63 60 52 87 40 66 24 5 73 77 79 46 51 44

Figure 2.32: Bar chart with movies sorted by average sharpness mismatch metric value in ascending order Sharpness Mismatch Stacked Bar Chart 100 1 7 3 8 6 2 71 81 51 21 12 16 18 19 17 15 70 52 76 77 79 73 78 84 62 50 90 38 96 75 88 64 57 60 58 83 87 66 35 85 63 95 68 67 22 69 55 24 20 65 29 27 23 42 40 44 46 43 45 102 103

40 Percentage of scenes Percentage

8.00 20.00 40.00 MSU-3DSharpness-2012

Figure 2.33: Stacked bar chart with movies sorted by the amount of low-technical-quality scenes Overall Comparison Charts Stereo Window Violation MSU Stereo-Film Quality Analysis Report 10

2.7 Stereo Window Violation

Figure 2.34: Schematic illustration of a stereo pair with stereo window violation

Our stereo-window-violation analysis comprises two metrics: stereo-window-placement comfort measured by MSU-StereoWindowComfort-2014 and quality of stereo-window-violation handling measured by MSU- StereoViolationHandling-2014. Both are dimensionless. The ﬁrst one aims to assess viewing comfort. It takes into account both average stereo-window-violation noticeability (which depends on the size and sharpness of the edge-violating object) and average depth distribution throughout the movie (we consider an imbalanced parallax range shifted toward positive values to be less comfortable). Thus, the metric penalizes ﬁlms that achieve low stereo-window-violation noticeability by placing nearly all the content behind the screen.

The second metric is more technical. We designed it to measure how well a given movie handles potentially problematic negative-parallax content. We consider both proper use of ﬂoating windows and placement of all negative-parallax content far from screen edges to be acceptable techniques. For both metrics this report provides three diagrams: one chart relative to movie-release date, one chart relative to movie budget and one bar chart with average metric values.

For more information on the negative eﬀects of stereo-window violation and use of ﬂoating windows, consult our sixth and seventh VQMT3D reports [6,7].

See Stereo Window Violation Examples in Our Previous Reports (748 pages and 803 figures in total) Numerous stereo window violation examples both in captured and converted movies and per-frame stereo window analysis charts can be found here: • MSU VQMT3D Report 6 (September 2014, 415 pages, 455 figures) [6] • MSU VQMT3D Report 7 (October 2014, 333 pages, 348 figures) [7]

CS MSU Graphics & Media Lab 82 https://videoprocessing.ml/stereo_quality/ Stereo Window Placement Comfort vs. Release Date

9 10 99 0 25 86 24 41 80 79 44 77 55 58 93 46 78 94 51 98 95 37 10342 48 63 33 8 36 33%17 102 16 88 66 31 52 39 54 73 90 62 81 59 14 67 3 60 87 40 30 21 10134 23 76 20 26 104 2 50 13 89 82 72 18 28 4 69 49 32 64 91 83 105 57 74 61 22 85 47 97 35 7 53 84 6 65 100 12 71 11 5 75 68 66% 43 1 15 29 100 92 56 70 19 96 45

200

t t 300

Natively Captured

2D-3D Conversion

CGI 400 MSU-StereoWindowComfort-2014 Avatar Hybrid (native+conversion) 38 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.35: Diagram illustrating stereo window placement comfort metric value relative to movie release date Stereo Window Placement Comfort vs. Release Date

0 99 9 10 25 41 86 24 80 44 77 79 93 46 51 63 78 55 37 103 48 33 94 8 58 95 42 54 36 88 59 31 17 102 66 98 30 90 52 39 73 87 20 67 40 33% 16 3 60 62 81 14 2 10134 72 23 20 50 21 76 104 26 13 89 82 4 28 69 64 18 32 105 83 57 49 91 74 22 47 61 85 97

7 40 53 35

r 100 e 65

t t 12 e 60 71 11

75 Natively Captured 5

2D-3D Conversion

68 CGI

MSU-StereoWindowComfort-2014 80 Avatar Hybrid (native+conversion) 43 1 Reference lines

29 66%15 Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.35a: Magniﬁed fragment of the diagram in Figure 2.35 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Stereo Window Placement Comfort vs. Movie Budget

0 99 9 10 25 41 44 24 86 80 77 79 51 46 93 55 78 63 37 103 33 94 48 8 95 36 42 54 58 33% 88 59 31 17 66 98 73 90 30 39 52 40 87 20 16 67 3 62 60 81 72 14 2 23 76 20 34 101 50 21 26 104 82 89 4 13 69 28 64 18 66% 32 105 57 83 49 91 74 22 61 47 85 97

40 7 53 35

84 6

60 11

r 75 5

t t 68

B 80 1 43

100 Natively Captured 2D-3D Conversion MSU-StereoWindowComfort-2014 CGI 96 19 Avatar Hybrid (native+conversion) 45 Reference lines 120 Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.36: Diagram illustrating stereo window placement comfort metric value relative to movie budget (per minute) Stereo Window Placement Comfort vs. Movie Budget

0 99 9 10 25 41 44 24 86 80 77 79 93 10 51 46 78 63 55 37 103 48 8 33 94 95 58 36 42 54 31 88 59 33%17 66 98 90 30 73 39 52 20 40 87 16 67 3 60 81 62 72 14 2 23 20 34 101 50 76 21 104 26 82 89 4 13 30 69 28 64 18 66% 32 105 57 83 74 49 91 22 61 47

85 97

r 40 7 53

e t 35

B 84

Natively Captured 60 71 11 2D-3D Conversion MSU-StereoWindowComfort-2014 CGI 75 Avatar Hybrid (native+conversion) 5 70 Reference lines Trend lines 68 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.36a: Magniﬁed fragment of the diagram in Figure 2.36 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Stereo Window Placement Comfort Bar Chart

Natively Captured 38 2D-3D Conversion Hybrid (native+conversion) 400 CGI

300

200 27 45 96 19 Avatar 70 56

100 92 15 29 1 43 68 5 MSU-StereoWindowComfort-2014 75 11 71 12 65 6 100 84 35 7 53 85 97 61 47 22 91 74 49 83 57 32 18 64 4 69 105 28 13 82 89 26 21 2 50 76 23 20 34 72 3 104 14 101 81 62 16 60 67 40 87 52 39 73 30 90 17 66 98 31 88 59 8 36 54 42 58 102 95 33 94 37 48 55 63 78 51 46 103 93 77 79 86 80 44 24 41 9 10 25 0 99

Figure 2.37: Bar chart with movies sorted by average stereo window placement comfort metric value in ascending order Stereo Window Placement Comfort Bar Chart (Logarithmic Scale) Natively Captured

2D-3D Conversion 38 Hybrid (native+conversion) CGI 27

2 45 96 19 10 70 56 92 15 29 1 43 68 5

Avatar 75 11 71 12 65 6 100 84 35 7 53 85 97 61 47 22 91 74 49 83 57 32 18 64 105 69 28 4 13 89 82 26 21 50 76 104 23 20 34 2 101 72 14 62 81 3 60 16 67 40 87 52 39 73 30 90 66 98 17 88 102 59 31 36 42 54 58 8 95 33 94 37 48 1 55 63 103 10 78 46 51 93 77 79 86 44 80 24 41 25 10 9 99 MSU-StereoWindowComfort-2014 (logarithmic scale) (logarithmic MSU-StereoWindowComfort-2014

Figure 2.37a: Bar chart with movies sorted by average stereo window placement comfort metric value in ascending order (logarithmic scale) Stereo Window Violation Handling vs. Release Date

102 9 41 51 99 0 33%17 25 77 86 55 10 24 79 8 73 59 37 28 48 44 63 36 88 66 58 31 34 93 42 80 87 33 52 94 30 16 95 46 40 39 90 49 23 60 54 2 62 32 21 98 72 3 76 104 50 82 103 105 78 74 13 81 22 18 83 4 20 47 97 101 14 35 57 85 5 64 7 69 26 61 84 53 6 100 91 75 92 11 67 12 66% 65 15 89 200 29 43 1 56

70 71 96

19 45 27 68 400

t t 600

Natively Captured

2D-3D Conversion

CGI

800 Hybrid (native+conversion) MSU-StereoViolationHandling-2014 Avatar 38 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.38: Diagram illustrating quality of stereo window violations handling metric value relative to movie release date Stereo Window Violation Handling vs. Release Date

0 99 9 41 102 51 25 55 24 17 77 86 10 79 8 44 73 37 63 59 48 33% 93 28 36 58 33 30 88 66 31 34 42 80 87 52 94 16 46 40 39 95 90 23 2 49 54 60 72 3 76 62 32 104 50 21 98 78 50 82 103 105 13 22 18 20 74 81 83 4 47 101 14 85 35 97 57 61 26 5 64 7 69

100 53 84

100

t 75 67 e 92 11

B 150

Natively Captured

2D-3D Conversion

89 CGI 66% 15 Hybrid (native+conversion) MSU-StereoViolationHandling-2014 43 Avatar 200 29 1 Reference lines Trend lines 56

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.38a: Magniﬁed fragment of the diagram in Figure 2.38 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Stereo Window Violation Handling vs. Movie Budget

99 0 51 9 41 17 55 24 25 86 77 79 44 8 73 63 59 10 37 93 48 33 28 36 30 58 33% 66 88 42 34 94 80 52 31 87 16 46 40 95 90 39 49 23 54 2 60 3 72 76 62 32 104 78 21 98 50 103 82 105 18 20 13 74 81 83 22 4 101 47 14 85 97 35 57 61 66% 26 69 64 7 5 100 84 53 6 91

75 67 11 92

65 89

43 1 29

200

r 56

300

Natively Captured 19 2D-3D Conversion 45 MSU-StereoViolationHandling-2014 CGI Avatar Hybrid (native+conversion) 68 Reference lines 400 Trend lines 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.39: Diagram illustrating quality of stereo window violations handling metric value relative to movie budget (per minute) Stereo Window Violation Handling vs. Movie Budget

0 99 51 9 41 55 25 17 24 86 77 8 10 79 44 73 63 59 37 93 48 33 28 36 30 58 66 42 94 80 31 87 88 34 52 33% 16 46 40 39 95 90 23 2 49 54 60 3 72 76 50 62 32 104 78 21 98 50 103 82 105 74 18 22 20 13 81 83 4 47 14 85 101 97 35 57 61 26 66% 69 64 7 5

100

r 53 84 e 6

e 91

67 11 92

150

Natively Captured 2D-3D Conversion MSU-StereoViolationHandling-2014 CGI 65 Avatar Hybrid (native+conversion) 89 Reference lines 43 Trend lines 200 1 29 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.39a: Magniﬁed fragment of the diagram in Figure 2.39 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Stereo Window Violation Handling Bar Chart

Natively Captured 38 2D-3D Conversion 800 Hybrid (native+conversion) CGI

700

600

500

400 68 27 45 19

300 96 71 70 Avatar 56 1 29 43 15

200 89 65 12 11 92 67 75 MSU-StereoViolationHandling-2014 91 6 100 84 53 5 7 64 100 69 26 61 57 4 97 35 14 85 47 101 81 83 18 22 13 20 74 82 50 103 105 21 78 3 98 32 62 72 76 104 60 2 49 54 23 90 95 39 16 46 40 52 88 31 34 66 94 80 87 42 58 30 33 28 36 93 48 59 8 37 63 44 73 10 79 77 86 17 24 9 55 25 51 41 102 0 99

Figure 2.40: Bar chart with movies sorted by average stereo window violation handling metric value in ascending order Stereo Window Violation Handling Bar Chart (Logarithmic Scale) 3 10 Natively Captured

2D-3D Conversion 38 Hybrid (native+conversion) CGI 68 27 45 19 96 71 70 56 1 29 43 15 89 65

Avatar 12 11 92 67 75

2 91 6 100

10 84 53 5 7 64 69 26 61 57 97 35 4 85 14 47 101 81 83 18 22 13 20 74 82 103 105 50 78 21 98 32 3 62 72 104 76 60 49 2 54 23 90 95 39 16 46 40 52 88 34 66 94 87 80 31 42 58 30 33 28 36 93 48 59 37 63 44 73 8 10 79

1 77 86 17 10 24 55 25 102 51 9 41

100 99 MSU-StereoViolationHandling-2014 (logarithmic scale) MSU-StereoViolationHandling-2014

Figure 2.40a: Bar chart with movies sorted by average stereo window violation handling metric value in ascending order (logarithmic scale) Overall Comparison Charts Temporal Shift MSU Stereo-Film Quality Analysis Report 10

2.8 Temporal Shift

Figure 2.41: Schematic illustration of a stereo pair with temporal shift

This section compares ﬁlms by the number and magnitude of temporal inconsistencies between views. We provide several metrics: cumulative duration of all scenes with temporal shifts (measured in seconds), maximum temporal shift throughout a movie (also measured in seconds) and an overall movie score that we compute as the sum of scores for individual scenes, each measured as the scene’s temporal-shift magnitude multiplied by its duration. We show several scatterplots and bar charts that compare movies according to these metrics, similar to the diagrams in previous sections.

More information on temporal shifts in S3D video and our automatic detection method is in our eighth VQMT3D report [8].

See Temporal Shift Examples in Our Previous Reports

Several examples of scenes with noticeable temporal shifts can be found here: • MSU VQMT3D Report 8 (June 2015, 366 pages, 361 ﬁgures) [8]

CS MSU Graphics & Media Lab 99 https://videoprocessing.ml/stereo_quality/ Maximum Temporal Shift Bar Chart

Natively Captured 16

2D-3D Conversion 71 0.08 Hybrid (native+conversion) CGI 81 0.06 96 17 15 56 20 42

0.04 75 55 Seconds 76 19 1

0.02 62 90 69 57

Avatar 21 7 67 50 88 3 35 23 58 8 9 6 2 5 4 11 31 91 51 61 41 12 10 14 13 18 72 70 74 32 52 82 92 77 78 79 30 34 73 80 84 94 36 54 33 37 38 39 86 98 99 53 59 60 64 83 87 89 93 97 66 63 68 85 95 22 24 65 26 27 28 29 25 40 44 46 43 47 48 49 45 101 102 100 104 103 0.00 105

Figure 2.42: Bar chart with movies sorted by maximum temporal shift value in ascending order Temporal Shift Duration Bar Chart

Natively Captured 15 2000 2D-3D Conversion Hybrid (native+conversion) CGI

1500

1000 Seconds

500 81 17

Avatar 1 19 21 67 50 7 16 88 69 71 58 3 62 8 9 6 2 5 42 4 23 57 20 35 11 90 76 96 55 31 51 91 61 75 41 56 12 10 14 13 18 72 70 74 32 52 82 92 77 78 79 30 34 73 36 54 80 84 94 86 33 37 38 39 53 59 60 64 83 87 89 93 97 98 99 66 63 68 85 95 22 65 24 26 27 28 29 25 40 44 46 43 47 48 49 45 101 102 100 104 103 0 105

Figure 2.43: Bar chart with movies sorted by total duration of scenes with temporal shift in ascending order Temporal Shift Score Bar Chart

Natively Captured 15 2D-3D Conversion 16 Hybrid (native+conversion) CGI

6 MSU-TS-Score-2014

4 81

Avatar 1 19

2 16 17 71 67 50 21 20 69 7 88 96 62 55 42 3 56 8 9 6 2 5 4 57 90 75 76 11 58 23 35 31 91 51 61 41 12 10 14 13 18 72 70 74 32 52 82 92 30 34 73 77 78 79 80 84 94 36 54 86 33 37 38 39 53 59 60 64 83 87 89 93 97 98 99 66 63 68 85 95 22 24 65 26 27 28 29 25 40 44 46 43 47 48 49 45 101 102 104 100 103 0 105

Figure 2.44: Bar chart with movies sorted by temporal shift score in ascending order Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Temporal Shift Score vs. Release Date

38 1022712702992 494368925846 5 13 89 7511 56 65 827732 86 6664 985958 453110134109322142472 18 9533735912383 103 28 41 10510080 486079444 76 63 7 46 87 78 33 4052 26 398574 471045361979454 51 8 3073 99 2 9036 0 88 96 62 55 42 57 50 21 69 50% 71 67 20 17 16 19 1

80%

MSU-TS-Score-2014

Natively Captured

2D-3D Conversion

CGI

Avatar Hybrid (native+conversion) 15 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.45: Diagram illustrating temporal shift score relative to movie release date Temporal Shift Score vs. Release Date

0.00 38 1022712702992 494368925846 5 13 89 11 65 827732 86 6664 9859 453110134109322142472 18 95 37 9183 103 28 41 10510080 486079444 63 46 87 78 33 4052 26 398574 471045361979454 51 8 3073 99 2 36 3

0.05 58 23 76

75 90 57 0.10 56

42 0.15 55 62

7 0.20 88

t t 0.25 50%

e 80%

MSU-TS-Score-2014

Natively Captured 0.30

2D-3D Conversion

CGI

Hybrid (native+conversion) 0.35 Avatar 69 21 20 Reference lines Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.45a: Magniﬁed fragment of the diagram in Figure 2.45 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Temporal Shift Score vs. Film Budget

50% 45 516849786644 8 2936573 6424 72 1883 22 43 84 33 28 14 4 6337955936 85 103 9154 469734 9486 1160 93 30 10 1326 101 9832 617782 74538962 105993980 947 1049252 792540 31 5 41 87 48 0.0 75 23 76 35 58 57 90 56 42 55 62 96 88 7

69 21 20

50 0.5 67 71

1.0 80%

17 1.5 16

r 2.0

e 1

2.5

MSU-TS-Score-2014

3.0 Natively Captured 2D-3D Conversion CGI Avatar Hybrid (native+conversion) 3.5 81 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.46: Diagram illustrating temporal shift score relative to movie budget (per minute) Temporal Shift Score vs. Film Budget

0.00 45 516849786644 8 296573 6424 72 1883 22 43 84 33 28 14 4 6337955936 85 103 9154 469734 9486 1160 93 30 10 1326 101 9832 617782 74538962 105993980 947 1049252 792540 31 5 41 87 48 3

0.05 23 76 58 50% 75 90 57 0.10 56

42 0.15 55 62

0.20 7 r 88

0.25

MSU-TS-Score-2014

0.30 Natively Captured 80% 2D-3D Conversion CGI 0.35 69 Avatar Hybrid (native+conversion) 21 20 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.46a: Magniﬁed fragment of the diagram in Figure 2.46 Overall Comparison Charts Channel Mismatch MSU Stereo-Film Quality Analysis Report 10

2.9 Channel Mismatch

Figure 2.47: Schematic illustration of channel mismatch

A relatively rare but potentially annoying artifact is channel mismatchthe swapping of left and right views in stereoscopic video. The swap can be complete or it can be partial, meaning only some objects in the scene have improper depth values. We compare movies by the cumulative duration of all scenes containing channel mismatch and by channel-mismatch noticeability. To measure noticeability we con- ducted a subjective test with over 50 participants, who assessed each individual scene on a scale from 1 (channel mismatch is imperceptible) to 5 (channel mismatch is extremely annoying). We also computed the overall movie score in a manner similar to how we computed temporal shift (for all scenes with channel mismatch, we ﬁnd the product of each scene’s duration and channel-mismatch noticeability and then sum these products).

For more details on channel mismatch and our automatic-detection approach, consult the eighth VQMT3D report [8].

See Channel Mismatch Examples in Our Previous Reports Several examples of scenes with channel mismatch can be found here: • MSU VQMT3D Report 8 (June 2015, 366 pages, 361 ﬁgures) [8]

CS MSU Graphics & Media Lab 109 https://videoprocessing.ml/stereo_quality/ Average Channel Mismatch Perceptibility vs. Release Date

0 17 38 1022712702992 4943509192584 5 88 96 11 5662 7732 86 666455 985958 4531101 1093222467 18 37 2383 10342 41 10510080 57486079444 76 63 20 69 46 87 78 33 4052 26 398574 471045361979454 51 8 30 99 2 9036

95 28 89 6 13

75 14 91 7 35 2 65 16 81 21

r 3 34

t 73 72

t 82

86% Natively Captured

4 15

2D-3D Conversion

MSU-CM-Perceptibility-2014 94%

CGI

Avatar Hybrid (native+conversion) 68 Reference lines 5 Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.48: Diagram illustrating average perceptibility of detected channel mismatch relative to movie release date Average Channel Mismatch Perceptibility vs. Release Date

0.0 17 38 1022712702992 4943509192584 5 88 96 11 5662 7732 86 666455 985958 4531101 1093222467 18 37 2383 10342 41 10510080 57486079444 76 63 20 69 46 87 78 33 4052 26 398574 471045361979454 51 8 30 99 2 9036

0.5

1.0

r 28

e 89 t 1.5

t 6 13

14 91 7 Natively Captured

2D-3D Conversion 35 MSU-CM-Perceptibility-2014

2.0 CGI 65 16 Hybrid (native+conversion)

Avatar 81 21 Reference lines 94% 86% Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.48a: Magniﬁed fragment of the diagram in Figure 2.48 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Average Channel Mismatch Perceptibility vs. Film Budget

0 17 55 579645 5149786644881950 8 6929 5667642423 187683 22 43 2084 33 62 4 6337593690 85 103 4254 4697 9486 1160 93 30 10 26 101 9832 6177 7453 2 105993980 947 1049252 792540 31 585 41 87 48

95 28 89 6 13

75 7 14 91 2 35 65 16 81 21

86%

1 r 71

t t 3 34

e 94% 73 B 72

MSU-CM-Perceptibility-2014 4 Natively Captured 2D-3D Conversion CGI Avatar Hybrid (native+conversion) 68 Reference lines 5 Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.49: Diagram illustrating average perceptibility of detected channel mismatch relative to movie budget (per minute) Average Channel Mismatch Perceptibility vs. Film Budget

0.0 17 55 579645 5149786644881950 8 6929 5667642423 187683 22 43 2084 33 62 4 6337593690 85 103 4254 4697 9486 1160 93 30 10 26 101 9832 6177 7453 2 105993980 947 1049252 792540 31 585 41 87 48

0.5

1.0

r 95

t 28

t 89 e 1.5 B 6

75 14 7 91

MSU-CM-Perceptibility-2014 Natively Captured 35 2.0 2D-3D Conversion 65 CGI 16 Avatar Hybrid (native+conversion) 81 21 94% Reference lines 86% Trend lines 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.49a: Magniﬁed fragment of the diagram in Figure 2.49 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Average Channel Mismatch Perceptibility Bar Chart 5

Natively Captured 68 2D-3D Conversion Hybrid (native+conversion) CGI

4 15 82 72 73 34 3 71 1 3 21 81

Avatar 16 65

2 35 7 91 14 75 13 6 89 28 95 MSU-CM-Perceptibility-2014 1 8 9 2 5 4 11 31 51 61 41 12 10 17 18 19 70 74 32 92 52 76 77 78 79 30 54 62 80 84 90 94 36 50 96 33 37 38 39 56 86 53 57 58 59 60 64 83 87 88 93 97 98 99 66 55 63 67 69 85 22 24 20 26 23 27 29 25 42 40 44 46 43 47 48 49 45 101 102 100 104 103 0 105

Figure 2.50: Bar chart with movies sorted by average perceptibility of detected channel mismatch in ascending order Channel Mismatch Duration Bar Chart 60

Natively Captured 81 2D-3D Conversion Hybrid (native+conversion) CGI 50

30 91 Seconds 1

Avatar 71 35

10 68 65 89 16 15 28 73 6 72 34 82 14 7 75 3 13 21 95 8 9 2 5 4 11 31 51 61 41 12 10 17 18 19 32 70 74 92 52 76 30 77 78 79 54 62 80 84 90 94 36 50 56 86 96 33 37 38 39 53 57 58 59 60 64 83 87 88 93 97 98 99 66 85 22 55 63 67 69 20 24 26 23 27 29 25 42 40 44 46 43 47 48 49 45 101 102 100 104 103 0 105

Figure 2.51: Bar chart with movies sorted by total duration of scenes with channel mismatch in ascending order Channel Mismatch Score Bar Chart

Natively Captured 81 2D-3D Conversion 120 Hybrid (native+conversion) CGI

100

80 1 60 91 68

MSU-CM-Score-2014 40 71

Avatar 15 20 35 65 73 16 72 89 34 82 28 6 14 3 7 21 75 13 8 9 2 5 4 95 11 31 51 61 41 12 10 17 18 19 70 74 32 52 76 92 77 78 79 30 36 50 54 62 80 84 90 94 96 33 37 38 39 56 86 58 59 60 64 83 87 88 93 97 98 99 53 57 66 63 67 69 85 22 55 20 24 26 23 27 29 25 42 40 44 46 43 47 48 49 45 101 102 100 104 103 0 105

Figure 2.52: Bar chart with movies sorted by channel mismatch score in ascending order Overall Comparison Charts Crosstalk MSU Stereo-Film Quality Analysis Report 10

2.10 Crosstalk

Figure 2.53: Schematic illustration of a stereo pair with visible crosstalk

This section shows results from our movie comparison in terms of potential perceived crosstalk. The main idea is that the amount of perceived crosstalk depends not only on the viewing environment but also on the content. For example, high-contrast shots with a large depth budget tend to cause considerable discomfort owing to crosstalk.

Crosstalk-metric values are dimensionless and represent the strength of perceived crosstalk when the viewer sees the content on a crosstalk-prone S3D display. Higher values indicate greater perceived crosstalk. For more details on stereoscopic crosstalk and our metric, see the eighth VQMT3D report [8].

To compare movies by perceived crosstalk, we again use the now familiar four charts: two straightforward scatterplots illustrating average crosstalk values relative to movie-release date and budget, a bar chart with average crosstalk values, and a stacked bar chart illustrating the metric-value distributions for diﬀerent movies.

See Examples of Shots with Potentially High Crosstalk in Our Previous Reports Several examples of shots, where the crosstalk may cause signiﬁcant discomfort and crosstalk noticeability maps can be found here: • MSU VQMT3D Report 8 (June 2015, 366 pages, 361 ﬁgures) [8]

CS MSU Graphics & Media Lab 119 https://videoprocessing.ml/stereo_quality/ Crosstalk vs. Release Date

0 13 89 14 37 79 73 2 32 82 58 24 91 103 87 47 54 64 60 77 46 59 34 72 66 31 105 4 78 40 5 98 93 100 7 92 67 44 63 99 38 86 10110 28 30 11 41 39 12 42 80 20 104 27 19 36 6 22 69 94 43 62 65 83 25 88 95 97 18 3 52 26 56 8 1 33% 84 74 51 81 33 61 50 15 96 75 23

55 76 90 1 9 21 85 29 35 48 53 49 2 68 57

71 r 3 66%

t 70 17 e 45

MSU-Crosstalk-2014

Natively Captured

2D-3D Conversion

CGI

Avatar Hybrid (native+conversion) 102 Reference lines 5 Trend lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.54: Diagram illustrating crosstalk metric value relative to movie release date Crosstalk vs. Release Date 0.0

13 89 79 14 37 73 2

32 91 58 24 103 87 47 54 82 64 77 60 46 59 34 72 40 31 4 66 105 78 7 5 100 98 93 99 67 63 92 44 0.5 86 30 10 38 101 28 11 39 41 42 80 12 20 104 27 19 36 6 22 69 94 43 62 83 65 25 88 95 97 3 52

18 26

56 8

1.0

74 51 r 84 e 33% 81 t 33 61

t 50

e 15 75 23 96

MSU-Crosstalk-2014

Natively Captured

2D-3D Conversion 90 76 55 1.5 CGI 21 1 85 9 Hybrid (native+conversion) 29 Avatar 35 66% 48 Reference lines

Trend 53lines

Nov 1955May 1970Jul 1984Feb 1999Jan 2010May 2010Sep 2010Jan 2011May 2011Sep 2011Jan 2012May 2012Sep 2012Jan 2013May 2013Sep 2013Jan 2014May 2014 Release Date

Figure 2.54a: Magniﬁed fragment of the diagram in Figure 2.54 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011) Crosstalk vs. Movie Budget

0.0 13 79 73 14 37 89 2 24 91 32 103 54 82 47 58 87 64 60 77 59 46 34 72 40 78 66 4 31 7 105 5 63 93 98 44 67 99 0.5 86 30 92 28 10 101 11 39 41 42 80 20 104 36 19 22 6 69 94 43 65 83 62 25 33% 88 95 97 52 3 18 26 1.0 8 56 51 84 74 81 33 61 50 23 96 75

66% 90 1.5 55 76 1 21 85 9 29 35 48

r 2.0

t 57

2.5

MSU-Crosstalk-2014

71 3.0 Natively Captured 2D-3D Conversion CGI 17 Avatar Hybrid (native+conversion) 45 3.5 Reference lines Trend lines

0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.55: Diagram illustrating crosstalk metric value relative to movie budget (per minute) Crosstalk vs. Movie Budget 0.0

13 79 89 2 73 14 37

24 91 32 103 58 87 54 47 64 82 77 60 46 59 34 72 40 4 31 78 66 7 105 5 93 98 63 99 67 0.5 44 92 86 30 10 28 101 11 39 41 42 80 20 104 36 19 22 6 69 94

43 83 62 65

88 25 95 33% 97 3 52 18 26

r 1.0 8 56 e

t 51 t 84 74

e 81 B 33 61

23 MSU-Crosstalk-2014 75

Natively Captured

90 66% 76 2D-3D Conversion 1.5 55 CGI 1 21 85 9 Hybrid (native+conversion) 29 Avatar 35 Reference lines 48 Trend lines 53 0 250 500 750 1000 1250 1500 1750 2000 Budget per Minute ($1000)

Figure 2.55a: Magniﬁed fragment of the diagram in Figure 2.55 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Crosstalk Bar Chart Natively Captured

2D-3D Conversion 102 Hybrid (native+conversion) CGI 4 45 17 70 3 71 16

2 57 68 49 53 48 35 9 29 MSU-Crosstalk-2014 1 85 21 55 76 90 96 75 23 15 50 61 33 81 84 1 51 74 8 56 3 18 26 Avatar 52 97 95 88 25 65 62 83 43 69 94 6 22 19 36 27 12 20 104 80 42 41 11 39 28 38 10 101 30 86 92 44 67 63 99 93 5 98 7 4 100 78 66 31 105 40 72 59 34 46 60 77 64 82 47 54 87 58 24 91 32 103 2 37 73 14 89 13 0 79

Figure 2.56: Bar chart with movies sorted by average crosstalk metric value in ascending order Crosstalk Stacked Bar Chart 100 1 7 3 8 9 6 2 5 4 11 71 31 91 51 81 61 21 41 12 14 10 16 19 18 17 13 15 72 74 70 32 82 92 52 76 73 79 30 77 34 78 36 84 90 50 54 80 94 62 37 38 86 39 56 75 96 33 89 87 60 93 58 64 59 99 98 88 97 83 53 57 35 66 63 67 95 22 69 55 85 68 20 65 24 26 28 27 23 29 25 42 40 44 46 47 43 48 49 45 101 102 100 104 103 105

40 Percentage of scenes Percentage

0.10 1.50 5.00 MSU-Crosstalk-2014

Figure 2.57: Stacked bar chart with movies sorted by the amount of scenes with potentially noticeable crosstalk Overall Comparison Charts Average Brightness MSU Stereo-Film Quality Analysis Report 10

2.11 Average Brightness

Figure 2.58: Illustration of diﬀerence in average brightness for selected movies. Each image represents an an average of all frames in the respective movie.

Films with many dark scenes tend to induce additional viewer fatigue. This problem is especially common in S3D content, as most stereoscopic-display technologies reduce the image’s perceived brightness con- siderably. Therefore, comparing movies by average brightness is helpful even though brightness usually depends on creative choices made throughout the ﬁlm.

Our brightness comparison employs the same four charts as the previous section (Crosstalk). To measure this characteristic we use luminance values normalized from 0 (completely black frame) to 255 (completely white frame).

CS MSU Graphics & Media Lab 128 https://videoprocessing.ml/stereo_quality/

Luminance 100 40 20 60 80 Nov 1955

33% 66% 15 May 1970 17

Jul 1984

iue25:Darmilsrtn vrg rgtesvlerltv omverlaedate release movie to relative value brightness average illustrating Diagram 2.59: Figure Feb 1999 38

Jan 2010 102 27 12 70 29 71 92 49 43 68 50 9 19 25 84 16 6 May 2010 Avatar Average Brightnessvs.ReleaseDate 5 13 Sep 2010 88 89 96 11 75 56

Jan 2011 62 81 65 Release Date 82 77

May 2011 32 86 66 64 55 21

Sep 2011 1 98 59 58 45 31 101 34 10 93 22 24 72 14

Jan 2012 67 18 95 3 37 35 91 May 2012 23 83 103 42 28 41 105 100 80 Sep 2012 57 48 60 79 4 44 76

Jan 2013 63 7 20 69 46

May 2013 87 78 33 40 52 26

Sep 2013 Trend lines Reference lines Hybrid (native+conversion) CGI 2D-3D Conversion Natively Captured 39 85 74 47 104 53 61 97 94 54

Jan 2014 51 8 30 73 99

May 2014 2 90 36 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy (Apr 2011) 4: Abraham Lincoln: Vampire Hunter (Jun 2012) 2: 47 Ronin (Dec 2013) 5: Alice in Wonderland (Mar 2010) 3: A Very Harold & Kumar 3D Christmas (Nov 2011) 10: Captain America: The First Avenger (Jul 2011) 6: Avatar (Dec 2009) 11: Cats & Dogs: The Revenge of Kitty Galore (Jul 2010) 7: Bait (Sep 2012) 13: Clash of the Titans (Apr 2010) 8: Battle of the Year (Sep 2013) 14: Conan the Barbarian (Aug 2011) 12: Cirque du Soleil: Journey of Man (May 2000) 25: G-Force (Jul 2009) 15: Creature from the Black Lagoon (Mar 1954) 26: G.I. Joe: Retaliation (Mar 2013) 16: Dark Country (Oct 2009) 28: Ghost Rider: Spirit of Vengeance (Feb 2012) 17: Dial M for Murder (May 1954) 30: Gravity (Oct 2013) 18: Dolphin Tale (Sep 2011) 31: Green Lantern (Jun 2011) 19: Dolphins and Whales 3D: Tribes of the Ocean (Jun 2009) 32: Gulliver’s Travels (Dec 2010) 20: Dredd (Sep 2012) 34: Harry Potter and the Deathly Hallows: Part 2 (Jul 2011) 21: Drive Angry (Feb 2011) 36: I, Frankenstein (Jan 2014) 22: Final Destination 5 (Aug 2011) 37: Immortals (Nov 2011) 23: Flying Swords of Dragon Gate (Dec 2011) 39: Iron Man 3 (May 2013) 24: Fright Night (Aug 2011) 41: John Carter (Mar 2012) 27: Galapagos: The Enchanted Voyage (Oct 1999) 47: Man of Steel (Jun 2013) 29: Ghosts of the Abyss (Apr 2003) 48: Men in Black 3 (May 2012) 35: Hugo (Nov 2011) 49: Mummies: Secrets of the Pharaohs (May 2007) 38: Into the Deep (Nov 1994) 53: Paciﬁc Rim (Jul 2013) 40: Jack the Giant Slayer (Mar 2013) 54: Percy Jackson: Sea of Monsters (Aug 2013) 42: Journey 2: The Mysterious Island (Feb 2012) 56: Piranha 3D (Aug 2010) 43: Journey to the Center of the Earth (Jul 2008) 59: Priest (May 2011) 44: Katy Perry: Part of Me (Jul 2012) 61: R.I.P.D. (Jul 2013) 45: Legends of Flight (Jun 2011) 72: Spy Kids: All the Time in the World in 4D (Aug 2011) 46: Life of Pi (Nov 2012) 74: Star Trek Into Darkness (May 2013) 50: My Bloody Valentine (Jan 2009) 80: The Avengers (Apr 2012) 51: One Direction: This Is Us (Aug 2013) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader (Dec 2010) 52: Oz the Great and Powerful (Mar 2013) 86: The Green Hornet (Jan 2011) 55: Pina (Feb 2011) 89: The Last Airbender (Jul 2010) 57: Piranha 3DD (May 2012) 91: The Nutcracker in 3D (Dec 2011) 58: Pirates of the Caribbean: On Stranger Tides (May 2011) 93: The Smurfs (Jul 2011) 60: Prometheus (Jun 2012) 94: The Smurfs 2 (Jul 2013) 62: Resident Evil: Afterlife (Sep 2010) 97: The Wolverine (Jul 2013) 63: Resident Evil: Retribution (Sep 2012) 98: Thor (May 2011) 64: Sanctum (Feb 2011) 99: Thor: The Dark World (Nov 2013) 65: Saw 3D: The Final Chapter (Oct 2010) 100: Titanic (Apr 2012) 66: Sea Rex 3D: Journey to a Prehistoric World (Feb 2011) 104: World War Z (Jun 2013) 67: Shark Night 3D (Sep 2011) 105: Wrath of the Titans (Mar 2012) 68: Sharks 3D (Nov 2008) 69: Silent Hill: Revelation 3D (Oct 2012) 70: Space Station 3D (Apr 2002) CGI 71: Spy Kids 3-D: Game Over (Jul 2003) 9: Bolt (Nov 2008) 73: Stalingrad (Oct 2013) 92: The Polar Express (Nov 2004) 75: Step Up 3D (Aug 2010) 76: Step Up Revolution (Jul 2012) 77: TRON: Legacy (Dec 2010) 78: Texas Chainsaw 3D (Jan 2013) 79: The Amazing Spiderman (Jun 2012) 81: The Child’s Eye (Oct 2010) 83: The Darkest Hour (Dec 2011) 84: The Final Destination (Aug 2009) 85: The Great Gatsby (May 2013) 87: The Hobbit: An Unexpected Journey (Dec 2012) 88: The Hole (Jun 2010) 90: The Legend of Hercules (Jan 2014) 95: The Three Musketeers (Oct 2011) 96: The Ultimate Wave Tahiti (Jul 2010) 102: Ultimate G’s (Jan 2000) 103: Underworld: Awakening (Jan 2012)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters (Jan 2013) 101: Transformers: Dark of the Moon (Jun 2011)

Luminance 100 40 20 60 80

33% 66% 0 17 1 55 16 81 57 96 45 51 68 49 78 66 44 88 19 50 8 69 iue26:Darmilsrtn vrg rgtesvlerltv omvebde prminute) (per budget movie to relative value brightness average illustrating Diagram 2.60: Figure 3 65 29 250 73 56 67 64 75 24 23 7 72 18 76 83 22 71 500 21 43 20 84 Average Brightnessvs.MovieBudget 33 28 62 14 4 63 95 37 59 36 90 750 Budget per Minute($1000) 85 103 91 42 54 46 97 34 1000 94 86 11 60 93 30 10 13 26 1250 101 98 32 35 61 77 82 74 53 89 1500 6 Avatar 2 105 99 39 80 9 47 104 92 52 79 25 40 1750 31 Trend lines Reference lines Hybrid (native+conversion) CGI 2D-3D Conversion Natively Captured 58 5 41 87 2000 48 Natively Captured 2D-3D Conversion 1: 3-D Sex and Zen: Extreme Ecstasy ($22K/min) 4: Abraham Lincoln: Vampire Hunter ($657K/min) 2: 47 Ronin ($1470K/min) 5: Alice in Wonderland ($1851K/min) 3: A Very Harold & Kumar 3D Christmas ($211K/min) 10: Captain America: The First Avenger ($1129K/min) 6: Avatar ($1462K/min) 11: Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 7: Bait ($301K/min) 13: Clash of the Titans ($1179K/min) 8: Battle of the Year ($181K/min) 14: Conan the Barbarian ($619K/min) 12: Cirque du Soleil: Journey of Man ($n/a K/min) 25: G-Force ($1704K/min) 15: Creature from the Black Lagoon ($n/a K/min) 26: G.I. Joe: Retaliation ($1181K/min) 16: Dark Country ($45K/min) 28: Ghost Rider: Spirit of Vengeance ($593K/min) 17: Dial M for Murder ($13K/min) 30: Gravity ($1098K/min) 18: Dolphin Tale ($327K/min) 31: Green Lantern ($1769K/min) 19: Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 32: Gulliver’s Travels ($1317K/min) 20: Dredd ($520K/min) 34: Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 21: Drive Angry ($480K/min) 36: I, Frankenstein ($698K/min) 22: Final Destination 5 ($434K/min) 37: Immortals ($681K/min) 23: Flying Swords of Dragon Gate ($286K/min) 39: Iron Man 3 ($1526K/min) 24: Fright Night ($283K/min) 41: John Carter ($1893K/min) 27: Galapagos: The Enchanted Voyage ($n/a K/min) 47: Man of Steel ($1573K/min) 29: Ghosts of the Abyss ($213K/min) 48: Men in Black 3 ($2122K/min) 35: Hugo ($1349K/min) 49: Mummies: Secrets of the Pharaohs ($102K/min) 38: Into the Deep ($n/a K/min) 53: Paciﬁc Rim ($1450K/min) 40: Jack the Giant Slayer ($1710K/min) 54: Percy Jackson: Sea of Monsters ($849K/min) 42: Journey 2: The Mysterious Island ($840K/min) 56: Piranha 3D ($272K/min) 43: Journey to the Center of the Earth ($483K/min) 59: Priest ($689K/min) 44: Katy Perry: Part of Me ($127K/min) 61: R.I.P.D. ($1354K/min) 45: Legends of Flight ($66K/min) 72: Spy Kids: All the Time in the World in 4D ($306K/min) 46: Life of Pi ($944K/min) 74: Star Trek Into Darkness ($1439K/min) 50: My Bloody Valentine ($148K/min) 80: The Avengers ($1538K/min) 51: One Direction: This Is Us ($93K/min) 82: The Chronicles of Narnia: The Voyage of the Dawn Treader 52: Oz the Great and Powerful ($1653K/min) ($1371K/min) 55: Pina ($40K/min) 86: The Green Hornet ($1008K/min) 57: Piranha 3DD ($60K/min) 89: The Last Airbender ($1456K/min) 58: Pirates of the Caribbean: On Stranger Tides ($1838K/min) 91: The Nutcracker in 3D ($833K/min) 60: Prometheus ($1048K/min) 93: The Smurfs ($1067K/min) 62: Resident Evil: Afterlife ($618K/min) 94: The Smurfs 2 ($1000K/min) 63: Resident Evil: Retribution ($677K/min) 97: The Wolverine ($952K/min) 64: Sanctum ($277K/min) 98: Thor ($1304K/min) 65: Saw 3D: The Final Chapter ($222K/min) 99: Thor: The Dark World ($1517K/min) 66: Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 100: Titanic ($n/a K/min) 67: Shark Night 3D ($277K/min) 104: World War Z ($1637K/min) 68: Sharks 3D ($98K/min) 105: Wrath of the Titans ($1515K/min) 69: Silent Hill: Revelation 3D ($210K/min) 70: Space Station 3D ($n/a K/min) 71: Spy Kids 3-D: Game Over ($464K/min) CGI 73: Stalingrad ($229K/min) 9: Bolt ($1562K/min) 75: Step Up 3D ($280K/min) 92: The Polar Express ($1650K/min) 76: Step Up Revolution ($333K/min) 77: TRON: Legacy ($1360K/min) 78: Texas Chainsaw 3D ($108K/min) 79: The Amazing Spider-Man ($1691K/min) 81: The Child’s Eye ($46K/min) 83: The Darkest Hour ($337K/min) 84: The Final Destination ($524K/min) 85: The Great Gatsby ($739K/min) 87: The Hobbit: An Unexpected Journey ($1914K/min) 88: The Hole ($129K/min) 90: The Legend of Hercules ($707K/min) 95: The Three Musketeers ($681K/min) 96: The Ultimate Wave Tahiti ($65K/min) 102: Ultimate G’s ($n/a K/min) 103: Underworld: Awakening ($786K/min)

Hybrid (Native+Conversion) 33: Hansel & Gretel: Witch Hunters ($568K/min) 101: Transformers: Dark of the Moon ($1266K/min) Average Brightness Bar Chart 100 Natively Captured 32

49 2D-3D Conversion Hybrid (native+conversion) 1 71 CGI 96 56 105 76 102

80 23 46 44 95 70 45 67 9 4 51 82 57 72 97 26 47 40 74 18 62 41 94 84 15 21 22 63 12 93 42 48 61 52 3 10 85 27 13 104 2

60 11 75 78 28 53 7 43 20 Avatar 101 100 90 38 98 29 69 6 8 55 30 65 89 33 86 83 91 5 19 14 17 80 36 68 99 87 58 81 Luminance 59 25

40 66 60 35 88 34 79 54 50 39 31 64 37 77 73 92 24 103 20 16

Figure 2.61: Bar chart with movies sorted by average brightness value in descending order Brightness Stacked Bar Chart 100 1 7 3 8 9 6 5 2 4 11 71 31 91 81 51 61 21 41 12 10 14 16 17 19 13 18 15 72 32 70 74 92 52 76 82 30 73 79 77 34 78 94 36 62 84 50 54 90 80 33 56 86 38 39 37 75 96 99 87 57 58 89 60 83 64 98 88 59 97 53 93 35 66 63 67 22 95 68 55 85 69 20 65 24 26 27 28 23 29 25 42 44 40 46 49 47 48 43 45 101 102 104 100 103 105

40 Percentage of scenes Percentage

90.00 50.00 16.00 Luminance

Figure 2.62: Stacked bar chart with movies sorted by the amount of relatively dark scenes Chapter 3

Movie Ratings

Next we present movie ratings in several categories. For each metric we include the following categories: • Three budget ranges (low-budget, mid-budget and high-budget movies) • Four release-date ranges • One overall category • Two trade-off categories one for movie budget and one for release date In this section we exclude metrics for which the proper movie ranking is arguable or unclear: depth budget, depth continuity, temporal shift, channel mismatch, crosstalk and average brightness. Depending on the metric, we may include additional categories for natively captured films only. Most categories rank movies in a straightforward way. For the trade-off categories we rank them on the basis of proximity to the optimum point (Figure 3.1 shows an example).

gggg g

Figure 3.1: Schematic illustration of how movies are ranked in the trade-oﬀ categories. The points are numbered corre- spondingly

The section concludes with the same set of categories, but it combines all relevant metrics (vertical parallax, scale/rotation mismatch, color mismatch and sharpness mismatch). Ratings in these categories are based on the average rank for the corresponding categories of diﬀerent metrics. Movie Ratings Vertical Parallax MSU Stereo-Film Quality Analysis Report 10

3.1 Vertical Parallax

3.1.1 Budget Categories

Top 10 Best Movies with Smallest Vertical Parallax (budget < $300K/min) 1. Stalingrad ($229K/min) Natively Captured 2. Piranha 3D ($272K/min) 3. Mummies: Secrets of the Pharaohs ($102K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. One Direction: This Is Us ($93K/min) Hybrid 6. Saw 3D: The Final Chapter ($222K/min) Budget/min 7. Texas Chainsaw 3D ($108K/min) 8. A Very Harold & Kumar 3D Christmas ($211K/min) 9. Flying Swords of Dragon Gate ($286K/min) 10. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 0.00 0.05 0.10 0.15 Permil of screen width

Figure 3.2: Diagram with top 10 best movies in terms of vertical parallax with budgets less than $300K/minute

Top 10 Best Movies with Smallest Vertical Parallax ($300 budget $1000K/min) 1. The Wolverine ($952K/min) Natively Captured 2. The Smurfs 2 ($1000K/min) 3. Abraham Lincoln: Vampire Hunter ($657K/min) 2D-3D Conversion 4. I, Frankenstein ($698K/min) CGI 5. Immortals ($681K/min) Hybrid 6. Percy Jackson: Sea of Monsters ($849K/min) Budget/min 7. Conan the Barbarian ($619K/min) 8. Ghost Rider: Spirit of Vengeance ($593K/min) 9. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 10. Priest ($689K/min) 0.0000 0.0005 0.0010 0.0015 0.0020 0.0025 0.0030 0.0035 Permil of screen width

Figure 3.3: Diagram with top 10 best movies in terms of vertical parallax with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Movies with Smallest Vertical Parallax (budget > $1000K/min) 1. The Last Airbender ($1456K/min) Natively Captured 2. Man of Steel ($1573K/min) 3. Wrath of the Titans ($1515K/min) 2D-3D Conversion 4. Thor: The Dark World ($1517K/min) CGI 5. Iron Man 3 ($1526K/min) Hybrid 6. World War Z ($1637K/min) Budget/min 7. John Carter ($1893K/min) 8. Captain America: The First Avenger ($1129K/min) 9. R.I.P.D. ($1354K/min) 10. Bolt ($1562K/min) 0.0000 0.0001 0.0002 0.0003 0.0004 0.0005 0.0006 0.0007 Permil of screen width

Figure 3.4: Diagram with top 10 best movies in terms of vertical parallax with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 136 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (budget < $300K/min) 1. Stalingrad ($229K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. One Direction: This Is Us ($93K/min) 4. Saw 3D: The Final Chapter ($222K/min) 5. Texas Chainsaw 3D ($108K/min) 6. A Very Harold & Kumar 3D Christmas ($211K/min) 7. Flying Swords of Dragon Gate ($286K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. Battle of the Year ($181K/min) 10. Sharks 3D ($98K/min) 0.00 0.05 0.10 0.15 0.20 0.25 Permil of screen width

Figure 3.5: Diagram with top 10 best natively captured movies in terms of vertical parallax with budgets less than $300K/minute Top 10 Best Natively Captured Movies with Smallest Vertical Parallax ($300 budget $1000K/min) 1. The Great Gatsby ($739K/min) Budget/min 2. Life of Pi ($944K/min) 3. Underworld: Awakening ($786K/min) 4. Spy Kids 3-D: Game Over ($464K/min) 5. Step Up Revolution ($333K/min) 6. The Legend of Hercules ($707K/min) 7. The Three Musketeers ($681K/min) 8. The Darkest Hour ($337K/min) 9. Dredd ($520K/min) 10. Resident Evil: Retribution ($677K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 Permil of screen width

Figure 3.6: Diagram with top 10 best natively captured movies in terms of vertical parallax with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (budget > $1000K/min) 1. Prometheus ($1048K/min) Budget/min 2. The Amazing Spider-Man ($1691K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. Oz the Great and Powerful ($1653K/min) 5. Avatar ($1462K/min) 6. 47 Ronin ($1470K/min) 7. TRON: Legacy ($1360K/min) 8. Jack the Giant Slayer ($1710K/min) 9. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 10. Hugo ($1349K/min) 0.00 0.05 0.10 0.15 Permil of screen width

Figure 3.7: Diagram with top 10 best natively captured movies in terms of vertical parallax with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 137 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.1.2 Release Date Categories

Top 10 Best Movies with Smallest Vertical Parallax (released in 2010 and earlier) 1. The Last Airbender ($1456K/min) Natively Captured 2. Bolt ($1562K/min) 3. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) 2D-3D Conversion 4. Alice in Wonderland ($1851K/min) CGI 5. Gulliver's Travels ($1317K/min) Hybrid 6. Clash of the Titans ($1179K/min) Budget/min 7. G-Force ($1704K/min) 8. Piranha 3D ($272K/min) 9. The Polar Express ($1650K/min) 10. Mummies: Secrets of the Pharaohs ($102K/min) 0.000 0.005 0.010 0.015 0.020 Permil of screen width

Figure 3.8: Diagram with top 10 best movies in terms of vertical parallax released in 2010 and earlier

Top 10 Best Movies with Smallest Vertical Parallax (released in 2011) 1. Captain America: The First Avenger ($1129K/min) Natively Captured 2. Green Lantern ($1769K/min) 3. Immortals ($681K/min) 2D-3D Conversion 4. The Smurfs ($1067K/min) CGI 5. Conan the Barbarian ($619K/min) Hybrid 6. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) Budget/min 7. Thor ($1304K/min) 8. Priest ($689K/min) 9. The Nutcracker in 3D ($833K/min) 10. The Green Hornet ($1008K/min) 0.000 0.002 0.004 0.006 0.008 0.010 0.012 0.014 Permil of screen width

Figure 3.9: Diagram with top 10 best movies in terms of vertical parallax released in 2011 Top 10 Best Movies with Smallest Vertical Parallax (released in 2012) 1. Wrath of the Titans ($1515K/min) Natively Captured 2. John Carter ($1893K/min) 3. Abraham Lincoln: Vampire Hunter ($657K/min) 2D-3D Conversion 4. The Avengers ($1538K/min) CGI 5. Ghost Rider: Spirit of Vengeance ($593K/min) Hybrid 6. Men in Black 3 ($2122K/min) Budget/min 7. Titanic ($n/a K/min) 8. Prometheus ($1048K/min) 9. Katy Perry: Part of Me ($127K/min) 10. The Amazing Spider-Man ($1691K/min) 0.000 0.005 0.010 0.015 0.020 Permil of screen width

Figure 3.10: Diagram with top 10 best movies in terms of vertical parallax released in 2012

CS MSU Graphics & Media Lab 138 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Vertical Parallax (released in 2013 and early 2014) 1. Man of Steel ($1573K/min) Natively Captured 2. The Wolverine ($952K/min) 3. The Smurfs 2 ($1000K/min) 2D-3D Conversion 4. Thor: The Dark World ($1517K/min) CGI 5. Iron Man 3 ($1526K/min) Hybrid 6. World War Z ($1637K/min) Budget/min 7. R.I.P.D. ($1354K/min) 8. I, Frankenstein ($698K/min) 9. Star Trek Into Darkness ($1439K/min) 10. Percy Jackson: Sea of Monsters ($849K/min) 0.0000 0.0002 0.0004 0.0006 0.0008 0.0010 0.0012 Permil of screen width

Figure 3.11: Diagram with top 10 best movies in terms of vertical parallax released in 2013 and early 2014 Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (released in 2010 and earlier) 1. Avatar ($1462K/min) Budget/min 2. Saw 3D: The Final Chapter ($222K/min) 3. TRON: Legacy ($1360K/min) 4. Spy Kids 3-D: Game Over ($464K/min) 5. Sharks 3D ($98K/min) 6. Resident Evil: Afterlife ($618K/min) 7. Space Station 3D ($n/a K/min) 8. The Final Destination ($524K/min) 9. Ghosts of the Abyss ($213K/min) 10. The Hole ($129K/min) 0.0 0.1 0.2 0.3 0.4 0.5 Permil of screen width

Figure 3.12: Diagram with top 10 best natively captured movies in terms of vertical parallax released in 2010 and earlier Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (released in 2011) 1. Pirates of the Caribbean: On Stranger Tides ($1838K/min) Budget/min 2. A Very Harold & Kumar 3D Christmas ($211K/min) 3. Hugo ($1349K/min) 4. Flying Swords of Dragon Gate ($286K/min) 5. The Three Musketeers ($681K/min) 6. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 7. The Darkest Hour ($337K/min) 8. Fright Night ($283K/min) 9. Legends of Flight ($66K/min) 10. Final Destination 5 ($434K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 Permil of screen width

Figure 3.13: Diagram with top 10 best natively captured movies in terms of vertical parallax released in 2011

CS MSU Graphics & Media Lab 139 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (released in 2012) 1. Prometheus ($1048K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. The Amazing Spider-Man ($1691K/min) 4. The Hobbit: An Unexpected Journey ($1914K/min) 5. Life of Pi ($944K/min) 6. Underworld: Awakening ($786K/min) 7. Step Up Revolution ($333K/min) 8. Dredd ($520K/min) 9. Resident Evil: Retribution ($677K/min) 10. Journey 2: The Mysterious Island ($840K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 Permil of screen width

Figure 3.14: Diagram with top 10 best natively captured movies in terms of vertical parallax released in 2012 Top 10 Best Natively Captured Movies with Smallest Vertical Parallax (released in 2013 and early 2014) 1. Stalingrad ($229K/min) Budget/min 2. Oz the Great and Powerful ($1653K/min) 3. One Direction: This Is Us ($93K/min) 4. The Great Gatsby ($739K/min) 5. 47 Ronin ($1470K/min) 6. Jack the Giant Slayer ($1710K/min) 7. Texas Chainsaw 3D ($108K/min) 8. The Legend of Hercules ($707K/min) 9. Battle of the Year ($181K/min)

0.00 0.05 0.10 0.15 0.20 Permil of screen width

Figure 3.15: Diagram with top 10 best natively captured movies in terms of vertical parallax released in 2013 and early 2014

CS MSU Graphics & Media Lab 140 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.1.3 Overall Categories

Top 10 Best Natively Captured Movies with Smallest Vertical Parallax 1. Stalingrad ($229K/min) Budget/min 2. Prometheus ($1048K/min) 3. Katy Perry: Part of Me ($127K/min) 4. The Amazing Spider-Man ($1691K/min) 5. The Hobbit: An Unexpected Journey ($1914K/min) 6. Oz the Great and Powerful ($1653K/min) 7. Avatar ($1462K/min) 8. One Direction: This Is Us ($93K/min) 9. The Great Gatsby ($739K/min) 10. 47 Ronin ($1470K/min) 0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 Permil of screen width

Figure 3.16: Diagram with top 10 best natively captured movies in terms of vertical parallax

RRRR R R R Top 10 Natively Captured Movies with Best Budget/Vertical Parallax Trade-off 1. Katy Perry: Part of Me ($127K/min) Budget/min 2. One Direction: This Is Us ($93K/min) 3. Stalingrad ($229K/min) 4. Texas Chainsaw 3D ($108K/min) 5. Saw 3D: The Final Chapter ($222K/min) 6. A Very Harold & Kumar 3D Christmas ($211K/min) 7. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 8. Step Up Revolution ($333K/min) 9. Flying Swords of Dragon Gate ($286K/min) 10. Spy Kids 3-D: Game Over ($464K/min) 0.00 0.05 0.10 0.15 Permil of screen width

Figure 3.17: Diagram with top 10 best natively captured movies in terms of budget/vertical parallax trade-oﬀ Top 10 Natively Captured Movies with Best Release Date/Vertical Parallax Trade-off 1. Spy Kids 3-D: Game Over ($464K/min, Jul 2003) Budget/min 2. Space Station 3D ($n/a K/min, Apr 2002) 3. Avatar ($1462K/min, Dec 2009) 4. Saw 3D: The Final Chapter ($222K/min, Oct 2010) 5. TRON: Legacy ($1360K/min, Dec 2010) 6. Sharks 3D ($98K/min, Nov 2008) 7. Pirates of the Caribbean: On Stranger Tides ($1838K/min, May 2011) 8. Prometheus ($1048K/min, Jun 2012) 9. The Amazing Spider-Man ($1691K/min, Jun 2012) 10. Katy Perry: Part of Me ($127K/min, Jul 2012) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 Permil of screen width

Figure 3.18: Diagram with top 10 best natively captured movies in terms of release date/vertical parallax trade-oﬀ

CS MSU Graphics & Media Lab 141 https://videoprocessing.ml/stereo_quality/ Movie Ratings Vertical Parallax: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Vertical Parallax 1. The Last Airbender ($1456K/min) Natively Captured 2. Man of Steel ($1573K/min) 3. The Wolverine ($952K/min) 2D-3D Conversion 4. The Smurfs 2 ($1000K/min) CGI 5. Wrath of the Titans ($1515K/min) Hybrid 6. Thor: The Dark World ($1517K/min) Budget/min 7. Iron Man 3 ($1526K/min) 8. World War Z ($1637K/min) 9. John Carter ($1893K/min) 10. Captain America: The First Avenger ($1129K/min) 0.0000 0.0001 0.0002 0.0003 0.0004 0.0005 Permil of screen width

Figure 3.19: Diagram with top 10 best movies in terms of vertical parallax RRRR R R R Top 10 Movies with Best Budget/Vertical Parallax Trade-off 1. Mummies: Secrets of the Pharaohs ($102K/min) Natively Captured 2. Katy Perry: Part of Me ($127K/min) 3. Stalingrad ($229K/min) 2D-3D Conversion 4. One Direction: This Is Us ($93K/min) CGI 5. Piranha 3D ($272K/min) Hybrid 6. Spy Kids: All the Time in the World in 4D ($306K/min) Budget/min 7. Saw 3D: The Final Chapter ($222K/min) 8. Texas Chainsaw 3D ($108K/min) 9. A Very Harold & Kumar 3D Christmas ($211K/min) 10. Hansel & Gretel: Witch Hunters ($568K/min) 0.00 0.02 0.04 0.06 0.08 0.10 0.12 0.14 0.16 Permil of screen width

Figure 3.20: Diagram with top 10 best movies in terms of budget/vertical parallax trade-oﬀ Top 10 Movies with Best Release Date/Vertical Parallax Trade-off 1. Spy Kids 3-D: Game Over ($464K/min, Jul 2003) Natively Captured 2. The Polar Express ($1650K/min, Nov 2004) 3. Mummies: Secrets of the Pharaohs ($102K/min, May 2007) 2D-3D Conversion 4. Bolt ($1562K/min, Nov 2008) CGI 5. G-Force ($1704K/min, Jul 2009) Hybrid 6. Avatar ($1462K/min, Dec 2009) Budget/min 7. Alice in Wonderland ($1851K/min, Mar 2010) 8. Clash of the Titans ($1179K/min, Apr 2010) 9. The Last Airbender ($1456K/min, Jul 2010) 10. Space Station 3D ($n/a K/min, Apr 2002) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 Permil of screen width

Figure 3.21: Diagram with top 10 best movies in terms of release date/vertical parallax trade-oﬀ

CS MSU Graphics & Media Lab 142 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch MSU Stereo-Film Quality Analysis Report 10

3.2 Scale Mismatch

3.2.1 Budget Categories

Top 10 Best Movies with Smallest Scale Mismatch (budget < $300K/min) 1. Stalingrad ($229K/min) Natively Captured 2. Mummies: Secrets of the Pharaohs ($102K/min) 3. Saw 3D: The Final Chapter ($222K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. Sharks 3D ($98K/min) Hybrid 6. Piranha 3D ($272K/min) Budget/min 7. One Direction: This Is Us ($93K/min) 8. Fright Night ($283K/min) 9. Battle of the Year ($181K/min) 10. Texas Chainsaw 3D ($108K/min) 0.00 0.01 0.02 0.03 0.04 0.05 Percent (x100)

Figure 3.22: Diagram with top 10 best movies in terms of scale mismatch with budgets less than $300K/minute

Top 10 Best Movies with Smallest Scale Mismatch ($300 budget $1000K/min) 1. The Wolverine ($952K/min) Natively Captured 2. The Smurfs 2 ($1000K/min) 3. I, Frankenstein ($698K/min) 2D-3D Conversion 4. Conan the Barbarian ($619K/min) CGI 5. Percy Jackson: Sea of Monsters ($849K/min) Hybrid 6. Immortals ($681K/min) Budget/min 7. Ghost Rider: Spirit of Vengeance ($593K/min) 8. Priest ($689K/min) 9. Abraham Lincoln: Vampire Hunter ($657K/min) 10. Spy Kids: All the Time in the World in 4D ($306K/min) 0.0000 0.0005 0.0010 0.0015 0.0020 0.0025 Percent (x100)

Figure 3.23: Diagram with top 10 best movies in terms of scale mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Movies with Smallest Scale Mismatch (budget > $1000K/min) 1. The Last Airbender ($1456K/min) Natively Captured 2. Thor: The Dark World ($1517K/min) 3. Men in Black 3 ($2122K/min) 2D-3D Conversion 4. Captain America: The First Avenger ($1129K/min) CGI 5. Man of Steel ($1573K/min) Hybrid 6. Wrath of the Titans ($1515K/min) Budget/min 7. Iron Man 3 ($1526K/min) 8. World War Z ($1637K/min) 9. Alice in Wonderland ($1851K/min) 10. Green Lantern ($1769K/min) 0.00000 0.00005 0.00010 0.00015 0.00020 0.00025 Percent (x100)

Figure 3.24: Diagram with top 10 best movies in terms of scale mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 143 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (budget < $300K/min) 1. Stalingrad ($229K/min) Budget/min 2. Saw 3D: The Final Chapter ($222K/min) 3. Katy Perry: Part of Me ($127K/min) 4. Sharks 3D ($98K/min) 5. One Direction: This Is Us ($93K/min) 6. Fright Night ($283K/min) 7. Battle of the Year ($181K/min) 8. Texas Chainsaw 3D ($108K/min) 9. A Very Harold & Kumar 3D Christmas ($211K/min) 10. Flying Swords of Dragon Gate ($286K/min) 0.00 0.01 0.02 0.03 0.04 0.05 0.06 Percent (x100)

Figure 3.25: Diagram with top 10 best natively captured movies in terms of scale mismatch with budgets less than $300K/minute Top 10 Best Natively Captured Movies with Smallest Scale Mismatch ($300 budget $1000K/min) 1. The Great Gatsby ($739K/min) Budget/min 2. Life of Pi ($944K/min) 3. Step Up Revolution ($333K/min) 4. Underworld: Awakening ($786K/min) 5. The Three Musketeers ($681K/min) 6. Resident Evil: Retribution ($677K/min) 7. Resident Evil: Afterlife ($618K/min) 8. The Legend of Hercules ($707K/min) 9. The Darkest Hour ($337K/min) 10. Final Destination 5 ($434K/min) 0.00 0.02 0.04 0.06 0.08 Percent (x100)

Figure 3.26: Diagram with top 10 best natively captured movies in terms of scale mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (budget > $1000K/min) 1. Prometheus ($1048K/min) Budget/min 2. The Amazing Spider-Man ($1691K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. Oz the Great and Powerful ($1653K/min) 5. 47 Ronin ($1470K/min) 6. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 7. Avatar ($1462K/min) 8. TRON: Legacy ($1360K/min) 9. Jack the Giant Slayer ($1710K/min) 10. Hugo ($1349K/min) 0.00 0.01 0.02 0.03 0.04 0.05 0.06 Percent (x100)

Figure 3.27: Diagram with top 10 best natively captured movies in terms of scale mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 144 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.2.2 Release Date Categories

Top 10 Best Movies with Smallest Scale Mismatch (released in 2010 and earlier) 1. The Last Airbender ($1456K/min) Natively Captured 2. Alice in Wonderland ($1851K/min) 3. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) 2D-3D Conversion 4. G-Force ($1704K/min) CGI 5. Gulliver's Travels ($1317K/min) Hybrid 6. Bolt ($1562K/min) Budget/min 7. Clash of the Titans ($1179K/min) 8. The Polar Express ($1650K/min) 9. Mummies: Secrets of the Pharaohs ($102K/min) 10. Saw 3D: The Final Chapter ($222K/min) 0.000 0.002 0.004 0.006 0.008 0.010 Percent (x100)

Figure 3.28: Diagram with top 10 best movies in terms of scale mismatch released in 2010 and earlier

Top 10 Best Movies with Smallest Scale Mismatch (released in 2011) 1. Captain America: The First Avenger ($1129K/min) Natively Captured 2. Green Lantern ($1769K/min) 3. Conan the Barbarian ($619K/min) 2D-3D Conversion 4. The Smurfs ($1067K/min) CGI 5. Immortals ($681K/min) Hybrid 6. Thor ($1304K/min) Budget/min 7. Priest ($689K/min) 8. Spy Kids: All the Time in the World in 4D ($306K/min) 9. The Nutcracker in 3D ($833K/min) 10. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 0.0000 0.0005 0.0010 0.0015 0.0020 0.0025 0.0030 0.0035 Percent (x100)

Figure 3.29: Diagram with top 10 best movies in terms of scale mismatch released in 2011 Top 10 Best Movies with Smallest Scale Mismatch (released in 2012) 1. Men in Black 3 ($2122K/min) Natively Captured 2. Titanic ($n/a K/min) 3. Wrath of the Titans ($1515K/min) 2D-3D Conversion 4. John Carter ($1893K/min) CGI 5. The Avengers ($1538K/min) Hybrid 6. Ghost Rider: Spirit of Vengeance ($593K/min) Budget/min 7. Abraham Lincoln: Vampire Hunter ($657K/min) 8. Prometheus ($1048K/min) 9. The Amazing Spider-Man ($1691K/min) 10. The Hobbit: An Unexpected Journey ($1914K/min) 0.000 0.001 0.002 0.003 0.004 0.005 0.006 0.007 Percent (x100)

Figure 3.30: Diagram with top 10 best movies in terms of scale mismatch released in 2012

CS MSU Graphics & Media Lab 145 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Scale Mismatch (released in 2013 and early 2014) 1. The Wolverine ($952K/min) Natively Captured 2. Thor: The Dark World ($1517K/min) 3. The Smurfs 2 ($1000K/min) 2D-3D Conversion 4. Man of Steel ($1573K/min) CGI 5. Iron Man 3 ($1526K/min) Hybrid 6. World War Z ($1637K/min) Budget/min 7. I, Frankenstein ($698K/min) 8. G.I. Joe: Retaliation ($1181K/min) 9. R.I.P.D. ($1354K/min) 10. Gravity ($1098K/min) 0.00000 0.00005 0.00010 0.00015 0.00020 0.00025 0.00030 0.00035 Percent (x100)

Figure 3.31: Diagram with top 10 best movies in terms of scale mismatch released in 2013 and early 2014 Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (released in 2010 and earlier) 1. Saw 3D: The Final Chapter ($222K/min) Budget/min 2. Sharks 3D ($98K/min) 3. Into the Deep ($n/a K/min) 4. Avatar ($1462K/min) 5. TRON: Legacy ($1360K/min) 6. Cirque du Soleil: Journey of Man ($n/a K/min) 7. Resident Evil: Afterlife ($618K/min) 8. Dolphins and Whales 3D: Tribes of the Ocean ($142K/min) 9. Ghosts of the Abyss ($213K/min) 10. Dial M for Murder ($13K/min) 0.00 0.02 0.04 0.06 0.08 0.10 Percent (x100)

Figure 3.32: Diagram with top 10 best natively captured movies in terms of scale mismatch released in 2010 and earlier Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (released in 2011) 1. Pirates of the Caribbean: On Stranger Tides ($1838K/min) Budget/min 2. Fright Night ($283K/min) 3. The Three Musketeers ($681K/min) 4. A Very Harold & Kumar 3D Christmas ($211K/min) 5. Flying Swords of Dragon Gate ($286K/min) 6. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 7. Hugo ($1349K/min) 8. Legends of Flight ($66K/min) 9. The Darkest Hour ($337K/min) 10. Final Destination 5 ($434K/min) 0.00 0.02 0.04 0.06 0.08 Percent (x100)

Figure 3.33: Diagram with top 10 best natively captured movies in terms of scale mismatch released in 2011

CS MSU Graphics & Media Lab 146 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (released in 2012) 1. Prometheus ($1048K/min) Budget/min 2. The Amazing Spider-Man ($1691K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. Katy Perry: Part of Me ($127K/min) 5. Life of Pi ($944K/min) 6. Step Up Revolution ($333K/min) 7. Underworld: Awakening ($786K/min) 8. Resident Evil: Retribution ($677K/min) 9. Dredd ($520K/min) 10. Journey 2: The Mysterious Island ($840K/min) 0.00 0.02 0.04 0.06 0.08 0.10 0.12 0.14 Percent (x100)

Figure 3.34: Diagram with top 10 best natively captured movies in terms of scale mismatch released in 2012 Top 10 Best Natively Captured Movies with Smallest Scale Mismatch (released in 2013 and early 2014) 1. Stalingrad ($229K/min) Budget/min 2. Oz the Great and Powerful ($1653K/min) 3. 47 Ronin ($1470K/min) 4. The Great Gatsby ($739K/min) 5. One Direction: This Is Us ($93K/min) 6. Jack the Giant Slayer ($1710K/min) 7. Battle of the Year ($181K/min) 8. Texas Chainsaw 3D ($108K/min) 9. The Legend of Hercules ($707K/min)

0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 Percent (x100)

Figure 3.35: Diagram with top 10 best natively captured movies in terms of scale mismatch released in 2013 and early 2014

CS MSU Graphics & Media Lab 147 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.2.3 Overall Categories

Top 10 Best Natively Captured Movies with Smallest Scale Mismatch 1. Stalingrad ($229K/min) Budget/min 2. Prometheus ($1048K/min) 3. The Amazing Spider-Man ($1691K/min) 4. The Hobbit: An Unexpected Journey ($1914K/min) 5. Oz the Great and Powerful ($1653K/min) 6. Saw 3D: The Final Chapter ($222K/min) 7. Katy Perry: Part of Me ($127K/min) 8. Sharks 3D ($98K/min) 9. 47 Ronin ($1470K/min) 10. The Great Gatsby ($739K/min) 0.000 0.005 0.010 0.015 Percent (x100)

Figure 3.36: Diagram with top 10 best natively captured movies in terms of scale mismatch

RRRR R R R Top 10 Natively Captured Movies with Best Budget/Scale Mismatch Trade-off 1. Sharks 3D ($98K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. Stalingrad ($229K/min) 4. Saw 3D: The Final Chapter ($222K/min) 5. One Direction: This Is Us ($93K/min) 6. Fright Night ($283K/min) 7. Texas Chainsaw 3D ($108K/min) 8. Battle of the Year ($181K/min) 9. Step Up Revolution ($333K/min) 10. A Very Harold & Kumar 3D Christmas ($211K/min) 0.00 0.01 0.02 0.03 0.04 0.05 Percent (x100)

Figure 3.37: Diagram with top 10 best natively captured movies in terms of budget/scale mismatch trade-oﬀ Top 10 Natively Captured Movies with Best Release Date/Scale Mismatch Trade-off 1. Dial M for Murder ($13K/min, May 1954) Budget/min 2. Into the Deep ($n/a K/min, Nov 1994) 3. Cirque du Soleil: Journey of Man ($n/a K/min, May 2000) 4. Sharks 3D ($98K/min, Nov 2008) 5. Avatar ($1462K/min, Dec 2009) 6. Saw 3D: The Final Chapter ($222K/min, Oct 2010) 7. Ghosts of the Abyss ($213K/min, Apr 2003) 8. Pirates of the Caribbean: On Stranger Tides ($1838K/min, May 2011) 9. TRON: Legacy ($1360K/min, Dec 2010) 10. Fright Night ($283K/min, Aug 2011) 0.00 0.02 0.04 0.06 0.08 0.10 Percent (x100)

Figure 3.38: Diagram with top 10 best natively captured movies in terms of release date/scale mismatch trade-oﬀ

CS MSU Graphics & Media Lab 148 https://videoprocessing.ml/stereo_quality/ Movie Ratings Scale Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Scale Mismatch 1. The Wolverine ($952K/min) Natively Captured 2. The Last Airbender ($1456K/min) 3. Thor: The Dark World ($1517K/min) 2D-3D Conversion 4. Men in Black 3 ($2122K/min) CGI 5. Captain America: The First Avenger ($1129K/min) Hybrid 6. The Smurfs 2 ($1000K/min) Budget/min 7. Man of Steel ($1573K/min) 8. Titanic ($n/a K/min) 9. Wrath of the Titans ($1515K/min) 10. Iron Man 3 ($1526K/min) 0.00000 0.00002 0.00004 0.00006 0.00008 0.00010 Percent (x100)

Figure 3.39: Diagram with top 10 best movies in terms of scale mismatch RRRR R R R Top 10 Movies with Best Budget/Scale Mismatch Trade-off 1. Mummies: Secrets of the Pharaohs ($102K/min) Natively Captured 2. Sharks 3D ($98K/min) 3. Katy Perry: Part of Me ($127K/min) 2D-3D Conversion 4. Stalingrad ($229K/min) CGI 5. Saw 3D: The Final Chapter ($222K/min) Hybrid 6. Spy Kids: All the Time in the World in 4D ($306K/min) Budget/min 7. One Direction: This Is Us ($93K/min) 8. Piranha 3D ($272K/min) 9. Fright Night ($283K/min) 10. Hansel & Gretel: Witch Hunters ($568K/min) 0.000 0.005 0.010 0.015 0.020 0.025 0.030 Percent (x100)

Figure 3.40: Diagram with top 10 best movies in terms of budget/scale mismatch trade-oﬀ Top 10 Movies with Best Release Date/Scale Mismatch Trade-off 1. Dial M for Murder ($13K/min, May 1954) Natively Captured 2. Into the Deep ($n/a K/min, Nov 1994) 3. The Polar Express ($1650K/min, Nov 2004) 2D-3D Conversion 4. Cirque du Soleil: Journey of Man ($n/a K/min, May 2000) CGI 5. Mummies: Secrets of the Pharaohs ($102K/min, May 2007) Hybrid 6. Bolt ($1562K/min, Nov 2008) Budget/min 7. Sharks 3D ($98K/min, Nov 2008) 8. G-Force ($1704K/min, Jul 2009) 9. Alice in Wonderland ($1851K/min, Mar 2010) 10. Clash of the Titans ($1179K/min, Apr 2010) 0.00 0.02 0.04 0.06 0.08 0.10 Percent (x100)

Figure 3.41: Diagram with top 10 best movies in terms of release date/scale mismatch trade-oﬀ

CS MSU Graphics & Media Lab 149 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch MSU Stereo-Film Quality Analysis Report 10

3.3 Rotation Mismatch

3.3.1 Budget Categories

Top 10 Best Movies with Smallest Rotation Mismatch (budget < $300K/min) 1. Piranha 3D ($272K/min) Natively Captured 2. Stalingrad ($229K/min) 3. Mummies: Secrets of the Pharaohs ($102K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. Sharks 3D ($98K/min) Hybrid 6. Saw 3D: The Final Chapter ($222K/min) Budget/min 7. One Direction: This Is Us ($93K/min) 8. Fright Night ($283K/min) 9. Texas Chainsaw 3D ($108K/min) 10. A Very Harold & Kumar 3D Christmas ($211K/min) 0.00 0.02 0.04 0.06 0.08 0.10 0.12 0.14 0.16 Degrees (x10)

Figure 3.42: Diagram with top 10 best movies in terms of rotation mismatch with budgets less than $300K/minute

Top 10 Best Movies with Smallest Rotation Mismatch ($300 budget $1000K/min) 1. The Wolverine ($952K/min) Natively Captured 2. The Smurfs 2 ($1000K/min) 3. Ghost Rider: Spirit of Vengeance ($593K/min) 2D-3D Conversion 4. I, Frankenstein ($698K/min) CGI 5. Conan the Barbarian ($619K/min) Hybrid 6. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) Budget/min 7. Abraham Lincoln: Vampire Hunter ($657K/min) 8. Priest ($689K/min) 9. Percy Jackson: Sea of Monsters ($849K/min) 10. Immortals ($681K/min) 0.0000 0.0005 0.0010 0.0015 0.0020 Degrees (x10)

Figure 3.43: Diagram with top 10 best movies in terms of rotation mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Movies with Smallest Rotation Mismatch (budget > $1000K/min) 1. The Last Airbender ($1456K/min) Natively Captured 2. Wrath of the Titans ($1515K/min) 3. Man of Steel ($1573K/min) 2D-3D Conversion 4. Men in Black 3 ($2122K/min) CGI 5. Thor: The Dark World ($1517K/min) Hybrid 6. Captain America: The First Avenger ($1129K/min) Budget/min 7. G.I. Joe: Retaliation ($1181K/min) 8. R.I.P.D. ($1354K/min) 9. World War Z ($1637K/min) 10. Star Trek Into Darkness ($1439K/min) 0.0000 0.0001 0.0002 0.0003 0.0004 Degrees (x10)

Figure 3.44: Diagram with top 10 best movies in terms of rotation mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 150 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (budget < $300K/min) 1. Stalingrad ($229K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. Sharks 3D ($98K/min) 4. Saw 3D: The Final Chapter ($222K/min) 5. One Direction: This Is Us ($93K/min) 6. Fright Night ($283K/min) 7. Texas Chainsaw 3D ($108K/min) 8. A Very Harold & Kumar 3D Christmas ($211K/min) 9. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 10. Battle of the Year ($181K/min) 0.00 0.05 0.10 0.15 Degrees (x10)

Figure 3.45: Diagram with top 10 best natively captured movies in terms of rotation mismatch with budgets less than $300K/minute Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch ($300 budget $1000K/min) 1. The Great Gatsby ($739K/min) Budget/min 2. Life of Pi ($944K/min) 3. Underworld: Awakening ($786K/min) 4. Step Up Revolution ($333K/min) 5. The Darkest Hour ($337K/min) 6. The Legend of Hercules ($707K/min) 7. The Three Musketeers ($681K/min) 8. Dredd ($520K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. Final Destination 5 ($434K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 0.40 Degrees (x10)

Figure 3.46: Diagram with top 10 best natively captured movies in terms of rotation mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (budget > $1000K/min) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. The Hobbit: An Unexpected Journey ($1914K/min) 3. Prometheus ($1048K/min) 4. Oz the Great and Powerful ($1653K/min) 5. 47 Ronin ($1470K/min) 6. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 7. Avatar ($1462K/min) 8. Jack the Giant Slayer ($1710K/min) 9. TRON: Legacy ($1360K/min) 10. Hugo ($1349K/min) 0.00 0.05 0.10 0.15 0.20 0.25 Degrees (x10)

Figure 3.47: Diagram with top 10 best natively captured movies in terms of rotation mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 151 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.3.2 Release Date Categories

Top 10 Best Movies with Smallest Rotation Mismatch (released in 2010 and earlier) 1. The Last Airbender ($1456K/min) Natively Captured 2. Alice in Wonderland ($1851K/min) 3. The Polar Express ($1650K/min) 2D-3D Conversion 4. G-Force ($1704K/min) CGI 5. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) Hybrid 6. Piranha 3D ($272K/min) Budget/min 7. Bolt ($1562K/min) 8. Clash of the Titans ($1179K/min) 9. Gulliver's Travels ($1317K/min) 10. Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 0.000 0.002 0.004 0.006 0.008 Degrees (x10)

Figure 3.48: Diagram with top 10 best movies in terms of rotation mismatch released in 2010 and earlier

Top 10 Best Movies with Smallest Rotation Mismatch (released in 2011) 1. Captain America: The First Avenger ($1129K/min) Natively Captured 2. Green Lantern ($1769K/min) 3. Conan the Barbarian ($619K/min) 2D-3D Conversion 4. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) CGI 5. Priest ($689K/min) Hybrid 6. Thor ($1304K/min) Budget/min 7. Immortals ($681K/min) 8. The Smurfs ($1067K/min) 9. The Nutcracker in 3D ($833K/min) 10. The Green Hornet ($1008K/min) 0.000 0.005 0.010 0.015 0.020 Degrees (x10)

Figure 3.49: Diagram with top 10 best movies in terms of rotation mismatch released in 2011 Top 10 Best Movies with Smallest Rotation Mismatch (released in 2012) 1. Wrath of the Titans ($1515K/min) Natively Captured 2. Men in Black 3 ($2122K/min) 3. Titanic ($n/a K/min) 2D-3D Conversion 4. Ghost Rider: Spirit of Vengeance ($593K/min) CGI 5. Abraham Lincoln: Vampire Hunter ($657K/min) Hybrid 6. John Carter ($1893K/min) Budget/min 7. The Avengers ($1538K/min) 8. The Amazing Spider-Man ($1691K/min) 9. The Hobbit: An Unexpected Journey ($1914K/min) 10. Katy Perry: Part of Me ($127K/min) 0.000 0.005 0.010 0.015 0.020 0.025 Degrees (x10)

Figure 3.50: Diagram with top 10 best movies in terms of rotation mismatch released in 2012

CS MSU Graphics & Media Lab 152 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Rotation Mismatch (released in 2013 and early 2014) 1. The Wolverine ($952K/min) Natively Captured 2. Man of Steel ($1573K/min) 3. Thor: The Dark World ($1517K/min) 2D-3D Conversion 4. G.I. Joe: Retaliation ($1181K/min) CGI 5. R.I.P.D. ($1354K/min) Hybrid 6. The Smurfs 2 ($1000K/min) Budget/min 7. World War Z ($1637K/min) 8. Star Trek Into Darkness ($1439K/min) 9. I, Frankenstein ($698K/min) 10. Gravity ($1098K/min) 0.0000 0.0001 0.0002 0.0003 0.0004 0.0005 0.0006 Degrees (x10)

Figure 3.51: Diagram with top 10 best movies in terms of rotation mismatch released in 2013 and early 2014 Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (released in 2010 and earlier) 1. Sharks 3D ($98K/min) Budget/min 2. Saw 3D: The Final Chapter ($222K/min) 3. Into the Deep ($n/a K/min) 4. Avatar ($1462K/min) 5. TRON: Legacy ($1360K/min) 6. Space Station 3D ($n/a K/min) 7. The Ultimate Wave Tahiti ($65K/min) 8. Ghosts of the Abyss ($213K/min) 9. Ultimate G's ($n/a K/min) 10. Cirque du Soleil: Journey of Man ($n/a K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 0.40 Degrees (x10)

Figure 3.52: Diagram with top 10 best natively captured movies in terms of rotation mismatch released in 2010 and earlier Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (released in 2011) 1. Pirates of the Caribbean: On Stranger Tides ($1838K/min) Budget/min 2. Fright Night ($283K/min) 3. A Very Harold & Kumar 3D Christmas ($211K/min) 4. The Darkest Hour ($337K/min) 5. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 6. The Three Musketeers ($681K/min) 7. Flying Swords of Dragon Gate ($286K/min) 8. Sanctum ($277K/min) 9. Hugo ($1349K/min) 10. Pina ($40K/min) 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 Degrees (x10)

Figure 3.53: Diagram with top 10 best natively captured movies in terms of rotation mismatch released in 2011

CS MSU Graphics & Media Lab 153 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (released in 2012) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. The Hobbit: An Unexpected Journey ($1914K/min) 3. Katy Perry: Part of Me ($127K/min) 4. Prometheus ($1048K/min) 5. Life of Pi ($944K/min) 6. Underworld: Awakening ($786K/min) 7. Step Up Revolution ($333K/min) 8. Dredd ($520K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. Resident Evil: Retribution ($677K/min) 0.0 0.1 0.2 0.3 0.4 Degrees (x10)

Figure 3.54: Diagram with top 10 best natively captured movies in terms of rotation mismatch released in 2012 Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch (released in 2013 and early 2014) 1. Stalingrad ($229K/min) Budget/min 2. Oz the Great and Powerful ($1653K/min) 3. 47 Ronin ($1470K/min) 4. The Great Gatsby ($739K/min) 5. One Direction: This Is Us ($93K/min) 6. Texas Chainsaw 3D ($108K/min) 7. Jack the Giant Slayer ($1710K/min) 8. Battle of the Year ($181K/min) 9. The Legend of Hercules ($707K/min)

0.00 0.05 0.10 0.15 0.20 Degrees (x10)

Figure 3.55: Diagram with top 10 best natively captured movies in terms of rotation mismatch released in 2013 and early 2014

CS MSU Graphics & Media Lab 154 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.3.3 Overall Categories

Top 10 Best Natively Captured Movies with Smallest Rotation Mismatch 1. Stalingrad ($229K/min) Budget/min 2. The Amazing Spider-Man ($1691K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. Katy Perry: Part of Me ($127K/min) 5. Prometheus ($1048K/min) 6. Oz the Great and Powerful ($1653K/min) 7. Sharks 3D ($98K/min) 8. Saw 3D: The Final Chapter ($222K/min) 9. 47 Ronin ($1470K/min) 10. The Great Gatsby ($739K/min) 0.00 0.01 0.02 0.03 0.04 0.05 0.06 Degrees (x10)

Figure 3.56: Diagram with top 10 best natively captured movies in terms of rotation mismatch

RRRR R R R Top 10 Natively Captured Movies with Best Budget/Rotation Mismatch Trade-off 1. Sharks 3D ($98K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. One Direction: This Is Us ($93K/min) 4. Stalingrad ($229K/min) 5. Saw 3D: The Final Chapter ($222K/min) 6. Texas Chainsaw 3D ($108K/min) 7. Fright Night ($283K/min) 8. A Very Harold & Kumar 3D Christmas ($211K/min) 9. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 10. Battle of the Year ($181K/min) 0.00 0.05 0.10 0.15 Degrees (x10)

Figure 3.57: Diagram with top 10 best natively captured movies in terms of budget/rotation mismatch trade-oﬀ Top 10 Natively Captured Movies with Best Release Date/Rotation Mismatch Trade-off 1. Into the Deep ($n/a K/min, Nov 1994) Budget/min 2. Space Station 3D ($n/a K/min, Apr 2002) 3. Sharks 3D ($98K/min, Nov 2008) 4. Ultimate G's ($n/a K/min, Jan 2000) 5. Ghosts of the Abyss ($213K/min, Apr 2003) 6. Cirque du Soleil: Journey of Man ($n/a K/min, May 2000) 7. Saw 3D: The Final Chapter ($222K/min, Oct 2010) 8. Avatar ($1462K/min, Dec 2009) 9. Pirates of the Caribbean: On Stranger Tides ($1838K/min, May 2011) 10. Dial M for Murder ($13K/min, May 1954) 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 Degrees (x10)

Figure 3.58: Diagram with top 10 best natively captured movies in terms of release date/rotation mismatch trade-oﬀ

CS MSU Graphics & Media Lab 155 https://videoprocessing.ml/stereo_quality/ Movie Ratings Rotation Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Rotation Mismatch 1. The Wolverine ($952K/min) Natively Captured 2. The Last Airbender ($1456K/min) 3. Wrath of the Titans ($1515K/min) 2D-3D Conversion 4. Man of Steel ($1573K/min) CGI 5. Men in Black 3 ($2122K/min) Hybrid 6. Thor: The Dark World ($1517K/min) Budget/min 7. Captain America: The First Avenger ($1129K/min) 8. G.I. Joe: Retaliation ($1181K/min) 9. R.I.P.D. ($1354K/min) 10. The Smurfs 2 ($1000K/min) 0.00000 0.00005 0.00010 0.00015 0.00020 Degrees (x10)

Figure 3.59: Diagram with top 10 best movies in terms of rotation mismatch RRRR R R R Top 10 Movies with Best Budget/Rotation Mismatch Trade-off 1. Mummies: Secrets of the Pharaohs ($102K/min) Natively Captured 2. Sharks 3D ($98K/min) 3. Katy Perry: Part of Me ($127K/min) 2D-3D Conversion 4. Stalingrad ($229K/min) CGI 5. Piranha 3D ($272K/min) Hybrid 6. One Direction: This Is Us ($93K/min) Budget/min 7. Spy Kids: All the Time in the World in 4D ($306K/min) 8. Saw 3D: The Final Chapter ($222K/min) 9. Texas Chainsaw 3D ($108K/min) 10. Hansel & Gretel: Witch Hunters ($568K/min) 0.00 0.02 0.04 0.06 0.08 0.10 0.12 0.14 Degrees (x10)

Figure 3.60: Diagram with top 10 best movies in terms of budget/rotation mismatch trade-oﬀ Top 10 Movies with Best Release Date/Rotation Mismatch Trade-off 1. Into the Deep ($n/a K/min, Nov 1994) Natively Captured 2. The Polar Express ($1650K/min, Nov 2004) 3. Mummies: Secrets of the Pharaohs ($102K/min, May 2007) 2D-3D Conversion 4. Space Station 3D ($n/a K/min, Apr 2002) CGI 5. Bolt ($1562K/min, Nov 2008) Hybrid 6. Sharks 3D ($98K/min, Nov 2008) Budget/min 7. G-Force ($1704K/min, Jul 2009) 8. Alice in Wonderland ($1851K/min, Mar 2010) 9. Clash of the Titans ($1179K/min, Apr 2010) 10. The Last Airbender ($1456K/min, Jul 2010) 0.00 0.05 0.10 0.15 0.20 Degrees (x10)

Figure 3.61: Diagram with top 10 best movies in terms of release date/rotation mismatch trade-oﬀ

CS MSU Graphics & Media Lab 156 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch MSU Stereo-Film Quality Analysis Report 10

3.4 Color Mismatch

3.4.1 Budget Categories

Top 10 Best Movies with Smallest Color Mismatch (budget < $300K/min) 1. Stalingrad ($229K/min) Natively Captured 2. Mummies: Secrets of the Pharaohs ($102K/min) 3. Piranha 3D ($272K/min) 2D-3D Conversion 4. Fright Night ($283K/min) CGI 5. Katy Perry: Part of Me ($127K/min) Hybrid 6. Battle of the Year ($181K/min) Budget/min 7. One Direction: This Is Us ($93K/min) 8. Sharks 3D ($98K/min) 9. My Bloody Valentine ($148K/min) 10. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 0 1 2 3 4 5 6 MSU-3DColor-2011

Figure 3.62: Diagram with top 10 best movies in terms of color mismatch with budgets less than $300K/minute

Top 10 Best Movies with Smallest Color Mismatch ($300 budget $1000K/min) 1. Priest ($689K/min) Natively Captured 2. Immortals ($681K/min) 3. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 2D-3D Conversion 4. Ghost Rider: Spirit of Vengeance ($593K/min) CGI 5. Percy Jackson: Sea of Monsters ($849K/min) Hybrid 6. The Wolverine ($952K/min) Budget/min 7. The Smurfs 2 ($1000K/min) 8. Abraham Lincoln: Vampire Hunter ($657K/min) 9. I, Frankenstein ($698K/min) 10. The Nutcracker in 3D ($833K/min) 0.0 0.2 0.4 0.6 0.8 MSU-3DColor-2011

Figure 3.63: Diagram with top 10 best movies in terms of color mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Movies with Smallest Color Mismatch (budget > $1000K/min) 1. Clash of the Titans ($1179K/min) Natively Captured 2. Iron Man 3 ($1526K/min) 3. Man of Steel ($1573K/min) 2D-3D Conversion 4. The Amazing Spider-Man ($1691K/min) CGI 5. Green Lantern ($1769K/min) Hybrid 6. Wrath of the Titans ($1515K/min) Budget/min 7. Thor: The Dark World ($1517K/min) 8. Captain America: The First Avenger ($1129K/min) 9. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) 10. World War Z ($1637K/min) 0.0 0.1 0.2 0.3 0.4 0.5 0.6 MSU-3DColor-2011

Figure 3.64: Diagram with top 10 best movies in terms of color mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 157 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Color Mismatch (budget < $300K/min) 1. Stalingrad ($229K/min) Budget/min 2. Fright Night ($283K/min) 3. Katy Perry: Part of Me ($127K/min) 4. Battle of the Year ($181K/min) 5. One Direction: This Is Us ($93K/min) 6. Sharks 3D ($98K/min) 7. My Bloody Valentine ($148K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. Sanctum ($277K/min) 10. Texas Chainsaw 3D ($108K/min) 0 1 2 3 4 5 6 7 8 MSU-3DColor-2011

Figure 3.65: Diagram with top 10 best natively captured movies in terms of color mismatch with budgets less than $300K/minute Top 10 Best Natively Captured Movies with Smallest Color Mismatch ($300 budget $1000K/min) 1. Life of Pi ($944K/min) Budget/min 2. Underworld: Awakening ($786K/min) 3. The Great Gatsby ($739K/min) 4. The Three Musketeers ($681K/min) 5. The Darkest Hour ($337K/min) 6. Final Destination 5 ($434K/min) 7. Resident Evil: Retribution ($677K/min) 8. The Legend of Hercules ($707K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. Dredd ($520K/min) 0 2 4 6 8 10 12 MSU-3DColor-2011

Figure 3.66: Diagram with top 10 best natively captured movies in terms of color mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Natively Captured Movies with Smallest Color Mismatch (budget > $1000K/min) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. TRON: Legacy ($1360K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. 47 Ronin ($1470K/min) 5. Prometheus ($1048K/min) 6. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 7. Hugo ($1349K/min) 8. Jack the Giant Slayer ($1710K/min) 9. Oz the Great and Powerful ($1653K/min) 10. Avatar ($1462K/min) 0 1 2 3 4 5 6 7 MSU-3DColor-2011

Figure 3.67: Diagram with top 10 best natively captured movies in terms of color mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 158 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.4.2 Release Date Categories

Top 10 Best Movies with Smallest Color Mismatch (released in 2010 and earlier) 1. Clash of the Titans ($1179K/min) Natively Captured 2. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) 3. Alice in Wonderland ($1851K/min) 2D-3D Conversion 4. The Polar Express ($1650K/min) CGI 5. G-Force ($1704K/min) Hybrid 6. Mummies: Secrets of the Pharaohs ($102K/min) Budget/min 7. TRON: Legacy ($1360K/min) 8. The Last Airbender ($1456K/min) 9. Cats & Dogs: The Revenge of Kitty Galore ($1036K/min) 10. Piranha 3D ($272K/min) 0.0 0.2 0.4 0.6 0.8 1.0 1.2 MSU-3DColor-2011

Figure 3.68: Diagram with top 10 best movies in terms of color mismatch released in 2010 and earlier

Top 10 Best Movies with Smallest Color Mismatch (released in 2011) 1. Priest ($689K/min) Natively Captured 2. Immortals ($681K/min) 3. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 2D-3D Conversion 4. Green Lantern ($1769K/min) CGI 5. Captain America: The First Avenger ($1129K/min) Hybrid 6. The Smurfs ($1067K/min) Budget/min 7. Thor ($1304K/min) 8. The Nutcracker in 3D ($833K/min) 9. Conan the Barbarian ($619K/min) 10. The Green Hornet ($1008K/min) 0.0 0.2 0.4 0.6 0.8 1.0 MSU-3DColor-2011

Figure 3.69: Diagram with top 10 best movies in terms of color mismatch released in 2011 Top 10 Best Movies with Smallest Color Mismatch (released in 2012) 1. Ghost Rider: Spirit of Vengeance ($593K/min) Natively Captured 2. Titanic ($n/a K/min) 3. The Amazing Spider-Man ($1691K/min) 2D-3D Conversion 4. Wrath of the Titans ($1515K/min) CGI 5. Abraham Lincoln: Vampire Hunter ($657K/min) Hybrid 6. The Avengers ($1538K/min) Budget/min 7. Men in Black 3 ($2122K/min) 8. John Carter ($1893K/min) 9. The Hobbit: An Unexpected Journey ($1914K/min) 10. Life of Pi ($944K/min) 0.0 0.5 1.0 1.5 2.0 MSU-3DColor-2011

Figure 3.70: Diagram with top 10 best movies in terms of color mismatch released in 2012

CS MSU Graphics & Media Lab 159 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Color Mismatch (released in 2013 and early 2014) 1. Iron Man 3 ($1526K/min) Natively Captured 2. Man of Steel ($1573K/min) 3. Percy Jackson: Sea of Monsters ($849K/min) 2D-3D Conversion 4. Thor: The Dark World ($1517K/min) CGI 5. The Wolverine ($952K/min) Hybrid 6. World War Z ($1637K/min) Budget/min 7. The Smurfs 2 ($1000K/min) 8. Stalingrad ($229K/min) 9. I, Frankenstein ($698K/min) 10. R.I.P.D. ($1354K/min) 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 MSU-3DColor-2011

Figure 3.71: Diagram with top 10 best movies in terms of color mismatch released in 2013 and early 2014 Top 10 Best Natively Captured Movies with Smallest Color Mismatch (released in 2010 and earlier) 1. TRON: Legacy ($1360K/min) Budget/min 2. Sharks 3D ($98K/min) 3. My Bloody Valentine ($148K/min) 4. Avatar ($1462K/min) 5. Ghosts of the Abyss ($213K/min) 6. The Child's Eye ($46K/min) 7. Dial M for Murder ($13K/min) 8. Dark Country ($45K/min) 9. Resident Evil: Afterlife ($618K/min) 10. The Ultimate Wave Tahiti ($65K/min) 0 2 4 6 8 10 12 14 16 MSU-3DColor-2011

Figure 3.72: Diagram with top 10 best natively captured movies in terms of color mismatch released in 2010 and earlier Top 10 Best Natively Captured Movies with Smallest Color Mismatch (released in 2011) 1. Fright Night ($283K/min) Budget/min 2. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 3. Hugo ($1349K/min) 4. The Three Musketeers ($681K/min) 5. The Darkest Hour ($337K/min) 6. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 7. Final Destination 5 ($434K/min) 8. Sanctum ($277K/min) 9. A Very Harold & Kumar 3D Christmas ($211K/min) 10. Flying Swords of Dragon Gate ($286K/min) 0 2 4 6 8 10 MSU-3DColor-2011

Figure 3.73: Diagram with top 10 best natively captured movies in terms of color mismatch released in 2011

CS MSU Graphics & Media Lab 160 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Color Mismatch (released in 2012) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. The Hobbit: An Unexpected Journey ($1914K/min) 3. Life of Pi ($944K/min) 4. Prometheus ($1048K/min) 5. Underworld: Awakening ($786K/min) 6. Katy Perry: Part of Me ($127K/min) 7. Resident Evil: Retribution ($677K/min) 8. Silent Hill: Revelation 3D ($210K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. Dredd ($520K/min) 0 2 4 6 8 10 12 MSU-3DColor-2011

Figure 3.74: Diagram with top 10 best natively captured movies in terms of color mismatch released in 2012 Top 10 Best Natively Captured Movies with Smallest Color Mismatch (released in 2013 and early 2014) 1. Stalingrad ($229K/min) Budget/min 2. 47 Ronin ($1470K/min) 3. Battle of the Year ($181K/min) 4. One Direction: This Is Us ($93K/min) 5. Jack the Giant Slayer ($1710K/min) 6. Oz the Great and Powerful ($1653K/min) 7. The Great Gatsby ($739K/min) 8. Texas Chainsaw 3D ($108K/min) 9. The Legend of Hercules ($707K/min)

0 2 4 6 8 10 MSU-3DColor-2011

Figure 3.75: Diagram with top 10 best natively captured movies in terms of color mismatch released in 2013 and early 2014

CS MSU Graphics & Media Lab 161 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.4.3 Overall Categories

Top 10 Best Natively Captured Movies with Smallest Color Mismatch 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. Stalingrad ($229K/min) 3. TRON: Legacy ($1360K/min) 4. The Hobbit: An Unexpected Journey ($1914K/min) 5. 47 Ronin ($1470K/min) 6. Fright Night ($283K/min) 7. Life of Pi ($944K/min) 8. Prometheus ($1048K/min) 9. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 10. Underworld: Awakening ($786K/min) 0.0 0.5 1.0 1.5 2.0 2.5 MSU-3DColor-2011

Figure 3.76: Diagram with top 10 best natively captured movies in terms of color mismatch

RRRR R R R Top 10 Natively Captured Movies with Best Budget/Color Mismatch Trade-off 1. Stalingrad ($229K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. One Direction: This Is Us ($93K/min) 4. Battle of the Year ($181K/min) 5. Fright Night ($283K/min) 6. Sharks 3D ($98K/min) 7. My Bloody Valentine ($148K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. The Darkest Hour ($337K/min) 10. Texas Chainsaw 3D ($108K/min) 0 1 2 3 4 5 6 7 8 MSU-3DColor-2011

Figure 3.77: Diagram with top 10 best natively captured movies in terms of budget/color mismatch trade-oﬀ Top 10 Natively Captured Movies with Best Release Date/Color Mismatch Trade-off 1. Dial M for Murder ($13K/min, May 1954) Budget/min 2. Creature from the Black Lagoon ($n/a K/min, Mar 1954) 3. Ghosts of the Abyss ($213K/min, Apr 2003) 4. Sharks 3D ($98K/min, Nov 2008) 5. My Bloody Valentine ($148K/min, Jan 2009) 6. TRON: Legacy ($1360K/min, Dec 2010) 7. Pirates of the Caribbean: On Stranger Tides ($1838K/min, May 2011) 8. Fright Night ($283K/min, Aug 2011) 9. Hugo ($1349K/min, Nov 2011) 10. Underworld: Awakening ($786K/min, Jan 2012) 0 5 10 15 MSU-3DColor-2011

Figure 3.78: Diagram with top 10 best natively captured movies in terms of release date/color mismatch trade-oﬀ

CS MSU Graphics & Media Lab 162 https://videoprocessing.ml/stereo_quality/ Movie Ratings Color Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Movies with Smallest Color Mismatch 1. Priest ($689K/min) Natively Captured 2. Clash of the Titans ($1179K/min) 3. Immortals ($681K/min) 2D-3D Conversion 4. Iron Man 3 ($1526K/min) CGI 5. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) Hybrid 6. Ghost Rider: Spirit of Vengeance ($593K/min) Budget/min 7. Man of Steel ($1573K/min) 8. Titanic ($n/a K/min) 9. Percy Jackson: Sea of Monsters ($849K/min) 10. The Amazing Spider-Man ($1691K/min) 0.0 0.1 0.2 0.3 0.4 0.5 MSU-3DColor-2011

Figure 3.79: Diagram with top 10 best movies in terms of color mismatch RRRR R R R Top 10 Movies with Best Budget/Color Mismatch Trade-off 1. Mummies: Secrets of the Pharaohs ($102K/min) Natively Captured 2. Stalingrad ($229K/min) 3. Piranha 3D ($272K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. One Direction: This Is Us ($93K/min) Hybrid 6. Spy Kids: All the Time in the World in 4D ($306K/min) Budget/min 7. Battle of the Year ($181K/min) 8. Fright Night ($283K/min) 9. Sharks 3D ($98K/min) 10. Ghost Rider: Spirit of Vengeance ($593K/min) 0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 MSU-3DColor-2011

Figure 3.80: Diagram with top 10 best movies in terms of budget/color mismatch trade-oﬀ Top 10 Movies with Best Release Date/Color Mismatch Trade-off 1. Dial M for Murder ($13K/min, May 1954) Natively Captured 2. The Polar Express ($1650K/min, Nov 2004) 3. Mummies: Secrets of the Pharaohs ($102K/min, May 2007) 2D-3D Conversion 4. Bolt ($1562K/min, Nov 2008) CGI 5. G-Force ($1704K/min, Jul 2009) Hybrid 6. Ghosts of the Abyss ($213K/min, Apr 2003) Budget/min 7. Sharks 3D ($98K/min, Nov 2008) 8. Alice in Wonderland ($1851K/min, Mar 2010) 9. Clash of the Titans ($1179K/min, Apr 2010) 10. The Last Airbender ($1456K/min, Jul 2010) 0 2 4 6 8 10 MSU-3DColor-2011

Figure 3.81: Diagram with top 10 best movies in terms of release date/color mismatch trade-oﬀ

CS MSU Graphics & Media Lab 163 https://videoprocessing.ml/stereo_quality/ Movie Ratings Sharpness Mismatch MSU Stereo-Film Quality Analysis Report 10

3.5 Sharpness Mismatch

3.5.1 Budget Categories

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (budget < $300K/min) 1. One Direction: This Is Us ($93K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. Stalingrad ($229K/min) 4. Fright Night ($283K/min) 5. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 6. Sharks 3D ($98K/min) 7. Battle of the Year ($181K/min) 8. Legends of Flight ($66K/min) 9. Flying Swords of Dragon Gate ($286K/min) 10. Texas Chainsaw 3D ($108K/min) 0 2 4 6 8 10 MSU-3DSharpness-2012

Figure 3.82: Diagram with top 10 best natively captured movies in terms of sharpness mismatch with budgets less than $300K/minute

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch ($300 budget $1000K/min) 1. Life of Pi ($944K/min) Budget/min 2. Resident Evil: Retribution ($677K/min) 3. The Three Musketeers ($681K/min) 4. The Darkest Hour ($337K/min) 5. The Great Gatsby ($739K/min) 6. Underworld: Awakening ($786K/min) 7. Spy Kids 3-D: Game Over ($464K/min) 8. The Legend of Hercules ($707K/min) 9. Step Up Revolution ($333K/min) 10. Final Destination 5 ($434K/min) 0 2 4 6 8 10 MSU-3DSharpness-2012

Figure 3.83: Diagram with top 10 best natively captured movies in terms of sharpness mismatch with budgets less than $1000K/minute and more than $300K/minute Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (budget > $1000K/min) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. TRON: Legacy ($1360K/min) 3. Jack the Giant Slayer ($1710K/min) 4. The Hobbit: An Unexpected Journey ($1914K/min) 5. Oz the Great and Powerful ($1653K/min) 6. Prometheus ($1048K/min) 7. 47 Ronin ($1470K/min) 8. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 9. Hugo ($1349K/min) 10. Avatar ($1462K/min) 0 2 4 6 8 10 12 MSU-3DSharpness-2012

Figure 3.84: Diagram with top 10 best natively captured movies in terms of sharpness mismatch with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 164 https://videoprocessing.ml/stereo_quality/ Movie Ratings Sharpness Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.5.2 Release Date Categories

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (released in 2010 and earlier) 1. TRON: Legacy ($1360K/min) Budget/min 2. Sharks 3D ($98K/min) 3. Spy Kids 3-D: Game Over ($464K/min) 4. Galapagos: The Enchanted Voyage ($n/a K/min) 5. Avatar ($1462K/min) 6. Space Station 3D ($n/a K/min) 7. Resident Evil: Afterlife ($618K/min) 8. The Ultimate Wave Tahiti ($65K/min) 9. The Hole ($129K/min) 10. Ghosts of the Abyss ($213K/min) 0 2 4 6 8 10 12 14 MSU-3DSharpness-2012

Figure 3.85: Diagram with top 10 best natively captured movies in terms of sharpness mismatch released in 2010 and earlier

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (released in 2011) 1. Fright Night ($283K/min) Budget/min 2. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 3. The Three Musketeers ($681K/min) 4. The Darkest Hour ($337K/min) 5. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 6. Hugo ($1349K/min) 7. Legends of Flight ($66K/min) 8. Flying Swords of Dragon Gate ($286K/min) 9. Final Destination 5 ($434K/min) 10. Shark Night 3D ($277K/min) 0 2 4 6 8 10 12 MSU-3DSharpness-2012

Figure 3.86: Diagram with top 10 best natively captured movies in terms of sharpness mismatch released in 2011 Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (released in 2012) 1. Katy Perry: Part of Me ($127K/min) Budget/min 2. Life of Pi ($944K/min) 3. The Amazing Spider-Man ($1691K/min) 4. The Hobbit: An Unexpected Journey ($1914K/min) 5. Prometheus ($1048K/min) 6. Resident Evil: Retribution ($677K/min) 7. Underworld: Awakening ($786K/min) 8. Step Up Revolution ($333K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. Dredd ($520K/min) 0 2 4 6 8 10 12 MSU-3DSharpness-2012

Figure 3.87: Diagram with top 10 best natively captured movies in terms of sharpness mismatch released in 2012

CS MSU Graphics & Media Lab 165 https://videoprocessing.ml/stereo_quality/ Movie Ratings Sharpness Mismatch: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch (released in 2013 and early 2014) 1. One Direction: This Is Us ($93K/min) Budget/min 2. Stalingrad ($229K/min) 3. Jack the Giant Slayer ($1710K/min) 4. Oz the Great and Powerful ($1653K/min) 5. 47 Ronin ($1470K/min) 6. Battle of the Year ($181K/min) 7. The Great Gatsby ($739K/min) 8. The Legend of Hercules ($707K/min) 9. Texas Chainsaw 3D ($108K/min)

0 2 4 6 8 10 MSU-3DSharpness-2012

Figure 3.88: Diagram with top 10 best natively captured movies in terms of sharpness mismatch released in 2013 and early 2014

CS MSU Graphics & Media Lab 166 https://videoprocessing.ml/stereo_quality/ Movie Ratings Sharpness Mismatch: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.5.3 Overall Categories

Top 10 Best Natively Captured Movies with Smallest Sharpness Mismatch 1. One Direction: This Is Us ($93K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. Life of Pi ($944K/min) 4. The Amazing Spider-Man ($1691K/min) 5. TRON: Legacy ($1360K/min) 6. Stalingrad ($229K/min) 7. Fright Night ($283K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. Jack the Giant Slayer ($1710K/min) 10. The Hobbit: An Unexpected Journey ($1914K/min) 0 1 2 3 4 5 6 7 MSU-3DSharpness-2012

Figure 3.89: Diagram with top 10 best natively captured movies in terms of sharpness mismatch

RRRR R R R Top 10 Natively Captured Movies with Best Budget/Sharpness Mismatch Trade-off 1. One Direction: This Is Us ($93K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. Stalingrad ($229K/min) 4. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 5. Fright Night ($283K/min) 6. Sharks 3D ($98K/min) 7. Battle of the Year ($181K/min) 8. The Darkest Hour ($337K/min) 9. Legends of Flight ($66K/min) 10. Resident Evil: Retribution ($677K/min) 0 2 4 6 8 10 MSU-3DSharpness-2012

Figure 3.90: Diagram with top 10 best natively captured movies in terms of budget/sharpness mismatch trade-oﬀ Top 10 Natively Captured Movies with Best Release Date/Sharpness Mismatch Trade-off 1. Galapagos: The Enchanted Voyage ($n/a K/min, Oct 1999) Budget/min 2. Spy Kids 3-D: Game Over ($464K/min, Jul 2003) 3. TRON: Legacy ($1360K/min, Dec 2010) 4. Sharks 3D ($98K/min, Nov 2008) 5. Sea Rex 3D: Journey to a Prehistoric World ($121K/min, Feb 2011) 6. Fright Night ($283K/min, Aug 2011) 7. Space Station 3D ($n/a K/min, Apr 2002) 8. Katy Perry: Part of Me ($127K/min, Jul 2012) 9. The Amazing Spider-Man ($1691K/min, Jun 2012) 10. Life of Pi ($944K/min, Nov 2012) 0 2 4 6 8 10 12 MSU-3DSharpness-2012

Figure 3.91: Diagram with top 10 best natively captured movies in terms of release date/sharpness mismatch trade-oﬀ

CS MSU Graphics & Media Lab 167 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation MSU Stereo-Film Quality Analysis Report 10

3.6 Stereo Window Violation

3.6.1 Budget Categories

Top 10 Movies with Best Stereo Window Placement Comfort (budget < $300K/min) 1. Fright Night ($283K/min) Natively Captured 2. Katy Perry: Part of Me ($127K/min) 3. One Direction: This Is Us ($93K/min) 2D-3D Conversion 4. Texas Chainsaw 3D ($108K/min) CGI 5. Pina ($40K/min) Hybrid 6. Battle of the Year ($181K/min) Budget/min 7. The Hole ($129K/min) 8. Dial M for Murder ($13K/min) 9. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 10. Stalingrad ($229K/min) 0 5 10 15 MSU-StereoWindowComfort-2014

Figure 3.92: Diagram with top 10 best movies in terms of stereo window placement comfort with budgets less than $300K/minute

Top 10 Movies with Best Stereo Window Placement Comfort ($300 budget $1000K/min) 1. Life of Pi ($944K/min) Natively Captured 2. Resident Evil: Retribution ($677K/min) 3. Underworld: Awakening ($786K/min) 2D-3D Conversion 4. Immortals ($681K/min) CGI 5. The Smurfs 2 ($1000K/min) Hybrid 6. Hansel & Gretel: Witch Hunters ($568K/min) Budget/min 7. The Three Musketeers ($681K/min) 8. Percy Jackson: Sea of Monsters ($849K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. I, Frankenstein ($698K/min) 0 2 4 6 8 10 12 14 MSU-StereoWindowComfort-2014

Figure 3.93: Diagram with top 10 best movies in terms of stereo window placement comfort with budgets less than $1000K/minute and more than $300K/minute Top 10 Movies with Best Stereo Window Placement Comfort (budget > $1000K/min) 1. Thor: The Dark World ($1517K/min) Natively Captured 2. Bolt ($1562K/min) 3. Captain America: The First Avenger ($1129K/min) 2D-3D Conversion 4. G-Force ($1704K/min) CGI 5. John Carter ($1893K/min) Hybrid 6. The Avengers ($1538K/min) Budget/min 7. The Green Hornet ($1008K/min) 8. The Amazing Spider-Man ($1691K/min) 9. TRON: Legacy ($1360K/min) 10. The Smurfs ($1067K/min) 0 2 4 6 8 MSU-StereoWindowComfort-2014

Figure 3.94: Diagram with top 10 best movies in terms of stereo window placement comfort with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 168 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Movies with Best Stereo Window Violation Handling (budget < $300K/min) 1. One Direction: This Is Us ($93K/min) Natively Captured 2. Pina ($40K/min) 3. Fright Night ($283K/min) 2D-3D Conversion 4. Dial M for Murder ($13K/min) CGI 5. Battle of the Year ($181K/min) Hybrid 6. Stalingrad ($229K/min) Budget/min 7. Katy Perry: Part of Me ($127K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. The Hole ($129K/min) 10. Dark Country ($45K/min) 0 5 10 15 20 25 30 MSU-StereoViolationHandling-2014

Figure 3.95: Diagram with top 10 best movies in terms of stereo window violation handling with budgets less than $300K/minute Top 10 Movies with Best Stereo Window Violation Handling ($300 budget $1000K/min) 1. Resident Evil: Retribution ($677K/min) Natively Captured 2. Immortals ($681K/min) 3. Priest ($689K/min) 2D-3D Conversion 4. I, Frankenstein ($698K/min) CGI 5. Ghost Rider: Spirit of Vengeance ($593K/min) Hybrid 6. Hansel & Gretel: Witch Hunters ($568K/min) Budget/min 7. Journey 2: The Mysterious Island ($840K/min) 8. The Smurfs 2 ($1000K/min) 9. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 10. Life of Pi ($944K/min) 0 5 10 15 20 25 30 MSU-StereoViolationHandling-2014

Figure 3.96: Diagram with top 10 best movies in terms of stereo window violation handling with budgets less than $1000K/minute and more than $300K/minute Top 10 Movies with Best Stereo Window Violation Handling (budget > $1000K/min) 1. Thor: The Dark World ($1517K/min) Natively Captured 2. John Carter ($1893K/min) 3. Bolt ($1562K/min) 2D-3D Conversion 4. G-Force ($1704K/min) CGI 5. The Green Hornet ($1008K/min) Hybrid 6. TRON: Legacy ($1360K/min) Budget/min 7. The Amazing Spider-Man ($1691K/min) 8. Captain America: The First Avenger ($1129K/min) 9. Men in Black 3 ($2122K/min) 10. The Smurfs ($1067K/min) 0 5 10 15 20 MSU-StereoViolationHandling-2014

Figure 3.97: Diagram with top 10 best movies in terms of stereo window violation handling with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 169 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.6.2 Release Date Categories

Top 10 Movies with Best Stereo Window Placement Comfort (released in 2010 and earlier) 1. Bolt ($1562K/min) Natively Captured 2. G-Force ($1704K/min) 3. TRON: Legacy ($1360K/min) 2D-3D Conversion 4. The Hole ($129K/min) CGI 5. Ultimate G's ($n/a K/min) Hybrid 6. Dial M for Murder ($13K/min) Budget/min 7. Dark Country ($45K/min) 8. The Child's Eye ($46K/min) 9. Resident Evil: Afterlife ($618K/min) 10. My Bloody Valentine ($148K/min) 0 5 10 15 20 25 MSU-StereoWindowComfort-2014

Figure 3.98: Diagram with top 10 best movies in terms of stereo window placement comfort released in 2010 and earlier

Top 10 Movies with Best Stereo Window Placement Comfort (released in 2011) 1. Captain America: The First Avenger ($1129K/min) Natively Captured 2. Fright Night ($283K/min) 3. The Green Hornet ($1008K/min) 2D-3D Conversion 4. The Smurfs ($1067K/min) CGI 5. Pina ($40K/min) Hybrid 6. Immortals ($681K/min) Budget/min 7. The Three Musketeers ($681K/min) 8. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 9. Green Lantern ($1769K/min) 10. Priest ($689K/min) 0 2 4 6 8 10 12 14 MSU-StereoWindowComfort-2014

Figure 3.99: Diagram with top 10 best movies in terms of stereo window placement comfort released in 2011 Top 10 Movies with Best Stereo Window Placement Comfort (released in 2012) 1. John Carter ($1893K/min) Natively Captured 2. The Avengers ($1538K/min) 3. Katy Perry: Part of Me ($127K/min) 2D-3D Conversion 4. The Amazing Spider-Man ($1691K/min) CGI 5. Life of Pi ($944K/min) Hybrid 6. Resident Evil: Retribution ($677K/min) Budget/min 7. Underworld: Awakening ($786K/min) 8. Men in Black 3 ($2122K/min) 9. Journey 2: The Mysterious Island ($840K/min) 10. The Hobbit: An Unexpected Journey ($1914K/min) 0 5 10 15 MSU-StereoWindowComfort-2014

Figure 3.100: Diagram with top 10 best movies in terms of stereo window placement comfort released in 2012

CS MSU Graphics & Media Lab 170 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Movies with Best Stereo Window Placement Comfort (released in 2013 and early 2014) 1. Thor: The Dark World ($1517K/min) Natively Captured 2. One Direction: This Is Us ($93K/min) 3. Texas Chainsaw 3D ($108K/min) 2D-3D Conversion 4. The Smurfs 2 ($1000K/min) CGI 5. Hansel & Gretel: Witch Hunters ($568K/min) Hybrid 6. Battle of the Year ($181K/min) Budget/min 7. Percy Jackson: Sea of Monsters ($849K/min) 8. I, Frankenstein ($698K/min) 9. The Legend of Hercules ($707K/min) 10. Gravity ($1098K/min) 0 2 4 6 8 10 12 14 16 MSU-StereoWindowComfort-2014

Figure 3.101: Diagram with top 10 best movies in terms of stereo window placement comfort released in 2013 and early 2014 Top 10 Movies with Best Stereo Window Violation Handling (released in 2010 and earlier) 1. Bolt ($1562K/min) Natively Captured 2. Ultimate G's ($n/a K/min) 3. G-Force ($1704K/min) 2D-3D Conversion 4. Dial M for Murder ($13K/min) CGI 5. TRON: Legacy ($1360K/min) Hybrid 6. The Hole ($129K/min) Budget/min 7. Dark Country ($45K/min) 8. Mummies: Secrets of the Pharaohs ($102K/min) 9. Resident Evil: Afterlife ($618K/min) 10. Gulliver's Travels ($1317K/min) 0 10 20 30 40 50 MSU-StereoViolationHandling-2014

Figure 3.102: Diagram with top 10 best movies in terms of stereo window violation handling released in 2010 and earlier Top 10 Movies with Best Stereo Window Violation Handling (released in 2011) 1. Pina ($40K/min) Natively Captured 2. Fright Night ($283K/min) 3. The Green Hornet ($1008K/min) 2D-3D Conversion 4. Captain America: The First Avenger ($1129K/min) CGI 5. Immortals ($681K/min) Hybrid 6. Priest ($689K/min) Budget/min 7. The Smurfs ($1067K/min) 8. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 9. Green Lantern ($1769K/min) 10. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 0 5 10 15 20 25 MSU-StereoViolationHandling-2014

Figure 3.103: Diagram with top 10 best movies in terms of stereo window violation handling released in 2011

CS MSU Graphics & Media Lab 171 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Movies with Best Stereo Window Violation Handling (released in 2012) 1. John Carter ($1893K/min) Natively Captured 2. The Amazing Spider-Man ($1691K/min) 3. Katy Perry: Part of Me ($127K/min) 2D-3D Conversion 4. Resident Evil: Retribution ($677K/min) CGI 5. Men in Black 3 ($2122K/min) Hybrid 6. Ghost Rider: Spirit of Vengeance ($593K/min) Budget/min 7. Journey 2: The Mysterious Island ($840K/min) 8. The Avengers ($1538K/min) 9. The Hobbit: An Unexpected Journey ($1914K/min) 10. Life of Pi ($944K/min) 0 5 10 15 20 25 30 MSU-StereoViolationHandling-2014

Figure 3.104: Diagram with top 10 best movies in terms of stereo window violation handling released in 2012 Top 10 Movies with Best Stereo Window Violation Handling (released in 2013 and early 2014) 1. Thor: The Dark World ($1517K/min) Natively Captured 2. One Direction: This Is Us ($93K/min) 3. Battle of the Year ($181K/min) 2D-3D Conversion 4. Stalingrad ($229K/min) CGI 5. I, Frankenstein ($698K/min) Hybrid 6. Hansel & Gretel: Witch Hunters ($568K/min) Budget/min 7. Gravity ($1098K/min) 8. The Smurfs 2 ($1000K/min) 9. Oz the Great and Powerful ($1653K/min) 10. Jack the Giant Slayer ($1710K/min) 0 5 10 15 20 25 30 MSU-StereoViolationHandling-2014

Figure 3.105: Diagram with top 10 best movies in terms of stereo window violation handling released in 2013 and early 2014

CS MSU Graphics & Media Lab 172 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.6.3 Overall Categories

Top 10 Movies with Best Stereo Window Placement Comfort 1. Thor: The Dark World ($1517K/min) Natively Captured 2. Bolt ($1562K/min) 3. Captain America: The First Avenger ($1129K/min) 2D-3D Conversion 4. G-Force ($1704K/min) CGI 5. John Carter ($1893K/min) Hybrid 6. Fright Night ($283K/min) Budget/min 7. The Avengers ($1538K/min) 8. Katy Perry: Part of Me ($127K/min) 9. The Green Hornet ($1008K/min) 10. The Amazing Spider-Man ($1691K/min) 0 1 2 3 4 5 6 7 MSU-StereoWindowComfort-2014

Figure 3.106: Diagram with top 10 best movies in terms of stereo window placement comfort

RRRR R R R Top 10 Movies with Best Budget/Stereo Window Placement Comfort Trade-off 1. Katy Perry: Part of Me ($127K/min) Natively Captured 2. One Direction: This Is Us ($93K/min) 3. Fright Night ($283K/min) 2D-3D Conversion 4. Texas Chainsaw 3D ($108K/min) CGI 5. Pina ($40K/min) Hybrid 6. Battle of the Year ($181K/min) Budget/min 7. The Hole ($129K/min) 8. Dial M for Murder ($13K/min) 9. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 10. Stalingrad ($229K/min) 0 5 10 15 MSU-StereoWindowComfort-2014

Figure 3.107: Diagram with top 10 best movies in terms of budget/stereo window placement comfort trade-oﬀ Top 10 Movies with Best Release Date/Stereo Window Placement Comfort Trade-off 1. Dial M for Murder ($13K/min, May 1954) Natively Captured 2. Ultimate G's ($n/a K/min, Jan 2000) 3. Bolt ($1562K/min, Nov 2008) 2D-3D Conversion 4. G-Force ($1704K/min, Jul 2009) CGI 5. TRON: Legacy ($1360K/min, Dec 2010) Hybrid 6. The Green Hornet ($1008K/min, Jan 2011) Budget/min 7. The Hole ($129K/min, Jun 2010) 8. Captain America: The First Avenger ($1129K/min, Jul 2011) 9. Pina ($40K/min, Feb 2011) 10. Dark Country ($45K/min, Oct 2009) 0 5 10 15 20 MSU-StereoWindowComfort-2014

Figure 3.108: Diagram with top 10 best movies in terms of release date/stereo window placement comfort trade-oﬀ

CS MSU Graphics & Media Lab 173 https://videoprocessing.ml/stereo_quality/ Movie Ratings Stereo Window Violation: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Top 10 Movies with Best Stereo Window Violation Handling 1. Thor: The Dark World ($1517K/min) Natively Captured 2. John Carter ($1893K/min) 3. Bolt ($1562K/min) 2D-3D Conversion 4. One Direction: This Is Us ($93K/min) CGI 5. Ultimate G's ($n/a K/min) Hybrid 6. G-Force ($1704K/min) Budget/min 7. Pina ($40K/min) 8. Fright Night ($283K/min) 9. Dial M for Murder ($13K/min) 10. The Green Hornet ($1008K/min) 0 2 4 6 8 10 12 MSU-StereoViolationHandling-2014

Figure 3.109: Diagram with top 10 best movies in terms of stereo window violation handling RRRR R R R Top 10 Movies with Best Budget/Stereo Window Violation Handling Trade-off 1. One Direction: This Is Us ($93K/min) Natively Captured 2. Pina ($40K/min) 3. Dial M for Murder ($13K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. Battle of the Year ($181K/min) Hybrid 6. Stalingrad ($229K/min) Budget/min 7. Fright Night ($283K/min) 8. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 9. The Hole ($129K/min) 10. Dark Country ($45K/min) 0 5 10 15 20 25 30 MSU-StereoViolationHandling-2014

Figure 3.110: Diagram with top 10 best movies in terms of budget/stereo window violation handling trade-oﬀ Top 10 Movies with Best Release Date/Stereo Window Violation Handling Trade-off 1. Dial M for Murder ($13K/min, May 1954) Natively Captured 2. Ultimate G's ($n/a K/min, Jan 2000) 3. Mummies: Secrets of the Pharaohs ($102K/min, May 2007) 2D-3D Conversion 4. Bolt ($1562K/min, Nov 2008) CGI 5. G-Force ($1704K/min, Jul 2009) Hybrid 6. Dark Country ($45K/min, Oct 2009) Budget/min 7. The Hole ($129K/min, Jun 2010) 8. TRON: Legacy ($1360K/min, Dec 2010) 9. Creature from the Black Lagoon ($n/a K/min, Mar 1954) 10. The Green Hornet ($1008K/min, Jan 2011) 0 50 100 150 MSU-StereoViolationHandling-2014

Figure 3.111: Diagram with top 10 best movies in terms of release date/stereo window violation handling trade-oﬀ

CS MSU Graphics & Media Lab 174 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality MSU Stereo-Film Quality Analysis Report 10

3.7 Overall Technical Quality

3.7.1 Disclaimer

1. Overall ratings in this section compare movies only in terms of technical quality measured using our metrics. A higher rank in a particular category doesn’t necessarily mean a viewer will prefer that movie.

2. Movie ranks in this section are based on the average rating for categories that correspond to the following metrics: vertical parallax, scale/rotation mismatch, color mismatch and sharpness mismatch (only for natively captured movies).

3. Our technical-quality comparison of converted and captured S3D movies is generally unfair, as it fails to take into account problems specific to converted movies. Quantitative assessment of 2D-to-3D conversion problems is a more complicated task; previous reports analyze some of these problems [3,5]. Comparing converted S3D movies with each other is also less than entirely fair for the same reason. Another reason is that technical-quality differences between top converted movies are negligible when measured using our metrics, whereas perceived quality is mostly defined by specific 2D-to-3D conversion problems, which are beyond the scope of this report.

CS MSU Graphics & Media Lab 175 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Budget Categories MSU Stereo-Film Quality Analysis Report 10

3.7.2 Budget Categories

Technical Quality Top 10 Best Natively Captured Movies (budget < $300K/min) 1. Stalingrad ($229K/min) Budget/min 2. Katy Perry: Part of Me ($127K/min) 3. One Direction: This Is Us ($93K/min) 4. Fright Night ($283K/min) 5. Sharks 3D ($98K/min) 6. Battle of the Year ($181K/min) 7. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 8. Texas Chainsaw 3D ($108K/min) 9. A Very Harold & Kumar 3D Christmas ($211K/min) 10. Flying Swords of Dragon Gate ($286K/min) 0 5 10 15 20 25 Average rating

Figure 3.112: Diagram with overall top 10 best natively captured movies with budgets less than $300K/minute

Technical Quality Top 10 Best Natively Captured Movies ($300 budget $1000K/min) 1. Life of Pi ($944K/min) Budget/min 2. The Great Gatsby ($739K/min) 3. Underworld: Awakening ($786K/min) 4. The Three Musketeers ($681K/min) 5. The Darkest Hour ($337K/min) 6. Step Up Revolution ($333K/min) 7. The Legend of Hercules ($707K/min) 8. Resident Evil: Retribution ($677K/min) 9. Final Destination 5 ($434K/min) 10. Spy Kids 3-D: Game Over ($464K/min) 0 5 10 15 20 25 30 Average rating

Figure 3.113: Diagram with overall top 10 best natively captured movies with budgets less than $1000K/minute and more than $300K/minute Technical Quality Top 10 Best Natively Captured Movies (budget > $1000K/min) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. The Hobbit: An Unexpected Journey ($1914K/min) 3. Prometheus ($1048K/min) 4. Oz the Great and Powerful ($1653K/min) 5. 47 Ronin ($1470K/min) 6. TRON: Legacy ($1360K/min) 7. Pirates of the Caribbean: On Stranger Tides ($1838K/min) 8. Jack the Giant Slayer ($1710K/min) 9. Avatar ($1462K/min) 10. Hugo ($1349K/min) 0 5 10 15 20 Average rating

Figure 3.114: Diagram with overall top 10 best natively captured movies with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 176 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Budget Categories MSU Stereo-Film Quality Analysis Report 10

Technical Quality Top 10 Best Movies (budget < $300K/min) 1. Stalingrad ($229K/min) Natively Captured 2. Piranha 3D ($272K/min) 3. Mummies: Secrets of the Pharaohs ($102K/min) 2D-3D Conversion 4. Katy Perry: Part of Me ($127K/min) CGI 5. One Direction: This Is Us ($93K/min) Hybrid 6. Sharks 3D ($98K/min) Budget/min 7. Fright Night ($283K/min) 8. Texas Chainsaw 3D ($108K/min) 9. Saw 3D: The Final Chapter ($222K/min) 10. Battle of the Year ($181K/min) 0 10 20 30 40 50 60 Average rating

Figure 3.115: Diagram with overall top 10 best movies with budgets less than $300K/minute Technical Quality Top 10 Best Movies ($300 budget $1000K/min) 1. The Wolverine ($952K/min) Natively Captured 2. The Smurfs 2 ($1000K/min) 3. I, Frankenstein ($698K/min) 2D-3D Conversion 4. Ghost Rider: Spirit of Vengeance ($593K/min) CGI 5. Immortals ($681K/min) Hybrid 6. Percy Jackson: Sea of Monsters ($849K/min) Budget/min 7. Priest ($689K/min) 8. Abraham Lincoln: Vampire Hunter ($657K/min) 9. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) 10. Conan the Barbarian ($619K/min) 0 5 10 15 20 Average rating

Figure 3.116: Diagram with overall top 10 best movies with budgets less than $1000K/minute and more than $300K/minute Technical Quality Top 10 Best Movies (budget > $1000K/min) 1. Man of Steel ($1573K/min) Natively Captured 2. Thor: The Dark World ($1517K/min) 3. Wrath of the Titans ($1515K/min) 2D-3D Conversion 4. Captain America: The First Avenger ($1129K/min) CGI 5. The Last Airbender ($1456K/min) Hybrid 6. Iron Man 3 ($1526K/min) Budget/min 7. World War Z ($1637K/min) 8. Green Lantern ($1769K/min) 9. R.I.P.D. ($1354K/min) 10. Men in Black 3 ($2122K/min) 0 2 4 6 8 10 12 14 16 Average rating

Figure 3.117: Diagram with overall top 10 best movies with budgets more than $1000K/minute

CS MSU Graphics & Media Lab 177 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

3.7.3 Release Date Categories

Technical Quality Top 10 Best Natively Captured Movies (released in 2010 and earlier) 1. TRON: Legacy ($1360K/min) Budget/min 2. Sharks 3D ($98K/min) 3. Avatar ($1462K/min) 4. Saw 3D: The Final Chapter ($222K/min) 5. Spy Kids 3-D: Game Over ($464K/min) 6. Into the Deep ($n/a K/min) 7. Ghosts of the Abyss ($213K/min) 8. Space Station 3D ($n/a K/min) 9. Resident Evil: Afterlife ($618K/min) 10. The Child's Eye ($46K/min) 0 5 10 15 20 25 30 35 40 Average rating

Figure 3.118: Diagram with overall top 10 best natively captured movies released in 2010 and earlier

Technical Quality Top 10 Best Natively Captured Movies (released in 2011) 1. Pirates of the Caribbean: On Stranger Tides ($1838K/min) Budget/min 2. Fright Night ($283K/min) 3. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 4. The Three Musketeers ($681K/min) 5. Hugo ($1349K/min) 6. The Darkest Hour ($337K/min) 7. A Very Harold & Kumar 3D Christmas ($211K/min) 8. Flying Swords of Dragon Gate ($286K/min) 9. Final Destination 5 ($434K/min) 10. Legends of Flight ($66K/min) 0 5 10 15 20 25 30 35 Average rating

Figure 3.119: Diagram with overall top 10 best natively captured movies released in 2011 Technical Quality Top 10 Best Natively Captured Movies (released in 2012) 1. The Amazing Spider-Man ($1691K/min) Budget/min 2. The Hobbit: An Unexpected Journey ($1914K/min) 3. Katy Perry: Part of Me ($127K/min) 4. Prometheus ($1048K/min) 5. Life of Pi ($944K/min) 6. Underworld: Awakening ($786K/min) 7. Step Up Revolution ($333K/min) 8. Resident Evil: Retribution ($677K/min) 9. Dredd ($520K/min) 10. Journey 2: The Mysterious Island ($840K/min) 0 5 10 15 20 25 30 35 Average rating

Figure 3.120: Diagram with overall top 10 best natively captured movies released in 2012

CS MSU Graphics & Media Lab 178 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Technical Quality Top 10 Best Natively Captured Movies (released in 2013 and early 2014) 1. Stalingrad ($229K/min) Budget/min 2. Oz the Great and Powerful ($1653K/min) 3. 47 Ronin ($1470K/min) 4. One Direction: This Is Us ($93K/min) 5. The Great Gatsby ($739K/min) 6. Jack the Giant Slayer ($1710K/min) 7. Battle of the Year ($181K/min) 8. Texas Chainsaw 3D ($108K/min) 9. The Legend of Hercules ($707K/min)

0 5 10 15 20 25 Average rating

Figure 3.121: Diagram with overall top 10 best natively captured movies released in 2013 and early 2014 Technical Quality Top 10 Best Movies (released in 2010 and earlier) 1. The Last Airbender ($1456K/min) Natively Captured 2. Alice in Wonderland ($1851K/min) 3. The Chronicles of Narnia: The Voyage of the Dawn Treader ($1371K/min) 2D-3D Conversion 4. Clash of the Titans ($1179K/min) CGI 5. G-Force ($1704K/min) Hybrid 6. Bolt ($1562K/min) Budget/min 7. Gulliver's Travels ($1317K/min) 8. The Polar Express ($1650K/min) 9. Piranha 3D ($272K/min) 10. Mummies: Secrets of the Pharaohs ($102K/min) 0 5 10 15 20 25 30 35 Average rating

Figure 3.122: Diagram with overall top 10 best movies released in 2010 and earlier Technical Quality Top 10 Best Movies (released in 2011) 1. Captain America: The First Avenger ($1129K/min) Natively Captured 2. Green Lantern ($1769K/min) 3. Immortals ($681K/min) 2D-3D Conversion 4. Priest ($689K/min) CGI 5. Harry Potter and the Deathly Hallows: Part 2 ($961K/min) Hybrid 6. Conan the Barbarian ($619K/min) Budget/min 7. The Smurfs ($1067K/min) 8. Thor ($1304K/min) 9. The Nutcracker in 3D ($833K/min) 10. The Green Hornet ($1008K/min) 0 5 10 15 20 25 30 35 Average rating

Figure 3.123: Diagram with overall top 10 best movies released in 2011

CS MSU Graphics & Media Lab 179 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Release Date Categories MSU Stereo-Film Quality Analysis Report 10

Technical Quality Top 10 Best Movies (released in 2012) 1. Wrath of the Titans ($1515K/min) Natively Captured 2. Titanic ($n/a K/min) 3. Ghost Rider: Spirit of Vengeance ($593K/min) 2D-3D Conversion 4. Men in Black 3 ($2122K/min) CGI 5. John Carter ($1893K/min) Hybrid 6. Abraham Lincoln: Vampire Hunter ($657K/min) Budget/min 7. The Avengers ($1538K/min) 8. The Amazing Spider-Man ($1691K/min) 9. The Hobbit: An Unexpected Journey ($1914K/min) 10. Prometheus ($1048K/min) 0 5 10 15 20 25 30 35 40 Average rating

Figure 3.124: Diagram with overall top 10 best movies released in 2012 Technical Quality Top 10 Best Movies (released in 2013 and early 2014) 1. Man of Steel ($1573K/min) Natively Captured 2. The Wolverine ($952K/min) 3. Thor: The Dark World ($1517K/min) 2D-3D Conversion 4. The Smurfs 2 ($1000K/min) CGI 5. Iron Man 3 ($1526K/min) Hybrid 6. World War Z ($1637K/min) Budget/min 7. R.I.P.D. ($1354K/min) 8. I, Frankenstein ($698K/min) 9. Percy Jackson: Sea of Monsters ($849K/min) 10. G.I. Joe: Retaliation ($1181K/min) 0 5 10 15 20 Average rating

Figure 3.125: Diagram with overall top 10 best movies released in 2013 and early 2014

CS MSU Graphics & Media Lab 180 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Overall Categories MSU Stereo-Film Quality Analysis Report 10

3.7.4 Overall Categories

Technical Quality Top 10 Best Natively Captured Movies 1. Stalingrad ($229K/min) Budget/min 2. The Amazing Spider-Man ($1691K/min) 3. The Hobbit: An Unexpected Journey ($1914K/min) 4. Katy Perry: Part of Me ($127K/min) 5. Prometheus ($1048K/min) 6. Oz the Great and Powerful ($1653K/min) 7. 47 Ronin ($1470K/min) 8. One Direction: This Is Us ($93K/min) 9. Life of Pi ($944K/min) 10. TRON: Legacy ($1360K/min) 0 2 4 6 8 10 Average rating

Figure 3.126: Diagram with overall top 10 best natively captured movies

RRRR R R R Technical Quality Top 10 Natively Captured Movies with Best Budget/Quality Trade-off 1. Katy Perry: Part of Me ($127K/min) Budget/min 2. Stalingrad ($229K/min) 3. One Direction: This Is Us ($93K/min) 4. Sharks 3D ($98K/min) 5. Fright Night ($283K/min) 6. Sea Rex 3D: Journey to a Prehistoric World ($121K/min) 7. Texas Chainsaw 3D ($108K/min) 8. Battle of the Year ($181K/min) 9. The Darkest Hour ($337K/min) 10. A Very Harold & Kumar 3D Christmas ($211K/min) 0 2 4 6 8 10 12 Average rating

Figure 3.127: Diagram with overall top 10 best natively captured movies in terms of budget/quality trade-oﬀ Technical Quality Top 10 Natively Captured Movies with Best Release Date/Quality Trade-off 1. Sharks 3D ($98K/min, Nov 2008) Budget/min 2. TRON: Legacy ($1360K/min, Dec 2010) 3. Pirates of the Caribbean: On Stranger Tides ($1838K/min, May 2011) 4. The Amazing Spider-Man ($1691K/min, Jun 2012) 5. Prometheus ($1048K/min, Jun 2012) 6. Katy Perry: Part of Me ($127K/min, Jul 2012) 7. Avatar ($1462K/min, Dec 2009) 8. Fright Night ($283K/min, Aug 2011) 9. Sea Rex 3D: Journey to a Prehistoric World ($121K/min, Feb 2011) 10. Ghosts of the Abyss ($213K/min, Apr 2003) 0 2 4 6 8 10 12 14 Average rating

Figure 3.128: Diagram with overall top 10 best natively captured movies in terms of release date/quality trade-oﬀ

CS MSU Graphics & Media Lab 181 https://videoprocessing.ml/stereo_quality/ Movie Ratings Overall Technical Quality: Overall Categories MSU Stereo-Film Quality Analysis Report 10

Technical Quality Top 10 Best Movies 1. Man of Steel ($1573K/min) Natively Captured 2. The Wolverine ($952K/min) 3. Thor: The Dark World ($1517K/min) 2D-3D Conversion 4. Wrath of the Titans ($1515K/min) CGI 5. Captain America: The First Avenger ($1129K/min) Hybrid 6. The Smurfs 2 ($1000K/min) Budget/min 7. The Last Airbender ($1456K/min) 8. Iron Man 3 ($1526K/min) 9. World War Z ($1637K/min) 10. Green Lantern ($1769K/min) 0 2 4 6 8 10 12 14 Average rating

Figure 3.129: Diagram with overall top 10 best movies

CS MSU Graphics & Media Lab 182 https://videoprocessing.ml/stereo_quality/ Chapter 4

Movie Nominations

4.1 Disclaimer

1. This section presents a simple, concise overall movie ranking by number of nominations. We take into account only the top three places in each category; the previous section (Movie Ratings) presents more-detailed and more-comprehensive ratings.

2. Overall ratings in this section compare movies only in terms of technical quality measured using our metrics. A higher rank in a particular category doesn’t necessarily mean a viewer will prefer that movie. Higher ranking of a movie in some category doesn’t necessarily mean that this movie is indeed better for a viewer.

4.2 Movies With Best Technical Quality

1. Stalingrad (Average Depth Budget: 0.64%)

• Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Vertical Parallax among Natively Captured Movies (released in 2013 and early 2014) • First Place in Scale Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Rotation Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Color Mismatch (budget<$300K/min) • First Place in Vertical Parallax (budget<$300K/min) • First Place in Scale Mismatch (budget<$300K/min) • Second Place in Rotation Mismatch (budget<$300K/min) • First Place in Color Mismatch among Natively Captured Movies (budget<$300K/min) • Third Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • First Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min) • First Place in Scale Mismatch among Natively Captured Movies (budget<$300K/min) • First Place in Rotation Mismatch among Natively Captured Movies (budget<$300K/min)

2. Katy Perry: Part of Me (Average Depth Budget: 0.35%)

• Second Place in Color Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Sharpness Mismatch/Budget Trade-off among Natively Captured Movies • First Place in Vertical Parallax/Budget Trade-off among Natively Captured Movies • Second Place in Scale Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Rotation Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Sharpness Mismatch among Natively Captured Movies • Third Place in Vertical Parallax among Natively Captured Movies • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2012) • Second Place in Vertical Parallax among Natively Captured Movies (released in 2012) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2012) • Third Place in Color Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min) • Third Place in Scale Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Rotation Mismatch among Natively Captured Movies (budget<$300K/min)

3. The Amazing Spiderman (Average Depth Budget: 0.56%)

• First Place in Color Mismatch among Natively Captured Movies • Third Place in Scale Mismatch among Natively Captured Movies

CS MSU Graphics & Media Lab 184 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Second Place in Rotation Mismatch among Natively Captured Movies • Third Place in Color Mismatch (released in 2012) • First Place in Color Mismatch among Natively Captured Movies (released in 2012) • Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2012) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2012) • Second Place in Scale Mismatch among Natively Captured Movies (released in 2012) • First Place in Rotation Mismatch among Natively Captured Movies (released in 2012) • First Place in Color Mismatch among Natively Captured Movies (budget>$1000K/min) • First Place in Sharpness Mismatch among Natively Captured Movies (budget>$1000K/min) • Second Place in Vertical Parallax among Natively Captured Movies (budget>$1000K/min) • Second Place in Scale Mismatch among Natively Captured Movies (budget>$1000K/min) • First Place in Rotation Mismatch among Natively Captured Movies (budget>$1000K/min)

4. One Direction: This Is Us (Average Depth Budget: 0.52%)

• Third Place in Color Mismatch/Budget Trade-off among Natively Captured Movies • First Place in Sharpness Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Vertical Parallax/Budget Trade-off among Natively Captured Movies • Third Place in Rotation Mismatch/Budget Trade-off among Natively Captured Movies • First Place in Sharpness Mismatch among Natively Captured Movies • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2013 and early 2014) • First Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • Third Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min)

5. The Wolverine (2D-3D Conversion, Average Depth Budget: 1.36%)

• Third Place in Vertical Parallax • First Place in Scale Mismatch • First Place in Rotation Mismatch • Second Place in Vertical Parallax (released in 2013 and early 2014) • First Place in Scale Mismatch (released in 2013 and early 2014) • First Place in Rotation Mismatch (released in 2013 and early 2014) • First Place in Vertical Parallax ($300

6. The Last Airbender (2D-3D Conversion, Average Depth Budget: 0.24%)

CS MSU Graphics & Media Lab 185 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• First Place in Vertical Parallax • Second Place in Scale Mismatch • Second Place in Rotation Mismatch • First Place in Vertical Parallax (released in 2010 and earlier) • First Place in Scale Mismatch (released in 2010 and earlier) • First Place in Rotation Mismatch (released in 2010 and earlier) • First Place in Vertical Parallax (budget>$1000K/min) • First Place in Scale Mismatch (budget>$1000K/min) • First Place in Rotation Mismatch (budget>$1000K/min)

7. The Hobbit: An Unexpected Journey (Average Depth Budget: 0.82%)

• Third Place in Rotation Mismatch among Natively Captured Movies • Second Place in Color Mismatch among Natively Captured Movies (released in 2012) • Third Place in Scale Mismatch among Natively Captured Movies (released in 2012) • Second Place in Rotation Mismatch among Natively Captured Movies (released in 2012) • Third Place in Color Mismatch among Natively Captured Movies (budget>$1000K/min) • Third Place in Vertical Parallax among Natively Captured Movies (budget>$1000K/min) • Third Place in Scale Mismatch among Natively Captured Movies (budget>$1000K/min) • Second Place in Rotation Mismatch among Natively Captured Movies (budget>$1000K/min)

8. Life of Pi (Average Depth Budget: 0.74%)

• Third Place in Sharpness Mismatch among Natively Captured Movies • Third Place in Color Mismatch among Natively Captured Movies (released in 2012) • Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2012) • First Place in Color Mismatch among Natively Captured Movies ($300

9. Sharks 3D (Average Depth Budget: 2.27%)

• Third Place in Rotation Mismatch/Release Date Trade-off among Natively Captured Movies • First Place in Scale Mismatch/Budget Trade-off among Natively Captured Movies • First Place in Rotation Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Color Mismatch among Natively Captured Movies (released in 2010 and earlier) • Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2010 and earlier) • Second Place in Scale Mismatch among Natively Captured Movies (released in 2010 and earlier)

CS MSU Graphics & Media Lab 186 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• First Place in Rotation Mismatch among Natively Captured Movies (released in 2010 and earlier) • Third Place in Rotation Mismatch among Natively Captured Movies (budget<$300K/min)

10. Prometheus (Average Depth Budget: 0.87%)

• Second Place in Vertical Parallax among Natively Captured Movies • Second Place in Scale Mismatch among Natively Captured Movies • First Place in Vertical Parallax among Natively Captured Movies (released in 2012) • First Place in Scale Mismatch among Natively Captured Movies (released in 2012) • First Place in Vertical Parallax among Natively Captured Movies (budget>$1000K/min) • First Place in Scale Mismatch among Natively Captured Movies (budget>$1000K/min) • Third Place in Rotation Mismatch among Natively Captured Movies (budget>$1000K/min)

11. Man of Steel (2D-3D Conversion, Average Depth Budget: 0.84%)

• Second Place in Vertical Parallax • Second Place in Color Mismatch (released in 2013 and early 2014) • First Place in Vertical Parallax (released in 2013 and early 2014) • Second Place in Rotation Mismatch (released in 2013 and early 2014) • Third Place in Color Mismatch (budget>$1000K/min) • Second Place in Vertical Parallax (budget>$1000K/min) • Third Place in Rotation Mismatch (budget>$1000K/min)

12. TRON: Legacy (Average Depth Budget: 0.75%)

• Third Place in Sharpness Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies • Third Place in Color Mismatch among Natively Captured Movies • First Place in Color Mismatch among Natively Captured Movies (released in 2010 and earlier) • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2010 and earlier) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2010 and earlier) • Second Place in Color Mismatch among Natively Captured Movies (budget>$1000K/min) • Second Place in Sharpness Mismatch among Natively Captured Movies (budget>$1000K/min)

13. Wrath of the Titans (2D-3D Conversion, Average Depth Budget: 0.73%)

• Third Place in Rotation Mismatch • First Place in Vertical Parallax (released in 2012) • Third Place in Scale Mismatch (released in 2012) • First Place in Rotation Mismatch (released in 2012) • Third Place in Vertical Parallax (budget>$1000K/min) • Second Place in Rotation Mismatch (budget>$1000K/min)

CS MSU Graphics & Media Lab 187 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

14. The Smurfs 2 (2D-3D Conversion, Average Depth Budget: 1.09%)

• Third Place in Vertical Parallax (released in 2013 and early 2014) • Third Place in Scale Mismatch (released in 2013 and early 2014) • Second Place in Vertical Parallax ($300

15. Fright Night (Average Depth Budget: 1.08%)

• First Place in Color Mismatch among Natively Captured Movies (released in 2011) • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2011) • Second Place in Scale Mismatch among Natively Captured Movies (released in 2011) • Second Place in Rotation Mismatch among Natively Captured Movies (released in 2011) • Second Place in Color Mismatch among Natively Captured Movies (budget<$300K/min)

16. Saw 3D: The Final Chapter (Average Depth Budget: 1.26%)

• Second Place in Vertical Parallax among Natively Captured Movies (released in 2010 and earlier) • First Place in Scale Mismatch among Natively Captured Movies (released in 2010 and earlier) • Second Place in Rotation Mismatch among Natively Captured Movies (released in 2010 and earlier) • Third Place in Scale Mismatch (budget<$300K/min) • Second Place in Scale Mismatch among Natively Captured Movies (budget<$300K/min)

17. Thor: The Dark World (2D-3D Conversion, Average Depth Budget: 1.13%)

• Third Place in Scale Mismatch • Second Place in Scale Mismatch (released in 2013 and early 2014) • Third Place in Rotation Mismatch (released in 2013 and early 2014) • Second Place in Scale Mismatch (budget>$1000K/min)

18. Immortals (2D-3D Conversion, Average Depth Budget: 0.77%)

• Third Place in Color Mismatch • Second Place in Color Mismatch (released in 2011) • Third Place in Vertical Parallax (released in 2011) • Second Place in Color Mismatch ($300

19. Pirates of the Caribbean: On Stranger Tides (Average Depth Budget: 0.94%)

• Second Place in Color Mismatch among Natively Captured Movies (released in 2011) • First Place in Vertical Parallax among Natively Captured Movies (released in 2011) • First Place in Scale Mismatch among Natively Captured Movies (released in 2011) • First Place in Rotation Mismatch among Natively Captured Movies (released in 2011)

CS MSU Graphics & Media Lab 188 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

20. Into the Deep (Average Depth Budget: 3.74%)

• Second Place in Scale Mismatch/Release Date Trade-oﬀ among Natively Captured Movies • First Place in Rotation Mismatch/Release Date Trade-oﬀ among Natively Captured Movies • Third Place in Scale Mismatch among Natively Captured Movies (released in 2010 and earlier) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2010 and earlier)

21. The Great Gatsby (Average Depth Budget: 1.20%)

• Third Place in Color Mismatch among Natively Captured Movies ($300

22. Mummies: Secrets of the Pharaohs (2D-3D Conversion, Average Depth Budget: 0.86%)

• Second Place in Color Mismatch (budget<$300K/min) • Third Place in Vertical Parallax (budget<$300K/min) • Second Place in Scale Mismatch (budget<$300K/min) • Third Place in Rotation Mismatch (budget<$300K/min)

23. Captain America: The First Avenger (2D-3D Conversion, Average Depth Budget: 0.83%)

• First Place in Vertical Parallax (released in 2011) • First Place in Scale Mismatch (released in 2011) • First Place in Rotation Mismatch (released in 2011)

24. The Three Musketeers (Average Depth Budget: 0.77%)

• Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2011) • Third Place in Scale Mismatch among Natively Captured Movies (released in 2011) • Third Place in Sharpness Mismatch among Natively Captured Movies ($300

25. Men in Black 3 (2D-3D Conversion, Average Depth Budget: 1.12%)

• First Place in Scale Mismatch (released in 2012) • Second Place in Rotation Mismatch (released in 2012) • Third Place in Scale Mismatch (budget>$1000K/min)

26. 47 Ronin (Average Depth Budget: 0.79%)

• Second Place in Color Mismatch among Natively Captured Movies (released in 2013 and early 2014)

CS MSU Graphics & Media Lab 189 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Third Place in Scale Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2013 and early 2014)

27. Underworld: Awakening (Average Depth Budget: 0.69%)

• Second Place in Color Mismatch among Natively Captured Movies ($300

28. Clash of the Titans (2D-3D Conversion, Average Depth Budget: 0.66%)

• Second Place in Color Mismatch • First Place in Color Mismatch (released in 2010 and earlier) • First Place in Color Mismatch (budget>$1000K/min)

29. Green Lantern (2D-3D Conversion, Average Depth Budget: 0.67%)

• Second Place in Vertical Parallax (released in 2011) • Second Place in Scale Mismatch (released in 2011) • Second Place in Rotation Mismatch (released in 2011)

30. The Chronicles of Narnia: The Voyage of the Dawn Treader (2D-3D Conversion, Average Depth Budget: 0.78%)

• Second Place in Color Mismatch (released in 2010 and earlier) • Third Place in Vertical Parallax (released in 2010 and earlier) • Third Place in Scale Mismatch (released in 2010 and earlier)

31. Piranha 3D (2D-3D Conversion, Average Depth Budget: 0.84%)

• Third Place in Color Mismatch (budget<$300K/min) • Second Place in Vertical Parallax (budget<$300K/min) • First Place in Rotation Mismatch (budget<$300K/min)

32. Titanic (2D-3D Conversion, Average Depth Budget: 1.55%)

• Second Place in Color Mismatch (released in 2012) • Second Place in Scale Mismatch (released in 2012) • Third Place in Rotation Mismatch (released in 2012)

33. Alice in Wonderland (2D-3D Conversion, Average Depth Budget: 1.24%)

• Third Place in Color Mismatch (released in 2010 and earlier) • Second Place in Scale Mismatch (released in 2010 and earlier)

CS MSU Graphics & Media Lab 190 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Second Place in Rotation Mismatch (released in 2010 and earlier)

34. Priest (2D-3D Conversion, Average Depth Budget: 0.78%)

• First Place in Color Mismatch • First Place in Color Mismatch (released in 2011) • First Place in Color Mismatch ($300

35. Spy Kids 3-D: Game Over (Average Depth Budget: 2.40%)

• Second Place in Sharpness Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies • First Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies • Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2010 and earlier)

36. Oz the Great and Powerful (Average Depth Budget: 1.05%)

• Second Place in Vertical Parallax among Natively Captured Movies (released in 2013 and early 2014) • Second Place in Scale Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Second Place in Rotation Mismatch among Natively Captured Movies (released in 2013 and early 2014)

37. Iron Man 3 (2D-3D Conversion, Average Depth Budget: 1.11%)

• First Place in Color Mismatch (released in 2013 and early 2014) • Second Place in Color Mismatch (budget>$1000K/min)

38. Ghost Rider: Spirit of Vengeance (2D-3D Conversion, Average Depth Budget: 0.38%)

• First Place in Color Mismatch (released in 2012) • Third Place in Rotation Mismatch ($300

39. Hugo (Average Depth Budget: 1.57%)

• Third Place in Color Mismatch among Natively Captured Movies (released in 2011) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2011)

40. Jack the Giant Slayer (Average Depth Budget: 0.84%)

• Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Sharpness Mismatch among Natively Captured Movies (budget>$1000K/min)

CS MSU Graphics & Media Lab 191 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

41. Dial M for Murder (Average Depth Budget: 2.02%)

• First Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies • First Place in Scale Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

42. Abraham Lincoln: Vampire Hunter (2D-3D Conversion, Average Depth Budget: 1.12%)

• Third Place in Vertical Parallax (released in 2012) • Third Place in Vertical Parallax ($300

43. Avatar (Average Depth Budget: 1.69%)

• Third Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies • First Place in Vertical Parallax among Natively Captured Movies (released in 2010 and earlier)

44. Space Station 3D (Average Depth Budget: 2.06%)

• Second Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies • Second Place in Rotation Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies

45. Harry Potter and the Deathly Hallows: Part 2 (2D-3D Conversion, Average Depth Budget: 0.47%)

• Third Place in Color Mismatch (released in 2011) • Third Place in Color Mismatch ($300

46. Conan the Barbarian (2D-3D Conversion, Average Depth Budget: 0.50%)

• Third Place in Scale Mismatch (released in 2011) • Third Place in Rotation Mismatch (released in 2011)

47. A Very Harold & Kumar 3D Christmas (Average Depth Budget: 0.89%)

• Second Place in Vertical Parallax among Natively Captured Movies (released in 2011) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2011)

48. John Carter (2D-3D Conversion, Average Depth Budget: 1.17%)

• Second Place in Vertical Parallax (released in 2012)

49. Battle of the Year (Average Depth Budget: 0.91%)

CS MSU Graphics & Media Lab 192 https://videoprocessing.ml/stereo_quality/ Movie Nominations Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Third Place in Color Mismatch among Natively Captured Movies (released in 2013 and early 2014)

50. Percy Jackson: Sea of Monsters (2D-3D Conversion, Average Depth Budget: 1.18%)

• Third Place in Color Mismatch (released in 2013 and early 2014)

51. Ghosts of the Abyss (Average Depth Budget: 2.56%)

• Third Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

52. Cirque du Soleil: Journey of Man (Average Depth Budget: 1.50%)

• Third Place in Scale Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

53. Step Up Revolution (Average Depth Budget: 1.15%)

• Third Place in Scale Mismatch among Natively Captured Movies ($300

54. Sea Rex 3D: Journey to a Prehistoric World (Average Depth Budget: 1.24%)

• Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2011)

55. Galapagos: The Enchanted Voyage (Average Depth Budget: 2.57%)

• First Place in Sharpness Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies

56. Bolt (CGI, Average Depth Budget: 1.61%)

• Second Place in Vertical Parallax (released in 2010 and earlier)

57. Creature from the Black Lagoon (Average Depth Budget: 3.18%)

• Second Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

58. I, Frankenstein (2D-3D Conversion, Average Depth Budget: 0.96%)

• Third Place in Scale Mismatch ($300

59. The Polar Express (CGI, Average Depth Budget: 1.54%)

• Third Place in Rotation Mismatch (released in 2010 and earlier)

60. Resident Evil: Retribution (Average Depth Budget: 0.87%)

• Second Place in Sharpness Mismatch among Natively Captured Movies ($300

CS MSU Graphics & Media Lab 193 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

61. My Bloody Valentine (Average Depth Budget: 1.69%)

• Third Place in Color Mismatch among Natively Captured Movies (released in 2010 and earlier)

4.3 Natively Captured Movies With Best Technical Quality

1. Stalingrad (Average Depth Budget: 0.64%)

• First Place in Color Mismatch/Budget Trade-off among Natively Captured Movies • Third Place in Sharpness Mismatch/Budget Trade-off among Natively Captured Movies • Third Place in Vertical Parallax/Budget Trade-off among Natively Captured Movies • Third Place in Scale Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Color Mismatch among Natively Captured Movies • First Place in Vertical Parallax among Natively Captured Movies • First Place in Scale Mismatch among Natively Captured Movies • First Place in Rotation Mismatch among Natively Captured Movies • First Place in Color Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Vertical Parallax among Natively Captured Movies (released in 2013 and early 2014) • First Place in Scale Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Rotation Mismatch among Natively Captured Movies (released in 2013 and early 2014) • First Place in Color Mismatch (budget<$300K/min) • First Place in Vertical Parallax (budget<$300K/min) • First Place in Scale Mismatch (budget<$300K/min) • Second Place in Rotation Mismatch (budget<$300K/min) • First Place in Color Mismatch among Natively Captured Movies (budget<$300K/min) • Third Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • First Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min) • First Place in Scale Mismatch among Natively Captured Movies (budget<$300K/min) • First Place in Rotation Mismatch among Natively Captured Movies (budget<$300K/min)

2. Katy Perry: Part of Me (Average Depth Budget: 0.35%)

• Second Place in Color Mismatch/Budget Trade-oﬀ among Natively Captured Movies

CS MSU Graphics & Media Lab 194 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Second Place in Sharpness Mismatch/Budget Trade-off among Natively Captured Movies • First Place in Vertical Parallax/Budget Trade-off among Natively Captured Movies • Second Place in Scale Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Rotation Mismatch/Budget Trade-off among Natively Captured Movies • Second Place in Sharpness Mismatch among Natively Captured Movies • Third Place in Vertical Parallax among Natively Captured Movies • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2012) • Second Place in Vertical Parallax among Natively Captured Movies (released in 2012) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2012) • Third Place in Color Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min) • Third Place in Scale Mismatch among Natively Captured Movies (budget<$300K/min) • Second Place in Rotation Mismatch among Natively Captured Movies (budget<$300K/min)

3. The Amazing Spiderman (Average Depth Budget: 0.56%)

• First Place in Color Mismatch among Natively Captured Movies • Third Place in Scale Mismatch among Natively Captured Movies • Second Place in Rotation Mismatch among Natively Captured Movies • Third Place in Color Mismatch (released in 2012) • First Place in Color Mismatch among Natively Captured Movies (released in 2012) • Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2012) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2012) • Second Place in Scale Mismatch among Natively Captured Movies (released in 2012) • First Place in Rotation Mismatch among Natively Captured Movies (released in 2012) • First Place in Color Mismatch among Natively Captured Movies (budget>$1000K/min) • First Place in Sharpness Mismatch among Natively Captured Movies (budget>$1000K/min) • Second Place in Vertical Parallax among Natively Captured Movies (budget>$1000K/min) • Second Place in Scale Mismatch among Natively Captured Movies (budget>$1000K/min) • First Place in Rotation Mismatch among Natively Captured Movies (budget>$1000K/min)

4. One Direction: This Is Us (Average Depth Budget: 0.52%)

CS MSU Graphics & Media Lab 195 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• First Place in Sharpness Mismatch among Natively Captured Movies • First Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2013 and early 2014) • First Place in Sharpness Mismatch among Natively Captured Movies (budget<$300K/min) • Third Place in Vertical Parallax among Natively Captured Movies (budget<$300K/min)

5. The Hobbit: An Unexpected Journey (Average Depth Budget: 0.82%)

6. Life of Pi (Average Depth Budget: 0.74%)

7. Sharks 3D (Average Depth Budget: 2.27%)

CS MSU Graphics & Media Lab 196 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

8. Prometheus (Average Depth Budget: 0.87%)

9. TRON: Legacy (Average Depth Budget: 0.75%)

10. Fright Night (Average Depth Budget: 1.08%)

11. Saw 3D: The Final Chapter (Average Depth Budget: 1.26%)

12. Pirates of the Caribbean: On Stranger Tides (Average Depth Budget: 0.94%)

CS MSU Graphics & Media Lab 197 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• First Place in Rotation Mismatch among Natively Captured Movies (released in 2011)

13. Into the Deep (Average Depth Budget: 3.74%)

14. The Great Gatsby (Average Depth Budget: 1.20%)

• Third Place in Color Mismatch among Natively Captured Movies ($300

15. The Three Musketeers (Average Depth Budget: 0.77%)

16. 47 Ronin (Average Depth Budget: 0.79%)

• Second Place in Color Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Scale Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Rotation Mismatch among Natively Captured Movies (released in 2013 and early 2014)

17. Underworld: Awakening (Average Depth Budget: 0.69%)

• Second Place in Color Mismatch among Natively Captured Movies ($300

18. Spy Kids 3-D: Game Over (Average Depth Budget: 2.40%)

• Second Place in Sharpness Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies • First Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies

CS MSU Graphics & Media Lab 198 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2010 and earlier)

19. Oz the Great and Powerful (Average Depth Budget: 1.05%)

20. Hugo (Average Depth Budget: 1.57%)

• Third Place in Color Mismatch among Natively Captured Movies (released in 2011) • Third Place in Vertical Parallax among Natively Captured Movies (released in 2011)

21. Jack the Giant Slayer (Average Depth Budget: 0.84%)

• Third Place in Sharpness Mismatch among Natively Captured Movies (released in 2013 and early 2014) • Third Place in Sharpness Mismatch among Natively Captured Movies (budget>$1000K/min)

22. Dial M for Murder (Average Depth Budget: 2.02%)

• First Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies • First Place in Scale Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

23. Avatar (Average Depth Budget: 1.69%)

• Third Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies • First Place in Vertical Parallax among Natively Captured Movies (released in 2010 and earlier)

24. Space Station 3D (Average Depth Budget: 2.06%)

• Second Place in Vertical Parallax/Release Date Trade-oﬀ among Natively Captured Movies • Second Place in Rotation Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies

25. A Very Harold & Kumar 3D Christmas (Average Depth Budget: 0.89%)

• Second Place in Vertical Parallax among Natively Captured Movies (released in 2011)

CS MSU Graphics & Media Lab 199 https://videoprocessing.ml/stereo_quality/ Movie Nominations Natively Captured Movies With Best Technical Quality MSU Stereo-Film Quality Analysis Report 10

• Third Place in Rotation Mismatch among Natively Captured Movies (released in 2011)

26. Battle of the Year (Average Depth Budget: 0.91%)

• Third Place in Color Mismatch among Natively Captured Movies (released in 2013 and early 2014)

27. Ghosts of the Abyss (Average Depth Budget: 2.56%)

• Third Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

28. Cirque du Soleil: Journey of Man (Average Depth Budget: 1.50%)

• Third Place in Scale Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

29. Step Up Revolution (Average Depth Budget: 1.15%)

• Third Place in Scale Mismatch among Natively Captured Movies ($300

30. Sea Rex 3D: Journey to a Prehistoric World (Average Depth Budget: 1.24%)

• Second Place in Sharpness Mismatch among Natively Captured Movies (released in 2011)

31. Galapagos: The Enchanted Voyage (Average Depth Budget: 2.57%)

• First Place in Sharpness Mismatch/Release Date Trade-oﬀ among Natively Cap- tured Movies

32. Creature from the Black Lagoon (Average Depth Budget: 3.18%)

• Second Place in Color Mismatch/Release Date Trade-oﬀ among Natively Captured Movies

33. Resident Evil: Retribution (Average Depth Budget: 0.87%)

• Second Place in Sharpness Mismatch among Natively Captured Movies ($300

34. My Bloody Valentine (Average Depth Budget: 1.69%)

• Third Place in Color Mismatch among Natively Captured Movies (released in 2010 and earlier)

CS MSU Graphics & Media Lab 200 https://videoprocessing.ml/stereo_quality/ Chapter 5

Unsolved Problems and Possible Next Steps

5.1 Universal Fatigue Metric

Among our main research areas is development of a general metric for predicting visual fatigue caused by watching S3D video. Some may argue that development of a universal fatigue metric is impossible owing to high and unpredictable variance in human reaction to S3D artifacts and to creative choices throughout the production. This variance does occur, but it doesn’t preclude creation of a universal metric. For example, one possibility is to predict the fraction of individuals who experience noticeable discomfort during or after watching a full-length S3D movie. This metric is reasonable and could be estimated directly by querying people in theaters. But predicting its value on the basis of the S3D content is a complicated task.

Figure 5.1: The illustration of diﬀerence between subjective evaluation results obtained while showing test scenes in straight and reverse order. Courtesy of CS MSU Graphics & Media Lab

Development of a universal fatigue metric involves a range of challenges associated with conducting proper subjective evaluations. For instance, while performing a subjective evaluation of channel-mismatch noticeability (our results appear in the Channel Mismatch section), we faced the problem of significantly different subjective marks when the test scenes were shown in reverse order compared with forward (each subject watched the sequence only once, either in forward or reverse order). Figure 5.1 illustrates this effect.The deviation clearly goes beyond statistical error and results from underlying dependencies that Unsolved Problems and Possible Next Steps Universal Fatigue Metric MSU Stereo-Film Quality Analysis Report 10 we neglected to take into account. Though we obtained our results by simple averaging of forward and backward passes, more-involved techniques may be beneficial. Other problems that further complicate proper fatigue estimation include the following: • The capabilities of binocular vision can vary dramatically among test subjects, so additional effort is necessary to correctly represent all groups of people. • We must explicitly consider the problems of stereoscopic-display technologies (crosstalk, low brightness, etc.) that can also lead to noticeable discomfort. • Because the effect of many minor artifacts (as opposed to several major ones that are immediately noticeable) can accumulate and produce noticeable fatigue only after long viewing sessions, capturing this kind of fatigue requires lengthy experiments.

Once the procedure for subjective evaluation of fatigue caused by S3D content is established, we will be able to develop a metric that predicts the results of these evaluations by analyzing S3D artifacts and other characteristic features of the content. We recognize, however, the many challenges and overall complexity of the task. Thus, we’re open to collaboration in this research area. Our main interest is cooperation with subjective-evaluation specialists, particularly in the ﬁelds of fatigue estimation and binocular vision.

We’re looking for scientiﬁc partnerships to develop a subjective-evaluation method If you’re interested in creating a universal fatigue metric for S3D, please contact us: 3dmovi- [email protected]

CS MSU Graphics & Media Lab 202 https://videoprocessing.ml/stereo_quality/ Unsolved Problems and Possible Next Steps Objective Fatigue-Estimation and Improvement of Artifact Metrics MSU Stereo-Film Quality Analysis Report 10

5.2 Objective Fatigue-Estimation and Improvement of Artifact Metrics

Approximate Entropy 1.3 +X Channel locations before 3D after 3D

+Y Fp1 Fp2 1.2

1.1 F7 F8 F3 Fz F4 1

ApEn(nat) 0.9 T3 C3 Cz C4 T4

0.8

P3 Pz P4 0.7 T5 T6

POz C3 C4 Cz F3 F4 F7 F8 Fp1 Fp2 Fz O1 O2 P3 P4 POz Pz T3 T4 Channels O1 O2 (a) Schematic illustration of channel locations (b) The results of measurements before and after viewing an S3D video 20 of 20 electrode locations shown Figure 5.2: An early result of applying EEG for evaluating fatigue caused by the low quality of S3D content. Courtesy of CS MSU Graphics & Media Lab

Another prominent research area is objective metrics for evaluating a test subject’s mental state as an alternative to subjective tests. But state-of-the-art techniques for objective fatigue estimation often fail to properly capture viewer discomfort caused by watching low-quality S3D content. For example, we’ve tried several techniques that objectively estimate discomfort caused by S3D video with swapped channels, including estimation of critical ﬂicker-fusion frequency (CFF). All of them exhibited practically no correlation with discomfort reported by the test subjects. One focus of our research is analysis of electroencephalography (EEG) results to objectively estimate visual fatigue and discomfort caused by S3D-content quality. Our ﬁrst attempts in this area have shown promising results (Figure 5.2).

Objective fatigue evaluations, as well as the subjective tests we describe in the previous section, are crucial for improving all of our metrics and making them more perceptually oriented rather than purely technical. Ground-truth fatigue estimates will also enable us to rate artifacts on the basis of their contribution to overall viewer fatigue and discomfort. This area is therefore vital to further progress of our project, and as always, we’re open to collaboration.

We are looking for scientiﬁc collaboration with specialists in fatigue analysis and binocular vision If you are interested in objective evaluation of fatigue and discomfort caused by watching S3D movies, please contact us: [email protected]

CS MSU Graphics & Media Lab 203 https://videoprocessing.ml/stereo_quality/ Unsolved Problems and Possible Next Steps Developing a Tool for S3D-Video Quality Assessment MSU Stereo-Film Quality Analysis Report 10

5.3 Developing a Tool for S3D-Video Quality Assessment

(a) A prototype of report graph for one metric

(b) User interface of an alpha version

Figure 5.3: An illustration of the proposed tool. Main features include automated report generation for arbitrary video sequence using a customizable set of quality metrics, highlighting the most severe errors, automatic generation of text descriptions for detected errors. Courtesy of YUVSoft Corp.

VQMT3D stands for “video quality measurement tool”, so developing a tool remains a major goal. Such a product would enable automatic quality assurance for S3D content according to a wide range of technical parameters for both converted and natively captured S3D movies. It could also simplify or even eliminate daily review sessions by automatically detecting the main problems and subsequently generating to-do lists for contractors. Figure 5.3 shows an alpha version.

A main reason why the tool remains in an early development stage is the stagnation of the S3D market and subsequent lack of demand. Few potential customers are ready to pay for such a product, so we’re looking for project partners.

We are looking for partnership in promoting S3D quality control tools and studios interested in using such tools If you are interested in promotion and sales or if you are interested in using quality control tools in your work, please contact us: [email protected]

CS MSU Graphics & Media Lab 204 https://videoprocessing.ml/stereo_quality/ Unsolved Problems and Possible Next Steps Performance Comparison of S3D-Artifact-Correction Tools MSU Stereo-Film Quality Analysis Report 10

5.4 Performance Comparison of S3D-Artifact-Correction Tools

Correction Tool/ Post-production Expert #1

Studio #1

......

Test S3D video Correction Tool/ samples Post-production Expert #M Comprehensive Studio #N report

Figure 5.4: Schematic illustration of proposed workﬂow for comparing S3D artifact correction tools and/or post-production studios. Courtesy of CS MSU Graphics & Media Lab

Another interesting possibility is an extensive independent performance comparison of automatic correction tools on the basis of both objective criteria (our quality-metric results, correction speed, etc.) and subjective criteria (expert evaluation of correction quality, usability, etc.). Alternatively, a comparison of volunteer postproduction studios could examine both the speed and quality of their work. In this scenario, studios would receive test S3D-video samples of varying correction diﬃculty, and independent experts would blindly assess the results. The analysis could employ some objective metrics as well. Figure 5.4 illustrates the overall scheme.

Our lab has vast experience in conducting similar comparisons for video-compression quality.Annual MSU video-codec comparisons (https://videoprocessing.ml/codecs/) are widely known throughout the community and have proven beneﬁcial to the industry. We’ve published 19 reports since 2003, totaling over 600,000 downloads. We believe introducing standards for S3D postproduction quality can also be helpful.

This project is in an early concept stage, so we welcome feedback and suggestions. We’re seeking experts and postproduction studios willing to participate in the comparison. In addition, we’re looking for independent funding (i.e., from partners with no conﬂict of interest) to support the project.

We are looking for experts and studios that are willing to participate in the comparison, as well as independent funding for the project If you are interested, please contact us: [email protected]

CS MSU Graphics & Media Lab 205 https://videoprocessing.ml/stereo_quality/ Unsolved Problems and Possible Next Steps Improving Analysis of 2D-to-3D Conversion MSU Stereo-Film Quality Analysis Report 10

5.5 Improving Analysis of 2D-to-3D Conversion

5555555

555555

5555555

(a) Schematic illustration of a common case where source image (b) An example per-frame chart depicting relative 2D source image is located exactly in the middle between the left and right views position

Figure 5.5: Source 2D image potentially can be located anywhere between the views of the resulting S3D video. The choice is usually dictated by speciﬁcs of the background texture, while the goal is to minimize the work on occlusion ﬁlling. Courtesy of CS MSU Graphics & Media Lab

Besides improving the edge-sharpness-mismatch metric [3,5], which remains unable to quantitatively assess 2D-to-3D conversion quality, we have two main research directions: more-thorough and more-accurate comparison of 2D and 3D versions of converted movies, and assessment of depth-map quality by detecting depth/motion inconsistencies. The main goal of this project is to ﬁnd reasonable ways to quantitatively assess 2D-to-3D conversion quality. Converted movies today have a major advantage in nearly all of our comparisons because we still lack quantitative metrics for analyzing 2D-to-3D conversion issues.

Planned improvements to the 2D- and 3D-version comparison include the following: • More-advanced quantitative analysis of geometric inconsistencies between 2D and 3D versions, such as global scaling transforms as well as local object scaling. These kinds of approaches are commonly used to simplify the conversion process. For instance, local scaling of foreground objects can reduce or eliminate the need to explicitly ﬁll occlusions. • Explicit estimation of source-frame position relative to left and right views in the resulting S3D video. The source image often resides in the exact middle between the left and right views, but many other conﬁgurations are possible (see Figure 5.5).

More-advanced analysis of depth-map quality would allow us to more robustly detect and assess the cardboard eﬀect. It would also let us detect regions that employed a rough or inaccurate depth map, leading to noticeable artifactsfor example, regions where depth-map edges fail to align with the real object edges..

We are looking for scientiﬁc collaboration on developing 2D-3D conversion technical quality metrics If you are interested in objective quality evaluation of 2D-3D conversion, please contact us: 3dmovi- [email protected]

CS MSU Graphics & Media Lab 206 https://videoprocessing.ml/stereo_quality/ Unsolved Problems and Possible Next Steps VR180 Analysis MSU Stereo-Film Quality Analysis Report 10

5.6 VR180 Analysis

VR180 is a new virtual-reality (VR) format that improves perception of VR video. Google announced details in April 2018. Comparison of the new format with existing 360 video reveals the following differences: • Economy. The new format focuses only on the front 180 degrees, because interesting events usually happen on that side of the video. A 360 video conveys not only the main image subject in front, but also the minor image in the back. • Stereoscopy. VR180 is a stereoscopic format, potentially improving the presence effect relative to 360 video. • Low cost. Even now, after the format’s release, some VR180 cameras are lower in price than, for example, a stereo rig. Many manufacturers (such as Lenovo, LucidCam and Yi) have already released VR180 cameras. • No stitching.This benefit is due to the architectural features of VR180 devices (they only use one fish-eye camera per view).

Note, however, that VR180 still has disadvantages: • No VR180-postprocessing software is available. • Inexpensive cameras capture poor stereoscopy, causing viewer discomfort.

Even a basic check of VR180 content has shown that its quality is similar to that of conventional stereoscopic movies from around the middle of the last century. Below are examples of artifacts we discovered in VR180 video.

Color distortion

The most convenient way to visualize this artifact is to think of a chessboard where motion compensation brings the right view to the left, then blocks are selected from the left and reduced right views in a staggered manner.

CS MSU Graphics & Media Lab 207 https://videoprocessing.ml/stereo_quality/ The diﬀerences in sharpness

These and many other VR180 artifacts can cause viewer discomfort and, as a result, slow or even reverse any growth in the popularity of this format. We understand this challenge, and we’re actively developing ways to assess VR180-video quality. List of publications

[1] D. Vatolin, A. Voronov, D. Sumin, G. Rozhkova, V. Napadovsky, A. Borisov, and M. Arsaev, “VQMT3D Project Stereo-Film-Quality Analysis Report 1,” 2013. [Online]. Available: http://compression.ru/video/vqmt3d/ﬁrst-report

[2] D. Vatolin, A. Voronov, D. Sumin, G. Rozhkova, V. Napadovsky, A. Borisov, and M. Arsaev, “VQMT3D Project Stereo-Film-Quality Analysis Report 2,” 2013. [Online]. Available: http://compression.ru/video/vqmt3d/second-report

[3] D. Vatolin, A. Voronov, D. Sumin, G. Rozhkova, V. Napadovsky, A. Bokov, V. Yanushkovsky, A. Belous, A. Shalpegin, A. Borisov, and M. Arsaev, “VQMT3D Project Stereo-Film-Quality Analysis Report 3,” 2013. [Online]. Available: http://compression.ru/video/vqmt3d/report3

[4] D. Vatolin, A. Voronov, D. Sumin, G. Rozhkova, V. Napadovsky, A. Belous, V. Yanushkovsky, A. Borisov, and M. Arsaev, “VQMT3D Project Stereo-Film-Quality Analysis Report 4,” 2013. [Online]. Available: http://compression.ru/video/vqmt3d/report4

[5] D. Vatolin, A. Voronov, D. Sumin, G. Rozhkova, V. Napadovsky, A. Bokov, V. Yanushkovsky, A. Belous, A. Shalpegin, A. Novikov, A. Borisov, and M. Arsaev, “VQMT3D Project Stereo-Film- Quality Analysis Report 5,” 2014. [Online]. Available: http://compression.ru/video/vqmt3d/report5

[6] D. Vatolin, A. Bokov, O. Cahen, W. Sewell, R. Copeland, T. Villepoux, A. Fedorov, A. Belous, and V. Yanushkovsky, “VQMT3D Project Stereo-Film-Quality Analysis Report 6,” 2014. [Online]. Available: http://compression.ru/video/vqmt3d/report6

[7] D. Vatolin, A. Bokov, O. Cahen, W. Sewell, R. Copeland, T. Villepoux, A. Fedorov, A. Belous, and V. Yanushkovsky, “VQMT3D Project Stereo-Film-Quality Analysis Report 7,” 2014. [Online]. Available: http://compression.ru/video/vqmt3d/report7

[8] D. Vatolin, A. Bokov, A. Shalpegin, S. Lavrushkin, V. Yanushkovsky, and A. Fedorov, “VQMT3D Project Stereo-Film-Quality Analysis Report 8,” 2015. [Online]. Available: http: //compression.ru/video/vqmt3d/report8

[9] A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov, “Towards automatic stereo-video quality assessment and detection of color and sharpness mismatch,” in International Conference on 3D Imaging (IC3D), 2012, pp. 1–6.

[10] A. Voronov, A. Borisov, and D. Vatolin, “System for automatic detection of distorted scenes in stereo video,” in Proceedings of the Sixth International Workshop on Video Processing and Quality Metrics (VPQM), 2012.

[11] D. Akimov, A. Shestov, A. Voronov, and D. Vatolin, “Automatic left-right channel swap detection,” in International Conference on 3D Imaging (IC3D), 2012.

[12] A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov, “Methodology for stereoscopic

209 LIST OF PUBLICATIONS LIST OF PUBLICATIONS MSU Stereo-Film Quality Analysis Report 10

motion-picture quality assessment,” in Stereoscopic Displays and Applications XXIV, Proceedings of SPIE 8648, 2013, pp. 864 810–864 810–14.

[13] A. Bokov, D. Vatolin, A. Zachesov, A. Belous, and M. Erofeev, “Automatic detection of artifacts in converted S3D video,” in Stereoscopic Displays and Applications XXV, Proceedings of SPIE 9011, 2014, pp. 901 112–901 112–14.

[14] A. Ploshkin and D. Vatolin, “Accurate method of temporal-shift estimation for 3d video,” in 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2018, pp. 1–4.

[15] S. Lavrushkin and D. Vatolin, “Channel-mismatch detection algorithm for stereoscopic video using convolutional neural network,” in 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2018, pp. 1–4.

[16] A. Khatiullin, M. Erofeev, and D. Vatolin, “Fast occlusion ﬁlling method for multiview video generation,” in 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2018, pp. 1–4.

[17] S. Lavrushkin, V. Lyudvichenko, and D. Vatolin, “Local method of color-diﬀerence correction between stereoscopic-video views,” in 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2018, pp. 1–4.

CS MSU Graphics & Media Lab 210 https://videoprocessing.ml/stereo_quality/