Landscape Report
Total Page:16
File Type:pdf, Size:1020Kb
www.xr4all.eu XR4ALL (Grant Agreement 825545) “eXtended Reality for All” Coordination and Support Action D4.1: Landscape Report Issued by: Fraunhofer HHI Issue date: 30/11/2019 Due date: 30/11/2019 Work Package Leader: Fraunhofer HHI Start date of project: 01 December 2018 Duration: 30 months Document History Version Date Changes 0.1 31/07/2019 Draft structure 0.2 31/08/2019 Revised structure 0.3 05/11/2019 Comments from 1st review included 1.0 30/11/2019 Final version Dissemination Level PU Public X PP Restricted to other programme participants (including the EC Services) RE Restricted to a group specified by the consortium (including the EC Services) CO Confidential, only for members of the consortium (including the EC) Main authors Name Organisation Oliver Schreer HHI Ivanka Pelivan HHI Peter Kauff HHI Ralf Schäfer HHI Anna Hilsmann HHI Paul Chojecki HHI Thomas Koch HHI Ramon Wiegratz HHI Jérome Royan BCOM Muriel Deschanel BCOM Albert Murienne BCOM Laurent Launay BCOM Jacques Verly I3D Quality reviewers Name Organisation Jacques Verly I3D Muriel Deschanel BCOM LEGAL NOTICE The information and views set out in this report are those of the authors and do not necessarily reflect the official opinion of the European Union. Neither the European Union institutions and bodies nor any person acting on their behalf may be held responsible for the use which may be made of the information contained therein. © XR4ALL Consortium, 2019 This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement N° 825545. Reproduction is authorised provided the source is acknowledged. This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement N° 825545. Table of Contents 1 INTRODUCTION .................................................................................................................. 8 2 THE SCOPE OF EXTENDED REALITY ........................................................................................... 9 2.1 References.................................................................................................................................... 10 3 XR MARKET WATCH .......................................................................................................... 11 3.1 Market development and forecast .............................................................................................. 11 3.2 Areas of application ..................................................................................................................... 13 3.3 Investments .................................................................................................................................. 14 3.4 Shipment of devices ..................................................................................................................... 15 3.5 Main players ................................................................................................................................. 18 3.6 International, European and regional associations in XR ............................................................ 20 3.7 Patents ......................................................................................................................................... 23 3.8 References.................................................................................................................................... 24 4 XR TECHNOLOGIES ............................................................................................................ 26 4.1 Video capture for XR .................................................................................................................... 26 4.2 3D sound capture ......................................................................................................................... 29 4.3 Scene analysis and computer vision ............................................................................................ 32 4.4 3D sound processing algorithms .................................................................................................. 40 4.5 Input and output devices ............................................................................................................. 43 4.6 Cloud services .............................................................................................................................. 52 4.7 Conclusion .................................................................................................................................... 53 5 XR APPLICATIONS ............................................................................................................. 54 5.1 Advertising and commerce .......................................................................................................... 54 5.2 Design, engineering, and manufacturing ..................................................................................... 57 5.3 Health and medicine .................................................................................................................... 65 5.4 Journalism & weather .................................................................................................................. 75 5.5 Social VR ....................................................................................................................................... 75 5.6 Conclusion .................................................................................................................................... 82 6 STANDARDS .................................................................................................................... 83 6.1 XR specific standards.................................................................................................................... 83 6.2 XR related standards .................................................................................................................... 85 7 REVIEW OF CURRENT EC RESEARCH ....................................................................................... 89 7.1 References.................................................................................................................................... 91 8 CONCLUSION ................................................................................................................... 95 D4.1: Landscape Report Page 5 List of figures Figure 1: Extended reality scheme. ............................................................................................................. 9 Figure 2: VR/AR market forecast by Gartner and Credit Suisse [7]. ........................................................ 11 Figure 3: Market growth rates by worldwide regions [4]. ....................................................................... 12 Figure 4: AR/VR regional revenue between 2017 and 2022 [10]. ............................................................ 12 Figure 5: Distribution of VR/AR companies analysed in survey by Capgemini Research [13]. ............... 13 Figure 6: Separated AR and VR sector revenue from 2017 to 2022 [8]. .................................................. 14 Figure 7: XR4ALL analysis of European investors for start-ups [15]. ....................................................... 15 Figure 8: VR unit shipments in the last three years [17]. ......................................................................... 16 Figure 9: Forecast of AR unit shipments from 2016 to 2022 [19]. ............................................................ 17 Figure 10: Forecast of VR and AR shipments [20]. .................................................................................... 17 Figure 11: AR Industry Landscape by Venture Reality Fund [22]. ............................................................ 18 Figure 12: VR Industry Landscape by Venture Reality Fund [22]. ............................................................ 19 Figure 13: Comparison chart of VR headset resolutions [134]. ................................................................ 46 Figure 14: Examples for different AR applications in advertising and commerce ................................... 54 Figure 15: Sample views of ZREALITY virtual show room. ........................................................................ 55 Figure 16: The fashion eco-system. ........................................................................................................... 55 Figure 17: AR application for assembly in industrial environment. ......................................................... 57 Figure 18: AR application for quality control in industrial environment. ................................................ 59 Figure 19: AR application for maintenance in industrial environment. ................................................... 60 Figure 20: AR application for planning in industrial environment. .......................................................... 62 Figure 21: AR application for logistics. ...................................................................................................... 63 Figure 22: AR application for training in industrial environment. ........................................................... 64 Figure 23: Example of training and learning use of AR in the medical domain. ..................................... 66 Figure 24: Example of pre-operative use of AR/VR. ................................................................................. 67 Figure