XR technologies for industrial SMEs: The VAMRs University-Business Cooperation Handbook 1 Table of content 1. INTRODUCTION TO THE VAMR*S UNIVERSITY-BUSINESS COOPERATION HANDBOOK ............... 7 2. DEVELOPING AUGMENTED PRODUCTS IN MANUFACTURING SMES ....................................... 13 3. DEVELOPING AUGMENTED SERVICES IN MANUFACTURING SMES .......................................... 34 4. HOW VIRTUAL AND AUGMENTED (VAM) REALITIES CAN SUPPORT THE DESIGN PROCESS IN MANUFACTURING SMES .................................................................................................... 46 5. HOW VIRTUAL, AUGMENTED AND MIXED (VAM) REALITIES CAN SUPPORT BUSINESS OPERATIONS IN MANUFACTURING SMES ............................................................................... 60 6. HOW VIRTUAL, AUGMENTED AND MIXED (VAM) REALITIES CAN SUPPORT AND ENHANCE MARKETING AND SALES IN MANUFACTURING SMES .............................................................. 76 7. HOW VIRTUAL AND AUGMENTED (VAM) REALITIES CAN SUPPORT AND ENHANCE COLLABORATION .................................................................................................................... 88 8. LEGAL & REGULATORY CHALLENGES REGARDING VR, AR, AND MR APPLICATIONS ............... 100 9. STRATEGIC AND MANAGERIAL OPPORTUNITIES AND CHALLENGES ...................................... 111 10. VAM*RS HEI – SME COOPERATION STANDARDS ................................................................... 133 2 List of figures Figure 1: The VAM*Rs HEi - SME Cooperation route map ............................................................................ 10 Figure 2: Animated artificial Siberian husky dog rendered in the user’s actual environment using a smartphone and Google Search. The user environment is scanned and mapped to the digital environment using an intelligent method. .................................................................................... 15 Figure 3: A futuristic car dashboard concept. Augmented reality is used to enhance driving safety and ease of navigation. ........................................................................................................................ 16 Figure 4: The five-dimensional model of digital twins reproduced in a simplified form from [6]. The dimensions are as follows: (1) the physical entity shown in the diagram as an industrial plant on the left; (2) the virtual entity ¬– a digital representation of the plant; (3) a database for storing information about both the real plant and its digital twin; (4) services which expose the functions of both the physical and the virtual entity to end users; and (5) all the connections between these nodes. ............................................................................................... 18 Figure 5: An example of a digital twin of plant machinery. The user can interact with the digital twin to learn the operation without using actual machinery. Thus, there is no down-time for actual working processes, while the user successfully learns to operate the unit. ....................... 19 Figure 6: Example of a factory floor scanning application in the form of augmented reality: the additional arrows and warning dialog window appear overlaid on top of the actual system of pipes, valves, and actuators. The user can thus make a quick decision to ensure the continued safe operation of the plant. .......................................................................................... 20 Figure 7: Example of a user interface implemented in Microsoft HoloLens 2. The user is manipulating a hologram ¬– essentially a digital twin ¬– of a red chair. ............................................................. 25 Figure 8: The smartphone quickly identifies a marker placed into the real environment and inserts a model of a house to the marker. Obtaining the location and orientation of the marker is a relatively inexpensive operation and can be easily performed offline without having access to cloud computing. ...................................................................................................................... 25 Figure 9: Use a smart device to place a piece of furniture into your living room to see whether it fits your decor before purchasing it. ................................................................................................... 26 Figure 10: A high-resolution digital twin of a Volvo car model appearing, layer by layer, before the user of the Varjo XR-1 head-mounted display in a real environment. The user can enter the vehicle and get transported into a different location. ................................................................... 27 Figure 11: The user directly influences the controller which is responsible for liquid level regulation in the laboratory model of a multitank system [7]. ........................................................................... 27 Figure 12: Microsoft HoloLens used in a production process at BMW. The digital twin serves here as a guide for the engineer. .................................................................................................................. 28 Figure 13: The industrial designer or operator can build robots for different applications using a modular kit with Autodesk Fusion 360. The robot can then be placed into the intended space in AR and tested. ........................................................................................................................... 28 3 Figure 14: Printed circuit board check in AR using Microsoft HoloLens. ......................................................... 29 Figure 15: Using Microsoft HoloLens 2 to navigate through workplace data using natural gestures. ............ 30 Figure 16: Technician instructions for testing an electrical system. ............................................................... 30 Figure 17: Operator instructions for checking a certain system in augmented reality. .................................. 31 Figure 18: Example of augmented remote assistance in the maintenance of an electrical system. ............... 31 Figure 19: An engineer is provided with AR support during a repair. ............................................................. 35 Figure 20: a) Average number of errors in each treatment; (b) Average time of completion in each treatment ...................................................................................................................................... 36 Figure 21: (a) Visualization of virtual robots and machinery in a plant-environment; (b) System-up AR- Plan. ............................................................................................................................................... 38 Figure 22: DIHK Textbook ............................................................................................................................... 42 Figure 23: Design thinking process ................................................................................................................. 47 Figure 24: Design review with R3DT ............................................................................................................... 49 Figure 25: AR product visualization with 3DQR............................................................................................... 53 Figure 26: Business Operation with XR Source: Original. ................................................................................ 61 Figure 27: Iristick in industrial use .................................................................................................................. 62 Figure 28: Example Augmented reality real-time updates .............................................................................. 63 Figure 29: Worker data management ............................................................................................................. 64 Figure 30: Example of Augmented reality Order picking ................................................................................ 65 Figure 31: Example of Virtual reality industrial training .................................................................................. 67 Figure 32: PointR use of AR for remote maintenace ....................................................................................... 68 Figure 33: Example of Remote maintenance using Augmented reality .......................................................... 69 Figure 34: Example of warehouse management using Augmented reality ..................................................... 72 Figure 35: Example of Warehouse management using Augmented Reality ................................................... 73 Figure 36: Virtual reality enables emotional experiences ............................................................................... 76 Figure 37: Complex product design. ............................................................................................................... 78 Figure 38: Mobile AR hardware is very accessible today. ............................................................................... 80 Figure 39: 360 cameras are getting smaller and better. ................................................................................. 82 4 Figure 40: XR Showroom provides VR and AR modes to showcase products. ................................................ 83 Figure 41: Lappset AR solution........................................................................................................................ 84 Figure