A Natural User Interface for Immersive Design Review Anastacia Macallister Iowa State University, [email protected]
Total Page:16
File Type:pdf, Size:1020Kb
Mechanical Engineering Conference Presentations, Mechanical Engineering Papers, and Proceedings 2014 A Natural User Interface for Immersive Design Review Anastacia MacAllister Iowa State University, [email protected] Eliot H. Winer Iowa State University, [email protected] Siemens PLM Software The Boeing Company Follow this and additional works at: https://lib.dr.iastate.edu/me_conf Part of the Computer-Aided Engineering and Design Commons, Ergonomics Commons, and the Operational Research Commons Recommended Citation MacAllister, Anastacia; Winer, Eliot H.; Siemens PLM Software; and The Boeing Company, "A Natural User Interface for Immersive Design Review" (2014). Mechanical Engineering Conference Presentations, Papers, and Proceedings. 180. https://lib.dr.iastate.edu/me_conf/180 This Conference Proceeding is brought to you for free and open access by the Mechanical Engineering at Iowa State University Digital Repository. It has been accepted for inclusion in Mechanical Engineering Conference Presentations, Papers, and Proceedings by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. A Natural User Interface for Immersive Design Review Abstract As markets demand engineered products faster, waiting on the cyclical design processes of the past is not an option. Instead, industry is turning to concurrent design and interdisciplinary teams. When these teams collaborate, engineering CAD tools play a vital role in conceptualizing and validating designs. These tools require significant user investment to master, due to challenging interfaces and an overabundance of features. These challenges often prohibit team members from using these tools for exploring alternatives. This paper presents a method allowing users to interact with a design using intuitive gestures and head tracking, all while keeping the model in a CAD format. Specifically, Siemens’ Teamcenter® Lifecycle Visualization Mockup (Mockup) was used to display the design geometry while modifications were made through a set of gestures captured by a Microsoft Kinect™ in real time. This proof of concept program allowed a user to rotate the scene, activate Mockup’s immersive menu, move the immersive wand, and manipulate the view based on head position. The er sult is an immersive user-friendly low cost platform for interdisciplinary design review. Disciplines Computer-Aided Engineering and Design | Ergonomics | Operational Research Comments This proceeding is published as MacAllister, Anastacia, Eliot Winer, Tsung-Pin Yeh, Daniel Seal, and Grant Degenhardt. "A Natural User Interface for Immersive Design Review." In ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. American Society of Mechanical Engineers, 2014. DOI: 10.1115/DETC2014-34633. Posted with permission. This conference proceeding is available at Iowa State University Digital Repository: https://lib.dr.iastate.edu/me_conf/180 Proceedings of the ASME 2014 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2014 August 17-20, 2014, Buffalo, New York, USA DETC2014-34633 A NATURAL USER INTERFACE FOR IMMERSIVE DESIGN REVIEW Anastacia MacAllister Dr. Eliot Winer Research Assistant Associate Professor Iowa State University Iowa State University Virtual Reality Applications Center Virtual Reality Applications Center Dept. of Mechanical Engineering Dept. of Mechanical Engineering Ames, Iowa, USA Ames, Iowa, USA Tsung-Pin Yeh Daniel Seal Software Engineer - Principal Program Manager Siemens PLM Software The Boeing Company Ames, Iowa, USA Immersive Development Environment St. Louis, Missouri, USA Grant Degenhardt Senior Engineer The Boeing Company St. Louis, Missouri, USA ABSTRACT INTRODUCTION As markets demand engineered products faster, waiting on Designing and validating new products like aircraft and the cyclical design processes of the past is not an option. machinery rely heavily on engineering tools. While these tools Instead, industry is turning to concurrent design and are very effective at creating, modifying, and evaluating interdisciplinary teams. When these teams collaborate, designs, they can be very cumbersome to learn for all except engineering CAD tools play a vital role in conceptualizing and practiced experts. CAD packages in general are dominated by validating designs. These tools require significant user a hierarchical approach for creating model representations [1]. investment to master, due to challenging interfaces and an This approach is often confusing to inexperienced or casual overabundance of features. These challenges often prohibit CAD users. team members from using these tools for exploring alternatives. With the recent emphasis on interdisciplinary design teams This paper presents a method allowing users to interact with a [2], those unaccustomed to CAD interfaces are forced to deal design using intuitive gestures and head tracking, all while with engineering tools to help evaluate designs. The significant keeping the model in a CAD format. Specifically, Siemens’ learning curve and stigma of difficulty associated with Teamcenter® Lifecycle Visualization Mockup (Mockup) was navigating engineering software creates a significant hurdle for used to display the design geometry while modifications were reviewing designs thoroughly. In addition, even if non- made through a set of gestures captured by a Microsoft engineering users wanted to familiarize themselves with CAD KinectTM in real time. This proof of concept program allowed a technology, they most likely do not have time, resources, or user to rotate the scene, activate Mockup’s immersive menu, access to these types of software tools. In light of this, a design move the immersive wand, and manipulate the view based on team often becomes reliant on a subset of its members to drive head position. The result is an immersive user-friendly low changes. This limits other group members’ ability to explore cost platform for interdisciplinary design review. and review these changes. Limits on the members lead to a sub-optimal functioning team as well as design output. Due to the lack of user centered design principles in many CAD interfaces, user navigation challenges do not come as a 1 Copyright © 2014 by ASME Downloaded From: http://proceedings.asmedigitalcollection.asme.org/ on 12/28/2017 Terms of Use: http://www.asme.org/about-asme/terms-of-use surprise [3, 4]. A way to deal with the deficiencies in CAD head tracking. These principles allow the user to develop a interfaces is to incorporate user-centered design principles seen better mental model of the design, thus helping them in many VR applications [5, 6, 7]. In addition, VR aids understand and identify possible issues early on in the design immersion through head tracking and provides more intuitive process. interaction modes [8, 9]. This immersion gives the user a more complete mental model of the design, improving understanding BACKGROUND and evaluation ability. VR systems though are often expensive Previous research relating to the work in this paper is and require considerable preparation work to load models and scattered into three main areas; research on team use of maintain the system, not to mention the space and setup technology, the benefits of VR, and natural user interfaces requirements. Large-scale VR systems are custom solutions (NUIs). Work in each of these areas influenced the building of tailored to the installations specific physical space and not the immersive low cost user-friendly design review prototype easily moved or repurposed. The custom nature of each presented in this paper. system, the space requirements, and cost make deploying traditional large VR systems challenging. As a result, many Teams and Technology companies that invest in VR have limited facilities. These Design teams today are increasingly made up of limited resources cannot support numerous dispersed teams that interdisciplinary backgrounds. Swink et al. points out in could benefit from more user-friendly evaluation tools. today’s world concurrent design is needed to meet customer Even though VR is becoming more affordable and easy to demands and to keep a company profitable in the fast paced implement, it is still another tool inserted into a crowded well- international market [10]. As a result, companies are favoring established workflow. VR programs for design review add concurrent design, leading to interdisciplinary teams. These additional expensive software/hardware to purchase and teams need effective tools that allow them to communicate and maintain to already budget conscientious departments. understand each aspect of the design process [11, 12]; helping In addition, VR does not often use the same file formats as them review designs and assemble strategies to pinpoint CAD programs. CAD program file types contain boundary potential roadblocks. representation (b-rep) data. B-rep based files contain The necessity for tools of this nature has not escaped information on the topology and exact geometry of the model. researchers. There exist numerous examples of past research Exact dimensions and surface relations allow designers to looking for ways to help teams collaborate and communicate. modify and evaluate models in engineering software packages. For example Liveboard, a device developed to display Converting from a CAD format to a VR format produces a information on a larger