On-Screen Navigation for 3D Interaction on Multi-Touch-Displays

Total Page:16

File Type:pdf, Size:1020Kb

On-Screen Navigation for 3D Interaction on Multi-Touch-Displays On-Screen Navigation for 3D Interaction on Multi-Touch-Displays Aspects making the SGD navigation more intuitive Thesis Master of Advanced Studies in Human Computer Interaction Design ̶ Authors Stephan Egli; Mark S. Hirst; Hannes Sacher Coach Jacqueline Trachsler, Industrial Designer FH Date 19.01.2012 University of Basel University of Applied Sciences Rapperswil (HSR) University of Applied Sciences and Arts Northwestern Switzerland (FHNW) Abstract A usability test with novice users was conducted on an initial and an improved navigation concept. The tested system was a multi-touch-display using infrared technology with a limit of detecting two touch-points. The task for participants was to navigate through a virtual environment using either a widget or gesture-only based navigation concept. The goal of these tests was to assess which aspects influenced intuitiveness of a system for novice users as well as to collect user expectations. The results of these tests indicated that further investigations would be necessary in certain domains as some conclusions were based on assumptions. However, this thesis gives good insights on different aspects and gives further interesting areas to be explored. Keywords gestures; intuitiveness; learnability; multi-touch; navigation; novice users; touch- screen; usability; virtual environment; widget Egli, Hirst, Sacher i Declaration of Authorship We declare that we have developed and written the enclosed thesis completely by ourselves and have not used sources or means without declaration in the text. The Master Thesis has not been used in the same or in a similar version to achieve an academic grading or has been published elsewhere. Zurich, 19.01.2012 Stephan Egli Mark S. Hirst Hannes Sacher Egli, Hirst, Sacher iii Table of Contents 1 Introduction 1 1.1 Project Definition ............................................................................................................................. 1 1.2 The Subject ....................................................................................................................................... 1 1.3 Problem Domain .............................................................................................................................. 2 1.4 Relevance of this Work.................................................................................................................... 3 1.5 Timeline ............................................................................................................................................ 4 2 Theoretical Aspects of Virtual Environments 5 2.1 Intuitiveness – Definition and Method of Evaluation ................................................................... 5 2.2 Overview of 3D Technologies, Tasks, and Multi-Touch-Displays ................................................. 5 2.2.1 User Interfaces and Devices .............................................................................................. 6 2.2.2 Widgets ............................................................................................................................... 8 2.2.3 Degree of Freedom (DOF) .................................................................................................. 8 2.2.4 Tasks and Scenarios in Virtual Worlds............................................................................. 9 2.2.5 Navigation Metaphors Used in Virtual Environments................................................... 11 2.2.6 Navigation Interactions and Gestures ............................................................................ 11 2.2.7 Exploring Large-Scale 3D Astrophysical Simulations ................................................... 15 2.3 Known Issues Navigating through and Interacting with Virtual Worlds ................................... 16 2.4 Questions Which Are Of Special Interest ...................................................................................... 18 2.4.1 Are Interactions More Intuitive and Comprehensive with or without Widget? ........... 18 2.4.2 What Impact Do Navigation Metaphors Have on Intuitiveness? .................................. 18 2.4.3 Which Role Does Technology and Implementation Have on Intuitiveness and Learnability? .................................................................................................................... 18 2.5 Conclusions for the SGD Based on Literature and Current State-of-the-Art Solutions ............ 19 3 Evaluation of Initial Solution and Improvements 21 3.1 Approach and Methodology .......................................................................................................... 21 3.1.1 Requirements Analysis .................................................................................................... 21 3.1.2 Evaluating Initial Implementation .................................................................................. 22 3.1.3 Development of Solutions and Design Process .............................................................. 26 3.1.4 Evaluating Proposed Solutions ....................................................................................... 27 3.2 Description of the Initial Solution ................................................................................................ 29 3.3 PC and Display Hardware .............................................................................................................. 30 3.4 Provisional Personas ...................................................................................................................... 31 3.5 Results from the First Evaluation with Initial Solution ............................................................... 31 3.5.1 Main Usability Issues Identified ...................................................................................... 31 3.5.2 Main User Expectations Identified .................................................................................. 34 3.5.3 Interaction Success Rate .................................................................................................. 35 3.6 Designing an Intuitive Solution for Novice Users ....................................................................... 36 3.6.1 Design Key Aspects.......................................................................................................... 36 3.6.2 General Proposals ............................................................................................................ 38 3.6.3 Proposal A: Scene-in-Hand Metaphor with Widget Interaction ................................... 39 3.6.4 Proposal B: Eyeball-in-Hand Metaphor with Gestures-only Interaction...................... 42 3.6.5 Implementation ................................................................................................................ 46 iv Egli, Hirst, Sacher 3.7 Results from the Second Evaluation with Proposed Solutions ................................................... 49 3.7.1 Usability Issues Observed During the Usability Test ..................................................... 49 3.7.2 Participants’ Statements about the two Solutions ......................................................... 56 3.7.3 Overview of Resolution of Usability Issues and User Expectations.............................. 57 3.7.4 Rating and Preferences for Solution A and B ................................................................ 58 4 Discussion of Results and Conclusion 61 4.1 Theory versus Practice ................................................................................................................... 61 4.2 Conclusion for SGD ....................................................................................................................... 64 4.3 Future Work ................................................................................................................................... 65 5 A Critical Look Back on Scientific Approach and Methodology 69 5.1 HCI Methods ................................................................................................................................... 69 5.1.1 Research of Current Literature ........................................................................................ 69 5.1.2 Requirements Engineering .............................................................................................. 70 5.1.3 Evaluation of Initial Implementation ............................................................................. 70 5.1.4 Developments of Solutions and Design Process ............................................................ 71 5.1.5 Evaluation of Proposed Solutions .................................................................................. 71 5.2 Scientific Aspects of the Results ................................................................................................... 72 5.3 Lessons Learned ............................................................................................................................. 73 6 Glossary 75 7 Bibliography 77 8 Index of Tables 78 9 Index of Figures 81 10 Addendum 83 Egli, Hirst, Sacher v Introduction 1 Introduction This document represents the work of our master thesis. After an introduction, chapter 2 outlines the theoretical aspects of 3D interaction within the context of the subject and brings up questions that are of special interest. The team’s approach and used methodology is explained in chapter 3.1. The evaluation and results of the initial solution are described in chapter 3.5 and the proposed
Recommended publications
  • Designing a User Interface for Musical Gameplay
    Designing a User Interface for Musical Gameplay An Interactive Qualifying Project submitted to the faculty of WORCESTER POLYTECHNIC INSTITUTE in partial fulfillment of the requirements for the Degree of Bachelor of Science Submitted by: Tech Side: Hongbo Fang Alexander Guerra Xiaoren Yang Art Side: Kedong Ma Connor Thornberg Advisor Prof. Vincent J. Manzo Abstract A game is made up of many components, each of which require attention to detail in order to produce a game that is enjoyable to use and easy to learn. The graphical user interface, or GUI, is the method a game uses to communicate with the player and has a large impact on the gameplay experience. The goal of this project was to design a GUI for a music oriented game that allows players to construct a custom instrument using instruments they have acquired throughout the game. Based on our research of GUIs, we designed a prototype in Unity that incorporates a grid system that responds to keypress and mouse click events. We then performed a playtest and conducted a survey with students to acquire feedback about the simplicity and effectiveness of our design. We found that our design had some confusing elements, but was overall intuitive and easy to use. We found that facilitation may have impacted the results and should be taken into consideration for future development along with object labeling and testing sample size. 1 Acknowledgements We would like to thank Professor Vincent Manzo for selecting us to design an important feature of his game and for is support and encouragement throughout the duration of the project.
    [Show full text]
  • The Desktop (Overview)
    The desktop (overview) The desktop is the main screen area that you see after you turn on your computer and log on to Windows. Like the top of an actual desk, it serves as a surface for your work. When you open programs or folders, they appear on the desktop. You can also put things on the desktop, such as files and folders, and arrange them however you want. The desktop is sometimes defined more broadly to include the taskbar and Windows Sidebar. The taskbar sits at the bottom of your screen. It shows you which programs are running and allows you to switch between them. It also contains the Start button , which you can use to access programs, folders, and computer settings. On the side of the screen, Sidebar contains small programs called gadgets. The desktop, taskbar, and Sidebar Where did my desktop go? Because programs run on top of the desktop, the desktop itself is often partially or completely hidden. But it's still there, underneath everything. To see the whole desktop without closing any of your open programs or windows, click the Show Desktop button on the taskbar. The desktop is revealed. Click the icon again to restore all of your windows to the way they were. Desktop Training Session Handout Page 1 http://ict.maxwell.syr.edu/vista/ Working with desktop icons Icons are small pictures that represent files, folders, programs, and other items. When you first start Windows, you'll see at least one icon on your desktop: the Recycle Bin (more on that later).
    [Show full text]
  • Bforartists UI Redesign Design Document Part 2 - Theming
    Bforartists UI redesign Design document part 2 - Theming Content Preface...........................................................................................................................6 The editor and window types......................................................................................7 Python console.............................................................................................................8 Layout:................................................................................................................................................................8 The Console Window.........................................................................................................................................8 Menu bar with a menu........................................................................................................................................8 Dropdown box with icon....................................................................................................................................9 RMB menu for menu bar....................................................................................................................................9 Toolbar................................................................................................................................................................9 Button Textform..................................................................................................................................................9
    [Show full text]
  • Navigate Windows and Folders
    Windows® 7 Step by Step by Joan Preppernau and Joyce Cox To learn more about this book, visit Microsoft Learning at http://www.microsoft.com/MSPress/books/ 9780735626676 ©2009 Joan Preppernau and Joyce Cox Early Content—Subject to Change Windows 7 Step by Step Advance Content–Subject to Change Windows 7 Step by Step Draft Table of Contents Overview Front Matter ............................................................................................................................................. 3 Contents ................................................................................................................................................ 3 About the Authors ................................................................................................................................ 3 Features and Conventions of This Book ................................................................................................ 3 Using the Companion CD ...................................................................................................................... 3 Getting Help .......................................................................................................................................... 3 Introducing Windows 7 ......................................................................................................................... 3 Part I: Getting Started with Windows 7 .................................................................................................... 4 1 Explore Windows 7 ...........................................................................................................................
    [Show full text]
  • Editing the Home Screen Widgets:
    Brisbane German Club WordPress Website Manual 1 Table of Contents How To Add: A Page .............................................................................................................. 3 How To Edit: A Page .............................................................................................................. 4 How To Add: A Post ............................................................................................................... 8 How To Edit: A Post ............................................................................................................. 12 How To Edit: Home Page ..................................................................................................... 13 Editing the Home Screen Widgets: ....................................................................................... 19 How To Change: The Menu .................................................................................................. 22 Events & Calendar ............................................................................................................... 24 How To Add: a Hyperlink ..................................................................................................... 26 2 How To Add: A Page Step 1: Go to „Pages‟ on the left sidebar of the backend. Click „Add New‟ 3 How To Edit: A Page Step 1: Hold the cursor over any specific page. 4 options appear – to edit/ quick edit/ trash/ view. These are self-explanatory however to edit a page select the edit function or alternatively just click on
    [Show full text]
  • Review Interface Quick Reference
    Review Interface Review Interface Features Viewer type tabs Select which Viewer type you would like to view the current document in. Viewer Displays the current document in the selected Viewer. Document navigation Browse across documents in the Review queue. 9 6 8 1 2 3 Coding layouts Customizable coding forms for viewing and editing a document’s fields. 7 Related items card Identify and act on documents related to the active document. Document list List presentation of all the documents in the user’s Review queue. Viewer settings Menu of display configurations and review settings. 4 Keyboard Shortcut Displays the keyboard shortcuts legend. Legend Enable/Disable Turns keyboard shortcuts on or off. Keyboard Shortcuts Show/Hide Tab Strip Display or hide the Sidebar and Tab strip in the Viewer. Pop Out Viewer Select to open the Pop Out Viewer in a new browser window. Select to move the Coding Layout and the Document card to the opposite Swap Layout side of the Viewer from where they are currently located. Document Actions Menu of actions the user may perform on the document as a whole. 5 Download document Download the native file for the current document. Alternatively, you can native click on the document’s name to download the native. Copy document link Select to copy the URL to the current document to your clipboard. Select to open an email in your default email application with the URL to the Email document current document included in the body of the email. Replace document Select to replace the native file of the current document with a new file native Hover your cursor over this option and Image Profile options will display.
    [Show full text]
  • Vigil Client 10 | User's Guide
    Client 10 Remote Desktop Client Software User Guide Revised: June 1st, 2017 3xLOGIC Inc. ©2017 COPYRIGHT AND LEGAL NOTICES|VIGIL CLIENT 10 | USER'S GUIDE VIGIL Copyright ©2017 3xLOGIC, Inc. All rights reserved. 3xLOGIC Inc. 210-10385 Westmoor Drive Westminster, CO 80021 United States (303) 430-1969 Disclaimer Information in this document is subject to change without notice and does not represent a commitment on the part of 3xLOGIC Inc. The soft- ware and /or databases described in this document are furnished under a license agreement or nondisclosure agreement. They may be used or copied only in accordance with the terms of the agreement. It is against the law to copy the software on any medium except as specifically allowed in the license or nondisclosure agreement. The purchaser may make one copy of the software for backup purposes. No part of this manual and /or databases may be reproduced or transmitted in any form or by any means, electronic or mechanical, including (but not limited to) photocopying, recording, or information storage and retrieval systems, for any purpose other than the purchaser's personal use, without the express written permission of 3xLOGIC Inc. 3xLOGIC, VIGIL and AZTECH are trademarks of 3xLOGIC, Inc. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. 3xLOGIC Inc. disclaim any proprietary interest in trademarks and trade names other than their own. TABLE OF CONTENTS|VIGIL CLIENT 10 | USER'S GUIDE Table of Contents 1 Introduction
    [Show full text]
  • GST Mapper MDC Training
    GeoSpatial Technologies, Inc. GST Mapper MDC Training Train the Trainer GST Mapper MDC Training GST Mapper© MDC/MP Navigator is an integrated interface for GPS/AVL that allows you to display your current location, your sister unit locations, routing, mapping, navigation and CAD linking for receiving and displaying incidents (Tags). Scenarios: •Enables Deputies to find or search for locations, supporting units, and incidents. •Provides the functions to generate a route to an incident, sister unit, or manually input an address via a local GIS map or navigation screen. •Deputies\Officers have the ability to view various map layers including aerial imagery and night\day contrasting views for tactical needs when setting parameters, and various other functions and scenarios that will be addressed throughout the training. GST Mapper MDC components GST Mapper MDC GST Navigator GST Mobile Console GST Advantage GST vs. Consumer Navigation GST Others Custom Mapping Utilizes an agency’s GIS data and Pre configured Solutions map layers providing the ability to consumer-driven maps. display map layers such as: aerial (Non-agency specific photo, RD, beat, address, parcel, map data) hydrant, etc. Group Vehicle Display Ability to display, route-to or N/A navigate-to sister vehicles in surrounding area. CAD Integration CAD interface providing the ability N/A to display, route-to or navigate-to CAD\Incident calls. MDC\MDT Integration Ability to install onto existing N/A MDC\MDT with common Microsoft operating systems. Request for features GST works with agencies to N/A customize integrated solutions. GST Mapper MDC Toolbar ◦ Map Control Buttons ◦ Incident Panel ◦ CAD\Request CAD ◦ Unit List ◦ Routing Functions ◦ AVL Locator ◦ GST Navigator ◦ Cosmetic Layers ◦ Address \Identify ◦ Pan X, Y Menu Bar ◦ View ◦ Tools ◦ Window Tool Bar The toolbar is used to access the integrated features and functions of GST Mapper MDC, allowing the user to control the map, search, route, or navigate to CAD incidents (tags), sister units, addresses, or landmarks.
    [Show full text]
  • Microsoft Office 2016! Step
    spine = 0.8291” The quick way to get started with Microsoft Office 2016! Step Covers Microsoft Word, Excel, PowerPoint, and Outlook by Office 2016 Microsoft Step Microsoft This is learning made easy. Get more done quickly with IN FULL COLOR! Microsoft Word, Excel, PowerPoint, and Outlook. Jump in wherever you need answers—brisk lessons and Office 2016 colorful screenshots show you exactly what to do, step by step. • Format documents for visual impact • Quickly prepare personalized email messages and labels • Build powerful workbooks for analysis and reporting • Analyze alternative data sets with Quick Analysis Lens, Goal Seek, and Solver • Prepare highly effective presentations • Strengthen your presentations by adding tables and graphics • Organize your email, scheduling, and contacts • Look up just the tasks and lessons you need Step Colorful screenshots by Step Download your Step by Step practice files at: Helpful tips and http://aka.ms/Office2016sbs/downloads pointers Easy numbered Lambert Frye steps MicrosoftPressStore.com ISBN 978-0-7356-9923-6 U.S.A. $44.99 44999 Canada $55.99 [Recommended] 9 780735 699236 Microsoft Office Joan Lambert and Curtis Frye PRACTICE FILES Celebrating over 30 years! 9780735699236_Office2016SBS_cover.indd 1 10/29/2015 12:13:47 PM Microsoft Office 2016 Step by Step Joan Lambert Curtis Frye 699236_Office2016SBS.indb 1 10/29/2015 6:33:02 PM PUBLISHED BY Microsoft Press A division of Microsoft Corporation One Microsoft Way Redmond, Washington 98052-6399 Copyright © 2015 by Curtis Frye and Joan Lambert All rights reserved. No part of the contents of this book may be reproduced or transmitted in any form or by any means without the written permission of the publisher.
    [Show full text]
  • IG7013-Toolbars.Pdf
    Impress Guide Appendix B Toolbars Copyright This document is Copyright © 2021 by the LibreOffice Documentation Team. Contributors are listed below. You may distribute it and/or modify it under the terms of either the GNU General Public License (http://www.gnu.org/licenses/gpl.html), version 3 or later, or the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), version 4.0 or later. All trademarks within this guide belong to their legitimate owners. Contributors To this edition. Peter Schofield Dave Barton Feedback Please direct any comments or suggestions about this document to the Documentation Team’s mailing list: [email protected] Note Everything sent to a mailing list, including your email address and any other personal information that is written in the message, is publicly archived and cannot be deleted. Publication date and software version Published February 2021. Based on LibreOffice 7.0. Using LibreOffice on macOS Some keystrokes and menu items are different on macOS from those used in Windows and Linux. The table below gives some common substitutions for the instructions in this document. For a detailed list, see the application Help. Windows or Linux macOS equivalent Effect Tools > Options LibreOffice > Preferences Access setup options menu selection Right-click Control+click or right-click Open a context menu depending on computer setup Ctrl (Control) ⌘ (Command) Used with other keys F11 ⌘+T Open the Styles deck in the Sidebar Documentation for LibreOffice is available at
    [Show full text]
  • Toolbar,Sidebar and Statusbar Libreoffice (Writer)
    NIELIT Gorakhpur Course Name: O Level (1st Sem) Subject: ITTNB Topic: Toolbar,Sidebar and Statusbar Date: 21-04-20 Libreoffice [Writer] Toolbar:- The toolbar, also called bar or standard toolbar, is a row of boxes, often at the top of an application window, that control various functions of the software. The boxes often contain images that correspond with the function they control. A toolbar often provides quick access to functions that are commonly performed in the program. For example, a formatting toolbar gives us access to things like making text bold or changing its alignment, along with other common buttons. In an Internet browser, toolbars add functionality that may not come pre-installed. For example, with the Google toolbar, you can get access to exclusive Google features. To activate it, enable View > Toolbars > Standard (Single Mode) and disable View > Toolbars > Standard and View > Toolbars > Formatting. Sidebar:-The Sidebar is located on the right side of the edit views of Writer, Calc, Impress, and Draw. It contains one or more panels, based on the current document context. Panels are organized into decks. A tab bar on the right side of the sidebar allows you to switch between different decks. All components contain the Properties, Styles and Formatting, Pages , Gallery, and Navigator decks. Some components have additional decks, such as Master Pages, Custom Animation, and Slide Transition for Impress; Manage Changes for Writer; and Functions for Calc. To activate the Sidebar, select View > Sidebar from the Menu bar. To hide the Sidebar, click on the gray Hide button on the left. Click on the same button to show the Sidebar again.
    [Show full text]
  • For a Visual Glimpse at the Contents of the Document, Click the Grid Icon in the Upper Right- Hand Corner
    ADDITIONAL FUNCTIONALITY WITHIN THE COMMUNITY ASSOCIATION LIVING LIVE DOCUMENT INTERFACE For a visual glimpse at the contents of the document, click the grid icon in the upper right- hand corner. Note: you must mouse over the area to bring up the navigation bar. This will bring up a different window showing each of the sections—click on any of them to navigate to that section. HOW TO SEARCH FOR KEY WORDS AND PHRASES WITHIN THE COMMUNITY ASSOCIATION LIVING LIVE DOCUMENT INTERFACE Click on the search icon in the lower right-hand corner. Note: you must mouse over the area to bring up the navigation bar. That will bring up this dialog box to search specific words and phrases. HOW TO PRINT OR DOWNLOAD THE COMMUNITY ASSOCIATION LIVING DOCUMENT FROM WITHIN THE LIVE INTERFACE From the Community Association Living live document interface, click on the download icon in the upper right-hand corner. Note: you must mouse over the area to bring up the navigation bar. This will bring up a new dialog box. Click on the download icon again to save a PDF to your local drive, or click the printer icon to print. If you click print, you will see your computer’s native print dialog box and you should be able to change the individual settings here. HOW TO SHARE THE GUIDING PRINCIPLES DOCUMENT FROM WITHIN THE LIVE INTERFACE From the Guiding Principles live document interface, click on the share icon in the lower right-hand corner. Note: you must mouse over the area to bring up the navigation bar.
    [Show full text]