Experimental Test Report

Total Page:16

File Type:pdf, Size:1020Kb

Experimental Test Report Experimental Test report Document information Project Title 6th Sense Project Number E.02.25 Project Manager Fraunhofer Austria Deliverable Name Verification Report “Experimental Test Report” Deliverable ID Del 4.2 Edition 00.01.01 Template Version 03.00.00 Task contributors Fraunhofer Austria, FREQUENTIS AG, Fraunhofer FKIE, subcontracted by Fraunhofer Austria Abstract The project Sixth Sense postulates that the users “body language" is different at “good” and “bad” decisions. The project follows the idea to use the whole body language of a user for communicating with a machine. In our case it is an Air Traffic Controller (ATCO) with an Air Traffic Tower CWP. Specifically we intend to analyse the correlation of the change of the behaviour of an ATCO - expressed through his body language - with the quality of the decisions he is making. For that, an experiment was set up, data about the user behaviour was collected, explored and analysed. This document is the test report of the proof of concept for the Sixth Sense prototype and its core components. Results of our work may be used for an early warning for “bad” situations about to occur or decision aids for the ATCO. Authoring & Approval Prepared By - Authors of the document. Name & Company Position & Title Date Volker Settgast/Fraunhofer Austria Project Contributor 22.06.2015 Nelson Silva / Fraunhofer Austria Project Contributor 01.07.2015 Carsten Winkelholz, Jesscia Schwarz/ Subcontracted Project 07.07.2015 Fraunhofer FKIE Contributor Michael Poiger / Frequentis AG Project Contributor 08.07.2015 Florian Grill / Frequentis AG Project Contributor 08.07.2015 Reviewed By - Reviewers internal to the project. Name & Company Position & Title Date Theodor Zeh / Frequentis Technical Coordinator 15.07.2015 Eva Eggeling / Fraunhofer Austria Project Manager 15.07.2015 Approved for submission to the SJU By - Representatives of the company involved in the project. Name & Company Position & Title Date Theodor Zeh / Frequentis Technical Coordinator 30.07.2015 Eva Eggeling / Fraunhofer Austria Project Manager 30.07.20125 Rational for rejection None. Document History Edition Date Status Author Justification 00.00.01 20/06/2015 Draft Eva Eggeling New Document 00.00.03 07/07/2015 Update Volker Settgast merged version 00.00.04 09/07/2015 Update all merged version 00.00.08 15/07/2015 Update all merged version Submission 00.01.00 30/07/2015 Eva Eggeling Merged Version Version 00.01.01 15/09/2015 Review Version Eva Eggeling/all Resubmission Intellectual Property Rights (foreground) This deliverable consists of SJU foreground. 2 of 98 ©SESAR JOINT UNDERTAKING, 2011. Created by Fraunhofer Austria, FREQUENTIS AG for the SESAR Joint Undertaking within the frame of the SESAR Programme co-financed by the EU and EUROCONTROL. Reprint with approval of publisher and the source properly acknowledged. Table of Contents TABLE OF CONTENTS ..................................................................................................................................... 3 LIST OF TABLES ................................................................................................................................................ 4 LIST OF FIGURES .............................................................................................................................................. 4 EXECUTIVE SUMMARY .................................................................................................................................... 6 1.1 PURPOSE OF THE DOCUMENT ............................................................................................................... 7 1.2 INTENDED READERSHIP......................................................................................................................... 7 1.3 ACRONYMS AND TERMINOLOGY ........................................................................................................... 7 2 THE EXPERIMENT ..................................................................................................................................... 9 2.1 EXPERIMENTAL SETUP ......................................................................................................................... 9 2.2 OPERATIONAL SCENARIO ................................................................................................................... 10 2.3 ROLES AND RESPONSIBILITIES ........................................................................................................... 11 2.4 TECHNICAL SETUP OF THE EXPERIMENT ............................................................................................ 12 2.5 AMQ BROKER ..................................................................................................................................... 13 2.6 THE HUMAN MACHINE INTERFACE (HMI) .......................................................................................... 13 3 PERFORMING THE EXERCISES .......................................................................................................... 16 3.1 PROFILE OF PARTICIPANTS ................................................................................................................. 16 3.2 DATA ANALYSIS, EXPLORATION AND VISUALIZATION ......................................................................... 17 3.2.1 Heart Rate vs Observations List ................................................................................................ 18 3.2.2 Eye-Tracker and mouse Analysis .............................................................................................. 19 3.2.3 Simple Metrics and Data Exploration ........................................................................................ 20 4 RESULTS ................................................................................................................................................... 23 4.1 WORKLOAD ESTIMATES BASED ON QUESTIONNAIRES ....................................................................... 23 4.2 HINTS FOR H1 - EXPLORING THE SENSOR DATA ............................................................................... 28 4.2.1 Sixth Sense Prototype Framework for Data Exploration ........................................................ 31 4.2.2 Categorization of Metrics regarding mental Aspects .............................................................. 34 4.2.3 Research Questions .................................................................................................................... 38 4.2.4 Data Exploration and Analysis ................................................................................................... 40 4.3 HINTS FOR H2 - ANALYSIS OF THE ARRIVAL AND DEPARTURE WORKFLOWS ................................... 54 4.3.1 Implementation ............................................................................................................................. 54 4.3.2 Results of the Analysis of ATC Workflow Steps ...................................................................... 55 4.3.3 Machine Learning Experiments ................................................................................................. 57 4.4 EVENT TRACE ANALYSIS .................................................................................................................... 61 4.4.1 Variable Length Markov Models (VLMM) ................................................................................. 61 4.4.2 Scatterplot Matrix for Measures ................................................................................................. 64 4.4.3 Visualization of Sequential Patterns .......................................................................................... 64 4.4.4 Insights regarding interaction sequences ................................................................................. 66 4.4.5 States corresponding to outliers and around ........................................................................... 75 4.5 CONCLUSION ....................................................................................................................................... 77 4.6 FUTURE WORK .................................................................................................................................... 79 REFERENCES ................................................................................................................................................... 80 APPENDIX A ...................................................................................................................................................... 82 A.1 TECHNICAL VERIFICATION DETAILS OF EXERCISE 1 AND 2 ............................................................... 82 A.1.1 Kinect ............................................................................................................................................. 87 A.1.2 Speech Recognition ..................................................................................................................... 92 APPENDIX B QUESTIONNAIRES ............................................................................................................ 94 3 of 98 ©SESAR JOINT UNDERTAKING, 2011. Created by Fraunhofer Austria, FREQUENTIS AG for the SESAR Joint Undertaking within the frame of the SESAR Programme co-financed by the EU and EUROCONTROL. Reprint with approval of publisher and the source properly acknowledged. List of tables Table 1 - Description of the workflow steps ...........................................................................................
Recommended publications
  • WIMP Interfaces for Emerging Display Environments
    Graz University of Technology Institute for Computer Graphics and Vision Dissertation WIMP Interfaces for Emerging Display Environments Manuela Waldner Graz, Austria, June 2011 Thesis supervisor Prof. Dr. Dieter Schmalstieg Referee Prof. Dr. Andreas Butz To Martin Abstract With the availability of affordable large-scale monitors and powerful projector hardware, an increasing variety of display configurations can be found in our everyday environments, such as office spaces and meeting rooms. These emerging display environments combine conventional monitors and projected displays of different size, resolution, and orientation into a common interaction space. However, the commonly used WIMP (windows, icons, menus, and pointers) user interface metaphor is still based on a single pointer operating multiple overlapping windows on a single, rectangular screen. This simple concept cannot easily capture the complexity of heterogeneous display settings. As a result, the user cannot facilitate the full potential of emerging display environments using these interfaces. The focus of this thesis is to push the boundaries of conventional WIMP interfaces to enhance information management in emerging display environments. Existing and functional interfaces are extended to incorporate knowledge from two layers: the physical environment and the content of the individual windows. The thesis first addresses the tech- nical infrastructure to construct spatially aware multi-display environments and irregular displays. Based on this infrastructure, novel WIMP interaction and information presenta- tion techniques are demonstrated, exploiting the system's knowledge of the environment and the window content. These techniques cover two areas: spatially-aware cross-display navigation techniques for efficient information access on remote displays and window man- agement techniques incorporating knowledge of display form factors and window content to support information discovery, manipulation, and sharing.
    [Show full text]
  • Design Patterns and Frameworks for Developing WIMP User Interfaces
    Design Patterns and Frameworks for Developing WIMP+ User Interfaces Vom Fachbereich Informatik der Technischen Universität Darmstadt genehmigte Dissertation zur Erlangung des akademischen Grades der Doktor-Ingenieurin (Dr.-Ing.) vorgelegt von Yongmei Wu, M.Sc. geboren in Guizhou, China Referenten der Arbeit: Prof. Dr.-Ing. Hans-Jürgen Hoffmann Prof. Robert J.K. Jacob, Ph.D. Tag des Einreichens: 09.10.2001 Tag der mündlichen Prüfung: 11.12.2001 D17 Darmstädter Dissertation 2001 Abstract Abstract This work investigates the models and tools for support of developing a kind of future user interfaces, which are partially built upon the WIMP (Windows, Icons, Menus, and Pointing device: the mouse) interaction techniques and devices; and able to observe and leverage at least one controlled process under the supervision of their user(s). In this thesis, they are called WIMP+ user interfaces. There are a large variety of applications dealt with WIMP+ user interfaces, e.g., robot control, telecommunication, car driver assistant systems, distributed multi-user database systems, automation rail systems, etc. At first, it studies the evolution of user interfaces, deduces the innovative functions of future user interfaces, and defines WIMP+ user interfaces. Then, it investigates high level models for user interface realization. Since the most promising user-centered design methodology is a new emerging model, it is still short of modeling methodology and rules to support the concrete development process. Therefore, in this work, a universal modeling methodology, which picks up the design pattern application, is researched and used to structure different low level user interface models. And a framework, named Hot-UCDP, for aiding the development process, is proposed.
    [Show full text]
  • Flexible Interfaces: Future Developments for Post-WIMP Interfaces Benjamin Bressolette, Michel Beaudouin-Lafon
    Flexible interfaces: future developments for post-WIMP interfaces Benjamin Bressolette, Michel Beaudouin-Lafon To cite this version: Benjamin Bressolette, Michel Beaudouin-Lafon. Flexible interfaces: future developments for post- WIMP interfaces. CMMR 2019 - 14th International Symposium on Computer Music Multidisciplinary Research, Oct 2019, Marseille, France. hal-02435177 HAL Id: hal-02435177 https://hal.archives-ouvertes.fr/hal-02435177 Submitted on 15 Jan 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Flexible interfaces : future developments for post-WIMP interfaces Benjamin Bressolette and Michel Beaudouin-Lafon LRI, Universit´eParis-Sud, CNRS, Inria, Universit´eParis-Saclay Orsay, France [email protected] R´esum´e Most current interfaces on desktop computers, tablets or smart- phones are based on visual information. In particular, graphical user in- terfaces on computers are based on files, folders, windows, and icons, ma- nipulated on a virtual desktop. This article presents an ongoing project on multimodal interfaces, which may lead to promising improvements for computers' interfaces. These interfaces intend to ease the interaction with computers for blind or visually impaired people. We plan to inter- view blind or visually impaired users, to understand how they currently use computers, and how a new kind of flexible interface can be designed to meet their needs.
    [Show full text]
  • Design and Implementation of Post-WIMP Interactive Spaces with the ZOIL Paradigm
    Design and Implementation of Post-WIMP Interactive Spaces with the ZOIL Paradigm Dissertation zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaften (Dr. rer. nat.) vorgelegt von Hans-Christian Jetter an der Universität Konstanz Mathematisch-Naturwissenschaftliche Sektion Fachbereich Informatik und Informationswissenschaft Tag der mündlichen Prüfung: 22. März 2013 1. Referent: Prof. Dr. Harald Reiterer (Universität Konstanz) 2. Referent: Prof. Dr. Andreas Butz (LMU München) Prüfungsvorsitzender: Prof. Dr. Daniel Keim (Universität Konstanz) Konstanz, Dezember 2013 Design and Implementation of Post-WIMP Interactive Spaces with the ZOIL Paradigm Dissertation submitted for the degree of Doctor of Natural Sciences (Dr. rer. nat.) Presented by Hans-Christian Jetter at the University of Konstanz Faculty of Sciences Department of Computer and Information Science Date of the oral examination: March 22nd, 2013 1st Supervisor: Prof. Dr. Harald Reiterer (University of Konstanz) 2nd Supervisor: Prof. Dr. Andreas Butz (University of Munich, LMU) Chief Examiner: Prof. Dr. Daniel Keim (University of Konstanz) Konstanz, December 2013 i Zusammenfassung Post-WIMP (post-“Windows, Icons, Menu, Pointer”) interaktive Räume sind physische Umgebungen oder Räume für die kollaborative Arbeit, die mit Technologien des Ubiquitous Computing angereichert sind. Ihr Zweck ist es, eine computer-unterstützte Kollaboration mehrerer Benutzer zu ermöglichen, die auf einer nahtlosen Benutzung mehrerer Geräte und Bildschirme mittels „natürlicher“ post-WIMP Interaktion basiert. Diese Dissertation beantwortet die Forschungsfrage, wie Gestalter und Entwickler solcher Umgebungen dabei unterstützt werden können, gebrauchstaugliche interaktive Räume für mehrere Benutzer mit mehreren Geräten zu erschaffen, die eine kollaborative Wissensarbeit ermöglichen. Zu diesem Zweck werden zunächst Konzepte wie post-WIMP Interaktion, interaktive Räume und Wissensarbeit definiert. Die Arbeit formuliert dann das neue technologische Paradigma ZOIL (Zoomable Object-Oriented Information Landscape).
    [Show full text]
  • Lessons Learned from the Design and Implementation of Distributed Post
    Lessons Learned from the Design and Implementation of Distributed Post-WIMP User Interfaces Thomas Seifried1, Hans-Christian Jetter2, Michael Haller1, Harald Reiterer2 1Upper Austria University of Applied Sciences 2University of Konstanz Media Interaction Lab Human-Computer Interaction Group {thomas.seifried, haller}@fh-hagenberg.at {jetter, reiterer}@inf.uni-konstanz.de a b c Figure 1: Interactive spaces based on post-WIMP DUIs. (a) NiCE Meeting Room [5], (b) DeskPiles [2] and (c) Facet-Streams [10] ABSTRACT “natural” interaction, i.e. the UI is perceived as something Creating novel user interfaces that are “natural” and unobtrusive or even invisible that does not require the distributed is challenging for designers and developers. users’ continuous attention or a great deal of cognitive “Natural” interaction techniques are barely standardized resources. A well-proven approach to achieve this are and in combination with distributed UIs additional technical visual model-world interfaces for “direct manipulation”, in difficulties arise. In this paper we present the lessons we which a tight coupling of input and output languages have learned in developing several natural and distributed narrows the gulfs of execution and evaluation [7]. While user interfaces and propose design patterns to support direct manipulation originates from 1980s desktop development of such applications. computing, its principles are also the foundation of novel Author Keywords post-WIMP (post-“Windows Icons Menu Pointing”) or Post-WIMP, natural user interfaces, distributed user reality-based UIs [8]: Their interaction styles (e.g. tangible, interfaces, zoomable user interfaces, design patterns. multi-touch or paper-based UIs) “draw strength by building on users’ pre-existing knowledge of the everyday, non- ACM Classification Keywords digital world to a much greater extent than before.” Users H5.2.
    [Show full text]
  • A Visual Language for Non-WIMP User Interfaces Robert J.K
    A Visual Language for Non-WIMP User Interfaces Robert J.K. Jacob Department of Electrical Engineering and Computer Science Tufts University Medford, Mass. 02155 Abstract single input/output stream. Even where there are several devices, the input is treated conceptually as a single Unlike current GUI or WIMP style interfaces, non- multiplexed stream, and interaction proceeds in half- WIMP user interfaces, such as virtual environments, involve duplex, alternating between user and computer. Users do parallel, continuous interactions with the user. However, not, for example, meaningfully move a mouse while typing most current visual (and non-visual) languages for describing human-computer interaction are based on characters; they do one at a time. Non-WIMP interfaces are serial, discrete, token-based models. This paper introduces instead characterized by continuous interaction between a visual language for describing and programming the fine- user and computer via several parallel, asynchronous grained aspects of non-WIMP interaction. It is based on the channels or devices. notion that the essence of a non-WIMP dialogue is a set of Because interaction with such systems can draw on the continuous relationships, most of which are temporary. The user’s existing skills for interacting with the real world, they underlying model combines a data-flow or constraint-like offer the promise of interfaces that are easier to learn and to component for the continuous relationships with an event- use. However, they are currently making interfaces more based component for discrete interactions, which can difficult to build. Advances in user interface design and enable or disable individual continuous relationships.
    [Show full text]
  • Software Studies: a Lexicon, Edited by Matthew Fuller, 2008
    fuller_jkt.qxd 4/11/08 7:13 AM Page 1 ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• S •••••••••••••••••••••••••••••••••••••new media/cultural studies ••••software studies •••••••••••••••••••••••••••••••••• ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• O ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• F software studies\ a lexicon ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• T edited by matthew fuller Matthew Fuller is David Gee Reader in ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• This collection of short expository, critical, Digital Media at the Centre for Cultural ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• W and speculative texts offers a field guide Studies, Goldsmiths College, University of to the cultural, political, social, and aes- London. He is the author of Media ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• thetic impact of software. Computing and Ecologies: Materialist Energies in Art and A digital media are essential to the way we Technoculture (MIT Press, 2005) and ••••••••••••••••••••••••••••••••••••• •••• •••••••••••••••••••••••••••••••••• work and live, and much has been said Behind the Blip: Essays on the Culture of •••••••••••••••••••••••••••••••••••••
    [Show full text]
  • Windows Development Environment
    A P P E N D I X A ■ ■ ■ Windows Development Environment For those developers who spend most of their coding time with Microsoft development tools, the world of *nix is probably a scary place. Drupal is written for the so-called LAMP stack, "Linux/Apache/MySQL/ PHP." While it is possible to substitute Windows for Linux, it is a bit more difficult to substitute IIS for Apache, and even harder to substitute SQL Server for MySQL. And don’t even think about replacing PHP with C# or Visual Basic. This appendix provides a step-by-step tutorial for setting up a debugging environment on your Windows workstation. My goal was to duplicate the development environment of Visual Studio, and this set-up gets about as close as you can. Old habits die hard, and if you’re like me you’ve got some. I’ve been using a Windows-based computer since Windows was first available as an application that ran under DOS. As with most technologies, Windows and I have a love-hate relationship, but for some reason I keep coming back. Visual Studio is the perfect development environment. My development editor of choice was once VEdit, an emacs-style editor. I reluctantly switched to Visual Studio to do Visual Basic 6 programming, and learned to love IntelliSense. With Visual Studio 2010 and the .NET reflection-based IntelliSense, I can’t imagine coding without it. After the Windows Vista debacle, I seriously considered switching to Ubuntu or Macintosh. If Microsoft couldn’t get its core operating system right, how long would it be until everything else suffered? Windows 7 changed my mind.
    [Show full text]
  • Techniques for Inelastic Effective Field Theory Measurements with The
    Techniques for Inelastic Effective Field Theory Measurements with the Large Underground Xenon Experiment by Daniel Patrick Hogan A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Physics in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Robert Jacobsen, Chair Professor Marjorie Shapiro Professor Kai Vetter Summer 2018 Techniques for Inelastic Effective Field Theory Measurements with the Large Underground Xenon Experiment Copyright 2018 by Daniel Patrick Hogan 1 Abstract Techniques for Inelastic Effective Field Theory Measurements with the Large Underground Xenon Experiment by Daniel Patrick Hogan Doctor of Philosophy in Physics University of California, Berkeley Professor Robert Jacobsen, Chair Cosmological evidence indicates that nonbaryonic dark matter makes up a quarter of the energy density of the universe. One hypothesis for the particle nature of dark matter is the weakly-interacting massive particle (WIMP). The Large Underground Xenon (LUX) experiment is a dual-phase xenon WIMP search experiment with a 250kg active volume. Computational tools developed to support LUX analyses include data mirroring and a data visualization web portal. Within the LUX detector, particle interactions produce pulses of scintillation light. A pulse shape discrimination (PSD) technique is shown to help classify interaction events into nuclear recoils and electron recoils based on the time-structure of the pulses. This approach is evaluated in the context of setting limits on inelastic effective field theory (IEFT) dark matter models. Although PSD is not found to provide significant improvement in the limits, LUX is nevertheless able to set world-leading limits on some IEFT models, while limits for other IEFT models are reported here for the first time.
    [Show full text]
  • Dialog Design: Windows, Icons, Menus and Pointers (WIMP)
    Dialog Design: Windows, Icons, Menus and Pointers (WIMP) This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Elizabeth Mynatt, Jeff Pierce, Colin Potts, Chris Shaw, John Stasko, and Bruce Walker. Last update by Valerie Summet, Emory University. Permission is granted to use with acknowledgement for non-profit purposes. Last revision: Feb. 2011. 1 Dialog Styles 1. Direct Manipulation 2. Command languages 3. WIMP - Window, Icon, Menu, Pointer 4. Speech/Natural language 5. Gesture, pen 2 Agenda • Review of dialogue design issues • WIMP . Advantages, disadvantages . Design guidelines 3 General Issues in Choosing Dialogue Style • Who is in control - user or computer • Initial training required • Learning time to become proficient • Speed of use • Generality/flexibility/power • Special skills - typing • Gulf of evaluation / gulf of execution • Screen space required • Computational resources required 4 WIMP • Menus, Buttons, Forms, Icons • Predominant desktop interface paradigm (along with some direct manipulation) 5 Windows Pros and Cons • Why are windows good (at least sometimes)? Are there problems with windows? . Focus just on windows, not on menus and icons etc 6 Window Pros • Facilitate multi-tasking, which many people do. • Maps well onto overlapping sheets of paper on our desks, so is a familiar concept. • Makes computer usage easier for most of us. 7 Window Cons • Can make concentrating on a single task hard (that incoming mail….) • An extension of the cluttered desk :) • May be unnecessary for dedicated- use environments that run a single application 8 Menus - Many Different Types • Pop-up • Pull-down • Radio buttons • Pie buttons • Hierarchical/cascading 9 Pie Menus From Sim City 10 Pop-up Hierarchical 11 Menu Pros and Cons • What is good about menus? • What is bad about menus? 12 Menu Pros • One keystroke or mouse operation vs.
    [Show full text]
  • Testing and Maintenance of Graphical User Interfaces Valeria Lelli Leitao
    Testing and maintenance of graphical user interfaces Valeria Lelli Leitao To cite this version: Valeria Lelli Leitao. Testing and maintenance of graphical user interfaces. Human-Computer Inter- action [cs.HC]. INSA de Rennes, 2015. English. NNT : 2015ISAR0022. tel-01232388v2 HAL Id: tel-01232388 https://tel.archives-ouvertes.fr/tel-01232388v2 Submitted on 11 Apr 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THÈSE INSA Rennes présentée par sous le sceau de l’Université Européenne de Bretagne Valéria Lelli Leitão Dan- pour obtenir le grade de tas DOCTEUR DE L’INSA DE RENNES ÉCOLE DOCTORALE : MATISSE Spécialité : Informatique LABORATOIRE : IRISA/INRIA Thèse soutenue le 19 Novembre 2015 devant le jury composé de : Testing and Pascale Sébillot Professeur, Universités IRISA/INSA de Rennes / Présidente maintenance of Lydie du Bousquet Professeur d’informatique, Université Joseph Fourier / Rapporteuse Philippe Palanque graphical user Professeur d’informatique, Université Toulouse III / Rapporteur Francois-Xavier Dormoy interfaces Chef de produit senior, Esterel Technologies / Examinateur Benoit Baudry HDR, Chargé de recherche, INRIA Rennes - Bretagne Atlantique / Directeur de thèse Arnaud Blouin Maître de Conférences, INSA Rennes / Co-encadrant de thèse Testing and Maintenance of Graphical User Interfaces Valéria Lelli Leitão Dantas Document protégé par les droits d’auteur Contents Acknowledgements 5 Abstract 7 Résumé en Français 9 1Introduction 19 1.1 Context ...................................
    [Show full text]
  • Interaction Styles
    Interaction Styles User-computer dialogs Interaction Style Categories . Command-line interfaces . Menus . Natural Language . Question/answer and query dialog . WIMP and GUI . Three-dimensional interfaces 1 Interaction Style Categories . Command-line interfaces . Menus . Natural Language . Question/answer and query dialog . WIMP and GUI . Three-dimensional interfaces Command-line Interface . Def. An interface where the user types commands in response to a prompt . Examples . Operating systems . MS-DOS . Unix . Applications . ftp . telnet 2 Command-line Interfaces . Features . First interaction style (arguably) . Still widely used . Direct expression of commands to computer . May use function keys, single characters, abbreviations, or whole-word commands . Only interaction style available in some situations (e.g., remote access via telnet) Command-line Interfaces (2) . Advantages . Direct access to system functionality . Flexibility through options or parameters that modify behaviour of commands . Useful for repetitive tasks . Good for expert users . Disadvantages . Arcane syntax difficult for novices . Relies on recall (but commands difficult to remember) 3 Example Guidelines . Commands should use vocabulary of the user, not of the technician or system . Consistency from one command to the next 4 Interaction Style Categories . Command-line interfaces . Menus . Natural Language . Question/answer and query dialog . WIMP and GUI . Three-dimensional interfaces Menu-based Interaction . Features . Options displayed on the screen . Used on text-based and GUI-based systems . On text-based systems, options may be numbered . Shortcuts/accelerators possible . Just type the first letter or a unique letter of a command . Use TAB or arrow keys to navigate menu options . Advantages . Less demand on user (since options are visible) . Relies on recognition, rather than on recall 5 Guidelines .
    [Show full text]