DOCSLIB.ORG

Using Multiuser Multi-Touch Tables to Visualize GIS Data

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Using Multiuser Multi-Touch Tables to Visualize GIS Data MITSUBISHI ELECTRIC RESEARCH LABORATORIES Cambridge, Massachusetts, USA Using Multi-User Multi-Touch Tables to Visualize GIS Data Alan Esenther, Kathy Ryall Technology Lab Mitsubishi Electric Research Labs, Cambridge, MA, USA Masakazu Furuichi Modeling & Simulation, Information Systems Dept Mitsubishi Electric Corp, Kamakura, Japan Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES DiamondTouch (DT): Novel Technology Platform Overcoming limitations of the mouse… – Multi-user • Simultaneous multiple users • Supports up to four users at a time –Multi-touch • Each user can touch with multiple fingers at the same time • Enables rich gestures (unlike mouse/stylus) – Toucher identification • It doesn’t just allow multiple touchers – it distinguishes them • Identifies which user is touching each point (unlike tables based on cameras, IR, or pressure) – Direct-input • Input and Display spaces are superimposed • Allows simplicity of directly touching and MITSUBISHI interacting with content ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES DiamondTouch: Hardware Overview • Basic Components – Table (touch surface) is a transmitter array Receiver – Chairs (or a conductive pad) Transmitters are receivers • User capacitively couples a signal between the table and the receiver – Supports seated or standing interaction – Stylus-based interaction also possible – Transmitter signals are interpolated to 2736x2048 input resolution • DT most-often used as horizontal tabletop display – Front-projection from above (any projector will do) – Can be embedded in other forms (e.g. vertical, dashboard, etc) • Powered by 5 volt USB cable MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Multi-User? Multi-Touch? Toucher ID? Direct Input? MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Multi-Touch: Good for Rich Gestural Interactions • Supports all mouse functionality – including mouse-overs (vs mouse-drag), right/middle-drag, scroll-wheel, precision-input, etc – first/only direct touch surface to achieve this • Can build new functionality on top of mouse – e.g. fist-swipe or fist-drag can be mapped to anything • Flicking with 2 fingers • Simultaneously specify multiple points – e.g. piano chords - can’t do this with a mouse – e.g. Change the size and location of a region simultaneously MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Mouse Emulation Challenges + Current Solutions • Specifying a particular pixel, finger obscuring content, moving the mouse without dragging: – “Precision-Hover” mode • Timing and spacing (for double-tapping ,etc) – DiamondTouch settings independent of mouse settings (customizable) • Right and middle mouse buttons – Tap with second finger to toggle right mouse button – Tap twice with second finger to toggle middle mouse button • Desktop Incorporation – System tray icon with context menu; special gesture for muting; audio feedback MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Customer Usage • Modeling & Simulation, Information Systems Dept, Mitsubishi Elec Corp, Kamakura, Japan • In Development: “Decision Support System for Disaster Response” • Used ArcGIS with maps and satellite images of December 2004 flooding in Indonesia • Collaboratively analyzed on a DiamondTouch table MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Decision Support System for Disaster Response • Used before-after image processing to inform damage estimates MITSUBISHI Tsunami images (c) 2005 DigitalGlobe Inc. ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Decision Support System for Disaster Response • Combined with damage reports from on-site personnel • and inspection of satellite data MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Decision Support System for Disaster Response • To collaboratively determine usable routes and helicopter landing locations MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Emergency Response and Situational Awareness • Shared situational awareness: – All participants perceive elements and comprehend meaning/implications – can only be achieved with effective communications. • A shared tabletop environment allows for important face-to-face interactions without which subtleties of communication (gestures, expressions) could be lost. • Direct Input – clearly communicates to other participants who is doing what. Facilitates building shared mental model. • Simultaneous users – In an emergency, you don’t want to take turns. • With customizations, everyone can do things at the same time. • If using the mouse, turn-taking is required, but a first-to-touch-wins policy avoids chaotic mouse cursor movement. • Multi-finger input – Key to rich gestures for advanced functionality MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Enhancing existing applications • Customizing function – Drawing with different symbols (emergency unit deployments, routes) – Intelligent Undo – “Privileged” buttons (e.g. emergency Coordinator has final say) • Customizing content – Menus, bookmarks, tooltips and help tailored to the particular toucher’s professional background and to the current situation • Customizing appearance – Change font, color, language, size, thickness, orientation based on who is touching • Customizing group input – Simultaneous touches required to proceed – Modal input sequences: one person can annotate while another is erasing and another is browsing different map layers – Logging and audit trail creation MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Combining DiamondTouch with ESRI Software • 3 Directions 1 - Run existing ESRI software as is (convert touches to mouse input) 2 - Write extensions to existing ESRI software to add multi-user/multi- touch capabilities 3 - Use ArcEngine or ArcWeb Services to create new multi-user/multi-touch utilities and applications MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES 1. DiamondTouch & Unmodified ESRI applications: DTMouse Utility • DiamondTouch Mouse Emulator – Allows you to run unmodified ESRI (or any) software on the table as is – Converts touch inputs to mouse inputs – Provides functionality of a 3-button mouse and mousewheel – Allows precision input – Coordinates multiple touchers • First to touch is the mouse – others are ignored – One user at a time, but no need to explicitly hand off control – no physical device (i.e., mouse, keyboard) to pass back and forth MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES 2 - DiamondTouch & Extending Existing ESRI Applications • Example Prototype – DiamondTouch extension for ArcMap – Works in conjunction with DTMouse mouse emulator – Provides special buttons for simultaneous operations (line and marker symbol creation) MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES 3 - DiamondTouch & ESRI: New Application Development • Use ArcEngine or ArcWeb Services to create new multi-user/multi-touch utilities and applications • Example: Lensing to reveal different layers. • Example: Simultaneously zooming sub- windows into different regions • Future work: Exploit DiamondTouch capabilities within ESRI-based apps; e.g.: – Simultaneous input – Audit and logging – Permission/control on a per-user basis – Visualizing parallel geoprocessing MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Challenges/Issues/Findings • Mouse concepts are deeply embedded in modern operating systems – There is only one mouse focus – O.S. can’t handle 2 mouse-down events in a row, without a mouse-up (e.g. scrollbars) • Integration with O.S. is critical – Need mouse emulation often for existing buttons, menus, etc – Need to suppress the mouse when custom software is interpreting the touch • Rotating content to face different users – Especially text – COM-based software assumes normal orientation • clipping regions, windows, invalidation regions, etc are all rectangular • ArcGIS exposes a lot of useful APIs • ArcGIS computation and rendering times are too slow to do in-place geo-processing • The ideal tabletop is big enough for multiple people to sit at, but small enough so that everyone can reach anywhere on it MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Multi-surface GIS • Synchronized content • Synchronized displays • WebService-based synchronization of different applications (shown here on same surface) MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Summary • DiamondTouch – Novel Direct-Touch development platform – Multi-user, Multi-touch, User-Differentiation • Rich gestures require reliable multi-finger detection • Careful integration of full-featured mouse emulation is critical • Reliable multiple-user support requires ability to distinguish touchers • Several ways to integrate with GIS applications The computer mouse will continue to be the primary input mechanism, but be aware of it’s inherent limitations Technology should not get in the way: debris-tolerant, walk-up interaction style, portable/durable MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007 MITSUBISHI ELECTRIC RESEARCH LABORATORIES Questions? http://www.merl.com/projects/DiamondTouch/ http://diamondtouch.merl.com/stuff/ esenther @ merl.com MITSUBISHI ELECTRIC Changes for the better Petroleum User Group 2007.
Load more

Recommended publications
  • Annual Report
    Mitsubishi Electric Research Laboratories (MERL) Annual Report July 2007 through June 2008 TR2008-00 (Published July 2009) Welcome to Mitsubishi Electric Research Laboratories (MERL), the North American corporate R&D arm of Mitsubishi Electric Corporation. In this report, you will find descriptions of MERL and our projects. This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for another purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories. All rights reserved. Copyright© Mitsubishi Electric Research Laboratories, 2009 20 I Broadway, Cambridge, Massachusetts 02139 6 17.621.7500 Production: Karen Dickie, Janet O'Halloran, Janet McAndless, Richard C. Waters Table of Contents Mitsubishi Electric Research Laboratories ........................................................... 1 Awa rds and Commendations ........................... ........................................ ............ 7 Technical Staff .................................................................................................... 9 Publications ......................................................................................................
    [Show full text]
  • Thesis Explores How to Bridge the Gap Between the Power Provided by Current Desktop Com- Puter Interfaces and the Fluid Use of Whiteboards and Pin-Boards
    FLUID INTERACTION FOR HIGH RESOLUTION WALL-SIZE DISPLAYS A DISSERTATION SUBMITTED TO THE DEPARTMENT OF COMPUTER SCIENCE AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY François Guimbretière January 2002 2002 by François Guimbretière All Rights Reserved ii I certify that I have read this dissertation and that in my opinion it is fully ade- quate, in scope and quality, as a dissertation for the degree of Doctor of Philoso- phy. __________________________________ Terry Winograd (Principal Advisor) I certify that I have read this dissertation and that in my opinion it is fully ade- quate, in scope and quality, as a dissertation for the degree of Doctor of Philoso- phy. __________________________________ Pat Hanrahan I certify that I have read this dissertation and that in my opinion it is fully ade- quate, in scope and quality, as a dissertation for the degree of Doctor of Philoso- phy. __________________________________ David Kelley I certify that I have read this dissertation and that in my opinion it is fully ade- quate, in scope and quality, as a dissertation for the degree of Doctor of Philoso- phy. __________________________________ Maureen Stone (StoneSoup Consulting) Approved for the University Committee on Graduate Studies: __________________________________ iii Abstract As computers become more ubiquitous, direct interaction with wall-size, high-resolution dis- plays will become commonplace. The familiar desktop computer interface is ill-suited to the affor- dances of these screens, such as size, and capacity for using pen or finger as primary input device. Current Graphical User Interfaces (GUIs) do not take into account the cost of reaching for a far- away menu bar, for example, and they rely heavily on the keyboard for rapid interactions.
    [Show full text]
  • Technical Program
    Technical Program IS&T/SPIE 18th Annual Symposium 15-19 January 2006 San Jose Marriott and San Jose Convention Center • San Jose, California USA Sponsored by: electronicimaging.org • Tel: +1 703 642 9090 • [email protected] 1 Technical Program IS&T/SPIE 18th Annual Symposium 15–19 January 2006 San Jose Marriott and San Jose Convention Center • San Jose, California USA Conferences • Continuing Education • Technical Exhibition • Demonstrations Welcome We are all too busy. If your jobs are like ours, then you are expected to produce more innovation, more products, more research, more students, more money, but all with less time. So how does participating in EI 2006 fit into this picture? Well, here is the straight answer as to why the Electronic Imaging Symposium is a great investment of your time and resources. • Defines the cutting edge in imaging research - The EI symposium, and its associated publication the Journal of Electronic Imaging, have been defining the envelope of high impact digital imaging research since their inception. Because of its leading role, EI is where the innovation leaders in imaging research go to find out about the newest imaging systems, methods, instrumentation, and algorithms. • Provides broad coverage with tremendous technical depth - The unique structure of EI leads to a rich marketplace of ideas where a broad range of topics are discussed in great technical depth. Each year, the EI symposium starts new conferences on important new topics and reinvigorates highly respected existing conferences through the incorporation of new research and participants. • Promotes an atmosphere for professional networking - Because of its organization into primarily single-tracked conferences, the symposium has a very personal and friendly atmosphere that gives technical experts and researchers an opportunity to learn what they need and also, to efficiently network on a professional level.
    [Show full text]
  • Multimodal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations
    Multimodal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations Dissertation zur Erlangung des Grades Doktor der Ingenieurwissenschaften (Dr.-Ing.) der Naturwissenschaftlich-Technischen Fakultat¨ I der Universitat¨ des Saarlandes vorgelegt von Rainer Wasinger Saarbrucken¨ 20. November 2006 ii Datum des Kolloquiums: Montag den 20. November 2006 Dekan und Vorsitzender: Prof. Dr. Thorsten Herfet Gutachter: 1. Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster 2. Prof. Dr. Elisabeth Andre´ Akademischer Beisitzer: Dr. Dominik Heckmann Eidesstattliche Erklarung¨ Hiermit erklare¨ ich, dass ich die vorliegende Arbeit ohne unzulassige¨ Hilfe Dritter und ohne Be- nutzung anderer als der angegebenen Hilfsmittel angefertigt habe. Die aus anderen Quellen oder indirekt ubernommenen¨ Daten und Konzepte sind unter Angabe der Quelle gekennzeichnet. Diese Arbeit wurde bisher weder im In- noch im Ausland in gleicher oder ahnlicher¨ Form in anderen Prufungsverfahren¨ vorgelegt. Saarbrucken,¨ den 20. November 2006 iii iv Acknowledgements Most of all, I would like to thank Professor Wahlster for providing the funds, the time, and the environment, for any and all of this to have been possible. I also thank you for permitting me to work on such an interesting topic at the DFKI. I value your advice, which is always relevant, and your ability to see the interesting aspect of practically any research field. I also thank Elisabeth Andre´ for being the second corrector of this work, and the German Federal Ministry for Education and Research (BMBF), which has funded this work under the contract number 01 IN C02 as part of the projects COLLATE and COLLATE II. I would like to dearly thank my wife Emma and my son Xavier for making everything wor- thwhile.
    [Show full text]
  • Grasping Gestures: Gesturing with Physical Artifacts
    Artificial Intelligence for Engineering Design, Analysis and Manufacturing (2011), 25, 255–271. # Cambridge University Press 2011 0890-0604/11 $25.00 doi:10.1017/S0890060411000072 Grasping gestures: Gesturing with physical artifacts 1 2 ELISE VAN DEN HOVEN AND ALI MAZALEK 1User-Centered Engineering Group, Industrial Design Department, Eindhoven University of Technology, Eindhoven, The Netherlands 2Synaesthetic Media Lab, Digital Media Program, Georgia Institute of Technology, Atlanta, Georgia, USA (RECEIVED July 19, 2010; ACCEPTED October 6, 2010) Abstract Gestures play an important role in communication. They support the listener, who is trying to understand the speaker. How- ever, they also support the speaker by facilitating the conceptualization and verbalization of messages and reducing cog- nitive load. Gestures thus play an important role in collaboration and also in problem-solving tasks. In human–computer interaction, gestures are also used to facilitate communication with digital applications, because their expressive nature can enable less constraining and more intuitive digital interactions than conventional user interfaces. Although gesture re- search in the social sciences typically considers empty-handed gestures, digital gesture interactions often make use of hand- held objects or touch surfaces to capture gestures that would be difficult to track in free space. In most cases, the physical objects used to make these gestures serve primarily as a means of sensing or input. In contrast, tangible interaction makes use of physical objects as embodiments of digital information. The physical objects in a tangible interface thus serve as representations as well as controls for the digital information they are associated with. Building on this concept, gesture interaction has the potential to make use of the physical properties of hand-held objects to enhance or change the function- ality of the gestures made.
    [Show full text]
  • User Interaction in Hybrid Multi-Display Environments
    User Interaction in Hybrid Multi-Display Environments Hrvoje Benko Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2007 © 2007 Hrvoje Benko All Rights Reserved ABSTRACT User Interaction in Hybrid Multi-Display Environments Hrvoje Benko This dissertation presents the design, implementation, and evaluation of novel pointer-based and gesture-based interaction techniques for multi-display environments (MDEs). These techniques transcend the constraints of a single display, allowing users to combine multiple displays and interaction devices in order to benefit from the advan- tages of each. First, we introduce a set of pointer warping techniques, which improve existing mouse pointer interaction in an MDE, by allowing users to instantaneously relocate the cursor to an adjacent display, instead of traversing the bezel. Formal evaluations show significant improvements in user performance when compared to standard mouse be- havior. Next, we focus on a particular kind of MDE, in which 3D head-worn augmented re- ality displays are combined with handheld and stationary displays to form a hybrid MDE. A key benefit of hybrid MDEs is that they integrate and utilize the 3D space in which the 2D displays are embedded, creating a seamless visualization environment. We describe the development of a complex hybrid MDE system, called Visual Interac- tion Tool for Archaeology (VITA), which allows for collaborative off-site analysis of archaeological excavation data by distributing the presentation of data among several head-worn, handheld, projected tabletop, and large high-resolution displays. Finally, inspired by the lack of freehand interactions for hybrid MDEs, we designed gestural techniques that address the important issues of interacting across and within 2D and 3D displays.
    [Show full text]
  • Hand-And-Finger-Awareness for Mobiletouch Interaction Using
    Hand-and-Finger-Awareness for Mobile Touch Interaction using Deep Learning Von der Fakultät für Informatik, Elektrotechnik und Informationstechnik und dem Stuttgart Research Centre for Simulation Technology der Universität Stuttgart zur Erlangung der Würde eines Doktors der Naturwissenschaften (Dr. rer. nat.) genehmigte Abhandlung Vorgelegt von Huy Viet Le aus Nürtingen Hauptberichter: Prof. Dr. Niels Henze Mitberichter: Prof. Antti Oulasvirta Mitprüfer: Jun.-Prof. Dr. Michael Sedlmair Tag der mündlichen Prüfung: 28.03.2019 Institut für Visualisierung und Interaktive Systeme der Universität Stuttgart 2019 2 Zusammenfassung Mobilgeräte wie Smartphones und Tablets haben mittlerweile Desktop Compu- ter für ein breites Spektrum an Aufgaben abgelöst. Nahezu jedes Smartphone besitzt einen berührungsempfindlichen Bildschirm (Touchscreen), welches die Ein- und Ausgabe zu einer Schnittstelle kombiniert und dadurch eine intuitive Interaktion ermöglicht. Mit dem Erfolg sind Anwendungen, die zuvor nur für Desktop Computer verfügbar waren, nun auch für Mobilgeräte verfügbar. Dieser Wandel steigerte die Mobilität von Computern und erlaubt es Nutzern dadurch Anwendungen auch unterwegs zu verwenden. Trotz des Erfolgs von Touchscreens sind traditionelle Eingabegeräte, wie Tastatur und Maus, aufgrund ihrer Eingabemöglichkeiten immer noch überlegen. Eine Maus besitzt mehrere Tasten, mit denen verschiedene Funktionen an dersel- ben Zeigerposition aktiviert werden können. Zudem besitzt eine Tastatur mehrere Hilfstasten, mit denen die Funktionalität anderer Tasten vervielfacht werden. Im Gegensatz dazu beschränken sich die Eingabemöglichkeiten von Touchscreens auf zweidimensionale Koordinaten der Berührung. Dies bringt einige Herausfor- derungen mit sich, die die Benutzerfreundlichkeit beeinträchtigen. Unter anderem sind Möglichkeiten zur Umsetzung von Kurzbefehlen eingeschränkt, was Sheider- mans goldene Regeln für das Interface Design widerspricht. Zudem wird meist nur ein Finger für Eingabe verwendet, was die Interaktion verlangsamt.
    [Show full text]
  • Supporting Medical Conversations Between Deaf and Hearing Individuals with Tabletop Displays Anne Marie Piper and James D
    Supporting Medical Conversations between Deaf and Hearing Individuals with Tabletop Displays Anne Marie Piper and James D. Hollan Distributed Cognition and Human-Computer Interaction Laboratory Department of Cognitive Science, University of California, San Diego 9500 Gilman Dr., La Jolla, CA 92093 {apiper, hollan}@ucsd.edu ABSTRACT language interpreter to facilitate communication between a This paper describes the design and evaluation of Shared deaf patient and hearing doctor. Deaf patients must plan Speech Interface (SSI), an application for an interactive ahead to ensure that an interpreter is available. For most multitouch tabletop display designed to facilitate medical patients, privacy is a central concern. Some deaf patients, conversations between a deaf patient and a hearing, non- depending on their comfort level with interpreters, prefer signing physician. We employ a participatory design and actually use an alternate communication channel (e.g., process involving members of the deaf community as well email or instant messenger to discuss sensitive medical as medical and communication experts. We report results issues with their physician). Increasing communication from an evaluation that compares conversation when privacy is one motivation behind the work reported here. facilitated by: (1) a digital table, (2) a human sign language While other viable communication tools for the deaf interpreter, and (3) both a digital table and an interpreter. community exist, tabletop displays with speech recognition Our research reveals that tabletop displays have valuable have potential to facilitate medical conversations between properties for facilitating discussion between deaf and deaf and hearing individuals. Consultations with physicians hearing individuals as well as enhancing privacy and often involve discussion of visuals such as medical records, independence.
    [Show full text]
  • Diamondtouch: a Multi-User Touch Technology
    MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com DiamondTouch: A Multi-User Touch Technology Paul Dietz and Darren Leigh TR2003-125 October 2003 Abstract A technique for creating touch sensitive surfaces is proposed which allows multiple, simul- taneous users to interact in an intuitive fashion. Touch location information is determined independently for each user, allowing each touch on the common surface to be associated with a particular user. The surface gnerates location dependent electric fields, which are capaci- tively coupled through the users to receivers installed in the work environment. We describe the design of these sytems and their applications. Finally, we conclude with a description of the results we have obtained with a first generation prototype. This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. Copyright c Mitsubishi Electric Research Laboratories, Inc., 2003 201 Broadway, Cambridge, Massachusetts 02139 Published in Proceedings of UIST 2001, the 14th Annual ACM Symposium on User Interface Soft- ware and Technology, November 11-14, 2001, Orlando, Florida USA, pages 219-226.
    [Show full text]
  • Diamondtouch SDK:Support for Multi-User, Multi-Touch Applications
    MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com DiamondTouch SDK:Support for Multi-User, Multi-Touch Applications Alan Esenther, Cliff Forlines, Kathy Ryall, Sam Shipman TR2002-48 November 2002 Abstract DiamondTouch is a multi-touch input technology that supports multiple, simultaneous users; it can distinguish who is touching where. We present the DiamondTouch SDK; it provides sup- port for the development of applications that utilize DiamondTouch s capabilities to implement computer-supported collaboration and rich input modalities (such as gestures). Our first demo illustrates the basic utilities and functionality of our system. Our second demo, a multi-user map application, highlights DiamondTouch s ability to sup-port input from multiple, simultane- ous users and exploits Di-amondTouch s ability to identify the owner of each touch. Our third demo illustrates DiamondTouch s ability to run with existing applications by providing a mouse emulation mode. DiamondTouch is well-suited to shared-display applications. It is suitable for front-projected video of the computer display, which facilitates direct manipulation of user interface elements and provides a shared focus of attention for collab-orating users. Possible applications include command-and-control command posts, control rooms, business or technical meetings, and a variety of casual applications in the home, at schools, and in retail settings. CSCW 2002 Demo This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice.
    [Show full text]
  • Vision and Visual Interfaces 1
    PART Vision and Visual Interfaces 1 CHAPTER Face-to-Face Collaborative Interfaces 1 Aaron J. Quigley and Florin Bodea School of Computer Science and Informatics, Complex & Adaptive Systems Laboratory, University College, Dublin, Ireland 1.1 Introduction .................................................................................................................. 4 1.2 Background .................................................................................................................. 7 1.3 Surface User Interface ................................................................................................ 10 1.4 Multitouch .................................................................................................................. 12 1.4.1 Camera-Based Systems............................................................................. 13 1.4.2 Capacitance-Based Systems ...................................................................... 18 1.5 Gestural Interaction..................................................................................................... 20 1.6 Gestural Infrastructures ............................................................................................... 24 1.6.1 Gestural Software Support......................................................................... 25 1.7 Touch Versus Mouse ................................................................................................... 26 1.8 Design Guidelines for SUIs for Collaboration ...............................................................
    [Show full text]
  • Diamondtouch: a Multi-User Touch Technology
    MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com DiamondTouch: A Multi-User Touch Technology Paul Dietz and Darren Leigh TR-2003-125 October 2003 Abstract A technique for creating touch sensitive surfaces is proposed which allows multiple, simultaneous users to interact in an intuitive fashion. Touch location information is determined independently for each user, allowing each touch on the common surface to be associated with a particular user. The surface generates location dependent electric fields, which are capacitively coupled through the users to receivers installed in the work environment. We describe the design of these systems and their applications. Finally, we conclude with a description of the results we have obtained with a first generation prototype. This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. Copyright c Mitsubishi Electric Research Laboratories, Inc., 2003 201 Broadway, Cambridge, Massachusetts 02139 Published in Proceedings of UIST 2001, the 14th Annual ACM Symposium on User Interface Soft- ware and Technology, November 11-14, 2001, Orlando, Florida USA, pages 219-226.
    [Show full text]