DOCSLIB.ORG

Gesticulation Behaviors for Virtual Humans

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Gesticulation Behaviors for Virtual Humans University of Pennsylvania ScholarlyCommons Center for Human Modeling and Simulation Department of Computer & Information Science October 1998 Gesticulation Behaviors for Virtual Humans Liwei Zhao University of Pennsylvania Norman I. Badler University of Pennsylvania, [email protected] Follow this and additional works at: https://repository.upenn.edu/hms Recommended Citation Zhao, L., & Badler, N. I. (1998). Gesticulation Behaviors for Virtual Humans. Retrieved from https://repository.upenn.edu/hms/21 Copyright 1998 IEEE. Reprinted from Sixth Pacific Conference on Computer Graphics and Applications, 1998, pages 161-168. Publisher URL: http://dx.doi.org/10.1109/PCCGA.1998.732100 This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of the University of Pennsylvania's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it. This paper is posted at ScholarlyCommons. https://repository.upenn.edu/hms/21 For more information, please contact [email protected]. Gesticulation Behaviors for Virtual Humans Abstract Gesture and speech are two very important behaviors for virtual humans. They are not isolated from each other but generally employed simultaneously in the service of the same intention. An underlying PaT-Net parallel finite-state machine may be used to coordinate them both. Gesture selection is not arbitrary. Typical movements correlated with specific textual elements are used to select and produce gesticulation online. This enhances the expressiveness of speaking virtual humans. Keywords virtual human, agent, avatar, gesture, posture, PaT-Nets Comments Copyright 1998 IEEE. Reprinted from Sixth Pacific Conference on Computer Graphics and Applications, 1998, pages 161-168. Publisher URL: http://dx.doi.org/10.1109/PCCGA.1998.732100 This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of the University of Pennsylvania's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it. This conference paper is available at ScholarlyCommons: https://repository.upenn.edu/hms/21 Gesticulation Behaviors for Virtual Humans Liwei Zhao and Norman I. Badler Center for Human Mo deling and Simulation Department of Computer and Information Science UniversityofPennsylvania Philadelphia PA 19104-638 9 USA [email protected] enn.edu, [email protected] enn.edu 1-215-898-5 862 phone; 1-215-573- 745 3 fax Abstract Beats are small formless waves of the hand that o ccur with heavily emphasized words, o ccasions Gesture and speech are two very important behaviors of turning over the o or to another sp eaker, and for virtual humans. They are not isolatedfrom each other kinds of sp ecial linguistic work. other but general ly employed simultaneously in the ser- While Cassell's system implemented instances of each vice of the same intention. An underlying PaT-Net typ e of gesture, the most prevalentwere iconics linked paral lel nite-state machine may be usedtocoordinate to mentions of sp eci c ob jects, metaphorics linked to them both. Gesture selection is not arbitrary. Typi- sp eci c actions, and b eats linked to sp eechintonation. cal movements correlated with speci c textual elements Following Cassell's lead, new problems in gesture are used to select and produce gesticulation online. generation were exp osed. This enhances the expressiveness of speaking virtual hu- mans. 1. Coarticulation: Generating a smo oth transition Keywords: Virtual Human, Agent, Avatar, Gesture, from one gesture to the next without returning Posture, PaT-Nets to a sp eci c rest p ose. 2. Expression: Mo difying the p erformance of a ges- ture to re ect the agent's manner or p ersonality. 1 Intro duction 3. Spatialization: Integrating a deictic gesture into the surrounding context. The past few years have seen several research e orts on human gestures i.e. [1,2, 5, 8, 27, 18, 16, 13]. Many 4. Selection: Generating a metaphoric that mightbe of these pro jects have fo cused on interpreting human asso ciated with an abstract concept. gestures for interactive control. Creating appropriate Problem 1, coarticulation, has b een addressed bya gestures in a virtual human has not b een as well studied numb er of computer graphics researchers [8,12, 28, b ecause the range of gestures p erformed during sp eech 26], although the issue has other asp ects suchas output is much larger than a symb olic selection set used preparatory actions which remain unsolved. Prob- for discrete inputs. For example, in [8] four gesture lem 2, expression, is b eing investigated at a number typ es are distinguished: of places [6, 33, 10]. In this pap er, weinvestigate problems 3 and 4. Of these two, spatialization is eas- Iconics represent some concrete feature of the ac- ier, since the desired gesture is combined or comp os- companying sp eech, such as an ob ject's shap e. ited with inverse kinematics to p oint or align the ges- turing b o dy part with the spatial referent. Selection Metaphorics represent an abstract feature concur- entails determining gestures that p eople would likely rently sp oken ab out. interpret and accept as \natural" and \representative." These concepts are orthogonal: a naturally p erformed Deictics indicate a p oint in space, and may refer to motion captured gesture might not b e appropriate to p ersons, places and other spatializeable discourse entities. the sp eech text, while a synthesized less natural arm motion might nevertheless b e representative of the ex- tures and sp eech. Kendon [20] o ers a distinction b e- pressed concepts. tween autonomous gestures gestures p erformed with- out accompanying sp eech and gesticulation gesture The selection problem itself splits into two: one is p erformed concurrently with phonological utterance. the creation of the gestural motion and the other is the Gestures and sp eech are closely asso ciated together. mapping from the textual content to the gesture. For They are generally employed simultaneously in the ser- example, to create a character waving hello during a vice of the same intention. Well-co ordinated gestures greeting, one has to create the waving motion as well and sp eech enhance the expressiveness and b elievabil- as know when to invoke it up on encountering a greet- ity of sp eaking virtual humans. In this pap er, we re- ing context. In this work we assume that the motions strict our investigation to gesticulation. themselves are generated byinverse kinematics, mo- tion capture, or otherwise pre-created e.g. key p ose sequences. Our contribution lies in prop osing a repre- 2.1 Gestures sentative mapping from concepts to gestures such that they are selected based on stylized rhetorical sp eaking. The study of gestures in dance and oratory may date To select and spatialize various gestures correlating back to the b eginning of seventeenth century [7]. More sp eech and language, we use an underlying co ordina- recently, semioticists from the elds of anthrop ology, tion scheme called PaT-Nets [3]. The virtual human neurophysiology, neuropsychology and psycholinguis- 1 animation is implemented as an extensions to Jack . tics Freedman [17]; Wiener, Devo e, Rubinow and The inputs see b elow to the system are in the form of Geller [34]; McNeill and Levy [24] have b een inter- sp eech texts with emb edded commands, most of which ested in the study of gestures. The Lexis dictionary are related to gestures. The gestures are controlled 1977 gives the most general de nition of gesture | by PaT-Nets to coincide with the utterance of the \movements of b o dy parts, particularly the arms, the sp eech. While the emb edded commands in our exam- hands or the head conveying, or not conveying, mean- ples are manually inserted for now, the idea is to detect ing." the presence of the corresp onding concepts in the raw While gestures are the \little" movements that are text stream and automatically insert the deictics and con ned to a part or parts of the b o dy, if just con- metaphorics based solely on the words used. sidered in isolation they havevery limited contribu- tion to make to non-verbal communication. Emblems warning welcome. Hello, ngest nhead front Currently, I can supp ort following basic arm gestures. and manual languages, such as American Sign Lan- Now let me intro duce you some simple ob jects I know: idxfftable.table.cornerg this is a table np oint guage, are exceptions b ecause the communication is np oint idxffdo or.do or.panelg this is a do or idxffchair1.chair.redg this is red chair np oint fully b orne bymovements. Gestures are rarely p er- np oint idxffchair0.chair.yellowg this is yellowchair slant right Let me showyou the basic arm gestures nhead formed outside a communicative context and only o cca- ngest arm reject arm reject gesture ngest arm unlikely arm unlikely gesture sionally transmit any depth of emotion or information, arm not arm not gesture ngest ngest arm improbable arm improbable gesture since, as so on as there is any complicated meaning, the ngest arm doubtful arm doubtful gesture arm probable arm probable gesture ngest gestures can only b e \read" in relation to the whole ngest arm tis arm it is gesture expressivemovement of the b o dy [14,9,22].
Load more

Recommended publications
  • The Meanings of the Term Mudra and a Historical Outline of "Hand
    The Meanings of the term Mudra T h e M and a Historical Outline of ae n ni "Hand gestures" g s o f ht e Dale Todaro t re m M u d 梗 概 ar a この 拙 論 は2部 に分 か れ る。 n d 第1部 は"mudra"と い う語 の最 も一 般 的 な 定 義 を 扱 う。仏 教 ・ヒ ン ドゥー 教 a H を 研 究 して い る学 者 や東 洋 の 図像 学 の専 門 家 は、 大 抵、"皿udra"の さ ま ざ まな 意 i torical Outline味 を 知 って い る。 しか し、特 に タ ン トラ にお い て 使 用 され た"mudr翫"の す べ て の 定 義 が、 どん な 参考 文 献 に も見 つ か るわ け で は な い。 従 って、 第1部 は これ ら 種 々の、 一 般 的 な"mudra"の 語 法 を集 め る よ う試 み た。 又、 イ ン ドの舞 踏 や 劇 につ いて 書 いた 人 が、"hasta"と い う語 を 使 用 す べ きで あ るの に、 専 門的 に言 え ば 誤 って"mudra"を 用 いて い る。 それ に つ いて も説 明 を試 み た。 fo " 第1部 よ りも長 い 第2部 で は、"印 契(手 印)"と い う意 味 で使 用 され た"mu- H a dra"の 歴 史 の あ らま しを、 系 統 的 に述 べ た。 印契 の歴 史 上 異 な った 使 用 と意 味 n d g は、 次 の4に お い て 顕著 にみ られ る。 即 ち、1)ヴ ェー ダ の儀 礼、2)規 格 化 され た se ut イ ン ドの舞 踏、3)イ ン ドの彫 刻(仏 教、 ヒ ン ド ゥー 教、 ジ ャイ ナ教)、4)タ ン ト r s"e ラの 成 就 法、 で あ る。 これ ら4の 分 野 は す べ て、 共 通 して、 イ ン ドで 使 用 され た 印 契 の 伝統 か ら由 来 して い る。 そ しで、 い くつか の事 例 に お いて、 イ ン ドか ら 日 本 密 教 の 伝 統 まで に わ た って、 特 定 の"mudra"が 驚 くほ ど継 続 して 使 用 され て い るこ とが、 証 明 で き る。 Introduction The goal of this short essay is twofold.
    [Show full text]
  • This List of Gestures Represents Broad Categories of Emotion: Openness
    This list of gestures represents broad categories of emotion: openness, defensiveness, expectancy, suspicion, readiness, cooperation, frustration, confidence, nervousness, boredom, and acceptance. By visualizing the movement of these gestures, you can raise your awareness of the many emotions the body expresses without words. Openness Aggressiveness Smiling Hand on hips Open hands Sitting on edge of chair Unbuttoning coats Moving in closer Defensiveness Cooperation Arms crossed on chest Sitting on edge of chair Locked ankles & clenched fists Hand on the face gestures Chair back as a shield Unbuttoned coat Crossing legs Head titled Expectancy Frustration Hand rubbing Short breaths Crossed fingers “Tsk!” Tightly clenched hands Evaluation Wringing hands Hand to cheek gestures Fist like gestures Head tilted Pointing index finger Stroking chins Palm to back of neck Gestures with glasses Kicking at ground or an imaginary object Pacing Confidence Suspicion & Secretiveness Steepling Sideways glance Hands joined at back Feet or body pointing towards the door Feet on desk Rubbing nose Elevating oneself Rubbing the eye “Cluck” sound Leaning back with hands supporting head Nervousness Clearing throat Boredom “Whew” sound Drumming on table Whistling Head in hand Fidget in chair Blank stare Tugging at ear Hands over mouth while speaking Acceptance Tugging at pants while sitting Hand to chest Jingling money in pocket Touching Moving in closer Dangerous Body Language Abroad by Matthew Link Posted Jul 26th 2010 01:00 PMUpdated Aug 10th 2010 01:17 PM at http://news.travel.aol.com/2010/07/26/dangerous-body-language-abroad/?ncid=AOLCOMMtravsharartl0001&sms_ss=digg You are in a foreign country, and don't speak the language.
    [Show full text]
  • Hand Gestures
    L2/16-308 More hand gestures To: UTC From: Peter Edberg, Emoji Subcommittee Date: 2016-10-31 Proposed characters Tier 1: Two often-requested signs (ILY, Shaka, ILY), and three to complete the finger-counting sets for 1-3 ​ (North American and European system). None of these are known to have offensive connotations. HAND SIGN SHAKA ● Shaka sign ​ ● ASL sign for letter ‘Y’ ● Can signify “Aloha spirit”, surfing, “hang loose” ● On Emojipedia top requests list, but requests have dropped off ​ ​ ● 90°-rotated version of CALL ME HAND, but EmojiXpress has received requests for SHAKA specifically, noting that CALL ME HAND does not fulfill need HAND SIGN ILY ● ASL sign for “I love you” (combines signs for I, L, Y), has moved into ​ ​ mainstream use ● On Emojipedia top requests list ​ HAND WITH THUMB AND INDEX FINGER EXTENDED ● Finger-counting 2, European style ● ASL sign for letter ‘L’ ● Sign for “loser” ● In Montenegro, sign for the Liberal party ● In Philippines, sign used by supporters of Corazon Aquino ● See Wikipedia entry ​ ​ HAND WITH THUMB AND FIRST TWO FINGERS EXTENDED ● Finger-counting 3, European style ● UAE: Win, victory, love = work ethic, success, love of nation (see separate proposal L2/16-071, which is the source of the information ​ ​ below about this gesture, and also the source of the images at left) ● Representation for Ctrl-Alt-Del on Windows systems ● Serbian “три прста” (tri prsta), symbol of Serbian identity ​ ​ ● Germanic “Schwurhand”, sign for swearing an oath ​ ​ ● Indication in sports of successful 3-point shot (basketball), 3 successive goals (soccer), etc. HAND WITH FIRST THREE FINGERS EXTENDED ● Finger-counting 3, North American style ● ASL sign for letter ‘W’ ● Scout sign (Boy/Girl Scouts) is similar, has fingers together ​ Tier 2: Complete the finger-counting sets for 4-5, plus some less-requested hand signs.
    [Show full text]
  • Pointing Gesture in Young Children Hand Preference and Language Development
    Pointing gesture in young children Hand preference and language development Hélène Cochet and Jacques Vauclair Aix-Marseille University This paper provides an overview of recent studies that have investigated the development of pointing behaviors in infants and toddlers. First, we focus on deictic gestures and their role in language development, taking into account the different hand shapes and the different functions of pointing, and examining the cognitive abilities that may or may not be associated with the production of pointing gestures. Second, we try to demonstrate that when a distinction is made between pointing gestures and manipulative activities, the study of children’s hand preference can help to highlight the development of speech-gesture links. Keywords: toddlers, gestural communication, pointing, handedness, speech- gesture system Emergence of communicative gestures: Focus on pointing gestures Pointing is a specialized gesture for indicating an object, event or location. Chil- dren start using pointing gestures at around 11 months of age (Butterworth & Morissette, 1996; Camaioni, Perucchini, Bellagamba, & Colonnesi, 2004), and this behavior opens the door to the development of intentional communication. One of the prerequisites for the production of pointing gestures is a shared experi- ence between the signaler and the recipient of the gesture, that is, a simultaneous engagement with the same external referent, usually referred to as joint attention (e.g., Carpenter, Nagell, & Tomasello, 1998). While pointing is sometimes regard- ed as a “private gesture” (Delgado, Gómez, & Sarriá, 2009), whose main role is to regulate the infant’s attention rather than to enable the latter to communicate with a recipient, a growing body of research suggests that the onset of pointing gestures reflects a newly acquired ability to actively direct the adult’s attention to outside entities in triadic interactions (e.g., Liszkowski, 2005; Tomasello, Carpenter, & Liszkowski, 2007).
    [Show full text]
  • 16 Gestures by 16 Months
    16 Gestures by 16 Months Children Should Learn at Least 16 Gestures by 16 Months Good communication development starts in the first year of life and goes far beyond learning how to talk. Communication development has its roots in social interaction with parents and other caregivers during everyday activities. Your child’s growth in social communication is important because it helps your child connect with you, learn language and play concepts, and sets the stage for learning to read and future success in school. Good com- munication skills are the best tool to prevent behavior problems and make it easier to work through moments of frustration that all infants and toddlers face. Earlier is Better Catching communication and language difficulties By observing children’s early early can prevent potential problems later with gestures, you can obtain a critical behavior, learning, reading, and social interaction. snapshot of their communication Research on brain development reminds us that “earlier IS better” when teaching young children. development. Even small lags in The most critical period for learning is during the communication milestones can first three years of a child’s life. Pathways in the add up and impact a child’s rate brain develop as infants and young children learn of learning that is difficult to from exploring and interacting with people and objects in their environment. The brain’s architec- change later. Research with young ture is developing the most rapidly during this crit- children indicates that the development of gestures from 9 to 16 ical period and is the most sensitive to experiential months predicts language ability 2 years later, which is significant learning.
    [Show full text]
  • University of Groningen a Cultural History of Gesture Bremmer, JN
    University of Groningen A Cultural History Of Gesture Bremmer, J.N.; Roodenburg, H. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below. Document Version Publisher's PDF, also known as Version of record Publication date: 1991 Link to publication in University of Groningen/UMCG research database Citation for published version (APA): Bremmer, J. N., & Roodenburg, H. (1991). A Cultural History Of Gesture. s.n. Copyright Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons). The publication may also be distributed here under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license. More information can be found on the University of Groningen website: https://www.rug.nl/library/open-access/self-archiving-pure/taverne- amendment. Take-down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum. Download date: 02-10-2021 The 'hand of friendship': shaking hands and other gestures in the Dutch Republic HERMAN ROODENBURG 'I think I can see the precise and distinguishing marks of national characters more in those nonsensical minutiae than in the most important matters of state'.
    [Show full text]
  • The Use of Gesture in Architecture
    the use of gesture donald kunze • art3idea.psu.edu/boundaries/ In the design of architecture and landscape, the role of dynamics is evident not simply in accommodation of the (presumably) mobile behaviors of the occupants and their perceptions but as an indicator of a ‘signifier-ness’ (a sense of meaningfulness without any particular meaning attached). ‘Gesture’ stands for the ways in which mate- rial form can be imagined to express in ways analogous to human gesturing: pointing, opening, perching, facing, gazing, sneaking, waiting … in short, the full range of dramatic positions that an actor on the stage might take to indicate attitude, intention, emotion, or rôle. Gesture typically involves symmetrical signing. Thickening of one element is accompanied by the thinning of another. A opening directed skyward requires an opening (or closing) at a low point. These pairings can form an ‘idiotic symmetry’ (each element, though balanced by another, equally lacks an assigned function or meaning). Alternately, pairs can refer to a missing or silent third term that works to prevent or foreclose some spatial/temporal relationship. 1. gesture in general Gesture is the ‘language of the body’, a means of silent speech that can be read as intentional or unintentional. Gesture animates and re-configures the body, its parts, and their relationships. Gesture can create divisions, such as an audience and stage division. It can indicate impossibility (biting one’s elbow, an Italian gesture), difficulty (biting one’s hand), intelligence (pulling down the lower eye-lid), discovery (pointing to the head), idiocy (a screwing motion with the index finger to the cheek, an offensive gesture in Germany), and the countless obscene gestures in all cultures that are used for insult or mockery.
    [Show full text]
  • Prepose: Privacy, Security, and Reliability for Gesture-Based Programming
    Prepose: Privacy, Security, and Reliability for Gesture-Based Programming Lucas Silva Figueiredo∗, Benjamin Livshitsy, David Molnary, and Margus Veanesy Federal University of Pernambuco∗ Microsoft Researchy F Abstract|With the rise of sensors such as the Microsoft Kinect, Leap of an OS abstraction called a recognizer which enables Motion, and hand motion sensors in phones (i.e., Samsung Galaxy S6), gesture detection. Yet their approach fails to provide a gesture-based interfaces have become practical. Unfortunately, today, way to extend the system with new recognizers in a safe to recognize such gestures, applications must have access to depth and manner. SurroundWeb [27] demonstrates what a 3D web video of the user, exposing sensitive data about the user and her environ- ment. Besides these privacy concerns, there are also security threats in browser modified with new abstractions for input and sensor-based applications, such as multiple applications registering the output to protect privacy and security would look like. Yet same gesture, leading to a conflict (akin to Clickjacking on the web). it also lacks the capacity for precise automatic reasoning. We address these security and privacy threats with Prepose, a novel We are also inspired by world-drive access control [24], domain-specific language (DSL) for easily building gesture recognizers, which attempts to restrict applications from accessing combined with a system architecture that protects privacy, security, and sensitive objects in the environment. Lastly, Proton [15] reliability with untrusted applications. We run Prepose code in a trusted is an example of defining a higher-level abstraction for core, and only return specific gesture events to applications.
    [Show full text]
  • Module-04-Greetings-Etiquette-And
    Event Planner Module 04 4. Module 04- Greetings etiquette and handshake protocol Table of Contents 4. Module 04- Greetings etiquette and handshake protocol ............................................................................ 1 4.1 Managing Greetings etiquette and handshake protocol ......................................................................... 2 4.2 Handshake, greetings, and kisses ............................................................................................................ 3 4.3 Personal space ......................................................................................................................................... 5 4.4 Hand kisses ............................................................................................................................................... 5 1 | P a g e 4.1 Managing Greetings etiquette and handshake protocol Working as an event manager, you will certainly deal with people from different countries, cultures, and backgrounds. This can be fun, but also can be a little complicated. The customs and rituals involved in greeting often differ from country to country, and unfamiliar customs may be confusing. The situation becomes even more complex when different greeting gestures are required between men and women, women and women, and men and men. Luckily, the ultimate pleasant gesture is used in every country. Although occasionally, in some cultures and under certain circumstances, it may have negative connotations, this ultimate gesture is seldom misunderstood
    [Show full text]
  • Gestures: Your Body Speaks
    GESTURES: YOUR BODY SPEAKS How to Become Skilled WHERE LEADERS in Nonverbal Communication ARE MADE GESTURES: YOUR BODY SPEAKS TOASTMASTERS INTERNATIONAL P.O. Box 9052 • Mission Viejo, CA 92690 USA Phone: 949-858-8255 • Fax: 949-858-1207 www.toastmasters.org/members © 2011 Toastmasters International. All rights reserved. Toastmasters International, the Toastmasters International logo, and all other Toastmasters International trademarks and copyrights are the sole property of Toastmasters International and may be used only with permission. WHERE LEADERS Rev. 6/2011 Item 201 ARE MADE CONTENTS Gestures: Your Body Speaks............................................................................. 3 Actions Speak Louder Than Words...................................................................... 3 The Principle of Empathy ............................................................................ 4 Why Physical Action Helps........................................................................... 4 Five Ways to Make Your Body Speak Effectively........................................................ 5 Your Speaking Posture .................................................................................. 7 Gestures ................................................................................................. 8 Why Gestures? ...................................................................................... 8 Types of Gestures.................................................................................... 9 How to Gesture Effectively..........................................................................
    [Show full text]
  • Emblems & Illustrators Kinesics • Body
    Chapter8, Presentation 2 1 CHAPTER 8 The Nonverbal Code Part 2: Body language - Emblems & Illustrators 2 Kinesics • Body movement, including gestures, hand/arm movement, leg movement, facial expressions, eye gaze, and stance/ posture • Categories…. – Emblems—direct literal verbal translation – Illustrators—accent/complement what is being said • Meta-communicative – Affect displays—facial expressions of emotion • Considered universal – Regulators—behaviors/actions that govern, direct, or manage conversation – Adaptors—actions that satisfy physiological or psychological needs 3 Emblems & Illustrators • Emblems are primarily hand gestures that have a direct literal verbal translation • Illustrators are typically hand and arm movements that accompany speech or function to accent or complement what is being said 4 What does it mean? 5 What does it mean? 6 What does it mean? 7 Functions of emblems & illustrators • Main uses: 1. Greetings & departures 2. To insult or to utter obscenities to others 3. To indicate fight or flight 4. To designate friendly or romantic relationships 1 • Also common: signs for homosexuals • Gestures culturally bound – Sometimes gestures can be regional in nature 8 Emblem gestures: Yes and no 9 Emblem gestures: Yes and no • Regional gestures – “Gesture frontiers” amazingly resilient, resistant to national boundaries – Historical origins – Head toss: originally Greek, used in southern Italy 10 Illustrator Example: Greetings 11 Illustrator Example: Greetings • Handshake: far from universal – “Limp fish” universally disdained?
    [Show full text]
  • Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: a Review
    remote sensing Review Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review Shahzad Ahmed 1 , Karam Dad Kallu 2, Sarfaraz Ahmed 1 and Sung Ho Cho 1,* 1 Department of Electronic Engineering, Hanyang University, 222 Wangsimini-ro, Seongdong-gu, Seoul 133-791, Korea; [email protected] (S.A.); [email protected] (S.A.) 2 Robotics and Intelligent Machine Engineering (RIME), School of Mechanical and Manufacturing Engineering (SMME), National University of Science and Technology (NUST), H-12 Islamabad 44000, Pakistan; [email protected] * Correspondence: [email protected]; Tel.: +82-(02)-2220-4883 Abstract: Human–Computer Interfaces (HCI) deals with the study of interface between humans and computers. The use of radar and other RF sensors to develop HCI based on Hand Gesture Recognition (HGR) has gained increasing attention over the past decade. Today, devices have built-in radars for recognizing and categorizing hand movements. In this article, we present the first ever review related to HGR using radar sensors. We review the available techniques for multi-domain hand gestures data representation for different signal processing and deep-learning-based HGR algorithms. We classify the radars used for HGR as pulsed and continuous-wave radars, and both the hardware and the algorithmic details of each category is presented in detail. Quantitative and qualitative analysis of ongoing trends related to radar-based HCI, and available radar hardware and algorithms is also presented. At the end, developed devices and applications based on gesture- recognition through radar are discussed. Limitations, future aspects and research directions related to this field are also discussed.
    [Show full text]