Is It Contagious? an Eye-Movement and Emg Study of Smile Authenticity Judgment

Total Page:16

File Type:pdf, Size:1020Kb

Is It Contagious? an Eye-Movement and Emg Study of Smile Authenticity Judgment IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT by JUSTIN CHAMBERLAND Thesis submitted in partial fulfillment of the requirement for the degree of Master of Arts in Psychology (M.A.) Faculty of Graduate Studies Laurentian University Sudbury, Ontario © JUSTIN CHAMBERLAND, 2016 ii THESIS DEFENCE COMMITTEE/COMITÉ DE SOUTENANCE DE THÈSE Laurentian Université/Université Laurentienne Faculty of Graduate Studies/Faculté des études supérieures Title of Thesis Titre de la thèse IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT Name of Candidate Nom du candidat Chamberland, Justin Degree Diplôme Master of Arts Department/Program Date of Defence Département/Programme Psychology Date de la soutenance March 10, 2016 APPROVED/APPROUVÉ Thesis Examiners/Examinateurs de thèse: Dr. Annie Roy-Charland (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Mélanie Perron (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Robert Jack (Committee member/Membre du comité) Dr. Joel Dickinson (Committee member/Membre du comité) Approved for the Faculty of Graduate Studies Approuvé pour la Faculté des études supérieures Dr. David Lesbarrères Monsieur David Lesbarrères Dr. Lauri Nummenmaa Acting Dean, Faculty of Graduate Studies (External Examiner/Examinateur externe) Doyen intérimaire, Faculté des études supérieures ACCESSIBILITY CLAUSE AND PERMISSION TO USE I, Justin Chamberland, hereby grant to Laurentian University and/or its agents the non-exclusive license to archive and make accessible my thesis, dissertation, or project report in whole or in part in all forms of media, now or for the duration of my copyright ownership. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also reserve the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. I further agree that permission for copying of this thesis in any manner, in whole or in part, for scholarly purposes may be granted by the professor or professors who supervised my thesis work or, in their absence, by the Head of the Department in which my thesis work was done. It is understood that any copying or publication or use of this thesis or parts thereof for financial gain shall not be allowed without my written permission. It is also understood that this copy is being made available in this form by the authority of the copyright owner solely for the purpose of private study and research and may not be copied or reproduced except as permitted by the copyright laws without written authority from the copyright owner. iii Table of Contents Table of Contents ........................................................................................................................... iii List of Figures ................................................................................................................................. v List of Tables ................................................................................................................................. vi Abstract ........................................................................................................................................... 1 1 Introduction ............................................................................................................................... 2 1.1 Production of Smiles ........................................................................................................ 2 1.1.1 Masking Smiles ......................................................................................................... 3 1.2 Embodied Simulation ....................................................................................................... 6 1.3 Electromyography and Facial Mimicry............................................................................ 8 1.4 Emotional Contagion...................................................................................................... 13 1.5 Current Study ................................................................................................................. 16 2 Methods and Materials ............................................................................................................ 18 2.1 Participants ..................................................................................................................... 18 2.2 Materials ......................................................................................................................... 19 2.2.1 Stimuli ..................................................................................................................... 19 2.2.2 Emotional Contagion Scale..................................................................................... 21 2.2.3 EMG Measures ....................................................................................................... 21 2.2.4 Eye-Tracking Measures .......................................................................................... 22 2.3 Procedure ........................................................................................................................ 22 2.4 Data Analysis ................................................................................................................. 23 2.4.1 Behavioural ............................................................................................................. 23 2.4.2 Eye-Movements ...................................................................................................... 24 2.4.3 Electromyography ................................................................................................... 24 3 Results ..................................................................................................................................... 25 3.1 Accuracy......................................................................................................................... 25 3.1.1 Truly Happy Question............................................................................................. 25 3.1.2 Another Emotion Question ..................................................................................... 26 3.1.3 What Emotion Question .......................................................................................... 26 3.2 Eye-Movements ............................................................................................................. 28 3.2.1 Total Dwell Time .................................................................................................... 28 3.2.2 Proportion of Time .................................................................................................. 29 3.3 EMG Activity ................................................................................................................. 30 3.4 Regressions..................................................................................................................... 32 iv 3.4.1 Truly Happy Question............................................................................................. 32 3.4.2 Explicit Knowledge ................................................................................................ 33 3.4.3 EMG Activity.......................................................................................................... 33 4 Discussion ............................................................................................................................... 36 5 Conclusion .............................................................................................................................. 45 References ..................................................................................................................................... 46 Appendix A ................................................................................................................................... 53 Appendix B ................................................................................................................................... 54 v List of Figures Figure 1 ......................................................................................................................................... 20 Figure 2 ......................................................................................................................................... 25 Figure 3 ......................................................................................................................................... 26 Figure 4 ......................................................................................................................................... 28 Figure 5 ......................................................................................................................................... 29 Figure 6 ......................................................................................................................................... 31 Figure 7 ......................................................................................................................................... 31 vi List of Tables Table 1 .......................................................................................................................................... 34 Table 2 .......................................................................................................................................... 35 Table 3 .........................................................................................................................................
Recommended publications
  • Emotions and Deception Detection
    Emotions and Deception Detection Mircea Zloteanu Division of Psychology and Language Sciences University College London, UK A dissertation submitted in part fulfilment of the requirement for the degree of Doctor of Philosophy in Psychology Prepared under the supervision of Dr. Daniel C. Richardson September 2016 1 I, Mircea Zloteanu, confirm that the work presented in this thesis is my own. Where information has been derived from other sources, I confirm that this has been indicated in the thesis. Signature 2 Abstract Humans have developed a complex social structure which relies heavily on communication between members. However, not all communication is honest. Distinguishing honest from deceptive information is clearly a useful skills, but individuals do not possess a strong ability to discriminate veracity. As others will not willingly admit they are lying, one must rely on different information to discern veracity. In deception detection, individuals are told to rely on behavioural indices to discriminate lies and truths. A source of such indices are the emotions displayed by another. This thesis focuses on the role that emotions have on the ability to detect deception, exploring the reasons for low judgemental accuracy when individuals focus on emotion information. I aim to demonstrate that emotion recognition does not aid the detection of deception, and can result in decreased accuracy. This is attributed to the biasing relationship of emotion recognition on veracity judgements, stemming from the inability of decoders to separate the authenticity of emotional cues. To support my claims, I will demonstrate the lack of ability of decoders to make rational judgements regarding veracity, even if allowed to pool the knowledge of multiple decoders, and disprove the notion that decoders can utilise emotional cues, both innately and through training, to detect deception.
    [Show full text]
  • Facial Micro-Expression Analysis Jingting Li
    Facial Micro-Expression Analysis Jingting Li To cite this version: Jingting Li. Facial Micro-Expression Analysis. Computer Vision and Pattern Recognition [cs.CV]. CentraleSupélec, 2019. English. NNT : 2019CSUP0007. tel-02877766 HAL Id: tel-02877766 https://tel.archives-ouvertes.fr/tel-02877766 Submitted on 22 Jun 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THESE DE DOCTORAT DE CENTRALESUPELEC COMUE UNIVERSITE BRETAGNE LOIRE ECOLE DOCTORALE N° 601 Mathématiques et Sciences et Technologies de l'Information et de la Communication Spécialité : Signal, Image, Vision Par « Jingting LI » « Facial Micro-Expression Analysis » Thèse présentée et soutenue à « Rennes », le « 02/12/2019 » Unité de recherche : IETR Thèse N° : 2019CSUP0007 Rapporteurs avant soutenance : Composition du Jury : Olivier ALATA Professeur, Université Jean Monnet, Président / Rapporteur Saint-Etienne Olivier ALATA Professeur, Fan YANG-SONG Professeur, Université de Bourgogne, Université Jean Monnet, Dijon Saint-Etienne Rapporteuse Fan YANG-SONG Professeur, Université de Bourgogne,
    [Show full text]
  • Darwin, Deception, and Facial Expression
    Darwin, Deception, and Facial Expression PAUL EKMAN Department of Psychiatry, University of California, San Francisco, San Francisco, California 94143, USA ABSTRACT: Darwin did not focus on deception. Only a few sentences in his book mentioned the issue. One of them raised the very interesting question of whether it is difficult to voluntarily inhibit the emotional expressions that are most difficult to voluntarily fabricate. Another suggestion was that it would be possible to unmask a fabricated expression by the absence of the difficult-to-voluntarily-generate facial actions. Still another was that during emotion body movements could be more easily suppressed than fa- cial expression. Research relevant to each of Darwin’s suggestions is re- viewed, as is other research on deception that Darwin did not foresee. KEYWORDS: Darwin; deception; facial expression; lies; lying; emotion; in- hibition; smile; leakage; micro-facial-expressions; Facial Action Coding System; illustrators; pitch; Duchenne; asymmetry The scientific study of the facial expression of emotion began with Charles Darwin’s The Expression of Emotions in Man and Animals, first published in 1872.1 Among his many extraordinary contributions Darwin gathered ev- idence that some emotions have a universal facial expression, cited examples and published pictures suggesting that emotions are evident in other ani- mals, and proposed principles explaining why particular expressions occur for particular emotions—principles that, he maintained, applied to the ex- pressions of all animals. But Darwin did not consider at any length when, how, and why emotional expressions are reliable or misleading. Neither deception nor lies (or lying) appears in the index to his book.
    [Show full text]
  • Microexpression Identification and Categorization Using a Facial
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2016 1 Microexpression Identification and Categorization using a Facial Dynamics Map Feng Xu, Junping Zhang, James Z. Wang Abstract—Unlike conventional facial expressions, microexpres- researchers have investigated spontaneous expressions that can sions are instantaneous and involuntary reflections of human reflect true emotions [9], [10]. emotion. Because microexpressions are fleeting, lasting only a As a type of spontaneous expression, microexpressions have few frames within a video sequence, they are difficult to perceive and interpret correctly, and they are highly challenging to identify not yet been explored extensively [11]–[15]. Microexpressions and categorize automatically. Existing recognition methods are are involuntary and instant facial dynamics during the time often ineffective at handling subtle face displacements, which can the subject is experiencing emotions, including when the be prevalent in typical microexpression applications due to the subject attempts to conceal emotions, especially in high-stake constant movements of the individuals being observed. To address situations [16], [17]. As early as in 1969, Ekman observed this problem, a novel method called the Facial Dynamics Map is proposed to characterize the movements of a microexpression in microexpresssions when he analyzed an interview video of a different granularity. Specifically, an algorithm based on optical patient with depression [18]. The patient who attempted to flow estimation is used to perform pixel-level alignment for commit suicide showed brief yet intense sadness but resumed microexpression sequences. Each expression sequence is then smiling quickly. Such microexpressions only last for a few divided into spatiotemporal cuboids in the chosen granularity. We frames in the standard 25 fps (frames per second) video but also present an iterative optimal strategy to calculate the princi- pal optical flow direction of each cuboid for better representation are often capable of revealing the actual emotions of subjects of the local facial dynamics.
    [Show full text]
  • DOCTORAL THESIS the Empathy Fillip: Can Training in Microexpressions of Emotion Enhance Empathic Accuracy? Eyles, Kieren
    DOCTORAL THESIS The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Eyles, Kieren Award date: 2016 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 04. Oct. 2021 The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Presented by: Kieren Eyles A thesis submitted in partial fulfilment of the requirements of the degree of PsychD, Department of Psychology, University of Roehampton 2015 Abstract Empathy is a central concern in the counselling process. Though much researched, and broadly commented upon, empathy is still largely understood through the words within a client-counsellor interaction. This semantic focus continues despite converging lines of evidence that suggest other elements of an interaction – for example body language – may be involved in the communication of empathy. In this thesis, the foundations of empathy are examined, focusing on empathy’s professional instantiation.
    [Show full text]
  • The Effect of Trait Empathy on Emotional Contagion Through Art
    Tilburg University Perceiving emotion in non-social targets Stavrova, O.; Meckel, Andrea Published in: Motivation and Emotion DOI: 10.1007/s11031-017-9619-5 Publication date: 2017 Document Version Publisher's PDF, also known as Version of record Link to publication in Tilburg University Research Portal Citation for published version (APA): Stavrova, O., & Meckel, A. (2017). Perceiving emotion in non-social targets: The effect of trait empathy on emotional contagion through art. Motivation and Emotion, 41(4), 492–509. https://doi.org/10.1007/s11031-017- 9619-5 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 27. sep. 2021 Motiv Emot (2017) 41:492–509 DOI 10.1007/s11031-017-9619-5 ORIGINAL PAPER Perceiving emotion in non-social targets: The effect of trait empathy on emotional contagion through art Olga Stavrova1 · Andrea Meckel2 Published online: 18 May 2017 © The Author(s) 2017.
    [Show full text]
  • Micro-Expression Application to Detect Deception
    Liar Liar: Micro Expression Application to Detect Deception Andrew Batiuk Linfield College Abstract This study focused on nonverbal micro expressions as a deception identification method to shed light on the effectiveness of such a tool for use in detecting lies. Five examples of videos depicting instances in which individuals who were later proven to be lying were analyzed in order to assess the reliability of such a tool in an area of interest to researchers in both communication and psychology. This study suggested that the theory provides a reliable tool for assessing the use of deception by a variety of people in different situations. The paper upon which this poster was based was written for the Senior Seminar course in Communication Arts. 2 Research Question • Does an individual’s use of micro expressions indicate they are lying? Artifacts • Four videos of individuals who were determined, after the fact, to be lying during the taped communication interaction • Craig Pusley • Bill Clinton • Unidentified Witness: Jimmy Kimmel- “Lie Witness News” • Alex Rodriguez • One video in which the individual was confirmed to be telling the truth during the taped communication interaction • Bill Clinton Method • Micro expressions are brief facial expressions lasting a fraction of a second. Seven have been identified. • Anger, fear, sadness, disgust, contempt, surprise and happiness. • Theorists • Haggard and Isaacs-1966 • Paul Ekman-1989 Micro Expression: Contempt • Expression of Contempt = One side of the mouth rises or pulls back Contempt Microexpression - YouTube https://i.ytimg.com/vi/WlrCfzI55io/maxresdefault.jpg Example of Analysis: Micro Expression Contempt • Craig Pusley • Contempt Fake Marine Caught Lying On Camera - Phony Marine Craig Pusley https://www.youtube.com/watch?v=uV9YU8D2k5I Example of Analysis: Micro Expression Contempt • Alex Rodriguez • Contempt Alex Rodriguez Says He Never Did Steroids.
    [Show full text]
  • The Ability to Detect Deceit Generalizes Across Different Types of High-Stake Lies
    Journal of Personality and Social Psychology 097, Vol. 72. No.6, 1429—1439 Copyright 1997 by the American Psychological Association. Inc. 0022-35l4/97/$3.00 The Ability to Detect Deceit Generalizes Across Different Types of High-Stake Lies Mark G. Frank Rutgers—The State University of New Jersey Paul Ekman University of California, San Francisco The authors investigated whether accuracy in identifying deception from demeanor in high-stake lies is specific to those lies or generalizes to other high-stake lies. In Experiment 1, 48 observers judged whether 2 different groups of men were telling lies about a mock theft (crime scenario) or about their opinion (opinion scenario). The authors found that observers’ accuracy in judging deception in the crime scenario was positively correlated with their accuracy in judging deception in the opinion scenario. Experiment 2 replicated the results of Experiment 1, as well as P. Ekman and M. O’Sullivan’s (1991) finding of a positive correlation between the ability to detect deceit and the ability to identify micromomentary facial expressions of emotion. These results show that the ability to detect high-stake lies generalizes across high-stake situations and is most likely due to the presence of emotional clues that betray deception in high-stake lies. Professional lie catchers recognize that some lie catchers are consistently better judges of interpersonal deception than others. For example, Australian customs agents have noted that the same group of officers seems to top their “contraband recovered” rankings each month (S. Van Der Kooy, Australian customs officer, personal communication, June IS. 1993; see also Kraut & Poe, 1980).
    [Show full text]
  • Background Factors Predicting Accuracy and Improvement in Micro Expression Recognition
    Background factors predicting accuracy and improvement in micro expression recognition Carolyn M. Hurley, Ashley E. Anker, Mark G. Frank, David Matsumoto & Hyisung C. Hwang Motivation and Emotion ISSN 0146-7239 Volume 38 Number 5 Motiv Emot (2014) 38:700-714 DOI 10.1007/s11031-014-9410-9 1 23 Your article is protected by copyright and all rights are held exclusively by Springer Science +Business Media New York. This e-offprint is for personal use only and shall not be self- archived in electronic repositories. If you wish to self-archive your article, please use the accepted manuscript version for posting on your own website. You may further deposit the accepted manuscript version in any repository, provided it is only made publicly available 12 months after official publication or later and provided acknowledgement is given to the original source of publication and a link is inserted to the published article on Springer's website. The link must be accompanied by the following text: "The final publication is available at link.springer.com”. 1 23 Author's personal copy Motiv Emot (2014) 38:700–714 DOI 10.1007/s11031-014-9410-9 ORIGINAL PAPER Background factors predicting accuracy and improvement in micro expression recognition Carolyn M. Hurley • Ashley E. Anker • Mark G. Frank • David Matsumoto • Hyisung C. Hwang Published online: 4 June 2014 Ó Springer Science+Business Media New York 2014 Abstract Micro expressions are brief facial expressions personality or demographic factors. Individuals in both displayed when people attempt to conceal, hide, or repress studies showed recognition improvement with training, and their emotions.
    [Show full text]
  • Emotional Contagion in Children Witii Autism and Without Autism
    EMOTIONAL CONTAGION IN CHILDREN WITII AUTISM AND WITHOUT AUTISM A THESIS PROPOSAL IN PARTIAL FULFILLMENT OF THE UNIVERSITY OF HAW AI'I REQUIREMENTS FOR THE DEGREE OF MASTER OF ARTS IN PSYCHOLOGY MAY 2008 By Landry L. Fukunaga Thesis committee Karl Minke, Chairperson Elaine Hatfield Debra Lieberman Jason Schiffman We certi fy that we have read this thesis and that, in our opinion, it is sati sfactory in scope and quality as a thesis for the degree of Master of Arts in Psychology. THESIS COMMITTEE ~~~_./ Chairperson . ii Acknowledgements Arts and Sciences Advisory Council Travel Grant University of Hawai'i, Department of Psychology Research Support Bursary iii Abstract According to the theory of emotional contagion, people automatically mimic and coordinate facial expressions, body gestures, tone of voice, and postures with those of others, and feedback from muscles activated in these imitations affects how emotion is experienced. People are predisposed to acquiring the emotions of others as a result of this feedback. Past studies show that people with autism are less likely to attend to social cues or respond similarly to the expressions of others. This study investigated susceptibility to emotional contagion in children with and without autism as mediated by attention. It was hypothesized that children with autism would be impaired in matching facial expressions on a nonverbal task, would display less facial mimicry, and would catch the emotions of others less often than typically developing children. This study also hypothesized that with a visual attention­ getting stimulus, attention to facial cues would increase facial mimicry and emotional contagion for 20 children with autism and 20 typical children, ages five to 17 years, matched on mental and chronological age.
    [Show full text]
  • How Body Posture Influences Deception Detection and Gazing
    Running head: POSTURE AND DECEPTION DETECTION 1 Sitting in judgment: How body posture influences deception detection and gazing behavior Mircea Zloteanu* and Daniel C. Richardson University College London Author Note Mircea Zloteanu, and Daniel C. Richardson, Department of Experimental Psychology, University College London, United Kingdom. Mircea is now at the School of Social Sciences, Humanities & Law, Teesside University, United Kingdom. *Correspondence concerning this article should be addressed to Mircea Zloteanu, School of Social Sciences, Humanities & Law, Teesside University, Middleborough, TS1 3BX, United Kingdom. E-mail: [email protected] Word count: 6,057 (excluding references) Conflict of Interest statement: The authors do not have any conflict of interest to report. POSTURE AND DECEPTION DETECTION 2 Abstract Body postures can affect how we process and attend to information. Here, a novel effect of adopting an open or closed posture on the ability to detect deception was investigated. It was hypothesized that the posture adopted by decoders would affect their social acuity, resulting in differences in the detection of nonverbal behavior and discrimination of deceptive and truthful statements. In Study 1, adopting an open posture produced higher accuracy for detecting naturalistic lies, but no difference in the recognition of brief facial expressions, as compared to adopting a closed posture. Study 2 measured differences in gaze behavior based on posture when detecting both low and high stakes lies. Sitting in an open posture reduced visual attention towards senders, and in particular, the attention given to their hands. The findings suggest that simply shifting posture can impact veracity judgments and the way they attend to visual information.
    [Show full text]
  • Review of Automatic Microexpression Recognition in the Past Decade
    machine learning & knowledge extraction Review Review of Automatic Microexpression Recognition in the Past Decade Liangfei Zhang * and Ognjen Arandjelovi´c School of Computer Science, University of St Andrews, St Andrews KY16 9SX, UK; [email protected] * Correspondence: [email protected] Abstract: Facial expressions provide important information concerning one’s emotional state. Unlike regular facial expressions, microexpressions are particular kinds of small quick facial movements, which generally last only 0.05 to 0.2 s. They reflect individuals’ subjective emotions and real psycho- logical states more accurately than regular expressions which can be acted. However, the small range and short duration of facial movements when microexpressions happen make them challenging to recognize both by humans and machines alike. In the past decade, automatic microexpression recognition has attracted the attention of researchers in psychology, computer science, and security, amongst others. In addition, a number of specialized microexpression databases have been collected and made publicly available. The purpose of this article is to provide a comprehensive overview of the current state of the art automatic facial microexpression recognition work. To be specific, the features and learning methods used in automatic microexpression recognition, the existing microex- pression data sets, the major outstanding challenges, and possible future development directions are all discussed. Keywords: affective computing; microexpression recognition; emotion recognition; microexpression database; video feature extraction; deep learning Citation: Zhang, L.; Arandjelovi´c,O. Review of Automatic Microexpression Mach. Recognition in the Past Decade. 1. Introduction Learn. Knowl. Extr. 2021, 3, 414–434. https://doi.org/10.3390/make3020021 Facial expressions are important for interpersonal communication [1], in no small part because they are key in understanding people’s mental state and emotions [2].
    [Show full text]