Background Factors Predicting Accuracy and Improvement in Micro Expression Recognition

Total Page:16

File Type:pdf, Size:1020Kb

Background Factors Predicting Accuracy and Improvement in Micro Expression Recognition Background factors predicting accuracy and improvement in micro expression recognition Carolyn M. Hurley, Ashley E. Anker, Mark G. Frank, David Matsumoto & Hyisung C. Hwang Motivation and Emotion ISSN 0146-7239 Volume 38 Number 5 Motiv Emot (2014) 38:700-714 DOI 10.1007/s11031-014-9410-9 1 23 Your article is protected by copyright and all rights are held exclusively by Springer Science +Business Media New York. This e-offprint is for personal use only and shall not be self- archived in electronic repositories. If you wish to self-archive your article, please use the accepted manuscript version for posting on your own website. You may further deposit the accepted manuscript version in any repository, provided it is only made publicly available 12 months after official publication or later and provided acknowledgement is given to the original source of publication and a link is inserted to the published article on Springer's website. The link must be accompanied by the following text: "The final publication is available at link.springer.com”. 1 23 Author's personal copy Motiv Emot (2014) 38:700–714 DOI 10.1007/s11031-014-9410-9 ORIGINAL PAPER Background factors predicting accuracy and improvement in micro expression recognition Carolyn M. Hurley • Ashley E. Anker • Mark G. Frank • David Matsumoto • Hyisung C. Hwang Published online: 4 June 2014 Ó Springer Science+Business Media New York 2014 Abstract Micro expressions are brief facial expressions personality or demographic factors. Individuals in both displayed when people attempt to conceal, hide, or repress studies showed recognition improvement with training, and their emotions. They are difficult to detect in real time, yet the implications of the ability to improve at micro expression individuals who can accurately identify micro expressions recognition are discussed in the context of security and receive higher workplace evaluations and can better detect interpersonal situations. deception. Two studies featuring college students and security officers examined background factors that may Keywords Micro expression Á Personality Á Confidence Á account for accuracy differences when reading micro Facial expression Á National security expressions, both before and after training. Study 1 revealed that college students who were younger and high in openness to experience were better at recognizing micro expressions. Introduction However, individual differences did not predict improve- ment in micro expression recognition gained through train- In many interpersonal contexts, individuals must make ing. Study 2 revealed experiential factors such as prior facial judgments as to the thoughts, feelings, and reactions of expression training and lack of law enforcement experience others in order to evaluate their emotions and intentions. were more predictive of micro expression recognition than For particular professional contexts—such as national security—the ability to quickly and accurately interpret nonverbal signals of such emotions may provide clues as to Part of this work was submitted in partial fulfillment of a Doctor of the hostile plans of others; specifically, an officer who can Philosophy degree at the University at Buffalo by the first author. The identify these clues when they first emerge would be in a fourth author is a co-author of the Micro Expression Training Tool used in both studies. This tool is currently available from Humintell, better position to prevent an attack or other hostile action. which receives a financial benefit from its sales. Any opinions, Emotions are of particular interest because they are findings, and conclusions or recommendations expressed in this transient, involuntary, and unconscious bio-psycho-social material are those of the authors and do not necessarily reflect the reactions (Matsumoto et al. 2013), and thus, are a major views of the Transportation Security Administration, the Department of Homeland Security, or the United States of America. source of motivation and action by providing the impulse for behavior (Frijda et al. 1989; Matsumoto et al. 2013; C. M. Hurley Á A. E. Anker Á M. G. Frank Tomkins 1962, 1963). Emotions are primarily expressed University at Buffalo, Buffalo, NY, USA through the face (Darwin 1872/1998; Ekman 2003; Izard 1994) and most people can accurately interpret these C. M. Hurley (&) University at Buffalo, Undergraduate Degree Programs in expressions when they are openly displayed (Biehl et al. Singapore, 461 Clementi Rd, Singapore 599491, Singapore 1997). When these expressions become shortened—as in e-mail: [email protected] the case of a micro expression (henceforth ME)—then such signals can be very difficult to detect. D. Matsumoto Á H. C. Hwang San Francisco State University and Humintell, San Francisco, Individuals who are skilled at identifying hidden or CA, USA concealed emotions can better interpret a target’s behavior 123 Author's personal copy Motiv Emot (2014) 38:700–714 701 and possibly understand intentions the target does not wish a change in facial expression. They found that—for the to communicate. Prior research demonstrates that accurate most part—people had great difficulty detecting micro identification of MEs is related to the ability to detect momentary expressions (used by Garwood et al. 1970; deception (Ekman and O’Sullivan 1991; Frank and Ekman Taylor et al. 1969). Later, Ekman and Friesen (1969, 1974) 1997), although it is not clear whether recognition of full or studied MEs using a frame-by-frame examination of partial expressions (called subtle expressions) are more recorded psychiatric interviews. Ekman and Friesen (1969, helpful for deception detection (Warren et al. 2009). ME 1974) suggested instead that MEs were due to conscious training has also been linked to social skills, in that indi- suppression and concluded that MEs were brief expressions viduals trained to detect MEs have received better evalu- of emotion that ‘leaked’ when individuals tried to delib- ations from supervisors in corporate settings (Matsumoto erately suppress their emotional expressions. Given that and Hwang 2011) and ME training has improved the social Ekman and Friesen (1982) reported that spontaneous, outcomes of specialized groups such as Autistic children uninhibited facial expressions of emotion lasted between (Clark et al. 2008). 0.5 and 4 s—a duration confirmed by subsequent research Given the apparent advantages successful ME detection (Frank et al. 1993; Hess and Kleck 1990; Yan et al. presents, it is important to identify the traits or personality 2013)—the current study followed that premise and con- factors, if any, that may contribute to their superior rec- ceptualized MEs as fleeting emotional expressions, lasting ognition. It may be the case that ME recognition ability is or less a second in duration, and presumed to reflect an inherent skill that is well-developed and solidified by concealment of one’s true emotional state. adulthood, or it may be a flexible skill that can be improved Concealed or managed expressions can occur on a daily through targeted training. Such findings, of course, would basis—often for benign reasons such as embarrassment or have implications for training law enforcement or other propriety—as individuals attempt to conform to cultural or sensitive security positions. The present study seeks to societal norms (Clark et al. 1996; Hayes and Metts 2008). identify the association between a series of internal and These examples of facial management (called ‘display experiential factors with accurate ME recognition by rules,’ Ekman and Friesen 1969) are most often used to individuals with varied training experiences. effect polite discourse, and thus, cause little harm to the recipient of the communication. Less often, individuals Micro expressions of emotion attempt to conceal or neutralize their expressions in order to succeed in some nefarious act—such as when lying The idea of MEs has its roots in the research of Darwin (1872/ about the intent to commit a robbery or conceal an illegal 1998) who suggested that facial expressions were part of an object—that could have devastating effects. In such high- overall emotional response and they might be triggered stakes situations, the ability to detect quick, hidden, or through nerve force beyond a person’s volitional control. concealed emotions may be vital to effective law Laterresearchconfirmedthatexpressionscanbebothinvol- enforcement or security, as meta-analytic research has untarily triggered—in the subcortical area of the brain—as shown that emotion clues significantly predict deception, well as voluntarily controlled—originating in the cortical but only in these high stakes situations (DePaulo et al. motor strip (Meihlke 1973;Myers1976; Tsschiassny 1953). 2003; Frank and Svetieva 2012). The expression of basic emotions, such as anger, contempt, disgust, fear, happiness, sadness, and surprise, can trigger Emotional expression recognition involuntary facial expressions, as well as unique physical and physiological changes to muscular tonus, voice, autonomic Several tests have been created to examine the specific nervous system patterning, and brain activity (e.g., Christie ability of ME recognition. The Japanese And Caucasian and Friedman 2004; Damasio et al. 2000; Ekman et al. 1983). Brief Affect Recognition Test (JACBART, Matsumoto MEs are actually a special case of basic facial expres- et al. 2000) was the first such test to utilize scientifically sions of emotion that occur more quickly and can often coded expression items shown
Recommended publications
  • Is It Contagious? an Eye-Movement and Emg Study of Smile Authenticity Judgment
    IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT by JUSTIN CHAMBERLAND Thesis submitted in partial fulfillment of the requirement for the degree of Master of Arts in Psychology (M.A.) Faculty of Graduate Studies Laurentian University Sudbury, Ontario © JUSTIN CHAMBERLAND, 2016 ii THESIS DEFENCE COMMITTEE/COMITÉ DE SOUTENANCE DE THÈSE Laurentian Université/Université Laurentienne Faculty of Graduate Studies/Faculté des études supérieures Title of Thesis Titre de la thèse IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT Name of Candidate Nom du candidat Chamberland, Justin Degree Diplôme Master of Arts Department/Program Date of Defence Département/Programme Psychology Date de la soutenance March 10, 2016 APPROVED/APPROUVÉ Thesis Examiners/Examinateurs de thèse: Dr. Annie Roy-Charland (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Mélanie Perron (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Robert Jack (Committee member/Membre du comité) Dr. Joel Dickinson (Committee member/Membre du comité) Approved for the Faculty of Graduate Studies Approuvé pour la Faculté des études supérieures Dr. David Lesbarrères Monsieur David Lesbarrères Dr. Lauri Nummenmaa Acting Dean, Faculty of Graduate Studies (External Examiner/Examinateur externe) Doyen intérimaire, Faculté des études supérieures ACCESSIBILITY CLAUSE AND PERMISSION TO USE I, Justin Chamberland, hereby grant to Laurentian University and/or its agents the non-exclusive license to archive and make accessible my thesis, dissertation, or project report in whole or in part in all forms of media, now or for the duration of my copyright ownership. I retain all other ownership rights to the copyright of the thesis, dissertation or project report.
    [Show full text]
  • Emotions and Deception Detection
    Emotions and Deception Detection Mircea Zloteanu Division of Psychology and Language Sciences University College London, UK A dissertation submitted in part fulfilment of the requirement for the degree of Doctor of Philosophy in Psychology Prepared under the supervision of Dr. Daniel C. Richardson September 2016 1 I, Mircea Zloteanu, confirm that the work presented in this thesis is my own. Where information has been derived from other sources, I confirm that this has been indicated in the thesis. Signature 2 Abstract Humans have developed a complex social structure which relies heavily on communication between members. However, not all communication is honest. Distinguishing honest from deceptive information is clearly a useful skills, but individuals do not possess a strong ability to discriminate veracity. As others will not willingly admit they are lying, one must rely on different information to discern veracity. In deception detection, individuals are told to rely on behavioural indices to discriminate lies and truths. A source of such indices are the emotions displayed by another. This thesis focuses on the role that emotions have on the ability to detect deception, exploring the reasons for low judgemental accuracy when individuals focus on emotion information. I aim to demonstrate that emotion recognition does not aid the detection of deception, and can result in decreased accuracy. This is attributed to the biasing relationship of emotion recognition on veracity judgements, stemming from the inability of decoders to separate the authenticity of emotional cues. To support my claims, I will demonstrate the lack of ability of decoders to make rational judgements regarding veracity, even if allowed to pool the knowledge of multiple decoders, and disprove the notion that decoders can utilise emotional cues, both innately and through training, to detect deception.
    [Show full text]
  • Facial Micro-Expression Analysis Jingting Li
    Facial Micro-Expression Analysis Jingting Li To cite this version: Jingting Li. Facial Micro-Expression Analysis. Computer Vision and Pattern Recognition [cs.CV]. CentraleSupélec, 2019. English. NNT : 2019CSUP0007. tel-02877766 HAL Id: tel-02877766 https://tel.archives-ouvertes.fr/tel-02877766 Submitted on 22 Jun 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THESE DE DOCTORAT DE CENTRALESUPELEC COMUE UNIVERSITE BRETAGNE LOIRE ECOLE DOCTORALE N° 601 Mathématiques et Sciences et Technologies de l'Information et de la Communication Spécialité : Signal, Image, Vision Par « Jingting LI » « Facial Micro-Expression Analysis » Thèse présentée et soutenue à « Rennes », le « 02/12/2019 » Unité de recherche : IETR Thèse N° : 2019CSUP0007 Rapporteurs avant soutenance : Composition du Jury : Olivier ALATA Professeur, Université Jean Monnet, Président / Rapporteur Saint-Etienne Olivier ALATA Professeur, Fan YANG-SONG Professeur, Université de Bourgogne, Université Jean Monnet, Dijon Saint-Etienne Rapporteuse Fan YANG-SONG Professeur, Université de Bourgogne,
    [Show full text]
  • Darwin, Deception, and Facial Expression
    Darwin, Deception, and Facial Expression PAUL EKMAN Department of Psychiatry, University of California, San Francisco, San Francisco, California 94143, USA ABSTRACT: Darwin did not focus on deception. Only a few sentences in his book mentioned the issue. One of them raised the very interesting question of whether it is difficult to voluntarily inhibit the emotional expressions that are most difficult to voluntarily fabricate. Another suggestion was that it would be possible to unmask a fabricated expression by the absence of the difficult-to-voluntarily-generate facial actions. Still another was that during emotion body movements could be more easily suppressed than fa- cial expression. Research relevant to each of Darwin’s suggestions is re- viewed, as is other research on deception that Darwin did not foresee. KEYWORDS: Darwin; deception; facial expression; lies; lying; emotion; in- hibition; smile; leakage; micro-facial-expressions; Facial Action Coding System; illustrators; pitch; Duchenne; asymmetry The scientific study of the facial expression of emotion began with Charles Darwin’s The Expression of Emotions in Man and Animals, first published in 1872.1 Among his many extraordinary contributions Darwin gathered ev- idence that some emotions have a universal facial expression, cited examples and published pictures suggesting that emotions are evident in other ani- mals, and proposed principles explaining why particular expressions occur for particular emotions—principles that, he maintained, applied to the ex- pressions of all animals. But Darwin did not consider at any length when, how, and why emotional expressions are reliable or misleading. Neither deception nor lies (or lying) appears in the index to his book.
    [Show full text]
  • Microexpression Identification and Categorization Using a Facial
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2016 1 Microexpression Identification and Categorization using a Facial Dynamics Map Feng Xu, Junping Zhang, James Z. Wang Abstract—Unlike conventional facial expressions, microexpres- researchers have investigated spontaneous expressions that can sions are instantaneous and involuntary reflections of human reflect true emotions [9], [10]. emotion. Because microexpressions are fleeting, lasting only a As a type of spontaneous expression, microexpressions have few frames within a video sequence, they are difficult to perceive and interpret correctly, and they are highly challenging to identify not yet been explored extensively [11]–[15]. Microexpressions and categorize automatically. Existing recognition methods are are involuntary and instant facial dynamics during the time often ineffective at handling subtle face displacements, which can the subject is experiencing emotions, including when the be prevalent in typical microexpression applications due to the subject attempts to conceal emotions, especially in high-stake constant movements of the individuals being observed. To address situations [16], [17]. As early as in 1969, Ekman observed this problem, a novel method called the Facial Dynamics Map is proposed to characterize the movements of a microexpression in microexpresssions when he analyzed an interview video of a different granularity. Specifically, an algorithm based on optical patient with depression [18]. The patient who attempted to flow estimation is used to perform pixel-level alignment for commit suicide showed brief yet intense sadness but resumed microexpression sequences. Each expression sequence is then smiling quickly. Such microexpressions only last for a few divided into spatiotemporal cuboids in the chosen granularity. We frames in the standard 25 fps (frames per second) video but also present an iterative optimal strategy to calculate the princi- pal optical flow direction of each cuboid for better representation are often capable of revealing the actual emotions of subjects of the local facial dynamics.
    [Show full text]
  • DOCTORAL THESIS the Empathy Fillip: Can Training in Microexpressions of Emotion Enhance Empathic Accuracy? Eyles, Kieren
    DOCTORAL THESIS The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Eyles, Kieren Award date: 2016 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 04. Oct. 2021 The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Presented by: Kieren Eyles A thesis submitted in partial fulfilment of the requirements of the degree of PsychD, Department of Psychology, University of Roehampton 2015 Abstract Empathy is a central concern in the counselling process. Though much researched, and broadly commented upon, empathy is still largely understood through the words within a client-counsellor interaction. This semantic focus continues despite converging lines of evidence that suggest other elements of an interaction – for example body language – may be involved in the communication of empathy. In this thesis, the foundations of empathy are examined, focusing on empathy’s professional instantiation.
    [Show full text]
  • The Effect of Trait Empathy on Emotional Contagion Through Art
    Tilburg University Perceiving emotion in non-social targets Stavrova, O.; Meckel, Andrea Published in: Motivation and Emotion DOI: 10.1007/s11031-017-9619-5 Publication date: 2017 Document Version Publisher's PDF, also known as Version of record Link to publication in Tilburg University Research Portal Citation for published version (APA): Stavrova, O., & Meckel, A. (2017). Perceiving emotion in non-social targets: The effect of trait empathy on emotional contagion through art. Motivation and Emotion, 41(4), 492–509. https://doi.org/10.1007/s11031-017- 9619-5 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 27. sep. 2021 Motiv Emot (2017) 41:492–509 DOI 10.1007/s11031-017-9619-5 ORIGINAL PAPER Perceiving emotion in non-social targets: The effect of trait empathy on emotional contagion through art Olga Stavrova1 · Andrea Meckel2 Published online: 18 May 2017 © The Author(s) 2017.
    [Show full text]
  • Micro-Expression Application to Detect Deception
    Liar Liar: Micro Expression Application to Detect Deception Andrew Batiuk Linfield College Abstract This study focused on nonverbal micro expressions as a deception identification method to shed light on the effectiveness of such a tool for use in detecting lies. Five examples of videos depicting instances in which individuals who were later proven to be lying were analyzed in order to assess the reliability of such a tool in an area of interest to researchers in both communication and psychology. This study suggested that the theory provides a reliable tool for assessing the use of deception by a variety of people in different situations. The paper upon which this poster was based was written for the Senior Seminar course in Communication Arts. 2 Research Question • Does an individual’s use of micro expressions indicate they are lying? Artifacts • Four videos of individuals who were determined, after the fact, to be lying during the taped communication interaction • Craig Pusley • Bill Clinton • Unidentified Witness: Jimmy Kimmel- “Lie Witness News” • Alex Rodriguez • One video in which the individual was confirmed to be telling the truth during the taped communication interaction • Bill Clinton Method • Micro expressions are brief facial expressions lasting a fraction of a second. Seven have been identified. • Anger, fear, sadness, disgust, contempt, surprise and happiness. • Theorists • Haggard and Isaacs-1966 • Paul Ekman-1989 Micro Expression: Contempt • Expression of Contempt = One side of the mouth rises or pulls back Contempt Microexpression - YouTube https://i.ytimg.com/vi/WlrCfzI55io/maxresdefault.jpg Example of Analysis: Micro Expression Contempt • Craig Pusley • Contempt Fake Marine Caught Lying On Camera - Phony Marine Craig Pusley https://www.youtube.com/watch?v=uV9YU8D2k5I Example of Analysis: Micro Expression Contempt • Alex Rodriguez • Contempt Alex Rodriguez Says He Never Did Steroids.
    [Show full text]
  • The Ability to Detect Deceit Generalizes Across Different Types of High-Stake Lies
    Journal of Personality and Social Psychology 097, Vol. 72. No.6, 1429—1439 Copyright 1997 by the American Psychological Association. Inc. 0022-35l4/97/$3.00 The Ability to Detect Deceit Generalizes Across Different Types of High-Stake Lies Mark G. Frank Rutgers—The State University of New Jersey Paul Ekman University of California, San Francisco The authors investigated whether accuracy in identifying deception from demeanor in high-stake lies is specific to those lies or generalizes to other high-stake lies. In Experiment 1, 48 observers judged whether 2 different groups of men were telling lies about a mock theft (crime scenario) or about their opinion (opinion scenario). The authors found that observers’ accuracy in judging deception in the crime scenario was positively correlated with their accuracy in judging deception in the opinion scenario. Experiment 2 replicated the results of Experiment 1, as well as P. Ekman and M. O’Sullivan’s (1991) finding of a positive correlation between the ability to detect deceit and the ability to identify micromomentary facial expressions of emotion. These results show that the ability to detect high-stake lies generalizes across high-stake situations and is most likely due to the presence of emotional clues that betray deception in high-stake lies. Professional lie catchers recognize that some lie catchers are consistently better judges of interpersonal deception than others. For example, Australian customs agents have noted that the same group of officers seems to top their “contraband recovered” rankings each month (S. Van Der Kooy, Australian customs officer, personal communication, June IS. 1993; see also Kraut & Poe, 1980).
    [Show full text]
  • Emotional Contagion in Children Witii Autism and Without Autism
    EMOTIONAL CONTAGION IN CHILDREN WITII AUTISM AND WITHOUT AUTISM A THESIS PROPOSAL IN PARTIAL FULFILLMENT OF THE UNIVERSITY OF HAW AI'I REQUIREMENTS FOR THE DEGREE OF MASTER OF ARTS IN PSYCHOLOGY MAY 2008 By Landry L. Fukunaga Thesis committee Karl Minke, Chairperson Elaine Hatfield Debra Lieberman Jason Schiffman We certi fy that we have read this thesis and that, in our opinion, it is sati sfactory in scope and quality as a thesis for the degree of Master of Arts in Psychology. THESIS COMMITTEE ~~~_./ Chairperson . ii Acknowledgements Arts and Sciences Advisory Council Travel Grant University of Hawai'i, Department of Psychology Research Support Bursary iii Abstract According to the theory of emotional contagion, people automatically mimic and coordinate facial expressions, body gestures, tone of voice, and postures with those of others, and feedback from muscles activated in these imitations affects how emotion is experienced. People are predisposed to acquiring the emotions of others as a result of this feedback. Past studies show that people with autism are less likely to attend to social cues or respond similarly to the expressions of others. This study investigated susceptibility to emotional contagion in children with and without autism as mediated by attention. It was hypothesized that children with autism would be impaired in matching facial expressions on a nonverbal task, would display less facial mimicry, and would catch the emotions of others less often than typically developing children. This study also hypothesized that with a visual attention­ getting stimulus, attention to facial cues would increase facial mimicry and emotional contagion for 20 children with autism and 20 typical children, ages five to 17 years, matched on mental and chronological age.
    [Show full text]
  • How Body Posture Influences Deception Detection and Gazing
    Running head: POSTURE AND DECEPTION DETECTION 1 Sitting in judgment: How body posture influences deception detection and gazing behavior Mircea Zloteanu* and Daniel C. Richardson University College London Author Note Mircea Zloteanu, and Daniel C. Richardson, Department of Experimental Psychology, University College London, United Kingdom. Mircea is now at the School of Social Sciences, Humanities & Law, Teesside University, United Kingdom. *Correspondence concerning this article should be addressed to Mircea Zloteanu, School of Social Sciences, Humanities & Law, Teesside University, Middleborough, TS1 3BX, United Kingdom. E-mail: [email protected] Word count: 6,057 (excluding references) Conflict of Interest statement: The authors do not have any conflict of interest to report. POSTURE AND DECEPTION DETECTION 2 Abstract Body postures can affect how we process and attend to information. Here, a novel effect of adopting an open or closed posture on the ability to detect deception was investigated. It was hypothesized that the posture adopted by decoders would affect their social acuity, resulting in differences in the detection of nonverbal behavior and discrimination of deceptive and truthful statements. In Study 1, adopting an open posture produced higher accuracy for detecting naturalistic lies, but no difference in the recognition of brief facial expressions, as compared to adopting a closed posture. Study 2 measured differences in gaze behavior based on posture when detecting both low and high stakes lies. Sitting in an open posture reduced visual attention towards senders, and in particular, the attention given to their hands. The findings suggest that simply shifting posture can impact veracity judgments and the way they attend to visual information.
    [Show full text]
  • Review of Automatic Microexpression Recognition in the Past Decade
    machine learning & knowledge extraction Review Review of Automatic Microexpression Recognition in the Past Decade Liangfei Zhang * and Ognjen Arandjelovi´c School of Computer Science, University of St Andrews, St Andrews KY16 9SX, UK; [email protected] * Correspondence: [email protected] Abstract: Facial expressions provide important information concerning one’s emotional state. Unlike regular facial expressions, microexpressions are particular kinds of small quick facial movements, which generally last only 0.05 to 0.2 s. They reflect individuals’ subjective emotions and real psycho- logical states more accurately than regular expressions which can be acted. However, the small range and short duration of facial movements when microexpressions happen make them challenging to recognize both by humans and machines alike. In the past decade, automatic microexpression recognition has attracted the attention of researchers in psychology, computer science, and security, amongst others. In addition, a number of specialized microexpression databases have been collected and made publicly available. The purpose of this article is to provide a comprehensive overview of the current state of the art automatic facial microexpression recognition work. To be specific, the features and learning methods used in automatic microexpression recognition, the existing microex- pression data sets, the major outstanding challenges, and possible future development directions are all discussed. Keywords: affective computing; microexpression recognition; emotion recognition; microexpression database; video feature extraction; deep learning Citation: Zhang, L.; Arandjelovi´c,O. Review of Automatic Microexpression Mach. Recognition in the Past Decade. 1. Introduction Learn. Knowl. Extr. 2021, 3, 414–434. https://doi.org/10.3390/make3020021 Facial expressions are important for interpersonal communication [1], in no small part because they are key in understanding people’s mental state and emotions [2].
    [Show full text]