Emotions and Deception Detection

Total Page:16

File Type:pdf, Size:1020Kb

Emotions and Deception Detection Emotions and Deception Detection Mircea Zloteanu Division of Psychology and Language Sciences University College London, UK A dissertation submitted in part fulfilment of the requirement for the degree of Doctor of Philosophy in Psychology Prepared under the supervision of Dr. Daniel C. Richardson September 2016 1 I, Mircea Zloteanu, confirm that the work presented in this thesis is my own. Where information has been derived from other sources, I confirm that this has been indicated in the thesis. Signature 2 Abstract Humans have developed a complex social structure which relies heavily on communication between members. However, not all communication is honest. Distinguishing honest from deceptive information is clearly a useful skills, but individuals do not possess a strong ability to discriminate veracity. As others will not willingly admit they are lying, one must rely on different information to discern veracity. In deception detection, individuals are told to rely on behavioural indices to discriminate lies and truths. A source of such indices are the emotions displayed by another. This thesis focuses on the role that emotions have on the ability to detect deception, exploring the reasons for low judgemental accuracy when individuals focus on emotion information. I aim to demonstrate that emotion recognition does not aid the detection of deception, and can result in decreased accuracy. This is attributed to the biasing relationship of emotion recognition on veracity judgements, stemming from the inability of decoders to separate the authenticity of emotional cues. To support my claims, I will demonstrate the lack of ability of decoders to make rational judgements regarding veracity, even if allowed to pool the knowledge of multiple decoders, and disprove the notion that decoders can utilise emotional cues, both innately and through training, to detect deception. I assert, and find, that decoders are poor at discriminating between genuine and deceptive emotional displays, advocating for a new conceptualisation of emotional cues in veracity judgements. Finally, I illustrate the importance of behavioural information in detecting deception using two approaches aimed at improving the process of separating lies and truths. First, I address the role of situational factors in detecting deception, demonstrating their impact on decoding ability. Lastly, I introduce a new technique for improving accuracy, passive lie detection, utilising body postures that aid decoders in processing behavioural information. The research will conclude suggesting deception detection should focus on improving information processing and accurate classification of emotional information. 3 Table of Contents List of Figures............................................................................................................10 List of Tables .............................................................................................................11 Dedication..................................................................................................................12 Acknowledgements....................................................................................................13 Chapter 1: Overview..................................................................................................15 Thesis Outline.......................................................................................................15 Unanswered Questions of the Deception Literature .............................................16 Chapter 2: General Introduction ...........................................................................17 Chapter 3: Emotions .............................................................................................17 Chapter 4: Multi-Decoder Deception Detection - Exploring the Errors in Veracity Judgements............................................................................................................17 Chapter 5: Emotion Recognition and Veracity Judgements .................................18 Chapter 6: Deceptive Emotional Expressions.......................................................20 Chapter 7: Situational Factors in Deception Detection.........................................20 Chapter 8: Body Postures, Gazing Behaviour, and Deception Detection.............21 Chapter 9: General Discussion .............................................................................22 Chapter 10: Future Directions in Deception Research .........................................22 Chapter 2: General Introduction ................................................................................23 General Introduction.............................................................................................23 Definition of Deception ........................................................................................25 Functions of Deception.........................................................................................26 Prevalence of Deception .......................................................................................27 4 The Ability to Lie .................................................................................................28 The Process of Lying............................................................................................29 Deception Detection .............................................................................................32 Behavioural Cues of Deception ............................................................................32 Theoretical Approaches to Detecting Deception ..................................................35 Summary of Theoretical Approaches ...................................................................47 Stakes to the Liar ..................................................................................................48 Decoder Veracity Judgements ..............................................................................51 Factors Affecting Detection..................................................................................56 Detection Errors and Judgement Biases ...............................................................58 Criticism of Deception Research ..........................................................................63 Summary...............................................................................................................69 Chapter 3: Emotions ..................................................................................................70 Universality and Basic Emotions..........................................................................70 Criticism of Universality ......................................................................................76 Deceptive Facial Expressions ...............................................................................79 Emotion Recognition............................................................................................81 Summary: Emotions .............................................................................................85 Chapter 4: Multi-Decoder Deception Detection – Exploring Errors in Veracity Judgements.................................................................................................................86 Abstract.................................................................................................................86 Introduction...........................................................................................................87 Method..................................................................................................................94 5 Results...................................................................................................................98 Discussion...........................................................................................................103 Chapter 5: Emotion Recognition and Veracity Judgements ....................................109 Abstract...............................................................................................................109 Introduction.........................................................................................................110 Experiment 2: Emotions, Empathy, and Low-Stakes Deception Detection .......114 Method................................................................................................................119 Results.................................................................................................................121 Discussion...........................................................................................................123 Experiment 3: The Effectiveness of Emotion Recognition Training on Low- Stakes and High-Stakes Deception Detection.....................................................127 Method................................................................................................................131 Results.................................................................................................................135 Discussion...........................................................................................................139 General Discussion .............................................................................................144 Chapter 6: Deceptive Emotional Control – Senders’ Ability to Fake an Emotion ..148 Abstract...............................................................................................................148
Recommended publications
  • Is It Contagious? an Eye-Movement and Emg Study of Smile Authenticity Judgment
    IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT by JUSTIN CHAMBERLAND Thesis submitted in partial fulfillment of the requirement for the degree of Master of Arts in Psychology (M.A.) Faculty of Graduate Studies Laurentian University Sudbury, Ontario © JUSTIN CHAMBERLAND, 2016 ii THESIS DEFENCE COMMITTEE/COMITÉ DE SOUTENANCE DE THÈSE Laurentian Université/Université Laurentienne Faculty of Graduate Studies/Faculté des études supérieures Title of Thesis Titre de la thèse IS IT CONTAGIOUS? AN EYE-MOVEMENT AND EMG STUDY OF SMILE AUTHENTICITY JUDGMENT Name of Candidate Nom du candidat Chamberland, Justin Degree Diplôme Master of Arts Department/Program Date of Defence Département/Programme Psychology Date de la soutenance March 10, 2016 APPROVED/APPROUVÉ Thesis Examiners/Examinateurs de thèse: Dr. Annie Roy-Charland (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Mélanie Perron (Co-supervisor/Co-Directeur(trice) de thèse) Dr. Robert Jack (Committee member/Membre du comité) Dr. Joel Dickinson (Committee member/Membre du comité) Approved for the Faculty of Graduate Studies Approuvé pour la Faculté des études supérieures Dr. David Lesbarrères Monsieur David Lesbarrères Dr. Lauri Nummenmaa Acting Dean, Faculty of Graduate Studies (External Examiner/Examinateur externe) Doyen intérimaire, Faculté des études supérieures ACCESSIBILITY CLAUSE AND PERMISSION TO USE I, Justin Chamberland, hereby grant to Laurentian University and/or its agents the non-exclusive license to archive and make accessible my thesis, dissertation, or project report in whole or in part in all forms of media, now or for the duration of my copyright ownership. I retain all other ownership rights to the copyright of the thesis, dissertation or project report.
    [Show full text]
  • The Future of Neuroimaged Lie Detection and the Law
    The University of Akron IdeaExchange@UAkron Akron Law Review Akron Law Journals June 2015 The uturF e of Neuroimaged Lie Detection and the Law Joelle Anne Moreno Please take a moment to share how this work helps you through this survey. Your feedback will be important as we plan further development of our repository. Follow this and additional works at: http://ideaexchange.uakron.edu/akronlawreview Part of the Science and Technology Law Commons Recommended Citation Moreno, Joelle Anne (2009) "The uturF e of Neuroimaged Lie Detection and the Law," Akron Law Review: Vol. 42 : Iss. 3 , Article 3. Available at: http://ideaexchange.uakron.edu/akronlawreview/vol42/iss3/3 This Article is brought to you for free and open access by Akron Law Journals at IdeaExchange@UAkron, the institutional repository of The nivU ersity of Akron in Akron, Ohio, USA. It has been accepted for inclusion in Akron Law Review by an authorized administrator of IdeaExchange@UAkron. For more information, please contact [email protected], [email protected]. Moreno: The Future of Neuroimaged Lie Detection and the Law 8-MORENO_COPYFORPRINTER.DOC 4/27/2009 12:43 PM THE FUTURE OF NEUROIMAGED LIE DETECTION AND THE LAW Joëlle Anne Moreno∗ I. How Should Law Prepare to Respond to Cognitive Neuroscience? .................................................................. 722 A. The Potential Influence of Cognitive Neuroscience on Law ...................................................................... 722 B. Neuroimages in Court ................................................ 723 C. Cognitive Neuroscience Evidence in Court ............... 723 C. Extra-Legal Uses of Cognitive Neuroscience ............ 732 II. How Should Law (and Law Professors) Respond to Cognitive Neuroscience? ................................................. 733 A. Understanding the Value and Limits of Cognitive Neuroscience ............................................................
    [Show full text]
  • Machine Learning-Based Lie Detector Applied to a Novel Annotated Game Dataset Nuria Rodriguez Diaz, Decky Aspandi, Federico Sukno, and Xavier Binefa
    JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2015 1 Machine Learning-based Lie Detector applied to a Novel Annotated Game Dataset Nuria Rodriguez Diaz, Decky Aspandi, Federico Sukno, and Xavier Binefa Abstract—Lie detection is considered a concern for everyone in the periorbital- [6] or perinasal-region [7] in thermal imagery, their day to day life given its impact on human interactions. Thus, which cannot be perceived by human vision. people normally pay attention to both what their interlocutors One of the crucial aspects to appropriately address lie- are saying and also to their visual appearances, including faces, to try to find any signs that indicate whether the person is detection research is the availability of adequate datasets. The telling the truth or not. While automatic lie detection may help acquisition of training and, especially, evaluation material for us to understand this lying characteristics, current systems are lie detection is a challenging task, particularly regarding the still fairly limited, partly due to lack of adequate datasets to necessity to gather ground truth, namely, to know whether a evaluate their performance in realistic scenarios. In this work, we person is lying or not. The main difficulty arises because such have collected an annotated dataset of facial images, comprising both 2D and 3D information of several participants during a knowledge is not useful if the scenario is naively simulated card game that encourages players to lie. Using our collected (e.g. it is not sufficient to instruct a person to simply tell dataset, We evaluated several types of machine learning-based a lie).
    [Show full text]
  • Facial Micro-Expression Analysis Jingting Li
    Facial Micro-Expression Analysis Jingting Li To cite this version: Jingting Li. Facial Micro-Expression Analysis. Computer Vision and Pattern Recognition [cs.CV]. CentraleSupélec, 2019. English. NNT : 2019CSUP0007. tel-02877766 HAL Id: tel-02877766 https://tel.archives-ouvertes.fr/tel-02877766 Submitted on 22 Jun 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THESE DE DOCTORAT DE CENTRALESUPELEC COMUE UNIVERSITE BRETAGNE LOIRE ECOLE DOCTORALE N° 601 Mathématiques et Sciences et Technologies de l'Information et de la Communication Spécialité : Signal, Image, Vision Par « Jingting LI » « Facial Micro-Expression Analysis » Thèse présentée et soutenue à « Rennes », le « 02/12/2019 » Unité de recherche : IETR Thèse N° : 2019CSUP0007 Rapporteurs avant soutenance : Composition du Jury : Olivier ALATA Professeur, Université Jean Monnet, Président / Rapporteur Saint-Etienne Olivier ALATA Professeur, Fan YANG-SONG Professeur, Université de Bourgogne, Université Jean Monnet, Dijon Saint-Etienne Rapporteuse Fan YANG-SONG Professeur, Université de Bourgogne,
    [Show full text]
  • Brain Activity During Simulated Deception: an Event-Related Functional Magnetic Resonance Study
    NeuroImage 15, 727–732 (2002) doi:10.1006/nimg.2001.1003, available online at http://www.idealibrary.com on RAPID COMMUNICATION Brain Activity during Simulated Deception: An Event-Related Functional Magnetic Resonance Study D. D. Langleben,1 L. Schroeder, J. A. Maldjian,* R. C. Gur, S. McDonald, J. D. Ragland, C. P. O’Brien, and A. R. Childress Department of Psychiatry and *Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania 19104 Received May 30, 2001; published online January 4, 2002 cations and there is a strong general interest in objec- The Guilty Knowledge Test (GKT) has been used tive methods for its detection (Holden, 2001). extensively to model deception. An association be- Multichannel physiological recording (polygraph) is tween the brain evoked response potentials and lying currently the most widely used method for the detec- on the GKT suggests that deception may be associated tion of deception (Office of Technology Assessment, with changes in other measures of brain activity such 1990). The effectiveness of the polygraph in the study as regional blood flow that could be anatomically lo- and detection of deception is limited by reliance on calized with event-related functional magnetic reso- peripheral manifestations of anxiety (skin conduc- nance imaging (fMRI). Blood oxygenation level-depen- tance, heart rate, and respiration) (Office of Technol- dent fMRI contrasts between deceptive and truthful responses were measured with a 4 Tesla scanner in 18 ogy Assessment, 1983). Scalp-recorded event-related participants performing the GKT and analyzed using potentials (ERPs) have also been used in the study of statistical parametric mapping. Increased activity in deception.
    [Show full text]
  • Darwin, Deception, and Facial Expression
    Darwin, Deception, and Facial Expression PAUL EKMAN Department of Psychiatry, University of California, San Francisco, San Francisco, California 94143, USA ABSTRACT: Darwin did not focus on deception. Only a few sentences in his book mentioned the issue. One of them raised the very interesting question of whether it is difficult to voluntarily inhibit the emotional expressions that are most difficult to voluntarily fabricate. Another suggestion was that it would be possible to unmask a fabricated expression by the absence of the difficult-to-voluntarily-generate facial actions. Still another was that during emotion body movements could be more easily suppressed than fa- cial expression. Research relevant to each of Darwin’s suggestions is re- viewed, as is other research on deception that Darwin did not foresee. KEYWORDS: Darwin; deception; facial expression; lies; lying; emotion; in- hibition; smile; leakage; micro-facial-expressions; Facial Action Coding System; illustrators; pitch; Duchenne; asymmetry The scientific study of the facial expression of emotion began with Charles Darwin’s The Expression of Emotions in Man and Animals, first published in 1872.1 Among his many extraordinary contributions Darwin gathered ev- idence that some emotions have a universal facial expression, cited examples and published pictures suggesting that emotions are evident in other ani- mals, and proposed principles explaining why particular expressions occur for particular emotions—principles that, he maintained, applied to the ex- pressions of all animals. But Darwin did not consider at any length when, how, and why emotional expressions are reliable or misleading. Neither deception nor lies (or lying) appears in the index to his book.
    [Show full text]
  • Microexpression Identification and Categorization Using a Facial
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2016 1 Microexpression Identification and Categorization using a Facial Dynamics Map Feng Xu, Junping Zhang, James Z. Wang Abstract—Unlike conventional facial expressions, microexpres- researchers have investigated spontaneous expressions that can sions are instantaneous and involuntary reflections of human reflect true emotions [9], [10]. emotion. Because microexpressions are fleeting, lasting only a As a type of spontaneous expression, microexpressions have few frames within a video sequence, they are difficult to perceive and interpret correctly, and they are highly challenging to identify not yet been explored extensively [11]–[15]. Microexpressions and categorize automatically. Existing recognition methods are are involuntary and instant facial dynamics during the time often ineffective at handling subtle face displacements, which can the subject is experiencing emotions, including when the be prevalent in typical microexpression applications due to the subject attempts to conceal emotions, especially in high-stake constant movements of the individuals being observed. To address situations [16], [17]. As early as in 1969, Ekman observed this problem, a novel method called the Facial Dynamics Map is proposed to characterize the movements of a microexpression in microexpresssions when he analyzed an interview video of a different granularity. Specifically, an algorithm based on optical patient with depression [18]. The patient who attempted to flow estimation is used to perform pixel-level alignment for commit suicide showed brief yet intense sadness but resumed microexpression sequences. Each expression sequence is then smiling quickly. Such microexpressions only last for a few divided into spatiotemporal cuboids in the chosen granularity. We frames in the standard 25 fps (frames per second) video but also present an iterative optimal strategy to calculate the princi- pal optical flow direction of each cuboid for better representation are often capable of revealing the actual emotions of subjects of the local facial dynamics.
    [Show full text]
  • Efficient Lying Involves Self-Deception – Because If You Really Believe Your Lie, Your Limbic System Won't Give You Away
    The story “Looking for the Lie” http://www.nytimes.com/2006/02/05/magazine/05lying.html by Robin Marantz Henig New York Times Magazine, February 5, 2006 The pitch Dear Vera, A picture of a brain caught in mid-lie – that’s pretty hard to resist. Think of all the liars you’d love to expose: criminals, terrorists, politicians, philandering spouses, drug- abusing kids. That’s why scientists are trying to develop ways to unmask liars with techniques that go beyond traditional polygraphs – which are notoriously imprecise – or simple hunches – which are notoriously wrong. The next generation of lie detectors will include functional MRI scans, sophisticated electroencephalograms, and beams of light that can be blasted right inside the brain. But as we move closer to an era of high-tech mindreading, we should first take a look at what we know about lying – and whether it’s always such a good idea to uncover it. Is there an evolutionary purpose to deceit? A social purpose? Can anyone live in a community in which lies are always exposed and eliminated? If we can tell with confidence that someone is lying to us, is that something we even want to know? I’d like to propose a piece about lying for the Magazine, either as a 5000-word feature or as a longer cover story that gives me the space to explore the cultural, biological, and evolutionary implications of deception. I will also ask some of the questions raised with any new medical technology: what it can offer, how it can be abused, and whether it will set us off down a “slippery slope” that will lead to information we’d be better off without.
    [Show full text]
  • An Assessment of Lie Detection Capability (1964)
    IDA TECHNICAL REPORT 62-16 AN ASSESSMENT OF LIE DETECTION CAPABILITY (DECLASSIFIED VERSION) Jesse Orlansky July 1964 (classified version issued July 1962) INSTITUTE FOR DEFENSE ANALYSES RESEARCH AND ENGINEERING SUPPORT DIVISION Contract SD-50 Task 8 FOREWORD "An Assessment of Lie Detection Capability" was originally pub- lished as a SECRET NOPORN document by IDA/RESD on July 31, 1962, as TR 62-16. The Director of Defense Research and Engineering, Depart- ment of Defense, deleted portions of the repoit and declassified the remainder on May 13, 1964. The declassified version was printed as Exhibit 25 (pp. 425 to 463) of "Hearings Before a Subcommittee nf the Committee of Government Operations, House of Representatives, Eighty- Eighth Congress, Second Session, April 29 and 30, 1964," by the U.S. Government Printing Office. Except for the forematter, this reprint of the unclassified ver- sion is a facsimile reproduction of Exhibit 25. Three asterisks (* **) indicate that less than a pargrap has been deleted. A line of seven asterisks * * * ) Indicates deletion of one or more paragraphas. The coeplote report rtans its original classification. iii ACXNOWLEDCI4EN! The author wishes to thank many individuals who assisted this study by providing information and by reviewing a preliminary draft. This assistance is acknowledged gratefully but the author alone is accountable for the views expressed in this report. Dr. Joseph E. Barmack of the Institute for Defense Analyses is due a special thanks for his help in preparing the final report. v CONTENTS Foreword ii Acknowledgment v Contents vii Summary ix Conclusions xi Recommendations xiii 1. Purpose of This Report 1 2.
    [Show full text]
  • Functional MRI-Based Lie Detection: Acknowledge Possession of the Other5
    PERSPECTIVES In one of the earliest studies, subjects NEUROSCIENCE AND THE LAW — SCIENCE AND SOCIETY were given two playing cards and were instructed to deny possession of one and Functional MRI-based lie detection: acknowledge possession of the other5. Subjects underwent fMRI scanning while they viewed a series of cards, including the scientific and societal challenges two critical cards and other cards that they had not been given. A comparison between Martha J. Farah, J. Benjamin Hutchinson, Elizabeth A. Phelps ‘truth’ trials and ‘lie’ trials revealed brain and Anthony D. Wagner activity associated with deception. In a simi- lar task design, subjects mentally picked a Abstract | Functional MRI (fMRI)-based lie detection has been marketed as a tool number between three and eight, and when for enhancing personnel selection, strengthening national security and protecting shown a series of numbers on a screen, personal reputations, and at least three US courts have been asked to admit the denied having picked that number (the criti- results of lie detection scans as evidence during trials. How well does fMRI-based cal lie item) and also denied having picked lie detection perform, and how should the courts, and society more generally, the other numbers (truth items) while undergoing fMRI7. Here again, activity on lie respond? Here, we address various questions — some of which are based on a trials was compared with that on truth trials meta-analysis of published studies — concerning the scientific state of the art in to discover which areas were associated with fMRI-based lie detection and its legal status, and discuss broader ethical and deception in this task.
    [Show full text]
  • Which Lie Detection Tools Are Ready for Use in the Criminal Justice System?
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Portsmouth University Research Portal (Pure) Lie Detection Tools 1 Which Lie Detection Tools are Ready for Use in the Criminal Justice System? Aldert Vrij1 University of Portsmouth (UK) Ronald P Fisher Florida International University (USA) 1 Correspondence concerning this article should be addressed to: Aldert Vrij, University of Portsmouth, Psychology Department, King Henry Building, King Henry 1 Street, PO1 2DY, Portsmouth, Hants, UK or via email: [email protected] Lie Detection Tools 2 We introduce ‘arousal based’ lie detection tools (the Behavior Analysis Interview, the Comparison Question polygraph Test, CQT) and ‘cognition based’ lie detection tools (imposing cognitive load, encouraging interviewees to say more, asking unexpected questions, Strategic Use of Evidence and Verifiability Approach, Concealed Information polygraph Test, CIT), and discuss whether they are ready for use in investigative interviews. We developed ten criteria on which to judge their suitability. The two arousal-based techniques (frequently used) fall short on numerous criteria. There are too many problems associated with the imposing cognitive load technique, but the other cognitive techniques are ready for use (encouraging interviewees to say more and Strategic Use of Evidence) or ready for use if they continue to receive support in empirical research (asking unexpected questions and Verifiability Approach). The CIT polygraph test cannot be included in a standard investigative interview but can be useful in addition to investigative interviewing. Vrij wrote the first draft of the article, Fisher commented on it, and Vrij revised the article based on Fisher's comments.
    [Show full text]
  • DOCTORAL THESIS the Empathy Fillip: Can Training in Microexpressions of Emotion Enhance Empathic Accuracy? Eyles, Kieren
    DOCTORAL THESIS The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Eyles, Kieren Award date: 2016 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 04. Oct. 2021 The empathy fillip: Can training in microexpressions of emotion enhance empathic accuracy? Presented by: Kieren Eyles A thesis submitted in partial fulfilment of the requirements of the degree of PsychD, Department of Psychology, University of Roehampton 2015 Abstract Empathy is a central concern in the counselling process. Though much researched, and broadly commented upon, empathy is still largely understood through the words within a client-counsellor interaction. This semantic focus continues despite converging lines of evidence that suggest other elements of an interaction – for example body language – may be involved in the communication of empathy. In this thesis, the foundations of empathy are examined, focusing on empathy’s professional instantiation.
    [Show full text]