DOCSLIB.ORG

EMOTION CLASSIFICATION of COVERED FACES 1 WHO CAN READ YOUR FACIAL EXPRESSION? a Comparison of Humans and Machine Learning Class

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
EMOTION CLASSIFICATION of COVERED FACES 1 WHO CAN READ YOUR FACIAL EXPRESSION? a Comparison of Humans and Machine Learning Class journal name manuscript No. (will be inserted by the editor) 1 A Comparison of Humans and Machine Learning 2 Classifiers Detecting Emotion from Faces of People 3 with Different Coverings 4 Harisu Abdullahi Shehu · Will N. 5 Browne · Hedwig Eisenbarth 6 7 Received: 9th August 2021 / Accepted: date 8 Abstract Partial face coverings such as sunglasses and face masks uninten- 9 tionally obscure facial expressions, causing a loss of accuracy when humans 10 and computer systems attempt to categorise emotion. Experimental Psychol- 11 ogy would benefit from understanding how computational systems differ from 12 humans when categorising emotions as automated recognition systems become 13 available. We investigated the impact of sunglasses and different face masks on 14 the ability to categorize emotional facial expressions in humans and computer 15 systems to directly compare accuracy in a naturalistic context. Computer sys- 16 tems, represented by the VGG19 deep learning algorithm, and humans assessed 17 images of people with varying emotional facial expressions and with four dif- 18 ferent types of coverings, i.e. unmasked, with a mask covering lower-face, a 19 partial mask with transparent mouth window, and with sunglasses. Further- Harisu Abdullahi Shehu (Corresponding author) School of Engineering and Computer Science, Victoria University of Wellington, 6012 Wellington E-mail: [email protected] ORCID: 0000-0002-9689-3290 Will N. Browne School of Electrical Engineering and Robotics, Queensland University of Technology, Bris- bane QLD 4000, Australia Tel: +61 45 2468 148 E-mail: [email protected] ORCID: 0000-0001-8979-2224 Hedwig Eisenbarth School of Psychology, Victoria University of Wellington, 6012 Wellington Tel: +64 4 463 9541 E-mail: [email protected] ORCID: 0000-0002-0521-2630 2 Shehu H. A. et al. 20 more, we introduced an approach to minimize misclassification costs for the 21 computer systems while maintaining a reasonable accuracy. 22 Computer systems performed significantly better than humans when no 23 covering was present (>15% difference). However, the achieved accuracy dif- 24 fered significantly depending on the type of coverings and, importantly, the 25 emotion category. It was also noted that while humans mainly classified unclear 26 expressions as neutral when the fully covering mask was used, the misclassifi- 27 cation varied in the computer systems, which would affect their performance 28 in automated recognition systems. Importantly, the variation in the misclas- 29 sification can be adjusted by variations in the balance of categories in the 30 training set. 31 Keywords COVID-19 · Emotion classification · Facial expression · Facial 32 features · Face masks 33 34 1 Introduction 35 Facial expressions convey information regarding human emotion in non-verbal 36 communication. Thus, an accurate categorization of a person's emotional facial 37 expression allows understanding of their needs, intentions, as well as poten- 38 tial actions. This is valuable insight for psychological experiments, but time 39 consuming to collect manually. Thus, computational methods are needed to 40 analyze facial expressions but how do they differ from human classifiers, espe- 41 cially in different circumstances? 42 Face coverings such as sunglasses and face masks are used to cover the face 43 for different reasons. For instance, people use sunglasses to either protect the 44 eyes from sunlight or to improve appearance, and people use face masks often 45 to prevent the spread of infectious diseases such as the coronavirus (COVID- 46 19) or for hygienic reasons in hospitals or food preparation. However, these 47 coverings not only cover parts of a face but might also affect social interaction 48 as they obscure parts of facial expressions, which might contain socially rele- 49 vant information even if the expression does not represent the emotional state 50 of a person. While sunglasses cover an estimated 10-15% of the face, approxi- 51 mately 60-65% of the face is covered with face masks { exact numbers are hard 52 to tell as this might vary across different people, depending on the size of the 53 face (Carbon, 2020). More importantly, these coverings obscure different parts 54 of the face conveying information about emotional expressions to a varying 55 extent (Roberson et al., 2012). 56 Different studies have shown that humans are far from perfect in accessing 57 the emotional states of people by just looking at their face (Picard et al., 2001). 58 Further, humans are still far from perfect even when it comes to categorizing 59 emotional labels from facial expressions (Lewinski et al., 2014). A further 60 occlusion of the face leads to an even higher decrease in the performance 61 of humans in categorizing emotion from the faces of people. For instance, it 62 has been observed that a partial occlusion of the eyes (Noyes et al., 2021) Emotion classification of covered faces 3 63 impaired the achieved performance by humans especially for categorizing sad 64 expressions (Miller et al., 2020; Wegrzyn et al., 2017; Yuki et al., 2007). On 65 the other hand, while negative emotions such as sadness and fear are the most 66 difficult to categorize by humans (Camras & Allison, 1985; Guarnera et al., 67 2018) compared to positive emotions like happiness (Calvo & Lundqvist, 2008; 68 Hugenberg, 2005; Van den Stock et al., 2007; Wacker et al., 2003), obscuring 69 the mouth leads to less accurate categorization even for happiness (Wegrzyn 70 et al., 2017). 71 More specifically, Carbon (2020) investigated the impact of face masks 72 on humans in evaluating six different categories of emotion (anger, disgust, 73 fear, happy neutral, and sad) from images of people. They found a significant 74 decrease in performance of their human participants across all expressions 75 except for fear and neutral expressions. In addition, emotional expressions such 76 as happy, sad, and anger were repeatedly confused with neutral expressions 77 whereas other emotions like disgust were confused with anger expressions. In 78 accordance with Carbon, several studies confirmed the detrimental effect of 79 face masks on emotion categorization by humans (Grundmann et al., 2021; 80 Marini et al., 2021; Noyes et al., 2021). However, none of these studies directly 81 compared the impact of face masks on humans with machine learning classifiers 82 (computer systems). 83 In contrast to humans, computer systems have done well in categorizing 84 emotion from in-distribution faces images (images from the same dataset) of 85 people, achieving an accuracy of over 95%. Nevertheless, the performance of 86 these systems is greatly affected when it comes to categorizing emotion from 87 natural imagery where the sun is free to shine and people are free to move, 88 changing dramatically the appearance of images received by these computer 89 systems (Picard et al., 2001). For instance, a change in the colour information 90 of the pixels, foreground colour of the whole or a small region of the face, which 91 are nonlinearly cofounded with emotional expressions can lead to a decrease 92 in the performance of these models by up to 25% (Shehu et al., 2020a; Shehu, 93 Siddique, et al., 2021). 94 Furthermore, face coverings such as sunglasses and face masks affect the 95 performance of computer systems by up to 74% (Shehu, Browne, et al., 2021). 96 However, it is unknown to which extent the same type of sunglasses and face 97 masks would affect the performance of humans in direct comparison to com- 98 puter systems in emotion categorization of the same naturalistic stimuli. 99 Moreover, the ecological validity of these computer systems remains ques- 100 tionable as they are mainly trained and evaluated with in-distribution data. 101 We aim to analyze the limitations of humans and computer systems in 102 categorizing emotion of covered and uncovered faces, as well as the misclassi- 103 fication cost of the computer systems: 104 Initially, we will compare the impact of sunglasses and different types of 105 face masks (i.e. fully covered and recently introduced face masks with a trans- 106 parent window (Coleman, 2020)) on humans' and computer systems' ability 107 to categorize emotional facial expressions. This direct comparison using the 108 same stimuli across different emotion categories and different naturalistic face 4 Shehu H. A. et al. 109 coverings addresses open questions about the differential relevance of facial 110 features for both types of observers. 111 With respect to the computer systems, classifier induction often assumes 112 that the best distribution of classes within the data is an equal distribution, 113 i.e. where there is no class imbalance (Grzymala-Busse, 2005; Japkowicz et 114 al., 2000). However, research has shown that this assumption is often not 115 true and might lead to a model that is very costly when it misclassifies an 116 instance (Ciraco et al., 2005; Kukar et al., 1999; Pazzani et al., 1994). This 117 might also be true for emotion classification, e.g. when the fully covering mask 118 is used to cover the face, emotion categories like happiness were classified 119 badly by the computer systems, where the majority of the happy expression 120 images were misclassified as anger expression (Shehu, Browne, et al., 2021). 121 Thus, a secondary objective is to investigate how data distribution effects 122 misclassification between humans and computer systems. This has a practical 123 importance as when positive expressions such as happiness are misclassified 124 as negative emotional expressions like anger or sadness, artificial intelligence 125 systems like robots might refrain from interacting with a person, taking actions 126 on the misbelief that they are angry or sad. Conversely, the computer systems 127 might continuously try to interact with a person if an expression such as angry 128 or sad were misclassified as happiness, which could lead to a potential threat 129 to the safety of humans interacting with these computer systems.
Load more

Recommended publications
  • Emotion Detection in Twitter Posts: a Rule-Based Algorithm for Annotated Data Acquisition
    2020 International Conference on Computational Science and Computational Intelligence (CSCI) Emotion detection in Twitter posts: a rule-based algorithm for annotated data acquisition Maria Krommyda Anastatios Rigos Institute of Communication and Computer Systems Institute of Communication and Computer Systems Athens, Greece Athens, Greece [email protected] [email protected] Kostas Bouklas Angelos Amditis Institute of Communication and Computer Systems Institute of Communication and Computer Systems Athens, Greece Athens, Greece [email protected] [email protected] Abstract—Social media analysis plays a key role to the person that provided the text and it is categorized as positive, understanding of the public’s opinion regarding recent events negative, or neutral. Such analysis is mainly used for movies, and decisions, to the design and management of advertising products and persons, when measuring their appeal to the campaigns as well as to the planning of next steps and mitigation actions for public relationship initiatives. Significant effort has public is of interest [4] and require extended quantities of text been dedicated recently to the development of data analysis collected over a long period of time from different sources to algorithms that will perform, in an automated way, sentiment ensure an unbiased and objective output. analysis over publicly available text. Most of the available While this technique is very popular and well established, research work, focuses on binary categorizing text as positive or with many important use cases and applications, there are negative without further investigating the emotions leading to that categorization. The current needs, however, for in-depth analysis other equally important use cases where such analysis fail to of the available content combined with the complexity and multi- provided the needed information.
    [Show full text]
  • DISGUST: Features and SAWCHUK and Clinical Implications
    Journal of Social and Clinical Psychology, Vol. 24, No. 7, 2005, pp. 932-962 OLATUNJIDISGUST: Features AND SAWCHUK and Clinical Implications DISGUST: CHARACTERISTIC FEATURES, SOCIAL MANIFESTATIONS, AND CLINICAL IMPLICATIONS BUNMI O. OLATUNJI University of Massachusetts CRAIG N. SAWCHUK University of Washington School of Medicine Emotions have been a long–standing cornerstone of research in social and clinical psychology. Although the systematic examination of emotional processes has yielded a rather comprehensive theoretical and scientific literature, dramatically less empirical attention has been devoted to disgust. In the present article, the na- ture, experience, and other associated features of disgust are outlined. We also re- view the domains of disgust and highlight how these domains have expanded over time. The function of disgust in various social constructions, such as cigarette smoking, vegetarianism, and homophobia, is highlighted. Disgust is also becoming increasingly recognized as an influential emotion in the onset, maintenance, and treatment of various phobic states, Obsessive–Compulsive Disorder, and eating disorders. In comparison to the other emotions, disgust offers great promise for fu- ture social and clinical research efforts, and prospective studies designed to improve our understanding of disgust are outlined. The nature, structure, and function of emotions have a rich tradition in the social and clinical psychology literature (Cacioppo & Gardner, 1999). Although emotion theorists have contested over the number of discrete emotional states and their operational definitions (Plutchik, 2001), most agree that emotions are highly influential in organizing thought processes and behavioral tendencies (Izard, 1993; John- Preparation of this manuscript was supported in part by NIMH NRSA grant 1F31MH067519–1A1 awarded to Bunmi O.
    [Show full text]
  • About Emotions There Are 8 Primary Emotions. You Are Born with These
    About Emotions There are 8 primary emotions. You are born with these emotions wired into your brain. That wiring causes your body to react in certain ways and for you to have certain urges when the emotion arises. Here is a list of primary emotions: Eight Primary Emotions Anger: fury, outrage, wrath, irritability, hostility, resentment and violence. Sadness: grief, sorrow, gloom, melancholy, despair, loneliness, and depression. Fear: anxiety, apprehension, nervousness, dread, fright, and panic. Joy: enjoyment, happiness, relief, bliss, delight, pride, thrill, and ecstasy. Interest: acceptance, friendliness, trust, kindness, affection, love, and devotion. Surprise: shock, astonishment, amazement, astound, and wonder. Disgust: contempt, disdain, scorn, aversion, distaste, and revulsion. Shame: guilt, embarrassment, chagrin, remorse, regret, and contrition. All other emotions are made up by combining these basic 8 emotions. Sometimes we have secondary emotions, an emotional reaction to an emotion. We learn these. Some examples of these are: o Feeling shame when you get angry. o Feeling angry when you have a shame response (e.g., hurt feelings). o Feeling fear when you get angry (maybe you’ve been punished for anger). There are many more. These are NOT wired into our bodies and brains, but are learned from our families, our culture, and others. When you have a secondary emotion, the key is to figure out what the primary emotion, the feeling at the root of your reaction is, so that you can take an action that is most helpful. .
    [Show full text]
  • Characteristics of the Regulation of the Surprise Emotion Chuanlin Zhu1, Ping Li2, Zhao Zhang2, Dianzhi Liu1 & Wenbo Luo2,3
    www.nature.com/scientificreports OPEN Characteristics of the regulation of the surprise emotion Chuanlin Zhu1, Ping Li2, Zhao Zhang2, Dianzhi Liu1 & Wenbo Luo2,3 This study aimed to assess the characteristics of the regulation of the emotion of surprise. Event-related Received: 27 June 2017 potentials (ERPs) of college students when using cognitive reappraisal and expressive suppression to Accepted: 11 April 2019 regulate their surprise level were recorded. Diferent contexts were presented to participants, followed Published: xx xx xxxx by the image of surprised facial expression; subsequently, using a 9-point scale, participants were asked to rate the intensity of their emotional experience. The behavioral results suggest that individuals’ surprise level could be reduced by using both expressive suppression and cognitive reappraisal, in basic and complex conditions. The ERP results showed that (1) the N170 amplitudes were larger in complex than basic contexts, and those elicited by using expressive suppression and cognitive reappraisal showed no signifcant diferences, suggesting that emotion regulation did not occur at this stage; (2) the LPC amplitudes elicited by using cognitive reappraisal and expressive suppression were smaller than those elicited by free viewing in both context conditions, suggesting that the late stage of individuals’ processing of surprised faces was infuenced by emotion regulation. This study found that conscious emotional regulation occurred in the late stages when individuals processed surprise, and the regulation efects of cognitive reappraisal and expressive suppression were equivalent. When we pass an important test, some of us dance out of excitement; when we are informed about the sudden death of a loved one, we feel extremely sad.
    [Show full text]
  • Machine Learning Based Emotion Classification Using the Covid-19 Real World Worry Dataset
    Anatolian Journal of Computer Sciences Volume:6 No:1 2021 © Anatolian Science pp:24-31 ISSN:2548-1304 Machine Learning Based Emotion Classification Using The Covid-19 Real World Worry Dataset Hakan ÇAKAR1*, Abdulkadir ŞENGÜR2 *1Fırat Üniversitesi/Teknoloji Fak., Elektrik-Elektronik Müh. Bölümü, Elazığ, Türkiye ([email protected]) 2Fırat Üniversitesi/Teknoloji Fak., Elektrik-Elektronik Müh. Bölümü, Elazığ, Türkiye ([email protected]) Received Date : Sep. 27, 2020 Acceptance Date : Jan. 1, 2021 Published Date : Mar. 1, 2021 Özetçe— COVID-19 pandemic has a dramatic impact on economies and communities all around the world. With social distancing in place and various measures of lockdowns, it becomes significant to understand emotional responses on a great scale. In this paper, a study is presented that determines human emotions during COVID-19 using various machine learning (ML) approaches. To this end, various techniques such as Decision Trees (DT), Support Vector Machines (SVM), k-nearest neighbor (k-NN), Neural Networks (NN) and Naïve Bayes (NB) methods are used in determination of the human emotions. The mentioned techniques are used on a dataset namely Real World Worry dataset (RWWD) that was collected during COVID-19. The dataset, which covers eight emotions on a 9-point scale, grading their anxiety levels about the COVID-19 situation, was collected by using 2500 participants. The performance evaluation of the ML techniques on emotion prediction is carried out by using the accuracy score. Five-fold cross validation technique is also adopted in experiments. The experiment works show that the ML approaches are promising in determining the emotion in COVID- 19 RWWD.
    [Show full text]
  • Emotion Classification Based on Biophysical Signals and Machine Learning Techniques
    S S symmetry Article Emotion Classification Based on Biophysical Signals and Machine Learning Techniques Oana Bălan 1,* , Gabriela Moise 2 , Livia Petrescu 3 , Alin Moldoveanu 1 , Marius Leordeanu 1 and Florica Moldoveanu 1 1 Faculty of Automatic Control and Computers, University POLITEHNICA of Bucharest, Bucharest 060042, Romania; [email protected] (A.M.); [email protected] (M.L.); fl[email protected] (F.M.) 2 Department of Computer Science, Information Technology, Mathematics and Physics (ITIMF), Petroleum-Gas University of Ploiesti, Ploiesti 100680, Romania; [email protected] 3 Faculty of Biology, University of Bucharest, Bucharest 030014, Romania; [email protected] * Correspondence: [email protected]; Tel.: +40722276571 Received: 12 November 2019; Accepted: 18 December 2019; Published: 20 December 2019 Abstract: Emotions constitute an indispensable component of our everyday life. They consist of conscious mental reactions towards objects or situations and are associated with various physiological, behavioral, and cognitive changes. In this paper, we propose a comparative analysis between different machine learning and deep learning techniques, with and without feature selection, for binarily classifying the six basic emotions, namely anger, disgust, fear, joy, sadness, and surprise, into two symmetrical categorical classes (emotion and no emotion), using the physiological recordings and subjective ratings of valence, arousal, and dominance from the DEAP (Dataset for Emotion Analysis using EEG, Physiological and Video Signals) database. The results showed that the maximum classification accuracies for each emotion were: anger: 98.02%, joy:100%, surprise: 96%, disgust: 95%, fear: 90.75%, and sadness: 90.08%. In the case of four emotions (anger, disgust, fear, and sadness), the classification accuracies were higher without feature selection.
    [Show full text]
  • 9:30–10:40Am
    THE RUHLMAN R C O N F E R E N C E 9:30–10:40am guage, and disability. With a focus on four Cross-cultural Research Literature and the Arts discourse variables—question-and-answer sequences, expletives (profanity), honorif- Construction of Gender: ics, and indirection—the study aims to Why There Are Indirect Speech Insight into Japan and Korea (panel) identify stereotypes associated with female Acts: A Response to Bertolet (panel) Science Center 396 vs. male speech and explores the role Pendleton West 117 of disability in their perpetuation. The Gender is a social construct expressed by Shan Shan Tam ’10, Philosophy and each individual in accordance with a social major questions addressed by this film- based linguistic analysis are as follows: Architecture, Kimberly Goyzueta ’11, standard. This panel examines native Cognitive and Linguistic Sciences, and 1) Are the disabled subject to the same portrayals of gender in creative outlets, Margaret Hall ’11, Psychology language-related gender stereotypes that and the use of language and other social ADVISOR: Mary Kate McGowan, Philosophy behavior, to examine the expression of characterize the speech of nondisabled Suppose a diner asks, “Can you pass the gender in modern Japan and Korea. men and women (e.g., women’s speech is “powerless” and/or “cooperative”)? and salt?” Although her utterance is literally a Real Men Wear Sequins: Performing 2) can physical disability, both in Oasis question (about the physical abilities of Gender on the Takarazuka Stage and more generally, in Korean society and the addressee), most would take it as a elsewhere, be a hyperbolized expression of request (that the addressee pass the salt).
    [Show full text]
  • DEAP: a Database for Emotion Analysis Using Physiological Signals
    IEEE TRANS. AFFECTIVE COMPUTING 1 DEAP: A Database for Emotion Analysis using Physiological Signals Sander Koelstra, Student Member, IEEE, Christian M¨uhl, Mohammad Soleymani, Student Member, IEEE, Jong-Seok Lee, Member, IEEE, Ashkan Yazdani, Touradj Ebrahimi, Member, IEEE, Thierry Pun, Member, IEEE, Anton Nijholt, Member, IEEE, Ioannis Patras, Member, IEEE Abstract—We present a multimodal dataset for the analysis of human affective states. The electroencephalogram (EEG) and peripheral physiological signals of 32 participants were recorded as each watched 40 one-minute long excerpts of music videos. Participants rated each video in terms of the levels of arousal, valence, like/dislike, dominance and familiarity. For 22 of the 32 participants, frontal face video was also recorded. A novel method for stimuli selection is proposed using retrieval by affective tags from the last.fm website, video highlight detection and an online assessment tool. An extensive analysis of the participants’ ratings during the experiment is presented. Correlates between the EEG signal frequencies and the participants’ ratings are investigated. Methods and results are presented for single-trial classification of arousal, valence and like/dislike ratings using the modalities of EEG, peripheral physiological signals and multimedia content analysis. Finally, decision fusion of the classification results from the different modalities is performed. The dataset is made publicly available and we encourage other researchers to use it for testing their own affective state estimation methods. Index Terms—Emotion classification, EEG, Physiological signals, Signal processing, Pattern classification, Affective computing. ✦ 1 INTRODUCTION information retrieval. Affective characteristics of multi- media are important features for describing multime- MOTION is a psycho-physiological process triggered dia content and can be presented by such emotional by conscious and/or unconscious perception of an E tags.
    [Show full text]
  • Emotion Classification Based on Brain Wave: a Survey
    Li et al. Hum. Cent. Comput. Inf. Sci. (2019) 9:42 https://doi.org/10.1186/s13673-019-0201-x REVIEW Open Access Emotion classifcation based on brain wave: a survey Ting‑Mei Li1, Han‑Chieh Chao1,2* and Jianming Zhang3 *Correspondence: [email protected] Abstract 1 Department of Electrical Brain wave emotion analysis is the most novel method of emotion analysis at present. Engineering, National Dong Hwa University, Hualien, With the progress of brain science, it is found that human emotions are produced by Taiwan the brain. As a result, many brain‑wave emotion related applications appear. However, Full list of author information the analysis of brain wave emotion improves the difculty of analysis because of the is available at the end of the article complexity of human emotion. Many researchers used diferent classifcation methods and proposed methods for the classifcation of brain wave emotions. In this paper, we investigate the existing methods of brain wave emotion classifcation and describe various classifcation methods. Keywords: EEG, Emotion, Classifcation Introduction Brain science has shown that human emotions are controlled by the brain [1]. Te brain produces brain waves as it transmits messages. Brain wave data is one of the biological messages, and biological messages usually have emotion features. Te feature of emo- tion can be extracted through the analysis of brain wave messages. But because of the environmental background and cultural diferences of human growth, the complexity of human emotion is caused. Terefore, in the analysis of brain wave emotion, classifcation algorithm is very important. In this article, we will focus on the classifcation of brain wave emotions.
    [Show full text]
  • Emotion Autonomic Arousal
    PSYC 100 Emotions 2/23/2005 Emotion ■ Emotions reflect a “stirred up’ state ■ Emotions have valence: positive or negative ■ Emotions are thought to have 3 components: ß Physiological arousal ß Subjective experience ß Behavioral expression Autonomic Arousal ■ Increased heart rate ■ Rapid breathing ■ Dilated pupils ■ Sweating ■ Decreased salivation ■ Galvanic Skin Response 2/23/2005 1 Theories of Emotion James-Lange ■ Each emotion has an autonomic signature 2/23/2005 Assessment of James-Lange Theory of Emotion ■ Cannon’s arguments against the theory: ß Visceral response are slower than emotions ß The same visceral responses are associated with many emotions (Î heart rate with anger and joy). ■ Subsequent research provides support: ß Different emotions are associated with different patterns of visceral activity ß Accidental transection of the spinal cord greatly diminishes emotional reactivity (prevents visceral signals from reaching brain) 2 Cannon-Bard Criticisms ■ Arousal without emotion (exercise) 2/23/2005 Facial Feedback Model ■ Similar to James-Lange, but not autonomic signature; facial signature associated with each emotion. 2/23/2005 Facial Expression of Emotion ■ There is an evolutionary link between the experience of emotion and facial expression of emotion: ß Facial expressions serve to inform others of our emotional state ■ Different facial expressions are associated with different emotions ß Ekman’s research ■ Facial expression can alter emotional experience ß Engaging in different facial expressions can alter heart rate and skin temperature 3 Emotions and Darwin ■ Adaptive value ■ Facial expression in infants ■ Facial expression x-cultures ■ Understanding of expressions x-cultures 2/23/2005 Facial Expressions of Emotion ■ Right cortex—left side of face 2/23/2005 Emotions and Learning ■ But experience matters: research with isolated monkeys 2/23/2005 4 Culture and Display Rules ■ Public vs.
    [Show full text]
  • Conceptual Framework for Quantum Affective Computing and Its Use in Fusion of Multi-Robot Emotions
    electronics Article Conceptual Framework for Quantum Affective Computing and Its Use in Fusion of Multi-Robot Emotions Fei Yan 1 , Abdullah M. Iliyasu 2,3,∗ and Kaoru Hirota 3,4 1 School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China; [email protected] 2 College of Engineering, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia 3 School of Computing, Tokyo Institute of Technology, Yokohama 226-8502, Japan; [email protected] 4 School of Automation, Beijing Institute of Technology, Beijing 100081, China * Correspondence: [email protected] Abstract: This study presents a modest attempt to interpret, formulate, and manipulate the emotion of robots within the precepts of quantum mechanics. Our proposed framework encodes emotion information as a superposition state, whilst unitary operators are used to manipulate the transition of emotion states which are subsequently recovered via appropriate quantum measurement operations. The framework described provides essential steps towards exploiting the potency of quantum mechanics in a quantum affective computing paradigm. Further, the emotions of multi-robots in a specified communication scenario are fused using quantum entanglement, thereby reducing the number of qubits required to capture the emotion states of all the robots in the environment, and therefore fewer quantum gates are needed to transform the emotion of all or part of the robots from one state to another. In addition to the mathematical rigours expected of the proposed framework, we present a few simulation-based demonstrations to illustrate its feasibility and effectiveness. This exposition is an important step in the transition of formulations of emotional intelligence to the quantum era.
    [Show full text]
  • LGBTI Rights in East and Southeast Asia E
    Special Brief: LGBTI Rights in East and Southeast Asia E apcom .org Writers: Professor Douglas Sanders Design and layout: Vaness S. Kongsakul © APCOM 2020 Map Disclaimer: The designations employed and the presentation of the material on this map do not imply the expression of any opinion whatsoever on the part of APCOM concerning the legal status of any country, terri- tory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. Every effort is made to ensure this map is free of errors but there is no warrant the map or its features are either spatially or temporally accurate or fit for a particular use. This map is provided without any warranty of any kind whatsoever, either express or implied. LGBTI Rights in East and Southeast Asia 4 LGBTI Rights in East and Southeast Asia BRUNEI Criminal law: The Malay, Muslim, Sultanate of Brunei retains a British colonial era anti-homosexual criminal law. Cases reported in the local press all involved sex with underage males – no other prosecutions. Sharia law: New Sharia (Islamic) criminal code provisions, first announced in 2013, came into force in 2019. They impose the death penalty for rape, adultery and sodomy. Muslims and non-Muslims alike are threatened with death by stoning and other ‘hudud’ punishments. This prompted renewed international calls for a boycott of the luxury hotels in the US, UK and Italy owned by the oil-rich Sultanate. In response, the Sultan has pledged that there will be no enforcement of the death penalty. A de facto moratorium on the death penalty was already in place.
    [Show full text]