Affective Computing Overview of Theory, Techniques And

Total Page:16

File Type:pdf, Size:1020Kb

Affective Computing Overview of Theory, Techniques And Affective Computing Overview of Theory, Techniques and Applications http://www.cs.unibo.it./difelice/ Context Aware Systems Prof. Marco Di Felice Department of Computer Science and Engineering University of Bologna Affective Computing q Affective computing is an emerging field of research that aims to enable intelligent systems to recognize, feel, infer and interpret human emotions (emotion-aware computing). ² Interdisciplinary research area: computer science (computer vision, IA, NLP, ..), psychology, cognitive science, social science. ² Include sentiment analysis (not covered in this presentation) and emotion recognition (focus on mobile applications here). AFFECTIVE COMPUTING: THEORY, TECHNIQUES AND APPLICATIONS MARCO DI FELICE 2 https://www.affectiva.com/product/affectiva-automotive-ai/ Affective Computing q USE CASES: SOCIAL MONITORING (I) Driver state monitoring ² Monitor levels of driver fatigue and distraction to enable appropriate alerts and interventions that correct dangerous driving. ² Monitor driver anger to enable interventions or route alternatives that avoid road rage. ² Address handoff challenge between driver and car in semi-autonomous vehicles. Occupant Experience Monitoring ² Personalize content recommendations ² Adapt environmental conditions AFFECTIVE COMPUTING: THEORY, TECHNIQUES AND APPLICATIONS MARCO DI FELICE 3 [1] M. Chen, Y. Zhang, Y. Li, S. Mao, V. C. M. Leung: EMC: Emotion-aware mobile cloud computing in 5G. IEEE Network 29(2): 32-38 (2015) [2] Yong Feng, Qiana Yin, Zhang Xiao, Han, Yu, Limei Peng, "EARS: Emotion-aware recommender system based on hybrid information fusion", Information Fusion, 46, March 2019, 141-146 Affective Computing CHEN2_LAYOUT.qxp_Layout 1 3/13/15 2:07 PM Page 33 q USE CASES: RECOMMENDER SYSTEMS (II) Y. Qian et al. Data collection (Historical data and data from social networks) ments when they are not available or when it is not conve- nient for the user to send his/her requests. Emotion-aware applications have great potential to Emotion Emotion-aware Mobile user recognition bring QoE provisioning to a new level and change the lifestyle of many people, which, however, also demands 5G network Emotion-aware more advanced technologies to yield effective solutions. service push recommender Fortunately, with MCC technology, computationally inten- sive tasks can be offloaded to the cloud instead of only by Remote cloud mobile devices [7]. Through the extensive use of cloud systems computing and cloud-assisted resources, mobile devices Data collection can break the shackles of their limited resources, the (Data from wearable models of mobile applications can be improved to enhance devices and user experience, and a user-centric paradigm can be smartphone) developed, which is also the core objective of 5G [8]. An important aspect of QoE provisioning is to offer personalized mobile service based on the user’s emotional Data collection Data preprocessing variations. This article proposes a novel style of applica- (multimedia emotional data) tions enabled by emotion-aware mobile cloud computing Sensing Computing resource (EMC) in 5G. EMC is design to provide emotion-aware resource mobile services by recognizing users’ emotionalArchitecture changes through cloud computing and big data analysis. EMC Architecture infers emotion based on affective computing, which is a complex process requiring a paradigmproposed shift in user model- in [1] Local cloudlet ing, for example, mode of operation, expression character- proposed in [2] istics, attitudes, preferences, cognitive styles, background Figure 1. The proposed EMC architecture. knowledge, and so on. The performance of affective com- Fig. 1. System architecture of EARS. puting largely depends on the quality of collected data, AFFECTIVE COMPUTING: THEORY, TECHNIQUES AND APPLICATIONS explicit information that can be processed through various approved the users, we can take some privacy preserving measures, such as which could be very large in volume and variety. The approaches for recommender systems, such as CF, SVD, and matrix anonymity, which protects the user’s privacy by hiding the user’s sen- 4 more types and larger scale of emotional data, the higher the quickly and efficiently, according to their physical andfactorization emo-[21]. However,MARCO DI FELICE social network data and user review sitive information, such as ID, name and so on. In fact, such a proces- data are implicit information whose features should be extracted by sing does not affect the performance of the recommendation system accuracy of emotional analysis results. Hence, in order to pro- tional status. available approaches. In particular, social information can be ex- proposed in this paper, because the two processes are vertical. We will vide accurate and timely emotion-aware services, affective To solve the challenging issues that arise in the EMCtracted archi- by social computing from social network data [22], and not discuss the data privacy preserving here. This work will be carried emotional information can be extracted from user review data by out in the future. computing is resource-intensive based on the analysis of emo- tecture, we investigate a comprehensive emotion-awaresentiment system analysis [23]. tional big data in the forms of text, video, social data, facial with the support of the latest technology advances,3. Algorithms such as and Models: After information fusion, the raw data are 3.2. Explicit feedback analysis features, and physiological signals, among others. mobile cloud computing and 5G. The main contributionspreprocessed, of and valuable information is extracted for re- commendations. Available algorithms and models are used to pro- On the basis of the algorithm mentioned above, we can provide the Recently, most existing healthcare systems only provide this work include: vide personalized services based on the hybrid information. following model: Assume that the user’s choice behavior is determined ff care for the user’s physiological status while EMC also takes •Enabling computation-intensive affective computing4. Recommendation in Services: In di erent scenarios, various re- by the user’s “selectivity” of the product. commendation services are appropriate: (i) statistics-based appli- Definition 1 assumes that user i and product j in potential product K- into account the user’s mental status. The existing healthcare mobile applications by MCC and big data analysis. cations that list the most popular items [24]; (ii) knowledge-based dimensional feature space are represented as a set of vectors applications that discover users’ interests according to historical systems exhibit the following features: •Providing users with resource cognition-based emotion- UUUUUUUUiiiikjjjjk(,12 ,, ), (, 12 ,, ). User characteristics and data [25]; and (iii) prediction-based applications that recognize product= characteristics⋯ = together determine⋯ the behavior of the user’s •Wearable and mobile devices are used to collect the user’s aware feedback by utilizing the abundant cloud resources fi users’ demands through advanced machine learning and arti cial choice, and thus Aij represents the absolute extent of the tendency of the physiological information. and the broadband bandwidth supported by 5G. intelligence [26]. product user ij: K •They only collect the user’s physical status, but are not •Identifying a novel EMC partitioning design trade-offIt is worth to noting that in the process of data collection and in- AUVUVij i· j ik jk formation fusion, the data we used may involve user s privacy in- aware of the user’s stress levels, unhealthy emotion, and guarantee users’ QoE while achieving optimized resource ’ ==k 1 (1) formation, such as emotional information. In order to protect privacy of ∑= even mental illness conditions. allocation under dynamic mobile network environments. However, the absolute tendency itself does not fully reflect the user’s •The existing mode based on wearable devices for collecting The remainder of this article is organized as follows. We physiological information will give a negative psychological first present the EMC architecture and then present a collab- implication that the user is in poor health. orative local cloudlet architecture for data collection and pre- In particular, for users in a mood of loneliness and depres- processing, as well as a proposed remote cloud for emotion sion, such a “conscious” way to collect and present their phys- recognition and service push. Next we introduce elastic emo- iological information may lead to even more serious mental tion-aware computing by joint cloud, communications, and illness. device resource optimization. Then we conclude the article. In contrast, with emotion care, the above problems can be alleviated. As examples, EMC can serve various scenarios as follows. Architecture • For elderly people, EMC can collect their physical condi- The proposed EMC architecture is shown in Fig. 1, which tions, as well as perceive their mental status, which allevi- includes three main components: a mobile terminal, a local ates their loneliness and other negative emotions. cloudlet, and a remote cloud. • For those working in a closed environment over a long peri- od, such as deep-sea or space exploration, EMC can be uti- EMC Infrastructure Functional Components lized to perceive their emotions and help adjust their In EMC, infrastructure functional components, which consist physical and mental state to ensure successful completion of mobile terminals, a local cloudlet, and a remote cloud,
Recommended publications
  • Feeling and Decision Making: the Appraisal-Tendency Framework
    Feelings and Consumer Decision Making: Extending the Appraisal-Tendency Framework The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Lerner, Jennifer S., Seunghee Han, and Dacher Keltner. 2007. “Feelings and Consumer Decision Making: Extending the Appraisal- Tendency Framework.” Journal of Consumer Psychology 17 (3) (July): 181–187. doi:10.1016/s1057-7408(07)70027-x. Published Version 10.1016/S1057-7408(07)70027-X Citable link http://nrs.harvard.edu/urn-3:HUL.InstRepos:37143006 Terms of Use This article was downloaded from Harvard University’s DASH repository, and is made available under the terms and conditions applicable to Other Posted Material, as set forth at http:// nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of- use#LAA Feelings and Consumer Decision Making 1 Running head: FEELINGS AND CONSUMER DECISION MAKING Feelings and Consumer Decision Making: The Appraisal-Tendency Framework Seunghee Han, Jennifer S. Lerner Carnegie Mellon University Dacher Keltner University of California, Berkeley Invited article for the Journal of Consumer Psychology Draft Date: January 3rd, 2006 Correspondence Address: Seunghee Han Department of Social and Decision Sciences Carnegie Mellon University Pittsburgh, PA 15213 Phone: 412-268-2869, Fax: 412-268-6938 Email: [email protected] Feelings and Consumer Decision Making 2 Abstract This article presents the Appraisal Tendency Framework (ATF) (Lerner & Keltner, 2000, 2001; Lerner & Tiedens, 2006) as a basis for predicting the influence of specific emotions on consumer decision making. In particular, the ATF addresses how and why specific emotions carry over from past situations to color future judgments and choices.
    [Show full text]
  • The Influence of Discrete Emotional States on Preferential Choice
    University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses Dissertations and Theses July 2016 The Influence of Discrete Emotional States on Preferential Choice Andrea M. Cataldo University of Massachusetts Amherst Follow this and additional works at: https://scholarworks.umass.edu/masters_theses_2 Part of the Cognition and Perception Commons, Cognitive Psychology Commons, Experimental Analysis of Behavior Commons, Personality and Social Contexts Commons, and the Quantitative Psychology Commons Recommended Citation Cataldo, Andrea M., "The Influence of Discrete Emotional States on Preferential Choice" (2016). Masters Theses. 339. https://doi.org/10.7275/8320829 https://scholarworks.umass.edu/masters_theses_2/339 This Open Access Thesis is brought to you for free and open access by the Dissertations and Theses at ScholarWorks@UMass Amherst. It has been accepted for inclusion in Masters Theses by an authorized administrator of ScholarWorks@UMass Amherst. For more information, please contact [email protected]. THE INFLUENCE OF DISCRETE EMOTIONAL STATES ON PREFERENTIAL CHOICE A Master’s Thesis by ANDREA M. CATALDO Submitted to the Graduate School of the University of Massachusetts Amherst in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE May 2016 Psychology © Copyright by Andrea M. Cataldo 2016 All Rights Reserved THE INFLUENCE OF DISCRETE EMOTIONAL STATES ON PREFERENTIAL CHOICE A Master’s Thesis by ANDREA M. CATALDO Approved as to style and content by: ________________________________________________________
    [Show full text]
  • 1 Automated Face Analysis for Affective Computing Jeffrey F. Cohn & Fernando De La Torre Abstract Facial Expression
    Please do not quote. In press, Handbook of affective computing. New York, NY: Oxford Automated Face Analysis for Affective Computing Jeffrey F. Cohn & Fernando De la Torre Abstract Facial expression communicates emotion, intention, and physical state, and regulates interpersonal behavior. Automated Face Analysis (AFA) for detection, synthesis, and understanding of facial expression is a vital focus of basic research. While open research questions remain, the field has become sufficiently mature to support initial applications in a variety of areas. We review 1) human-observer based approaches to measurement that inform AFA; 2) advances in face detection and tracking, feature extraction, registration, and supervised learning; and 3) applications in action unit and intensity detection, physical pain, psychological distress and depression, detection of deception, interpersonal coordination, expression transfer, and other applications. We consider user-in-the-loop as well as fully automated systems and discuss open questions in basic and applied research. Keywords Automated Face Analysis and Synthesis, Facial Action Coding System (FACS), Continuous Measurement, Emotion, Nonverbal Communication, Synchrony 1. Introduction The face conveys information about a person’s age, sex, background, and identity, what they are feeling, or thinking (Darwin, 1872/1998; Ekman & Rosenberg, 2005). Facial expression regulates face-to-face interactions, indicates reciprocity and interpersonal attraction or repulsion, and enables inter-subjectivity between members of different cultures (Bråten, 2006; Fridlund, 1994; Tronick, 1989). Facial expression reveals comparative evolution, social and emotional development, neurological and psychiatric functioning, and personality processes (Burrows & Cohn, In press; Campos, Barrett, Lamb, Goldsmith, & Stenberg, 1983; Girard, Cohn, Mahoor, Mavadati, & Rosenwald, 2013; Schmidt & Cohn, 2001). Not surprisingly, the face has been of keen interest to behavioral scientists.
    [Show full text]
  • Emotion Classification Based on Biophysical Signals and Machine Learning Techniques
    S S symmetry Article Emotion Classification Based on Biophysical Signals and Machine Learning Techniques Oana Bălan 1,* , Gabriela Moise 2 , Livia Petrescu 3 , Alin Moldoveanu 1 , Marius Leordeanu 1 and Florica Moldoveanu 1 1 Faculty of Automatic Control and Computers, University POLITEHNICA of Bucharest, Bucharest 060042, Romania; [email protected] (A.M.); [email protected] (M.L.); fl[email protected] (F.M.) 2 Department of Computer Science, Information Technology, Mathematics and Physics (ITIMF), Petroleum-Gas University of Ploiesti, Ploiesti 100680, Romania; [email protected] 3 Faculty of Biology, University of Bucharest, Bucharest 030014, Romania; [email protected] * Correspondence: [email protected]; Tel.: +40722276571 Received: 12 November 2019; Accepted: 18 December 2019; Published: 20 December 2019 Abstract: Emotions constitute an indispensable component of our everyday life. They consist of conscious mental reactions towards objects or situations and are associated with various physiological, behavioral, and cognitive changes. In this paper, we propose a comparative analysis between different machine learning and deep learning techniques, with and without feature selection, for binarily classifying the six basic emotions, namely anger, disgust, fear, joy, sadness, and surprise, into two symmetrical categorical classes (emotion and no emotion), using the physiological recordings and subjective ratings of valence, arousal, and dominance from the DEAP (Dataset for Emotion Analysis using EEG, Physiological and Video Signals) database. The results showed that the maximum classification accuracies for each emotion were: anger: 98.02%, joy:100%, surprise: 96%, disgust: 95%, fear: 90.75%, and sadness: 90.08%. In the case of four emotions (anger, disgust, fear, and sadness), the classification accuracies were higher without feature selection.
    [Show full text]
  • Green Environments and Happiness Level in Housing Areas Toward a Sustainable Life
    sustainability Article Green Environments and Happiness Level in Housing Areas toward a Sustainable Life Min Jee Nikki Han and Mi Jeong Kim * School of Architecture, Hanyang University, Seoul 04763, Korea * Correspondence: [email protected] Received: 25 April 2019; Accepted: 12 August 2019; Published: 1 September 2019 Abstract: Housing environments should enable residents to have positive experiences through the allocation of diverse green environments, which lead to physically and mentally happy, healthy living. Such positive experiences affect their happiness level, thus leading to sustainable lives. However, in Korea, since the 1980s, the design of housing complexes has been overly focused on their economic and iconic value, while the importance of residents’ experiences has been ignored in the living environment. This research explores categories of green environments in accordance with their scale and purpose of use and evaluates green environments in housing areas by focusing on the residents’ happiness levels. Further, this research examines the correlation between green environments and residents’ happiness level and the effect of green environments on their sociality satisfaction level. The results indicate that green environments and happiness levels are critically correlated. Through the results, this research emphasizes the importance of providing structural and strategic planning of green environments in housing areas for residents’ happiness, and thus their sustainable lives. Keywords: green environment; housing environment; residents’ cognition; happiness level; community life 1. Introduction In the 2018 World Happiness Index, Korea ranked 57 out of 156 countries [1]. Diverse factors affect the happiness level (HL) of citizens; however, the quality of their living environment is considered a major issue affecting their HL [2–4].
    [Show full text]
  • John F. Helliwell, Richard Layard and Jeffrey D. Sachs
    2018 John F. Helliwell, Richard Layard and Jeffrey D. Sachs Table of Contents World Happiness Report 2018 Editors: John F. Helliwell, Richard Layard, and Jeffrey D. Sachs Associate Editors: Jan-Emmanuel De Neve, Haifang Huang and Shun Wang 1 Happiness and Migration: An Overview . 3 John F. Helliwell, Richard Layard and Jeffrey D. Sachs 2 International Migration and World Happiness . 13 John F. Helliwell, Haifang Huang, Shun Wang and Hugh Shiplett 3 Do International Migrants Increase Their Happiness and That of Their Families by Migrating? . 45 Martijn Hendriks, Martijn J. Burger, Julie Ray and Neli Esipova 4 Rural-Urban Migration and Happiness in China . 67 John Knight and Ramani Gunatilaka 5 Happiness and International Migration in Latin America . 89 Carol Graham and Milena Nikolova 6 Happiness in Latin America Has Social Foundations . 115 Mariano Rojas 7 America’s Health Crisis and the Easterlin Paradox . 146 Jeffrey D. Sachs Annex: Migrant Acceptance Index: Do Migrants Have Better Lives in Countries That Accept Them? . 160 Neli Esipova, Julie Ray, John Fleming and Anita Pugliese The World Happiness Report was written by a group of independent experts acting in their personal capacities. Any views expressed in this report do not necessarily reflect the views of any organization, agency or programme of the United Nations. 2 Chapter 1 3 Happiness and Migration: An Overview John F. Helliwell, Vancouver School of Economics at the University of British Columbia, and Canadian Institute for Advanced Research Richard Layard, Wellbeing Programme, Centre for Economic Performance, at the London School of Economics and Political Science Jeffrey D. Sachs, Director, SDSN, and Director, Center for Sustainable Development, Columbia University The authors are grateful to the Ernesto Illy Foundation and the Canadian Institute for Advanced Research for research support, and to Gallup for data access and assistance.
    [Show full text]
  • Redalyc.Inter-Regional Metric Disadvantages When Comparing
    International Journal of Psychological Research ISSN: 2011-2084 [email protected] Universidad de San Buenaventura Colombia Rojas-Gualdron, Diego Fernando Inter-regional metric disadvantages when comparing country happiness on a global scale. A Rasch-based consequential validity analysis International Journal of Psychological Research, vol. 10, núm. 2, 2017, pp. 26-34 Universidad de San Buenaventura Medellín, Colombia Available in: http://www.redalyc.org/articulo.oa?id=299052071004 How to cite Complete issue Scientific Information System More information about this article Network of Scientific Journals from Latin America, the Caribbean, Spain and Portugal Journal's homepage in redalyc.org Non-profit academic project, developed under the open access initiative Int. j. psychol. res, Vol. 10 (2) 26-33, 2017 DOI 10.21500/20112084.2995 Inter-regional metric disadvantages when comparing country happiness on a global scale. A Rasch-based consequential validity analysis Desventajas metricas´ entre regiones al comparar la felicidad de los pa´ısesa escala global. Un analisis´ Rasch de validez consecuencial Diego Fernando Rojas-Gualdron´ 1* Abstract Measurement confounding due to socioeconomic differences between world regions may bias the estimations of countries’ happiness and global inequality. Potential implications of this bias have not been researched. In this study, the consequential validity of the Happy Planet Index, 2012 as an indicator of global inequality is evaluated from the Rasch measurement perspective. Differential Item Functioning by world region and bias in the estimated magnitude of inequalities were analyzed. The recalculated measure showed a good fit to Rasch model assumptions. The original index underestimated relative inequalities between world regions by 20%. DIF had no effect on relative measures but affected absolute measures by overestimating world average happiness and underestimating its variance.
    [Show full text]
  • Medical Treatment Guidelines (MTG)
    Post-Traumatic Stress Disorder and Acute Stress Disorder Effective: November 1, 2021 Adapted by NYS Workers’ Compensation Board (“WCB”) from MDGuidelines® with permission of Reed Group, Ltd. (“ReedGroup”), which is not responsible for WCB’s modifications. MDGuidelines® are Copyright 2019 Reed Group, Ltd. All Rights Reserved. No part of this publication may be reproduced, displayed, disseminated, modified, or incorporated in any form without prior written permission from ReedGroup and WCB. Notwithstanding the foregoing, this publication may be viewed and printed solely for internal use as a reference, including to assist in compliance with WCL Sec. 13-0 and 12 NYCRR Part 44[0], provided that (i) users shall not sell or distribute, display, or otherwise provide such copies to others or otherwise commercially exploit the material. Commercial licenses, which provide access to the online text-searchable version of MDGuidelines®, are available from ReedGroup at www.mdguidelines.com. Contributors The NYS Workers’ Compensation Board would like to thank the members of the New York Workers’ Compensation Board Medical Advisory Committee (MAC). The MAC served as the Board’s advisory body to adapt the American College of Occupational and Environmental Medicine (ACOEM) Practice Guidelines to a New York version of the Medical Treatment Guidelines (MTG). In this capacity, the MAC provided valuable input and made recommendations to help guide the final version of these Guidelines. With full consensus reached on many topics, and a careful review of any dissenting opinions on others, the Board established the final product. New York State Workers’ Compensation Board Medical Advisory Committee Christopher A. Burke, MD , FAPM Attending Physician, Long Island Jewish Medical Center, Northwell Health Assistant Clinical Professor, Hofstra Medical School Joseph Canovas, Esq.
    [Show full text]
  • Conceptual Framework for Quantum Affective Computing and Its Use in Fusion of Multi-Robot Emotions
    electronics Article Conceptual Framework for Quantum Affective Computing and Its Use in Fusion of Multi-Robot Emotions Fei Yan 1 , Abdullah M. Iliyasu 2,3,∗ and Kaoru Hirota 3,4 1 School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China; [email protected] 2 College of Engineering, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia 3 School of Computing, Tokyo Institute of Technology, Yokohama 226-8502, Japan; [email protected] 4 School of Automation, Beijing Institute of Technology, Beijing 100081, China * Correspondence: [email protected] Abstract: This study presents a modest attempt to interpret, formulate, and manipulate the emotion of robots within the precepts of quantum mechanics. Our proposed framework encodes emotion information as a superposition state, whilst unitary operators are used to manipulate the transition of emotion states which are subsequently recovered via appropriate quantum measurement operations. The framework described provides essential steps towards exploiting the potency of quantum mechanics in a quantum affective computing paradigm. Further, the emotions of multi-robots in a specified communication scenario are fused using quantum entanglement, thereby reducing the number of qubits required to capture the emotion states of all the robots in the environment, and therefore fewer quantum gates are needed to transform the emotion of all or part of the robots from one state to another. In addition to the mathematical rigours expected of the proposed framework, we present a few simulation-based demonstrations to illustrate its feasibility and effectiveness. This exposition is an important step in the transition of formulations of emotional intelligence to the quantum era.
    [Show full text]
  • Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, VOL. 1, NO. 2, JULY-DECEMBER 2010 109 Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task Dongrui Wu, Member, IEEE, Christopher G. Courtney, Brent J. Lance, Member, IEEE, Shrikanth S. Narayanan, Fellow, IEEE, Michael E. Dawson, Kelvin S. Oie, and Thomas D. Parsons Abstract—A closed-loop system that offers real-time assessment and manipulation of a user’s affective and cognitive states is very useful in developing adaptive environments which respond in a rational and strategic fashion to real-time changes in user affect, cognition, and motivation. The goal is to progress the user from suboptimal cognitive and affective states toward an optimal state that enhances user performance. In order to achieve this, there is need for assessment of both 1) the optimal affective/cognitive state and 2) the observed user state. This paper presents approaches for assessing these two states. Arousal, an important dimension of affect, is focused upon because of its close relation to a user’s cognitive performance, as indicated by the Yerkes-Dodson Law. Herein, we make use of a Virtual Reality Stroop Task (VRST) from the Virtual Reality Cognitive Performance Assessment Test (VRCPAT) to identify the optimal arousal level that can serve as the affective/cognitive state goal. Three stimuli presentations (with distinct arousal levels) in the VRST are selected. We demonstrate that when reaction time is used as the performance measure, one of the three stimuli presentations can elicit the optimal level of arousal for most subjects. Further, results suggest that high classification rates can be achieved when a support vector machine is used to classify the psychophysiological responses (skin conductance level, respiration, ECG, and EEG) in these three stimuli presentations into three arousal levels.
    [Show full text]
  • A Fuzzy Modelling Approach of Emotion for Affective Computing Systems
    A Fuzzy Modelling Approach of Emotion for Affective Computing Systems Charalampos Karyotis1, Faiyaz Doctor1, Rahat Iqbal1, Anne James1 and Victor Chang2 1Faculty of Engineering, Environment and Computing, Coventry University, Priory Street, CV1 5FB, Coventry, U.K. 2School of Computing, Creative Technologies & Engineering, Leeds Beckett University, City Campus, Leeds, LS1 3HE, U.K. Keywords: Adaptive Fuzzy Systems, Emotion Modelling, Affective Trajectories, Arousal Valence, Affective Computing, Personalised Learning. Abstract: In this paper we present a novel affective modelling approach to be utilised by Affective Computing systems. This approach is a combination of the well known Arousal Valence model of emotion and the newly introduced Affective Trajectories Hypothesis. An adaptive data driven fuzzy method is proposed in order to extract personalized emotion models, and successfully visualise the associations of these models’ basic elements, to different emotional labels, using easily interpretable fuzzy rules. Namely we explore how the combinations of arousal, valence, prediction of the future, and the experienced outcome after this prediction, enable us to differentiate between different emotional labels. We use the results obtained from a user study consisting of an online survey, to demonstrate the potential applicability of this affective modelling approach, and test the effectiveness and stability of its adaptive element, which accounts for individual differences between the users. We also propose a basic architecture in order for this approach to be used effectively by AC systems, and finally we present an implementation of a personalised learning system which utilises the suggested framework. This implementation is tested through a pilot experimental session consisting of a tutorial on fuzzy logic which was conducted under an activity-led and problem based learning context.
    [Show full text]
  • A Dialogue on Racial Melancholia  David L
    Psychoanalytic Dialogues, 10(4):667–700, 2000 A Dialogue on Racial Melancholia David L. Eng, Ph.D. Shinhee Han, C.S.W. As Freud’s privileged theory of unresolved grief, melancholia presents a compelling framework to conceptualize registers of loss and depression attendant to both psychic and material processes of Asian American immigration, assimilation, and racialization. Freud initially formulates melancholia as a pathological form of individual mourning for lost objects, places, or ideals. However, we propose a concept of melancholia as a depathologized structure of everyday group experience for Asian Americans. We analyze a number of Asian American cultural productions (literature and film) as well as two case histories of university students involving intergenerational conflicts and lost ideals of whiteness, Asianness, home, and language. Exploring these analyses against Klein’s notions of lost objects, we propose a more refined theory of good and bad racialized objects. This theory raises the psychic and political difficulties of reinstatement and the mediation of the depressive position for Asian Americans. In addition, this theory suggests that processes of immigration, assimilation, and racialization are neither pathological nor permanent but involve the fluid negotiation between mourning and melancholia. Throughout this essay, we consider methods by which a more speculative approach to psychoanalytic theory and clinical practice might offer a deeper understanding of Asian American mental health issues. David L. Eng, Ph.D., is an Assistant Professor of English and Comparative Literature at Columbia University, where he is also an affiliate faculty member of the Asian American Studies Program. He is author of the forthcoming Racial Castration: Managing Masculinity in Asian America (Duke University Press) as well as the Coeditor (with Alice Y.
    [Show full text]