CSCI 534: Affective Computing: an Interdisciplinary Approach

Home , Affective computing

CSCI 534: Affective Computing: An interdisciplinary approach

Lecture 1: 20 Jan, 2020 Prof Jonathan Gratch

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Outline

▪ What is affective computing?

▪ Is emotion a good thing? (for computers?)

– Review history of thinking on emotion

– Preview some applications

▪ Structure and Goals of Course

▪ Class projects and resources

▪ Will stay to talk after lecture

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch General comments

▪ Interdisciplinary focus – Emphasis on concepts, not code – You will learn more social science than you may think you need

▪ Project focus – You will work in teams on project to be presented at end of semester – Typically 4 students per team

▪ Interactive and Participatory Style – Turn on video: This course is all about affective signals – Please interrupt me. I prefer when people ask questions or disagree with what I’m saying – I will ask and expect you to participate – If you don’t understand, show me a sign…

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Note on participation in the Zoom era

▪ I frequently have in class experiments – look at some stimuli and vote for best answer or record face ▪ These recordings may play a role in homework

▪ Will explore new options because of zoom – e.g., Later today: send Quatrics link. Be prepared to enter your student ID. Then use zoom poll function

▪ Some experiments you have chance to make money – Need to figure out how to pay you. Gift card? Vemo? Send suggestions

▪ If you are taking this in Europe/Asia – Participate in “in class” polls while watching the lecture – I may figure out some other things

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Who are you?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Can, how (and should) machines have emotional intelligence?

And how does this change what it means to be human?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch What is it to be human?

Human Uniqueness

Haslam (2006)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 7 What is it to be human?

Human Uniqueness

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 8 What is it to be human?

Human Uniqueness

▪ Identity threats lead people to elevate alternative important traits ▪ What is one skill or attribute that, in your opinion, AI will likely never be able to achieve or replicate? ▪ Humans are better for entertainment, creative processes, storytelling, and having emotions. AI will never surpass the core characteristics of the human race ▪ Human emotion is probably the biggest obstacle that would be nearly impossible to program ▪ AI will never be able to replace the emotional part of humans.

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 9 What is it to be human?

Human Uniqueness

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 10 What is it to be human?

Human Uniqueness

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 11 Are we in an era of Emotion? (see optional reading)

▪ Across the sciences, there is growing interest in the

importance of human emotion

Budget % Budget Budget amount (USD) amount Budget

NIMH increase in funding on research on affect since 1985

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 12 Are we in an era of Emotion?

▪ Across the sciences, there is growing interest in the

importance of human emotion

% Publications % # Publications #

Growth of publications on affect

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 13 Are we in an era of Emotion?

▪ In the humanities, there is growing interest in the importance of human emotion

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 14 Are we in an era of Emotion?

▪ In Law, there is growing interests in emotion

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 15 Are we in an era of Emotion?

▪ And in industry

Amazon Rekognition Easily add intelligent image and video analysis to your applications

“The affective computing market was valued at US$6.9 billion in 2017 and is expected to grow at a CAGR of 42.63% to reach a market size of US$41 billion by the year 2022.”

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 16 AI just at dawn of an era of emotional intelligence

Regulating emotion Teaching emotion skills Manipulating emotion

Creative Arts

Student frustration Negotiation tactics Medical adherence

Computer artists Computer composers Computer chefs

Road rage Autism therapy Sales, service, marketing

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 17 And this is raising some concern

The AI Now Institute is an interdisciplinary research institute dedicated to understanding the social implications of AI technologies

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 18 Artificial intelligence good at generating emotion

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 19 ▪ “We are ourselves creating our own successors. Man will become to the machine what the horse and dog are to man.”

─ Samuel Butler, 1863

▪ “Men have become the tools of their tools”

─ Henry David Thoreau,1854

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch How will you feel when they achieve emotional intelligence?

You know, I can feel the fear that you carry around and I wish there was... something I could do to help you let go of it - Her (2013)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 21 What is “Affect”

▪ In the field of Affective Computing, “affect” refers to emotion and “related phenomena”: – Emotions (e.g., angry, sad, joyful, fearful) – Moods (e.g., cheerful, gloomy, irritable, listless, depressed, buoyant) – Interpersonal stances (e.g., distant, cold, warm, supportive) – Preferences/Attitudes/Sentiment (e.g., liking, loving, hating) – Personality (e.g., nervous, anxious, reckless, morose) – Culture (e.g., Individualistic vs. Collectivist; engineering vs. social sciences)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch What is “Affective Computing”?

An Interdisciplinary field of research

▪ Research and develop systems that recognize, interpret, stimulate and simulate human affect including: – How affect influences human-computer and human-robot interaction – How affective sensing informs machine-understanding of people – How to make computers more human-like – The ethics of “giving” machines emotional capabilities

▪ Covers but is not limited to the topics involving: – Sensing and analysis (i.e., recognition of facial expressions) – Psychology and behavior as they relate to affective computing – Behavior generation and user interaction

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Why mess up an intelligent machine by adding emotions?

▪ Affective computing presumes there is a benefit to giving computers “emotional intelligence”

”I have a gut, and my gut tells me more sometimes than anybody else’s brain can ever tell me.”

Typical view of AI Who do you want Typical human making decisions?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Would an “emotional” machine be better?

▪ Are emotions good for people?

▪ Very old (and ongoing) debate

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Theme: A war between emotion and reason

▪ Plato: The Allegory of the Chariot

▪ Moral Impulses lover of honor, modesty and temperance, Reason …follower of true glory; he needs no touch of the whip, but is guided by word and admonition only

Biological impulses crooked lumbering animal, … the mate of insolence and pride, shag-eared and deaf, hardly yielding to whip and spur.”

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Theme: A war between emotion and reason

▪ Freud Ego Develops to mediate between the id and the real world. The decision-making component of personality. Super ego Internalized moral compass. incorporates the values and morals of society which are learned from one's parents and others

Id Subconscious. Primitive instinctual component of personality

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Preview: Dual Process theories of emotion

Emotion (System 1) Cognition (System 2) • Parallel • Sequential • Associative • Rule-based • Intuitive • Rational

▪ Argues people have 2 modes of thinking – “Rational” – “Emotional”

▪ Often recommend contradictory decisions

▪ In course, we’ll talk about how technology can help one side or other “win the war”

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Preview: Dual Process theories of emotion

Emotion (System 1) Cognition (System 2) • Parallel • Sequential • Associative • Rule-based • Intuitive • Rational

Down-regulate emotion: Use emotion sensing to detect frustration and adjust teaching to avoid negative student emotions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Preview: Dual Process theories of emotion

Emotion (System 1) Cognition (System 2) • Parallel • Sequential • Associative • Rule-based • Intuitive • Rational

Up-regulate emotion

VR as an “Empathy Engine”

Idea: Encourage people to draw on emotions when making decisions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch If emotion a war, who should win?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit or curse? A very old debate

▪ Emotions long viewed as problematic

“He only employs his passion who can make no use of his reason” ― Cicero

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a curse

▪ Emotions long viewed as problematic

“He only employs his passion who can make no use of his reason” ― Cicero

“Passionate persons are like men that stand upon their heads; they see all things the wrong way ” ― Plato

“The passions are like those demons … Our only safety consists in keeping them asleep. If they wake, we are lost.” ― Goethe

“Our headstrong passions shut the door of our souls against God” ― Confucius

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: How could emotions make us stupid?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch In class experiment

Imagine you lead LA County Public Health You must decide between 2 plans to vaccinate a group of 60,000 high-risk people for COVID-19. Assume the exact scientific estimate of the consequences of the two programs are as follows:

Don’t think too hard about answer. Go with your first instinct

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch In class experiment

Program A: 20,000 survive =

Program B: 1/3 prob. 60,000 survive 1/3* 60,000 + 2/3 * 0 = 2/3 prob. no one survives 20,000 + 0 = 20,000

Based on Tversky and Kahneman’s 1981 Asian Disease Scenario

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch In class experiment

Program A: 20,000 survive Program C: 40,000 die

= =

Program B: 1/3 prob. 60,000 survive Program D: 1/3 prob. no one dies 2/3 prob. no one survives 2/3 prob. 60,000 die

Based on Tversky and Kahneman’s 1981 Asian Disease Scenario

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch In class experiment

Program A: 20,000 survive Program C: 40,000 die

Program B: 1/3 prob. 60,000 survive Program D: 1/3 prob. no one dies 2/3 prob. no one survives 2/3 prob. 60,000 die

83% of class chose Program A 65% of class chose program D

Based on Tversky and Kahneman’s 1981 Asian Disease Scenario

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Explanation (Why so many pick A?)

▪ A and B (C and D) have same expected utility ▪ People don’t decide using expected utility (only AI does) ▪ People imagine different outcomes and decide based on how these make us feel ▪ Certain/concrete outcomes evoke stronger feelings

– Expected outcome identical: 200 = 1/3 * 600

= =

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Explanation (Why A and C different?)

▪ People don’t calculate expected600 utility 200 People Saved ▪ We imagine different outcomes and decide based on how these total 400 make us feel Die ▪ Certain/concrete outcomes evoke stronger feelings

▪ These feelings sensitive to salient aspects of situation – “Framing effect”: people can focus on gains or losses

= =

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Preview: Emotion distorts reason

▪ Emotion shapes decision-making in ways that seem clearly irrational

▪ We can mathematically model this decision “bias”

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit?

▪ But emotion also argued to be indispensable for good decision making (and this view growing over time)

“The passions are the voice of the body” ― Rousseau

““Nothing ever becomes real 'til it is experienced.” ― Keats

“The passions are the winds which fill the sails of the vessel; they sink it at times, but without them it would be impossible to make way” ― Voltaire

“No one cares how much you know, until they know how much you care” ― Teddy Roosevelt

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Can emotions make us smart? Example

Task: Pick a poster to take home

• One group just grabbed one they feel good about • Other group asked to think carefully and write down their reasons for choosing

• Got to reconsider 6-months later

Wilson, T. D., Lisle, D., Schooler, J. W., Hodges, S. D., Klaaren, K. J., & LaFleur, S. J. (1993). Introspecting about reasons can reduce post-choice satisfaction. Personality and Social Psychology Bulletin, 19, 331–339.

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit: decision-theory perspective

“Reason is, and ought to be, only the slave of the passions” David Hume, 1711-1776

• Reason essential for accomplishing our goals • But without emotion, we wouldn’t have goals • Without passions we would lack all motivation, all impulse or drive to act, or even to reason • Emotion = Utility

The Ideal CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit: evolutionary perspective

▪ Emotions must be adaptive or they wouldn’t have evolved

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Darwin’s principles

▪ The principle of “serviceable habits” – Certain expressions confer evolutionary advantage – Surprise is useful “so the field of vision may be increased, and the eyeballs moved easily in any direction” p.281

– Some expressions may no longer be relevant for civilized man – Sneering in rage is a sign that our ancestors fought with our teeth whereas “civilized” humans do not

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Darwin’s principles

▪ The principle of antithesis – Some expressions of emotion look the way they do because they are the opposite of a “serviceable” expression

– Dogs “playful” expression evolved because this minimizes confusion with their signal of anger

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit: neuroscience perspective

Describes people brain damage to the ventromedial prefrontal cortex

▪ Intelligence intact (measured by standard IQ tests)

▪ But seem to lack emotion

Phineas Gage

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion a benefit: neuroscience perspective

Describes people brain damage to the ventromedial prefrontal cortex

▪ Intelligence intact (measured by standard IQ tests)

▪ But seem to lack emotion

These people seem incapable of making good decisions

Argues emotion indispensable for “real-world” decision-making

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotions and Artificial Intelligence

Early AI research discussed the importance of emotion

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotions and Artificial Intelligence

Psychologist Ulric Neisser argued that computers couldn’t capture human-level intelligence because they lacked bodies and emotion

Herb Simon (a founding-father of AI) responded that intelligent machines must have mechanisms akin to emotion "Motivational and emotional controls of cognition", Psychological Review, vol. 74, 1967

Other early AI researchers also emphasized importance of emotions for machines (Johnson-Laird; Minsky)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch But somehow, emotion was left aside

▪ Despite early interest in emotions, AI turned to focus on rational and dis-embodied cognition – Chess, not “Life” – Maybe emotion was too hard?

▪ Emphasized – Logic & Rationality over emotion – Non-social phenomena – Thinking over acting

▪ Ignored emotions ▪ Ignored the body ▪ But this starting to change

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emergence of Affective Computing: 1995

▪ Roz Picard introduced the term “Affective Computing” in 1995 – Her book with that title published in 1997

▪ Originally defined as – “computing that relates to, arises from, and deliberately influences emotion,”

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Today A vibrant community of practice

▪ Represented by a professional society

▪ International Conference (started in 2005)

▪ International Journal, impact factor 6.29 (AIJ impact 3.33)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Some typical recent research topics (from TAC)

▪ Emotion Recognition in: ▪ Games/Entertainment computing – Speech: – Responses to victory and defeat ▪ Emotion in natural speech – Affective music player ▪ Depression detection – Boredom detection – Text ▪ Modeling ▪ Opinions in twitter; blogs – Modeling emotional influences on decision- ▪ Emotocons making – Face – Modeling factors that elicit emotions ▪ Understanding impact of aging ▪ Recognizing expressions with thermal ▪ Applications – Physiology – Health – detection and shaping ▪ Inferring response to music via EEG – Games/entertainment – detection ▪ Detecting stress from skin conductance and shaping; synthesis/realism ▪ Synthesis – Education – detections; shaping – Emotional speech ▪ Behavioral science – Emotional facial expressions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Current thinking: Emotions good

▪ Emotions serve important functions, not just for humans but any intelligent entity

▪ Some of these functions missing from traditional AI/rational models – Thus, and analysis of the function emotions serves in people can improve artificial intelligences

▪ And, regardless of their function for machines, computers have to deal with emotional humans – Thus, they would benefit from recognizing and understanding these processes

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Although thinking may be shifting?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch So what is the function emotion?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: Emotion “in the wild”

Marsella & Gratch, Journal of Cognitive Systems Research 2009

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch What is function emotion?

▪ Physical: Shapes the body – Action preparation: energizes body, changes physical orientation

▪ Cognitive: Shapes the mind – Rapid, continually adjusting assessment of significant events – Interruption of behaviors and changing of goals

▪ Social: Shapes the minds of others – Signaling: broadcast information about mental state – Coordination: orient and coordinate group response

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion prepares the body for the circumstances that elicited the emotion

Surprise ▪ Orienting response:

– Opens eyes wider, allowing in more light to perceive information

– Mouth opens and breath taken, pulling more oxygen to the body

▪ Defensive response

– Eyes lower, defensive posture

– When angry, blood flows to the extremities: preparing for physical action

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion shifts cognition to a mode appropriate for the circumstances that elicited the emotion

▪ Emotions change perception & decision- making (e.g., Anger)

– Quicker to perceive threats (DeSteno et al 2000/2004)

– Underestimate risk (Lerner & Keltner 2000/2001) – Use quick/heuristic reasoning (Bodenhausen et al 1994) – Blame others/outgroups (Keltner et al 93; Mackie et al 00)

– Remember anger-evoking past events (Bower, 91)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Seeing emotions in others shapes our own cognition to prepares to interact with that person

▪ Emotions impact social interaction – Distress elicits helping (Eisenberg et al 89) – Anger elicits fear (Dimberg&Ohman96) – Negotiators concede more to angry partner (van Kleef et al. 2007) – Emotion communicates information to other social actors (Darwin; Parkinson01)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion is also information: Mind reading

Well, Guy Cuny is the editor of the technology website, news wireless...

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Emotion is also information: Mind reading

Well, Guy Cuny is the editor of the technology website, news wireless...

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Some practical applications of affective computing

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: Mental Health Facial expression synthesis Facial expression Automatic recognition contingent empathetic feedback

High-level understanding and decision- Estimate prevalence making Sentiment analysis of depression

Detect affect in Detect affect in Posture and speech posture & gesture gesture synthesis

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 68 David DeVault, Johnathan Mell and Jonathan Gratch. Toward Natural Turn-Taking in a Virtual Human Negotiation Agent. AAAI Spring Symposium on Turn-taking and Coordination in Human-Machine Interaction. 2015, AAAI Press: Stanford, CA. Example: Skills Training

Teach us to use and control our emotions in a negotiation

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Stratou, Hoegen, Lucas and Gratch. Emotional Signaling in a Social Dilemma: an Automatic Analysis. 6th International Conference on Affective Computing and Intelligent Interaction. Xi’an, China, 2015 Example: Psychology

Synchronized video

Personality

Task events

Automated Facial Expression

Understand how emotions shape social decisions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: Marketing

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: Tutoring systems (e.g., D’Mello)

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Hartholt, Gratch, Leuski, et al., At the Virtual Frontier: Introducing Gunslinger; a Multi-Character; Mixed-Reality; Story-Driven Experience. 9th International Conference on Intelligent Virtual Agents, Amsterdam. 2009 Example: Entertainment and Games

Understand how to make emotionally compelling interactions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Example: Entertainment and Games

• How would a machine know what to feel? • How should it display those expressions? • How should it change its decisions? • How does it sense our intentions and emotions? • How does it react to our touch? • Do we feel sad for it? • Does it matter if its organic or not? • Does it change how we treat other people?

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Summary of Course Goals

▪ Develop a basic understanding of emotion theory and findings from social sciences

▪ Understand functions of emotions in context of autonomous systems and human-machine interaction

▪ Understand state-of-art in affective computing techniques

▪ Understand methodological issues in collecting and analyzing data on human emotions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Grades

▪ 10% Class participation

▪ 40% Homework

▪ 50% Group Project

15% Mid-term project presentation 15% Final project presentation 20% Project writeup

TA: Su Lei; Office hours by appointment

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Syllabus

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Student projects

▪ Big focus of course on group project – Teams typically involve 4 students – Expect to finalize teams/tentative-project idea by Feb 22

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Student project examples

▪ Looked at 2 questions – Does felt emotion change tendency to lie? (predicted that induced anger would increase number of lies) – Can a machine detect a person is lying from facial expressions

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Student project examples

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Resources

▪ General Toolkits ▪ Virtual Human Toolkit: contains a number of sensing, language and synthesis tools. Allows one to construct interactive affectively-aware digital characters .

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 87 Resources Facial Expression Analysis

OpenFace High-quality freely-available facial action unit recognizer ▪ https://github.com/TadasBa ltrusaitis/OpenFace

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 88 Resources Voice Analysis

COVAREP Freely-available voice analysis toolkit ▪ http://covarep.github.io/covarep/

OpenEAR Another freely-available voice analysis tool ▪ https://sourceforge.net/projects/openart/

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 89 Resources Text Analysis

LIWC Calculates the degree to which people use different categories of words associated with emotion and other mental states ▪ http://liwc.wpengine.com/ Text Analysis, Crawling and Interpretation Tool Freely-available tool for classifying social media text ▪ http://tacit.usc.edu/index.html

Sentiment analysis tools Large collection of tools maintained by Rada Mihalcea ▪ https://web.eecs.umich.edu/~mihalcea/downloads.html BERT, word2vec, ….

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 90 Resources Text Analysis

Sentiment analysis tools Large collection of tools maintained by Rada Mihalcea ▪ https://web.eecs.umich.edu/~mihalcea/downloads.html

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 91 Resources

▪ Affect generation ▪ SmartBody – character animation system ▪ NVBG – Nonverbal Behavior Generation System

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 92 Resources Agent Architectures

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 93 Resources Experimental game environments

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 94 Resources

▪ Databases ▪ Face expressions ▪ Depression: DAIC-WOZ ▪ Rapport ▪ Economic games (Poker, Prisoner’s Dilemma, Negotiation) ▪ Twitter

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch 95 Final comment

▪ This class emphasizes Western thought on emotion

▪ But views of emotion differ by culture

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch Final comment

▪ This class emphasizes Western thought on emotion

▪ But views of emotion differ by culture

– No word for emotion in Sanskrit

– Strong dichotomy between emotion and cognition missing from Indian Philosophy

– Strong dichotomy between individual and social emotions missing from East Asian philosophy

CSCI 534(Affective Computing) – Lecture by Jonathan Gratch