DOCSLIB.ORG

Emotion Detection and Sentiment Analysis of Images

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Emotion Detection and Sentiment Analysis of Images Emotion Detection and Sentiment Analysis of Images Vasavi Gajarla Aditi Gupta Georgia Institute of Technology Georgia Institute of Technology [email protected] [email protected] describe some of the most influential work that addresses Abstract this issue. If we search for a tag "love" on Flickr, we get a wide Visual Sentiment Prediction with Deep Convolutional variety of images: roses, a mother holding her baby, Neural Networks proposed by Xu et al. [2] use images with hearts, etc. These images are very different Convolutional Neural Networks pretrained on Object from one another and yet depict the same emotion of recognition data to perform sentiment analysis on images “love” in them. In this project, we explore the possibility collected from Twitter and Tumblr. Robust image of using deep learning to predict the emotion depicted by sentiment analysis using progressively trained and domain an image. Our results look promising and indicate that transferred deep networks by You et al. [3] uses VGG- neural nets are indeed capable of learning the emotion ImageNet and its architectural variations to study essayed by an image. These kinds of predictions can be sentiment analysis on Twitter and Flickr datasets. used in applications like automatic tag predictions for Recognizing image style by Karayev et al. [4] experiment images uploaded on social media websites and with handcrafted features like L*a*b color space features, understanding sentiment of people and their mood GIST and saliency features on Flickr style data, during/after an election. Wikipaintings and AVA Style data. Emotion based classification of natural images by Dellagiacoma et al. [5] 1 Introduction uses MPEG7 color and edge descriptors to perform emotion classification and compares the results with Bag Nowadays, people share a lot of content on social media in of Emotions method. the form of images - be it personal, or everyday scenes, or their opinions depicted in the form of cartoons or memes. 3 Our work Analyzing content like this from social media websites and/or photo-sharing websites like Flickr, Twitter, Tumblr, Firstly, we finalized the emotional categories to perform etc., can give insights into the general sentiment of people the classification on. We then collected data from Flickr about say Presidential elections. Also, it would be useful to for these categories. We experimented with various understand the emotion an image depicts to automatically classification methods on our data - SVM on high level predict emotional tags on them - like happiness, fear, etc. features of VGG-ImageNet, fine-tuning on pretrained models like RESNET, Places205-VGG16 and VGG- As a part of this project, we aim to predict the emotional ImageNet - more details follow in Section 4. category an image falls into from 5 categories - Love, Happiness, Violence, Fear, and Sadness. We do this by 3.1 Deciding Emotion Categories fine-tuning 3 different convolutional neural networks for We are inspired by the 6 emotion categories defined by the the tasks of emotion prediction and sentiment analysis. famous psychologist Ekman in [1] - Happiness, Sadness, Fear, Disgust, Anger and Surprise. These emotions are 2 Related Work used by several other papers in this domain ([5], [7]). There exists an affective gap in Emotion Semantic Image However instead of ‘Anger’ we chose ‘Violence’ as we Retrieval (ESIR) between low-level features and the feel it is more suited to the applications we are looking at - emotional content of an image reflecting a particular more and more people are turning to social media to show sentiment, similar to the well-known semantic gap. A lot of their support for causes or protest against something (For previous work tries to address this issue, using both example, a lot of social messages poured in after terrorist handcrafted features and neural networks. We briefly attacks in Paris in November, 2015). For the same reason, we add ‘Love’ as an emotion category. To limit ourselves 1 to 5 emotions we dropped ‘Disgust’ and ‘Surprise’. So our final emotion categories are: Love, Happiness, Violence, We obtained an accuracy of 32.9% on the test data. The Fear and Sadness. obtained confusion matrix is shown in Figure 1. 3.2 Data Collection 4.2 Fine-tuning VGG-ImageNet We collected data for the selected 5 emotional categories - The results obtained for the One vs All SVM classifier are Love, Happiness, Violence, Fear, and Sadness from Flickr. better than chance (20%) but still far from good. The following are the steps involved in collecting this data. Therefore, we experimented with fine-tuning the VGG- ImageNet model. We added a dropout layer followed by a Step 1: Querying the image metadata. fully connected layer and trained it on our dataset. We We used the Flickr’s API service to query for images using obtained a maximum testing accuracy of 38.4%. each of the emotional categories - Fear, Happiness, Love, Sad, and Violence - as search query parameters (along 4.3 Sentiment Analysis with the license flag set to ‘creative commons’) to collect The confusion matrix (Figure 1) indicates that there exists the image metadata (like server and farm ID numbers on more confusion within each of the positive (Love, which the image is stored) after sorting the result set by Happiness) and negative (Violence, Fear, Sadness) interestingness to make sure that images fitting to the emotions. To understand our results better, we perform emotional categories are retrieved on priority. sentiment analysis on our dataset. We obtain a testing Step 2: Downloading the images from Flickr server. accuracy of 67.8% which indicates that the network is Once the image metadata is retrieved, it was possible to learning to distinguish between the overall positive and use that metadata to directly access the images from Flickr negative categories, but is having trouble classifying servers instead of going through the Flickr API [8]. within each of the positive and negative sentiments. We suspect this is because the network is learning colors - For this project, we collected 9854 images in total with positive sentiments usually have bright colored images and ~1900 images in every category. We split the data in each negative sentiments correspond to dark images. category such that 75% of the data (~8850) is used for training, and 25% of the data (~1000) is used for testing. 4.4 Fine-tuning VGG-Places205 4 Experiments VGG-ImageNet is pretrained on ImageNet which consists mostly of iconic images. However, our dataset has both In this section we demonstrate all the experiments we iconic, as well as non-iconic images (for example, in conducted on our data. Violence category, many images contain protests which have a lot of people). Therefore, we experimented with 4.1 One vs All SVM fine-tuning a model pretrained on a scene-based database The idea is to use a pretrained neural network to get the called Places205. We hypothesize that this will work feature representation of our dataset and then use this better, since our task is closer to scene classification than representation as an input to SVM and classify the data object recognition or detection. We fine-tune the VGG using one vs all SVM classifiers. We used VGG-ImageNet model trained on the Places205 database. Using this [9] as the pretrained model. method, we obtain a testing accuracy of 40.9% on the emotion classification task and an accuracy of 68.7% on The following are the steps involved in this experiment: the sentiment analysis task. The network’s confusion Step 1: Pass the data (both train and test) as input to VGG- matrix can be seen in Figure 1. ImageNet model. Step 2: Store the activations from second-to-last fully 4.5 Fine-tuning ResNet-50 connected layer of the network as feature vectors. We also experiment with fine-tuning a pretrained ResNet- Step 3: Train a one vs all SVM classifier for each emotion 50. Because this network is very deep (has 50 layers), and category. is trained on both scene-centric data (MS COCO) as well Step 4: For each of the test image, find the maximum of as object-centric data (ImageNet), we expected it to give the scores from each SVM to get its predicted category better results. We did get better results with this approach - label. 40.9% of testing accuracy on emotion classification task 2 in other categories. The model seems to be learning Figure 1: ( row-wise starting from top left) Confusion matrix of emotion classification for One vs All SVM, Confusion matrix of emotion clasification and sentiment analysis for CGG-ImageNet, 205PlacesVGG-16 and ResNet-50 and an accuracy of 73% on sentiment analysis task. The posters, demonstration scenes, officers and text, ‘Je Suis confusion matrix of this network can be seen in Figure 1. Charlie’ in particular. It probably because of the labeling for this class is unambiguous. In all of the fine-tuning experiments, it has been observed Fear: The model seems to be learning dark, haunting that standard data augmentation techniques like mirroring images and spiders. and random cropping of images increase the accuracy. Sadness: This class has the maximum variation. The Having a higher learning rate for the later layers also model seems to be learning a lot of face images. yields a better accuracy. We used Stochastic Gradient Descent optimization for all the networks, and the base Table 2 shows some misclassified instances. These learning rate at a start value of 0.0001 gave better examples seemed to have been rightly classified (emotion- accuracies. wise) but fall under misclassifications with respect to the actual tagged label. For example, the first image in the row 5 Analysis of Results of fear is dark and dull, which we suspect has led the network to classify it as fear but it was actually tagged as In this section we examine the results of the ResNet-50 happiness.
Load more

Recommended publications
  • The Influence of Emotional States on Short-Term Memory Retention by Using Electroencephalography (EEG) Measurements: a Case Study
    The Influence of Emotional States on Short-term Memory Retention by using Electroencephalography (EEG) Measurements: A Case Study Ioana A. Badara1, Shobhitha Sarab2, Abhilash Medisetty2, Allen P. Cook1, Joyce Cook1 and Buket D. Barkana2 1School of Education, University of Bridgeport, 221 University Ave., Bridgeport, Connecticut, 06604, U.S.A. 2Department of Electrical Engineering, University of Bridgeport, 221 University Ave., Bridgeport, Connecticut, 06604, U.S.A. Keywords: Memory, Learning, Emotions, EEG, ERP, Neuroscience, Education. Abstract: This study explored how emotions can impact short-term memory retention, and thus the process of learning, by analyzing five mental tasks. EEG measurements were used to explore the effects of three emotional states (e.g., neutral, positive, and negative states) on memory retention. The ANT Neuro system with 625Hz sampling frequency was used for EEG recordings. A public-domain library with emotion-annotated images was used to evoke the three emotional states in study participants. EEG recordings were performed while each participant was asked to memorize a list of words and numbers, followed by exposure to images from the library corresponding to each of the three emotional states, and recall of the words and numbers from the list. The ASA software and EEGLab were utilized for the analysis of the data in five EEG bands, which were Alpha, Beta, Delta, Gamma, and Theta. The frequency of recalled event-related words and numbers after emotion arousal were found to be significantly different when compared to those following exposure to neutral emotions. The highest average energy for all tasks was observed in the Delta activity. Alpha, Beta, and Gamma activities were found to be slightly higher during the recall after positive emotion arousal.
    [Show full text]
  • Emotion Detection in Twitter Posts: a Rule-Based Algorithm for Annotated Data Acquisition
    2020 International Conference on Computational Science and Computational Intelligence (CSCI) Emotion detection in Twitter posts: a rule-based algorithm for annotated data acquisition Maria Krommyda Anastatios Rigos Institute of Communication and Computer Systems Institute of Communication and Computer Systems Athens, Greece Athens, Greece [email protected] [email protected] Kostas Bouklas Angelos Amditis Institute of Communication and Computer Systems Institute of Communication and Computer Systems Athens, Greece Athens, Greece [email protected] [email protected] Abstract—Social media analysis plays a key role to the person that provided the text and it is categorized as positive, understanding of the public’s opinion regarding recent events negative, or neutral. Such analysis is mainly used for movies, and decisions, to the design and management of advertising products and persons, when measuring their appeal to the campaigns as well as to the planning of next steps and mitigation actions for public relationship initiatives. Significant effort has public is of interest [4] and require extended quantities of text been dedicated recently to the development of data analysis collected over a long period of time from different sources to algorithms that will perform, in an automated way, sentiment ensure an unbiased and objective output. analysis over publicly available text. Most of the available While this technique is very popular and well established, research work, focuses on binary categorizing text as positive or with many important use cases and applications, there are negative without further investigating the emotions leading to that categorization. The current needs, however, for in-depth analysis other equally important use cases where such analysis fail to of the available content combined with the complexity and multi- provided the needed information.
    [Show full text]
  • About Emotions There Are 8 Primary Emotions. You Are Born with These
    About Emotions There are 8 primary emotions. You are born with these emotions wired into your brain. That wiring causes your body to react in certain ways and for you to have certain urges when the emotion arises. Here is a list of primary emotions: Eight Primary Emotions Anger: fury, outrage, wrath, irritability, hostility, resentment and violence. Sadness: grief, sorrow, gloom, melancholy, despair, loneliness, and depression. Fear: anxiety, apprehension, nervousness, dread, fright, and panic. Joy: enjoyment, happiness, relief, bliss, delight, pride, thrill, and ecstasy. Interest: acceptance, friendliness, trust, kindness, affection, love, and devotion. Surprise: shock, astonishment, amazement, astound, and wonder. Disgust: contempt, disdain, scorn, aversion, distaste, and revulsion. Shame: guilt, embarrassment, chagrin, remorse, regret, and contrition. All other emotions are made up by combining these basic 8 emotions. Sometimes we have secondary emotions, an emotional reaction to an emotion. We learn these. Some examples of these are: o Feeling shame when you get angry. o Feeling angry when you have a shame response (e.g., hurt feelings). o Feeling fear when you get angry (maybe you’ve been punished for anger). There are many more. These are NOT wired into our bodies and brains, but are learned from our families, our culture, and others. When you have a secondary emotion, the key is to figure out what the primary emotion, the feeling at the root of your reaction is, so that you can take an action that is most helpful. .
    [Show full text]
  • Zest and Work
    Journal of Organizational Behavior J. Organiz. Behav. 30, 161–172 (2009) Published online in Wiley InterScience (www.interscience.wiley.com) DOI: 10.1002/job.584 Zest and work CHRISTOPHER PETERSON1*, NANSOOK PARK2, NICHOLAS HALL3 AND MARTIN E.P.SELIGMAN 3 1University of Michigan, Michigan, U.S.A. 2University of Rhode Island, Rhode Island, U.S.A. 3University of Pennsylvania, Pennsylvania, U.S.A. Summary Zest is a positive trait reflecting a person’s approach to life with anticipation, energy, and excitement. In the present study, 9803 currently employed adult respondents to an Internet site completed measures of dispositional zest, orientation to work as a calling, and satisfaction with work and life in general. Across all occupations, zest predicted the stance that work was a calling (r ¼.39), as well as work satisfaction (r ¼.46) and general life satisfaction (r ¼.53). Zest deserves further attention from organizational scholars, especially how it can be encouraged in the workplace. Copyright # 2009 John Wiley & Sons, Ltd. Your work is to discover your work, and then with all of your heart to give yourself to it.—the Buddha Introduction Recent years have seen a widespread call for the study of work organizations in which people can be well and do well (Cameron, Dutton, & Quinn, 2003; Gardner, Csikszentmihalyi, & Damon, 2001; Luthans, 2003; Wright, 2003). The emergence of the positive perspective within organizational psychology has brought new attention to the venerable topic of work satisfaction (Hoppock, 1935). Satisfaction with the work that one does is seen not just as a contributor to good performance and increased profitability but as a worthy end in its own right (Heslin, 2005).
    [Show full text]
  • A Faithful Love Yields Enduring Happiness July 2018
    A faithful love yields enduring happiness July 2018 Married love is also faithful and exclusive of all other, and this until death. This is how husband and wife understood it on the day on which, fully aware of what they were doing, they freely vowed themselves to one another in marriage. Though this fidelity of husband and wife sometimes presents difficulties, no one has the right to assert that it is impossible; it is, on the contrary, always honorable and meritorious. The example of countless married couples proves not only that fidelity is in accord with the nature of marriage, but also that it is the source of profound and enduring happiness. (Humanae vitae no. 9) Reflection There tends to be a common view in the culture that freedom means doing anything one wants, anytime, with no restraints. Such a view makes it difficult to understand the vowed commitment to lifelong, faithful marriage. Bl. Pope Paul VI in Humanae vitae reminds the world that the Church offers a different view of freedom, a view that authentic freedom can only be found when it is ordered towards the truth. When we live our lives according to the truth, as with the example of a husband and wife living a life of faithfulness and fidelity to each other in marriage, we experience the “profound and enduring happiness” and authentic freedom our hearts are truly longing for. How have you experienced the fruits of living faithful love in your life? Are there areas God may be inviting you to grow in trust and faithfulness in your relationship with Him? Intercessory Prayer to Paul VI God our Father, Empower married couples to live the beautiful call to free, total, faithful, fruitful love in the vow they exchanged in holy matrimony.
    [Show full text]
  • Machine Learning Based Emotion Classification Using the Covid-19 Real World Worry Dataset
    Anatolian Journal of Computer Sciences Volume:6 No:1 2021 © Anatolian Science pp:24-31 ISSN:2548-1304 Machine Learning Based Emotion Classification Using The Covid-19 Real World Worry Dataset Hakan ÇAKAR1*, Abdulkadir ŞENGÜR2 *1Fırat Üniversitesi/Teknoloji Fak., Elektrik-Elektronik Müh. Bölümü, Elazığ, Türkiye ([email protected]) 2Fırat Üniversitesi/Teknoloji Fak., Elektrik-Elektronik Müh. Bölümü, Elazığ, Türkiye ([email protected]) Received Date : Sep. 27, 2020 Acceptance Date : Jan. 1, 2021 Published Date : Mar. 1, 2021 Özetçe— COVID-19 pandemic has a dramatic impact on economies and communities all around the world. With social distancing in place and various measures of lockdowns, it becomes significant to understand emotional responses on a great scale. In this paper, a study is presented that determines human emotions during COVID-19 using various machine learning (ML) approaches. To this end, various techniques such as Decision Trees (DT), Support Vector Machines (SVM), k-nearest neighbor (k-NN), Neural Networks (NN) and Naïve Bayes (NB) methods are used in determination of the human emotions. The mentioned techniques are used on a dataset namely Real World Worry dataset (RWWD) that was collected during COVID-19. The dataset, which covers eight emotions on a 9-point scale, grading their anxiety levels about the COVID-19 situation, was collected by using 2500 participants. The performance evaluation of the ML techniques on emotion prediction is carried out by using the accuracy score. Five-fold cross validation technique is also adopted in experiments. The experiment works show that the ML approaches are promising in determining the emotion in COVID- 19 RWWD.
    [Show full text]
  • Positive Psychology
    7 WAYS TO APPLY POSITIVE PSYCHOLOGY Learn practical, proven strategies to live a happier, more engaged and more meaningful life. We all want to live happier, more engaging and more meaningful lives. The science of positive psychology contributes new Introduction insights and proven strategies to increase wellbeing in individuals, workplaces and communities. After years classifying and repairing the worst of human experience, positive psychology emerged to help us flourish and learn from the best. This rich and varied field now spans many areas, building on philosophies and practices from Aristotle to Maslow. This eBook introduces you to some of the most practical and research-backed ways to apply positive psychology to increase happiness, wellbeing and effectiveness—in your life, at work, at home and with the people you care for, help and lead. You will learn: • How to maximise the power of positivity to create sustainable pathways to happiness and success. • Seven positive psychology practices - “[Positive Psychology is] the from optimism to mindfullness. scientific study of positive • Tips to apply these practices at work, at human functioning and home and when helping people. flourishing on multiple levels.” We look forward to inspiring you and others to live a Martin Seligman &Mihaly Csikszentmihalyi happier, more engaged and fulfilling life! The Langley Group team © 2015 Langley Group. All rights reserved 2 Positive psychology 7 POSITIVE PRACTICES Positive emotion 1 Generating positive emotions helps broaden and build our resources and moves us toward greater wellbeing. Spearheaded by Martin Seligman and Mindset Mihaly Csikszentmihalyi in 1998, positive 2 psychology focuses on exploring and Adopting a positive attitude and Growth Mindset enhances learning and opens our expanding what makes life worthwhile, mind to new ways to raise happiness levels.
    [Show full text]
  • Emotion Classification Based on Biophysical Signals and Machine Learning Techniques
    S S symmetry Article Emotion Classification Based on Biophysical Signals and Machine Learning Techniques Oana Bălan 1,* , Gabriela Moise 2 , Livia Petrescu 3 , Alin Moldoveanu 1 , Marius Leordeanu 1 and Florica Moldoveanu 1 1 Faculty of Automatic Control and Computers, University POLITEHNICA of Bucharest, Bucharest 060042, Romania; [email protected] (A.M.); [email protected] (M.L.); fl[email protected] (F.M.) 2 Department of Computer Science, Information Technology, Mathematics and Physics (ITIMF), Petroleum-Gas University of Ploiesti, Ploiesti 100680, Romania; [email protected] 3 Faculty of Biology, University of Bucharest, Bucharest 030014, Romania; [email protected] * Correspondence: [email protected]; Tel.: +40722276571 Received: 12 November 2019; Accepted: 18 December 2019; Published: 20 December 2019 Abstract: Emotions constitute an indispensable component of our everyday life. They consist of conscious mental reactions towards objects or situations and are associated with various physiological, behavioral, and cognitive changes. In this paper, we propose a comparative analysis between different machine learning and deep learning techniques, with and without feature selection, for binarily classifying the six basic emotions, namely anger, disgust, fear, joy, sadness, and surprise, into two symmetrical categorical classes (emotion and no emotion), using the physiological recordings and subjective ratings of valence, arousal, and dominance from the DEAP (Dataset for Emotion Analysis using EEG, Physiological and Video Signals) database. The results showed that the maximum classification accuracies for each emotion were: anger: 98.02%, joy:100%, surprise: 96%, disgust: 95%, fear: 90.75%, and sadness: 90.08%. In the case of four emotions (anger, disgust, fear, and sadness), the classification accuracies were higher without feature selection.
    [Show full text]
  • John F. Helliwell, Richard Layard and Jeffrey D. Sachs
    2018 John F. Helliwell, Richard Layard and Jeffrey D. Sachs Table of Contents World Happiness Report 2018 Editors: John F. Helliwell, Richard Layard, and Jeffrey D. Sachs Associate Editors: Jan-Emmanuel De Neve, Haifang Huang and Shun Wang 1 Happiness and Migration: An Overview . 3 John F. Helliwell, Richard Layard and Jeffrey D. Sachs 2 International Migration and World Happiness . 13 John F. Helliwell, Haifang Huang, Shun Wang and Hugh Shiplett 3 Do International Migrants Increase Their Happiness and That of Their Families by Migrating? . 45 Martijn Hendriks, Martijn J. Burger, Julie Ray and Neli Esipova 4 Rural-Urban Migration and Happiness in China . 67 John Knight and Ramani Gunatilaka 5 Happiness and International Migration in Latin America . 89 Carol Graham and Milena Nikolova 6 Happiness in Latin America Has Social Foundations . 115 Mariano Rojas 7 America’s Health Crisis and the Easterlin Paradox . 146 Jeffrey D. Sachs Annex: Migrant Acceptance Index: Do Migrants Have Better Lives in Countries That Accept Them? . 160 Neli Esipova, Julie Ray, John Fleming and Anita Pugliese The World Happiness Report was written by a group of independent experts acting in their personal capacities. Any views expressed in this report do not necessarily reflect the views of any organization, agency or programme of the United Nations. 2 Chapter 1 3 Happiness and Migration: An Overview John F. Helliwell, Vancouver School of Economics at the University of British Columbia, and Canadian Institute for Advanced Research Richard Layard, Wellbeing Programme, Centre for Economic Performance, at the London School of Economics and Political Science Jeffrey D. Sachs, Director, SDSN, and Director, Center for Sustainable Development, Columbia University The authors are grateful to the Ernesto Illy Foundation and the Canadian Institute for Advanced Research for research support, and to Gallup for data access and assistance.
    [Show full text]
  • DEAP: a Database for Emotion Analysis Using Physiological Signals
    IEEE TRANS. AFFECTIVE COMPUTING 1 DEAP: A Database for Emotion Analysis using Physiological Signals Sander Koelstra, Student Member, IEEE, Christian M¨uhl, Mohammad Soleymani, Student Member, IEEE, Jong-Seok Lee, Member, IEEE, Ashkan Yazdani, Touradj Ebrahimi, Member, IEEE, Thierry Pun, Member, IEEE, Anton Nijholt, Member, IEEE, Ioannis Patras, Member, IEEE Abstract—We present a multimodal dataset for the analysis of human affective states. The electroencephalogram (EEG) and peripheral physiological signals of 32 participants were recorded as each watched 40 one-minute long excerpts of music videos. Participants rated each video in terms of the levels of arousal, valence, like/dislike, dominance and familiarity. For 22 of the 32 participants, frontal face video was also recorded. A novel method for stimuli selection is proposed using retrieval by affective tags from the last.fm website, video highlight detection and an online assessment tool. An extensive analysis of the participants’ ratings during the experiment is presented. Correlates between the EEG signal frequencies and the participants’ ratings are investigated. Methods and results are presented for single-trial classification of arousal, valence and like/dislike ratings using the modalities of EEG, peripheral physiological signals and multimedia content analysis. Finally, decision fusion of the classification results from the different modalities is performed. The dataset is made publicly available and we encourage other researchers to use it for testing their own affective state estimation methods. Index Terms—Emotion classification, EEG, Physiological signals, Signal processing, Pattern classification, Affective computing. ✦ 1 INTRODUCTION information retrieval. Affective characteristics of multi- media are important features for describing multime- MOTION is a psycho-physiological process triggered dia content and can be presented by such emotional by conscious and/or unconscious perception of an E tags.
    [Show full text]
  • Emotion Classification Based on Brain Wave: a Survey
    Li et al. Hum. Cent. Comput. Inf. Sci. (2019) 9:42 https://doi.org/10.1186/s13673-019-0201-x REVIEW Open Access Emotion classifcation based on brain wave: a survey Ting‑Mei Li1, Han‑Chieh Chao1,2* and Jianming Zhang3 *Correspondence: [email protected] Abstract 1 Department of Electrical Brain wave emotion analysis is the most novel method of emotion analysis at present. Engineering, National Dong Hwa University, Hualien, With the progress of brain science, it is found that human emotions are produced by Taiwan the brain. As a result, many brain‑wave emotion related applications appear. However, Full list of author information the analysis of brain wave emotion improves the difculty of analysis because of the is available at the end of the article complexity of human emotion. Many researchers used diferent classifcation methods and proposed methods for the classifcation of brain wave emotions. In this paper, we investigate the existing methods of brain wave emotion classifcation and describe various classifcation methods. Keywords: EEG, Emotion, Classifcation Introduction Brain science has shown that human emotions are controlled by the brain [1]. Te brain produces brain waves as it transmits messages. Brain wave data is one of the biological messages, and biological messages usually have emotion features. Te feature of emo- tion can be extracted through the analysis of brain wave messages. But because of the environmental background and cultural diferences of human growth, the complexity of human emotion is caused. Terefore, in the analysis of brain wave emotion, classifcation algorithm is very important. In this article, we will focus on the classifcation of brain wave emotions.
    [Show full text]
  • What Is Compassion? How Can It Bring Happiness and Build Resilience? by Brandel France De Bravo
    What is compassion? How can it bring happiness and build resilience? By Brandel France de Bravo Compassion is one of those words that no one is entirely sure about. What is it, and how is it different from empathy, pity, or plain-old kindness? I wasn’t really able to answer those questions either until I took an eight-week meditation course developed at Stanford University called Compassion Cultivation Training (CCT™). Dr. Kelly McGonigal, who helped create the curriculum and trained me to become a CCT teacher, says that compassion “is actually a human strength that …evolved to help you meet stress in a way that is good for you and good for others.” As a certified CCT teacher, one of the exercises I like to begin with is this: think of a time when someone showed you compassion or you behaved compassionately towards someone. How did you know it was compassion and not some other emotion? And, how did it feel in your body? Can you recollect any physical sensations that arose during that experience? If asked to recall an experience of compassion, I think of the time I lost my child in a crowd. This has happened to many parents at some point. The difference was this was in Mexico, at night, in the state with the highest per capita rate of kidnapping. We were in a church yard watching hundreds participate in a beautiful silent, candle-lit procession when my six-year-old daughter’s hand slipped from her father’s. “Oh, yes, we saw a little girl being led away, crying that she didn’t want to leave,” one woman told my husband, our entire frantic search carried out in whispers.
    [Show full text]