“Blissfully Happy” Or “Ready to Fight”: Varying Interpretations of Emoji
Total Page:16
File Type:pdf, Size:1020Kb
“Blissfully happy” or “ready to fight”: Varying Interpretations of Emoji Hannah Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac Johnson, Loren Terveen, Brent Hecht GroupLens Research, University of Minnesota Minneapolis, MN 55455, USA {hmiller, thebault, schang, ijohnson, terveen, bhecht}@cs.umn.edu Abstract Most commonly-used emoji are encoded in the Unicode 3 Emoji are commonly used in modern text communication. standard for indexing characters . There are currently 1,282 However, as graphics with nuanced details, emoji may be emoji in the Unicode standard, and for each of these, the open to interpretation. Emoji also render differently on dif- Unicode Consortium provides a code and name (e.g., ferent viewing platforms (e.g., Apple’s iPhone vs. Google’s U+1F600 for “grinning face”) but not the actual graphic. Nexus phone), potentially leading to communication errors. We explore whether emoji renderings or differences across This is the same as is the case for Unicode text characters: platforms give rise to diverse interpretations of emoji. for example, the Unicode character U+0041 indexes the Through an online survey, we solicit people’s interpreta- Latin capital letter ‘A’, but it does not indicate specifically tions of a sample of the most popular emoji characters, each how the ‘A’ should look. Instead, a font renders the rendered for multiple platforms. Both in terms of sentiment Unicode characters a particular way: the appearance of this and semantics, we analyze the variance in interpretation of the emoji, quantifying which emoji are most (and least) like- text that you are reading is dictated by the Times New ly to be misinterpreted. In cases in which participants rated Roman font. the same emoji rendering, they disagreed on whether the Similarly, individual platform vendors such as Apple sentiment was positive, neutral, or negative 25% of the time. and Google create their own rendering for each emoji When considering renderings across platforms, these disa- character they support. This means that the “Grinning greements only increase. Overall, we find significant poten- tial for miscommunication, both for individual emoji render- Face” emoji character has a different appearance when ings and for different emoji renderings across platforms. viewed on an Apple device (e.g., an iPhone) than on a Google device (e.g., a Nexus phone). This is just one ex- ample of two different platform renderings; there are many Introduction platforms that each have their own unique set of emoji ren- derings. Emojipedia—a website serving as an “encyclope- Emoji are “picture characters” or pictographs that are pop- 4 ular in text-based communication. They are commonly dia for emoji”—lists 17 such platforms , which means that used in smartphone texting, social media sharing (e.g., there may be at least 17 different renderings for a given nearly half of all text on Instagram contains emoji (Dimson Unicode emoji character. 2015)), advertising (e.g., Chevy’s press release written An emoji conveys its meaning through its graphic re- entirely in emoji #ChevyGoesEmoji1), and more. Oxford semblance to a physical object (e.g., a smiling face), but it Dictionaries declared the emoji or “face with tears of is not well understood how people interpret the meaning of joy” to be the 2015 “word of the year.” As this is the first emoji. Words have a dictionary definition, but emoji are time that they had selected an emoji, they noted that “emoji nuanced, visually-detailed graphics that may be more open have come to embody a core aspect of living in a digital to interpretation. Furthermore, since emoji render different- world that is visually driven, emotionally expressive, and ly on different platforms, the emoji graphic that is sent by obsessively immediate.”2 one person on one device may be quite different than what is seen by the recipient using a different device. Copyright © 2016, Association for the Advancement of Artificial Intelli- gence (www.aaai.org). All rights reserved. 1 http://www.chevrolet.com/crack-the-emoji-code.html 3 http://unicode.org/emoji/charts/full-emoji-list.html 2 http://time.com/4114886/oxford-word-of-the-year-2015-emoji/ 4 http://emojipedia.org/ We contextualize our analysis in Herbert Clark’s psy- 2001) such as :), have been in use in text-based communi- cholinguistic theory of language use (Clark 1996). In social cation since at least the early 1980s, with numerous studies psychology, a construal is the way that an individual inter- documenting their prevalence in SMS texts (Tossell et al. prets communication. That is, when a speaker communi- 2012), blogs (Huffaker and Calvert 2006), and, more re- cates something, the addressee interprets or construes what cently, Twitter (Park et al. 2013). Much research has fo- s/he believes the speaker to mean. When the addressee’s cused on the role that emoticons can play in complement- interpretation differs from what the speaker intended, a ing traditional text-based computer-mediated communica- misconstrual occurs. In the context of emoji, a speaker is tion (CMC). Notably, Walther and D’Addario (2001) sending emoji to an addressee through a mobile or desktop found that while the emotional valence of text (e.g., “I am platform. Likewise, the addressee is receiving the emoji via happy”) tends to be more important than any accompany- a mobile or desktop platform. In this exchange, miscon- ing emoticons with respect to interpretation, a negative strual can arise from differing interpretations derived from emoticon (e.g., :( “frowny face”) can significantly change either (1) the same rendering, if they each see the same the interpretation of the message. Lo (2008) provided addi- rendering or (2) different renderings, if they each see a tional evidence that emoticons affect interpretation, show- different rendering. ing that the same text can be perceived as either happy or We explore the potential for misconstrual when using sad depending on which emoticon accompanies it. Derks, emoji in communication by evaluating variation in emoji Fischer, and Bos (2008) concluded in a survey of emotion interpretation. Using an online survey, we solicit people’s in CMC that emoticons largely function as non-verbal cues interpretations of a sample of the most popular emoji do in face-to-face communication. Going beyond interpre- Unicode characters. In order to analyze how emoji inter- tation of individual messages, Liebman and Gergle (2016) pretations vary for renderings across platforms, the survey demonstrated that emoticons (along with punctuation) are included renderings of each emoji from five major mobile important in interpersonal relationship development over platforms: Apple, Google, Microsoft, Samsung, and LG. text-based communication. Together, this work emphasizes We identify the variance of interpretation in terms of sen- the importance of emoticons in text-based communication. timent (i.e., how positive is this emoji?) and semantics (i.e., what does this emoji mean?). The Rise of Emoji We find that only 4.5% of emoji symbols we examined Emoji were first created in the late 1990s in Japan but were have consistently low variance in their sentiment interpre- not officially added to the Unicode Standard until 2009 tations. Conversely, in 25% of the cases where participants (Davis and Edberg 2015). They have become quite popular rated the same rendering, they did not agree on whether the since then, with, for example, over 2% of tweets (Novak et sentiment was positive, neutral, or negative. When consid- al. 2015) and nearly half of text on Instagram (Dimson ering renderings across platforms, these disagreements 2015) containing emoji. Emoji are often described as a only increase. For U+1F601 (“grinning face with smiling successor to emoticons (e.g., Novak et al. 2015), and eyes” according to the Unicode Standard), participants Pavalanathan and Eisenstein (2016) found that while emot- described the Google rendering as “blissfully happy” icons are decreasing in popularity on Twitter, emoji are while the exact same Unicode character, but rendered for increasing in popularity and seem to be replacing, not Apple , was described as “ready to fight.” We conclude complementing, emoticons. that emoji usage may be ripe for misconstrued communica- While the large body of work on the role of emoticons in tion and provide implications for design to manage the text-based communication has largely not been replicated likelihood of misinterpretation when using emoji. for emoji, early work indicates that emoji do fulfill much the same role. Kelly and Watts (2015) interviewed a cul- Related Work turally diverse group of people and found that they did use emoji in text-based communication to convey and modify We begin this section with a discussion of the role of emot- the meaning and emotional valence of their words. icons (e.g., :-) or ‘smiley face’ – a precursor to emoji) in the interpretation of text-based communication and how Consistency of Emoticon and Emoji Interpretation emoji relate to emoticons. We then discuss what we know Whereas the display of emoji is platform-dependent, emot- about the consistency of interpretation for emoticons and icons, as text, are displayed relatively consistently. Walther emoji. and D’Addario (2001) found high agreement across their participants (226 mostly male students) around sentiment Emoticons interpretations of the three emoticons that they studied, :-) Emoticons, or “typographic symbols that appear sideways and :-( and ;-). In research on using emoticons in sentiment as resembling facial expressions,” (Walther and D’Addario analysis, Davidov, Tsur, and Rappoport (2010) found that when Amazon Mechanical Turk participants were present- Survey ed with tweets in which emoticons had been removed, they were able to identify with high precision the original emot- We created an online survey to solicit people’s interpreta- icon that had been in the tweet. tions of a sample of emoji Unicode characters, each ren- Less is known about the consistency of emoji interpreta- dered for multiple platforms.