Modern Psychological Studies
Volume 21 Number 1 Article 11
2015
Synesthesia and memory: an exploratory analysis
Caleb Robinson Ball State University
Follow this and additional works at: https://scholar.utc.edu/mps
Part of the Psychology Commons
Recommended Citation Robinson, Caleb (2015) "Synesthesia and memory: an exploratory analysis," Modern Psychological Studies: Vol. 21 : No. 1 , Article 11. Available at: https://scholar.utc.edu/mps/vol21/iss1/11
This articles is brought to you for free and open access by the Journals, Magazines, and Newsletters at UTC Scholar. It has been accepted for inclusion in Modern Psychological Studies by an authorized editor of UTC Scholar. For more information, please contact [email protected]. SYNESTHESIA AND MEMORY I ROBINSON
Synesthesia and Memory: An Exploratory Analysis Caleb Robinson Ball State University Few studies have measured how the memory of individuals with synesthesia, a perceptual phenomenon in which a stimulus triggers a separate sensory experience, is affected because of their novel perceptual experiences. The studies that have examined synesthesia and enhanced memory have been inconclusive, as some have found those with synesthesia exhibit superior memory capabilities, while other studies have not. This study sought to replicate previous studies that have found effects of color congruency. The participant M.P., a female with grapheme-color synesthesia, was given lists of words that were either congruent to her synesthetic experience, random colors, or words in black ink, then tested over her memory for the lists. Results were then compared to mean scores of a control group (n = 15). Results indicate a deviation from the hypothesis, as M.P. did not exhibit superior memory for congruent information, but rather a potentially enhanced ability to suppress color information.
Synesthesia has been described as a there is no reversed effect (Grossenbacher & condition in which one stimulus triggers an Lovelace, 2001). Once again using the above image or experience in a separate sensory example, the inducing stimulus of the furnace modality, such that a sound may not be just igniting may trigger a sensation of red colors, heard but also tasted, smelled, or even felt as a but seeing the same red shades may not trigger physical touch; the word literally meaning the sensation of a furnace igniting. "experiencing together" (Baron-Cohen, Wyke, Different kinds of synesthesia occur at & Binnie, 1987). Many forms of synesthesia different rates in the population. The have been documented, including colors experience of colors from letters, or grapheme- arising from written words, sounds eliciting a color synesthesia, has been shown to be the certain taste, or even the feeling of touch most frequent, occurring in 45-65% of those accompanying a smell (Cytowic & Eagleman, with synesthetic experiences (Radvansky, 2009). For example, if someone with sound- Gibson, & McNerney, 2011). While other color synesthesia heard the sound of a violin common forms of synesthesia include sound- playing, it may evoke the color green or the touch, vision-taste, and spatial-sequence sound of a furnace igniting may elicit a variety synesthesia, the most common inducer is of red shades. Someone with sequence- linguistic-based and the most common location synesthesia, a type of synesthesia in concurrent is color (Cytowic & Eagleman, which an individual perceives numbers or time 2009; Rouw & Sholte, 2007). units in specific spaces, may describe the In addition to the various forms of number 6 as slightly above them to the left. In synesthesia, there are a few core features literature, the common terminology for the apparent for those who experience this initial stimulus is an inducer and the separate neurological phenomenon. The two core sensory perception is termed the concurrent. In features most agreed upon in literature are that the example given above, the sound of a violin synesthetic experiences are automatic, playing would be described as the inducing occurring uncontrollably and not easily stimulus and the color green would be the suppressed by the perceiver, and that the concurrent. These sensory experiences are specific perceptual experiences are relatively most often unidirectional, as an inducer will consistent over time (Grossenbacher lead to the experience of the concurrent but Lovelace, 2001). In regards to the consistency MODERN PSYCHOLOGICAL STUDIES 79 SYNESTHESIA AND MEMORY I ROBINSON found in synesthesia, when those with of synesthesia has grown. Research has shown grapheme-color synesthesia were asked to map that there is a distinct familial pattern in out the colors they experience, they could synesthesia, (Barnett et al., 2008; Rothen, accurately choose the same color 92% of the Meier, & Ward, 2012) as 42% of synesthetes time upon retest one year later as compared to have a family member who also has some form non-synesthetes who were only consistent 38% of synesthesia. While this indicates that of the time (Baron-Cohen, Harrison, different forms of synesthesia are Goldstein, & Wyke, 1993). This reveals that fundamentally related at the genetic level, the those with synesthesia do not report color exact genotype involved is not well understood. experiences simply based off of loose criteria, What has emerged from recent research is such as the letter "W" appearing white because a greater understanding of the brain structures of the name of the color starting with that that may relate to the phenomena. The most letter, or the letter "A" appearing red based off common explanation of synesthesia is evidence of a relational context such as a red apple. of cross-wiring between area V4 of the visual Rather, these experiences are innate and do not cortex, which processes color perception have to be "remembered," instead experienced (Ramachandran, & Hubbard, 2001; Nunn et all over again when retested. al., 2002) and the fusiform gyms, which is The best example that can be used in associated with both color and word regards to the automaticity of these perceptual information (rancke, Beeli, Eulig, & Hanggi, experiences is with Stroop-like tasks. In this 2009; Rouw & Scholte, 2007). In the normal task, participants view the name of a color population, areas within the fusiform gyms printed in ink, such as the word blue printed in have been found to show activation when blue ink, and are asked to state the word individuals are presented the inducing presented. There is a certain level of stimulus, such as a word or letter. However, interference when the word presented is concurrent areas in the V4 color region are incompatible to the ink color, such as the same typically only activated by experiencing real word blue instead being presented in red ink. colors in normal individuals, but in those with Similarly, when those with synesthesia are synesthesia both regions show activation when asked to state the color of a grapheme that is only presented the inducing stimulus (Bargary, incongruent to their perception, they & Mitchell, 2008; Nunn et al. 2002). Cross- experience a similar level of interference activation between these regions is generally (Spector, & Maurer, 2009; Mills, Boteler, & unidirectional, and is stable in its associations Oliver, 1999). On the opposite side of this of specific inducers leading to activation in spectrum, when these same graphemes are areas correlated with the concurrent that presented congruently, or in colors matching follows (Bagary et al., 2008). Studies of event- their sensory experiences, they facilitate rather related potentials, a measurement of than interfere with their perception. Evidence electrophysiological brain activity, have also for this facilitating effect from color shown enhanced positive activation in more congruency can be traced to memory. anterior regions of the scalp at around 200 ms after the presentation of a given stimulus The Neuroanatomy of Synesthesia (Radavensky et al., 2011). Because this The study of neuroscience has advanced difference occurred later in processing than in significantly over the past few decades, thus a the first 100 ms, which is a peak more based greater understanding of the neural correlates solely on the physical parameters of a stimulus, this suggests a difference in perceptual MODERN PSYCHOLOGICAL STUDIES 80 SYNESTHESIA AND MEMORY ROBINSON processing rather than a difference in early superior memory (Rothen, & Meier, 2010; sensory processing. Yaro & Ward, 2007). Based on the reasoning for studying these individuals, they serve as The Effect of Synesthesia on Memory merely examples of individuals with superior Many case studies have revealed that there memory, thus presenting some issues of may be potential memory benefits of generalizability to the synesthetic population. synesthesia. The most famous of these was by Only a number of group studies have Luria (1968) and his groundbreaking book in sought to find generalizability and how which he studied S., or Solomon Shereshevsky. significant the potential memory benefits are S., who was described as having a memory that within synesthesia. In general, those with "had no distinct limit" and could be tested synesthesia do self-report having better flawlessly over a list of 50 matrices, even memory than non-synesthetes, (Yaro & Ward, remembering this list when tested again years 2007) but not all results have been as later. He reportedly had multiple different astounding as case reports have exhibited forms of synesthesia, and while one could posit (Rothen, Meier, & Ward, 2012). The results that this was linked to his distinct perception, found by Smilek et al. (2002) regarding color this theory can no longer be tested. One other congruency effects have been replicated in outstanding report is the case of C, a 21 year some cases using similar materials (Radvansky, old student researchers investigated because of Gibson, & Mcnerney, 2011) yet not replicated her memory capabilities (Smilek, Dixon, by others (Yaro & Ward, 2007; Rothen & Cudahy, & Merikle, 2002). The case of C Meier, 2010). Other studies have found differs from Luria's study in that the evidence of greater memory for tasks not synesthetic experiences that affect memory directly associated with synesthesia, which could be tested rather than theorized. C was suggests enhanced general memory benefits presented with three lists of matrices that were (Rothen et al, 2012). This research still either printed in congruent colors, (colors that indicates a need for more evidence of memory match her sensory experiences), incongruent benefits based off of color congruency. colors, (colors that did not match her sensory One may argue that an issue with these experiences) or black. As had been studies is a lack of consistent and effective hypothesized, C's memory performance for methodology. One important factor in the these matrices was superior to a control group study conducted by Smilek et al. on C was that of non-synesthetes when congruent or black, incongruent information drastically but when tested over incongruent colors C's diminished memory resources. This may performance was strikingly poorer than her suggest that the material used, specifically former performance and the performance of material that manipulates for color the control group. This presents more concrete congruency, is crucial to gathering consistent evidence that C's memory capabilities were findings. As stated above, some case studies likely enhanced by her synesthesia. have manipulated color congruency and found While these extraordinary cases exhibit results consistent with past findings. However, intriguing possibilities about the effects that other studies have utilized standard memory may come from synesthesia, they also exhibit tests (Rothen & Meier, 2010) without some clear issues. First, each of these cases manipulation of color congruency and have were approached not due to their synesthetic found more ordinary results. This suggests that experiences but rather based on their apparent the framework under which enhanced memory and synesthesia is explored requires some MODERN PSYCHOLOGICAL STUDIES 81 SYNESTHESIA AND MEMORY ROBINSON revision. Revisiting the use of a case study by M.P. and concretely verify her synesthetic design may prove to be useful in adapting the experiences. methodology in which these studies are M.P. reported that she had only recently conducted. It is of equal importance that the discovered what the phenomena was, thinking case study used within the study not be of it as a "funny little habit" and that she did approached due to their superior memory not know that it was a well-documented capabilities, as has been the case in other condition. She describes her synesthesia as not studies, and rather simply based on their novel overwhelming but rather quiet background perceptual experiences. Therefore, the subject noise that she has grown accustomed to in mind would be more similar to the general overtime. She does report that she cannot population of synesthetes and in turn provide handle too much noise, describing it as "a more generalizable results. sensory overload." Though she is not aware of any family members that also have synesthesia, Case Study she did report that ADHD runs in her family, The participant, M.P., is a twenty-two year which is a common correlate in those with old female with grapheme-color synesthesia. synesthesia. M.P. is a friend of the author, who in the past In regards to her color experience, she reported she had experienced something reports that words are experienced "inside my similar to synesthesia. To verify her head," rather than outside in the world. This synesthesia, a sensory map was completed. To type of synesthesia is described as a non- do this, M.P. described the color experience localizer— those that experience color out in she felt from each letter of the alphabet and the world are referred to as localizers; they are was encouraged to be as descriptive as she felt, also commonly referred to as "projectors" and such as the letter K which she described as "like "associators" (Cytowic & Eagleman, D. 2009). a grape. Imagine an oil painting of a bowl of M.P. also stated that, on occasion, she has a fruit. The K is the grapes." Following this, color experiences when hearing words spoken, three months later she was asked to repeat this and she believes this "depends on how strong process, in which 85% of her answers remained or bright the color is to me." She offered an consistent. (See Appendix D). As an additional example of when she recently received a mail test, on a separate occasion, an online battery key, and when she heard the word mail spoken was conducted in which each letter was she had an experience of the color pink (the presented to M.P. on three separate trials at color that she associates with the letter M.) random. She would then choose from a color This also relates to her description of how she spectrum the color that most closely resembled experiences words, rather than just letters. She her perceptual experience of the letter. After all stated that the first letter "definitely stands out three trials, the online battery reported her to me;" however, if she reads the letters consistency at 92%. (for more information on individually rather than reading the word as a this online battery, refer to Eagleman D., whole, she experiences each individual color Kagan A., Nelson S., Sagaram D., Sarma A. she associates with the letters. This detail was 2007). Given that answers in the range of 85- crucial when designing the memory task for 100% indicate an association between the M.P. and determining in which color the grapheme and colors, M.P. would qualify as words would be printed, as the perception of having synesthesia. These tests also helped to the first letter dominates the color of the whole avoid relying on merely a self-diagnosis given word.
MODERN PSYCHOLOGICAL STUDIES 82 SYNESTHESIA AND MEMORY ROBINSON
Finally, M.P. also reports that she believes effect, with higher reaction times for any she has "an excellent memory," which is in line incongruent set. It was also assumed they with Yaro and Ward's (2007) finding that would remember more details from memory those with synesthesia frequently self-report tasks with materials printed in any color of ink having above average memory. While she as compared to plain black ink. could not say for sure if it directly correlates with her synesthesia, she believed it may be Method helpful. Participants The study included one synesthetic Hypothesis participant, M.P., as well as fifteen non- The current study intended to replicate the synesthetic students from the Introduction to results of past research. It was expected that Psychology research pool at Ball State M.P.'s memory for items within a list of words University as a control group. These would be superior to the control group for participants were predominantly female, items that are congruent to her synesthetic Caucasian, and were all between the ages of experience as well as for items printed in black 18-22. Participants were given one research ink, and inferior for items that are presented credit for their participation, and were offered incongruently. It was also expected that an alternative assignment if they did not wish reaction times for the Stroop-task would be to participate in the study. faster for M.P. when printed in colors Materials congruent to her synesthetic experience but not matching the name of the color, and would be Stroop-task. First, a simple Stroop-like inferior to the control group when presented in recognition task was used. Lists of color names ink matching the name of the color but (red, green, blue, etc.) were created in three incongruent to her synesthesia. separate conditions. One list consisted of The Stroop task is used as a supplement to words in ink matching the name of the color the memory task, as it has been argued that (the word red = red ink), one list of words cognitive control and working memory are matching how the word is perceived functionally and anatomically interrelated synesthetically by M.P., based on the first (Soutschek, A., Strobach, T., & Schubert, T. letter of the word (red = green ink, the color 2013). The Stroop-task is a common test of she perceives for the letter r), and one list in ink cognitive control, and this additional testing that does not match either the name of the may lend to the results found from the memory color or MP's synesthetic experience for the task. For instance, an incongruent set of words word (red = yellow ink) (See Appendix A). may cause an additional strain cognitively, Colors used in this task were determined by the impeding working memory resources. It could online battery referenced previously that tested be argued that the Stroop-task is a strict test of M.P.'s consistency for color experiences (See cognitive control and the memory task utilized Appendix C). Participants were asked to state is both a test of cognitive control and working the colored word presented and were timed memory demands, thus both tests are useful over how long it took them to verbally towards analyzing this study's findings. complete the entirety of the list using a stop In regards to the control group, it was watch. The amount of time it took to read each assumed they would have a typical Stroop-