Text Complexity by Dr
Total Page:16
File Type:pdf, Size:1020Kb
Author Monographs Text Complexity By Dr. Timothy Shanahan University of Illinois at Chicago Member, National Reading Panel; President, International Reading Association, 2006 Chair, National Literacy Panel and National Early Literacy Panel It would be too costly and All texts are not equal. Some texts inconvenient to perform the above- are harder to read and comprehend. explained process for every text, of Just as there are individual differences course, so a second fundamental in children, there are individual premise of readability measurement differences in the texts that we ask is that the measure must specifically children to read. Some children summarize only text features or read better than others, and there characteristics, and not how easily are a variety of reasons for these read the text has been in the past. On differences in reading abilities. The the basis of this enumeration of text same is true of texts. Some texts are features, the formula has successfully easier or harder, and there are several predicted reader comprehension for reasons for these differences. texts. The purpose of this essay is to describe what factors Readability measures have evolved since they first cause texts to differ and to explore the relationship of appeared. Now, most readability formulas only measure text difficulty and children’s learning. two factors: word complexity and sentence complexity (Klare, 1984). Thus, measuring the readability or What makes text complex? complexity of a text involves an evaluation of the words: counting the average number of letters or syllables, Since the 1920s, there has been interest in measuring checking the frequency of the words (common words text difficulty or readability (Lively & Pressey, 1923). The are usually easier than rare words), or considering basic purpose of these measures has been to try to how abstract or concrete the words may be. Similarly, place texts along a continuum or scale, from easiest to average sentence or clause lengths, as well as other hardest. The most straightforward way to do this would measures of sentence or grammatical complexity, are be to have a group of people read the various texts and included. These word and sentence measures are then complete comprehension tests based on each one. The combined into mathematical formulas that are used to texts that most people understood would be rated as predict actual reading comprehension. If a formula does easy, and the ones that fewer people comprehended or well with some set of texts, then it is assumed that it that had fewer questions answered correctly would be will do equally well with other texts that have not been rated as more difficult. Readability estimates, however, actually tested with readers. are not quite this direct. Text Complexity Readability measures often try to express student beyond sentence complexity and vocabulary performance in terms of grade levels. (Measures that do sophistication—that are likely to influence reading not use grades usually provide some kind of conversion comprehension? One such factor is the complexity chart to show how to translate the readability score to of the ideas themselves. Some topics (rocket science, a grade level.) The idea is that the readability formula brain surgery, the infield fly rule), are more complicated, is revealing the reading level at which readers would sophisticated, or subtle than others. Also, ideas connect be able to understand the text. Thus, a fifth-grade text with each other across a text through a feature called would be readable or comprehensible to the average coherence. Readers have to interpret pronouns, fifth-grade reader. synonyms, and other connectors Early on, these formulas improved to make sense of a text. The greater our ability to predict text difficulty, Readability only the distance across ideas, the more but not by very much (they were measures the varied the connections, and the able to anticipate about 35 percent variations in the text; more competition for a link (if the pronoun “he” is mentioned, how of the variation in actual reading reader variations will comprehension performance). Over many male characters could be the years, readability measures present variability the topic of discussion?), the harder improved, and most of them are now that the readability the text will be. Text structure or able to explain about 50 to 60 percent measure cannot organization matters, too. Ideas can be arranged across text in many ways of the comprehension variance. One capture specifically. recent approach, the implementation (e.g., time sequence, causation, lists, of Lexiles, is able to explain about 90 comparison). How straightforward percent of reading comprehension the structure is will help to determine differences (Smith, 2012). how complicated the text will be to readers. Some texts may be more-or-less complete, including sufficient Why aren’t these measures able to do better than that? background information and context to help readers Why don’t they predict 100 percent of the variation to interpret the ideas; other, more difficult texts in reading performance? There are two basic reasons may require that readers bring a lot of this kind of for this. The first has to do with the nature of the information to the text. Finally, texts may use various measures of themselves. Remember, only word and literary devices (e.g., irony, repetition, metaphor) or data sentence difficulty are being considered. There are presentation tools (e.g., tables and charts), adding to the other text features that may impact complexity, but interpretive burden. these are not accounted for directly in these formulas. These measures do well because other unmeasured Another reason for the imperfect measurement of text features tend to be correlated with the word readability formulas has to do with what we are trying and sentence challenges which are measured in the to predict: reading comprehension. Readers differ formulas. Thus, texts that have simple words and in what they bring to a text in terms of background sentences will usually be about simpler concepts and knowledge, motivation, abilities to cope with ambiguity, will use simpler or more straightforward organizations. and so on. Even if two students have the same It is possible, however, that some of these other features “reading level,” they may perform differently with a will make a text either easier or harder for readers to particular text, which would reduce the accuracy of understand than predicted. Accuracy is important, but the text-level prediction. Reading comprehension will so is efficiency (adding other variables that are harder always be the product of two factors: the text and the to measure only improves accuracy a small bit, and reader. Readability only measures the variations in the these other features are much harder and more time- text; reader variations will present variability that the consuming to measure). readability measure cannot capture specifically. What are some of the other text complexity factors— Text Complexity Relationship of Text Complexity and reveal the student/text match that leads to the greatest Learning amount of learning. Readability formulas examine text complexity features Unfortunately, there have been few such studies, to predict reading comprehension. What connection and instructional practice has usually relied upon does text complexity have to learning to read? Scholars assertion rather than empirical evidence. The most have long claimed that the match of text difficulty and a influential claims have indicated that students needed reader’s ability to read will be an important determinant to be taught from texts they could read with 95 to of learning (Betts, 1946). 98 percent oral reading accuracy and with a reading comprehension of 75 to 89 percent (Betts, 1946). More The original idea of this reader/text match concept recent claims for optimum text complexity levels is that it is important to place students in texts that are based on minor adjustments to Betts’ original are not too easy (if the students can read a text easily assertions, even though we now know that Betts without help from a teacher or someone else, then made his numbers up without evaluating them against there would be little opportunity to learn from that student learning (Shanahan, 1983). text) or not too hard (if the students struggle too much to make sense of a text, there would be a lot to learn, The few studies that do exist (Morgan, Wilcox, & but they might be overwhelmed or frustrated, or the Eldredge, 2000) suggest that students do better—that teacher might find it difficult to provide sufficient is, learn more—with texts that are somewhat harder support to promote learning). than Betts claimed, and there is clear evidence that From this basic conception school texts have been getting easier and easier over a period came the idea that there are The most straightforward of about seventy years for independent, instructional, and approach to the problem frustration levels of performance. grades 3 to 12 (Chall, Conrad, Independent level refers to would be to test children in & Harris 1977; Hayes, Wolfer, texts that students can read terms of their ability to read & Wolfe, 1996). Past efforts to successfully without help; texts at particular readability place students in texts have striven to protect students from frustration level refers to those levels and then to randomly texts that are so hard for the confronting too much difficulty, students to comprehend that assign those children to and yet, such protections also it would be difficult for them reading instruction that place an important limitation on to learn; and instructional employed texts written at opportunities to learn. “Just as it’s impossible to build muscle level would be the optimum different levels. level that would provide an without weight or resistance, opportunity for learning, but it’s impossible to build robust without being too hard or too frustrating.