Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP

Total Page:16

File Type:pdf, Size:1020Kb

Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP Anthony Chen∗ Pallavi Gudipati Shayne Longpre Xiao Ling Sameer Singh University of California, Irvine Apple fanthony.chen, [email protected] fpgudipati, slongpre, [email protected] Abstract Q: Which battle did Abe Lincoln fight in? Retrieval is a core component for open-domain A: World War II Wikipedia Documents Ranked by BLINK: NLP tasks. In open-domain tasks, multiple en- 1. Abraham Lincoln tities can share a name, making disambigua- 2. Abraham Lincoln in the Black Hawk War tion an inherent yet under-explored problem. 3. Abraham Lincoln (captain) We propose an evaluation benchmark for as- 4. Benjamin Lincoln 5. Lincoln Nebraska sessing the entity disambiguation capabilities 6. Lincoln England of these retrievers, which we call Ambiguous Entity Retrieval (AmbER) sets. We define an Q: What musical instrument does Abe Lincoln play? AmbER set as a collection of entities that share A: Trombone a name along with queries about those entities. Wikipedia Documents Ranked by BLINK: 1. Abraham Lincoln By covering the set of entities for polysemous 2. John Wilkes Booth names, AmbER sets act as a challenging test 3. Abe (musical) of entity disambiguation. We create AmbER 4. Nebraska sets for three popular open-domain tasks: fact 5. Lincoln Nebraska checking, slot filling, and question answering, 6. Abe Lincoln (musician) and evaluate a diverse set of retrievers. We find that the retrievers exhibit popularity bias, sig- Figure 1: Queries for two entities (president& mu- nificantly under-performing on rarer entities sician) with the name “Abe Lincoln”. Retrieving the that share a name, e.g., they are twice as likely gold document involves disambiguating which “Abe to retrieve erroneous documents on queries for Lincoln” each query is asking about. BLINK performs the less popular entity under the same name. sub-optimally on the second query, as it ranks the doc- These experiments on AmbER sets show their ument of the president over the gold document. utility as an evaluation tool and highlight the weaknesses of popular retrieval systems.1 Because success hinges on finding relevant docu- ments, open-domain progress has been closely tied 2 1 Introduction to improvements in retrieval systems (Lee et al., 2019; Karpukhin et al., 2020; Lewis et al., 2020b). Substantial progress in NLP has been made on A crucial challenge when interacting with a large “closed” tasks, where queries are paired with rele- knowledge source (e.g., Wikipedia) is entity ambi- vant documents (Rajpurkar et al., 2016; Dua et al., arXiv:2106.06830v1 [cs.CL] 12 Jun 2021 guity, the phenomenon where a single name can 2019). However, there is growing interest in “open- map to multiple entities. Resolving this ambiguity domain” tasks, where relevant documents need is referred to as entity disambiguation and is an to be retrieved from a knowledge source before important step for effective retrieval. For example, an NLP system can perform reasoning and pro- given the query “What musical instrument does duce an answer (Chen et al., 2017; Petroni et al., Abe Lincoln play?”, documents about the musician 2021). The open-domain setting better reflects should rank higher than other entities with the same real-world usage for tasks where relevant informa- name (Figure1). Although entity disambiguation tion is generally not provided (e.g., fact checking). has been extensively studied in entity linking (Hof- ∗Work started during an internship at Apple. fart et al., 2011; Rao et al., 2013; Sevgili et al., 1The AmbER sets used in this paper and the code to generate them are available at https://github.com/ 2For example, replacing the BM25 retriever with DPR on anthonywchen/AmbER-Sets. Natural Questions increases exact match by 15 points. 2020) and search (Balog et al., 2010, 2011), in the context of open-domain NLP, it is unclear how good retrieval systems are when faced with queries with ambiguous entities. Evaluating entity ambigu- ity is challenging because the popularity of entities follows a long-tail (Figure2) and rare entities are seldom covered in naturally-occurring datasets. In this paper we introduce AmbER sets, a bench- mark for evaluating the entity disambiguation ca- pabilities of retrievers across multiple NLP tasks. Each AmbER set is a collection of Wikidata entities that share a name, and their corresponding queries for specific NLP tasks. For each set, we define the Figure 2: The Long Tail of Entity Popularity: Graph head entity as the most popular entity and tail en- of the Wikipedia pageviews (in October 2019) for each tities as the less popular ones. By creating queries Wikidata entity, ranked by popularity. Gray are 100k for multiple entities that share a name, AmbER sets randomly sampled entities, while red/blue are entities with the name “Abe Lincoln”. provide an accurate test of entity disambiguation capabilities of retrievers and help assess the role first step in the open-domain pipeline. An inher- of entity popularity in disambiguation. We show ent problem in working with such sources is entity examples of AmbER sets for the question answer- disambiguation: resolving a name (mention) to ing task in Table1. We automatically create Am- an entity in the knowledge source. Entity disam- bER sets by mining the Wikidata knowledge graph biguation can be challenging because many entities (Vrandecic and Krotzsch¨ , 2014) for relevant names share a name, and the popularity of entities follows and entities, and leveraging task-specific templates a long-tail distribution (Figure2). Despite the im- to generate inputs for three tasks: fact checking, portance of entity disambiguation, it remains an slot filling, and question answering (Figure3). In understudied problem for open-domain NLP. We total, our AmbER sets contain 80k task-specific introduce AmbER sets for evaluating entity disam- queries which we align to the Wikipedia snapshot biguation capabilities of retrievers and analyze the from KILT (Petroni et al., 2021). role of entity popularity in disambiguation. We use AmbER sets to conduct a systematic study of various retrieval systems that operate un- 2.1 What is an AmbER Set? der different principles, such as token overlap and We first provide an intuition for an AmbER set be- dense embedding similarity. Retrievers perform fore concretely defining one. Consider two entities, very differently on AmbER sets in terms of ab- a president and a musician, both of which have the solute retrieval numbers, with Bootleg (Orr et al., name “Abe Lincoln” (Figure1). Now, consider 2020), an entity-linking-based retriever, perform- the query “Which battle did Abe Lincoln fight in?” ing best. Despite these differences, all retrievers and assume a retriever correctly returns the article exhibit a large degree of popularity bias, under- about the president for this query. Simply because performing on inputs concerning tail entities. TF- the correct document was retrieved does not mean IDF, a token-based retriever, performs about four a retriever has the ability to disambiguate between times worse on tail entity inputs compared to head the president and the musician, as the president is entity inputs. Even with Bootleg, the best perform- much more popular. We should only be confident ing retriever, performance on tail entities is still in its ability to disambiguate entities if we also 1.5 times lower than on head entities. Our results pose a query about the less popular musician and on AmbER sets demonstrate that there is signifi- the retriever again returns the correct document (as cant work to be done on making retrievers robust opposed to the document about the president). in handling entity disambiguation. Based on this intuition, we define an AmbER set 2 AmbER Sets as a collection of queries that satisfy the following: • Criteria 1: Polysemous Name: The queries in Retrieving relevant documents from large knowl- an AmbER set are all about entities that share a edge sources such as Wikipedia is an important common name (e.g., Abe Lincoln). QID Input Answer Gold Document Q517 What wars did Napoleon participate in? Napoleon Wars Napoleon Q3335909 What sport does Napoleon play? Rugby Napolioni Nalaga Q3335909 Which team does Napoleon play for? Fiji National Napolioni Nalaga AmbER-H Q117012 What movement did Yoko Ono participate in? Fluxus Yoko Ono Q16264827 Which sport does Yoko Ono participate in? Judo Yoko Ono (judoka) Q312 Which industry is Apple in? Electronics Apple Inc. Q532100 What is the record label of Apple? Page One Apple (band) Q7714007 Who acted in Apple? Ray Shell The Apple (1980 film) AmbER-N Q788822 Who is a cast member on Her? Steve Zissis Her (film) Q788822 Who is Her’s screenwriter? Spike Jonze Her (film) Q28441308 Who performed Her? Aaron Tippin Her (song) Table 1: Examples of QA AmbER sets. An AmbER set is a collection of entities that share a name, with instantiated queries for each entity. In this work, we use Wikidata to collect entities (QID). We also create queries for two more tasks, fact checking and slot filling (omitted from this table). • Criteria 2: Disparity in Popularity: An Am- Task Input Instance Output bER set contains queries about both the most FC John Mayer plays music. True popular entity for a name (the head entity), e.g., SF Nike [SEP] country USA the president, and the less popular entities (the QA Whose face is on $100 bill? Benjamin Franklin tail entities), e.g., the musician. Table 2: Examples for each open-domain NLP task. • Criteria 3: Resolvable Ambiguity: The con- tent of the query should be sufficient to resolve names and related entities before manually writing to the correct entity. The query “Which battle did queries for those entities. Instead, we present a Abe Lincoln fight in?” satisfies this criteria, be- pipeline for automatically creating AmbER sets us- cause there is only one Abe Lincoln that fought ing the Wikidata knowledge graph (Vrandecic and in a war, while “Where was Abe Lincoln born?” Krotzsch¨ , 2014).
Recommended publications
  • The Rhetoric of Abraham Lincoln's Gettysburg Address
    1 The Rhetoric of Abraham Lincoln’s Gettysburg Address: Why It Works the Way It Works George D. Gopen Professor Emeritus of the Practice of Rhetoric Duke University Copyright, 2019: George D. Gopen 2 The Rhetoric of Abraham Lincoln’s Gettysburg Address: Why It Works the Way It Works The Gettysburg Address Fourscore and seven years ago our fathers brought forth on this continent a new nation, conceived in liberty and dedicated to the proposition that all men are created equal. Now we are engaged in a great civil war, testing whether that nation or any nation so conceived and so dedicated can long endure. We are met on a great battlefield of that war. We have come to dedicate a portion of that field as a final resting-place for those who here gave their lives that that nation might live. It is altogether fitting and proper that we should do this. But in a larger sense, we cannot dedicate, we cannot consecrate, we cannot hallow this ground. The brave men, living and dead who struggled here have consecrated it far above our poor power to add or detract. The world will little note nor long remember what we say here, but it can never forget what they did here. It is for us the living rather to be dedicated here to the unfinished work which they who fought here have thus far so nobly advanced. It is rather for us to be here dedicated to the great task remaining before us--that from these honored dead we take increased devotion to that cause for which they gave the last full measure of devotion--that we here highly resolve that these dead shall not have died in vain, that this nation under God shall have a new birth of freedom, and that government of the people, by the people, for the people shall not perish from the earth.
    [Show full text]
  • Abraham Lincolm Was Born On
    Abraham Lincoln and Marshall, IL By Brian Burger, Andy Sweitzer, David Tingley Abraham Lincoln was born on Feb. 12, 1809 in Hodgenville, Kentucky. Abraham's parents were Nancy Hanks and Thomas Lincoln. At the age of two he was taken by his parents to nearby Knob Creek and at eight to Spencer County, Indiana. The following year his mother died. In 1819, his father married Sarah Bush Johnston. In 1831, after moving with his family to Macon County, Illinois, he struck out on his own, taking cargo on a flatboat to New Orleans, Louisiana. He then returned to Illinois and settled in New Salem where he split rails and clerked in a store. In 1833, he was appointed postmaster but had to supplement his income with surveying and various other jobs. At the same time he began to study law. In 1832, Lincoln ran for state legislature. He was defeated, but he won two years later and served in the Lower House from 1834 to 1841. He quickly emerged as a leader of the Whig Party and was involved in the moving of the capital to Springfield. In 1836, Lincoln was admitted to the bar. He then entered successful partnerships with John T. Stuart, Stephen T. Logan, and William Herndon. Based on this success, Lincoln soon won recognition as an effective and resourceful attorney. Even though Lincoln was born in Kentucky, a slave state, he had long opposed slavery. In the state legislature, he had voted against the "peculiar institution" and in 1837 was one of only two members to protest it.
    [Show full text]
  • Lincoln's New Salem, Reconstructed
    Lincoln’s New Salem, Reconstructed MARK B. POHLAD “Not a building, scarcely a stone” In his classic Lincoln’s New Salem (1934), Benjamin P. Thomas observed bluntly, “By 1840 New Salem had ceased to exist.”1 A century later, however, a restored New Salem was—after the Lincoln Memorial, in Washington, D.C.—the most visited Lincoln site in the world. How this transformation occurred is a fascinating story, one that should be retold, especially now, when action must be taken to rescue the present New Salem from a grave decline. Even apart from its connection to Abraham Lincoln, New Salem is like no other reconstructed pioneer village that exists today. Years before the present restoration occurred, planners aimed for a unique destination. A 1920s state-of- Illinois brochure claimed that once the twenty- five original structures were rebuilt on their original founda- tions, it would be “the only known city in the world that has ever been restored in its entirety.”2 In truth, it is today the world’s largest log- house village reconstructed on its original site and on its build- ings’ original foundations. It is still startling nearly two hundred years later that a town of more than a hundred souls—about the same number as lived in Chicago at that time—existed for only a decade. But such was the velocity of development in the American West. “Petersburg . took the wind out of its sails,” a newspaperman quipped in 1884, because a new county seat and post office had been established there; Lincoln himself had surveyed it.3 Now the very buildings of his New Salem friends and 1.
    [Show full text]
  • Four Roads to Emancipation: Lincoln, the Law, and the Proclamation Dr
    Copyright © 2013 by the National Trust for Historic Preservation i Table of Contents Letter from Erin Carlson Mast, Executive Director, President Lincoln’s Cottage Letter from Martin R. Castro, Chairman of The United States Commission on Civil Rights About President Lincoln’s Cottage, The National Trust for Historic Preservation, and The United States Commission on Civil Rights Author Biographies Acknowledgements 1. A Good Sleep or a Bad Nightmare: Tossing and Turning Over the Memory of Emancipation Dr. David Blight……….…………………………………………………………….….1 2. Abraham Lincoln: Reluctant Emancipator? Dr. Michael Burlingame……………………………………………………………….…9 3. The Lessons of Emancipation in the Fight Against Modern Slavery Ambassador Luis CdeBaca………………………………….…………………………...15 4. Views of Emancipation through the Eyes of the Enslaved Dr. Spencer Crew…………………………………………….………………………..19 5. Lincoln’s “Paramount Object” Dr. Joseph R. Fornieri……………………….…………………..……………………..25 6. Four Roads to Emancipation: Lincoln, the Law, and the Proclamation Dr. Allen Carl Guelzo……………..……………………………….…………………..31 7. Emancipation and its Complex Legacy as the Work of Many Hands Dr. Chandra Manning…………………………………………………..……………...41 8. The Emancipation Proclamation at 150 Dr. Edna Greene Medford………………………………….……….…….……………48 9. Lincoln, Emancipation, and the New Birth of Freedom: On Remaining a Constitutional People Dr. Lucas E. Morel…………………………….…………………….……….………..53 10. Emancipation Moments Dr. Matthew Pinsker………………….……………………………….………….……59 11. “Knock[ing] the Bottom Out of Slavery” and Desegregation:
    [Show full text]
  • Bulletin 86 - the Lincoln-Douglas Debate S
    Eastern Illinois University The Keep Eastern Illinois University Bulletin University Publications 10-1-1924 Bulletin 86 - The Lincoln-Douglas Debate S. E. Thomas Eastern Illinois University Follow this and additional works at: http://thekeep.eiu.edu/eiu_bulletin Recommended Citation Thomas, S. E., "Bulletin 86 - The Lincoln-Douglas Debate" (1924). Eastern Illinois University Bulletin. 183. http://thekeep.eiu.edu/eiu_bulletin/183 This Article is brought to you for free and open access by the University Publications at The Keep. It has been accepted for inclusion in Eastern Illinois University Bulletin by an authorized administrator of The Keep. For more information, please contact [email protected]. , liBRARY : ~TERN ILLINOIS STAtE CO~ CHARLESTON, ILLINOI$ ; ,' JB The EXH Teachers College Bulletin Number 86 October 1, 1924 Eastern Illinois State Teachers College ~ -AT- CHARLESTON Lincoln-Douglas Debate A narrative and descriptive account of the events of the day of the debate in Charleston -By- S. E. THOMAS PROFESSOR OF HISTORY, EASTERN ILLINOIS STATE TEACHERS COLLEGE PUBLISHERS EXHIBIT _ The Teachers College Bulletin Published Quarterly by the Eastern Illinois State Teachers College at Charleston Entered March 5, 1902, as second-class matter, at the post office at Charles­ ton, Illinois. Act of Congress, July 16, 1894. No. 86 CHARLESTON, ILLINOIS October 1, 1924 Lincoln-Douglas Debate The fourth joint debate between Abraham Lincoln and Stephen A. Douglas, held in Charleston, Coles County, Ill­ inois, on September the eight- eenth, eighteen hundred and fifty-eight A narrative and descriptive account of the events of the day of the debate in Charleston -By- S. E. THOMAS PROFESSOR OF HISTORY, EASTERN ILLINOIS STATE TEACHERS COLLEGE [Printe d by authority of the State of Illinois] (59521-2M-11-26) ~2 FOREWORD This paper was read at the semi-centennial celebration of the Lincoln­ Dcuglas Detate in Charleston, Illinois, September 18, 1908.
    [Show full text]
  • CONSUMING LINCOLN: ABRAHAM LINCOLN's WESTERN MANHOOD in the URBAN NORTHEAST, 1848-1861 a Dissertation Submitted to the Kent S
    CONSUMING LINCOLN: ABRAHAM LINCOLN’S WESTERN MANHOOD IN THE URBAN NORTHEAST, 1848-1861 A dissertation submitted to the Kent State University College of Arts and Sciences in partial fulfillment of the requirements for the degree of Doctor of Philosophy By David Demaree August 2018 © Copyright All right reserved Except for previously published materials A dissertation written by David Demaree B.A., Geneva College, 2008 M.A., Indiana University of Pennsylvania, 2012 Ph.D., Kent State University, 2018 Approved by ____________________________, Chair, Doctoral Dissertation Committee Kevin Adams, Ph.D. ____________________________, Members, Doctoral Dissertation Committee Elaine Frantz, Ph.D. ____________________________, Lesley J. Gordon, Ph.D. ____________________________, Sara Hume, Ph.D. ____________________________ Robert W. Trogdon, Ph.D. Accepted by ____________________________, Chair, Department of History Brian M. Hayashi, Ph.D. ____________________________, Dean, College of Arts and Sciences James L. Blank, Ph.D. TABLE OF CONTENTS TABLE OF CONTENTS ..............................................................................................................iii LIST OF FIGURES ...................................................................................................................... iv ACKNOWLEDGMENTS...............................................................................................................v INTRODUCTION ..........................................................................................................................1
    [Show full text]
  • Lincoln S New Salem State Historic Site Invites You & Your Family to The
    Lincoln’s New Salem State Historic Site Welcomes You Lincoln s New Salem State Historic Site invites you & your family to the Reunion of Direct Descendants of the New Salem Community Saturday, July 8, 2006 Lincoln’s New Salem State Historic Site Petersburg, Illinois The 2006 Lincoln’s Landing events celebrate the 175th anniversary of Abraham Lincoln’s arrival at New Salem July 8, 2006, is the Reunion of Direct Descendants of New Salem. Direct descendants will be recognized as special guests of New Salem and the Illinois Historical Preservation Agency. Descendants, relatives, friends, and visitors are invited to enjoy many special activities. Some descendant families have scheduled reunions in the area this weekend, and many participants are coming great distances to attend. We are happy to welcome everyone to New Salem. Please check in with us at the Descendant’s Registration Desk at the Visitors Center. Enjoy meeting new relatives and sharing your family history with family, friends, and the site. The contact for this event is Event Chair Barbara Archer, who may be reached at 217- 546-4809 or [email protected] for further information and details. To reach New Salem from Springfield, follow Route 125 (Jefferson Street) to Route 97 (about 12 miles west), turn right at the brown New Salem sign; travel 12 miles to the site entrance. From Chicago, exit Interstate 55 at the Williamsville Exit 109 and follow the signs or take the Springfield Clear Lake Exit 98; Clear Lake becomes Route 125. From St. Louis, take 55 Exit 92 to Route 72 west; exit 72 at Route 4/Veterans Parkway Exit 93; take Veterans Parkway north to Route 125; turn left.
    [Show full text]
  • Abraham Lincoln Final by William
    Abraham Lincoln: “Didn’t Want Slavery” By William Martinez Lones Abraham Lincoln 16th President of the U.S.A. Born:February 12,1809 in Hodgeville, Kentucky Died:April 14,1865 Age:56 Vocab Box: Background Humble → simple or not fancy Chores → work around the house Politics → Activity or power of government Abraham Lincoln was born in Hodgeville, Kentucky, Legislature → the branch of government that writes laws February 12, 1809. His family was poor. They lived in a Term → a length of time in office humble house and the shelter was made out of wood until Abolish → to ban they built a cabin. Abe’s chores were to fish, put traps for rabbits and muskrats and follow bees to the honey tree to get honey. Abe’s parents couldn’t read or write. But Abe studied law, politics, and history when he had time. His first election was as a legislator for the Illinois state legislature. He lost the election but decided to do it again. After he had a lot of jobs in government. He became a member of the Congress and lost his second term because he wanted to abolish slavery. In 1860, he ran for president and lost every Southern state, but he won The Lincolns lived in a cabin like this the election. one. The Civil War and Ending Slavery After Abe became president, the seven Vocab Box: Amendment → a change to the law southern states left the U.S., becoming Emancipation → freedom Confederate States of America (they wanted to Proclamation → when you make a statement keep slavery).
    [Show full text]
  • Homes of Lincoln
    Homes of Lincoln Overview: Students will learn about the homes of Lincoln and how these homes shaped Lincoln to become who he was. Materials: ° Lincoln Homes Graphic Organizer ° Lincoln Homes Background Sheets Citation: ° Abraham Lincoln Birthplace: http://www.nps.gov/abli/index.htm ° Lincoln’s Boyhood National Memorial: http://www.nps.gov/LIBO/index.htm ° Lincoln’s Springfield Home: http://www.nps.gov/liho/the-lincoln-home.htm ° Mr. Lincoln’s White House: http://www.mrlincolnswhitehouse.org/inside.asp?ID=3&subjectID=3 ° President Lincoln’s Cottage: http://www.lincolncottage.org/about/lincoln.htm DC Skills (Grades 6-8): Chronology and Historical Interpretation: 1. Students explain how major events are related to one another in time. 4. Students understand and distinguish cause, effect, sequence, and correlation in historical events, including the short-term causes or sparks from long-term causes. Essential Questions: ° How does a person’s environment and experiences shape who them become? ° What can we learn about Abraham Lincoln from his life experiences growing up and growing older? ° How did Lincoln’s life experiences shape him as a president? Background Information: Lincoln lived in four locations in his life. He was born in Kentucky, moved to Indiana as a young boy and spent his teenage years there, and moved to Springfield as a young professional, living there with his family until he was elected president. As a president he resided in the White House and traveled to his summer cottage in the warmer DC months. Each of his homes provided him with different experiences and gave him different skill sets which served him well as president.
    [Show full text]
  • Re-Enactment of Abraham Lincoln's 1858 Political Rally and Speech in Lincoln, Illinois: His First Namesake City
    The Re-Enactment of Abraham Lincoln's 1858 Political Rally and Speech in Lincoln, Illinois: His First Namesake City By Darold Leigh Henson, Ph.D. [email protected] Tim Searby (left) Sings Campaign Song "Uncle Abe" as Dignitaries Clap Along Photo by D. Leigh Henson (Others left to right: Professor Ron Keller as Samuel C. Parks, Roger Matson as John Dean Gillett, Sean Leonard as Abraham Lincoln, and Professor Brian Messner as Judge David Davis) The Abraham Lincoln Bicentennial Commission of Lincoln, Illinois, produced this re‐enactment on October 16, 2008, the sesquicentennial anniversary of the original, which took place the day after the last Lincoln‐Douglas debate in Alton. The re‐enactment was this commissionʹs primary celebration of the Lincoln Bicentennial and was endorsed by the Illinois Abraham Lincoln Bicentennial Commission and the national Abraham Lincoln Bicentennial Commission. Ron Keller served on all three commissions, and was co‐chairperson of the cityʹs Lincoln Bicentennial Commission. Re-Enactment of Mr. Lincoln's 1858 Namesake City Rally-Speech 2 Re-Enactment of Mr. Lincoln's 1858 Namesake City Rally-Speech 3 Proposal Published in the Lincoln Courier, 11-17-07, to Erect Historical Marker for Mr. Lincoln's 1858 Rally-Speech Set the Stage for the Re-Enactment Proposal Note that the headline indicates the Courierʹs editorial endorsement of this project. Re-Enactment of Mr. Lincoln's 1858 Namesake City Rally-Speech 4 Rally-Speech Re-Enactment Proposal Published in the Lincoln Courier, 12-5-07 Note that the Courier does not give this bolder, more provocative proposal an editorial endorsement, but clearly identifies it as the writerʹs opinion.
    [Show full text]
  • ABRAHAM LINCOLN Study Outline
    ABRAHAM LINCOLN TEACHER-STUDENT INFORMATION 1. OUTLINE OF PRESENTATION Dates, names, quotations, some suggested books, Lincoln anecdotes 2. STUDY GUIDE a. LEARNING BY “LITTLES” Abraham learned by “littles” that is, attending school for 6 days one year then 30 days the next year until his schooling totaled one year of learning. Here are ideas for students to expand their learning and for teachers to assess that learning. b. LINCOLN FAMILY TREE c. ACROSTIC: FROM A LOG CABIN TO THE WHITE HOUSE After listening to the presentation, students will discover they know the answers to the ACROSTIC questions. KEY to questions: pawpaw, Hanks, Sarah, Cabin, Creek, Honest, Drowned Circled letters are: P N S R I E E T D Word to complete the sentence: PRESIDENT d. WORD FIND: WHAT’S ON ABE’S MIND? 25 words to find and circle within Abe’s silhouette e. TEACHER’S KEY TO WORD FIND: WHAT’S ON ABE’S MIND Abraham Lincoln Outline and Study Activities (if time does not permit…. some of the following might not be included) I pretend to be Abigail Gollaher, sister of Austin, Abe’s best friend in Knob Creek, KY. Abigail tells stories of Abe’s honesty, responsibility, compassion, and judgment to demonstrate “behind every man is the boy he used to be.” VOCABULARY: Tadwackers…children Shank’s mare….to walk Coon it…to walk barefoot Say nothin’ … talks only if something worthwhile to share Born 1809 February 12, Sunday near Hodgenville, KY Nancy Hanks…dark, pretty, smart Sarah---sis about 2 1/2 years old…nickname Sally Tom Lincoln…carpenter, tall, dark, a say nothin’, sense of humor, “The day you can flip a flapjack up the chimney, run outside and catch it is the day I will call you a good cook.” “Nancy, by the time our son gets “growed” up there will be a long walk from the bottom of his feet to the top of his head.” Dennis Hanks, 9 year old cousin, “Aunt Nancy, you take him.
    [Show full text]
  • Abraham Lincoln, a Case Study
    The Development of a Leader: Abraham Lincoln, a Case Study © 2013 The Henry Ford. Some Rights Reserved. This content is offered for personal and educational use through an “Attribution NonCommercial No-Derivs” Creative Commons License. If you have any questions or feedback regarding these materials, please Lincoln’s Legacy | thehenryford.org/education 60 contact [email protected]. See creativecommons.org for more information about Creative Commons. The Development of a Leader: Abraham Lincoln, a Case Study Contents Teacher Guide 86 Lesson 4 | Lincoln’s Journey to Eman- cipation — Silent Class Discussion 61 Connections to Michigan, Common Core, and other National Standards and Expectations 87 Student Activity Sheet 4: Reflection Essay 64 Bibliography/ Online Resources 88 65 Unit Plan Overview Lesson 5 | Lincoln Blogs 89 Student Activity Sheet 5A: Blog 1 66 Lesson 1 | Lincoln Document-Based Question (DBQ) 90 Student Activity Sheet 5B: Blog 2 67 Student Activity Sheet 1: Reading Passages — 91 Student Activity Sheet 5C: Blog 3 Lincoln Speech Excerpts 93 Student Activity Sheet 5D: Blog 4 73 Lesson 2 | Lincoln and the Slave 95 Student Activity Sheet 5E: Blog 5 Power Conspiracy 96 Student Activity Sheet 5F: Blog 6 74 Student Activity Sheet 2: Reflection Essay 98 Student Activity Sheet 5G: Blog 7 99 Student Activity Sheet 5H: Blog 8 75 Lesson 3 | Lincoln-Douglas Debates: Politics vs. Morality 100 Student Activity Sheet 5I: Blog 9 76 Student Activity Sheet 3A: Reading Passages — 102 Student Activity Sheet 5J: Blog 10 Lincoln-Douglas Debate Excerpts 85 Student Activity Sheet 3B: Lincoln-Douglas De- bate Location Activity © 2013 The Henry Ford.
    [Show full text]