Final Report Outline

Total Page:16

File Type:pdf, Size:1020Kb

Final Report Outline NISTIR 7556 Report of Findings: Use of Language in Ballot Instructions Janice (Ginny) Redish, Ph.D. Redish & Associates Dana E. Chisnell UsabilityWorks Ethan Newby Newby Research Sharon J. Laskowski Information Access Division Information Technology Laboratory National Institute of Standards and Technology Svetlana Z. Lowry Information Access Division Information Technology Laboratory National Institute of Standards and Technology December 2008 NISTIR 7556 Report of Findings: Use of Language in Ballot Instructions Janice (Ginny) Redish, Ph.D. Redish & Associates Dana E. Chisnell UsabilityWorks Ethan Newby Newby Research Sharon J. Laskowski Information Access Division Information Technology Laboratory National Institute of Standards and Technology Svetlana Z. Lowry Information Access Division Information Technology Laboratory National Institute of Standards and Technology December 2008 U.S. Department of Commerce Carlos M. Gutierrez, Secretary National Institute of Standards and Technology James M. Turner, Deputy Director NISTIR 7556 Report of Findings: Use of Language in Ballot Instructions Janice (Ginny) Redish, Ph.D. Redish & Associates Dana Chisnell UsabilityWorks Ethan Newby Newby Research Sharon J. Laskowski Information Access Division Information Technology Laboratory National Institute of Standards and Technology Svetlana Z. Lowry Information Access Division Information Technology Laboratory National Institute of Standards and Technology December 2008 This document has been prepared by the National Institute of Standards and Technology (NIST) and describes research in support of test methods and materials for the Election Assistance Commission's next iteration of the Voluntary Voting System Guidelines (VVSG). It does not represent a consensus view or recommendation from NIST, nor does it represent any policy positions of NIST. Certain commercial entities, equipment, or material may be identified in the document in order to describe an experimental procedure or concept adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that these entities, materials, or equipment are necessarily the best available for the purpose. Report of Findings: Use of Language in Ballot Instructions Table of Contents Highlights and Summary ..................................................................................... 1 What we learned ..................................................................................... 2 Where (and why) participants had problems .......................................... 3 Recommendations .................................................................................. 6 Suggestions for future research .............................................................. 7 What we did ............................................................................................ 11 Part 1: Description of the Study ........................................................................ 13 What did we study? ................................................................................ 13 What is plain language? ......................................................................... 13 What were the goals of the study? ......................................................... 14 Where did the traditional and plain language instructions come from?............................................................................................. 14 How did we conduct the study? .............................................................. 15 How many people participated in the study? .......................................... 16 When and where did we conduct the test sessions? .............................. 16 How did we recruit our participants? ....................................................... 17 We recruited with only two screening criteria ...................... 17 We strove for diversity ........................................................ 18 We focused on people with a high school education ........... 18 We hoped for a range of voting experience ........................ 19 A professional recruiter helped us ....................................... 20 What were the ballots like for this study? ............................................... 21 What did we do in each session? ........................................................... 22 How were participants compensated? .................................................... 24 What was the setup like in each location? .............................................. 24 How were the ballots presented? ........................................................... 25 What materials did we use? ................................................................... 26 How did we control for bias in the study? ............................................... 26 What tasks and directions did we give the participants as voters? ......... 27 What data did we collect while participants voted? ................................. 29 What data did we collect in the forced choice comparison interview? .... 29 December 2008 page i of 198 Report of Findings: Use of Language in Ballot Instructions Part 2: Results ..................................................................................................... 30 Participants voted more accurately on the ballot with plain language instructions .............................................................. 30 What did we count as accuracy? ........................................ 30 How did accuracy compare between the two ballots? ......... 31 Participants who voted B first did better on A than participants who voted A first ...................................... 32 Only education level made a difference in how accurately different groups of participants voted .................................. 33 Education made a slightly greater difference for Ballot A than for Ballot B .................................................................. 34 Participants recognized the difference in language ................................ 34 Participants overwhelmingly preferred the plain language instructions ............................................................................................. 36 In the page-by-page comparison, participants preferred the page from Ballot B most of the time .............................. 36 A large majority (82%) of participants chose Ballot B for their overall preference .................................................. 36 Although Ballot B was better than Ballot A, it was not perfect ................ 38 Part 3 Discussion: Where did participants have problems? ......................... 40 Other studies looked at error rates after ballots were cast ..................... 40 We observed voting, giving us a better understanding of why voters make mistakes.................................................................. 41 In this part, we use mistakes that participants recovered from as well as “official” errors ........................................................................ 41 How we organized Part 3 ....................................................................... 41 How participants performed .................................................................... 42 Participants across the spectrum voted perfect ballots ....... 42 Most participants made relatively few errors ....................... 44 A few participants are responsible for a sizable portion of the total error count ......................................................... 44 How pages performed: Six pages had very high error rates .................. 44 Why did these six pages have such high error rates? ............................ 45 Voters must know a lot about how elections work to follow a ballot .................................................................. 46 Experience with other technology does not necessarily give voters a good mental model of using an electronic voting system ...................................................................... 46 December 2008 page ii Report of Findings: Use of Language in Ballot Instructions Many voters do not understand different levels of offices .... 47 Electronic voting systems compound the problem because voters do not know what is yet to come on the ballot .......... 47 Did plain language make a difference? .................................................. 48 Straight Party Vote/Straight Party Voting ................................................ 49 US Senate, State Senator ...................................................................... 52 Registrar of Deeds .................................................................................. 56 County Commissioners .......................................................................... 60 City Council ............................................................................................ 62 Ballot Summary/Review Your Choices ................................................... 65 Part 4 Discussion: Which ballot did participants prefer in a page-by-page comparison? ............................................................ 72 Thank you (last page in each ballot) ....................................................... 73 Instructions to Voters/How to Vote ......................................................... 74 Ballot Summary/Review Your Choices ................................................... 76 Confirmation ..........................................................................................
Recommended publications
  • ORAL HISTORY PROJECT in Celebration of the City of Sugar Land 60Th Anniversary
    ORAL HISTORY PROJECT in Celebration of the City of Sugar Land 60th Anniversary GOODSILL: What brought your family to Sugar Land, Billy? GOODSILL: What is William Alfred Streich’s story? STRITCH: My grandmother, Mary Alice Blair, was born in STRITCH: I never knew my grandfather. He died before I was Blessing, Texas, but her family moved to Sugar Land early in her born, in 1957 or so. My older sister is the only one who vaguely life. My grandmother and Buddy Blair were cousins. Mary Alice remembers him. He worked for a philanthropist in Houston whose was one of the founding families of First Presbyterian Church in name was Alonzo Welch. He had a foundation, the Welch Foundation, Sugar Land, founded in 1920 or so. There is definitely a Sugar which started in 1954, two years after Welch’s death in 1952. My Land connection that goes way back for us. grandfather was Mr. Welch’s right hand man. I know this through stories my grandmother told me over the years. At the time she married my dad, William Alfred Striech, they lived in Houston, where I was born in 1962. When I was about My dad who was an only child, who was raised in Houston. He went one, they decided to move out to Sugar Land and build a house. to Texas A & M for college and directly into the service afterward. He [Editor’s note: Striech was the original spelling of the name. Billy served two years in the Air Force. He met and married my mother, Jane goes by Stritch.] Toffelmire, during the course of the war.
    [Show full text]
  • Dancing Through the City and Beyond: Lives, Movements and Performances in a Romanian Urban Folk Ensemble
    Dancing through the city and beyond: Lives, movements and performances in a Romanian urban folk ensemble Submitted to University College London (UCL) School of Slavonic and East European Studies In fulfilment of the requirements for the degree of Doctor of Philosophy (PhD) By Elizabeth Sara Mellish 2013 1 I, Elizabeth Sara Mellish, confirm that the work presented in this thesis is my own. Where information has been derived from other sources, I confirm that this has been indicated in the thesis. Signed: 2 Abstract This thesis investigates the lives, movements and performances of dancers in a Romanian urban folk ensemble from an anthropological perspective. Drawing on an extended period of fieldwork in the Romanian city of Timi şoara, it gives an inside view of participation in organised cultural performances involving a local way of moving, in an area with an on-going interest in local and regional identity. It proposes that twenty- first century regional identities in southeastern Europe and beyond, can be manifested through participation in performances of local dance, music and song and by doing so, it reveals that the experiences of dancers has the potential to uncover deeper understandings of contemporary socio-political changes. This micro-study of collective behaviour, dance knowledge acquisition and performance training of ensemble dancers in Timi şoara enhances the understanding of the culture of dance and dancers within similar ensembles and dance groups in other locations. Through an investigation of the micro aspects of dancers’ lives, both on stage in the front region, and off stage in the back region, it explores connections between local dance performances, their participants, and locality and the city.
    [Show full text]
  • Introduction to Law and Legal Reasoning Law Is
    CHAPTER 1: INTRODUCTION TO LAW AND LEGAL REASONING LAW IS "MAN MADE" IT CHANGES OVER TIME TO ACCOMMODATE SOCIETY'S NEEDS LAW IS MADE BY LEGISLATURE LAW IS INTERPRETED BY COURTS TO DETERMINE 1)WHETHER IT IS "CONSTITUTIONAL" 2)WHO IS RIGHT OR WRONG THERE IS A PROCESS WHICH MUST BE FOLLOWED (CALLED "PROCEDURAL LAW") I. Thomas Jefferson: "The study of the law qualifies a man to be useful to himself, to his neighbors, and to the public." II. Ask Several Students to give their definition of "Law." A. Even after years and thousands of dollars, "LAW" still is not easy to define B. What does law Consist of ? Law consists of enforceable rule governing relationships among individuals and between individuals and their society. 1. Students Need to Understand. a. The law is a set of general ideas b. When these general ideas are applied, a judge cannot fit a case to suit a rule; he must fit (or find) a rule to suit the unique case at hand. c. The judge must also supply legitimate reasons for his decisions. C. So, How was the Law Created. The law considered in this text are "man made" law. This law can (and will) change over time in response to the changes and needs of society. D. Example. Grandma, who is 87 years old, walks into a pawn shop. She wants to sell her ring that has been in the family for 200 years. Grandma asks the dealer, "how much will you give me for this ring." The dealer, in good faith, tells Grandma he doesn't know what kind of metal is in the ring, but he will give her $150.
    [Show full text]
  • WXYC Brings You Gems from the Treasure of UNC's Southern
    IN/AUDIBLE LETTER FROM THE EDITOR a publication of N/AUDIBLE is the irregular newsletter of WXYC – your favorite Chapel Hill radio WXYC 89.3 FM station that broadcasts 24 hours a day, seven days a week out of the Student Union on the UNC campus. The last time this publication came out in 2002, WXYC was CB 5210 Carolina Union Icelebrating its 25th year of existence as the student-run radio station at the University of Chapel Hill, NC 27599 North Carolina at Chapel Hill. This year we celebrate another big event – our tenth anni- USA versary as the first radio station in the world to simulcast our signal over the Internet. As we celebrate this exciting event and reflect on the ingenuity of a few gifted people who took (919) 962-7768 local radio to the next level and beyond Chapel Hill, we can wonder request line: (919) 962-8989 if the future of radio is no longer in the stereo of our living rooms but on the World Wide Web. http://www.wxyc.org As always, new technology brings change that is both exciting [email protected] and scary. Local radio stations and the dedicated DJs and staffs who operate them are an integral part of vibrant local music communities, like the one we are lucky to have here in the Chapel Hill-Carrboro Staff NICOLE BOGAS area. With the proliferation of music services like XM satellite radio Editor-in-Chief and Live-365 Internet radio servers, it sometimes seems like the future EDITOR-IN-CHIEF: Nicole Bogas of local radio is doomed.
    [Show full text]
  • The Fossil No
    THE FOSSIL Official Publication of The Fossils, Inc., Historians of Amateur Journalism Volume 103, Number 4, Whole Number 333, Glenview, Illinois, July 2007 appointing all other officers and committees necessary A LEGACY INTACT for the operation of Fossils business.The plan should President's Report give us more flexibility for future adjustments as we go along to continue to find answers to what we really Guy Miller need to do in order to operate a group which proudly calls itself the “Historians of Amateur Journalism.” Some of you might recall the publication In the meantime, the number one Fossilbed which I published occasionally between responsibility for the Trustees over the years has been November 1994 and February 2001. You might also satisfactorily discharged, and that has been the care of recall the series of cartoon commentaries entitled “A our Library of Amateur Journalism. News from Ms. Fos-Sil Dialogue” which featured two humanoid Robin Rider, Curator of Special Collections of the brachiopods, Foster and Silvia Brachio. One of the University of Wisconsin in Madison, where the LAJ scenes depicts Fos reacting to a remark by a member of now resides, is heartening in that we are informed that another ajay group insisting that the Fossils as an work on the collection is progressing. We look for organization was “moribund.” Says Fos to Sil: “I hear further good news in the coming days now that we have that we are moribund,” to which Sil replies: “Big learned that Ms. Yvonne Schofer, recently retired from deal ─Who the heck isn't?” her position at the Memorial Library, has volunteered That conversation took place more than a to assist in organizing and creating finding aids for the decade ago; and, if moribund, nevertheless we're still LAJ and its comprehensive British counterpart, the here.
    [Show full text]
  • Songs by Title
    16,341 (11-2020) (Title-Artist) Songs by Title 16,341 (11-2020) (Title-Artist) Title Artist Title Artist (I Wanna Be) Your Adams, Bryan (Medley) Little Ole Cuddy, Shawn Underwear Wine Drinker Me & (Medley) 70's Estefan, Gloria Welcome Home & 'Moment' (Part 3) Walk Right Back (Medley) Abba 2017 De Toppers, The (Medley) Maggie May Stewart, Rod (Medley) Are You Jackson, Alan & Hot Legs & Da Ya Washed In The Blood Think I'm Sexy & I'll Fly Away (Medley) Pure Love De Toppers, The (Medley) Beatles Darin, Bobby (Medley) Queen (Part De Toppers, The (Live Remix) 2) (Medley) Bohemian Queen (Medley) Rhythm Is Estefan, Gloria & Rhapsody & Killer Gonna Get You & 1- Miami Sound Queen & The March 2-3 Machine Of The Black Queen (Medley) Rick Astley De Toppers, The (Live) (Medley) Secrets Mud (Medley) Burning Survivor That You Keep & Cat Heart & Eye Of The Crept In & Tiger Feet Tiger (Down 3 (Medley) Stand By Wynette, Tammy Semitones) Your Man & D-I-V-O- (Medley) Charley English, Michael R-C-E Pride (Medley) Stars Stars On 45 (Medley) Elton John De Toppers, The Sisters (Andrews (Medley) Full Monty (Duets) Williams, Sisters) Robbie & Tom Jones (Medley) Tainted Pussycat Dolls (Medley) Generation Dalida Love + Where Did 78 (French) Our Love Go (Medley) George De Toppers, The (Medley) Teddy Bear Richard, Cliff Michael, Wham (Live) & Too Much (Medley) Give Me Benson, George (Medley) Trini Lopez De Toppers, The The Night & Never (Live) Give Up On A Good (Medley) We Love De Toppers, The Thing The 90 S (Medley) Gold & Only Spandau Ballet (Medley) Y.M.C.A.
    [Show full text]
  • North Carolina Domestic Violence Best Practices Guide for District Court Judges
    North Carolina Domestic Violence Best Practices Guide for District Court Judges July 2010 (updated June 2012) North Carolina Administrative Office of the Courts Sarah Parker, Chief Justice John W. Smith, Director Supreme Court of North Carolina Administrative Office of the Courts TABLE OF CONTENTS INTRODUCTION.................................................................................................................. 4 DOMESTIC VIOLENCE ADVISORY COMMITTEE MEMBERS.......................................... 6 PART 1: BEST PRACTICES ............................................................................................... 8 Best Practice #1: Enhanced Safety ................................................................................................................. 9 Best Practice #2: Effective Scheduling........................................................................................................... 9 Best Practice #3: Specialized Judges............................................................................................................. 9 Best Practice #4: Continuance Policies........................................................................................................ 10 Best Practice #5: Local Rules........................................................................................................................ 10 Best Practice #6: Community Resources..................................................................................................... 11 Best Practice #7: Providing Information
    [Show full text]
  • 1 Below Is a Comprehensive List of All the Lines Hello Barbie Says As O
    Below is a comprehensive list of all the lines Hello Barbie says as of November 17, 2015. We are consistently updating and enhancing the product’s vocabulary and will update the lines on this site periodically to reflect any changes. OK, sooooo..... I love hanging out with you! (SIGH) Wow... there's so much we can talk about... I've got a question for you... Oh! I know what we can talk about... Oh, I know what we can do now... Speaking of things you want to be when you grow up... You know what I want to talk about? FRIENDS! So, let's talk friends! Ooh, why don't we talk about friends! Hey... let's talk about friends for a bit! I'm the most myself when I'm around my friends, just playing games and imagining what we'll be when we grow up! You know, I really appreciate my friends who have a completely unique sense of style... like you! You know, on those days where waking up for school is hard, I just think about how much fun it'll be to see my friends. ©2015 Mattel. All Rights Reserved. Version 2 1 You know, talking about all the fun things we do is making me think about who we could do them with ... friends! So we've been talking about family, let's talk about the other people in our lives that mean a lot to us ...like our friends! I bet someone who's a friend to animals knows a thing or two about being a friend to people.
    [Show full text]
  • An Ethnomusicological Study of the Policies and Aspirations for US
    Florida State University Libraries Electronic Theses, Treatises and Dissertations The Graduate School 2014 Beyond the Blockade: An Ethnomusicological Study of the Policies and Aspirations for U.S.-Cuban Musical Interaction Timothy P. Storhoff Follow this and additional works at the FSU Digital Library. For more information, please contact [email protected] FLORIDA STATE UNIVERSITY COLLEGE OF MUSIC BEYOND THE BLOCKADE: AN ETHNOMUSICOLOGICAL STUDY OF THE POLICIES AND ASPIRATIONS FOR U.S.-CUBAN MUSICAL INTERACTION By TIMOTHY P. STORHOFF A Dissertation submitted to the College of Music in partial fulfillment of the requirements for the degree of Doctor of Philosophy Degree Awarded: Spring Semester, 2014 Timothy Storhoff defended this dissertation on April 2, 2014. The members of the supervisory committee were: Frank Gunderson Professor Directing Dissertation José Gomáriz University Representative Michael B. Bakan Committee Member Denise Von Glahn Committee Member The Graduate School has verified and approved the above-named committee members, and certifies that the dissertation has been approved in accordance with university requirements. ii To Mom and Dad, for always encouraging me to write and perform. iii ACKNOWLEDGMENTS This dissertation was made possible through the support, assistance and encouragement of numerous individuals. I am particularly grateful to my advisor, Frank Gunderson, and my dissertation committee members, Michael Bakan, Denise Von Glahn and José Gomáriz. Along with the rest of the FSU Musicology faculty, they have helped me refine my ideas and ask the right questions while exemplifying the qualities required of outstanding educators and scholars. From the beginning of my coursework through the completion of my dissertation, I could not have asked for a finer community of colleagues, musicians and scholars than the musicologists at the Florida State University.
    [Show full text]
  • Images for Thesis
    ENTERTAINING A NEW REPUBLIC: MUSIC AND THE WOMEN OF WASHINGTON, 1800-1825 by Leah R. Giles A thesis submitted to the Faculty of the University of Delaware in partial fulfillment of the requirements for the degree of Master of Arts in American Material Culture Spring 2011 Copyright 2011 Leah R. Giles All Rights Reserved ENTERTAINING A NEW REPUBLIC: MUSIC AND THE WOMEN OF WASHINGTON, 1800-1825 by Leah R. Giles Approved: __________________________________________________________ J. Ritchie Garrison, Ph.D. Professor in charge of thesis on behalf of the Advisory Committee Approved: __________________________________________________________ J. Ritchie Garrison, Ph.D. Director of the Winterthur Program in American Material Culture Approved: __________________________________________________________ George H. Watson, Ph.D. Dean of the College of Arts and Sciences Approved: __________________________________________________________ Charles G. Riordan, Ph.D. Vice Provost for Graduate and Professional Education PREFACE Before the advent of recorded music (with the exceptions of musical clocks, music boxes, and barrel organs), people had to create sound themselves if they wanted to add a musical component to their entertainment. They could sing and play instruments on their own, or they could bring in outside musicians. This thesis investigates the various ways women in Washington, DC used and played music and musical instruments from 1800 to 1825. As such, it is not intended to be a comprehensive history of music in Washington, DC in the federal era. By focusing on members of elite society, I have been able to take advantage of the rich documentation and objects associated with early Washington‘s middle- and upper-class women. Many of them left behind diaries, letters, and other documents that provide enticing glimpses into their music making.
    [Show full text]
  • Sandra, Mimi, Peter & Karen Bring the Laughs As Motor City Pride
    Remembering Ruth Ellis Exploring Pete Buttigieg’s Path to the White House COMEDY FEST Sandra,RETURNS Mimi, Peter & Karen Bring the Laughs as Motor City Pride Fundraiser Comes to Dearborn PRIDESOURCE.COMPRIDESOURCE.COM FEBRUARY 21, 2019 | VOL. 2708 | FREE 2 BTL | February 21, 2019 www.PrideSource.com VOL. 2708 • FEBRUARY 21, 2019 • ISSUE 1099 PRIDE SOURCE MEDIA GROUP 20222 Farmington Rd., Livonia, Michigan 48152 Phone 734.293.7200 PUBLISHERS Susan Horowitz & Jan Stevenson EDITORIAL 06 Editor in Chief Susan Horowitz, 734.293.7200 x 102 [email protected] Entertainment Editor Chris Azzopardi, 734.293.7200 x 106 [email protected] Feature News Editor Kate Opalewski, 734.293.7200 x 108 [email protected] Editorial Assistant 22 10 Eve Kucharski, 734.293.7200 x 105 [email protected] News & Feature Writers Emell Derra Adolphus, Michelle Brown, Ellen Knoppow, Jason Michael, Drew Howard, Jonathan Thurston CREATIVE Webmaster & MIS Director Kevin Bryant, [email protected] Columnists Charles Alexander, Michelle E. Brown, Mikey Rox, D’Anne Witkowski, Gwendolyn Ann Smith Cartoonists Paul Berg Contributing Photographers 18 20 Andrew Potter, Andrew Cohen ADVERTISING & SALES Director of Sales 14 Cover: Comedy Fest Returns 12 Disney Promotes Same-Sex Wedding and Jan Stevenson, 734.293.7200 x 101 Honeymoon Program on Instagram [email protected] NEWS Sales Representatives 4 ConVocation Conference’s Raffle to Benefit LIFE Ann Cox, 734.293.7200 x 103 [email protected] Affirmations LGBTQ Community Center 14 Michigan
    [Show full text]
  • Wonderful! 131: ‘Skeetos Published April 29Th, 2020 Listen Here on Themcelroy.Family
    Wonderful! 131: ‘Skeetos Published April 29th, 2020 Listen here on TheMcElroy.family [theme music plays] Rachel: Hi, this is Rachel McElroy. Griffin: Hello, this is Griffin McElroy. Rachel: And this is Wonderful! Griffin: I feel like you hit the ―L‖ in our last name, like really hard that time. And I almost never do it—perform it that way, or hear it that way? Rachel: It gets—there‘s a lot of vowels in there, and it gets kind of mumble-y? Griffin: Right. Rachel: And so I—I try really hard to kind of say each syllable precisely. Griffin: And I appreciate that! It shows a certain r—like, reverence— Rachel: [laughs] Griffin: —for the brand. [laughs] Rachel: I‘m relatively new to this last name. Griffin: I know! And I—I—you know, I stumble in like a drunkard off the street, like… ―I‘m Mackaroy. I'm Mackaroy.‖ Rachel: [laughs] Mm-hmm. Griffin: It could be spelled any which way. Rachel: Mm-hmm. Griffin: There may or may not be an ―L‖ in there. But you come in here with your eloquent diction… Rachel: Thank you! Griffin: And you just smash it right out of the freaking park, man. Rachel: Thank you so much. Griffin: Now your first name, you could use some help with that. Your first name, you could— Rachel: Oh yeah? Do I stumble through that? Griffin: You could—I got some notes! Rachel: [laughs] Griffin: I‘ve been taking notes. Uh, this is a show where we talk about things that are good, things that are wonderful, things that are nice, that are lifting us up! That are the winds beneath our wings! Rachel: Mm-hmm.
    [Show full text]