Title: Exploring the Influence of Suprasegmental Features of Speech on Rater Judgements of Intelligibility

Total Page:16

File Type:pdf, Size:1020Kb

Title: Exploring the Influence of Suprasegmental Features of Speech on Rater Judgements of Intelligibility Title: Exploring the influence of suprasegmental features of speech on rater judgements of intelligibility Name: Thomas Michael Rogers This is a digitised version of a dissertation submitted to the University of Bedfordshire. It is available to view only. This item is subject to copyright. EXPLORING THE INFLUENCE OF SUPRASEGMENTAL FEATURES OF SPEECH ON RATER JUDGEMENTS OF INTELLIGIBILITY A thesis submitted to the University of Bedfordshire in partial fulfilment of the requirements for the degree of Doctor of Philosophy by Thomas Michael Rogers Centre for Research in English Language Learning and Assessment University of Bedfordshire January 2018 Declaration I, Thomas Rogers, declare that this thesis and the work presented in it are my own and have been generated by me as the result of my own original research. Exploring the Influence of Suprasegmental Features of Speech on Rater Judgements of Intelligibility I confirm that: 1. This work was done wholly or mainly while in candidature for a research degree at this University; 2. Where any part of this thesis has previously been submitted for a degree or any other qualification at this University or any other institution, this has been clearly stated; 3. Where I have cited the published work of others, this is always clearly attributed; 4. Where I have quoted from the work of others, the source is always given. With the exception of such quotations, this thesis is entirely my own work; 5. I have acknowledged all main sources of help; 6. Where the thesis is based on work done by myself jointly with others, I have made clear exactly what was done by others and what I have contributed myself; 7. None of this work has been published before submission. Signed: ………………………………. Date: ……………… iii Abstract The importance of suprasegmental features of speech to pronunciation proficiency is well known, yet limited research has been undertaken to identify how raters attend to suprasegmental features in the English-language speaking test encounter. Currently, such features appear to be underrepresented in language learning frameworks and are not always satisfactorily incorporated into the analytical rating scales that are used by major language testing organisations. This thesis explores the influence of lexical stress, rhythm and intonation on rater decision making in order to provide insight into their proper place in rating scales and frameworks. Data were collected from 30 raters, half of whom were experienced professional raters and half of whom lacked rater training and a background in language learning or teaching. The raters were initially asked to score 12 test taker performances using a 9-point intelligibility scale. The performances were taken from the long turn of Cambridge English Main Suite exams and were selected on the basis of the inclusion of a range of notable suprasegmental features. Following scoring, the raters took part in a stimulated recall procedure to report the features that influenced their decisions. The resulting scores were quantitatively analysed using many-facet Rasch measurement analysis. Transcriptions of the verbal reports were analysed using qualitative methods. Finally, an integrated analysis of the quantitative and qualitative data was undertaken to develop a series of suprasegmental rating scale descriptors. The results showed that experienced raters do appear to attend to specific suprasegmental features in a reliable way, and that their decisions have a great deal in common with the way non- experienced raters regard such features. This indicates that stress, rhythm, and intonation may be somewhat underrepresented on current speaking proficiency scales and frameworks. The study concludes with the presentation of a series of suprasegmental rating scale descriptors. v Acknowledgements Several people were involved in providing access to the test taker responses necessary to carry out this study. I would like to thank Jaime Dunlea, Fiona Barker, Ardeshir Geranpayeh, Bruce Howell, John Slaght, Sarah Brewer, and Veronica Benigo for their generosity during this project. I am also grateful to the panel of phoneticians who helped me make sense of the data: Yuni Kim, Richard Cauldwell, Linda Shockey, and Rachel Smith. Financial support was provided by Pearson, for which I am grateful. Of course this research would have been impossible without the participants who kindly donated their time. I am also indebted to Stefan O’Grady for discussion and comments on drafts of chapters, and Dan Frost and Jane Setter for helpful discussion in the early stages of the project. The staff at CRELLA have been a regular source of support throughout this project, primarily John Field who supervised my doctoral studies. I greatly appreciate the guidance and mentorship that he provided. My sincerest thanks also go to Fumiyo Nakatsuhara who provided insightful feedback at critical junctures. Finally, my most heartfelt gratitude goes to my parents, and to Cara and Masha for their loving support. This thesis reports on research using examination data provided by Cambridge English Language Assessment. vi Table of Contents Abstract....................................................................................................................................... v Acknowledgements ................................................................................................................ vi Table of Contents .................................................................................................................. vii List of Tables .......................................................................................................................... xi List of Figures ........................................................................................................................ xii Additional Material ................................................................................................................ xiii Abbreviations and Acronyms ................................................................................................ xiv The International Phonetic Alphabet ...................................................................................... xv Chapter 1: Introduction ............................................................................................................... 1 1.1 Rationale for the Study ..................................................................................................... 3 1.2 Setting for the Research ................................................................................................... 8 1.2.1 Current Practice in Pronunciation Assessment ........................................................... 8 1.2.2 The Context for this Research ...................................................................................12 1.3 Significance of the Study .................................................................................................13 1.4 Important Terms Defined .................................................................................................14 1.5 Outline of the Thesis ........................................................................................................15 Chapter 2: Literature Review .....................................................................................................21 2.1 Suprasegmental Features of Speech ...............................................................................22 2.1.1 Stress ........................................................................................................................23 2.1.2 Intonation ..................................................................................................................26 2.1.3 Rhythm .....................................................................................................................29 2.2 Defining Intelligibility ........................................................................................................32 2.3 Suprasegmental Correlates of Intelligibility ......................................................................34 2.3.1 Lexical Stress ............................................................................................................35 2.3.2 Intonation ..................................................................................................................36 2.3.3 Rhythm .....................................................................................................................42 2.3.4 Rater Awareness of Suprasegmental Features .........................................................44 2.4 Frameworks and Rating Scales .......................................................................................49 2.4.1 Current Frameworks .................................................................................................50 2.4.2 Rating Scale Development and Validation.................................................................55 2.4.3 Current Rating Scales ...............................................................................................60 2.5 Raters ..............................................................................................................................63 vii 2.5.1 Influence of Rater Experience ...................................................................................64 2.5.2 Linguistic Background ...............................................................................................67 2.6 Summary, Research Questions
Recommended publications
  • Tourism Guide
    Your Guide to Charm City’s Best Restaurants and Attractions Baltimore, Maryland January 4-8, 2012 Welcome to Baltimore,Hons! Inside this Guide: This Guide will provide you with all the information you need to make your interlude in Baltimore (Balmer, as the locals say) pleasant and enjoyable. Rick n’ Nic have done all Bars & Restaurants 2-3 the hard work to find the best spots for dining, libations, and local attractions. (No, Attractions 4-5 Rick n’ Nic are not local attractions). For many months, we have selflessly labored to Local Necessities 6-7 sample all that Baltimore has to offer — this Guide provides the result of our exten- Cruising Around 8 sive scientific research. We list our favorite restaurants, pubs, and attractions, to- gether with helpful maps to make sure that you don’t lose your way while exploring our fine city. Also look for the discounts! We also listed local pharmacies, banks, parking and other important locations in the vicinity. On the final page, we include information on how to get around town (and even how to reach DC) during your con- ference stay. Hope you enjoy your visit to the Land of Pleasant Living, Hons! How to Speak Balmerese: Chest Peak - Chesapeake The kitschy Hon tradition began between the 1950s and 1970s. It was common to see Wooder - What’s in the Chest working class women from the Hampden, Highlandtown, and Canton neighborhoods Peak. wearing gaudy bright dresses with outdated glasses and beehive hairdos. Men often Merlin - The state you’re in! dressed casually as many of them worked at the local factories and docks.
    [Show full text]
  • FREDDY CORBIN Oakland Tattoo Artist
    FREDDY CORBIN Oakland tattoo artist. Shot for Inked Magazine. REFUELEDMAGAZINE.COM LIFESTYLE INTERVIEW BY JAMIE WATSON PHOTOGRAPHS BY JAY WATSON California photographer Jay Watson specializes in lifestyle and environmental portraits of people on location. His work involves shooting for editorial, advertising, clothing, music, entertainment, industrial, and corporate clients. Elemental Magazine once wrote “he shoots the crazy shit,” and an early issue of Garage Magazine said “Jay came to California to raise free range artichokes.” Some of these things are true. You were raised in Baltimore, Maryland. What did you bring to What was the first thing you photographed when you arrived to California’s table? California in 1999? I brought a plastic toy camera, a humidor filled with some cigars, 6 The "Welcome to California" sign. I pulled over right after the border bungee cords, an Alpine car stereo, and a Biz Markie CD. It was all inspectors check incoming vehicles carrying fruit and vegetables. I stolen the first week I moved to the Bay Area along with shot the sign with a Polaroid Land camera. Then I got distracted in some other stuff. I guess it was a toll I had to pay, but nobody told me Joshua Tree and stayed there an extra day to shoot and drink up about it before I got here. They let me keep my Baltimore accent and the California desert. I also hit the Dinosaurs at Cabazon with the blue collar work ethic. I'll never shake those things. In toy camera. reality I came with a desire to just find my own way, but now I feel the ability to contribute.
    [Show full text]
  • High Rising Terminals in Australian Eng- Lish: Form and Function
    The University of Melbourne Department of Linguistics and Applied Linguistics Honours Thesis November 2008 High Rising Terminals in Australian Eng- lish: Form and Function by Kelly Webb 314813 Under the supervision of Associate Professor Janet Fletcher and Dr. Deborah Loakes Declaration This thesis is submitted in partial fulfilment of the requirements for the Degree of Bachelor of Arts (Honours) in the Department of Linguistics and Applied Linguistics of the University of Melbourne. Work presented herein is the original work of the author, unless otherwise acknowledged. Kelly Webb November 24th, 2008 2 Abstract This study examined various aspects of both the form and function of high rising terminals in Australian English. Using both narrative and collaborative speech data, relevant intonational phrases were labeled on severals levels and an objective method to classify question and declara- tive utterances was also developed. In particular it aimed to examine the relationship between speech act and location of the rise onset, as past studies have shown a significant result in New Zealand English. The findings were that HRTs have a ‘continuing’ function in dialog, that previ- ous findings of a phonological distinction between speech acts are unsupported, and that there appears to be no significant relationship between the location of the rise onset and speech act type. 3 Acknowledgements I would first and foremost like to express my gratitude to both Janet Fletcher and Debbie Loakes for all of their advice and encouragement over this past year, and for their confidence when my self-doubt was at its worst. Without their help this thesis would be a much lesser piece of work – in fact, almost certainly non-existent.
    [Show full text]
  • THE FOSSIL Official Publication of the Fossils, Inc., Historians of Amateur Journalism Volume 105, Number 1, Whole Number 338, G
    THE FOSSIL Official Publication of The Fossils, Inc., Historians of Amateur Journalism Volume 105, Number 1, Whole Number 338, Glenview, Illinois, October 2008 A HISTORIC MOMENT President's Report Guy Miller Yes, a historic moment it is. Our first election under our new set of by-laws has been successfully conducted and the officers have taken their places. As outlined, the election was for three members to compose the Board of Trustees. All other offices have become appointive. In addition, the position of Vice-President has been eliminated. All officers will serve for a two-year term. In 2010 only two positions on the Board will be open: the incumbent President will remain as carry over but will relinquish his title, and the new Board will proceed to choose one among them once more for President for 2010-12. That's the “game plan,” so to speak. On August 4, Secretary-Treasurer Tom Parson delivered to the President the results of the election: Number of ballots received = 21 Louise Lincoln 1 Danny L. McDaniel 8 Guy Miller 18: Elected Stan Oliner 18: Elected Jack Swenson 17: Elected Immediately upon receipt of the report, I called upon the newly elected members to give to the Secretary-Treasurer their choices for the new President to serve for the 2-year term 2008-2010. Their choice was that I should be that person. And so, I begin another stint at the end of which I will have had a ten-year try plus an earlier term (1994-95). Hopefully, by 2010 all of you will have had enough of me and, mercifully, put me out to pasture! In the meantime, I am very pleased to tell you that everyone I have asked has agreed to work along with the Board for the next two years: Ken Faig, Jr.
    [Show full text]
  • Curriculum and Resources for First Nations Language Programs in BC First Nations Schools
    Curriculum and Resources for First Nations Language Programs in BC First Nations Schools Resource Directory Curriculum and Resources for First Nations Language Programs in BC First Nations Schools Resource Directory: Table of Contents and Section Descriptions 1. Linguistic Resources Academic linguistics articles, reference materials, and online language resources for each BC First Nations language. 2. Language-Specific Resources Practical teaching resources and curriculum identified for each BC First Nations language. 3. Adaptable Resources General curriculum and teaching resources which can be adapted for teaching BC First Nations languages: books, curriculum documents, online and multimedia resources. Includes copies of many documents in PDF format. 4. Language Revitalization Resources This section includes general resources on language revitalization, as well as resources on awakening languages, teaching methods for language revitalization, materials and activities for language teaching, assessing the state of a language, envisioning and planning a language program, teacher training, curriculum design, language acquisition, and the role of technology in language revitalization. 5. Language Teaching Journals A list of journals relevant to teachers of BC First Nations languages. 6. Further Education This section highlights opportunities for further education, training, certification, and professional development. It includes a list of conferences and workshops relevant to BC First Nations language teachers, and a spreadsheet of post‐ secondary programs relevant to Aboriginal Education and Teacher Training - in BC, across Canada, in the USA, and around the world. 7. Funding This section includes a list of funding sources for Indigenous language revitalization programs, as well as a list of scholarships and bursaries available for Aboriginal students and students in the field of Education, in BC, across Canada, and at specific institutions.
    [Show full text]
  • 24.901 Lecture 17: Tone III: Intonation and Phrasing
    24.901 Tone-3: Intonation Nov. 10, 2010 [1]. Overview • Traditional analysis of intonation especially in Britain in terms of gross F0 contours such as rise for interrogative or fall for declarative oriented with respect to the edge of a phrase or the strongest stress (the nuclear accent): assìmilátion vs. prelíminàry • Strong (invariant?) correlation between intonation contour and information content: fall associated with with complete information, rise with incomplete information (Bollinger) • Early generativists Liberman (1975) and Goldsmith (1976) propose that autosegmental- metrical (AM) model of tone and stress can be applied to analysis of intonation contours: falling declarative F0 contour on cabin is phonetically and phonologically comparable to the HL tonal analysis of Mende ngílà and falling contour of baloon is comparable to mbû • Cf. English loans into Yoruba (Kenstowicz 2006): 'dollar > doĺ à, de'cree > dikirí ́ì • AM model applied to analysis of sentential F0 contours in English, Japanese, Romance, Hungarian, Korean, Bengali, and many other languages • Traditional contours analyzed as sequence of turning points (H,L) defined with respect to stressed syllables and edges of phrases and larger units • Universalist view of Bollinger is revealed to be just a statistical (markedness) tendency • More recent attempts to model F0 contours more precisely with notions of slope and decay [2]. Pierrehumbert (1980) develops general model of AM intonation with application to English and later Japanese (Beckman & Pierrehumbert 1988) • Two tone levels (H and L) suffice for English • Three tonal categories: pitch accents (e.g. H*, H*+L, ...), boundary tones (H%, %L), and phrase tone (H-) • Sparse representation: not every syllable specified for a tone: phonetic interpolation between tonal targets • Tones subject to phonetic implementation to generate F0 contour • ToBi (tone-break-index) transcription system [3].
    [Show full text]
  • Brenna's Story
    ccanewsletter of the children’s craniofacialnetwork association Cher — honorary chairperson summer 2005 inside cca teen brittany stevens. 2 cca grad tiffany kerchner. 3 cca supersib message lauren trevino . 4 from the chairman 2005 retreat recap . 5-7 Brenna Johnston n the spring issue of the fundraising news. 8 inewsletter Tim Ayers brenna’s story announced that he was cca programs . 11 by Robyn Johnston stepping down as calendar of events. 11 Chairman of the CCA Board of Directors. He has early a decade ago, my husband Erin and I discovered provided countless hours of prosthetic ears . 12 nwe would soon be parents. Like all parents, we his personal time to our wanted to raise a child that was happy, healthy and well mission and we will miss nacc recap . 13 adjusted. On May 14, 1996, Brenna, the first of our three him as Chairman. children, entered the world. She instantly was my little Tim is not going far as he 3 cheers . 14 Sugarplum, such a sweet baby! will still be on the Board of Her journey has not been easy, but you would never Directors. He is especially pete’s scramble . 16 know it meeting her today. She knows that she’s a typical committed to leading our kid who just happens to have been born with head and advocacy efforts to get facial bones too small to function properly, and we try to health insurance companies 2006 Retreat Info keep her life as balanced as possible. Here’s the typical to cover craniofacial part: Her favorite food is catsup, with hotdogs and ham- The 16th Annual Cher’s surgeries that today are burgers, no buns.
    [Show full text]
  • Placements of Idle Under Farm Plan Is Re^Rted Upon
    THE LETHBRIDGE HERALD FRIDAY, DECEMBER.il,1986 Government to save the Eskimos "That's a relatively high aver­ starving beyond the Mackenzie age," she said. "Five of these wore River as a result of their own reck­ LIGHTS and SHADOWS girls." less destruction of game. The plan TECO STORE NEWS CAST Sopranos and baritones are plen­ STORE HOURS s 9 a.m. to 0 p,m.; Saturday, 9 a.m. to 9 pj|li.| was conceived from what was ac- (•» 0. r. 8.) tiful. Tenors and contraltos are Wednesday, 9 a.m. to 8 p.m. Information Phone, 2140. comi^lshcd in tlic nineties, when FLO^VER OF TRVTH getting scarcer,.the diva added. 1280 reindeer were brought from Boyhood out of wonder roae But Hark! Is that the distant To achieve prominence as a sing­ iklyiMi^View of Men and Matters Siberia to Alaska, which today re­ With eyes hitent to trail th* roll of thunder? v er in motion pictures is oven more " (By W. A. B. C.) present a capital value of seven and truth; Splendid! I merely push my difficult than, just on the concert a half million dollars, more than (How alien it is to yontht pillow under or operatic stage, she said. which .said that the lady Isn't the price paid Riissla l«r the United Uow far away and frail It "A m^ or woman with ambi­ pretty in any conventional manner Onr overturned canoe, and so States for Alaska. So the Canadian grows!) defy tions along that line should be v^M'.s&in fit and doesn't think she is.
    [Show full text]
  • Cover Next Page > Cover Next Page >
    cover next page > title : author : publisher : isbn10 | asin : print isbn13 : ebook isbn13 : language : subject publication date : lcc : ddc : subject : cover next page > < previous page page_i next page > Page i < previous page page_i next page > < previous page page_iii next page > Page iii In the Ballpark The Working Lives of Baseball People George Gmelch and J. J. Weiner < previous page page_iii next page > < previous page page_iv next page > Page iv Some images in the original version of this book are not available for inclusion in the netLibrary eBook. © 1998 by the Smithsonian Institution All rights reserved Copy Editor: Jenelle Walthour Production Editors: Jack Kirshbaum and Robert A. Poarch Designer: Kathleen Sims Library of Congress Cataloging-in-Publication Data Gmelch, George. In the ballpark : the working lives of baseball people / George Gmelch and J. J. Weiner. p. cm. Includes bibliographical references (p. ) and index. ISBN 1-56098-876-2 (alk. paper) 1. BaseballInterviews 2. Baseball fields. 3. Baseball. I. Weiner, J. J. II. Title. GV863.A1G62 1998 796.356'092'273dc21 97-28388 British Cataloguing-in-Publication Data available A paperback reissue (ISBN 1-56098-446-5) of the original cloth edition Manufactured in the United States of America 05 04 03 02 01 00 99 5 4 3 2 1 The Paper used in this publication meets the minimum requirements of the American National Standard for Information Sciences-Permanence of Paper for Printed Library Materials ANSI Z398.48-1984. For permission to reproduce illustrations appearing in this book, please correspond directly with the owners of the works, as listed in the individual captions.
    [Show full text]
  • Baseball Jerseys,USC Wears White Jerseys,Good Jerseys
    ,kids hockey jersey Baltimore Orioles tickets are some of the hottest major league baseball tickets available today. No wonder, since the Orioles have certainly had their share of league titles in the past. Not only are the Orioles one of the oldest teams,new nike nfl,nhl all star jerseys, but they also have a rich history and have given the world of baseball some really great classic players. The Orioles are perhaps best known for their golden years in the seventies and eighties but they are still a strong team to contend with today. Though the cynics might say the Orioles aren't what they used to be, they are certainly a team that can give stiff competition to their opponents. There's a reason why Baltimore Orioles tickets are still in such great demand. A Rich BeginningThe modern day Baltimore Orioles were initially known as the Milwaukee Brewers,nfl eagles jersey, back in 1894. In 1902, the team was shifted to St. Louis where they also got a new name,nike nfl shop, the St. Louis Browns. The Browns had what many consider a dream run,nhl jersey sizes, establishing themselves as one of the strongest baseball teams at that time. However the team was relocated to Baltimore in 1954,blank hockey jersey, after which the team unceremoniously landed at the very bottom of the barrel.While the Browns left behind a legacy, it was up to the new Baltimore Orioles to make a name for them selves. They certainly had a legacy to live up to however and from 1966 to 1983, the Orioles managed to rake in three World Series Titles, American League Eastern Division titles and six American League pennants.
    [Show full text]
  • Similar Prosodic Structure Perceived Differently in German and English
    INTERSPEECH 2017 August 20–24, 2017, Stockholm, Sweden Similar prosodic structure perceived differently in German and English Heather Kember1,2, Ann-Kathrin Grohe3, Katharina Zahner4, Bettina Braun4, Andrea Weber3, and Anne Cutler1,2 1The MARCS Institute, Western Sydney University, Australia; 2ARC Centre of Excellence for the Dynamics of Language, Australia; 3University of Tübingen, Germany; 4Konstanz University, Germany [email protected] consonants in these surnames were all voiceless, and the Abstract vowels were chosen to provide progressively less voiced English and German have similar prosody, but their speakers material (Schiefer, Schief, Schiff in German; Sheafer, Sheaf, realize some pitch falls (not rises) in subtly different ways. We and Shift in English). What she found was that for English, in here test for asymmetry in perception. An ABX discrimination both falling and rising contexts, rate of fundamental frequency task requiring F0 slope or duration judgements on isolated (F0) change increased significantly with decreasing syllable vowels revealed no cross-language difference in duration or duration. English speakers were thus compressing pitch F0 fall discrimination, but discrimination of rises (realized movements when the segmental material was shorter. The two similarly in each language) was less accurate for English than pitch accent types showed no significant differences in for German listeners. This unexpected finding may reflect realization; English speakers used compression for both rises greater sensitivity to rising patterns by German listeners, or and falls. German speakers, however, showed this pattern of reduced sensitivity by English listeners as a result of extensive compression only in the case of rises, and tended to truncate exposure to phrase-final rises (“uptalk”) in their language.
    [Show full text]
  • A Qualitative Analysis of Rising Tones in Dublin English Julia Bongiorno, Sophie Herment
    A qualitative analysis of rising tones in Dublin English Julia Bongiorno, Sophie Herment To cite this version: Julia Bongiorno, Sophie Herment. A qualitative analysis of rising tones in Dublin English. 9th international conference on Speech Prosody , Jun 2018, Poznan, Poland. hal-01814067 HAL Id: hal-01814067 https://hal.archives-ouvertes.fr/hal-01814067 Submitted on 15 Jun 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. A qualitative analysis of rising tones in Dublin English Julia Bongiorno & Sophie Herment Aix-Marseille University, Laboratoire Parole et Langage, CNRS UMR 7309, France [email protected]; [email protected] close analysis of a few sentences and the context in which they Abstract appear. Our analysis is therefore mainly qualitative. In this paper, we present the results of a preliminary study of the intonation system of Dublin English (DE) with a particular 2. Corpus and method focus on rising tones. After analysing a corpus recorded in the framework of the PAC Program, we conclude that Dublin 2.1. The PAC Project English has a hybrid intonation system that mixes standard The PAC Project (Phonologie de l’Anglais Contemporain, [9]) English contours like falls and rises, and Northern Irish was initiated in 2004.
    [Show full text]