APPLICATION OF BARTLETT AND MORGAN’S STANDARDS TO EVALUATE THE IMPACT OF ENGLISH TEXTBOOKS AT HSSC/A’LEVEL IN SINDH A Dissertation By STEPHEN JOHN In the Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Education Under the supervision of Prof. Dr. Syed Abdul Aziz (Supervisor) & Prof. Dr. E. J. Mall (Co-supervisor) Presented to Hamdard Institute of Education and Social Sciences HAMDARD UNIVERSITY KARACHI, PAKISTAN December 2013 ABSTRACT The purpose of this study was to determine the impact of intermediate English language textbooks prescribed by the Sindh Textbook Board Jamshoro (STBJ) by using Bartlett and Morgan standards. The conceptual frame work of the study was based on variables(Bartlett and Morgan standards) like suitability of activities given in the textbooks for various ELT methodologies, compatibility to the age, interest & needs of the learners, physical & functional attributes of the textbooks, sequence & achievability of tasks, consideration given to cultural sensitivities, situations created in dialogues and language used, efficient grading of listening tasks, meaningfulness of speaking activities for communication, interesting reading texts, achievability of goals of writing tasks, efficient repetition & recycling of words across the textbooks, focus on functional aspects of grammatical items, pronunciation of new words introduced, and, finally suitability of exercises for under/over achievers. The design of the study was both qualitative and quantitative. The population consisted of editors and reviewers working at the Sindh Textbook Board Jamshoro and the teachers using the textbooks for intermediate/higher secondary school students in Karachi (a major/representative city of Sindh). The sample of the study was selected by random selection procedures. Questionnaire and interview document using standards set by Bartlett and Morgan (the American researchers, who developed checklist/standards for evaluation of English textbooks for college students learning English as a second/foreign language) were personally administered to collect the responses using survey method. The Chi-square test was used to test the hypotheses. From the results of analysis, it was found that the prescribed textbooks of STBJ for intermediate/HSSC/A’Level students were not compatible with the age, interest and needs of the learners. The layout of the textbooks was not attractive as it was without the efficient use of text and visuals; although the textbooks were viewed as cost-effective they were not perceived as durable. The tasks/activities given in the textbooks could not work well with ELT methodologies; likewise, they were not interesting because of the sequence, language and achievability of objectives. The listening and speaking activities were not incorporated into the textbooks, while reading and writing activities were not suitable, as learners’ capabilities were not given due considerations. The pronunciation of the new words introduced in the textbooks was less learner-friendly and was not efficiently repeated across the textbooks. The exercises were not, adequate and helpful for under/over achievers; furthermore functional aspects of the grammatical items were not focused in the exercises. It was also explored from the content analysis that the material of the textbooks did not match with the competencies, standards and benchmarks discussed in the National Curriculum of English language(NCEL)-2006 Pakistan, moreover the themes and sub-themes selected for contents of the textbooks for grade XI & XII in NCEL-2006 were missing at all in the textbooks, as the textbooks were adopted from “An Intermediate English Course for Adult Learners” (By D. H. Spencer and A. S. Hornby in 1956) and compiled by a panel of experts including Ex-chairman of the British Council and Education Officer for Pakistan (D. Y. Morgan) in the late sixties (approximately a half century ago) Most of the standards fixed for evaluation of textbooks in the checklist given in the NCEL-2006 were not discussed in the existing textbooks. The weaknesses of the textbooks were admitted, by the representative, and reviewer of STBJ. They disclosed that the tasks had been assigned to different agencies/writers for compiling textbooks in accordance with the NCEL-2006 and the new textbooks would probably be introduced in 2014. Based on the above findings, recommendations were formulated for the improvement of textbooks. According to these recommendations, along with academic qualifications professional qualifications must be made mandatory for English language teachers teaching at intermediate level, and continuous professional development activities including textbook evaluation workshops for teachers be organized by the authorities. The national curriculum must be made available for teachers to study. The existing textbooks must be changed as soon as possible because they have no match with the needs of learners in the present era of technology. The new textbooks should incorporate the B and M standards for better impact on the learners. DEDICATION I would like to dedicate this thesis to my family who has supported me all the way since the beginning of this study, especially my beloved wife, who has been a great source of motivation and inspiration throughout this research process, whose words of encouragement and push for tenacity ring in my ears. I appreciate for whatever she has done for me, to prove and improve myself through all my walks of life. ACKNOWLEGEMENTS First and foremost, I am immensely grateful to my supervisor Professor Dr. Syed Abdul Aziz, the Dean, HIESS, Hamdard University, Karachi Pakistan, who has always been so generous in finding time for discussion of different stages of research study and satisfactorily answer my questions. This study would have never been completed without his painstaking approach, humble, unfailing patience, expert advice and compassionate guidance. I am greatly indebted to him for his detailed and insightful comments on the draft of my thesis, his inspirational guidance, and the hours of discussion, which have continuously challenged my thinking and encouraged me to push the boundaries of my research work. I am also most grateful for his faith in this study. The loyalty I have developed to this academic father has evolved into my ongoing passion for the research. My heartfelt gratitude is also due to Professor Dr. E. J. Mall (Co-supervisor), the Chairman of the Department of English, Banazir Shaheed University Lyari, Karachi Pakistan. His invaluable support and constant encouragement have been crucial in guiding me through various stages from the very first day of my research journey to the last chapter of this thesis. Many other people have contributed to the completion of this thesis and I wish to express my heartfelt appreciation to all of them. Space does not allow me to mention everyone by name but there are a number of individuals and bodies that deserve recognition. I wish to thank my friends in Bahria College Karsaz, Karachi, who helped me in developing a chain for data collection and my wife Rubina Maria who especially supported me a lot in collecting data from female teachers. I am highly thankful to my children (Hannan, Filza and especially, the youngest one Hamdan) who helped in the tabulation of data and Mr. Irfan Qasim (Deputy Director, IBA Sakkur) for analysis of the data. I am also grateful to Professor Ishahque Khan, Mr. Raziuddin Khan (Chief Editor Science Digest), Mr. Abdul Faheem Noonari (subject Specialist STBBJ) and Mr. Asif Ali Maher (Reviewer) for providing me with useful information about the textbooks prescribed by Sindh textbook Board Jamshoro for the students of XI and XII grade (equal to A’ Level). Finally, this thesis would have not been possible without the will of Almighty God, therefore, a big thanks to Him, for giving me strength, courage and the determination, as well as guidance in conducting and accomplishing this laborious task of my life, despite all difficulties. STEPHEN JOHN CERTIFICATE OF APPROVAL This is to certify that MR. STEPHEN JOHN has successfully completed his research study of PhD (Education) entitled “Application of Bartlett and Morgan’s Standards to Evaluate the Impact of English Textbooks at HSSC/A’ Level in Sindh” under our supervision and his dissertation meets the standard as set by Hamdard University Karachi. __________________________ ________________________ Professor Dr. Syed Abdul Aziz Professor Dr. E. J. Mall Supervisor Co-supervisor The Dean (HIESS) The Chairman Hamdard Institute of Education & Social Sciences Department of English Hamdard University Karachi Banazir Bhutto University, Pakistan Lyari, Karachi (Pakistan) Dated: ____________________________________ TABLE OF CONTENTS Title ______ Page Abstract i Dedication iii Acknowledgement iv Certificate of Approval vi List of Abbreviations vii Table of Contents viii CHAPTER ONE: INTRODUCTION 1.1 The Research Context 1 1.2 Pakistan: The Socio Cultural Background 1 1.3 Background of the Study 3 1.4 Importance of English Textbooks in Language Teaching 7 1.5 Statement of the Problem 8 1.6 Rational of the Study 8 1.7 The Scope of the Study 12 1.8 Objectives of the Study 12 1.9 Justification of the Study 13 1.10 Research Questions 13 1.11 Delimitations 14 1.12 Definition of the Key Terms 15 CHAPTER TWO: REVIEW OF THE LITERATURE 2.1 Introduction 17 2.2 Language 17 2.2.1 History of Language Development 17 2.2.2 Structure of Language 18 2.2.2.1 Semantics 18 2.2.2.2 Sounds and Symbols