Cross-Classified and Multiple Membership Structures in Multilevel Models: an Introduction and Review

Total Page:16

File Type:pdf, Size:1020Kb

Cross-Classified and Multiple Membership Structures in Multilevel Models: an Introduction and Review RESEARCH Cross-classified and Multiple Membership Structures in Multilevel Models: An Introduction and Review Antony Fielding University of Birmingham Harvey Goldstein University of Bristol Research Report RR791 Research Report No 791 Cross-classified and Multiple Membership Structures in Multilevel Models: An Introduction and Review Antony Fielding University of Birmingham Harvey Goldstein University of Bristol The views expressed in this report are the authors’ and do not necessarily reflect those of the Department for Education and Skills. © University of Birmingham 2006 ISBN 1 84478 797 2 ACKNOWLEGEMENTS The authors of this report would like to thank all the members and visiting fellows of the Centre for Multilevel Modelling, Graduate School of Education, and University of Bristol for the many discussions in the area which have informed this review. We are also extremely grateful to Professor Hywel Thomas and Dr Ian Davison of the University Of Birmingham School Of Education. The first effectively co-directed a project in which this review forms a part and was a constant source of advice. The second undertook valuable literature searches. Finally we are very grateful to the DfES researchers and officials for their patience and invaluable guidance. 1 CONTENTS 1 Introduction…………………………………………………….…………………... 3 2 Basic Multilevel Modelling in Hierarchical Social Structures …..……….……...... 4 2.1 Explanatory Models Using Multiple Regression.………….………………...... 4 2.2 Hierarchical Data Structures And Multilevel Models..………………….…...... 7 2.3 Basic Ideas Through An Example ……………………………………….…..... 9 2.4 An Example Of A Basic Two Level Variance Components Model.………....... 15 2.5 Extending Hierarchical Models…………………..……………….…………… 17 3 Cross-Classified Data Structures.……………………………………………………....... 20 3.1 The Nature Of Cross-Classifications And Their Effects………………………. 20 3.2 Some Objectives Of Analysing Cross-Classified Multilevel Models …………. 23 3.2.1 Improving the quality of estimates of explanatory variable effects………………………………………………………………… 23 3.2.2 Identifying components of variance in the outcomes……..………….. 24 3.2.3 The study of differential effect. ………………………………….…... 24 3.2.4 Estimating level 2 effects …………………………………..….……. 24 4 Further Examples of Cross-Classified Structures And Their Analysis …….……………. 25 4.1 Some Examples In Education And Repeated Measures Studies ……………… 25 4.2 Some Notation For Cross-Classified Models …………………………………. 29 4.3 An Example Analysis: Sixteen Year Examination Performance ……………… 30 5 More Complex Structures: Multiple Membership ………………………………………. 33 5.1 The Idea of Multiple Membership....………………………………………....... 33 5.2 Classification Diagrams And A More General Notation For Cross- Classified And Multiple Membership Structures……………………………… 35 5.3 Examples Of Application Of Multiple Membership And More Complex Structures……………………………………………………………. 38 5.3.1 Teachers, teaching groups and students in GCE Advanced Level Results (Fielding (2002) ……………………………………… 38 5.3.2 Spatial models using multiple membership relation………...……….. 41 6 Estimation Methodology And Software Issues …………………………………………. 44 6.1 Introduction …………………………………………………………………… 44 6.2 Approaches To Estimating Complex Multilevel Models.……………………... 44 6.3 Software ……………………………………………………………………….. 45 6.4 Brief Comments on Generalised Models For Discrete Responses…………….. 47 7 More Applications In The Literature And Potentiality For Similar Approaches in Education Research ……………………………….…………………….. 48 7.1 Health Research ……………………………………………………………….. 48 7.2 Survey Methodology And Interviewer Response Variance…………………….49 7.3 Social Networks ……………………………………………………………….. 50 7.4 Veterinary Epidemiology, Animal Ecology and Genetics.…………………….. 50 7.5 Transportation research.………………………………………………………... 52 7.6 Missing identification of units………………………………………………..... 52 7.7 Generalisability theory………………………………………………………..... 53 7.8 Psychometrics ………………………………………………………………..... 53 7.9 Further examples in education………………………………………………..... 53 8 Conclusion and Additional Comments…………………………………………….. 54 Appendix…………………………………………………………………………………… 57 References………………………………………………………………………………….. 59 2 1 Introduction The aim of this report is partly to introduce in a fairly readable way some of the key ideas of fairly recent statistical methodology for modelling data on complex social structures including those in education. It reviews the ‘state of the art’ in the development of such methodology, and its software implementation. It also considers a wide range of examples and published applications which are either drawn directly from education or suggests potentialities in that area. Since many of the key ideas of statistical modelling of effects and the necessity for statistical control of variables are well established in traditional explanatory multiple regression this is considered first. This establishes important notions which are essential to understand as the statistical models become more complex. Section 2 then goes on to consider how data can arise from hierarchical structures such as pupils within schools and why standard regression models should be extended to encompass multilevel models. Examples from educational progress research are then considered to illustrate the applicability of such models and to further introduce major concepts such as variance components. A variety of relevant extensions and applications are then introduced to fix ideas further, Section 3 then considers that hierarchical structures and models to handle them are only the starting point for statistical modelling of complex reality. For instance it may be seen that not only do students nest themselves within schools but may also be lodged in a parallel hierarchy of area of residence which cuts across the school hierarchy. The example of education production functions incorporating both school and area effects are given. Further examples are given and then cross-classified random effects models are introduced as an appropriate way of handling data on such structures. We then examine some of the aims of such analyses. By considering some fairly complex repeated measures designs Section 4.1 reveals even more detailed structural complexity that falls into a cross-classified model framework. To formulate and understand the statistical aspects of the models some fairly detailed structured algebraic notation is required. This is outlined in Section 4.2. The detailed examination of a published application and its results in Section 4.3 illustrates the variety of detailed answers to research questions which may be revealed. This example which crosses-classifies students by secondary school attended with their previous primary school shows that achievement at secondary school may depend not only on the secondary school but also large carry over effects of prior primary school. Further complexity is introduced into models in Section 5 by introducing the idea of multiple membership. For instance, in an educational setting students can attend more than one institution, so that a strict hierarchy of students within institutions is no longer applicable. Effects on a response variable may thus consist of contributions from more than one unit at the institutional level. It is shown that by conceptualising these random effects as weighted contributions from these several units the multilevel modelling framework may be further extended. Classification diagrams and a more simplified notation are then discussed and together form a heuristic way of grasping the essential features of such complex structures. Section 5 then concludes by consideration of detailed examples where the multiple membership ideas are seen in practical operation. It is also seen how units with multiple memberships may also be combined with existing cross-classifications in illuminating ways. In an educational setting a set of students may be crossed with a set of teaching groups for the purposes of studying their GCE A levels. The various A level grades are nested within a cross-classification of students and teaching groups. Teachers may make contributions to several groups and also each group may be handled by several teachers during its operation. By conceptualising each grade response as being in multiple membership relation with the set 3 of teachers alongside a crossing of students and groups it is shown how the model framework enables the disentangling of the separate effects of individual student characteristics, group features, and teachers. Section 6 discusses the contrasting approaches that are taken to the estimation and statistical fitting of the complex models that have been discussed. In particular the focus is on the two approaches, Maximum Likelihood (ML) and Monte-Carlo Markov Chains, which are contrasted. The wide range of statistical software which has facilities for handling the model frameworks is also briefly evaluated. Some crucial features of MLwiN which is most widely used in the UK research community are outlined. The penultimate Section 7 considers a range of quite complex applications that have appeared in the literature. This comprehensive up to date review covers the following areas; health research, survey methodology and interviewer variance, social networks, veterinary epidemiology, animal ecology, genetics, transportation, missing unit identification, generalisability theory, psychometrics and additional education applications. Where possible attention is drawn to parallel structures in education where some of the methodology of
Recommended publications
  • Elect New Council Members
    Volume 43 • Issue 3 IMS Bulletin April/May 2014 Elect new Council members CONTENTS The annual IMS elections are announced, with one candidate for President-Elect— 1 IMS Elections 2014 Richard Davis—and 12 candidates standing for six places on Council. The Council nominees, in alphabetical order, are: Marek Biskup, Peter Bühlmann, Florentina Bunea, Members’ News: Ying Hung; 2–3 Sourav Chatterjee, Frank Den Hollander, Holger Dette, Geoffrey Grimmett, Davy Philip Protter, Raymond Paindaveine, Kavita Ramanan, Jonathan Taylor, Aad van der Vaart and Naisyin Wang. J. Carroll, Keith Crank, You can read their statements starting on page 8, or online at http://www.imstat.org/ Bani K. Mallick, Robert T. elections/candidates.htm. Smythe and Michael Stein; Electronic voting for the 2014 IMS Elections has opened. You can vote online using Stephen Fienberg; Alexandre the personalized link in the email sent by Aurore Delaigle, IMS Executive Secretary, Tsybakov; Gang Zheng which also contains your member ID. 3 Statistics in Action: A If you would prefer a paper ballot please contact IMS Canadian Outlook Executive Director, Elyse Gustafson (for contact details see the 4 Stéphane Boucheron panel on page 2). on Big Data Elections close on May 30, 2014. If you have any questions or concerns please feel free to 5 NSF funding opportunity e [email protected] Richard Davis contact Elyse Gustafson . 6 Hand Writing: Solving the Right Problem 7 Student Puzzle Corner 8 Meet the Candidates 13 Recent Papers: Probability Surveys; Stochastic Systems 15 COPSS publishes 50th Marek Biskup Peter Bühlmann Florentina Bunea Sourav Chatterjee anniversary volume 16 Rao Prize Conference 17 Calls for nominations 19 XL-Files: My Valentine’s Escape 20 IMS meetings Frank Den Hollander Holger Dette Geoffrey Grimmett Davy Paindaveine 25 Other meetings 30 Employment Opportunities 31 International Calendar 35 Information for Advertisers Read it online at Kavita Ramanan Jonathan Taylor Aad van der Vaart Naisyin Wang http://bulletin.imstat.org IMSBulletin 2 .
    [Show full text]
  • This Thesis Has Been Submitted in Fulfilment of the Requirements for a Postgraduate Degree (E.G. Phd, Mphil, Dclinpsychol) at the University of Edinburgh
    This thesis has been submitted in fulfilment of the requirements for a postgraduate degree (e.g. PhD, MPhil, DClinPsychol) at the University of Edinburgh. Please note the following terms and conditions of use: This work is protected by copyright and other intellectual property rights, which are retained by the thesis author, unless otherwise stated. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This thesis cannot be reproduced or quoted extensively from without first obtaining permission in writing from the author. The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the author. When referring to this work, full bibliographic details including the author, title, awarding institution and date of the thesis must be given. Sociology and Statistics in Britain, 1830-1990 Plamena Yankova Panayotova A thesis submitted to the Department of Sociology in conformity with the requirements for the degree of Doctor of Philosophy The University of Edinburgh 2018 2 Declaration I hereby confirm that this doctoral thesis has been written entirely by myself, is solely the product of my own work unless otherwise specified, and has not been submitted for any other degree or professional qualification. Signed: Plamena Yankova Panayotova Dated: 17th July 2018 3 4 Acknowledgements My interest in the history of sociology and statistics in Britain began when I was still an undergraduate student; at a time when I had more curiosity to find out about these subjects than actual experience in studying them. Back then, I had been studying sociology for three years but knew little about its development in this country.
    [Show full text]
  • Do Algorithms Homogenize Students' Achievements in Secondary School Better Than Teachers' Tracking Decisions?
    education policy analysis archives A peer-reviewed, independent, open access, multilingual journal epaa aape Arizona State University Volume 23 Number 62 July 5th, 2015 ISSN 1068-2341 Do Algorithms Homogenize Students’ Achievements in Secondary School Better Than Teachers’ Tracking Decisions? Florian Klapproth University of Luxembourg Luxembourg Citation: Klapproth, F. (2015). Do algorithms homogenize students’ achievements in secondary school better than teachers’ tracking decisions? Education Policy Analysis Archives, 23(62). http://dx.doi.org/10.14507/epaa.v23.2007 Abstract: Two objectives guided this research. First, this study examined how well teachers’ tracking decisions contribute to the homogenization of their students’ achievements. Second, the study explored whether teachers’ tracking decisions would be outperformed in homogenizing the students’ achievements by statistical models of tracking decisions. These models were akin to teachers’ decisions in that they were based on the same information teachers are supposed to use when making tracking decisions. It was found that the assignments of students to the different tracks made either by teachers or by the models allowed for the homogenization of the students’ achievements for both test scores and school marks. Moreover, the models’ simulations of tracking decisions were more effective in the homogenization of achievement than were the tracking decisions, if the students assigned to the different tracks were at the center of the achievement distribution. For the remaining students, there was no significant difference found between teachers’ tracking decisions and the models’ simulations thereof. The reason why algorithms produced more homogeneous groups was assumed to be due to the higher consistency of model decisions compared to teacher decisions.
    [Show full text]
  • Longitudinal and Life Course Studies: International Journal
    VOLUME 3 | ISSUE 2 | MAY 2012 ISSN 1757-9597 Longitudinal and Life Course Studies: International Journal Published by Society for Longitudinal and Life Course Studies Inside this issue G Special Section: transition to adulthood in the UK, the US and Finland G Father involvement, family poverty and adversity G Study profile: Panel Study of Income Dynamics G Social class returns to higher education debate Co-sponsors: Promoting Longitudinal and Life Course Studies EDITORIAL BOARD EDITORIAL COMMITTEE Executive Editor John Bynner, Institute of Education, UK Health Sciences Section Editor - Michael Wadsworth, MRC Unit for Lifelong Health and Ageing London, UK Associate Editors - David Blane, Imperial College Medical School, UK - Scott Montgomery, Karolinska University Hospital, Sweden Social and Economic Sciences Section Editor - Robert Erikson, University of Stockholm, Sweden Associate Editors - Paul Gregg, University of Bath, UK - John Hobcraft, University of York, UK - Jan Smit, VU Medical Centre, Netherlands Statistical Sciences and Methodology Section Editor - Harvey Goldstein, University of Bristol, UK Associate Editor - Bianca de Stavola, London School of Hygiene and Tropical Medicine, UK Development and Behavioural Sciences Section Editor - Barbara Maughan, Institute of Psychiatry, Kings College, UK Associate Editors - Lars Bergman, University of Stockholm, Sweden - Amanda Sacker, University of Essex, UK BOARD MEMBERS Mel Bartley, University College London, UK; Nick Buck, University of Essex, UK; Richard Burkhauser, Cornell University,
    [Show full text]
  • The Royal Statistical Society Getstats Campaign Ten Years to Statistical Literacy? Neville Davies Royal Statistical Society Cent
    The Royal Statistical Society getstats Campaign Ten Years to Statistical Literacy? Neville Davies Royal Statistical Society Centre for Statistical Education University of Plymouth, UK www.rsscse.org.uk www.censusatschool.org.uk [email protected] twitter.com/CensusAtSchool RSS Centre for Statistical Education • What do we do? • Who are we? • How do we do it? • Where are we? What we do: promote improvement in statistical education For people of all ages – in primary and secondary schools, colleges, higher education and the workplace Cradle to grave statistical education! Dominic Mark John Neville Martignetti Treagust Marriott Paul Hewson Davies Kate Richards Lauren Adams Royal Statistical Society Centre for Statistical Education – who we are HowWhat do we we do: do it? Promote improvement in statistical education For people of all ages – in primary and secondary schools, colleges, higher education and theFunders workplace for the RSSCSE Cradle to grave statistical education! MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE Where are we? Plymouth Plymouth - on the border between Devon and Cornwall University of Plymouth University of Plymouth Local attractions for visitors to RSSCSE - Plymouth harbour area The Royal Statistical Society (RSS) 10-year
    [Show full text]
  • Measuring-Success-League-Tables-In
    oldstein G UCCESS and Harvey Harvey and Beth Foley League tablesLeague in the public sector S MEASURING MEASURING SUCCESS League tables in the public sector Beth Foley and Harvey Goldstein Measuring Success League tables in the public sector Beth Foley and Harvey Goldstein March 2012 Steering Group: Stephen Ball David Bartholomew Colin Crouch Harvey Goldstein (Chair) THE BRITISH ACADEMY 10 –11 Carlton House Terrace London SW1Y 5AH www.britac.ac.uk Registered Charity: Number 233176 © The British Academy 2012 Published March 2012 ISBN 978-0-85672-600-2 Designed by Soapbox, www.soapbox.co.uk Printed by Smith & Watts 3 Contents Acknowledgements 5 About the authors 6 Executive summary 7 Introduction 14 1 Education 21 Schools 21 Technical and analytical issues 23 Usability issues 26 Political, ethical and societal issues 28 Issues for further research 32 Summary of issues and recommendations 33 2 Higher education 35 Technical and analytical issues 36 Usability issues 39 Political, ethical and societal issues 41 Identifying solutions 43 Policy issues 43 Issues for further research 46 Summary of issues and recommendations 47 3 Crime and policing 48 Technical and analytical issues 50 Usability issues 53 Political, ethical and societal issues 54 Issues for further research 57 Summary of issues and recommendations 57 4 General conclusions and recommendations 59 Rankings as a tool for improvement 59 Who should produce comparative rankings? 60 Technicalities 60 4 Measuring Success // British Academy Policy Centre Monitoring 60 Summary of recommendations 62 General 62 Education 63 Higher education 64 Policing 64 References 66 Appendix A: Alternatives to league tables 69 Appendix B: Forum participants 74 British Academy Policy Centre publications 75 British Academy Policy Centre // Measuring Success 5 Acknowledgements We would like to thank Stephen Finnigan, Rob Copeland, Mick Brookes, Ann Mroz and Aaron Porter who were interviewed in the early stages of the project.
    [Show full text]
  • Harvey Goldstein
    HARVEY GOLDSTEIN Harvey Goldstein 30 October 1939 – 9 April 2020 elected Fellow of the British Academy 1996 by JOHN GRAY Fellow of the Academy IAN DIAMOND Fellow of the Academy FIONA STEELE Fellow of the Academy Harvey Goldstein died in April 2020 aged 80, an early victim of the Coronavirus pandemic. During the course of his career he made getting on for 400 published contributions to the development of statistical methods and to the substantive analysis of various educational, social and medical issues. He is particularly noted for his pioneering contributions to the development and dissemination of multilevel modelling and for his sustained critiques of so-called league tables of institutional performance. Biographical Memoirs of Fellows of the British Academy, XIX, 357–376 Posted 2 October 2020. © British Academy 2020. HARVEY GOLDSTEIN Professional life and contributions In 1977 the London Institute of Education (IoE) advertised a Chair of Statistical Methods and appointed Harvey Goldstein to it. At first glance this was a routine appointment—several professorial positions were being created across the Institute and a new head of department was needed for the Department of Measurement, Analysis and Computing. However, it was an unusual appointment in at least two respects. First, Harvey had been a lecturer at the London Institute of Child Health and, whilst he had already published quite extensively, relatively little of his output had had much to say about educational matters. And second, Educational Research was still in the process of establishing itself as an area of enquiry with its own distinc- tive approaches. Some of the major US graduate schools of education had a dedicated chair in statistics but there had never previously been such a chair in the UK.
    [Show full text]
  • A Contextual Analysis of Differential Association, Social Control, and Strain Theories of Delinquency*
    Theories of Delinquency / 753 A Contextual Analysis of Differential Association, Social Control, and Strain Theories of Delinquency* JOHN P. H OFFMANN, Brigham Young University Abstract The history of criminological thought has seen several theories that attempt to link community conditions and individual-level processes. However, a comparative analysis of contextual effects has not been undertaken. This article estimates a multilevel model that examines the effects of variables derived from three delinquency theories. The results indicate that youths residing in areas of high male joblessness who experience stressful life events or little parental supervision are especially likely to be involved in delinquent behavior. The attenuating impact of school involvement on delinquency is more pronounced in urban environments low in male joblessness. These results suggest that examining the contextual implications of delinquency theories is important, but theories need to be developed with more attention to specific contextual processes. The search for macro-micro linkages and how they affect deviant and crimi- nal behavior has a substantial and notable history (Coleman 1990; Durkheim 1951 [1897]; Stark 1987). The history of criminological thought has seen Shaw and McKay’s seminal work on how social disorganization affects behavior at the individual level, especially with reference to the qualitative life histories * Support for this research was provided by National Institute on Drug Abuse grant 11293. An earlier version of this article was presented at the 2000 annual meeting of the American Society of Criminology, San Francisco, Calif. I thank Bob Bursik, Frank Cullen, Bob Agnew, David Greenberg, and an anonymous Social Forces reviewer for helpful suggestions on earlier drafts.
    [Show full text]
  • Evaluating Educational Changes: a Statistical Perspective
    Evaluating educational changes: a statistical perspective Harvey Goldstein* Abstract The paper explores some of the issues involved in evaluating educational policy initiatives. It gives examples of how research findings can be evaluated and draws lessons for the ways in which policymakers can interact usefully with researchers. It argues that while central government’s use of research evidence is often highly selective and concerned with its own perceived short term interests, a broader view of the research process is more productive and beneficial. The issues of class size, school league tables and the effects of homework are studied in detail and the often provisional nature of research evidence is emphasised as well as the uncertainty surrounding the findings of individual studies. Keywords: Educational research. Educational policy. Class size research. League tables. Homework. Avaliando mudanças educacionais: uma perspectiva estatística Resumo O artigo explora questões que aparecem ao se avaliar iniciativas de políticas educacionais. O artigo dá exemplos de como resultados de pesquisas devem ser avaliados e tira lições de como formuladores de políticas podem interagir efetivamente com pesquisadores. O artigo argumenta que enquanto o uso que o governo faz da evidência da pesquisa é frequentemente seletivo e preocupado com seus interesses de curto prazo, uma visão mais geral do processo de pesquisa é mais produtivo e benéfico. As questões do tamanho da turma, ranqueamento de escolas e os efeitos do dever de casa são estudadas em detalhe e a natureza frequentemente provisória da evidência da pesquisa é enfatizada assim como a incerteza em volta dos resultados de estudos individuais. Palavras-chave: Pesquisa educacional.
    [Show full text]
  • Harvey Goldstein Memoria
    Radical Statistics 2020 Editorial to Section: Memories of Harvey Goldstein (30 October 1939 – 9 April 2020) "In dark times there will be singing" Brecht We statisticians may be hardened by continuous examination of death statistics. We may sneer uneasily at the statement questionably attributed to Stalin: “One death is a tragedy; a million deaths is a statistic”. But tragedy hits hard and we are impacted as much as others when one who dies is one of us, especially when it is a person so dear as Harvey Goldstein. Harvey always wore his eminence lightly: soft, quizzical, humourous. This shines out in a gem of an interview (Goldstein 2017). He was with Radical Statistics before our first meeting on 30 January 1975. The inaugural issue of Radical Statistics Journal (then called ‘Newsletter’) included his call (Goldstein 1975) to establish a Radstats study-group on educational research. Harvey was also with us at our most recent meeting on 29th February 2020, cogent and stimulating as usual, and with no sign of slowing down. His wisdom is already greatly missed in the statistical discussions around the disease that sadly floored him. Goldstein, Harvey. 2017. Interview with Harvey Goldstein. https://discover.ukdataservice.ac.uk/QualiBank/Document/?id=q-92053089-af34-4f09-b08c- 51c2279ca6b2&q=goldstein#relatedfiles. Goldstein, Harvey. 1975. “Radical Statistics Study Group on Educational Research.” Radical Statistics Newsletter, February. https://www.radstats.org.uk/no001/reports.pdf. Harron, Katie, George Leckie, Bill Browne, James Carpenter, Fiona Steele, and Tim Cole. 2020. “Professor Harvey Goldstein at 80.” Significance. Statistics Making Sense 17 (1): 41– 41.
    [Show full text]
  • Print This Article
    VOLUME 8 | ISSUE 1 | JANUARY 2017 ISSN 1757-9597 Longitudinal and Life Course Studies: International Journal Published by Society for Longitudinal and Life Course Studies Special section: Transition to young adulthood Inside this issue Special section: Transition to young adulthood G Attitudes towards social inequality and social justice G Life satisfaction and engagement with studies and work G Socio-ecological model of education and employment transitions G Contact with the criminal justice system and health Individual papers G 30 years of UK post-16 labour market transitions G Selective attrition and compositional changes in Swedish longitudinal study LLCS EDITORIAL BOARD EDITORIAL COMMITTEE Executive Editor John Bynner, Institute of Education, UK Population and Health Sciences Section Editor - Scott Montgomery, Örebro University Hospital and Örebro University, Sweden Associate Editors - David Blane, Imperial College Medical School, UK - Rachel Knowles, Institute of Child Health, University College London, UK - Jan Smit, VU Medical Centre, Netherlands Social and Economic Sciences Section Editor - Richard Layte, Trinity College, Dublin, Ireland Associate Editors - Paul Gregg, University of Bath, UK - John Hobcraft, University of York, UK Statistical Sciences and Methodology Section Editors - Harvey Goldstein, University of Bristol, UK - Kate Tilling, University of Bristol, UK Development and Behavioural Sciences Section Editor - Jeylan Mortimer, University of Minnesota, USA Associate Editors - Lars Bergman, University of Stockholm, Sweden
    [Show full text]
  • League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
    League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance Harvey Goldstein; David J. Spiegelhalter Journal of the Royal Statistical Society. Series A (Statistics in Society), Vol. 159, No. 3. (1996), pp. 385-443. Stable URL: http://links.jstor.org/sici?sici=0964-1998%281996%29159%3A3%3C385%3ALTATLS%3E2.0.CO%3B2-5 Journal of the Royal Statistical Society. Series A (Statistics in Society) is currently published by Royal Statistical Society. Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/journals/rss.html. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is an independent not-for-profit organization dedicated to and preserving a digital archive of scholarly journals. For more information regarding JSTOR, please contact [email protected]. http://www.jstor.org Mon May 14 09:57:04 2007 J. R. Statist. Soc. A (1996) 159, Part 3, pp. 385443 League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance By HARVEY GOLDSTEIN? and DAVID J.
    [Show full text]