Evaluation of the Strengthening South Africa's Revitalised Response To

Total Page:16

File Type:pdf, Size:1020Kb

Evaluation of the Strengthening South Africa's Revitalised Response To Mid-Term Evaluation of the SARRAH programme April 2014 Report authors: Simon Griffiths (Coffey) Samy Ahmar (Coffey) Prof John Seager (Coffey) Prof Leickness Simbayi (HSRC) Ntombizodwa Mbelle (HSRC) INMED TABLE OF CONTENTS EXECUTIVE SUMMARY 7 Introduction 7 Evaluation approach and methods 7 Key findings and conclusions 8 RELEVANCE 8 EFFICIENCY 8 EFFECTIVENESS 8 SUSTAINABILITY 9 Lessons learnt 9 Recommendations 10 1 INTRODUCTION 11 1.1 Purpose of the Mid-Term Evaluation (MTE) 11 1.2 Governance of the SARRAH Evaluation 12 1.2.1 DFID 12 1.2.2 SARRAH MANAGING AGENT (HLSP) 12 1.2.3 EVALUATION TEAM OF SARRAH (COFFEY & HSRC) 13 1.2.4 SARRAH EVALUATION STEERING COMMITTEE 14 1.3 Overview of SARRAH 15 1.3.1 BRIEF HISTORY OF SARRAH 15 1.3.2 THE SARRAH THEORY OF CHANGE 17 1.4 Methodology & Analytical Framework 23 1.4.1 ANALYTICAL FRAMEWORK 23 1.4.2 RESEARCH METHODOLOGY 24 1.5 Synthesis 27 1.5.1 NUMERICAL TOOL 27 1.5.2 SYNTHESIS 28 1.5.3 PREPARATION OF THE MTE REPORT 28 1.6 Research Challenges and Limitations 28 1.6.1 METHODOLOGICAL CHALLENGES AND LIMITATIONS 28 DIVERSITY OF WORK-STREAMS AND DATA SOURCES 28 DIFFICULTIES IN ASSESSING SARRAH’S CONTRIBUTION 29 EVIDENCE BASE 29 1.6.2 OPERATIONAL CHALLENGES AND LIMITATIONS 29 ADMINISTRATIVE DELAYS 29 LACK OF ACCESS TO NDOH DATA FOR CONFIDENTIALITY REASONS 29 2 EVALUATION FINDINGS 30 2.1 Coordination, oversight and advocacy 30 2.1.1 SOUTH AFRICAN NATIONAL AIDS COUNCIL (SANAC) 30 2.1.2 TREATMENT ACTION CAMPAIGN (TAC) 31 2.2 Health systems strengthening and NHI 32 2.2.1 ASSESSMENT OF CEOS AND DISTRICT HEALTH MANAGERS (DHMS) 32 2.2.2 ASSET MANAGEMENT 33 2.2.3 CONDITIONAL GRANT MANAGEMENT 33 2.2.4 PUBLIC FINANCIAL MANAGEMENT 35 2.2.5 HUMAN RESOURCE FOR HEALTH STRATEGY 36 2.2.6 ORGANISATIONAL REDESIGN OF NDOH 37 2.2.7 NATIONAL HEALTH INSURANCE 38 2.2.8 NHIRD 39 2.2.9 PREVENTION OF MOTHER-TO-CHILD TRANSMISSION OF HIV (PMTCT) 40 2.2.10 QUALITY ASSURANCE 41 2.2.11 SAHPRA 42 2.2.12 SERVICE TRANSFORMATION PLANS (STP) 43 2.3 Mid-term Evaluation Scoring Sheet 43 3 VALUE FOR MONEY 46 3.1 Overall Approach 46 3.2 Scope of this VFM Assessment at the Mid-Term Stage 46 3.3 VFM Assessment Methodology 47 3.4 Assessment of SARRAH’s Value for Money 49 3.4.1 ECONOMY AND EFFICIENCY 49 3.4.2 LEVERAGE 49 3.4.3 THEORY OF CHANGE 49 3.5 MTE Value for Money conclusion 50 4 CONCLUSIONS 52 4.1 Relevance: Full alignment with the NSDA and the Ten Point Plan 52 4.2 Efficiency 53 4.3 Effectiveness and Impact of SARRAH to date 53 4.4 Looking forward: sustainability of SARRAH 53 4.5 Strategic Added Value: SARRAH’s catalytic effect 54 5 LESSONS LEARNT 55 5.1 SARRAH’s key drivers of success 55 5.2 A uniquely flexible facility for the South African NDOH 55 6 OVERALL RECOMMENDATIONS 57 ANNEXES Annex 1 Historical Review of DFID’s Engagement with South Africa’s Health Sector Annex 2 Strategic Context of SARRAH Annex 3 Terms of Reference for the Evaluation of SARRAH Annex 4 Evaluation Strategy Report Annex 5 Mid-term Evaluation Report – Assessment of DHM & CEOs Annex 6 Mid-term Evaluation Report – Asset Management Annex 7 Mid-term Evaluation Report – Conditional Grant Management Annex 8 Mid-term Evaluation Report – Financial Management Annex 9 Mid-term Evaluation Report – Human Resources Annex 10 Mid-term Evaluation Report – Organisational redesign of NDOH Annex 11 Mid-term Evaluation Report – NHI Annex 12 Mid-term Evaluation Report – NHIRD Annex 13 Mid-term Evaluation Report – PMTCT Annex 14 Mid-term Evaluation Report – Quality Assurance Annex 15 Mid-term Evaluation Report – SAHPRA Annex 16 Mid-term Evaluation Report – SANAC Annex 17 Mid-term Evaluation Report – STP Annex 18 Mid-term Evaluation Report – TAC Annex 19 List of Key Informant Interviews Conducted Annex 20 Bibliography LIST OF ACRONYMS AGSA Auditor General of South Africa A-Plan PMTCT Accelerated Plan APP Annual Performance Plan ART Antiretroviral Therapy CBO Community Based Organisation CD4 Cluster of Differentiation 4 CEO Chief Executive Officer CFO Chief Financial Officer CG Conditional Grants CSO Civil Society Organisation CSP Comprehensive Service Plan DA Democratic Alliance DBSA Development Bank of Southern Africa DDG Deputy Director General DG Director General DFID Department for International Development (UK) DHIS District Health Information System DHM District Health Manager DORA Division of Revenue Act DPSA Department of Public Service and Administration EDMS Electronic Document Management System FDA Food and Drug Administration FGD Focus Group Discussion GBV Gender-Based Violence HISP Health Information Systems Programme HIV Human Immunodeficiency Virus HLSP HLSP is a trading name of Mott MacDonald Ltd. HR Human Resources HSRC Human Sciences Research Council ICT Information & Communication Technology KPA Key Performance Areas KZN KwaZulu-Natal M&E Monitoring and Evaluation M&OD Management and Organisational Development MCC Medicines Control Council MCWH Maternal Child and Women’s Health MDG Millennium Development Goal MFMA Municipal Financial Management Act MMC Medical Male Circumcision MRA Medical Research Affairs MTCT Mother-to-Child Transmission Coffey International Development December 2013 5 MTE Mid-Term Evaluation MTEF Medium Term Expenditure Framework M&E Monitoring & Evaluation M&OD Management & Organisational Development NCE New Chemical Entities NDOH National Department of Health (South Africa) NGO Non-Governmental Organisation NHC National Health Council NHI National Health Insurance NHIC National Health Information Centre (now known as NHIRD) NHIRD National Health Information Repository and Data Warehouse NSDA Negotiated Service Delivery Agreement NSP National Strategic Plan OSD Occupation Specific Dispensation PEPFAR President’s Emergency Plan for AIDS Relief PFM Public Financial Management PHC Primary Health Care PMTCT Prevention of Mother-to-Child Transmission POC Parliamentary Oversight Committee QA Quality Assurance SAHPRA South African Health Products Regulatory Authority SANAC South African National AIDS Council SARRAH Strengthening South Africa’s Revitalised Response to HIV and Health SCOPA Standing Committee on Public Accounts STI Sexually Transmitted Infection TA Technical Assistance TAC Treatment Action Campaign TB Tuberculosis TOC Theory of Change TOR Terms of Reference UNAIDS Joint United Nations Programme on HIV and AIDS VFM Value for Money Coffey International Development December 2013 6 EXECUTIVE SUMMARY Introduction SARRAH is a five-year DFID funded programme, delivered by HLSP, and which provides technical advice, funding and support to strategic national initiatives that aim to strengthen South Africa’s response to HIV and health. SARRAH’s main focus is to support the National Department of Health (NDOH) in efforts to strengthen and coordinate the national response to HIV and AIDS and make it more accountable to the South African public, and strengthen the health systems overall and their ability to provide quality healthcare to all. It is designed to support the achievement of the targets set out in the government’s Negotiated Service Delivery Agreement (NSDA) for health. SARRAH is based on partnerships with leading national players in HIV and health. Key partners include NDOH and the South African National AIDS Council (SANAC). The programme also supports civil society through the Treatment Action Campaign (TAC) and the work of the Joint Committee on HIV and the Parliamentary Portfolio Committee on Health. SARRAH commenced in January 2010 and is expected to finish delivering its activities in December 2014. This mid-term evaluation covers the period from January 2010 to December 2012. The total value of SARRAH when it commenced in 2010 was £13,500,000. SARRAH was allocated a further £6,852,217 in December 2011, bringing the total programme value at the end of December 2012 to £20,352,217. Evaluation approach and methods The detailed approach and methodology for the evaluation of SARRAH are presented in Section 1.4 and 1.5. SARRAH is structured around a series of initiatives or “work-streams” that are different in scope, scale, timing and objectives. The SARRAH Mid-Term Evaluation (MTE) recognised this diversity and considered the work-streams individually in the first instance, before making an attempt to aggregate and synthesise findings at the programme level. Evidence was collected for each work- stream by different evaluation leads and using different tools and techniques drawing on in a wide array of sources of data. To enable the evaluation team to conduct this assessment rigorously, the following approach was adopted: 1. Individual evaluations of work-streams, or groups of work-streams were conducted using appropriate methodologies, and exploiting potential synergies and complementarities between initiatives; 2. A quality assurance of the evidence collected was undertaken centrally by Coffey to ensure that evidence was of a sufficient standard to assess the overall performance of SARRAH; and 3. A synthesis of the various individual work-stream reports, complemented by a qualitative analysis of circa one hundred interview notes using Atlas.ti, was conducted in order to inform conclusions and answer the key evaluation questions. The evaluation team used the OECD-DAC criteria1 of Relevance, Effectiveness, Efficiency, Impact and Sustainability as the core evaluation framework of the MTE. The inception phase shed light on the nature of the SARRAH programme and made it clear to the evaluation team that the realisation of tangible and sustainable impacts on the South African health system would only be measurable towards the end of the programme in 2014-2015. Therefore the Impact criterion was not assessed to the same extent as the other DAC criteria, but will be the core focus of the final evaluation of SARRAH. 1 OECD (1991), DAC Principles for the Evaluation of Assistance Coffey International Development December 2013 7 Moreover, a numerical scoring tool was developed by the evaluation team as an analytical tool to support the findings emerging from the qualitative research and to enable comparison between different work-streams against the key performance criteria.
Recommended publications
  • Mid-Term Evaluation of the SARRAH Programme April 2014
    Mid-Term Evaluation of the SARRAH programme April 2014 Report authors: Simon Griffiths (Coffey) Samy Ahmar (Coffey) Prof John Seager (Coffey) Prof Leickness Simbayi (HSRC) Ntombizodwa Mbelle (HSRC) INMED TABLE OF CONTENTS EXECUTIVE SUMMARY 7 Introduction 7 Evaluation approach and methods 7 Key findings and conclusions 8 RELEVANCE 8 EFFICIENCY 8 EFFECTIVENESS 8 SUSTAINABILITY 9 Lessons learnt 9 Recommendations 10 1 INTRODUCTION 11 1.1 Purpose of the Mid-Term Evaluation (MTE) 11 1.2 Governance of the SARRAH Evaluation 12 1.2.1 DFID 12 1.2.2 SARRAH MANAGING AGENT (HLSP) 12 1.2.3 EVALUATION TEAM OF SARRAH (COFFEY & HSRC) 13 1.2.4 SARRAH EVALUATION STEERING COMMITTEE 14 1.3 Overview of SARRAH 15 1.3.1 BRIEF HISTORY OF SARRAH 15 1.3.2 THE SARRAH THEORY OF CHANGE 17 1.4 Methodology & Analytical Framework 23 1.4.1 ANALYTICAL FRAMEWORK 23 1.4.2 RESEARCH METHODOLOGY 24 1.5 Synthesis 27 1.5.1 NUMERICAL TOOL 27 1.5.2 SYNTHESIS 28 1.5.3 PREPARATION OF THE MTE REPORT 28 1.6 Research Challenges and Limitations 28 1.6.1 METHODOLOGICAL CHALLENGES AND LIMITATIONS 28 DIVERSITY OF WORK-STREAMS AND DATA SOURCES 28 DIFFICULTIES IN ASSESSING SARRAH’S CONTRIBUTION 29 EVIDENCE BASE 29 1.6.2 OPERATIONAL CHALLENGES AND LIMITATIONS 29 ADMINISTRATIVE DELAYS 29 LACK OF ACCESS TO NDOH DATA FOR CONFIDENTIALITY REASONS 29 2 EVALUATION FINDINGS 30 2.1 Coordination, oversight and advocacy 30 2.1.1 SOUTH AFRICAN NATIONAL AIDS COUNCIL (SANAC) 30 2.1.2 TREATMENT ACTION CAMPAIGN (TAC) 31 2.2 Health systems strengthening and NHI 32 2.2.1 ASSESSMENT OF CEOS AND DISTRICT HEALTH
    [Show full text]
  • Tobacco Control Policy Strategies, Successes, and Setbacks
    ARCHIV WAVERL no. 118483 Tobacco Control Policy STRATEGIES SUCCESSES & SETBACKS Edited by Joy de Beyer and Linda Waverley Brigden Tobacco Control Policy Strategies, Successes, and Setbacks Edited by Joy de Beyer and Linda Waverley Brigden • ritc rmct . A copublication of the World Bank and Research for InternationalTobacco Control (RITC) AIZ(!4!\ Copyright© 2003 The InternationalBank for Reconstructionand Development / The World Bank 1818 H StreetNW Washington, DC 20433, USA and The International Development Research Centreon behalfof the Research for International TobaccoControl Secretariat P.O. Box 8500, Ottawa,Ontario, Canada, K1G 3H9 All rights reserved. 1 2 3 4 06 05 04 03 The findings, interpretations, and conclusions expressed herein are those of the author(s) and do not necessarily reflect the views of the Board of Executive Directors of the WorldBank or the governmentsthey represent. Neither the World Bank nor IDRC/RITC guarantees the accuracyof the data in- cluded in this work. The boundaries,colors, denominations,and other informa- tionshown on any map in this work do not imply any judgmenton thepart of the World Bank or IDRC/RITC concerning the legal status of any territoryor the en- dorsementor acceptance of such boundaries. Rights and Permissions The materialin this work is copyrighted. Copying and/or transmittingportions or all of this work without permissionmay be a violationof applicable law. The World Bankand IDRC/RITC encourage dissemination of their work andwill nor- mally grant permissionpromptly. For permission to photocopy or reprint any part of this work, please send a request with complete information to the Copyright Clearance Center, Inc., 222 RosewoodDrive, Danvers, MA 01923, USA, telephone 978-750-8400, fax 978-750-4470,www.copyright.com.
    [Show full text]
  • Analysis of Non-Communicable Disease Prevention Policies in South Africa
    Analysis of Non-Communicable Disease Prevention Policies in South Africa FINAL REPORT 2017 Analysis of Non-Communicable Disease Prevention Policies in South Africa Submitted to: AFRICAN POPULATION AND HEALTH RESEARCH CENTER By Population, Health, Health Systems & Innovation Programme Human Sciences Research Council (HSRC) Private Bag X41 Pretoria, 0001 REPUBLIC OF SOUTH AFRICA Recommended Citation: Ndinda, C, & Hongoro, C. (2017). Analysis of non- communicable diseases prevention policies in Africa (ANPPA) – A case study of South Africa. A technical research report developed for the African Population & Health Research Centre (APHRC). FINAL REPORT | 2017 Acknowledgements This study was carried out with contract funding from the International Development and Research Centre (IDRC) through the African Population & Health Research Centre (APHRC). The research team is grateful to the Human Sciences Research Council (HSRC) executive for their support in this study. Disclaimer The views, opinions, and content of this publication are those of the authors and do not necessarily reflect the views, opinions or policies of the APHRC. Public domain notice All material appearing in this report is the property of the APHRC and HSRC. Until released to the public domain by the APHRC and HSRC, it may not be reproduced or copied without permission from the APHRC or HSRC. Citation of the source is required. The publication may not be reproduced or distributed for a fee. This report was compiled and produced for the African Population & Health Research Centre
    [Show full text]
  • Addressing HIV/AIDS in South Africa and Uganda: Successes, Failures, and Recommendations for Other Sub-Saharan African Countries
    Wesleyan University The Honors College Addressing HIV/AIDS in South Africa and Uganda: Successes, Failures, and Recommendations for Other Sub-Saharan African Countries by Sarah G. Bell Class of 2009 A thesis submitted to the faculty of Wesleyan University in partial fulfillment of the requirements for the Degree of Bachelor of Arts with Departmental Honors in Government Middletown, Connecticut April, 2009 TABLE OF CONTENTS A Note on Terminology iii List of Figures iii Abbreviations iv Acknowledgements v Introduction 1 Chapter One: Biology and Epidemiology of HIV/AIDS 5 Antiretroviral Drug Therapy 9 Theories of HIV Origination 11 Spread of HIV in Sub-Saharan Africa 18 Spread of HIV beyond Sub-Saharan Africa 24 Theories to Explain Sub-Saharan Africa’s High HIV Prevalence Rates 26 Chapter Two: History of South Africa and its HIV/AIDS Epidemic 35 Arrival of Europeans and Colonization 36 Rise of Apartheid and Initial Responses to HIV 39 Demise of Apartheid and Peak Spread of HIV 47 Transition to Democracy: Nelson Mandela’s Presidency 49 AIDS Denialism: Thabo Mbeki’s Presidency 54 South Africa’s Current HIV/AIDS Epidemic 56 Chapter Three: History of Uganda and its HIV/AIDS Epidemic 58 Early Ugandan History and Colonization 59 Independence from Britain 64 Idi Amin’s Dictatorship 66 Interim Governments and Neglect of HIV 68 Yoweri Museveni and Uganda’s Initial Responses to the Epidemic 69 Change in Policies: Museveni’s New Approach to HIV/AIDS 85 Chapter Four: Similarities and Differences in Responses to the 88 HIV/AIDS Epidemic Political and
    [Show full text]
  • Social Segregation
    SOCIAL SEGREGATION SOCIAL SEGREGATION Policy In February 1989 a spokesman for the minister of law and order announced that police had been ordered not to arrest people who contravened the Reservation of Separate Amenities Act of 1953. He said that police headquarters had issued a directive to all divisional commissioners, stipulating that police were not to arrest those contravening the act but to investigate any alleged offence and refer it to the local senior state prosecutor. He added, 'Because the arrest of someone is not regarded lightly by the South African Police, tangible proof must exist that the suspect has in fact committed the offence." In May 1989 the minister of constitutional development and planning, Mr Chris R ' is, said t.hat . e goe'mment was commi.ed ito '%x1A aad equal amenities for all communities on a non-discriminatory basis. Where amenities cannot be duplicated, they must be shared in an orderly fashion. This implies that all communities should be able to make use of such amenities in a civilised and well- ordered way'. Mr Heunis said that he had received a number of requests from industrialists and businessmen for the repeal of the act, as a result of 'difficulties' in towns where Conservative Party-controlled local authorities had reintroduced segregation (see 1988/89 Survey p28). He believed, however, that the repeal of the Reservation of Separate Amenities Act was unacceptable. He reiterated that the government would not 'at this stage' proceed with legislation to prevent the CP from reintroducing petty apartheid.2 In an address to the federal congress of the National Party (NP) in Pretoria in June 1989 the minister of home affairs and of communications, Mr Stoffel Botha, reiterated the government's policy regarding public amenities, which remained identical to the policy outlined in February 1988 (see 1988/89 Survey p26), ie some public amenities would be shared by all races, but 'certain population groups had a need for their own amenities'.
    [Show full text]
  • 13035 Pdf for Printing 19 Dec 2013 Successful Tobacco Legislation in South Africa
    intersectoral case study Successful Tobacco legiSlaTion in SouTh africa South Africa conTenTS Prof. Karen J. Hofman, MBBCh, FAAP Summary ..................................................... 2 Director Introduction ................................................... 2 Priority Cost Effective Lessons for Systems .................................................. Strengthening Methodology 2 MRC, University of Witwatersrand 1. General background ......................................... 3 Faculty of Health Sciences School of Public 1.1 Trends in smoking prevalence ............................ 3 Health Johannesburg, South Africa 1.2 The health burden of tobacco ............................. 3 1.3 Brief history of South African ties to tobacco ............... 4 Richard Lee ........................................ Intern 2. Initiation of the policy 4 PRICELESS-SA (Priority Cost Effective 2.1 Early academic action ................................... 4 Lessons for Systems Strengthening – SA) 2.2 Early government action ................................. 5 Correspondence: 3. Description of the policy ..................................... 5 Prof Karen Hofman 3.1 The Tobacco Products Control Act, its regulations, Room 231, Wits School of Public Health ....................................... Education Campus, 27 St. Andrews Road, and amendments 5 Parktown 2193 Johannesburg, South Africa 3.2 Taxes on tobacco ....................................... 6 Landline: 011 717-2083 3.3 Further regulation considerations ......................... 7 Cell: 076 439-2486
    [Show full text]
  • Thesis Hsf 2020 Singh Yesheen.Pdf
    Communication and Collaboration An exploration of Clinical Governance Interventions in the Western Cape Department of Health over the past Twenty Years Dr Yesheen Singh Student Number: SNGYES001 Submitted in partial fulfilment of the requirements for the degree MASTER OF PUBLIC HEALTH (Health Systems Specialisation) At UniversityUniversity of of Cape Cape Town Town January 2020 Supervised by Professor Lucy Gilson The copyright of this thesis vests in the author. No quotation from it or information derived from it is to be published without full acknowledgement of the source. The thesis is to be used for private study or non- commercial research purposes only. Published by the University of Cape Town (UCT) in terms of the non-exclusive license granted to UCT by the author. University of Cape Town Plagiarism declaration I, Yesheen Singh (Student Number SNGYES001), hereby declare that the work on which this dissertation/thesis is based is my original work (except where acknowledgements indicate otherwise) and that neither the whole work nor any part of it has been, is being, or is to be submitted for another degree in this or any other university. I empower the university to reproduce for the purpose of research either the whole or any portion of the contents in any manner whatsoever. Signature: University of Cape Town 2 Abstract The tension between the increasing cost of healthcare provision and the need to provide a quality level of care to a rising number of people is a global phenomenon. A focus on one over the other could result in a rise in adverse patient outcomes, or a health system too costly to be sustainable.
    [Show full text]
  • Race Relations
    file:///G|/ProjWip/Products/Omalley/Tim/03%20Pre-Transition/The%2...partheid%20State/T_SAIRR%201948-1990/SAIRR%20Survey%201989-90.HTM RACE RELATIONS SURVEY 1989/90 CAROLE COOPER COLLEEN McCAUL ROBIN HAMILTON ISABELLE DELVARE JOHN GARY MOONSAMY KRISTINE MUELLER Research staff South African Institute of Race Relations SOUTH AFRICAN INSTITUTE OF RACE RELATIONS JOHANNESBURG 1990 THE COVER Photograph by courtesy of Eskom. South Africa’s state-owned electricity supply commission, Eskom, is the fifth largest utility in the western world in terms of installed capacity. It operates more than two dozen power stations in South Africa—although the vast majority of South Africans have no electricity in their homes. Last year Eskom announced its commitment to ‘electricity for all’. This means bringing electricity to about 20m people, half in urban and half in rural areas, who do not have it. The process has already begun. Eskom hopes that by the end of the century the number of people file:///G|/ProjWip/Products/Omalley/Tim/03%20Pre...T_SAIRR%201948-1990/SAIRR%20Survey%201989-90.HTM (1 of 1461)25/11/2004 16:06:29 PM file:///G|/ProjWip/Products/Omalley/Tim/03%20Pre-Transition/The%2...partheid%20State/T_SAIRR%201948-1990/SAIRR%20Survey%201989-90.HTM without electricity will have been halved. Published by the South African Institute of Race Relations Auden House, 68 De Korte Street Braamfontein, Johannesburg, 2001 South Africa Copyrights South African Institute of Race Relations 1990 ISSN 0258-7246 PD 16/90 ISBN 0-86982-378-7 PREFACE Perhaps a word of explanation is required about the use of roman numerals for the pages at the beginning of this Survey.
    [Show full text]