Appendix a Methods and Data Set Description

Total Page:16

File Type:pdf, Size:1020Kb

Appendix a Methods and Data Set Description Appendix A Methods and Data Set Description 1. This appendix describes multiple analytical methods used for of the evaluation. These included desk reviews of governance and anticorruption (GAC) responsiveness; compara- tive case studies; sectoral and thematic analyses; statistical analysis; surveys, structured in- terviews, and facilitated discussions with stakeholders; and process and budget reviews. Desk Review of GAC Responsiveness of Bank Country Programs and Projects 2. The evaluation included desk reviews of Bank Country Assistance Strategies (CASs), projects, and linkages to related economic and sector work (ESW) over the FY04–10 period to assess the effectiveness of the strategy in enhancing the GAC-responsiveness of Bank-country engagement during design and implementation. Using standardized questionnaires, the re- views covered both upstream design and downstream implementation processes. Therefore, they relied on CASs, CAS Completion Reports (CASCRs), Country Portfolio Performance Re- views, and related ESW, as well as Project Appraisal Documents (PADs), Implementation Sta- tus Reports (ISRs), Quality Assurance Group (QAG)analyses, Implementation Completion Reports (ICRs), and similar documentation for recipient-executed trust funds and World Bank Institute (WBI) activities. They also draw on Independent Evaluation Group (IEG) reports in- cluding Country Assistance Evaluations (CAEs), Country Program Evaluations (CPEs), CASCR reviews, ICR reviews, Project Performance Audit Reports (PPARs), as well as the In- tegrity Vice Presidency‘s Detailed Implementation Reviews (DIRs), other Integrity Vice Pres- idency analyses, and summary results of investigations. 3. The sampling methodology for the desk reviews was designed to support three levels of analysis and to ensure adequate representation of sample countries across a number of pa- rameters including income level, governance performance, geographic region, and receipt of country GAC (CGAC) and Governance Partnership Facility (GPF) window support (Figure A.1). The methodology also sought to ensure representation of sample projects across geo- graphic regions and sectors. The Level 1 analysis analyzed whether the Bank was more sys- tematic in addressing GAC issues in countries, sectors, and projects since the launch of the strategy. Level 2 assessed whether CGAC/GPF window efforts contributed to improve- ments in GAC responsiveness. Level 3 involved field-based assessments of the results of GAC efforts. 105 APPENDIX A METHODS AND DATA SET DESCRIPTION Figure A.1. Three Levels of Analysis Level 3: What was the impact of GAC-responsive Bank efforts in client countries? What worked, what did not? • 12 countries • 70 projects Level 2: What difference did CGACs and related efforts make in improving GAC responsiveness? Level 2a. • 33 countries What worked, what • 160 projects didn’t with CGAC and Window 1 countries? Level 1: Was the Bank more systematic in addressing GAC at the country, sector, and project levels? • 50 countries • 200 projects 4. Level 1 Sampling. Level 1 analysis assessed whether the Bank has been more systematic and strategic in addressing GAC issues at the country, sector, and project levels since the launch of the strategy. To support this broad review of GAC-responsiveness of Bank opera- tions during design and implementation, countries were selected randomly from clusters representing governance performance (as measured by their governance scores in the Coun- try Policy and Institutional Assessment, or CPIA), per capita income levels (according to the World Bank country classification), and geographic region.42 A sample of 50 out of a possi- ble 143 borrowing countries—comprising 17 CGAC and Window One countries and 33 non- CGAC, non-Window One countries—was selected for desk review of GAC-responsiveness (Table A2). From these selected countries, a random sample of projects was chosen to ensure a pre-identified distribution by region and sector for desk review.43 The resulting sample of 200 closed and active projects approved during FY04–10 was selected out of a total popula- tion of 806 International Bank for Reconstruction and Development (IBRD) or International Development Association (IDA)-financed projects and 452 trust fund projects.44 Projects were selected randomly based on regional and sectoral distribution (Table A3). 5. Some inconsistencies with project lists were discovered during the project desk reviews. This led to re-sampling of part of the Level 1 project sample. First, eight trust fund projects were found to have approval dates outside the period of study (FY04–10); these were re- placed with the projects that had the next highest random number in the population of 452 trust fund projects, keeping the regional and sectoral distribution intact. Second, nine projects were found to have both a trust fund and an IBRD or IDA component and so were considered duplicates; to avoid overlaps, these were replaced by projects with the next highest random number in the population , keeping the same regional and sector distribu- tion of 122 IBRD/IDA lending projects and 78 trust fund projects. 6. The representativeness of the countries and projects relative to the CPIA governance score and gross national income (GNI) per capita of the whole population was tested and confirmed (Figure A.2). 45 Average GNI per capita and CPIA scores of each sample country do not deviate more than +/- 10 percent from regional averages within a cluster. For exam- 106 APPENDIX A METHODS AND DATA SET DESCRIPTION ple, Mali has an average CPIA governance score of 3.50 and GNI per capita of $460 where Sub-Saharan Africa Regional averages are 3.37 and $488 for CPIA scores and GNI per capita, respectively. Mali‘s deviation is +6 percent for CPIA score and -4 percent for GNI per capita. This holds for all Level 1 countries. A list of selected countries and projects is located in Tables A.2 and A.3. Figure A.2. Level 1 Country Sample Representativeness by CPIA and GNI Per Capita 7. Level 2 Sampling. The Level 2 analysis assessed whether CGACs and similar efforts made a difference by contributing to improvements in GAC-responsiveness of Bank opera- tions. Using the results of the Level 1 desk review, the Level 2 analysis involved a compara- tive analysis of Bank-country engagement in CGAC and Window 1 countries and matched pairs of non-CGAC, non-Window 1 countries. It also sought to assess the contribution of CGACs and Window 1-financed efforts to GAC responsiveness over time. To arrive at a Level 2 country sample, 33 low and lower middle income countries from the lowest three CPIA governance quintiles (consisting of CPIA governance scores between 1 and 3)— comprised of 17 CGAC and Window 1 countries, and 16 non-CGAC, non-Window 1 matched pairs—were drawn from the Level 1 country sample (Table A.2).46 Representative- ness of Level 2 countries was tested and confirmed and 160 projects in these 33 countries were drawn from the Level 1 project sample (Figure A.3). Figure A.3. Level 2 Country Sample Representativeness by CPIA and GNI Per Capita 107 APPENDIX A METHODS AND DATA SET DESCRIPTION Table A.1. Sampling of CGAC and GPF Window Countries47 CGAC Countries (In italics) GPF WINDOW 1a/ GPF WINDOW 2b/ GPF WINDOW 3c/ AFRICA Burkina Faso Burkina Faso Angola Africa Burundi Cameroon Cameroon Cameroon DRC Cape Verde Congo, Democratic Republic of (DRC) Ghana Cote d'Ivoire Ethiopia Kenya Djibouti Kenya Liberia DRC Mali Nigeria The Gambia Swaziland Sierra Leone Ghana Zambia Uganda Guinea Zambia Guinea-Bissau Kenya Mali Mauritania Mozambique Niger Nigeria 5/ Rwanda Senegal Sierra Leone Sudan 4/ Uganda Zambia EAST ASIA AND PACIFIC Cambodia Cambodia Cambodia Asia Indonesia Mongolia Indonesia d/ Mongolia Philippines Lao PDR Mongolia Papua New Guinea Philippines Thailand Timor-Leste EUROPE AND CENTRAL ASIA Albania Albania Bosnia-Herzegovina Moldova Tajikistan Kosovo Ukraine Kazakhstan Uzbekistan Kyrgyz Republic Russian Federation Tajikistan Turkey Uzbekistan LATIN AMERICA AND CARIBBEAN Guatemala Haiti Argentina e/ Latin America Honduras Brazil Paraguay Chile Peru Colombia (Continued on next page) 108 APPENDIX A METHODS AND DATA SET DESCRIPTION CGAC Countries (In italics) GPF WINDOW 1a/ GPF WINDOW 2b/ GPF WINDOW 3c/ Dominican Republic e/ Honduras e/ Jamaica Mexico Paraguay Peru d/ MIDDLE EAST AND NORTH AFRICA Iraq Morocco Lebanon Egypt Yemen Jordan West Bank and Gaza Yemen SOUTH ASIA Bangladesh Afghanistan Afghanistan Pakistan Nepal Nepal Bangladesh Sri Lanka India Nepal Notes: CGAC countries in italics; Country = Country selected in IEG sample a. Includes Grant Funding Request (GFR)2079 allocated to peer reviewers for Window 1. b. Includes GFRs allocated regionally for country studies: GFR 3098 for Angola, Cameroon, Mongolia, Lao PDR, the DRC, Ghana, Niger and Nigeria; GFR 2976 (2998) allocated to Timor-Leste, Democratic Republic of Congo, Ghana, Guinea, Mauritania, Niger, Nigeria; GFR 1739 allocated to India, Indonesia, Mexico, Jordan, and Nepal; GFR 2174 to Kenya, Zambia, Democratic Republic of Congo (and eastern central Africa), Bangladesh, India (two states), Mexico, Chile, the Philippines and South Korea; GFRs 1698 and 1728 allocated to Europe and Central Asia; GFRs 1749, 2615 and 2716 allocated to Latin America and the Caribbean; GFR 2659 allocated to the Middle East and North Africa; GFR 1712 allocated to South Asia; and GFR 2702 allocated to Southern Africa. c. Non-country specific. Nine GFRs coded ―Global‖ for training and knowledge purposes or for regions. d. Projects in these countries have two separate GFRs for the same project, a Bank-executed portion and a Recipient-executed GFR. They are GFRs 3579 and 2678 for South Sudan; GFRs 1804 and 216 for Indonesia; and GFRs 5052 and 2716 for Peru. e. Countries with two separate GFRs for different projects. For Nigeria GFR 4027 (W1) and 1695 (W2); for Sierra Leone GFR 4001 (W1) GFR 2548 (W2); for Uganda GFRs 4028 (W1) and 2653 (W1); for the Dominican Republic GFR 2720 (W1) and 4129 (W2); for Argentina GFRs 1784 (W2) and 4235 (W2); and for Honduras GFRs 1749 (W2) and 2615 (W2).
Recommended publications
  • 07623-9781451889369.Pdf
    © 2005 International Monetary Fund November 2005 IMF Country Report No. 05/415 [Month, Day], 2001 August 2, 2001 January 29, 2001 [Month, Day], 2001 August 2, 2001 Ukraine: 2005 Article IV Consultation and Ex Post Assessment of Longer-Term Program Engagement—Staff Reports; Staff Supplement; and Public Information Notice on the Executive Board Discussion Under Article IV of the IMF's Articles of Agreement, the IMF holds bilateral discussions with members, usually every year. In the context of the 2005 Article IV consultation with Ukraine, the following documents have been released and are included in this package: • the staff report for the 2005 Article IV consultation, prepared by a staff team of the IMF, following discussions that ended on August 2, 2005, with the officials of Ukraine on economic developments and policies. Based on information available at the time of these discussions, the staff report was completed on October 18, 2005. The views expressed in the staff report are those of the staff team and do not necessarily reflect the views of the Executive Board of the IMF. • a staff supplement of November 4, 2005 updating information on recent developments. • a staff report on ex post assessment of longer-term program engagement, which was completed October 18, 2005. • a Public Information Notice (PIN) summarizing the views of the Executive Board as expressed during its November 9, 2005 discussion of the staff report that concluded the Article IV consultation. The documents listed below have been or will be separately released. Selected Issues Paper Statistical Appendix The policy of publication of staff reports and other documents allows for the deletion of market-sensitive information.
    [Show full text]
  • The Ukrainian Weekly 2002, No.47
    www.ukrweekly.com INSIDE:• Special supplement: 50th ANNIVERSARY OF SOYUZIVKA, the resort of the Ukrainian National Association – an eight-page keepsake section located in the center spread. Published by the Ukrainian National Association Inc., a fraternal non-profit association Vol. LXX HE No.KRAINIAN 47 THE UKRAINIAN WEEKLY SUNDAY, NOVEMBER 24, 2002 EEKLY$1/$2 in Ukraine UCCAT announces plans toU build Famine memorial in D.C. Donetsk OblastW Chairman Yanukovych Fourth annual requiem service held at St. Patrick’s Cathedral approved as Ukraine’s prime minister by Andrew Nynka like, would likely be decided by a competi- tion of artists, architects or other interested by Roman Woronowycz NEW YORK – The Ukrainian Congress individuals. The details of such a competi- Kyiv Press Bureau Committee of America, with the support of tion also are not yet known. KYIV – Viktor Yanu- diaspora and U.S. government representa- Askold Lozynskyj, president of the kovych took the reins of tives, announced plans to build a memorial Ukrainian World Congress, the leading in Washington to the victims of the 1932- umbrella organization of the Ukrainian Ukraine’s 10th government 1933 Great Famine. UCCA President diaspora, said he and his organization fully since independence on Michael Sawkiw Jr. made the announce- support the initiative to build a monument November 21 after receiving ment at a press conference here on to victims of the Famine and said it would solid support for his appoint- November 16 after approximately 3,500 serve two very important functions. First, ment as prime minister from Ukrainians, as well as Cardinal and Major the monument would educate people who a recently formed and previ- Archbishop Lubomyr Husar, primate of were unaware of the Great Famine, said ously untested pro-presiden- the Ukrainian Greek-Catholic Church, and Mr.
    [Show full text]
  • World Bank Document
    THE WORLDBANK GROUP Public Disclosure Authorized 1993ANNUAL MEETINGS OF THE BOARDSOF GOVERNORS SUMMARYPROCEEDINGS Public Disclosure Authorized Public Disclosure Authorized WASHINGTON,D.C. SEPTEMBER28-30, 1993 Public Disclosure Authorized THEWORLD BANK GkOUP 1993 ANNUAL MEETINGS OF THE BOARDS OF GOVERNORS SUMMARY PROCEEDINGS WASHINGTON, D.C. SEPTEMBER 28-30, 1993 INTRODUCTORYNOTE The 1993 Annual Meetings ot tne Boards of Gcvernors of the WorldBank Group, which consists of the InternationalBank for Reconstructionand Deve- lopment (IBRD), International Finance Corporation (IFC), International DevelopmentAssociation (IDA), Multilateral Investment Guarantee Agency (MIGA) and InternationalCentre for the Settlement of Investment Disputes (ICSID), held jointly with that of the InternationalMonetary Fund, took place in Washington,D.C., September28-30, 1q93 (inclusive).The Honorable IvAn Szab6, Governorfor the Bank and the Fund for Hungary,served as Chairman. The SummaryProceedings record in alphabeticalorder by membercountry, the texts of statements by Governors during the meetings, resolutionsadopted by the Boards of Governors of the World Bank Grout over the past year, reports and other documents relating to the meetings. T. T. THAHANE Vice Prcsident and Secretary THE WORLD BANK GROUP Washington,D.C. December 1993 ... CONTENTS Page Opening Greetings by Lloyd M. Bentsen Govemor of the Bank and the Fund for the United States ........ I Opening Address by the Chairman IvAnSzab6 Governor of the B. -k and the Fund for Hungary ...... .......... 2 AnnualAddress by Lewis T. Preston President of the WorldBank Group ........... .................. 8 Report by Rudolf Hommes Chairman of the DevelopmentCommittee ....................... 13 Statements by Governors and Alternate Governors....... .......... 15 Page Page Armenia................. 15 Ireland................. 87 Australia................ 16 Israel................. 91 Austria................. 20 Italy................. 93 Bangladesh.............
    [Show full text]
  • International Organizations
    INTERNATIONAL ORGANIZATIONS EUROPEAN SPACE AGENCY (E.S.A.) Headquarters: 8±10 Rue Mario Nikis, 75738 Paris, CEDEX 15, France phone 011±33±1±5369±7654, fax 011±33±1±5369±7651 Chairman Council.ÐHugo Parr (Norway). Director General.ÐJean-Marie Luton (France) Member Countries: Austria Germany Spain Belgium Ireland Sweden Denmark Italy Switzerland Finland Netherlands United Kingdom France Norway Cooperative Agreement.ÐCanada. European Space Operations Center (E.S.O.C.), Robert Bosch-Strasse 5, 61, Darmstadt, Germany, phone 011±49±6151±900, telex: 419453, fax 011±49±6151±90495. European Space Research and Technology Center (E.S.T.E.C.), Keplerlaan 1, 2201, AZ Noordwijk, Zh, Netherlands, phone 011±31±71±565±6565; Telex: 844±39098, fax 011±31±71±565±6040. Information Retrieval Service (E.S.R.I.N./IRS), Via Galileo Galilei, Casella Postale 64, 00044 Frascati, Italy. Phone, 011±39±6±94±18±01; Telex: 610637, fax 011±39±94±180361. Washington Office (E.S.A.), Suite 7800, 955 L'Enfant Plaza SW. 20024. Head of Office.ÐI.W. Pryke, 488±4158, fax: (202) 488±4930. GREAT LAKES WATER QUALITY REGIONAL OFFICE Eighth Floor, 100 Ouellette Avenue, Windsor, Ontario Canada N9A 6T3 phone (519) 257±6700 (Canada), (313) 226±2170 (U.S.) Director.ÐDouglas A. McTavish. Public Affairs Officer.Ð[Vacant]. CANADIAN SECTION 100 Metcalfe Street 18th Floor, Ottawa, Ontario Canada K1P 5M1, phone (613) 995±2984 Chairman.ÐLeonard Legault. Commissioners.ÐPierre BeÂland, Frank Murphy. Secretary.ÐMurray Clamen (acting). INTER-AMERICAN DEFENSE BOARD 2600 16th Street 20441, phone 939±6600, fax 939±6620 Chairman.ÐMG John C.
    [Show full text]