PERFORMANCE MANAGEMENT AND SUPPORT PROGRAM FOR LEBANON II (PMSPL II) ANNUAL REPORT FY2018
DISCLAIMER: The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government.
Note: Limited redactions have been made to this version of the report in accordance with the principled exceptions to the presumption in favor of openness established in OMB Bulletin 12-01, “Guidance on Collection of U.S. Foreign Assistance Data.”
USAID/PERFORMANCE MANAGEMENT AND SUPPORT PROGRAM FOR LEBANON II (PMSPL II) ANNUAL REPORT FY2018 (October 1, 2017 – September 30, 2018)
Prepared by Social Impact, Inc. for the United States Agency for International Development under USAID Contract/Order No. AID-268-C-15-00001.
Submission date: January 2019
This document is not available in print. Documents of this nature are made available to the public through the Development Experience Clearinghouse repository (dec.usaid.gov). For additional information, please contact:
Social Impact, Inc. Corporate Office 2300 Clarendon Boulevard Arlington, VA 22201 Tel: (703) 465-1884 Fax: (703) 465-1888 [email protected]
Or
Social Impact, Inc. Lebanon Office Arz Street Librex Bldg. Bloc B – 3rd Floor Zalka, Metn, Lebanon Tel: +961-1-879260
COVER PHOTO: PMSPL II’s A&E team on a verification visit to a construction project in Anjar. PHOTO CREDITS: All photos and maps by PMSPL II unless otherwise indicated.
i | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV CONTENTS
Contents ...... ii
Figures and Tables ...... iii
Acronyms ...... v
Executive Summary ...... vii
Program Overview/Summary ...... 1
Program Description and Introduction...... 1
Reporting PMSPL II Work Plan Activities ...... 3
Purposes and Sub-Purposes ...... 3 Work Plan Meeting and Approval ...... 4 Quarterly Reports ...... 4 Key Activities Status for FY2018 ...... 5 Main Challenges Encountered in FY2018 ...... 12 Summary of Results to Date...... 12
Activity Implementation Progress ...... 13
Purpose I: USAID MEL Activities Enhanced ...... 13 Purpose II: Direct Support to USAID’s Program Management Increased...... 42 Purpose III: USAID’s Architecture and Engineering Services Enhanced ...... 56
Management and Administrative Issues ...... 59
Contract Administration Elements ...... 59
Lessons Learned ...... 60
Critical Assumptions ...... 61
Context for Achieving Targets and Goals of the CDCS ...... 61 Critical Assumptions for PMSPL II ...... 61
Annex A: Progress Summary ...... 62
Annex B: Reports Submitted ...... 63
Annex C: Financial Report ...... 70
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | ii FIGURES AND TABLES Figure 1: USAID projects alignment with CDCS ...... 15 Figure 2: Participants at the Gender Meeting in July 2018 ...... 20 Figure 3: PMSPL II Team and COR with MSI Team at the USAID M&E summit in Frankfurt ...... 23 FIGURE 4: DISCUSSIONS DURING THE RMF DV Frankfurt ...... 24 Figure 5: LIVCD heat map showing the density of beneficiaries in different regions ...... 27 Figure 6: Heat map showing budget density in different regions ...... 28 Figure 7: Screenshot from the IM GIS database ...... 29 Figure 8: Hamat Sattelite Image ...... 29 Figure 9: Updated GIS imagery of LRI’s reforestartion site...... 30 Figure 10: LIVCD maps for Assissted Value Chains ...... 30 Figure 11: A&E BALADI projects sites ...... 31 Figure 12: Schools that received buses from QITABI ...... 32 Figure 13: AGOL map of USAID activities ...... 33 Figure 14: USAID activities Mapped against refugees distribution ...... 33 Figure 15: PMSPL's Sr. GIS specialist (far left) at the 2018 Sustainable World Conference in Geneva ...... 34 Figure 16: Parliamentary elections map ...... 34 Figure 17: 2018 voting data disaggregated by gender ...... 35 Figure 18: KII at an apple-packing facility as part of LIVCD’s final evaluation ...... 38 Figure 19: bCAP evaluation team leader (left) during a KII with mayors ...... 40 Figure 20: The evaluation team (left) during an FGD ...... 40 Figure 21: FGD with olive oil producers ...... 41 Figure 22: FGD with beekeepers ...... 41 Figure 23: Participants at the CLA meeting in February ...... 43 Figure 24: Attendees discussing challenges to productive employment at the CLA partners meeting in February ...... 43 Figure 25: Participants at the EG/CLA meeting on PSD in April ...... 44 Figure 26: During the EG/CLA meeting on PSD, the IPs presented the reporting challenges they faced...... 44 Figure 27: PMSPL’s Sr. GIS specialist presenting the AGOL platform at the CLA meeting on August 14, 2018...... 45 Figure 28: The LED project was announced on USAID/Lebanon’s FB page ...... 46 Figure 29: US Ambassador Elizabeth H. Richard (left) with the Heads of municipalities that received funding through BALADI . 47 Figure 30: Lebanon’s First Lady planting a tree during the LRI reforestation event in Bcharre ...... 47 Figure 31: “The Litani is Lebanon’s artery: Don’t let it die!” - a slogan for LWP’s Litani river campaign ...... 48 Figure 32: An IM Capital beneficiary (right) created an interactive educational software that won her the Cartier Woman’s Initiative Award for the MENA region ...... 48 Figure 33: Social Media intervention at the DOC meeting ...... 49 Figure 34: Interventions at the DOC meeting ...... 49 Figure 35: Education poster released in Q1FY2018 ...... 50 Figure 36: Water poster released in Q2FY2018 ...... 50 Figure 37: Separate FGDs were held with women and men in Tripoli ...... 52
iii | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Figure 38: Stakeholders and partners discussing the gender assessment findings...... 53 Figure 39: PSMPL’s A&E team during a site visit to a BALADI project in Majdel Baana ...... 56 Figure 40: PSMPL II and BALADI teams during a site visit ...... 57
Table 1: SUMMARY OF PMSPL II ...... 2 Table 2: FY2018 Key Activities Status ...... 5
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | iv ACRONYMS A&E Architecture and Engineering ADS Automated Directives System AGOL ArcGIS OnLine AOR Agreement Officer’s Representative AT+ AIDtracker Plus AUB American University of Beirut BALADI Building Alliances for Local Advancement, Development, and Investment BALADI CAP BALADI Capacity Building CBC Capacity Building Component CDCS Country Development Cooperation Strategy CDP Community Development Project CEDG Civic Engagement for Democratic Governance CEI Civic Engagement Initiative CIO Chief Information Officer CIRS Context Indicator Reference Sheet CL Caritas Lebanon CLA Collaborating, Learning, and Adapting CLIN Contract Line Item Number COP Chief of Party COR Contracting Officer’s Representative CSO Civil Society Organization CSP Community Service Project DAHNT Dar al Handasah Nazih Taleb DCOP Deputy Chief of Party DEC Development Experience Clearinghouse DO Development Objective DOC Development Outreach and Communication DQA Data Quality Assessment DR Design Review DV Data Verification EGA Education Gender Assessment EQUI Evaluation, Quality, Use, Impact FB Facebook FGD Focus Group Discussion FY Fiscal Year GE/FE gender equality/female empowerment GIS geographic information system GOL Government of Lebanon HCP Higher Council of Privatization HEP Higher Education Project HO Home Office IDIQ Indefinite Delivery, Indefinite Quantity IE Impact Evaluation IM Implementing Mechanism IP Implementing Partner IPTT Indicator Performance Tracking Table IR Intermediate Result KII Key Informant Interview KM Knowledge Management v | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV LAU Lebanese American University LED Lebanon Enterprise Development LIFE Livelihoods and Inclusive Finance Expansion LIVCD Lebanon’s Industry Value Chain Development LRI Lebanon Reforestation Initiative LWP Lebanon Water Project M&E monitoring and evaluation MEHE Ministry of Education and Higher Education MEL monitoring, evaluation, and learning MENA II Middle East and North Africa Investment Initiative MSI Management Systems International NGO Non-Governmental Organization NXP Non-Expendable Property ODK Open Data Kit PAD Project Appraisal Document PEA Political Economy Assessment PIRS Performance Indicator Reference Sheet PMP Performance Management Plan PMSPL Performance Management and Support Program for Lebanon PMU Project Management Unit PPL Policy, Planning, and Learning PPP Public-Private Partnership PPR Performance Plan Report PSD Private Sector Development PSV Project Site Visit QITABI Quality Instruction Towards Access and Basic Education Improvement RF Results Framework RFP request for proposal RMF Rene Moawad Foundation SI Social Impact, Inc. SOO Statement of Objectives SOW Scope of Work TBT Throwback Thursday TL Team Leader TO Technical Office TVET Technical and Vocational Education and Training UNDP United Nations Development Program UNHCR United Nations High Commissioner for Refugees UNICEF United Nations Children’s Fund USAID United States Agency for International Development USP University Scholarship Program
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | vi EXECUTIVE SUMMARY Social Impact, Inc. (SI) was awarded the contract for the Performance Management and Support Program for Lebanon (PMSPL) II project on October 1, 2015. The award amount to SI under contract number AID-268-C-15-00001is $24,664,441, inclusive of fixed fees. The contract is a cost-plus-fixed-fee (CPFF) term contract. This annual progress report covers one year of project implementation from October 1, 2017 through September 30, 2018.
The purpose of PMSPL II is to supplement the monitoring and program management efforts of USAID/Lebanon staff and to verify, monitor, and support USAID program performance in Lebanon, ensuring the achievement of the Mission’s Country Development Cooperation Strategy (CDCS) objectives for 2014–2018.
To streamline and manage the program’s tasks, Social Impact developed a work plan that outlined activities and deliverables during FY2018 based on the three main purposes listed below. The work plan was approved in Q2FY2018 and formed the basis for the work executed for the project. To keep track of the progress, quarterly reports were submitted by PMSPL II highlighting the achievements made in each quarter. This Annual Report is based on the FY2018 Quarterly Reports.
Highlights in the Annual Report are structured according to contract components (purposes) and the approved work plan:
PURPOSE 1: USAID MEL ACTIVITIES ENHANCED During FY2018, PMSPL II proceeded with supporting USAID in developing consolidated projects under the PMP DOs, including a revision of the PMP project logical framework.
Under Sub-Purpose 1.1 (Mission PMP Implemented and Maintained), PMSPL II initiated support for the project approval document (PAD) consolidation process in October 2017. The logical frameworks developed in FY2017 that were based on the concept of “one activity-one project” were revised to reflect the linkage between ongoing activities and the new consolidated project PADs.
Five log frames were developed in FY2018 to feed into the PMP results framework (RF). PMSPL finalized the log frames for the Community Development Project (CDP), Higher Education Project (HEP), and Private Sector Development (PSD) in Q3FY2018, and reinitiated work on Basic Education and Water in Q4FY2018.
For Output 1.1.2 (PMP Data Tracked and Collected), FY2017 data collection was completed in Q2FY2018. In Q3FY2018, PMP data collection and narrative explanations for the reporting period of Q1 and Q2 FY2018 were completed for all PMP indicators that were being reported on a quarterly and semi-annual basis.
The EG data collection was consolidated per project, and an effort was made to reconsolidate the PMP data as of FY2014 in addition to out-year targets. Data were presented and integrated as part of the semi-annual USAID portfolio review presentations. Data collection and narrative explanations for Q3 and Q4FY2018 will be done in Q1FY2019.
vii | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Under Sub-Purpose 1.2 (Improved Implementing Mechanism Monitoring and Evaluation), PMSPL II worked with several implementing mechanisms (IMs) to develop MEL plans as per the FY2017 updated Automated Directives System (ADS) requirements. In FY2018, PMSPL II submitted the updated MEL plans of the following IMs to USAID: BALADI, QITABI, and LED.
PMSPL II also started implementing the IM beneficiary database with LIFE; initiated its support to guide the IMs in aligning their RFs, MEL plans, and PSD activities with the associated project-level guidelines; and conducted data quality assessments (DQAs) for MENA and LIFE.
Under Sub-Purpose 1.3 (Increased Integration of Gender into USAID/Lebanon’s Activities), PMSPL II and Encompass collaborated on several tasks in FY2018, including the CDCS gender analysis, the yearly partners workshop, and the 2018 Country Gender Assessment.
PMSPL II’s Gender Specialist reviewed the SOW for all evaluations and assessments for gender sensitivity, including the performance evaluations of BALADI CAP, LIVCD, and LRI. She also finalized the Gender in Education Resource Guide and uploaded it on the DEC.
PMSPL II provided gender-related support to various IMs, such as reviewing QITABI's MEL plan, MENA II’s draft mid-term evaluation Inception Report, the draft of LED's MEL plan, and LIFE’s work plan.
PMSPL II’s Gender Specialist supported the integration of the 5Rs framework side by side with the 5 Domains of the USAID Gender Analysis framework. This tool is now being used to elaborate all SOWs for assessments and develop consolidated project results frameworks.
In FY2018, the Gender Specialist also provided Lebanon’s Ministry of Education and Higher Education (MEHE) with links to the three Education Gender Analyses posted on the USAID DEC and wrote a report on Gender Coverage in USAID projects in Lebanon. Furthermore, she provided gender- integration guidance to both the EGA team and SI’s A&E partner, Dar al Handasah Nazih Taleb (DAHNT).
Under Sub-Purpose 1.4 (Increased Field-Level Monitoring Activities), a project site visit (PSV) schedule was submitted and approved accordingly at the beginning of each quarter. The PMSPL II team conducted the field visits and assessed projects as per the agreed-upon schedule. In FY2018, 16 PSVs were conducted. Members of the PMSPL II team also attended a 5-day M&E Summit held at USAID’s regional Middle East Bureau in Frankfurt.
Under Sub-Purpose 1.5 (Increased Integration of a Geographic Information System [GIS] into Mission and IM Activities), several goals were accomplished. The Mission issued a request to PMSPL II’s GIS Specialist to develop a procedure to periodically update the activities of all the IMs in the GIS. Accordingly, an Excel form was developed and shared with the IMs. The list was also incorporated as a new GIS layer in the master geo-database and used to produce several maps showing the distribution and density of beneficiaries and allocated budgets per IM.
Maps generated by PMSPL II’s GIS Specialist in FY2018 include: LIVCD’s activities per value chain; BALADI RMF’s Round 3 applicants’ distribution; Syrian refugees’ distribution as per the latest UNHCR dataset; LRI’s planting sites; sites to be supervised by the A&E team (for BALADI Caritas, BALADI RMF,
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | viii and LWP); CSOs’ capacity-building activities (to support the mid-term performance evaluation of BALADI CAP); public schools that received new buses from QITABI; 2018 elections; etc.
The GIS Specialist continued work to establish an AGOL platform for USAID Lebanon. After looking at different techniques to build the website, he opted to use the Web-app builder over the predefined templates. He also created new Open Data Kit (ODK) forms for several LIVCD and LWP inventory checks.
Under Sub-Purpose 1.6 (Increased Integration of AIDtracker Plus [AT+] into Mission and IM Activities), PMSPL II was informed that USAID was decommissioning the AT+ system as of June 2019 due the high costs associated with the platform. A new system called Development Information Solution (DIS) will be deployed to provide all of AT+’s functionality minus the challenges and difficulties.
Under Sub-Purpose 1.7 (Improved Evaluation Assistance Provided by PMSPL II), three evaluations were carried over from FY2017. They are: QITABI’s final evaluation (finalized in March 2018); MENA II’s midterm evaluation (finalized in March 2018); and BALADI CAP’s midterm evaluation (finalized in September 2018). PMSPL II also initiated LIVCD’s final evaluation in Q4 FY2018.
Under Sub-Purpose 1.8 (Capacity Building of Local Organizations to Monitor and Evaluate Projects Increased), PMSPL II originally expected to select two organizations by September 2018, however, we had to repost the call since only two companies responded to the CEI and one of them did not even meet the requirements. The CEI was edited, refined, and reposted in October.
PURPOSE II: DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT INCREASED Purpose II includes establishing and supporting USAID collaborating, learning, and adapting (CLA) systems and tools, initiating knowledge management, and providing support for the DOC and project design process.
Under Sub-Purpose 2.1. (Project Design, Management, and Reporting Requests Completed by PMSPL II), work on the DO I Project Approval Document (PAD) consolidation process was initiated in Q2FY2018. There are three components here: - The Community Development Project PAD: Finalized and approved in October 2017. A detailed project MEL plan was developed and will be submitted once all PIRS are completed and revised. - The Lebanon Water Project PAD: PMSPL II submitted LWP’s MEL plan in February 2018. - The Basic Education PAD: PMSPL II developed a project MEL plan and a revised RF for the project. The first draft was submitted in September.
Following several meetings with USAID, it was decided that two PADs would emerge under DO II:
- The Private Sector Development PAD: PMSPL II supported the EG team in finalizing the PAD document, the PSD RF, and the log frame, as well as in drafting the PSD PAD memo. An elaborate MEL plan was also developed. - The Higher Education Program PAD: Approved in Q2FY2018.
ix | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Under Sub-Purpose 2.2 (CLA/KM Advanced Implementation), PMSPL II facilitated four EG CLA meetings in FY2018. The themes were: 1. Productive employment (Feb 2018); 2. Alignment with PSD (April 2018); 3. Public-Private Partnership (June 2018); and 4. Designing and Implementing Effective Evaluations (Aug 2018). Furthermore, a CLA case was submitted and has been selected as finalist out of 120 applications. It describes the process of “Refocusing an Economic Growth Strategy through CLA.”
Under Sub-Purpose 2.3 (Increased Development Outreach and Communication Activities by the Mission and Implementing Mechanism), PMSPL II worked extensively on the USAID/Lebanon Facebook page with various posts pertaining to: Holidays and special days such as Christmas and International Volunteer Day; Special themes such as #projectoftheweek and #yearinreview; USAID happenings such as the US Ambassador’s visits to the North; Beneficiary happenings such as LIFE’s beneficiaries who received funds to open their own businesses; IM activities such as the LRI reforestation campaign launching event; and IM-related campaigns such as the LWP Litani campaign.
The DOC team submitted a series of deliverables as well, including a USAID video which was filmed on site in various IM activity locations; five USAID posters on education, agriculture, reforestation, higher education, and microfinance; and a DOC survey to gauge the Lebanese people’s attitude towards USAID and the American Government and people.
PSMPL II also hosted the annual IM DOC meeting, during which the partners interacted with bloggers and experts in social media, photography, and video production who shared their expertise about creative and effective ways to increase publicity.
Under Sub-Purpose 2.4 (Special Studies, Assessment, and Additional MEL Requests Completed by PMSPL II), several assessments and surveys were initiated, conducted, or completed in FY2018:
- The Education Gender Analysis, which was initiated in Q4FY2016 and finalized in Q1FY2018. - The CDCS Gender Analysis, which began in January 2018 and was finalized in August 2018. - The Political Economy Analysis (PEA), which is expected to begin in Q2FY2019. - The Economic Growth Assessment (EGA), which was initiated and conducted in Q4FY2018. - The Citizens Perception Survey, which will be initiated once the Gender Assessment, EGA, and PEA are completed.
PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED Under this purpose, the PMSPL II team supports USAID’s oversight and management of engineering and construction activities executed under USAID/Lebanon projects and provides quality assurance and quality control services for design, tendering, and execution of these activities.
The key staff person for Purpose III is the senior engineer, who provides oversight to the subcontracted local architecture and engineering (A&E) firm, DAHNT.
Because of the increased workload resulting from the LWP design reviews and site inspections, PMSPL II recruited a Quality Management Engineer in Q3FY2018 to help improve the tracking and reporting of A&E oversight activities.
In Q3FY2018, a review of the QA/QC protocol with LWP was initiated to improve the communication
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | x between PMSPL and LWP and the coordination between DAHNT and the Quality Control Engineers subcontracted by LWP. Similarly, the QA/QC protocol for design reviews under BALADI was revisited to agree on the essential documents that needed to be submitted prior to the review and to shorten the review timeframe for BALADI Round Three projects.
Eighteen formal meetings were held in FY2018 with USAID, BALADI, and LWP to refine the QA/QC protocol. During the meetings, participants also discussed relevant adjustments that take into consideration the nature of the projects implemented under BALADI Round Three of municipal awards and the implementation schedule of six water-related construction projects sub-contracted under LWP.
Under Output 3.1.2 (Quality Assurance and Quality Control are Provided on the Implementer’s Engineering Design Activities), the Senior Engineer and the subcontracted A&E firm conducted extensive field oversight, inspections, and verifications to support the review of the design activities.
In FY2018, PMSPL II’s A&E Team along with DAHNT completed 137 design reviews and conducted 125 site verification visits to BALADI and LWP projects.
xi | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
PROGRAM OVERVIEW/SUMMARY
PROGRAM DESCRIPTION AND INTRODUCTION The United States Agency for International Development (USAID)/Lebanon’s (the Mission’s) Country Development Cooperation Strategy (CDCS) for 2014–2018 was approved in May 2015. The CDCS puts in place a results framework (RF) and development objectives that the Mission hopes to achieve during this period. The CDCS proposes an overarching goal of “improved accountability and credibility of public institutions, and broader economic prosperity.” This goal supports the broader U.S. objective of achieving stability in Lebanon and aligns with various Government of Lebanon strategy pronouncements. Development Objective 1—Improved capacity of the public sector in providing transparent, quality services across Lebanon—reflects a program emphasis on enhancing the quality and availability of basic education, addressing water-quality and municipal-level service delivery issues, promoting accountability and transparency in public institutions, and strengthening the ability of nongovernmental organizations and civil society generally to effectively participate in and contribute to democratic governance. Development Objective II—Enhanced economic opportunity—emphasizes the importance of increased private-sector competitiveness as well as increased access to finance, especially for new business start- ups and women entrepreneurs.
To achieve CDCS objectives, the Mission has awarded a portfolio of more than 20 active projects valued at more than $400 million. These projects address the needs of vulnerable communities struggling to deal with declining income prospects and a growing refugee population—for example, education, livelihoods, and access to potable water. The Mission engages with partners to increase access to education; improve water, wastewater, and irrigation services; promote good governance; enhance economic opportunity; and protect the environment. USAID/Lebanon is a lead donor in education and water and an important influence in championing good governance and broad economic prosperity.
The purpose of PMSPL II is to supplement the monitoring and program management efforts of USAID/Lebanon’s staff and to verify, monitor, and support USAID’s program performance in Lebanon, ensuring the achievement of CDCS objectives. (For a summary of the program, see Table 1.)
Gathered information and program support services provided by PMSPL II help the Mission to make informed decisions and better manage its awards. Each award is the responsibility of an implementing mechanism (IM) that designs activities aimed at achieving intended results. IM activities are performed throughout the country. PMSPL II provides consistent, relevant, and frequent performance monitoring and reporting on IM activities and projects; day-to-day information needed to make management decisions; and, most importantly, field monitoring support to USAID/Lebanon staff, especially for activities located outside of greater Beirut. According to USAID’s Collaborating, Learning, and Adapting (CLA) guide, “monitoring and evaluation will make significant contributions to the Mission’s efforts to continually assess and address knowledge gaps—however, these efforts must be reinforced with a learning approach to maximize their effectiveness.” Monitoring, evaluation, and learning (MEL) and program support services provided under the PMSPL II contract will facilitate and advance the Mission’s implementation of CLA at different levels.
1 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
Table 1: SUMMARY OF PMSPL II
Performance Management and Support Award name Program for Lebanon II (PMSPL II)
Activity start date September 30, 2015 to September 29, and end date 2020
Name of prime Social Impact implementing partner
Contract/agreement number AID-268-C-15-00001
Geographic coverage Lebanon (cities and/or countries)
Reporting period October 1, 2017 to September 30, 2018
USAID will use PMSPL II’s services to:
• Develop and support the implementation of USAID/Lebanon’s Performance Management Plan (PMP);
• Support the Implementing Partners’ monitoring and evaluation efforts;
• Integrate gender issues into USAID/Lebanon’s activities;
• Support USAID/Lebanon’s monitoring activities;
• Support USAID/Lebanon’s geographic information system (GIS) activities;
• Support USAID/Lebanon’s integration to the AIDtracker Plus (AT+) system;
• Provide evaluation assistance;
• Build the capacity of local organizations in monitoring and evaluation;
• Assist in project design, management, and reporting support;
• Advance CLA implementation;
• Provide architecture and engineering (A&E) services;
• Provide Development Outreach and Communication (DOC) support; and
• Provide program support and additional MEL services.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | 2 REPORTING PMSPL II WORK PLAN ACTIVITIES At the start of Fiscal Year (FY) 2018, PMSPL II submitted its annual work plan to the Mission. The work plan serves as the basis for planning and scheduling PMSPL II activities throughout the year and for monitoring the progress that PMSPL II is making. The work plan highlights the main outputs pertaining to each purpose, including a set of indicators and a timeline that estimates the schedule of execution as well as the expected duration for each sub-purpose. PMSPL II’s work plan Purposes and Sub-Purposes also align with contract components and provide a framework that identifies how PMSPL II’s tasks serve contract objectives. This same framework provides the outline for a weekly report (a deliverable) that tracks work plan task progress and achievement. Each week, staff who are assigned to a task are responsible for reporting its status online. The weekly report is generated automatically and is part of an automated management system. PMSPL II’s management system also generates a draft quarterly report that draws on the weekly reports. The automatically generated draft quarterly report is then reviewed, condensed, and clarified.
This annual report combines all the activities and key achievements accomplished in FY2018.
PURPOSES AND SUB-PURPOSES The PMSPL II annual work plan was submitted in Q1 FY2018 to the Mission and approved in Q2 FY2018. The work plan is divided into three main purposes (aligned with the three contract components) and multiple sub-purposes as follows:
PURPOSE 1: USAID’S MEL ACTIVITIES ENHANCED • Sub-Purpose 1.1: The Mission PMP Implemented and Maintained
• Sub-Purpose 1.2: Improved Implementing Mechanism Activity Monitoring and Evaluation
• Sub-Purpose 1.3: Increased Integration of Gender into USAID/Lebanon’s Activities
• Sub-Purpose 1.4: Increased Integration of GIS into Mission and Implementing Mechanism Activities
• Sub-Purpose 1.5: Increased Integration of AT+ into Mission and IM Activities
• Sub-Purpose 1.6: Increased Field-Level Monitoring Activities
• Sub-Purpose 1.7: Improved Evaluation Assistance Provided
• Sub-Purpose 1.8: Capacity Building of Local Organizations to Monitor and Evaluate Projects Increased
PURPOSE II: INCREASED DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT • Sub-Purpose 2.1: Project Design, Management, and Reporting Requests Completed by PMSPL II
3 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV • Sub-Purpose 2.2: CLA Implementation Advanced
• Sub-Purpose 2.3: Increased Development Outreach and Communication Activities by the Mission and IMs
• Sub-Purpose 2.4: Special Studies, Assessments, and Additional MEL Requests
PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED • Sub-Purpose 3.1: IMs’ Engineering Design and Construction Implementation Are Reviewed and Monitored
• Sub-Purpose 3.2: USAID/Lebanon A&E Activity Reporting Increased and Construction Completion Certification Enhanced
WORK PLAN MEETING AND APPROVAL PMSPL II’s work plan is revised annually, and the revision for FY2018 was conducted at the end of FY2017. A first draft of the work plan was submitted on October 17, 2017. This work plan includes an estimated budget by contract line item number (CLIN). Several revisions of the work plan benefited from Mission comments and refinements of proposed tasks. The work plan was approved on December 6th, 2017.
QUARTERLY REPORTS At the end of every quarter, PMSPL II provided the Mission with quarterly progress reports highlighting the project’s activities, accomplishments, and performance during that period. These reports also included the challenges encountered in that quarter and the activities planned for the next one.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2018 | 4 KEY ACTIVITIES STATUS FOR FY2018 Table 2: FY2018 Key Activities Status
PURPOSE/ SUB-PURPOSE OUTPUTS PLANNED ACTIVITIES STATUS COMMENTS
Sub-Purpose 1.1: Output 1.1.1: Log frames Update of DO I and DO II log frame Ongoing Remaining is BE and LWP Mission PMP developed/reviewed (on hold) Implemented and Maintained
Output 1.1.2: PMP data tracked Revise and submit baseline and targets / Ongoing Scheduled for November and collected during and after the PPR/as Q3 data collection EG aligned MEL plans were not yet approved.
Output 1.1.3: PMP PIRSs/CIRSs Update PMP PIRSs/CIRSs Ongoing Linked to revisions of revised and updated project level PIRS
Update EG PIRS Completed
Output 1.1.4: PMP monitoring Update FY2018 schedules for performance Ongoing and evaluation schedule updated management, evaluation, assessment, DQAs, and other monitoring tasks
Sub-Purpose 1.2: Output 1.2.1: Implementing Continue with MEL plan development support Improved mechanisms supported until approved by USAID: Implementing Mechanism Completed Monitoring and QITABI Evaluation BALADI CAP Completed
LED MEL Plan development LED approved
Complete MEL plan alignment of EG LRI approved activities under PSD
Sub-Purpose 1.3: Output 1.3.1: Ensure structural Complete work on the resource guide on Completed Increased gender mainstreaming in all stages gender integration in education Integration of of design, planning,
Gender into implementation, and evaluation of Field work Work is progressing as USAID/Lebanon’s program activities Finalize the gender CDCS assessment field completed, data planned. Activities work and initiate data analysis analysis is ongoing
5 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Provide one-to-one support to IMs as needed Ongoing Support was given to LED and LIFE
Review project docs as needed Ongoing
Sub-Purpose 1.4: Output 1.4.1: Activity progress DV LRI FY2017 Completed Increased Field- monitored and implemented in Level Monitoring compliance with USAID DV LIVCD FY2017 Completed Activities regulations—PSVs BALADI CL DV FY2017 Completed BALADI RMF DV FY2017 Completed DQA MENA II Completed NXP LWP Completed NXP LIVCD Completed BALADI CL DV Q2-Q3 FY2018 Completed BALADI RMF DV Q2-Q3 FY2018 Completed QITABI DV Completed MENA DV Q1-Q2FY2018 Completed LIFE DV Q1-Q2FY2018 Completed LRI DV Q1-Q2FY2018 Completed
Sub-Purpose 1.5: Output 1.5.1: Data from current Quarterly updates of activity data for all IMs Ongoing Increased and previous projects integrated Integration of GIS and AT+ into Mission and IM Activities
Output 1.5.2: Search for online UNDP Data Source Completed data sources finalized Periodic search of United Nations Completed Submitted Syrian Refugees Development Programme (UNDP) and other related MAPs donor data sources
Output 1.5.3: Standardized Revised as needed to reflect current official Ongoing Ongoing administrative boundaries and boundaries and names names
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 6 Output 1.5.4: Access to the GIS Generate maps for Mission Completed Submitted as requested Unit Lebanon database established Generate maps for IMs Completed Submitted as requested LIVCD Completed BALADI Completed
Output 1.5.5: Automated field ODK form for DQA Ongoing Upon request, completed data collection LIVCD NXP
Sub-Purpose 1.6: Output 1.6.1: IMs’ regular use and Data reporting on AT+ Ongoing as needed Increased update of AT+ Integration of AT+ Support transition to DIS Ongoing into Mission and IM Activities
Output 1.6.2: Support USAID Support transition to DIS Ongoing as needed AT+ admin and A/COR using AT+ provided
Sub-Purpose 1.7: Output 1.7.1: Effectiveness of Submit QITABI evaluation report Completed Improved USAID’s projects examined Evaluation (relative to the stated DOs and Assistance Provided development hypothesis) by PMSPL II Initiate MENA midterm evaluation Completed
BALADI CAP midterm evaluation Completed Received MD comments on BALADI CAP final evaluation. Report revised and resubmitted. LIVCD final evaluation Initiated LRI Evaluation Initiated
Output 1.7.2: Corrective actions Adaptive management to be introduced Ongoing following at the different management approval of final levels facilitated Receive feedback on MENA post evaluation evaluation report action plan
Receive feedback QITABI post evaluation Received action plan
7 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
Draft B-CAP post evaluation action plan Ongoing
Sub-Purpose 1.8: Output 1.8.1: MEL capacity of Provide capacity-building support/training to Upon request Capacity Building of USAID local partners/grantees USAID partners to increase monitoring and Local Organizations improved evaluation capability and effectiveness to Monitor and Evaluate Projects Increased
Output 1.8.2: Lebanon’s capacity Identify two local organizations, provide them Initiated Submitted SOW to monitor and evaluate technical assistance and training to advance enhanced their ability and competence to conduct Released CEI monitoring and evaluation activities
Sub-Purpose 2.1: Output 2.1.1: USAID Mission Complete CDP MEL plan Completed RFP released Project Design, project design process supported Management, and Reporting Requests Work on the elaborated CDP MEL plan On hold until further notice from Completed by USAID PMSPL II PSD PIRS and data Finalize PSD corresponding MEL plan collection tools finalized. BE initiated and draft submitted
Finalize LWP consolidating PAD and On hold LWP review submitted corresponding MEL plan pending USAID feedback put on hold as per USAID
request. On hold Initiate work on IBESP MEL plan
No request made Train USAID staff on project design HEP PAD approved Completed Finalize HEP corresponding MEL plan
Sub-Purpose 2.2: Output 2.2.1: MEL tool updated MEL tool updated Ongoing BALADI and QITABI CLA Advanced and utilized updated and utilized Implementation Separate tools for IP MEL tracking were utilized
Output 2.2.2: CLA activities CLA initiatives supported Initiated CLA learning events implemented launched
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 8 EG CLA event conducted on “effective evaluations”
Conduct CLA assessment for USAID offices Initiated and develop the USAID CLA plan Support and facilitate EG CLA events Ongoing
Sub-Purpose 2.3: Output 2.3.1: Public awareness of Deliver weekly FB calendar Ongoing Continuous activity Increased USAID assistance and program Development achievements supported Continuous activity Outreach and Communication Activities by the Mission and IMsl
Deliver weekly media coverage report Ongoing
Output 2.3.2: Communication Prepare FB posts based on input and feedback Ongoing Continuous activity materials for USAID Mission of IMs developed and packaged
Output 2.3.3: Periodic logistical Attend and support IM events As per Mission request support for USAID DOC unit provided
Output 2.3.4: Program USAID video Completed information dissemination and development outreach know-how provided
USAID posters Completed
USAID DOC survey Completed USAID DOC partners meeting Completed
Sub-Purpose 2.4: Output 2.4.1: Mission’s decision- Final report for the CDCS gender assessment. Completed Report submitted Special Studies, making process facilitated Assessment, and EGA assessment Initiated Additional MEL Requests PEA PEA SOW cleared Completed by PMSPL II Citizens’ perception survey (CPS) CPS SOW being finalized, to be initiated after PEA
9 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Output 2.4.2: Identification of Identify potential development partners and Develop PPP guidelines for potential PPP partners and partnership opportunities municipalities (to be partnership opportunities proposed/ approved by USAID)
Output 2.4.3: Proactive Engage with Lebanon’s civil society, local Remaining alert to engagement with Lebanon’s civil stakeholders, private sector, economic actors, opportunities society and economic actors to and diaspora to identify development partners explore Mission development partner opportunities
Sub-Purpose 3.1: Output 3.1.1: Engineering designs, Conduct engineering, drawing reviews for Ongoing IMs’ Engineering specifications, and engineering BALADI and LWP Design and submissions are reviewed and Construction verified Implementation Are Reviewed and Monitored
Output 3.1.2: Quality assurance Conduct quality assurance visits for BALADI Ongoing and quality control are provided and LWP on the implementer’s engineering design activities
Sub-Purpose 3.2: Output 3.2.1: Increased USAID Ensure that the engineering and construction Ongoing USAID/Lebanon information about the challenges, contracts’ conditions and specifications are A&E Activity progress, and completion of work fulfilled Reporting Increased Ongoing Regularly and Construction Submittal of Minutes of Meetings to brief Completion USAID about status of field work or challenges Certification Enhanced Output 3.2.2: Completion of Pending projects completions Ongoing engineering work verified by PMSPL
Reports Reports submitted Quarterly report Q1, Q2, Q3, and Q4 FY2018 Weekly progress reports Weekly FB posts calendar Weekly media summary Monthly media report A&E reports
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 10 BALADI CAP midterm evaluation CDCS gender assessment M&E field monitoring reports PPR indicator tables Projects Presentations for USAID portfolio review
11 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV MAIN CHALLENGES ENCOUNTERED IN FY2018 - A new USAID vetting system was adopted, and delays occurred on different levels as staff couldn’t quite figure out how to work with it. - The team had to carry out intense evaluation and assessment field work, mainly under the gender assessment and the BALADI midterm evaluation. - The team had difficulty finding qualified local consultants and specialized PEA consulting firms to hire. - The team encountered challenges in aligning activities with the Private Sector Development (PSD) project RF. - The IPs lacked the capacity to provide GIS data in an accurate and timely manner. - During workshops and CLA events maintaining the full-time attention of attendees was challenging. - As part of the USAID documentary preparations, the team encountered difficulties in filming USAID beneficiaries. - The timely preparation of some task orders particularly at the beginning of the year was a challenge. - The A&E team faced communication difficulties with the partners. - The timely submission of A&E deliverables was a remarkable challenge this quarter due to a tight timeframe and considerable workload, especially as IPs were often behind schedule. - Adapting the team composition under the A&E TOs to the Mission’s needs was also a notable challenge this quarter.
SUMMARY OF RESULTS TO DATE Please see Annex A for details on PMSPL II indicators and progress.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 12 ACTIVITY IMPLEMENTATION PROGRESS
PURPOSE I: USAID MEL ACTIVITIES ENHANCED Key Accomplishments
• Continued the log frames’ revision in alignment with the project’s consolidation process under 2.1. • Initiated work on the Basic Education Project log frame. • Completed FY2017 annual data collection. • Submitted FY2017 PPR. • Completed DQAs for LIFE and MENA II. • Initiated and completed LED MEL plan support. • Reconsolidated EG data for PSD. • Initiated IM’s MEL plan alignment with PSD. • Finalized the ‘gender in education’ resource guide. • Organized and conducted the annual gender workshop on the education resource guide. • Carried out DVs for LRI, LIVCD, LIFE, LWP, MENA, QITABI, BALADI, BALADI Caritas, and RMF. • Completed NXP verifications for LIVCD and LWP. • Designed maps for: BALADI round 3 activities, LIVCD value chains, LRI satellite images, the gender analysis field work, EG-related activities, election/voting data, BCAP evaluation, A&E work, USAID activities distribution, public schools that received school buses through QITABI. • Established and improved the ArcGIS Online (AGOL) Platform for USAID Lebanon. Populated AGOL with up-to-date IM data. • Completed Q1 and Q2 FY2018 data reporting on AT+ and started preparing for transitioning to DIS after AT+ was decommissioned. • MENA and QITABI evaluations were approved and uploaded on DEC. • Completed the BALADI CAP midterm evaluation. • Received SOOs for LIVCD and LRI final evaluations and finalized drafting the SOWs. • Initiated the LIVCD final evaluation. • Finalized the LWP mid-term evaluation SOW. • Supported the semi-annual portfolio review.
Purpose I focuses on supporting USAID/Lebanon’s oversight and learning. It consists of three main Sub- Purposes that focus on: Developing and implementing the performance management plan (PMP), improving the IM monitoring and evaluation process, increasing field-level monitoring activities, and conducting formative and summative evaluations.
SUB-PURPOSE 1.1: MISSION PMP IMPLEMENTED AND MAINTAINED Work pertaining to Output 1.1.1 (PMP Log Frames Developed/Reviewed) focuses on reviewing PMP (approved in FY2016) log frames. During FY2018, PMSPL II proceeded with supporting USAID in developing consolidated projects under the PMP DOs, including a revision of the PMP project logical framework.
13 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
Log Frames for Development Objectives
In October 2017, PMSPL II initiated support for the project approval document (PAD) consolidation process. Results under this output are connected to the progress under 2.1. PMP log frame review and linked to the PAD consolidation process. The logical frameworks developed in FY2017 that were based on the concept of “one activity-one project” were revised to reflect the linkage between ongoing activities and the new consolidated project PADs.
PMSPL II has been supporting the design of five projects since Q1FY2018; as such, five log frames were developed to feed into the PMP results framework (RF). Progress under this sub-purpose is directly linked to the advancement of the project consolidation process, which is further described under sub- purpose 2.1.
PMSPL designed two project log frames in Q2 FY2018 and integrated them under DO II:
• The HEP log frame will serve Intermediate Result (IR) 2.1.3 and will cover the university scholarship program (USP) and other higher-education and workforce development activities that may be designed in the future. The HEP log frame was revised and shared with the USAID contact person in Q1FY2018. The HEP PAD was approved in Q2FY2018. • The PSD log frame serves the Economic Growth’s DO’s two IRs, which include activities such as Livelihoods and Inclusive Finance Expansion (LIFE), Middle East and North Africa Investment Initiative (MENA II), Lebanon Reforestation Initiative (LRI), Lebanon’s Industry Value Chain Development (LIVCD), and Lebanon Enterprise Development (LED). The PSD log frame was approved in April 2018.
Under DO1 and during Q2FY2018 also, PMSPL provided the needed support for the design of two logical frameworks for governance and water. Work on the basic education was initiated in Q4FY2018 and a draft was submitted to USAID. Three project log frames feed under DOI:
• The CDP logical framework serves IR 1.3 and 1.4 and will cover the upcoming Community Service Project (CSP) activity and other future governance related activities. The CDP was submitted to USAID on January 26th, 2018 prior to the request for proposal (RFP) release for the Community Service Project, which is the main activity under CDP so far. • The Lebanon Water Project (LWP) logical framework serves IR 1.2 and includes all water- and wastewater-related activities, including the ongoing LWP activity. LWP’s proposed log frame was submitted to USAID on February 7th, 2018. • The Basic Education log frame serves IR 1.1 and includes support to public schools and the current Quality Instruction Towards Access and Basic Education Improvement (QITABI) activity in addition to activities implemented through UNICEF and new planned basic education activities.
The table below highlights the projects’ contribution to each of the respective DOs. PMSPL finalized the log frames for the Community Development Project (CDP), Higher Education Project (HEP), and Private Sector Development (PSD) in Q3FY2018, and reinitiated work on Basic Education and Water in Q4FY2018.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 14 USAID/Lebanon’s goal: “Improved accountability and credibility of public institutions, and broader economic prosperity”
Development Objective 1: Improved capacity of the public Inclusive economic growth sector to provide transparent, quality services across Development Objective 2: enhanced Lebanon
Improved Basic Education Services Project Higher Education Project Lebanon Water Project Private Sector Development Project Community Development Project Building Alliance for Local Development and Investment Project
IR1.1: Expanded access to quality education for vulnerable IR 2.1: Increased private sector competitiveness students in Lebanese public schools
IR 1.2: Improved availability of water-related public IR 2.2: Increased access to finance, especially for services for all in Lebanon business start-ups and women entrepreneurs
IR 1.3: Improved governance in addressing citizens’ needs in public service delivery
IR 1.4: Strengthened civil society contributing effectively to participatory and democratic governance
Figure 1: USAID projects alignment with CDCS
Resulting from the DO II consolidation process, activities are now associated with a lead project and their respective results are combined in one log frame.
PMP DATA TRACKED AND COLLECTED Regarding Output 1.1.2 (PMP Data Tracked and Collected), in FY2016 PMSPL II proceeded with implementing the PMP by updating the PMP indicator tracking table, with new baselines and targets submitted by the implementing partners who had completed the development of their MEL plans. In FY2017, following the approval of the IM MEL plans, PMP data collection was done retroactively for FY2016, FY2015, and FY2014, whenever applicable.
In Q1FY2018, PMP data collection and narrative explanations for the reporting period of Q1, Q2, and Q3 FY2017 were completed for all PMP indicators that were being reported on a quarterly basis. Data collection continued in Q2FY2018 for indicators that are being reported on annually to complement the data that were compiled as part of the PPR data collection. FY2017 data collection was completed in Q2FY2018. DO- and IR-level data was discussed during the semi-annual USAID portfolio review in May 2018.
In Q3FY2018, PMP data collection and narrative explanations for the reporting period of Q1 and Q2 FY2018 were completed for all PMP indicators that were being reported on a quarterly and semi-annual basis. The EG data collection was consolidated per project, and an effort was made to reconsolidate the PMP data as of FY2014 in addition to out-year targets. Data was presented and integrated as part of the semi-annual USAID portfolio review presentations.
15 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV • Support for the Semi-Annual USAID portfolio review During May 2018, PMSPL intensively worked with the USAID program office to design the needed material for the project-level, semi-annual portfolio review. While USAID/Lebanon is moving forward with the activity consolidation process, the semi-annual portfolio review was to lead discussions of progress at the project level with less emphasis on the activities’ implementation. The PIR material needed to be designed accordingly while its outline was guided by the automated directives system (ADS) 201. Presentations for each project were designed using a standard outline covering performance monitoring and evaluation that aim to lead discussions around project progress, CLA, and post- evaluation action plans. All four presentations were circulated with the program and technical offices, and adjustments were made to include their inputs as needed.
Data collection and narrative explanations for Q3 and Q4FY2018 will be done in Q1FY2019 as part of the PPR data collection process reflecting new approved targets as a result of the EG consolidation process.
SUB-PURPOSE 1.2: IMPROVED IMPLEMENTING MECHANISM MONITORING AND EVALUATION PMSPL II supports the IMs in their MEL development by: Reviewing their MEL plans and aligning them with the new PMP and the new project-level MEL plans; offering them coaching sessions on MEL fundamentals; developing MEL guides for them; and standardizing and systemizing their reporting process. This work takes place throughout the year in close coordination with the Mission.
The PMSPL II team provides technical assistance and guidance to current and new USAID/Lebanon IMs on MEL-related issues. PMSPL II helps IMs develop MEL plans in compliance with Automated Directives System 201 (ADS 201) requirements. Below is a description of the work done with IM MEL in FY2018.
BALADI MEL PLAN In Q2FY2017, Building Alliances for Local Advancement, Development, and Investment (BALADI) Rene Moawad Foundation (RMF) and BALADI Caritas Lebanon (CL) submitted revised MEL plans with new targets for aligned indicators. The targets for RMF were approved in Q2FY2017. CL revised targets were submitted in Q3FY2017, and PMSPL II provided feedback for further revision.
In Q4FY2017, CL addressed these comments, made the necessary modifications to the document, and shared the revised targets. Following CL’s submission, and as per the Mission’s request, PMSPL II reviewed the updates for finalization and identified some issues that needed further consideration. The targets were finalized in Q1FY2018 and approved in Q2FY2018.
RMF is currently revising its targets, as BALADI was extended until 2019. PMSPL II has not received approval confirmation from USAID for the revised targets in FY2018.
QITABI MEL PLAN In Q1FY2018, PMSPLII received a request from QITABI to review the project’s year 4 MEL plan. PMSPL II provided minor recommendations and the adoption of the updated MEL plan template that incorporates the new ADS references. QITABI addressed the comments, adopted the new MEL plan template, and submitted the MEL plan to USAID.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 16 LED MEL PLAN Support for the LED MEL plan development was initiated during a meeting held on December 7th, 2017. Following the meeting, PMSPL II shared necessary support documents and templates with the LED team, including the MEL plan template, relevant performance indicator reference sheets (PIRS) for PMP indicators, and the revised PMP indicators list.
In January 2018, PMSPL II received a request to review the LED MEL plan that was submitted to USAID. Accordingly, comments and necessary adjustments were shared with the LED Contracting Officer’s Representative (COR).
In FY2018, while PSD was not yet made public, PMSPL II submitted four alignment propositions for the PSD to USAID in a separate document. The team shared the alignment propositions document during a meeting with LED on April 16th. This effort intends to support USAID, LED and PMSPL II discussions on the LED RF revision and to which extent LED can change its current RF design and contribute effectively to the PSD.
LED revised its RF to reflect PMSPL propositions and its contractual requirements; however, they did not send any additional feedback in Q3FY2018. During Q4FY2018, PMSPL reviewed and updated the MEL plan submitted by LED. The team also shared a list of comments and the revised MEL plans with the LED COR and LED team.
From looking at LED contract section C and the approved work plan, PMSPL identified an opportunity to design a LED RF and align it with PSD based on the theory of change mentioned in the LED contract and a few contract statements.
After several reviews and taking into consideration PMSPL’s proposed RF aligned with PSD, aA meeting took place on Monday August 2nd, 2018, during which PMSPL and USAID went over the latest MEL plan review including PMSPL comments on the RF and set targets. On August 6th, LED held another meeting to discuss the proposed changes and reach agreement.
Accordingly, LED submitted a revised MEL plan that was reviewed and sent back to USAID on September 10th. Needed changes were made in track changes to the RF and LF to avoid additional rounds of reviews. USAID approved the LED MEL plan at the end of September.
BENEFICIARY DATABASE During FY2016, PMSPL II finalized an IM beneficiary database that was developed to ensure reliable reporting on training and beneficiaries among all IMs while avoiding double-counting and duplication of beneficiaries under the same reported indicator. This database was designed to harmonize name translation and reduce the number of misspelled beneficiaries. PMSPL II’s GIS Specialist recommended closing the pilot database project with BALADI RMF, given the large data sets that needed restructuring.
In Q4FY2017, it was agreed that the beneficiary database would be implemented with LIFE, since it was a newly established IM. After several working sessions to review the beneficiary database and assess how it could be used internally, the updated database was sent to LIFE to populate it with relevant data. During Q1FY2018 and as part of the Data Quality Assessment (DQA) for LIFE, the database was verified as being used by the MEL team for data collection and reporting. PMSPL II scheduled a follow-up
17 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV session in Q2FY2018 to review the progress of data entry and make the necessary adjustments to ensure the database was capturing all needed datasets. Accordingly, edits and updates were incorporated into the database so that LIFE could fully report on its indicators and disaggregation by generating results from it. The revised version was shared with LIFE’s M&E Coordinator. Because of the data verification (DV) that was conducted in Q3FY2017, the PMSPL team working with LIFE’s M&E Coordinator was able to identify potential areas of improvement. Additional adjustments were later communicated to the GIS specialist, who provided LIFE with guidance and an updated Access database.
In Q4FY2018, LIFE’s M&E officer attended a meeting at PMSPL II’s offices to review the functionality of the database and assess the needs for customization. Customization mainly consists of automatically importing Excel sheets (list of beneficiaries) into the database rather than entering the data manually. Towards the end of September, PMSPL received a sample list to develop a script accordingly. The Senior GIS Specialist was unable to link the new beneficiaries into their related events using the database programming features and therefore decided to shift programming to Visual Basic to accommodate the needed adjustments. This work will continue in FY2019.
MEL ALIGNMENT In Q3FY2018, PMSPL II initiated its support to guide IMs in aligning their RFs and MEL plans properly with the associated project-level MELs. The following section will report on alignment status for each activity under PSD as of Q3FY2018. This task will be triggered by the PAD and project MEL plan approvals. The PSD was approved in Q3FY2018 and released on April 16th at the EG partners meeting.
In Q4FY2018, alignment efforts were geared towards PSD, as it includes several activities at diverse implementation stages. Within that scope, general guidance on how to align activities was circulated to the partners through the EG technical office. The PSD PIRS and indicators tracking sheets were submitted for approval and then shared with the PSD IMs to be incorporated in their MEL plans:
LIFE: A meeting was held on May 17th to support LIFE in revising their RF and indicators. A second meeting took place on June 25th to discuss LIFE alignment. Additional PIRS were requested and sent to LIFE.
LRI: A meeting was held on May 3rd to agree on a revised LRI RF. Upon receiving PSD PIRS approval, PMSPL shared PIRS with LRI to complete the alignment. A second meeting took place on July 5th to discuss LRI’s alignment. The LRI MEL plan was later approved.
LIVCD: No major work was to be done. The LIVCD RF was well aligned during the partners meeting. The MEL plan will be revised to incorporate the changes.
MENA: No major work was to be done. The MENA RF was well aligned during the partners meeting. The MEL plan will be revised to incorporate the changes. A meeting took place on July 7th to discuss the proposed alignment. USAID approved the MENA MEL plan later on.
LED: USAID approved the LED MEL plan.
Also in Q4FY2018, an introductory meeting was held with LINQ to provide preliminary guidance on the MEL plan development and the PSD alignment. Additional support will be provided once the project is awarded and the IP team is fully on board.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 18 DQA MENA The DQA for MENA II was initiated on August 9, 2017. The team conducted a DQA for 7 out of 10 indicators. A follow-up meeting took place in Q1 FY2018 to complete the DQA for the remaining indicators. A copy of the support documents, including print shots, updated documents, and photos, was collected by the team.
The DQA exercise focused on the standard indicators that are to be reported externally as part of the PPR FY2017. The MENA DQA report was submitted on October 27, 2017.
DQA LIFE A DQA was conducted for LIFE on November 2nd, 2017. It focused on the seven indicators that are to be reported externally as part of the PPR FY2017. This exercise was essential to include LIFE’s results in the PPR FY2017. A DQA for the remaining indicators will be conducted once further activities are implemented and the LIFE database is updated to cover all indicators and activities.
The LIFE DQA report was submitted in Q2FY2018.
SUB-PURPOSE 1.3: INCREASED INTEGRATION OF GENDER INTO USAID/LEBANON’S ACTIVITIES PMSPL II is committed to USAID’s global gender policy goal and to the effective integration of USAID gender equality and female empowerment (GE/FE) policy principles throughout its program cycle, from inception, design, and implementation all the way to the monitoring and evaluation stage. PMSPL II is the catalyst for implementing USAID’s Gender Integration Strategy. All projects in the current portfolio are reviewed to ensure that structural gender mainstreaming is implemented in all stages of the program cycle (refer to ADS 201 and 205). In doing this, PMSPL II’s gender-integration activities cut across its other work plan activities to ensure that GE/FE is an integral component of the project’s activities. This requires reaching out independently to build the capacity of the network of IM gender focal points.
Within Output 1.3.1 (Ensuring Structural Gender Mainstreaming in All Stages of Design, Planning, Implementation, and Evaluation of Program Activities), the Senior Gender Specialist holds an annual meeting with all IMs to plan ahead, follow up on gender-integration efforts, discuss progress toward achieving goals and objectives, share successes and lessons learned, and conduct refresher and new gender training sessions as the need arises.
The sections below detail FY2018’s accomplishments in this area.
COLLABORATION WITH ENCOMPASS To embark on a new fiscal year, a revision of Encompass’ work plan was necessary. Several discussions were held to correlate the planned tasks for FY2018 with the remaining budget. This resulted in reducing some of the initially planned tasks. The work plan was approved in December 2017.
In Q2FY2018, PMSPL II and Encompass collaborated on two main tasks: the CDCS gender analysis and the yearly partners workshop. The Encompass team visited Lebanon twice to assist in the preparations for the gender analysis and the partners workshop planned to launch the Education Resource Guide.
In Q3FY2018, PMSPL II and Encompass collaborated on the 2018 Country Gender Assessment. Several Skype conference calls took place between Encompass, Social Impact, a sub-contracted data collection firm, and the local consultants to discuss the way forward and agree on a set schedule for the research
19 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV field work.
A schedule of Focus Group Discussions (FGDs) and Key Informant Interviews (KII’s) was developed for the entire data collection period and shared with SI and Encompass. SI then started coordinating with Encompass to initiate the coding and analysis process on the finalized and uploaded transcripts. A team was formed to work on a qualitative data analysis program and multiple skype calls were held with Encompass to follow up on the data coding and analysis process.
On June 20th, an online meeting was held at PMSPL between Encompass and the USAID program office to discuss the draft findings as well as the objectives of the meeting scheduled with USAID staff for July 12th. PMSPL II and Encompass continued their collaboration on the 2018 Country Gender Assessment in Q4FY2018 with several Skype conference calls taking place between the concerned parties. Initiating the coding and analysis process on the finalized transcripts involved a great deal of coordination with Encompass. Encompass’ team continued to work on the qualitative data analysis program and followed up on the data coding and analysis processes. On July 12th, Encompass and the USAID Program Office had an online conference call with PMSPL II to discuss work progress.
Figure 2: Participants at the Gender Meeting in July 2018
CDCS Gender Analysis In the beginning of FY2018, PMSPL II and Encompass initiated their preparations for the CDCS gender analysis with the help of background documents and a literature review. PMSPLII also shared with Encompass more guidelines on the 5Rs to help them in the design of the Gender Analysis. Discussions were then held to agree on the workplan.
Preparations for the Gender Analysis Design Meeting that was held on January 10th, 2018 covered logistics, methodology, and the event’s agenda. A list of invitees was prepared by PMSPL, and Encompass sent the invitations. The Gender Analysis Design Meeting was attended by 18 people, including 7 USAID staff. It was facilitated by two Encompass consultants along with PMSPL II’s Senior Gender Specialist. The results of the meeting informed the gender scope of work (SOW) and inception report. In February 2018, the Encompass team assisted PMSPL II in conducting a workshop for the data collectors that will participate in the field work for the gender analysis survey.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 20 Gender Coordination/Meetings The Gender in Education Resource Guide was launched during the annual IMs Gender Workshop, which took place on February 21st and 22nd, 2018 and was facilitated by two Encompass consultants and PMSPL II’s Senior Gender Specialist. The workshop had Education as its main theme and focused on the Resource Guide for Gender Integration in Education Programming in Lebanon that PMSPL II developed in 2017. In addition to orienting staff on how to use the resource guide to integrate gender in the education sector, the workshop provided a general overview of how to integrate gender in programming and project implementation for achieving equitable and sustainable development.
PMSPL II’s Senior Gender Specialist attended a presentation on “Business Angels Investing” at IM Capital, in which the gender component was highly visible to the audience and media.
On a different level, preparations were initiated for the USAID and Stakeholders draft findings consultation meetings. Official invitations were sent to USAID and the stakeholders. Travel authorizations for the two members from Encompass team were issued to help the Senior Gender Specialist in facilitating the two- day gender assessment data consultation sessions in July.
As part of the coordination for those sessions, Encompass and SI jointly prepared a PPT and presented it to USAID/Lebanon’s program office. A session of Q&A followed, during which USAID made some comments that were duly noted to be later addressed when refining the findings.
EVALUATION / ASSESSMENT SUPPORT In Q1FY2018, PMSPL II met with the Director of the USAID Program Office to discuss future gender mainstreaming activities planned for FY2018 and clarify the tasks envisaged for the Perceptions Gender Analysis and other CDCS related assessments. The discussion also touched on the purpose of the Gender Analysis Design Meeting which would take place on 10-11 January 2018, involving USAID/L project officers, Encompass, and PMSPL II staff.
In Q2FY2018, the Senior Gender Specialist reviewed the SOW for the upcoming evaluations and assessments for gender sensitivity, including the performance evaluations for BALADI CAP, LIVCD and LRI. Following the initiation of the BALADI CAP evaluation, the Senior Gender Specialist participated in and provided support to the key informant interviews (KIIs) with BALADI CAP staff.
GUIDEBOOK / RELEVANT TRAINING RESOURCES Work on the Gender in Education Resource Guide was initiated in Q4 FY2017. The guide was approved by USAID in Q1FY2018 and sent to HO to be uploaded on the DEC.
PMSPLII contributed to an Agrilinks event by sharing the Gender in Value Chain Resource Guide. A knowledge-sharing platform hosted by USAID's Bureau for Food Security, Agrilinks captures and disseminates new learning in food security and agriculture. In November 2017, Agrilinks invited its members to post stories, events, or any type of learning tools related to gender in agriculture.
In Q3FY2018, the Gender in Education Resource Guide was posted on the Development Experience Clearinghouse (DEC).
21 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV IM SUPPORT Support for the LED project was initiated in Q1FY2018. PMSPL II’s Sr. Gender specialist provided the project’s team with useful documents related to increasing employment for women in Lebanon.
She also reviewed QITABI's MEL plan to ensure that the old gender indicators had been replaced with the new ones and that gender is appropriately addressed in this revision. She also reviewed MENA II’s draft mid-term evaluation Inception Report to check for gender sensitivity.
In Q2FY2018, the Sr. Gender Specialist reviewed the draft of LED's MEL plan for gender integration and incorporated relevant comments. In March 2018, a meeting was held with the LED team to provide them with additional guidance on how to mainstream gender in the activity workplan and to make sure that PMSPL II comments were appropriately addressed in the MEL plan revision.
The Senior Gender Specialist participated in the CLA meeting for the EG technical office in Q3FY2018. A second meeting later took place at LIFE’s offices to discuss gender integration in their work plan in the presence of the Grants Manager and M&E lead. The participants discussed how to best mainstream gender in accordance with the GE/FE policy and the Gender Assessment that LIFE conducted in 2016 at the onset of the project. The discussion focused on what needs to be done in terms of training and capacity-building where LIFE staff – as well as LIFE partners and beneficiaries – are concerned.
MISCELLANEOUS GENDER MAINSTREAMING ACTIVITIES Following discussions with PMSPLII's Project Design and Programming consultant in Q1FY2018, a concept note was prepared to support the integration of the 5Rs framework, side by side with the 5 Domains of the USAID Gender Analysis framework. The 5Rs is a tool to understand and analyze how local systems work with regard to available “Resources”, “Rules”, ‘Relationship”, “Roles” and “Results”. This tool has since been used to elaborate SOWs for the planned assessments and develop consolidated project results framework. A draft SOW was developed for a short-term local consultant to support in gender mainstreaming activities throughout FY2018.
The Sr. Gender Specialist shared with USAID/L 's Gender Point of Contact (GPC) background information on the gender mainstreaming activities undertaken and publications developed since 2012. She also provided USAID/L with information on gender-related achievements since 2012, the changes in laws and legislation, and the media campaigns launched to impact change on certain gender issues that affected females in Lebanon and hindered their progress and development.
Furthermore, the Sr. Gender Specialist provided the Ministry of Education and Higher Education (MEHE) with links to the three Ed Gender Analyses posted on the USAID DEC.
In December 2017, the Sr. Gender Specialist attended the launch of a study titled “Perceptions of Gender Equality in the MENA Region” that was conducted by Lebanese NGO ABAAD with a chapter on Lebanon.
In Q2FY2018, the recently-approved Basic Education PAD amendment was reviewed by the Sr. Gender Specialist to make sure that the gender-related recommendations from the previous year's analysis and evaluations were addressed. It turned out the major recommendations were not incorporated.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 22 The Senior Gender Specialist also wrote a report on Gender Coverage in USAID/L projects in Lebanon, in response to a request by USAID.
In Q4FY2018, the Sr. Gender Specialist had an introductory briefing session with the newly-hired PMSPLII editor on the GE/FE policy and how gender integration should take place in USAID programs and funded projects. She also reviewed and commented on the LWP and Economic Growth Assessment (EGA) draft SOW and SOO, to ensure they met gender integration-related criteria. Additionally, she reviewed LIVCD’s final evaluation draft Inception report for its gender sensitivity.
The Sr. Gender Specialist coordinated with the EGA’s Team Leader (TL) and consultants on how to best integrate the gender component in the EGA to capture any gender disparities. Along this line, the draft inception report and its questions were reviewed, and a guidance document was consolidated and shared with the assessment team to guide them in conducting a gender-sensitive assessment.
The Sr. Gender Specialist also provided gender integration guidance to SI’s partner DAHNT and referred to their agreement regarding gender, disability and other required compliance policies. She also reviewed the EGA data collection tools, and LIVCD’s final evaluation tools, to ensure gender was sufficiently covered.
SUB-PURPOSE 1.4: INCREASED FIELD-LEVEL MONITORING ACTIVITIES Under Sub-Purpose 1.4, the PMSPL II team provides the Mission with data on project implementation, allowing the technical offices to compare information from their own monitoring efforts with additional sources of monitoring data and make evidence-based management decisions on their projects’ performance. PMSPL II provides USAID/Lebanon with enough accurate and verified information on the progress of technical projects within its portfolio in accordance with the approved project MEL plans and Mission PMP. The revised PMP Toolkit provides templates for Project Site Visit (PSV) reporting, which are used as a reference for our MEL Specialists.
Within Output 1.4.1 (Activity Progress Monitored and Implemented in Compliance with USAID Regulations), PMSPL II conducts site visits to beneficiaries and funded activities as part of its ongoing USAID project-monitoring and oversight efforts. The overall number of sites visited is directly linked to the activity verifications being conducted and the number of beneficiaries we’re requested by USAID to visit. The target number of PSVs is determined on a quarterly basis. PMSPL II submits PSV reports after the completion of each PSV cycle.
FRANKFURT USAID M&E SUMMIT PPL organized a 5-day M&E Summit at USAID’s regional Middle East Bureau in Frankfurt. The Summit discussed various topics, such as exploring the roles of Third- Party-Monitoring (TPM) in supporting USAID Missions, and building the capacity of Figure 3: PMSPL II Team and COR with MSI Team at the USAID staff and TPM representatives in USAID M&E summit in Frankfurt
23 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV M&E and adaptive management, especially in challenging contexts. The event was attended by two M&E specialists from Social Impact / PMSPL II along with PMSPL II’s COR. All reference documents used during the event were made available to all attendees via online repositories. These documents will be used as a reference to enhance the M&E assistance that Social Impact provides to both the Implementing Partners and the Mission.
PSV SCHEDULE UPDATE As stipulated in the work plan, every quarter a proposed PSV schedule is made in coordination with the Mission’s A/CORs. PSVs are then initiated and completed accordingly and a PSV report is drafted following each visit.
In FY2018, the quarterly PSV schedules were updated in coordination with the COR, taking into consideration the required data verification for externally-reported indicators. Below is a breakdown of the field visits and project assessments that the PMSPL II team conducted in FY 2018.
PSV 036: BALADI RMF DV Y2Q4 The project’s AOR suggested to focus on the indicators that were not covered in the previous exercise so that all reported indicators are verified in the reporting year. Accordingly, the PMSPL II team conducted a data verification session with the BALADI RMF team (including the Operations and Monitoring Manager) and two MEL officers. The session covered all indicators reported in Y5Q3 of the project. No major findings were observed. The DV report was submitted in FIGURE 4: DISCUSSIONS DURING THE RMF DV Frankfurt Q2FY2018 to USAID and was later directly shared with RMF upon the AOR’s request.
PSV 037: LIVCD DV Y2Q4 The DV session was conducted on October 3, 2017 and covered 5 indicators that are reported on a quarterly basis. The report submitted was submitted on October 16.
PSV 038: BALADI CL DV Y2Q4 A data verification session was conducted with BALADI Caritas on September 27, 2017. The report was submitted to USAID on October 13. Significant findings were noted, discussed with the team, and reported to USAID. The BALADI AOR shared the PMSPL DV Report with Caritas and requested necessary adjustments be made. The AOR asked from the SI team to conduct a follow-on exercise to verify that the corrective actions were taken.
PSV 039: LIVCD INVENTORY VERIFICATION During Q3 FY2017, the PMSPL II team received a request from USAID to conduct an inventory verification for 210 items distributed over 45 grants. With USAID’s consent, PMSPL II excluded the olive mechanical harvesters from the verification exercise since similar items were already verified under different grants and no negative findings were noted thus far. The inventory requested to be verified was
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 24 reduced to 139 items distributed over 34 grants. The visits were conducted between November 13 and December 22, 2017. The inventory report was submitted on January 18, 2018.
PSV 040: LWP INVENTORY VERIFICATION To begin with this verification exercise, LWP shared a list of 234 items out of which 97 were already verified in the previous NXP inventory verification. The remaining 137 items were distributed to the regional water establishments as follows: - 1 item delivered and installed at SLWE; - 1 item delivered and installed at BWE; - 2 items delivered to BMLWE; - 125 items delivered to NLWE which most of them were not installed and were verified in boxes.
During this exercise, LWP shared another list of 309 NXP items that consisted of handheld collection units, printers, and cradles. Those items were to be distributed to the officers of the billing and collection departments at the regional water establishments. Hence, a verification was necessary prior to their distribution.
The 13 site visits were conducted between December 9 and December 22, 2017 and were coordinated by the LWP Office Manager. No major observations and findings were noted following these visits. PMSPL II recommended a follow-up on the utilization of the equipment once installed, particularly to verify its functionality and use. The inventory report was submitted on January 16th, 2018.
PSV 041: LRI DV The LRI data verification was conducted on December 12, 2017. Data verification covered both the standard and the PMP indicators that are reported annually. No major issues were to be reported. All data and supporting documents were verified.
PSV 042: LIVCD DV Three sessions were conducted during the third and fourth weeks of December to complete the data verification on the indicators that are reported on annually by LIVCD. Findings and recommendations addressed the methodology of extrapolation that is adopted by LIVCD to report on the sales and gross margin indicators. PMSPL II also checked the reported data for consistency, double-counting, gender disaggregation, and accuracy in reporting. In parallel, PMSPL II reviewed some of the templates used for data collection and inspected the hard copies and signatures as well as the filing process for the data available. Findings and recommendations were communicated to LIVCD during the data verification exercise and later to LIVCD’s AOR.
PSV 043: CL DV A data verification session for BALADI CL took place on January 10, 2018 to verify the FY2017 results that were reported under 9 indicators. As per the AOR’s request, findings were directly communicated to the partner during the DV visits. The DV results show that the partner is adjusting the data reporting system as per PMSPL II recommendations. The DV was completed in Q2FY2018 and the report was submitted in Q3FY2018 along with the BALADI CL recommendations tracking sheets, to point out to the AOR the pending actions that need to be taken on either the reporting system or the revision of submitted results. The report was later directly shared with CL upon the AOR’s request.
25 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV PSV 045: LIVCD NXP A request to conduct a non-expendable property (NXP) verification for 24 LIVCD grants was received in Q3FY2018. The field work was initiated on May 15, 2018 and completed on June 5. During the field work, 217 items out of the 232 listed in the LIVCD inventory were verified but not all of them were actually found at the Grantees’ locations as mentioned in the inventory. In fact, many of the items had already been handed to the end-beneficiary for utilization or placed in the field (such as the water tanks and irrigation equipment). PMSPL communicated this issue to LIVCD and the updated item-location lists were later shared following the completion of the field visits. These lists can be found in annex C of the PSV report. In total, 15 items (6% of the total number) were not verified because they were unexpectedly located in areas difficult to access by PMSPL team.
All verified equipment was functioning and adequately labeled with the relevant inventory numbers and USAID branding. Whenever accessible, Serial Numbers were also verified. The NXP verification report was submitted on June 28, 2018.
PSV 046: LIFE DV Data verification for LIFE was carried out on May 17, 2018 in the presence of the project’s AOR. The exercise covered the first year of the project, from October 2017 to September 2017, focusing on the eight indicators that were reported on to the Mission. The session also included a discussion about the PIRS alignment process for LIFE activity with the PSD project.
LIFE’s AOR noted all the recommendations and needed enhancements. The report was submitted on July 10, 2018.
PSV 047: LWP DV LWP’s data verification was conducted on May 29, 2018 and covered the Semi-Annual reported results on 12 indicators. The team verified the baselines that were collected after the last DV as well as the recently-revised targets. The DV report was submitted on July 16.
PSV 048: MENA II DV Data verification for MENA II was carried out on June 14, 2018 and covered all the reported indicators. No major findings were to be reported. The DV report was submitted on July 28.
PSV 49: BALADI CARITAS DV Data verification for BALADI CL was carried out on July 17, 2018 and covered all the reported indicators. The DV report was submitted on August 8. During the data verification session, SI went through all the recommendations from the previous DVs with the CL team to evaluate the progress made. Most of these recommendations were taken into consideration, and the needed adjustments were made.
PSV 50: BALADI RMF DV RMF’s data verification was conducted in August 2018 on selected quarterly reported indicators. During the DV session, SI went through all the recommendations from the previous DVs with the RMF team to evaluate the progress made. Most of these recommendations were taken into consideration, and the needed adjustments were made. No major recommendations were generated from this DV.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 26 PSV 51: QITABI DV Data verification for QITABI was carried out on August 10, 2018 and covered 3 indicators that were reported on in Q1, Q2 and Q3 FY2018, from October 2017 to June 2018. There were no major findings to be reported and the DV report was submitted on July 28. A DV was scheduled for November 2018 to verify the annual reported results.
PSV 52: LIVCD NXP A request to conduct a non-expendable property (NXP) verification for 24 LIVCD grants was received in Q4FY2018. The field work was initiated during the LIVCD performance evaluation and was completed in December 2018.
SUB-PURPOSE 1.5: INCREASED INTEGRATION OF GIS INTO MISSION AND IM ACTIVITIES Under this Sub-Purpose, the PMSPL II team supports USAID/Lebanon and USAID Geo Center to ensure the use of GIS systems and frameworks. PMSPL II supports the Mission’s Geographic Information System by hosting a GIS unit, housing the related equipment needed and managing its activities.
Significant work was completed within Output 1.5.1 (Data from Current and Previous Projects Integrated) in FY2018. The main activities are listed below.
IMDATA 002: IM ACTIVITIES DATA FORM In FY2017, the Mission issued a request to PMSPL II’s GIS Specialist to develop a procedure to periodically update the activities of all the IMs in the GIS. An Excel form was developed to be shared with the IMs so they could update and submit their data within a period of two weeks after the end of each quarter. The compiled data will be used to update the master geographic database and ensure that all the mapping is based on updated information.
Towards the end of Q4 FY2017, the form received the Mission’s approval and was sent to all active IMs with the available data for updates and an initial deadline for submission in the second week of October 2017.
During Q1FY2018, the GIS Specialist received the updated forms from all IMs, compiled the data into the master database, and generated a set of maps showing the distribution of the activities for all the active IMs. Initially, it was foreseen that within three weeks the partners would be able to submit their GIS data; however, several IMs had difficulties providing the data within the set timeframe. This was Figure 5: LIVCD heat map showing the density of beneficiaries in different regions due either to the large amount of data to process or
27 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV to the lack of personnel as most implementing mechanisms were unfamiliar with this kind of task. Following a series of weekly follow-ups, all the needed GIS data was finally received by the end of November 2017.
The data was then compiled into a single form and shared with the Mission for review and comments. The list was also incorporated as a new GIS layer in the master geo-database and used to produce a set of twenty-three maps, showing the distribution and density of beneficiaries and allocated budgets per IM.
IMDATA 004: IM ACTIVITIES DATA FORM In Q2FY2018, the GIS Specialist initiated a follow- on request for all the IMs to fill out the data form. The forms were all submitted by the end of March and after receiving the Mission’s approval on the collected data, all data sheets were compiled and reviewed for consistency of activity statuses and geographic locations. Data were then processed, and two maps were produced showing the distribution of budgets and beneficiaries. The data were then shared with IATI and redesigned to Figure 6: Heat map showing budget density in different meet their requirements. regions
IMDATA 005: IM ACTIVITIES DATA FORM In Q3FY2018, the GIS Specialist initiated a follow-on request for all the IMs to fill out the data form. The forms were all submitted by the end of May and after receiving the Mission’s approval on the collected data, all data sheets were compiled and reviewed for consistency of activity statuses and geographic locations. Data was processed and translated into a map in Q4FY2018.
IMDATA 006: IM ACTIVITIES UPDATE (UP TO JUNE 2018) In Q4FY2018, the GIS Specialist shared an activity template with all twelve active IMs (BALADI CAP, BALADI CARITAS, BALADI RMF, LED, LIFE, LIVCD, LRI, LWP, MENA II, QITABI, USP AUB, and USP LAU). The template included the last version of each IM’s list of activities in addition to a new field (as per the Mission’s request) to include key indicators at the outcome level. The IMs were asked to update and submit the list by the end of June 2018.
Most of the IMs responded within the deadline except for LIFE and LIVCD, who requested additional time due their workloads. Eventually, they submitted their data as well. All the submitted data was then compiled into a master sheet and reviewed for quality control, mainly concerning completeness and consistency. The final sheet was converted into a GIS layer and became ready to use for any mapping or data requests. This task is complete.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 28 Figure 7: Screenshot from the IM GIS database
DATA 005: LRI Satellite Image – Hamat
Within Output 1.5.2 (Search for Online Data Sources Finalized), the GIS Specialist received a request from LRI in Q1FY2018 to provide the project with a satellite image of the area of Hamat, North Lebanon. The GIS specialist searched the available shots and contacted the GeoCenter for new ones. Two scenes were found from 2014 and 2016 (two different satellites and specifications). After receiving LRI’s approval, the GIS Specialist compiled them and delivered them to LRI via Google Drive. Figure 8: Hamat Sattelite Image
DATA 006: LRI SATELLITE IMAGE - NAHER EL KALEB WATERSHED In the third week of June, the GIS Specialist was approached by LRI to provide updated satellite imagery of the Nahr al-Kalb watershed. Research on available in-house data led to images dating back to 2014 which did not meet LRI’s requirements. So PMSPL asked LRI’s COR to submit an official request to be forwarded to the GeoCenter, which provided the needed images two weeks later. Meanwhile, an older available scene of Jeita was delivered to LRI. The new imagery was submitted to LRI through a portable hard drive.
29 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Figure 9: Updated GIS imagery of LRI’s reforestartion site
MAPS 014: LIVCD VALUE CHAINS This task was initiated in FY2017 to develop a set of maps for LIVCD showing their activities’ distribution per value chain. In Q1 and Q2FY2018, the GIS Specialist processed and mapped the rural tourism value chain. After receiving the input data from LIVCD, a map was generated and finalized per their comments. An additional map was also generated to show the freekeh production sources. No further comments or requests were received from LIVCD. Figure 10: LIVCD maps for Assissted Value Chains
MAPS 025: USAID GEOCENTER WORKSHOP GALLERY 2017 In preparation for the annual USAID GeoCenter Workshop that was held in the U.S. in Q1FY2018, the USAID GeoCenter in Washington, DC requested from each GIS Specialist attending the annual workshop to design a map demonstrating some of his/her work throughout the year. Accordingly, the PMSPL II GIS Specialist began in Q4FY2017 preparing the map to be presented. LIVCD’s value chains maps were selected to be showcased this year. All maps were finalized prior to the workshop and a poster and the related data were submitted to the GeoCenter.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 30 MAPS 026: BALADI ROUND 3 Towards the end of Q1FY2018, PMSPL II received a request from BALADI RMF to map their list of Round 3 applicants for the BALADI Round 3 municipal awards. RMF shared the needed materials and in Q2FY2018 the GIS Specialist generated twelve maps: • Three maps, labeled in English and Arabic, showing the municipalities awarded as part of Round 3; • Three maps, labeled in English and Arabic, showing the geographic coverage of BALADI and; • Six maps showing the result of BALADI Round 3 awards disaggregated by type of activities: Health Services, Income Generation and Public Education, Solar Power for Backup Electricity and Water Pumping, Solar Water Heaters, and Street Lights.
MAPS 027: SYRIAN REFUGEES MAPS As per the Mission’s request, the GIS Specialist updated the Syrian refugees’ distribution maps as per the latest Figure 11: A&E BALADI projects sites UNHCR dataset published in June 2017. Three maps were generated: One showing the geographic distribution of refugees; another showing the same thing but with the location of USAID activities; and a third showing changes in refugee counts between June 2015 and June 2017. The maps were submitted to the Mission.
MAPS 028: SITE VISITS MAPS As per an urgent request from the Mission, the GIS Specialist generated two high-scale maps to show the locations of five sites that were visited by the Mission.
MAPS 029: GENDER ANALYSIS MAPPING To support the design of the gender analysis methodology and its related field work, the GIS Specialist processed needed data to generate a table summarizing the geographic coverage of USAID activities at the town level and indicating the implementing mechanisms operating in the identified towns.
MAPS 030: ECONOMIC DEVELOPMENT AND CAPACITY BUILDING Upon the Mission’s request, the GIS Specialist generated three maps showing the distribution of activities related to economic development and capacity building.
MAPS 032: LRI PLANTING SITES Upon the Mission’s request, the GIS Specialist generated and submitted a map showing the location of LRI planting sites.
31 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
MAPS 033: A&E SITE LOCATIONS Upon the request of PMSPL’s A&E team, the Sr. GIS Specialist generated a list of the sites that are or will be supervised by the team. This included projects implemented by BALADI Caritas, BALADI RMF, and LWP. One map was generated showing the distribution of BALADI Caritas and RMF activities, classified by IM and award cycles. Three other maps were produced for LWP’s construction sites: One showing all sites around Lebanon and two focusing on the Metn and Jezzine districts.
MAPS 034: BALADI CAPACITY-BUILDING: CIVIL SOCIETY ORGANIZATIONS Upon the request of PMSPL II’s M&E team and to support the mid-term performance evaluation of BALADI CAP (Building Alliance for Local Advancement, Development and Investment: Capacity Building), the Sr. GIS Specialist developed a map showcasing the distribution of Civil Society Organizations’ (CSOs) capacity-building activities.
MAPS 035: QITABI BUSES Upon the Mission’s request and to support the handover event, an A1-sized map was generated to show the location of public schools that received new buses from the QITABI project. The map was shared with the Mission, approved, and printed on a foam board.
MAPS 036: USAID ACTIVITIES AND SYRIAN REFUGEES Upon the Mission’s request, seven maps were produced to showcase the location of USAID’s activities in Lebanon in relation to the distribution of Syrian refugees. Refugee count and distribution were based on the latest data published by UNHCR in June 2018. These maps were reviewed by the Mission then updated by the Sr. GIS Specialist according to their feedback, finalized, and submitted digitally. Additionally, one map was printed on a foam board.
MISC 007: ESTABLISH AGOL PLATFORM FOR Figure 12: Schools that received buses from USAID LEBANON QITABI This task was initiated in FY2017 and continued throughout in FY2018. Its objective is to develop a web GIS application for the Mission.
After looking at different techniques to build the AGOL website, the Sr. GIS Specialist opted to use the Web-app builder over the predefined templates, as it gives more flexibility to customize the web application according to our requirements without the need for full web programming. After finalizing the collection and compilation of the IM activities data, the GIS Specialist uploaded it onto the AGOL
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 32 and built the application based on the AGOL dashboard template. After some testing and fine-tuning, the web application was ready to be published and used.
In parallel, the GIS Specialist sent a reminder to the GeoCenter to re-activate the AGOL accounts for all the users that were previously placed on hold and requested an additional account.
Following the activation, the Figure 13: AGOL map of USAID activities GIS Specialist sent all AGOL users a detailed instruction on how to activate the accounts and access the web app. A working session was held with USAID staff on January 11th, during which the GIS Specialist showed a live demo of an AGOL platform using IM data. Attendees provided feedback on how the platform could be enhanced to serve the Mission’s reporting needs. Further disaggregation, GIS boundary levels, and beneficiary types were among the most common requests.
Work on improving the platform is ongoing and will be carried over to FY2019.
MISC 009: Data Request from IATI In Q1FY2018, PMSPL II received a request from USAID’ International Aid Transparency Initiative (IATI) to share a list of all activity locations by award number. After getting the Mission’s approval, the GIS Specialist compiled the data and submitted it. It was also agreed to share an updated list of activities with IATI every quarter.
Figure 14: USAID activities Mapped against refugees distribution
33 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV MISC 010: GIS FOR SUSTAINABLE WORLD CONFERENCE The Sr. GIS Specialist attended the 2018 GIS for Sustainable World conference that took place in Geneva April 17th-19th, 2018. A compilation of notes and photos taken during the conference were submitted as part of a summary report, including a list of suggested tasks inspired from the conference.
SOURCE 007: ELECTIONS 2018 Figure 15: PMSPL's Sr. GIS specialist (far left) at the The GIS Specialist initiated this task in February 2018 Sustainable World Conference in Geneva 2018. It consists of updating the maps that were generated in 2016 by recompiling the voter counts of 2016 to match the electoral districts of 2018 and comparing them to the number of voters in 2018. The difference showed only a 3% increase in the number of voters between the two years and it was therefore assumed that data from 2016 were still representative. The election data were mapped based on electoral districts and seats and compiled with the existing data of voters from the 2016 official release. Accordingly, two sample maps were produced for internal review. The two maps were finalized and submitted digitally to the Mission.
SOURCE 008: ELECTIONS 2018 RESULTS The GIS Specialist initiated this task in May 2018 Upon the Sr. Gender Specialist’s request. It consists of disaggregating the data of voters per sex and regions. The GIS Specialist downloaded all available data and forms from these two sources and compiled them manually on a master Excel sheet. The data compilation process was completed at the end of June.
Preliminary analysis showed that in Beirut, the percentage of voters was almost the same between males and females. However, there was a huge difference in Hermel, where the percentage of female voters was 20% higher. Analysis for the Akkar region showed that female participation was 6% Figure 16: Parliamentary elections map higher. Further analysis showed a higher
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 34 participation of women in the Rashaya and Zahrani regions, while female participation was slightly lower in the Keserwan District.
In Q4 FY 2018, the Sr. GIS Specialist continued the data compilation process and finalized the last five remaining minor districts: Aley, Chouf, Minnieh- Dannieh, Bint Jbeil, and Hasbaiya. He also generated two sheets summarizing the results disaggregated by sex and based on district distribution and sectarian groups. Two maps were prepared to show the distribution of results.
ODK 005: LIVCD Inventory Check Within output 1.5. 5 Automated Field Data Collection, and upon the request of PMSPL II’s M&E team, the GIS Specialist created a new Open Data Kit (ODK) form for the LIVCD inventory check (November 2017), and uploaded it on the server. After the completion of the site visits, he downloaded all the collected data and incorporated them into the ODK database. The report was then generated and submitted to the M&E team. Figure 17: 2018 voting data disaggregated by gender ODK 006: LWP Inventory Check Upon the request of PMSPL II’s M&E team, the GIS Specialist created a new ODK form for the LWP inventory check (December 2017) and uploaded it to the server. Data were processed and submitted to the M&E team.
ODK 007: LIVCD Inventory Check In Q3FY2018, the GIS Specialist created a new ODK form for a new LIVCD inventory check (May-June 2018), and uploaded it on the server. After the completion of the site visits, he downloaded all the collected data and incorporated them into the ODK database. The report was generated and submitted to the M&E team.
ODK 008: LIVCD Inventory Check In Q4FY2018, the GIS Specialist created a new ODK form for a new LIVCD inventory check (September 2018), and uploaded it on the server. He will proceed with data extraction once the field work has been completed.
SUB-PURPOSE 1.6: INCREASED INTEGRATION OF AT+ INTO MISSION AND IM ACTIVITIES Within this Purpose (IM Regular Use and Update of AT+), the CLA Specialist was supposed to mentor USAID and IM personnel on AID Tracker Plus (AT+) and provide ongoing support and coordination for USAID/Lebanon on the use of AT+ by collecting IM data and working collaboratively with the Chief Information Officer (CIO) in Washington, DC to vet and upload data to AT+.
35 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Under this sub-purpose, the PMSPL II team would ensure the transition to and use of AT+ by the Mission and its partners. The AT+ is a cloud-based USAID management information system intended to streamline performance management and reporting processes.
However, in Q3FY2018, PMSPL was informed that USAID intends to decommission the AT+ system as of June 2019 with the main reason being the high costs associated with the system platform. In the meantime, USAID is working to deploy a new system called Development Information Solution (DIS) which will provide all of AT+’s functionality as well as address some of the challenges noted with AT+.
A phone call took place with the DIS support team on May 30th to know more about the features of the system, clarify the transition process, and assess the needed level of effort to support data migration. In Q4FY2018, the Mission agreed to postpone the roll-out in Lebanon until Q2FY2019. The team does not have the technical capacity to transfer selected data and as such, all irrelevant GIS data will be transferred. This will stipulate future efforts to review and clean this type of information, or to totally refrain from reporting on GIS data using such a system. Future guidance system use will be provided through a PowerPoint presentation whenever available.
Work achieved before the decommissioning of AT+:
AT+ COACHING / SUPPORT Two coaching sessions were provided in Q1FY2018 for three new users from BALADI CAP and LIFE. A Request for an account reactivation was received from AUB and was directly communicated to the USAID AT+ Admin. To proceed with addressing this issue, the AUB USP6 user resubmitted the AT+ user access form. The account for USP6 user was reactivated. An additional request was received from QITABI regarding the frequency of indicator reporting. As communicated to QITABI’s team, this issue can only be addressed when there is no data reported during the fiscal year. As such the frequency of reporting was to be revised in Q2 FY2018.
PMSPL II did not receive any coaching requests in Q2 FY2018 as no new users were identified. PMSPL II was to train LED users once they have an approved MEL plan and start reporting on their indicators.
AT+ support consisted mainly of responding to the IMs’ requests in terms of reviewing their uploaded data or communicating to USAID any adjustment needed to their accounts, indicators, or targets. Requests were received and resolved from BALADI CAP, MENA, LRI, AUB and QITABI. Due to the system’s capacity, some minor issues faced by QITABI regarding the frequency of reporting were not addressed.
AT+ QUARTERLY / ANNUAL REPORTING During the last week of October 2017 and prior to the IMs’ submission of their quarterly and annual reports, the PPR request for data collection was received from USAID. A new Excel template was shared as part of PPRFY2017 guidance to be adopted for the FY2017 data collection. The template consisted of an Excel sheet that would be customized for each indicator to include all the needed information, such as DQA dates, linkage to MO, out year data and narrative explanations. PMSPL II customized the Excel template for each IM based on the data to be collected and the indicators to be reported, and all customized templated were circulated with the partners. As new templates were released and due to the lack of time PPR data was to be captured from the customized templates. IPs
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 36 would then update all their indicators data on AT+ including data the PMP indicators when Q4 FY2017 and FY2017 targets were uploaded on the system and reporting periods were opened. The PPR data was submitted on the 8th of November to USAID as per the set deadline. The submitted Excel file included separate sheets for 40 indicators that were active in FY2016 in addition to two new standard indicators that are reported by LIFE in its new MEL plan.
In December 2017, Q4 and annual FY2017 targets were uploaded for LIVCD, QITABI, USP AUB, USP LAU and LRI. All partners reported on the opened reporting periods. Targets for the remaining projects such as LWP, BALADI CAP and BALADI were added in January 2018.
In Q2FY2017, PMSPL II continued supporting USAID in ensuring that partners were using AT+ to report on their indicators. All partners reported on their opened reporting periods, which included the remaining FY2017 data from LWP, BALADI CAP, and BALADI and all Q1FY2018 data from all the partners that were requested to reported on a quarterly basis.
SUPPORT USAID AT+ ADMIN AND A/COR USING AT+ PROVIDED Within Sub-Purpose 1.6 and pertaining to Output 1.6.2 (Support USAID AT+ Admin and A/COR Using AT+ Provided), PMSPL II was to ensure that relevant indicators are uploaded on IM portals and support the A/CORs in uploading and publishing indicator baselines and targets. The CLA Specialist was to review the partners’ data upload and synchronizes AT+ reported data with the USAID PMP/PPR reports developed by PMSPL II. PMSPL II was to ensure that relevant indicators were uploaded on IM portals.
In Q1 FY2018, the Q4 FY 2017 and Annual FY2017 targets for LIVCD, QITABI, USP AUB, USP LAU and LRI were added to the system and the partners reported accordingly. Comments from LRI and QITABI were received. As such, and as per LRI’s request, semi-annual targets were to be revised to mirror the annual targets set for their indicators. QITABI’s concerns on the reporting period were to be addressed in Q1 FY2018 as there were no data reported yet for FY2018.
In Q2 FY2018, PMSPL II provided USAID with the needed support in uploading the remaining activities targets for FY2017 and all the targets for Q1 and Q2FY2018. Furthermore, to fulfil the Mission’s future reporting requirements for the consolidated PADs, PMSPL II and the USAID AT+ Admin reached out to the support team for guidance on how the system could accommodate the consolidation of data at the project level and if this could be accessed by the MEL platform.
However, at this stage, PMSPL II was informed that a new system was being developed to replace AT+ and integrate data for the entire project design cycle. In the meantime, project level reporting could be captured through a customized report that would be created by the Mission with the team’s support.
SUB-PURPOSE 1.7: IMPROVED EVALUATION ASSISTANCE PROVIDED BY PMSPL II Based on Mission–identified evaluation objectives and questions, PMSPL II develops the evaluation scope of work (SOW) to incorporate stakeholder views on evaluation questions that are to be answered by the evaluation. The Evaluation Quality and Utilization and Impact (EQUI) principles are incorporated in the SOW to ensure that high-quality evaluations are conducted by certified evaluation TLs. A final SOW is agreed upon by PMSPL II and USAID. The evaluation SOW elaborates on the methodology to be used, the evaluation questions to be answered, and basic information about the project to be evaluated. It also sets the expected deliverables, budget, and execution timeframe.
37 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV The following evaluations were conducted as per USAID requests in FY2018:
QITABI EVALUATION In Q1 FY2017, USAID/Lebanon expressed its interest in conducting a midterm evaluation for QITABI. Accordingly, the execution of the evaluation was carried out and completed throughout Q2 FY2017 and Q3 FY2017. In Q4 FY2017, QITABI’s final evaluation was submitted to USAID/Lebanon. Following the submission, comments were received from both the Mission and World Learning (the Figure 18: KII at an apple-packing facility as part of LIVCD’s final evaluation Implementing Partner). The report was revised accordingly and shared with the Mission.
Additional comments were communicated by the project AOR and the evaluation report underwent further revisions and comments were addressed and sent back to USAID on October 17, 2017. New comments were received from the Mission director who expressed the need to follow the SOW rather than to relate the evaluation’s structure to the inception report. The PMSPL II team met with USAID on Nov 29, 2017 and it was agreed to revise the executive summary in order to reflect what worked, what didn’t work, and how things could be improved during the remaining project timeframe. PMSPL submitted a revised executive summary and received minor comments on the edits. On December 11, PMSPL re-submitted the report with “track changes” and received the final approval on March 6, 2018. The redacted version was shared with USAID on March 14 and uploaded on the DEC on March 27 following USAID’s approval. QITABI DEC’s redacted version took into consideration the ADS evaluation report guidelines.
MENA II MIDTERM EVALUATION In Q4 FY2017, the Mission issued a request to conduct a midterm evaluation for MENA II. The purpose of this evaluation was to:
• Assess the performance of Berytech under MENA II; • Examine and critique the underlying methodology of the project’s strategic approach; • Recommend whether USAID should further pursue its activities in this field; and • Check whether MENA II will augment its program objectives if USAID extends/increases the level of funding to the MENA II project.
The evaluation questions were to explore the effectiveness of the strategical model embedded in MENA II and of projects interventions. More specifically, the evaluation questions were to review the rationale, current performance to date, and likely effectiveness of the three respective aspects of the MENA II approach outlined above.
The evaluation was initiated in October 2017 with the development of a scope of work, which was shortly approved. All MENA II’s supporting documents were shared with the hired team leader prior to his arrival to Lebanon.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 38 A kick-off meeting was held at the Mission on November 3, 2017 and was attended by the EG Technical Office Director, an EG Technical Officer, and MENA II’s AOR. The meeting included a presentation of the evaluation’s methodology, proposed tools, meeting schedule, and other details. Discussions were held around the proposed questions and the Mission’s expectation from the evaluation. The meeting was followed by a presentation at IM Capital to introduce the project, its main components, and the progress achieved to date.
The field work took place between November 4 and 17, 2017. A total of 17 interviews and 3 Focus Group Discussions (FDG) were conducted with stakeholders including IM Capital staff and Board of Directors, portfolio companies, matching investors, eco system partners, angel investors. The FGD included Seeders 2016 deal leaders (3 investors), Women Angel Investment Network (5 investors) as well as Mentors (6 mentors).
Following the field work, the evaluation team developed a Matrix of Findings using the EQUI process. On November 13, 2017, a data analysis work session was held with the Mission to discuss the outputs of the KIIs and FGDs in addition to the questions and important findings that emerged during the field work. The data analysis work session also provided the team with an opportunity to highlight important gaps or issues that the team could focus on during the remainder of the data collection process.
On November 22, 2017, the evaluation team presented the preliminary findings to USAID. The presentation was attended by USAID staff who gave their feedback on the findings. A similar presentation was given to IMC MENA II’s staff.
Based on the feedback received, the evaluation’s final report was completed and submitted to USAID on December 11, 2017. On December 20, USAID provided PMSPL II with their comments, which mainly focused on reshaping and elaborating the executive summary section, developing a literature review, as well as underlining certain findings. Accordingly, the team leader, together with PMSPL II team and SI HO addressed the comments and re-submitted the report to USAID on January 3, 2018. The MENA II evaluation adhered to the EQUI standards.
The final approval on the evaluation report was received on February 5, 2018. The redacted version was shared with USAID on March 14 and uploaded on the DEC on March 27 following USAID’s approval. MENA DEC’s redacted version took into consideration the ADS evaluation report guidelines.
BALADI CAP MIDTERM EVALUATION In Q4 FY2017, preparatory work was underway for the BALADI CAP midterm evaluation. USAID shared with PMSPL II the BALADI CAP midterm evaluation Statement of Objectives (SOO). A meeting was then held at the Mission with the team who will be involved in this evaluation process. A midterm evaluation scope of work (SOW) was developed and shared with the Mission during the last week of Q4 FY2017. The SOW outlined the evaluation’s objectives and questions, an illustrative methodology, the evaluators’ profile, and a tentative schedule.
In Q1 FY2018, the B-CAP Evaluation SOW was revised to refine the evaluation’s purpose and reduce the number of questions as per the Mission’s recommendation.
39 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Following the SOW’s clearance, recruitment ads were published on various platforms. CVs were shared with the Mission to select one. The evaluation’s schedule was revised and adjusted to match the Mission’s deadlines and requirements.
In Q2FY2018, PMSPL II got USAID’s approval and vetting clearance. The BALADI CAP evaluation was officially started on the January 29, 2018 with the review of BALADI CAP’s contracts and progress reports and a kick-off call between the AOR and PMSPL II’s team on how to approach the field work and prioritize stakeholder interviews. Figure 19: bCAP evaluation team leader (left) during a KII with mayors The field work was initiated and completed as per the timeframe scheduled with the Mission, including KIIs with USAID, BALADI CAP staff, and service providers. All the CSOs participating in BALADI CAP benefitting from the CBC component as well at the CEI component were interviewed individually. All other CSOs that are only benefitting from the CBC component were invited to participate in a focus group discussion (FGD).
The KIIs and FGDs were conducted with municipalities participating in the CEDG component. In total, 50 KIIs and 7 FGDs were carried out to inform this evaluation. A presentation of the preliminary findings was given Figure 20: The evaluation team (left) during an FGD on March 16, 2018 followed by an out-brief meeting with the BALADI CAP team. The team leader departed Lebanon on March 17.
The draft report was submitted to the Mission on April 3, 2018. After receiving the Mission’s comments, a final report integrating the needed changes was resubmitted on April 26. Additional comments were received from the Mission Director toward the end of June and shared with the evaluation team. Responses were consolidated and submitted to USAID on July 19, 2018. Additional edits were still needed to improve the report’s language style. A redacted version was sent to USAID on September 17 and clearance was received on September 27. The report was uploaded on the DEC.
LIVCD FINAL EVALUATION After minor revisions from USAID, PMSPL II submitted the final evaluation SOW for LIVCD’s final evaluation on April 30, 2018. The evaluation was initiated on August 27 with a desk review, and a statistics firm was brought onboard as of August 31 to provide support in qualitative data collection and analysis. Within this scope, a meeting with LIVCD COR took place on September 11 to discuss the proposed reorganization of the evaluation questions and other details from the inception report. A KII with the COR followed the briefing.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 40 The KIIs with LIVCD’s staff were completed as per the planed schedule. The KIIs with grantees and the logistics for the FGDs were initiated during the 3rd week of September. By the end of September, most KIIs with grantees and stakeholders had been completed. The preliminary findings presentation took place on October 5, 2018. Work on the evaluation will be carried over to Q1FY2019.
Figure 22: FGD with beekeepers Figure 21: FGD with olive oil producers
SUB-PURPOSE 1.8: CAPACITY BUILDING OF LOCAL ORGANIZATIONS TO MONITOR AND EVALUATE PROJECTS INCREASED In Q3 & Q4FY2018, intensive collaboration took place between SI Home Office (HO) and PMSPL for the development of the capacity-building SOW and the selection process that will be adopted to recruit two local firms.
PMSPL II adopted a competitive selection process that will ensure local organizations’ commitment and fair competition. Based on their relative strengths and weaknesses, SI will build the capacities of these organizations on the key technical and managerial skills and tools that are necessary for conducting M&E work with international donors.
The draft SOW includes a detailed description of the selection process, the proposed capacity building program and schedule, and the team members along with their specified LOE.
Based on the findings of the capacity assessment, SI will design a series of training sessions to build partner capacities in key areas. Though the final list of likely training sessions will only be known after the completion of the capacity assessment, SI has already identified potential technical and managerial training topics in the SOW. Topics include understanding USAID policies ADS 201 and complying with USAID contracting requirements.
The final SOW was submitted to USAID in August 2018. PMSPL originally expected to select the two organizations by September 2018, however, we had to repost the call since only two companies responded to the CEI and one of them did not even meet the requirements. The CEI was edited, refined, and reposted in October.
41 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV PURPOSE II: DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT INCREASED Key Accomplishments
• Provided support to the CDP PAD design team. • Released the CSP RFA. • Provided support to the PSD design team. Got approval for the PSD. • Provided support to the HEP design team. Got approval for the HEP. • Provided support to the LWP design team. • Recruited a production company to produce USAID/Lebanon documentary. • Produced a documentary for USAID. • Designed posters for USAID. • Received approval and clearance on the three Gender Toolkits —basic education, higher education, and technical and vocational education and training (TVET). • Conducted four CLA EG quarterly meetings on: Productive employment, PSD alignment, PPP, and Effective evaluation. • Completed and submitted results for the Mini DOC survey. • Provided support to the DOC partners meeting. • SI/PMSPL/USAID CLA case listed as finalist in the CLA case competition. • Initiated the CDCS gender analysis. • Finalized the gender assessment field work and data analysis. Submitted the draft report. • Got approval for the Economic Growth Assessment (EGA) SOW. Initiated the EGA. • Got approval for the PEA SOW. • Completed the PSD MEL plan with PIRS, baselines, and targets. • Drafted SOWs for CDCS assessments.
Purpose II (Direct Support to USAID’s Program Management Increased) includes establishing and supporting USAID collaborating, learning, and adapting (CLA) systems and tools, initiating knowledge management, and providing support for the DOC and project design process.
SUB-PURPOSE 2.1: PROJECT DESIGN, MANAGEMENT, AND REPORTING REQUESTS COMPLETED BY PMSPL II Under this Sub-Purpose, the PMSPL II team provides support for the project design process, including project design, planning, and execution as well as program documentation preparation, review, and editing. PMSPL II ensures the implementation of USAID/Lebanon’s CDCS during the project design process and provides training to USAID/Lebanon staff in project design planning and execution, using USAID’s most up-to-date programming guidance to help them develop effective programs and projects with sustainable results based on best practices and lessons learned locally, regionally, and globally.
CONSOLIDATION OF ACTIVITIES The Mission requested advice from the PMSPL II on designing projects that would consolidate the activities under the CDCS DOs with an associated project-level MEL plans, work on the consolidation process was initiated in Q2FY2018.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 42 Work continued with the Mission to provide needed support on this consolidation process until all documentation was approved.
SUB-PURPOSE 2.2: CLA/KM ADVANCED IMPLEMENTATION In FY2016, the Mission’s interests shifted from an exclusively Knowledge Management (KM) consideration to the more broad-based CLA framework that mirrors USAID’s Policy, Planning, and Learning (PPL) developments. As a result, PMSPL II adapted its work plan to align with these new interests.
The PMSPL II FY2018 work plan was updated to reflect the CLA initiatives that will be designed to support USAID Lebanon in integrating and implementing CLA. It is foreseen that CLA initiatives may include the Mission’s CLA plan, the integration of CLA in the consolidated project level MEL plans, and other activities initiated by the different offices at USAID. As part of the activity consolidation process, each DO PAD will include a section about learning at the project level. A specific budget related to CLA may be allocated as well. The CLA budget may cover assessments and evaluations that will be conducted at the project level and will crosscut all related activities or implementing mechanisms.
A meeting with the USAID CLA focal point was held on December 6, 2017 to establish a CLA work plan for FY2018. It was initially agreed that all offices will undertake the CLA assessment using the maturity assessment tool. PMSPL II will initiate this activity with the EG office. This was reiterated as part of the portfolio review in May 2018. This activity is still to be initiated with the EG office.
EG/CLA meeting on productive employment
• Considering the EG office’s involvement in the project consolidation process and its engagement in CLA activities, PMSPL II facilitated the first EG CLA quarterly meeting, which was held on February 1, 2018:
In January 2018, PMSPL II received a request Figure 23: Participants at the CLA meeting in February from USAID to arrange and facilitate the first EG DO quarterly meeting. This CLA meeting addressed challenges to “productive employment” and included the Mission Director, the EG Technical Office Director, the USAID EG team, and the IPs of projects falling under the EG DO. The IPs were represented by COPs and EG coordinators in specific fields. Six IPs presented on how they addressed the challenges to productive employment. The PMSPL II COP facilitated the discussions as attendees agreed on the main challenges and Figure 24: Attendees discussing challenges to productive how to approach them collaboratively. employment at the CLA partners meeting in February
43 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV
• In Q3FY2018, PMSPL II facilitated and hosted two EG CLA quarterly meetings:
EG/CLA meeting on Alignment with PSD
On April 16, 2018, PMSPL hosted the second EG partner meeting, during which the EG technical office director presented the RF for the PSD project along with the main objectives and targets. The PSD implementing partners presented how they foresaw their activity aligned with the PSD. Six implementing partners discussed challenges to measurement and data collection for the PSD high level indicators. Discussions were facilitated by PMSPL’s Chief of Party (COP). Figure 25: Participants at the EG/CLA meeting on PSD in April Discussions informed the development of the PSD indicators definitions and the revision of the PSD targets.
In preparation for the meeting, PMSPL supported the EG office in providing guidance to the implementing partners who needed to have their activities aligned with PSD. As requested, PMSPL supported the IMs in reviewing their alignment propositions prior to the event. Figure 26: During the EG/CLA meeting on PSD, the IPs presented the reporting challenges they faced.
EG/CLA meeting on Public-Private Partnership
The purpose of this meeting, which took place on June 1, 2018, was to discuss the new public-private partnership (PPP) law in Lebanon and the new USAID Washington push on this front. PMSPL referred to its pre-approved consultant list and selected an attorney who had the needed background to aid in developing the material for this task. The EG CLA event was attended by Office Directors, Embassy Staff, Stakeholders such as DIFID, and partners.
The meeting was facilitated by PMSPL’s COP who presented the PPP legal framework and context along with challenges and opportunities. The PPP consultant provided in-depth explanation of the related decrees and processes. The attendees shared previous experiences and challenges in Lebanon and other
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 44 countries and agreed on the benefits of leveraging investments from the public sector and partnering with the private sector to reduce risks on both parties and achieve development goals.
• In Q4FY2018, PMSPL II facilitated and hosted a CLA quarterly meeting on Designing and Implementing Effective Evaluations:
EG/CLA event on Designing and Implementing Effective Evaluations
On the August 14, 2018, PMSPL facilitated and hosted the fourth EG partner meeting for FY2018 themed "Designing and Implementing Effective Evaluations." The meeting was attended by all six EG IPs who discussed their approaches to evaluation and how each activity is aimed at creating interesting and innovative evaluations that reveal program impact and/or effectiveness, support larger strategy development, and promote learning on what works and what doesn't in development. The PMSPL COP facilitated the discussions and presented the technical process and approach to conducting ADS compliant Figure 27: PMSPL’s Sr. GIS specialist presenting evaluations. the AGOL platform at the CLA meeting on August 14, 2018 The IPs presented their adopted and planned approaches to measure efficient women participation in microfinance activities, improved social stability, start-up screening process for viability, value chain economic impact assessment, and cost effectiveness studies.
At the end of the meeting, PMSPL’s Sr. GIS Specialist presented the AGOL platform as a main tool to analyze USAID interventions, evaluate outreach, and map activities across regions.
• The CLA Case Competition 2018
USAID/EG office, SI HO, and PMSPL collaborated to draft a CLA case, which described the effort done in refocusing the DG economic growth strategy through CLA. The EG Office Director provided initial notes, based on which answers to the eight CLA competition questions were elaborated. SI HO and PMSPL shared a draft with the EG office and Mission Director for clearance prior to submission to the CLA portal. The results were released on September 12, 2018 and PMSPL was listed as a finalist out of 127 cases received.
OUTPUT 2.2.1: MEL TOOL UPDATED AND UTILIZED In FY2016, PMSPL II developed a tool to effectively track and follow up on related findings and recommendations generated from MEL reports and other PMSPL II activities. This MEL tool will be used to focus on what PMSPL II learned through site visits, assessments, and MEL. USAID/Lebanon seeks to use the knowledge gained in its future programing. The MEL tool was updated to include the updated recommendations that were shared with USAID. Simultaneously, PMSPL II proceeded with tracking the use of evaluations and monitoring findings by developing post-evaluation action plans and separate monitoring tracking sheets for each activity.
45 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV In Q2FY2018, as a follow-on to the LIVCD DV, USAID approved the PMSPL II recommendations and the LIVCD request to recruit a consultant who will overview the data analysis and review the methodologies that were used to report on the beneficiaries’ sales values.
The post-evaluation action plans for QITABI and MENA II were submitted to USAID in Q3FY2018. The BALADI CAP post-evaluation action plan will be submitted once the report is approved by USAID. Select high-level recommendations that address USAID project performance were integrated in the project presentation and were discussed in the portfolio review. Those were generated by performance evaluation for USP, LIFE, QITABI, MENA, and BALADI CAP.
As per USAID feedback on the QITABI post-evaluation action plan, most recommendations were accepted and adopted either as part of the QITABI activity extension or as part of the new BE activity. Feedback on the MENA II post-evaluation action plan is still pending.
In Q4FY2018, PMSPL shared the recent monitoring tracking sheets developed for BALADI RMF and Caritas with both IPs. Our team will use them during DVs to make sure that recommendations from previous DVs were addressed and that necessary adjustments were made. Most recommendations that were generated from regular DVs were taken into consideration by the partners.
SUB-PURPOSE 2.3: INCREASED DEVELOPMENT OUTREACH AND COMMUNICATION ACTIVITIES BY THE MISSION AND IMPLEMENTING MECHANISM As part of Sub-Purpose 2.3, PMSPL II created a DOC Specialist position to support USAID’s DOC unit in the Program Office and manage outreach events, develop and package communication materials, and simulate DOC activities by the IM.
Within Output 2.3.1 (Public Awareness of USAID Assistance and Program Achievements Supported), PMSPL II provides direct support to USAID’s DOC unit. Specifically, the DOC Specialist, in collaboration with USAID’s DOC unit, organizes public awareness campaigns and engages the media to create visibility for USAID activities, including awareness of international days where USAID is a significant donor (e.g., Water Day). The DOC Specialist also compiles program information from the different AORs/CORs.
USAID FACEBOOK PAGE/FACEBOOK WEEKLY CALENDAR One of the main communication tools used by the Mission is the USAID/Lebanon Facebook (FB) page, which serves as a platform to post daily updates and interact with external audiences. On a weekly basis, the Mission sends the weekly notes to the DOC Specialist, who in turn formulates it into FB posts and submits the weekly FB calendar accordingly.
The following activities took place on USAID/Lebanon Facebook’s page in FY2018: Figure 28: The LED project was announced on USAID/Lebanon’s FB page
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 46 • Recognized Days and Events: Special posts were customized to reflect a number of holidays or international days: Lebanese Independence Day; Thanksgiving; International Volunteer Day; Christmas; New Year; Women’s Day/Month; Teacher’s Day (LB); Mother’s Day (LB); World Water Day; Easter; Earth Day; Labor Day (LB); US Independence Day; etc.
• Themed posts: o Q1: A series of Throwback Thursday (#TBT) and USAID #projectoftheweek or #factoftheweek posts highlighting key achievements made in the past that were not highlighted on the USAID/Lebanon Facebook page. o Q2: A series of year-in-review (#yearinreview) posts highlighting USAID’s key achievements in FY2017 in each sector. o Q3: A series of throwback and fact-of-the-week posts. PMSPL II supported USAID in promoting a series of videos providing tips for saving water in households. The videos were provided by LWP. o Q4: A series of throwback and fact-of-the-week posts. PSMSPL II supported USAID in promoting a series of videos on LIVCD’s rural tourism projects, including villages and cuisines from selected villages in Lebanon.
• USAID-centric posts: These posts are for work or activities directly funded by USAID and not through an implementing mechanism. Main activities covered: o US Ambassador’s visits to the North to check USAID activities. o US Ambassador’s invitation to the 32 municipalities that received project funding through BALADI. o USAID delegation’s tours of funded projects throughout the country.
• Beneficiary-based posts: A series of posts highlighting the achievements made by USAID beneficiaries. Main Figure 29: US Ambassador Elizabeth H. posts: Richard (left) with the Heads of municipalities o LIFE beneficiaries who received funds to open that received funding through BALADI their own businesses. o Testimonials from QITABI training participants. o Quotes from USP scholars. o An LIVCD beneficiary launching a new online portal. o An LIVCD beneficiary winning a gold award in New York.
• IM activity posts: Most of these posts emphasize the IMs’ activities and events. Main posts: o Q1: The LRI reforestation campaign, including Lebanon’s First Lady Nadia Aoun attendance at the launch event in Bcharre. o Q2: The LRI snowshoeing event in Aqoura. Figure 30: Lebanon’s First Lady planting a tree during the LRI reforestation event in Bcharre
47 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV o Q3: The launch of the USAID-funded LED project. The Travel Lebanon event. The Save and Win program launched by LIFE. o Q4: IM Capital Seeders’ graduation ceremony at the Grand Serail. The Launch of the BALADI Electricity Transmission Stations in Arsal. QITABI’s delivery of 100 buses to 100 public schools across Lebanon.
• Camapign-based Posts: Such posts coincided with campaigns that were carried out by IMs, such as the LWP Litani Campaign and the LRI Forest Fire hotline campaign.
SUCCESS STORIES / PRESS RELEASES / DOCUMENTARY / BRANDING Within Output 2.3.2 (Communication Materials for USAID Mission Developed and Packaged), most activities in FY2018 focused on producing communication material for USAID/Lebanon’s Facebook page and the media. Figure 31: “The Litani is Lebanon’s artery: Don’t let A series of posts were boosted during that period, it die!” - a slogan for LWP’s Litani river campaign including:
• BALADI apple season post. • LIVCD freekeh video. • LIFE Nancy sewing business. • USP scholar video. • LIVCD pickles video. • BALADI CAP forest protection video. • LRI Women’s Day video. • USP LAU Video. • LRI Green Passport initiative video. • BALADI CAP reforestation video.
As part of PMSPL II’s efforts to enhance the content of USAID/Lebanon’s FB page, the DOC Specialist made several field visits to four beneficiaries in Q3 FY2018. Following each visit, Figure 32: An IM Capital beneficiary (right) created an interactive educational software that won her the FB posts were prepared and shared for approval. Cartier Woman’s Initiative Award for the MENA region In Q4 FY2018, the DOC Specialist attended the Seeders graduation ceremony and prepared a post on one of the key beneficiaries who had won the Cartier Woman’s Initiative Award for the Middle East and North Africa for an online platform that uses artificial intelligence and data analytics to help learn and teach Arabic.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 48 DOC COORDINATION / MEETINGS Output 2.3.3 (Periodic Logistical Support for USAID DOC Unit Provided) focuses on devising a more strategic method of developing the communication component with USAID.
Event logistics/preparation (USAID/IM): Within the event logistics/preparation component, the DOC Specialist provides support to the IMs/Mission from initial preparation through the execution and follow- up stages. In Q1 FY2018, support was provided to the Mission for recruiting a production house and a Figure 33: Social Media intervention at the DOC graphic designer for the USAID poster. In Q2, the meeting DOC Specialist attended a Social Media presentation conducted by the U.S. Embassy. She also attended a USP event held at AUB where five students presented their community service projects to a USAID delegation.
In Q3FY2018, the annual IM DOC meeting was held at SI’s offices. During the meeting, USAID emphasized the importance of outreach moving forward. The partners interacted with bloggers and experts in social media, photography, and video production who shared their expertise about creative and effective ways to increase publicity. A full-day event was organized to include two morning sessions on blogging and social media and discussion panels in the afternoon.
In Q3, the DOC Specialist also attended the LED project launch and prepared an FB post accordingly. In Q4FY2018, the DOC Specialist provided the needed support to the Seeders graduation by attending the event and capturing the needed FB story, which she later turned into a post. She also requested the video showcased during the event to be used in the entrepreneurship week in November 2018 as well.
REPORTING Figure 34: Interventions at the DOC meeting The Mission requested the following reports from the DOC Specialist in FY2018:
• Weekly media coverage report: This report is submitted to the Communication Specialist at the Mission on a weekly basis. It includes all coverage of IM or Mission events in the media. • Monthly media coverage report: A monthly media coverage report is submitted on a rolling basis. It presents statistics on the coverage by type and by IM. • Six-Month media coverage report: A statistical compilation of the media each IM has accumulated over a period of six months. It also presents the total media appearances per media type.
USAID VIDEO
49 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV As part of Sub-Purpose 2.3 and within Output 2.3.3 (Periodic Logistical Support for USAID DOC Unit Provided), the Mission requested a short video be made to highlight USAID’s achievements in Lebanon. Work on this project started in Q1FY2018 and most of the filming took place in Q2FY2018. Shooting was finalized in Q3FY2018, and in Q4FY2018, both the short and long versions of the video were approved and submitted to the Mission along with all other deliverables, such as the rushes and the photo gallery. This activity has been concluded. Filming locations included:
- LIVCD Olive Oil Facility in Deir Bechtar - BALADI CAP in Shouf Biosphere - LRI and LWP in Bekaa and Rashaya - LIFE, LIVCD and BALADI in Ehmej - QITABI Daroun Public School - BALADI Jounieh Fishery - LWP Jeita Water Pump - BALADI CARITAS Saida Sports Stadium - Atelier du Miel - Lebanese American University (LAU) - American University of Beirut (AUB)
GRAPHIC DESIGN SERVICES Figure 35: Education poster released in Q1FY2018 In Q4FY2017, PMSPL II received a request to prepare posters and a roll-up banner to hang in USAID/Lebanon offices. In Q1FY2018, a graphic design agency was selected, and the work commenced immediately with the production of five posters on education, agriculture, reforestation, higher education, and microfinance. In Q2FY2018, two additional posters pertaining to water and community development were finalized and printed. A poster on rural tourism was supposed to be completed in Q4FY2018. The PMSPL DOC Specialist sent a few suggestions and requested photos to finalize the project but received no feedback. This project was therefore put on hold.
DOC SURVEY In Q3FY2018, PMSPL received a request to conduct an online survey to gauge the Lebanese people’s attitude towards, and perception of, USAID and the American Government and people. Social Impact hired a local data collection company to carry out the study, which surveyed Lebanese citizens of both sexes, aged 15-34, living in urban areas. All participants had to have a middle-school to university education and be social media users (especially Facebook).
The questions were posted online on May 11, 2018 and the target number of responses was reached on Figure 36: Water poster released in Q2FY2018 the same day. The survey’s results are shown in the table below.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 50 SUB-PURPOSE 2.4: SPECIAL STUDIES, ASSESSMENT, AND ADDITIONAL MEL REQUESTS COMPLETED BY PMSPL II This Sub-Purpose emphasizes PMSPL II’s support to the Mission in its decision-making regarding development issues gaining importance in the Lebanese society.
Within this Sub-Purpose and pertaining to Output 2.4.1 (Mission’s Decision-Making Process Facilitated), PMSPL II meets with, and accepts tasks from, USAID to identify special studies or assessments, for which technical assistance is needed. The contract agreement indicates the preparation of annual and periodic analyses and assessments that examine the effectiveness of USAID’s projects relative to the stated DOs and the development hypothesis. PMSPL II anticipates two or three such assignments each year, although ad hoc needs may arise.
EDUCATION GENDER ASSESSMENT The Education Gender Analysis (EGA) was initiated in Q4 of FY2016 following a request from the Mission to assess the impact of classroom learning from a gender-focused perspective. This request was made as USAID/Lebanon embarked on a set of new education activities that needed to be designed with a strong gender component.
The assessment covered three education levels: Basic education, Higher Education, and Technical and Vocational Education and Training (TVET). The three reports were approved in Q1FY2018 and uploaded on the DEC in Q2FY2018.
MISSION CDCS ASSESSMENTS As an examination of the current CDCS’ contextual environment and cross-cutting issues, PMSPL II received a request in Q1FY2018 to conduct five assessments:
1. Political Economy Assessment (PEA) at the macro level and within specific ministries where USAID expends significant resources (water, education, higher education, etc.) and at various levels using the DRG Framework; 2. Citizens Perception Survey (CPS) to complement, ground-truth, and flesh out the PEA; 3. Gender Assessment that includes Lebanese men’s attitude at the macro level as well as within specified ministries and at the municipal level, with a focus on economic and political perspectives; 4. Economic Growth Assessment (EGA) that examines and documents the investment climate and economic environment, with findings disaggregated by micro, small, medium, and large enterprises; and 5. Youth Assessment, including youths’ vulnerability to recruitment by extremist or criminal elements. (In Q2FY2018, USAID requested this assessment be dropped)
CDCS Gender Analysis
In Q2FY2018, PMSPL II and Encompass wrote the inception report for the analysis following a design meeting held on January 10th, 2018 and attended by 18 people, including 7 USAID staff. Two Encompass consultants facilitated the meeting with the help of PMSPL II’s Senior Gender Specialist. The results of the meeting informed the gender SOW and inception report.
51 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV Figure 37: Separate FGDs were held with women and men in Tripoli
PMSPL II then developed and finalized the SOW to conduct data collection. PMSPL II also finalized an agreement for contracting a local Gender Research Consultant to assist in the Gender Tasks for 2018. Similarly, two local researchers were hired to support in ensuring quality control over the field work.
In February 2018, two Encompass members supported PMSPL II in organizing a workshop for the data collectors who were hired to do the field work.
Data collection started in Q2FY2018 with a target of 73 KIIs and 56 FGDs. The field work was completed by the end of April. It was conducted by selecting a random sample of participants for the FGDs and identifying potential KIIs. A local firm played a key role in scheduling and organizing the FGDs while the local consultants provided the needed monitoring for the field work and drafted weekly reports including their observations on FGD moderation. The local consultants also compared the draft transcriptions to the original recordings to make sure these accurately reflected the FG participants’ testimonies.
Electronic questionnaires were also developed for the Key Informants with whom no live interview could be scheduled.
A summary report performance in managing and undertaking the data collection process was drafted for the record. It was shared with Encompass to feed into the final report.
To support data collection related to Governance, the Senior Gender Specialist coordinated with the Senior GIS Specialist to disaggregate 2018’s voting data nationwide by sex. The GIS Specialist coded, disaggregated, and consolidated voter data for 14 districts from the 2018 elections to be used for triangulation in the Gender Assessment. Once received in its final form, disaggregated by sex, geographical area, and sect, these data were shared with EnCompass to triangulate with other related gender analysis data and assess the women-to-men voter ratio.
Periodic meetings took place with the three Gender Analysis local consultants to assess the data collection process performance using the FGD Summary report as a background document. While data analysis was underway, "Save the Date" invitations were dispatched to USAID staff and external stakeholders to participate in the Findings Consultation meetings to share draft findings and conclusions and come up with relevant recommendations in a participatory manner.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 52 Figure 38: Stakeholders and partners discussing the gender assessment findings
The two-day meeting took place on July 11 and 12, 2018. The July 11 meeting was attended by 24 people representing external stakeholders, such as donors, ministries, UN organizations, and local NGOs. The July 12 meeting was attended by USAID staff and IPs. The purpose of these meetings was to collaborate and brainstorm with the major stakeholders in validation of the research’s findings and to propose recommendations that will help USAID programs adapt their projects as needed.
The draft Assessment report was finalized and submitted on the August 23rd.
Political Economy Analysis
Work on the PEA’s scope of work was completed in Q3FY2018. The SOW was then submitted to USAID for review and revised according to their feedback. It received final clearance in Q4FY2018. PMSPL started identifying potential candidates for the PEA. Following the dropout of a qualified team leader, we started looking for firms specialized in conducting PEAs. An RFP was released and only one proposal was received on September 20th. PMSPL is finalizing the subcontracting process. It is planned that the firm’s efforts will be supplemented by local experts in the field of governance, advocacy, and political economy. Four local consultants have already been identified. The PEA is scheduled to begin in December 2018 and conclude in February 2019.
Economic Growth Assessment
A first draft for the EGA SOW was submitted to USAID and shared with the EG Office in Q2FY2018. A meeting was held on March 13th, 2018 to discuss the received comments. Discussions with the EG Office helped reorient the assessment’s scope, and the draft was revised to capture the needed changes to the approach, the questions, and the requested deliverables. The final SOW was submitted on May 24th and approved on May 31st.
The EGA was initiated on August 23 with a kick-off meeting with USAID. During the first week of September, the EGA team focused on finalizing the inception report along with the data collection tools. A briefing meeting was held with USAID on September 7 to discuss the details of the inception report, the revised assessment questions, and the proposed stakeholders list for KIIs. The KIIs were initiated in mid-September and meeting minutes were drafted after each one. A KII and briefing with the EG team and the PO took place on September 21.
53 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV A kick-off meeting was held with the data collection firm on September 11. During the last week of September, the EGA team received and reviewed the KII discussion guide and the workplan proposed by the firm. The final selection of KIIs was finalized in coordination with PSMPL. The data collection firm began its field work in the first week of October. Meanwhile all seven sectoral desk reviews developed by them were submitted and reviewed by PMSPL.
By the end of September, the EGA team had completed KIIs with 45 stakeholders and 26 private sector firms. A presentation of the preliminary findings to USAID was scheduled for October 19.
Citizens Perception Survey
The SOW for the Citizens’ Perception Survey was drafted in collaboration with SI Home Office (HO). The survey will be initiated once the Gender Assessment, EGA and PEA are completed, as findings from those assessments may inform the design of the survey. The expected start date is February 2019.
PMSPL submitted the CPS SOW to USAID in Q4FY2018 and received clearance from the Technical Offices’ Directors.
The CPS was requested to examine, confirm, and further inform what was learned from the recent Gender Assessment, EGA, and PEA. A key objective of this survey is to serve as a resource document for a soon- to-be revised CDCS. The questions asked by the CPS are to be tightly linked to helping USAID/Lebanon achieve its DOs.
A three-step process was proposed to achieve a meaningful CPS that serves as a resource document for the CDCS:
- Step one is the design phase, where CPS objectives are matched with a questionnaire design and a sample design. Phase one will be implemented by SI professional staff from HO. - Step two is the data collection phase. The data collection contract will be awarded to a local firm through the free and open RFP process. The RFP itself is designed in step one. Both phases are subject to a rigorous design review and quality control measures. - Step three is data analysis conducted by SI HO in collaboration with PMSPL II and the Mission.
PUBLIC-PRIVATE PARTNERSHIP (PPP) OPPORTUNITIES The Government of Lebanon has long identified PPPs as a potential mechanism for attracting private sector participation to fill the country’s infrastructure gap. Prior to the enactment of the new PPP Law in September of 2017, the Higher Council for Privatization (HCP) published several articles and documents that laid out some of the key benefits for PPPs, clearly articulating the GoL’s PPP policy. In 2006, the HCP began advocating for the enactment of a PPP Law in Lebanon, and it prepared the draft law in 2007, which was eventually enacted in 2017 with the aim of creating clear tendering procedures and ensuring the incorporation of international best practices in all aspects of the PPP program. Until the recent passage of the PPP Law, there was limited understanding in Lebanon of how PPPs could be used to advance DOs. There is now a framework, as well as an early understanding of how this mechanism can work in the Lebanese context.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 54 The new PPP Law defines broadly what is possible mainly for large infrastructure projects and opens the door for municipalities and unions of municipalities to benefit from PPPs. The use of PPPs by municipalities still needs further elaboration to determine how they can use this mechanism to meet their local infrastructure needs. The Law exists, but the execution of the law is not yet clear.
Following the CLA learning event on PPP in Q3FY2018, PMSPL identified a need to develop a guide for determining how PPPs can be implemented at the municipal level to advance them as a mechanism to promote local development and provide opportunities to collaborate with US-based companies. But no activities were conducted in that respect in Q4 FY2018, as the government was still in the process of finalizing the needed guidance for PPP implementation at the local level.
One the same note, among the questions identified by the EGA as a tool to inform the PEA, there was one that examines how local government, including municipalities, could play a role in local economic development through PPP and other mechanisms. This justifies the need for further guidance and tools for PPP implementation. Additional work in that direction is foreseen is in FY2019.
55 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED Key Accomplishments • Completed Design Reviews for 145 BALADI and LWP construction projects • Conducted 122 Project Site Visits for BALADI and LWP construction projects • Submitted 83 PSV reports
Under this purpose, the PMSPL II team supports USAID’s oversight and management of engineering and construction activities executed under USAID/Lebanon projects and provides quality assurance and quality control services for design, tendering, and execution of these activities. This purpose consists of two sub-purposes that focus on 1) supporting the implementing mechanisms with their design activities and management of engineering and construction contracts; and 2) informing and reporting to USAID/Lebanon on all the issues and challenges that might compromise the completion of the engineering and construction activities.
PMSPL II’s Senior Engineer is the key staff person for Purpose III. He provides oversight of the subcontracted local A&E firm, (DAHNT), which was assigned in FY2016. DAHNT is issued with Task Orders under an indefinite delivery/indefinite quantity (IDIQ) sub-contract agreement that complements the fulfillment of the Sub-Purpose outputs listed below.
Because of the increased workload resulting from the LWP design reviews and site inspections, PMSPL II recruited a Quality Management Engineer in Q3FY2018. Her main responsibility is to improve the tracking and reporting of A&E oversight activities.
In Q3FY2018, a review of the QA/QC protocol with LWP was initiated to improve the communication between PMSPL and LWP and the coordination between DAHNT and the Quality Control Engineers subcontracted by LWP. This was completed in Q4FY2018 and resulted in a better communication between SI and LWP. PMSPL and DAHNT discussed several TO propositions to help provide the needed assistance and expertise and facilitate effective communication on the field.
Similarly, the QA/QC protocol for design reviews under BALADI was revisited to agree on the essential documents that need to be submitted prior the review and to shorten the review timeframe for BALADI Round Three projects. Adjustments on the QA/QC protocol were made to facilitate communication between the partners, limit the back and forth on specific issues, speed up the review process in order to avoid delays in the activities’ implementation, and limit and reduce the number of design reviews. These adjustments make the design review process and site inspections more efficient and less costly and Figure 39: PSMPL’s A&E team during a improve the flow of actionable information. site visit to a BALADI project in Majdel Baana
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 56 Q4FY2018 witnessed intensive work related to BALADI projects and a shift to monitoring work for LWP’s implemented, water-related construction activities.
A&E MEETINGS As part of Sub-Purpose 3.1, and in accordance with Output 3.1.1 (Engineering Designs, Specifications and Engineering Submissions are Reviewed and Verified), eighteen formal meetings were held in FY2018 with USAID, BALADI, and LWP to refine the QA/QC protocol. During the meetings, participants also discussed relevant adjustments that take into consideration the nature of the projects implemented under BALADI Round Three of municipal awards and the implementation schedule of six water-related construction projects sub-contracted under LWP.
In line with Sub-Purpose 3.1 and within Output 3.1.2 (Quality Assurance and Quality Control are Provided on the Implementer’s Engineering Design Activities), the Senior Engineer and the subcontracted A&E firm conducted extensive field oversight, inspections, and verification to support the review of the design activities.
LWP infrastructure project designs are complex, and design reviews require a wide range of expertise to provide the needed quality assurance. The expertise is provided by DAHNT through a specific TO that is discussed, reviewed, and approved by PMSPL engineers. Timeliness of the review is critical and, as challenging as the design review may be, the review needs to be completed before the 10-day deadline indicated in the QA/QC protocol. As with BALADI projects, the need for open engineer-to-engineer communications was acknowledged and has been reflected in more frequent meetings with RMF and Caritas.
In Q4FY2018 and after intensive discussions with PSMPL, DAHNT re-formulated monthly TOs for LWP quality assurance over monitoring field work. The TOs were designed for each LWP construction activity in order to specify technical POCs. The Level of Effort assigned to each monthly monitoring TO will be reviewed on a monthly basis to reflect the progress of LWP’s construction work plan. The purpose of the monthly TOs is to reduce the administrative burden and increase the responsiveness needed for field monitoring. These TOs are generic and provide the access to the core engineers that is needed for the LWP monitoring.
Meetings with LWP, PMSPL II, DAHNT, and WP’s construction contractors to review the DAHNT findings of LWP design review are now a regular occurrence. Many issues are resolved or clarified during these meetings, with the contractor agreeing to respond with additional documentation and analysis as needed.
IM ENGINEERING ACTIVITIES In FY2018, the PMSPL II Engineer and DAHNT completed 137 design reviews and conducted 125 site verification visits to BALADI and LWP projects (Refer to Annex B for details). The detailed reports Figure 40: PSMPL II and BALADI teams during a submitted to the Mission included updates on the site visit
57 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV progress of each construction activity under the Mission’s project(s), the challenges encountered, and recommended solutions. Furthermore, they included detailed information regarding the contractor’s compliance with design specifications and quality, safety, and environmental standards.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 58 MANAGEMENT AND ADMINISTRATIVE ISSUES This section highlights major issues under contract and administration as well as general project administration.
CONTRACT ADMINISTRATION ELEMENTS PMSPL contract administration elements include human resources, procurement, financial reporting, security, and general operations. These functions are the responsibility of the Lebanon-based Project Accountant and Operations Manager. Oversight and guidance on local project administration are provided by the COP and DCOP. PMSPL II’s oversight and guidance are conducted by SI’s Executive Vice President for Programs, the Project Management Unit (PMU), the Project Manager, and the Project Assistant, all located in Arlington, Virginia. Together, both the local and HO staff ensure compliance with USAID regulations.
In FY2018, two contract modifications were approved:
• Contract Modification 6, which realigned the budget, added a second driver, and added a second engineer under the A&E component.
• Contract Modification 7 related to NICRA budget realignments, which added a new M&E specialist and an Editor position.
A non-obligated additional budget was also received for the CSP A&E activities.
Major achievements of FY2018 include:
• Reports submitted: o Q4 F2017, Q1 FY2018, Q2 FY2018, and Q3 FY2018 reports. o FY2017 annual report.
• Vetting completed for: o SI and PMSPL II key personnel. o All subcontractors.
• Miscellaneous: o Timely submission of monthly invoices. o First-aid training for PMSPL II staff by the Red Cross. o Awareness session on the Lebanese labor law.
59 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV LESSONS LEARNED The following recommendations can be made based on the lessons learned in FY2018:
• For posters and other artwork to be produced for USAID, all photos and required materials should be ready before production in order to avoid delays in execution.
• Videos should be filmed during spring or summer when there’s more natural light and aesthetic scenery. Filming in winter can cause delay due to wind and rain.
• When filming a USAID video, it is advisable to shoot additional footage as back-up material to be later used for other shorter videos for FB.
• When filming beneficiaries, instead of using scripted texts, it is better to do a Q&A from behind the camera so that the interviewees appear natural, relaxed, and spontaneous.
• During intensive field work, it would be more efficient to have a person in charge of scheduling, coordinating, and organizing meetings, KIIs, and FGDs.
• As part of activity alignment, guidance is to be provided beforehand to both USAID and the implementing partners to speed up the process and set the expected objectives.
• Ongoing mentoring and discussions are essential during the activity alignment process. If needed, several propositions can be provided and illustrated so that the implementing partners can better assimilate what is requested to align their logical framework with the main project.
• Prime agreements and protocols need to be revisited as required to maintain and improve communication between parties. This will ensure that work is timely progressing towards its intended objective.
• Continuous discussions and clarifications with the IPs and USAID are a must to maintain proper communication and achieve a common understanding of the identified issues that may affect the partners’ activities and USAID’s deadlines.
• During events and workshops: o Duplication of content in the IP presentations needs to be kept minimal. o Discussions and presentations can be designed in a way to focus on new ideas and lessons learned rather than what the IPs have done. The in-depth review of the presentation will facilitate this as well. o Conduct Q&A sessions at regular intervals to retain the participants’ attention. o The invitation should mention that the full-day presence of the IP’s staff is mandatory. o Evaluation forms should be filled out by participants to help improve and better plan for future events.
• Broader and diverse recruitment channels are needed in order to find the best candidates.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 60 CRITICAL ASSUMPTIONS
CONTEXT FOR ACHIEVING TARGETS AND GOALS OF THE CDCS In general, the status of critical assumptions and causal relationships defined in the RF continue to hold. However, data gathered for the QITABI evaluation showed that the number of Syrian students in public schools increased significantly, even exceeding the number of Lebanese students in some public schools. This may affect the way that QITABI supports public schools in overcoming this pressure without major changes to the related IRs.
The GoL adopted a new budget, which was a major requirement to fulfill before seeking additional external funding. If Lebanon succeeds in securing external funds, this may impact the development sector and generate additional reforms. This will have an impact on IM implementation. IM’s working in some sectors (especially education and water) may need to assess these effects.
After the CDCS mid-course stocktaking, PMSPL II was asked to conduct a series of assessments that will support the update of the current CDCS. The results of this exercise, expected to be completed by Q1FY2019, will inform on whether the DOs and IRs, as well as the goals and targets of the CDCS, need revision.
CRITICAL ASSUMPTIONS FOR PMSPL II The following events occurred in FY2018:
• The immediate neighborhood of PMSPL II offices remained calm, with no noticeable changes in security; • Access to USAID/Lebanon’s Program Office and staff remained excellent throughout the fiscal year. PMSPL II continued to enjoy a positive relationship with the Mission staff and IMs. • Some degree of tension and instability occurred prior to the parliamentary elections in May 2018.
Military operations near Aarsal, Baalbeck, and Akkar have effectively eradicated Islamist groups, and life has returned to normal there. This paves the way for more development activities in these regions.
Progress toward achieving PMSPL II’s performance indicator targets may be constrained should the following critical assumptions be disturbed:
• The operating environment in Lebanon remains sufficiently stable and secure to allow planned PMSPL II activities to proceed; and • The PMSPL II team continues to have access to USAID/Lebanon’s Program Office and DO teams (i.e. A/COR’s) for consultations and guidance to support the implementation of this plan.
None of these critical assumptions were disturbed in FY2018 and work has continued normally.
61 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV ANNEX A: PROGRESS SUMMARY Achieved versus planned progress for the period is disaggregated by gender, geographic area, and other relevant factors (see table below).
FY2018 IPTT.xlsx
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 62 ANNEX B: REPORTS SUBMITTED
QI FY2018 Q2 FY2018 Q3 FY2018 Q4 FY2018 Quarterly Reports Q4 FY2017 QI FY2018 Q2 FY2018 Q3 FY2018 Annual Reports FY2018 PSVs PSV 038: BALADI CL DV PSV 039: LIVCD INVENTORY PSV 042 : LIVCD DV PSV 046: LIFE DV Y2Q4 VERIFICATION PSV 037: LIVCD DV PSV 040: LWP INVENTORY PSV 043 : BALADI CL DV PSV 047: LWP DV Y2Q4 VERIFICATION
PSV 041: LRI DV PSV 044 : BALADI RMF DV PSV 048: MENA DV
PSV 036: BALADI RMF DV PSV 045 : LIVCD NXP PSV 49: BALADI CARITAS DV Y2Q4 PSV 51: QITABI DV
A&E PSVs/Design DR 156: BALADI RMF DRR 184: BALADI RMF DRR 209: BALADI RMF DRR 256: BALADI Review (DR) Reports Tanourine recreation area Bhanine Irrigation Network Ehmej Cold Storage Facility RMF Yahchouch Cultural Center DR 157: BALADI CL DRR 185: BALADI DRR 210: BALADI DRR 258: BALADI Qornayel youth village Caritas Deir Mimes RMF Beshmezzine Solar Energy RMF Beshmezzine Solar Energy Community Center Generation Generation DR 158: BALADI CL DRR 186: BALADI DRR 211: BALADI DRR 259: BALADI Caritas Anjar Gharb El Aala argo food Caritas Chiah Football RMF Tanourine Recreational Agro Food Processing restriction plan Stadium Area DR 159: BALADI RMF DRR 187: BALADI DRR 212: BALADI DRR 260: BALADI RMF Batloun Yahchouch cult. Center RMF Maasser El Shouf RMF Yahchouch Cultural Information Center & Hiking VO request Irrigation Network Center Trail DR 160: BALADI RMF DRR 189: LWP Jezzine DA DRR 213: BALADI RMF Jran DRR 262: BALADI Tanourine recreation area Solar Energy Generation Caritas Khiara Argo Food Electrical only Processing DR 161: BALADI RMF DRR 190: BALADI DRR 215: BALADI RMF Kefraya DRR 263: BALADI Hrar Garden 3rd Caritas Rmeich Basketball Echography Machine RMF Tanourine Recreational submittal court Area DR 162: BALADI CL DRR 191: BALADI DRR 216: BALADI RMF Fih DRR 264: BALADI Caritas Deir Araya Garden 3rd Caritas Majdel Baana Sport Mammography Machine Mimes Community Center submittal Center
63 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV DR 163: BALADI CL DRR 193: BALADI RMF Toula DRR 217: BALADI DRR 265: BALADI RMF Mazreat Qornayel youth village Community Center Caritas Qornayel Youth center Al Shouf Public School 2nd submittal DR 164: BALADI CL DRR 194: DRR 218: BALADI DRR 266: BALADI RMF Beit Qsaibe Garden 7th BALADI Caritas Ramlieh Solar RMF Bshatfine Tourism Area Chlala Generator submittal RW3 Energy Generation DR 165: BALADI RMF Tal DRR DRR 219: BALADI DRR 267: BALADI Caritas Jabal Abbas irrigation 3rd 195: BALADI Caritas Deir Caritas kawkaba Tourism el Sheikh Sport Stadium submittal Mimes Community Center Venue DR 166: BALADI RMF DRR 196: BALADI DRR 220: LWP Jezzine DA DRR 268: LWP BWE Bar Elias / Hrar Garden 4th submittal Caritas Khiara Argo Food Ghazeh/ Baaloul water facilities. Proccessing LWP #2 DR 167: BALADI CL DRR 197: BALADI DRR 222: BALADI Caritas Deir DRR 269: LWP NLWE Kawkaba prefab houses RMF Bshatfine Tourism Area Mimes Community Center Aayoun/Rachiine/Rahbeh water 6th submittal facilities. LWP #6 DR 168: BALADI RMF DRR 198: BALADI DRR 223: BALADI DRR 270: BALADI Beshmezzine solar energy Caritas Kfarmishki Solar RMF Mashmouche Solar Water Caritas kawkaba Tourism 5th Submittal Energy Generation Heaters Venue DR 169: BALADI RMF DRR 199: BALADI DRR 214: BALADI RMF Bebnine DRR 271: BALADI RMF Jran Tanourine recreation area RMF Mehmarsh/Assia/Beit Solar Energy Hybrid PV 3rd submittal Chlala DR 170: BALADI CL DRR 200: BALADI DRR 221: BALADI DRR 272: BALADI Ainata cooling 2nd RMF Mashha Community Caritas Ramlieh Solar Energy Caritas Qosaybeh Recreational submittal Bakery Generation Area DR 171: BALADI CL DRR 201: BALADI DRR 224: BALADI DRR 273: LWP BWE Water Menjez solar energy 3rd Caritas Zawtar El Gharbiyeh RMF Beshmezzine Solar Energy meters & Chlorinators. LWP submittal Water Solar Power Generation #1
DR 172: LRI Bkassine DRR 202: USAID New USAID DRR 225: BALADI RMF Toula DRR 274: BALADI RMF Douma Forest office Community Center Youth Club & Playground DR 173: LWP Jezzine Park DRR 203: BALADI DRR 226: BALADI DRR 275: LWP BWE Water 5th submittal RMF Bebnine Solar Energy Caritas kawkaba Tourism meters & Chlorinators. LWP Venue #1 DR 174: BALADI RMF DRR 204: BALADI RMF Fih DRR 228: BALADI RMF Kattin DRR 276: BALADI Caritas Anjar Beshmezzine solar energy Mammography Machine Hidab Solar Water Heaters Agro Food Processing 6th Submittal DR 175: BALADI RMF DRR 205: BALADI DRR 229: BALADI DRR 277: BALADI RMF Kattin Korsayta irrigation 3rd RMF Kefraya Echography Caritas Ainata Cold Storage Hidab Solar Water Heaters submittal Machine Facility - Jean Paul 2
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 64 DR 176: BALADI RMF DRR 206: BALADI DRR 230: LWP Waste Water DRR 278: BALADI RMF Bcharre Menjez solar energy 4th RMF Tanourine Recreational (BMLWE, SLWE, NLWE, BWE). Ecotourism Trail submittal Area LWP #7 DR 177: BALADI CL DRR 207: BALADI DRR 231: BALADI DRR 279: BALADI Baaloul Solar farm 4th RMF SWH Generic Document RMF Rachiine Street LED lights RMF Tanourine Recreational submittal Area DR 178: LRI Maqne DRR 208: BALADI DRR 232: BALADI DRR 280: BALADI Rehabilitation Caritas Zawtar El Gharbiyeh RMF Maasser El Shouf Irrigation RMF Beshmezzine Solar Energy Water Solar Power Network Generation DR 179: BALADI RMF SVR 28a: LWP LWP#1 Bekaa DRR 233: BALADI DRR 281: BALADI Beshmezzine solar energy Chlorinators RMF Bshatfine Tourism Area RMF Bshatfine Tourism Area 6th Submittal DR 180: BALADI CL Jabal SVR 28b: LWP LWP#1 Bekaa DRR 234: BALADI DRR 282: BALADI el sheikh sport stadium Chlorinators RMF Tanourine Recreational Caritas Rmeich Basketball 2nd submittal Area Court. DR 181: BALADI RMF SVR 28c: LWP LWP#1 Bekaa DRR 235: BALADI DRR 283: BALADI Caritas Deir Maasser El Shouf concrete Chlorinators Caritas Khiara Argo Food Mimes Community Center. and test reports Processing DR 182: BALADI RMF SVR DRR 236: LWP Metn DA. LWP DRR 284: BALADI RMF Batloun Kfaryashit solar 6th 29: BALADI Caritas Kawkaba #4 Information Center & Hiking submittal Tourism Venue Trail. DR 183: BALADI CL SVR 30: LWP LWP#1 Bekaa DRR 237: BALADI RMF Bcharre DRR 285: BALADI RMF Beit Kfarmishki solar 4th Chlorinators Ecotourism Trail Chlala Generator. submittal PSV 016 BALADI CL SVR 31: BALADI RMF Bhanine DRR 238: BALADI DRR 286: LWP Koura DA. LWP Ainata #3 Irrigation Network RMF Yahchouch Cultural #5. Center PSV 017 BALADI RMF SVR 32: BALADI RMF Bebnine DRR 239: BALADI RMF Fih DRR 287: BALADI RMF Kfaryashit #4 Solar Energy Mammography Machine Yahchouch Cultural Center. PSV 018 BALADI RMF Tal SVR 33: BALADI RMF Maaser DRR 240: BALADI DRR 288: BALADI RMF Assia Abbas #2 El Chouf Irrigation Network Caritas Ainata Cold Storage Generator. Facility PSV 020 BALADI Douma SVR 34: BALADI RMF BALADI DRR 241: BALADI RMF Toula DRR 289: BALADI RMF Bebnine #2 3 – Mehmarsh/Assia/Beit Community Center Solar Energy. Chlala PSV 021 BALADI RMF SVR 36: BALADI RMF Ehmej DRR 242: BALADI RMF Bebnine DRR 290: BALADI RMF El Yahchouch cold storage facility Solar Energy Amayer Photovoltaics.
65 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV PSV 022 BALADI RMF SVR 38: BALADI DRR 243: BALADI DRR 291: LWP Waste Water Maaser El Chouf RMF Yahchouch Cultural RMF Maasser El Shouf Irrigation (BMLWE, SLWE, NLWE, BWE) Center Network & Constructed Wetland (BWE). LWP # 7&8. PSV 023 BALADI CL SVR 39: BALADI DRR 244: BALADI RMF Douma DRR 292: BALADI RMF Fardis Qsaibe South RMF Beshmezzine Solar Energy Youth Club & Playground Photovoltaic & Generator. Generation PSV 024 BALADI CL MM 11: LWP Jezzine DA DRR 245: LWP Koura DA. DRR 293: BALADI Caritas Kawkaba #2 LWP #5 Qornayel Youth center. PSV 025 BALADI CL MM 12: LWP Koura and Metn SVR 35: LWP LWP#2 Bar Elias / DRR 294: BALADI RMF Ainata #4 Ghazeh/ Baaloul M#1/March Mehmarch Generator. 2018 PSV 026 LWP Bekaa site MM 13: BALADI Round 3 RMF SVR 37: LWP LWP#2 Bar Elias / DRR 295: BALADI RMF monitoring Chlorinators Ghazeh/ Tanourine Recreational Area. #1 Baaloul M#2/April 2018 SVR 40: BALADI DRR 296: LWP NLWE Caritas Kfarmishki Solar Energy Aayoun/Rachiine/Rahbeh water Generation facilities. LWP #6.
SVR 41: BALADI Caritas Jabal el DRR 297: BALADI RMF Sheikh Sport Stadium Bshatfine Tourism Area. SVR 42: LWP#1 Bekaa Water DRR 298: BALADI RMF Fatri meters & Chlorinators M#5, Ecotourism Area. Hand Over/April 2018/part 1
SVR 43: BALADI RMF Jran Solar DRR 299: BALADI RMF Bzeil Energy Generation Generator. SVR 44: BALADI DRR 300: BALADI RMF Fardis Caritas Qosaybeh Recreational Photovoltaic & Generator. Area
SVR 46: BALADI Caritas Khiara DRR 301: BALADI RMF Assia Argo Food Processing Generator. SVR 47: BALADI RMF Toula DRR 302: BALADI RMF El Community Center Amayer Photovoltaics.
SVR 48: BALADI Caritas Ainata DRR 303: BALADI Cold Storage Facility Caritas kawkaba Tourism Venue. SVR 45: LWP#2 Bar Elias / DRR 304: Baaldi Caritas Jabal el Ghazeh/ Baaloul M#3/May 2018 Sheikh Sport Stadium.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 66
SVR 49: LWP LWP#1 Bekaa DRR 305: BALADI RMF Ras Water meters & Chlorinators Baalback Solar Water Pumping.
SVR 51: BALADI Caritas Majdel DRR 306: BALADI Baana Sport Center Caritas Chiah Football Stadium.
SVR 52: BALADI RMF Bcharre DRR 307: BALADI Ecotourism Trail Caritas Qornayel Youth Center. SVR 53: BALADI RMF Batloun DRR 308: BALADI RMF Al Information Center & Hiking Noura Street LED lights. Trail SVR 54: BALADI RMF Douma DRR 309: BALADI Youth Club & Playground Caritas Kfarmishki Solar Energy Generation. SVR 55: LWP LWP#2 Bar Elias / DRR 310: BALADI RMF El Ghazeh/ Baaloul W#1/week 4-9 Amayer Photovoltaics. June 2018
SVR 56: LWP LWP#2 Bar Elias / DRR 311: LWP Koura DA. LWP Ghazeh/ Baaloul W#2/week 11- #5. 14 June 2018 SVR 57: LWP LWP#2 Bar Elias / DRR 312: BALADI Ghazeh/ Baaloul RMF Tanourine Recreational Area. HOR 1a: LWP LWP#1 Bekaa DRR 315: BALADI RMF Jezzine Water meters & Chlorinators Tourism Area. Hand Over/April 2018/part 1 HOR 1b: LWP LWP#1 Bekaa DRR 318: BALADI RMF Fardis Water meters & Chlorinators Photovoltaic & Generator. Hand Over/April 2018/part 1
SVR 59a: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul M#5/July 2018/W1 SVR 59b: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul M#5/July 2018/W2
SVR 59c: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul M#5/July 2018/W3
67 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV SVR 59d: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul M#5/July 2018/W4
SVR 60: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#4/week 25- 30 June 2018 SVR 61: BALADI Caritas Jabal el Sheikh Sport Stadium SVR 62: BALADI Caritas Baaloul Solar Power Generation SVR 63: BALADI Caritas Chiah Football Stadium SVR 64: BALADI RMF Toula Community Center SVR 65: BALADI RMF Fatri Ecotourism Area SVR 66: BALADI Caritas Rmeich Basketball court SVR 67: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#1/week 30 July - 4 August 2018.
SVR 68: BALADI RMF Hrar Community garden. SVR 69: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#2/week 7- 11 August 2018.
SVR 70: BALADI Caritas Qab Elias Ecotourism Area. SVR 71: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#5/week 27 Aug - 1 Sept 2018.
SVR 72: BALADI Caritas Gharb El Aala Agro Food Processing. SVR 73: BALADI Caritas Ramlieh Solar Energy Generation. SVR 74: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#1/week 3-8 September 2018.
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 68 SVR 75: BALADI RMF Menjez Solar Energy Generation.
SVR 76: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#2/week 10- 15 September 2018. SVR 78: BALADI RMF Yahchouch Cultural Center. SVR 79: BALADI RMF Jezzine Tourism Area. SVR 80: LWP LWP#2 Bar Elias / Ghazeh/ Baaloul W#3/week 17- 22 September 2018.
MM#15: BALADI RMF Tanourine Recreational Area. HOR#2: LWP LWP#1 Bekaa Water meters & Chlorinators Hand Over/August 2018/part 2. DQAs DQA MENA
Evaluations QITABI midterm MENA Midterm B-CAP final Assessments Technical and Vocational Gender Assessment Education and Training (TVET) Education Gender Analysis Special Studies
69 | PMSPL II | ANNUAL REPORT, FY2018 USAID.GOV ANNEX C: FINANCIAL REPORT [redacted]
USAID.GOV PMSPL II | ANNUAL REPORT FY2018 | 70 Social Impact
2300 Clarendon Boulevard, Suite 1000 Arlington, VA 22201 USA