PERFORMANCE MANAGEMENT AND SUPPORT PROGRAM FOR LEBANON II (PMSPL II) ANNUAL REPORT FY2017
DISCLAIMER: The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government.
Note: Limited redactions have been made to this version of the report in accordance with the principled exceptions to the presumption in favor of openness established in OMB Bulletin 12-01, “Guidance on Collection of U.S. Foreign Assistance Data.”
USAID/PERFORMANCE MANAGEMENT AND SUPPORT PROGRAM FOR LEBANON II (PMSPL II) ANNUAL REPORT FY2017 (October 1, 2016 – September 30, 2017)
Submission date: December 2017
This document was produced for review by the United States Agency for International Development Mission for Lebanon (USAID/Lebanon).
Contract/Order No.: AID-268-C-15-00001USAID/Lebanon PMSPL II Project Social Impact, Inc.
Librex Center Bldg, 3rd Floor Zalka, Beirut Lebanon
This document is submitted by Social Impact, Inc., to the United States Agency for International Development under USAID Contract/Order No. AID-268-C-15-00001.
i | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV CONTENTS Contents ii
Figures and Tables ...... iii
Acronyms ...... iv
Executive Summary ...... vii
Program Overview/Summary ...... 1
Program Description and Introduction...... 1
Reporting PMSPL II Work Plan Activities ...... 3
Purposes and Sub-Purposes ...... 3 Work Plan Meeting and Approval ...... 4 Quarterly Reports ...... 4 Key Activities Status for FY2017 ...... 5 Challenges Encountered in FY2017 ...... 10 Summary of Results to Date...... 11
Activity Implementation Progress ...... 12
Purpose I: USAID MEL Activities Enhanced ...... 12 Purpose II: Direct Support to USAID’s Program Management Increased...... 40 Purpose III: USAID’s Architecture and Engineering Services Enhanced ...... 51
Management and Administrative Issues ...... 54
Contract Administration Elements ...... 54
Lessons Learned ...... 55
Critical Assumptions ...... 57
Context for Achieving Targets and Goals of the CDCS ...... 57 Critical Assumptions for PMSPL II ...... 57
Annex A: Progress Summary ...... 58
Annex B: Reports Submitted ...... 59
Annex C: Financial Report ...... 63
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | ii FIGURES AND TABLES Figure 1. LWP engineer trains farmers on drip irrigation system...... 14
Figure 2. BALADI CAP MEL plan was approved in July of Q4 FY2017...... 15
Figure 3. MENA II MEL plan received approval at the end of FY2017...... 16
Figure 4. USP MEL plans for both AUB and LAU were approved...... 17
Figure 5. In Q4 FY2017, it was agreed that the beneficiaries’ database will be implemented with LIFE, since it is a newly established IM...... 18
Figure 6. Collaboration with EnCompass took place throughout the year...... 20
Figure 7. This Year’s Gender Training was titled “Integrating Gender into Economic Growth and Value Chains,” deriving examples from LIVCD...... 22
Figure 8. PMSPL II conducted a data verification for all indicators that were not verified in previous PSVs and no major findings or concerns were identified...... 25
Figure 9. A data verification session was conducted with the BALADI Caritas team in the last week of FY2017. Most of the Caritas MEL team are newly employed, which presented many challenges...... 28
Figure 10. Sample map for olive oil value chain ...... 32
Figure 11. An in-depth midterm evaluation was conducted for QITABI in FY2017...... 38
Figure 12. IM news and events represent the major content for Facebook posts...... 44
Figure 13. A 60-page rural booklet was delivered by PMSPL II...... 44
Figure 14. PMSPL II suggested a testimonial from the son of a female beneficiary in the LRI project...... 46
Figure 15. The A&E component in FY2017 also included DV for LWP...... 52
Table 1. Summary of PMSPL II ...... Error! Bookmark not defined.
Table 2. Key Activities Status for Q4 FY2017 ...... 5
Table 3. Reports Submitted ...... 59
iii | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV ACRONYMS A&E architecture and engineering ADS Automated Directives System ALI Association of Lebanese Industrialists AMIDEAST America-Mideast Educational and Training Services, Inc. AOR Agreement Officer’s Representative AT+ AIDtracker Plus AUB American University of Beirut BALADI Building Alliances for Local Advancement, Development, and Investment BALADI CAP BALADI CAP Building Alliance for Local Advancement, Development and Investment – Capacity Building BEGA Basic Education Gender Assessment CCIAB Chamber of Commerce, Industry, and Agriculture of Beirut CDCS Country Development Cooperation Strategy CDP Community Development Project CEI Civic Engagement Initiative CERD Center for Educational Research and Development CIO chief information officer CIRS Context Indicator Reference Sheet CL Caritas Lebanon CLA collaborating, learning, and adapting COP Chief of Party COR Contracting Officer’s Representative CPFF cost plus fixed fee CSS Citizen Satisfaction Survey CSO civil society organization C-TIP Counter-Trafficking in Persons D-RASATI Developing Rehabilitation Assistance to Schools and Teachers Improvement DAHNT Dar al Handasah Nazih Taleb DCOP Deputy Chief of Party DEC Development Experience Clearinghouse DO Development Objective DOC Development Outreach and Communication DOPS Department of Orientation and Governance DQA data quality assessment DR design review DRI Democracy Reporting International DV data verification EGA Education Gender Assessment EGR Early Grade Reading EQUI Evaluation, Quality, Use, Impact FB Facebook FGD focus group discussion FTF Feed the Future FY fiscal year GBV gender-based violence GE/FE gender equality/female empowerment GIS geographic information system GOL Government of Lebanon HJC Higher Judicial Court
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | iv HO head office HQ headquarters HU Haigazian University IDIQ indefinite delivery, indefinite quantity IE impact evaluation IM implementing mechanism IP implementing partner IPTT indicator performance tracking table IR Intermediate Result IT information technology IWSAW Institute for Women’s Studies in the Arab World KII key informant interview KM knowledge management LAU Lebanese American University LDP Local Development Project LED Lebanon Enterprise Development LGA Local Governance Assessment LIFE Livelihoods and Inclusive Finance Expansion LIVCD Lebanon’s Industry Value Chain Development LOE level of effort LOP life of project LRA Litani River Authority LRI Lebanon Reforestation Initiative LWP Lebanon Water Project M&E monitoring and evaluation MEHE Ministry of Education and Higher Education MEL monitoring, evaluation, and learning MENA II Middle East and North Africa Investment Initiative MoSA Ministry of Social Affairs MRR mapping risks and resources MSI Management Systems International NXP non-expendable property ODK Open Data Kit PAD Project Appraisal Document PE performance evaluation PIRS Performance Indicator Reference Sheet PMP Performance Management Plan PMSPL Performance Management and Support Program for Lebanon PMU project management unit PO Program Office PPL Policy, Planning, and Learning PPP public-private partnership PPR Performance Plan Report PSV project site visit QITABI Quality Instruction Towards Access and Basic Education Improvement RF results framework RFP request for proposal RMF Rene Moawad Foundation ROL Rule of Law SI Social Impact, Inc.
v | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV SOO Statement of Objectives SOW Scope of Work STTA short-term technical assistance TAG technical advisory group TO technical office TVET technical and vocational education and training UN United Nations UNDP United Nations Development Programme UNHCR United Nations High Commissioner for Refugees UNICEF United Nations Children’s Fund U.S. United States USAID United States Agency for International Development USFS United States Forestry Services USG United States Government USP University Scholarship Program WP Work Plan
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | vi EXECUTIVE SUMMARY Social Impact, Inc. (SI) was awarded the contract for the Performance Management and Support Program for Lebanon (PMSPL) II project on October 1, 2015. The award amount to SI under contract number AID-268-C-15-00001is $24,664,441, inclusive of fixed fees. The contract is a cost-plus-fixed-fee (CPFF) term contract. This annual progress report covers the one year of project implementation through September 2017.
The purpose of PMSPL II is to supplement the monitoring and program management efforts of USAID/Lebanon staff and to verify, monitor, and support USAID program performance in Lebanon, ensuring the achievement of the Mission’s Country Development Cooperation Strategy (CDCS) for 2014–2018 objectives.
To streamline and manage the tasks of the program, Social Impact developed a work plan that outlined activities and deliverables during FY2017 based on the three main purposes listed below. The work plan was approved in Q2FY2017 and formed the basis for the work executed for the project. To keep track of the progress, quarterly reports were submitted by PMSPL II that covered the achievements each quarter. This Annual Report is based on the FY2017 Quarterly Reports.
Highlights in the Annual Report are structured according to contract components (purposes) and the approved work plan:
SUB-PURPOSE 1.1: MISSION PMP IMPLEMENTED AND MAINTAINED Within Sub-Purpose 1.1 (Mission PMP Implemented and Maintained), the PMSPL II team is expected to adopt a collaborative and participatory approach, working closely with the Development Objective (DO) teams and the Program Office to implement, review, and update on a yearly basis the Mission Performance Management Plan (PMP) and logical frameworks (log frames).
In FY2017, PMSPL II submitted an updated monitoring, evaluation, and learning (MEL) schedule, revised indicator list, updated Performance Indicator Reference Sheets (PIRSs), and an updated tracking table. Along with this sub-purpose, the log frames for DO1 and DO2 were finalized. As for the PMP data tracking and collection, PMSPL submitted during this year the FY2017 PMP indicator tracking sheets that were used to collect quantitative data.
In FY2017, the PMP indicators were updated and directly integrated in the MEL plan that were in the development process or undergoing revisions, such as University Scholarship Program (USP); Building Alliances for Local Advancement, Development, and Investment – Capacity Building (BALADI CAP); Lebanon Reforestation Initiative (LRI); and Livelihoods and Inclusive Finance Expansion (LIFE).
During this year, PMSPL II also updated the PMP PIRSs, taking into consideration the revisions to indicators and the implementing mechanisms’ inputs. The PMP MEL schedules were also updated, taking into consideration the A/COR MEL requests that had been communicated during this year.
Within Sub-Purpose 1.2 (Improved Implementing Mechanism Monitoring and Evaluation), PMSPL II worked with several implementing mechanisms (IMs) to develop MEL plans as per the FY2017 updated Automated Directives System (ADS) requirements. In FY2017, PMSPL II received approval on the
vii | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV BALADI CAP, Lebanon’s Industry Value Chain Development (LIVCD), Middle East and North Africa Investment Initiative (MENA II), Quality Instruction Towards Access and Basic Education Improvement (QITABI), LRI, LIFE, and USP7 MEL plans. PMSPL II also conducted data quality assessments (DQAs) for BALADI CAP, Lebanon Water Project (LWP), MENA II, and LRI.
A series of MEL support sessions was also provided to MENA II, LIVCD, LIFE, and Lebanese American University (LAU).
Finally, within this sub-purpose, MEL alignment was completed and approved for LWP, LIVCD, QITABI, LIFE, MENA II, BALADI CAP, and LRI.
As for Sub-Purpose 1.3 (Increased Integration of Gender into USAID/Lebanon’s Activities), a series of accomplishments was registered. In the first half of FY2017, PMSPL II entered into an agreement with EnCompass, a subcontractor providing support on the gender component in the PMSPL II agreement. Collaboration with EnCompass (PMSPL II’s subcontractor) took place throughout the year, which included conducting Basic Education Gender Analysis, developing the Gender in Education Resource Guide, and conducting the PMSPL II annual gender workshop.
Work progressed on the Gender in Education Resource Guide, which built on the two evaluations conducted on Developing Rehabilitation Assistance to Schools and Teacher Improvement Program II (D-RASATI II) and QITABI and benefited from the Education Gender Analysis undertaken this year. Following a series of meetings with key stakeholders, EnCompass submitted a corresponding outline, which was shared with a local consultant who submitted the first draft of the resource guide by the end of FY2017.
The annual gender workshop was also completed with EnCompass’s support. The theme this year was “Integrating Gender into Economic Growth and Value Chains.” It built on the Gender in Value Chain Resource Guide, which was developed by EnCompass and based on the LIVCD project.
Also within this sub-purpose, the PMSPL II senior gender specialist provided support to both the local governance assessment and the QITABI evaluation to ensure that they are gender-sensitive. The senior gender specialist held discussions with three IMs—BALADI CAP, Insurance and Matching Capital (IM Capital), and QITABI—to outline future gender mainstreaming support in their MEL plans for Y2 and conducted gender training workshops in parallel for LRI and BALADI CAP.
As for Sub-Purpose 1.4 (Increased Field-Level Monitoring Activities), a project site visit (PSV) schedule is submitted and approved accordingly at the beginning of each quarter. The PMSPL II team conducts the field visits and assesses projects as per the agreed-upon schedule. In FY2017, 18 PSVs were conducted.
Regarding Sub-Purpose 1.5 (Increased Integration of a Geographic Information System [GIS] into Mission and IM Activities), several goals were accomplished. A new GIS layer pertaining to updated (2017) USP data was created to reflect beneficiaries. In parallel, and based on a request to map the universities and the technical/vocational schools in Lebanon as accurately as possible, three other layers were created: universities, public technical schools, and private technical schools. In addition, in FY2017 the GIS specialist suggested updating the rivers network based on the most recent available satellite image (2016). Accordingly, the updated network was compiled and a new GIS layer was created and stored in the master geodatabase.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | viii The GIS specialist collected data published by UNDP to compare it to the data in the master geodatabase. After downloading and reviewing the data, the following were identified: 1) Levels 1 and 2 admin boundaries have similar data in the master geodatabase, 2) some discrepancies were found at the level of municipalities that require further assessment of which source is more reliable, and 3) two new data layers were added to the master geodatabase: a) Hospitals and b) Public Health Centers.
In line with this sub-purpose, the GIS specialist was requested to develop a procedure to periodically update the activities of all the IMs in GIS. Accordingly, an Excel form was designed to serve this purpose, which was intended to be shared with each IM. The compiled data was to be collected and used to update the master geographic database to ensure that all the mapping is based on updated information. Towards the end of FY2017 the IM activities form received the Mission’s approval.
Within Output 1.5.4 (Access to the GIS Unit Lebanon database established), the GIS unit works with the different IMs and Mission staff members to design and generate static maps and perform spatial and statistic data analysis. In FY2017, the GIS specialist produced 50 maps. As for satellite images, the following were designed: a satellite image for Lebanon (November–December 2016) and a satellite image for the Menjez area (where LRI has activities and reforestation projects).
Also within this sub-purpose, the GIS specialist designed 1) an Open Data Kit (ODK) form for the LIVCD inventory check and uploaded it into ODK Aggregate and 2) an ODK form for LWP inventory.
Finally, within Sub-Purpose 1.5, and as part of capacity building efforts, the GIS specialist provided technical support to LWP. A meeting was scheduled with LWP to review and discuss an upcoming GIS activity, an on-the-job GIS training for Litani River Authority (LRA) staff. PMSPL II also received an additional request from LWP that included an assessment of the LWP geodatabase; this was completed.
As for Sub-Purpose 1.6 (Increased Integration of AIDtracker Plus [AT+] into Mission and IM Activities), a series of tasks was accomplished. The collaborating, learning, and adapting (CLA) specialist delivered a series of training and coaching sessions on using AT+ to LWP, LAU, BALADI Caritas, and MENA II. Following the alignment of IMs’ MEL plans during the first half of FY2017, IMs submitted their targets and indicators, to be uploaded to AT+ by the Mission; the FY2016 reporting periods were opened for all IMs. By the end of Q4, all IMs had completed their Q1, Q2, and Q3 FY2017 quarterly reporting, except for BALADI Caritas, BALADI CAP, and QITABI.
As for the Performance Plan Report (PPR), IMs were requested to report their PPRs (as per new guidelines issued in FY2017) on AT+. The data was completed and compiled; PMSPL II generated the PPR indicator tables and submitted them to USAID.
PMSPL II provided support to USAID AT+ Admin in uploading the baseline and targets for active IMs. Following the alignment of all MEL plans with the USAID PMP, PMSPL II provided support again in uploading the PMP PIRSs on AT+, including all the water and higher education PIRSs in addition to four basic education PIRSs that were uploaded to the system.
As for Sub-Purpose 1.7 (Improved Evaluation Assistance Provided by PMSPL II), two evaluations were carried over from FY2016: a midterm evaluation for LIVCD and a final performance evaluation for D- RASATI II. The field work and data collection for both evaluations was completed in FY2016; in FY2017, their corresponding reports were submitted, cleared, and uploaded to the Development Experience ix | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV Clearinghouse (DEC).
In FY2017, the QITABI midterm evaluation was conducted. At the onset of the work, a Scope of Work (SOW) was submitted and approved; the execution commenced accordingly. A team composed of local and international consultants was formed; the methodology was designed; an inception report was submitted and approved; and the data collection was conducted. Following these steps and upon completing the data collection and data coding, a presentation was delivered to the Mission and the final evaluation report was delivered.
Within this same sub-purpose, PMSPL II received requests for midterm evaluations to be conducted for BALADI CAP and MENA II; they will commence in FY2018.
PURPOSE II: DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT INCREASED Purpose II (Direct Support to USAID’s Program Management Increased) includes establishing and supporting USAID CLA systems and tools, initiating knowledge management, support for DOC, and support for the project design process.
Within Sub-Purpose 2.1. (Project Design, Management, and Reporting Requests Completed by PMSPL II), a series of activities was carried over from FY2016.
Work on the Lebanon Enterprise Development (LED) design was carried over from the previous PMSPL contract. In the second half of FY2016, the Project Appraisal Document (PAD) pertaining to the LED design was developed and shared with the Mission for its review and input. In FY2017, PMSPL II supported USAID in preparing the request for proposal (RFP) for LED. Towards the end of FY2017, the RFP was finalized and announced to the public.
One of the main activities in Sub-Purpose 2.1 was the development of a Local Development Project (LDP) PAD. Towards the end of FY2017, PMSPL II submitted a Community Development Project (CDP) Statement of Objectives (SOO), SOW, and deliverables table, all updated according to edits made by the design team. This work will continue in FY2018, with the addition of an MEL plan as an annex to the PAD, which will become a part of the RFP.
Under Sub-Purpose 2.2 (CLA/KM Advanced Implementation), PMSPL II developed a tool in FY2016 to effectively track and follow on related findings and recommendations generated from MEL reports and other PMSPL II activities. During FY2017, the MEL tool was updated to include all FY2016 recommendations and then was shared with USAID.
Also within Sub-Purpose 2.2, PMSPL II supported USAID/Lebanon in developing and implementing a CLA action plan as requested by PPL and as described in ADS 201.3.2.16. PMSPL II held a PMP update meeting with the Program Office to introduce the Mission’s CLA requirements. In parallel, PMSPL II initiated the development of a CLA SOO that clarifies the Mission’s CLA priorities/engagement and the PMSPL deliverables in terms of initiating CLA implementation. The draft SOO for CLA intervention was submitted to USAID.
Finally, in response to Sub-Purpose 2.2, and in compliance with the ADS 201 requirements, PMSPL II supported a CDCS mid-course stocktaking that reviews CDCS validity. The process involved
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | x stakeholders’ engagement; meetings were scheduled with implementing partners, donors, and United Nations (UN) agencies as well as with companies from the economic growth sector. PMSPL II submitted the CDCS stocktaking report, which summarized the survey and document review findings; the report analyzed both the development environment at a macro level and stakeholders’ collaboration. Furthermore, the Mission submitted an action memo to USAID/Washington and concluded the activity.
With respect to Sub-Purpose 2.3 (Increased Development Outreach and Communication Activities by the Mission and Implementing Mechanism), PMSPL II worked extensively on the USAID/Lebanon Facebook page and was given administrator access. A Facebook calendar is shared with the Mission on a weekly basis so that the Facebook page can be populated with rich news pertaining to USAID/Lebanon or IMs. In addition, a contract was signed with local firm to provide social media support, which increases exposure for the page.
The program team submitted a series of deliverables, including a rural tourism booklet, a communication matrix to streamline communication among partners, and weekly and monthly media coverage reports.
In additional to attending regular coordination meetings with the Mission communication specialist, communication support was provided for the Mission VIP delegation visit, the IM Capital Confideo Venture Mentoring Program launch event, the LIVCD Rural Tourism Forum, the LRI Women’s Day event, the IM Capital Seeders Graduation, and the recruitment of a video production house to develop a USAID video and a graphic designer to prepare USAID/Lebanon posters.
As for Sub-Purpose 2.4 (Special Studies, Assessment, and Additional MEL Requests Completed by PMSPL II), three main assessments were conducted in FY2017.
The first assessment was a performance summary review of BALADI (RMF [Rene Moawad] and Caritas) activities conducted and completed in FY2017. PMSPL II received a request from USAID to submit a performance summary review for the BALADI project to summarize BALADI performance for the previous year. PMSPL II finalized the report and submitted it in November 2016.
The second assessment was the Education Sector Gender Analysis, which was a carryover from FY2016. This request was made as USAID/Lebanon was embarking on a set of new education activities and needed to design them with a strong gender component. This assessment is divided into three levels: basic education, higher education, and technical and vocational education and training (TVET). All three reports were submitted and cleared in FY2017.
The third assessment was the Local Governance Assessment (LGA). During the last part of FY2016, PMSPL II received a request from USAID to conduct an LGA based on an SOO. PMSPL II drafted the work plan that is an annex to the SOW, and the execution, field work, and data collection were conducted in early FY2017. The corresponding report was prepared by the team leader and it was submitted to the Mission. The LGA assessment was cleared by the Mission in Q3 FY2017.
PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED Under this purpose, the PMSPL II team supports USAID oversight and management of engineering and construction activities executed under USAID/Lebanon projects as well as the provision of quality
xi | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV assurance and quality control services for design, tendering, and execution of those activities.
The key staff person for Purpose III is the senior engineer, who provides oversight to the subcontracted local architecture and engineering (A&E) firm. In FY2016, a subcontract agreement was signed with the local firm Dar al Handasah Nazih Taleb (DAHNT). DAHNT provides expert engineers as determined by the construction design review task or inspection task, which is assigned by USAID and reviewed by the senior engineer.
As part of Sub-Purpose 3.1, and in accordance with Output 3.1.1 (Engineering designs, specifications, and engineering submissions are reviewed and verified), PMSPL II hosted regular meetings between DAHNT, the Senior Engineer, the Deputy Chief of Party (DCOP), and the COP to discuss and resolve how best to report A&E findings to the Mission. In the first half of FY2017, PMSPL II attended two meetings with BALADI Caritas Lebanon (CL) and RMF to solve issues related to Kawkaba design review (DR) and Kfaryashit Site Verification.
In line with Sub-Purpose 3.1 and within Output 3.1.2 (Quality assurance and quality control are provided on the implementer’s engineering design activities), the senior engineer and the subcontracted A&E firm conducted extensive field oversight, inspections, and verification to support the review of the design activities. By the end of FY2017, PMSPL II enhanced its managerial approach to BALADI design reviews. Furthermore, meetings were held with LRI and BALADI to streamline the DR process and clarify findings.
As for LWP, the infrastructure project designs are complex, and design reviews require a wide range of expertise to provide needed quality assurance. Meetings were held with LWP, PMSPL II, DAHNT, and LWP’s construction contractors to review the DAHNT findings of the first LWP design review. Many issues were resolved or clarified during this meeting with the construction contractor; the contractor agreed to respond with needed additional documentation and analysis.
With respect to IMs’ engineering activities in FY2017, the PMSPL II engineer and DAHNT reviewed 118 design reviews: 113 for BALADI (RMF and Caritas), 3 for LWP, and 2 for LRI. Eight site verification visits for BALADI projects were also conducted in FY2017, with detailed reports submitted to the Mission.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | xii PROGRAM OVERVIEW/SUMMARY
PROGRAM DESCRIPTION AND INTRODUCTION The United States Agency for International Development (USAID)/Lebanon’s (the Mission’s) Country Development Cooperation Strategy (CDCS) for 2014–2018 was approved in May 2015. The CDCS puts in place a results framework (RF) and development objectives that the Mission hopes to achieve during this period. The CDCS proposes an overarching goal of “improved accountability and credibility of public institutions, and broader economic prosperity.” This goal supports the broader U.S. objective of achieving stability in Lebanon and it aligns with various Government of Lebanon strategy pronouncements. Development Objective 1—Improved capacity of the public sector in providing transparent, quality services across Lebanon—reflects a program emphasis on enhancing the quality and availability of basic education, addressing water-quality and municipal-level service delivery issues, promoting accountability and transparency in public institutions, and strengthening the ability of nongovernmental organizations and civil society generally to effectively participate in and contribute to democratic governance. Development Objective II—Enhanced economic opportunity—emphasizes the importance of increased private-sector competitiveness as well as increased access to finance, especially for new business start- ups and women entrepreneurs.
To achieve CDCS objectives, the Mission has awarded a portfolio of more than 20 active projects valued at more than $400 million. These projects address the needs of vulnerable communities struggling to deal with declining income prospects and a growing refugee population—for example, education, livelihoods, and access to potable water. The Mission engages with partners to increase access to education; improve water, wastewater, and irrigation services; promote good governance; enhance economic opportunity; and protect the environment. USAID/Lebanon is a lead donor in education and water and is an important influence in championing good governance and broad economic prosperity.
The purpose of PMSPL II is to supplement the monitoring and program management efforts of USAID/Lebanon staff and to verify, monitor, and support USAID program performance in Lebanon, ensuring the achievement of CDCS objectives. (For a summary of the program, see Table 1.)
Information gathered and program support services provided by PMSPL II help the Mission to make informed decisions and better manage Mission awards. Each award is the responsibility of an implementing mechanism (IM) that designs activities aimed at achieving intended results. IM activities are performed throughout the country. PMSPL II provides consistent, relevant, and frequent performance monitoring and reporting on IM activities and projects; day-to-day information needed to make management decisions; and, most importantly, field monitoring support to USAID/Lebanon staff, especially for activities located outside of greater Beirut. According to the USAID guide Collaborating, Learning, and Adapting (CLA), “monitoring and evaluation will make significant contributions to the Mission’s efforts to continually assess and address knowledge gaps—however, these efforts must be reinforced with a learning approach to maximize their effectiveness.” Monitoring, evaluation, and learning (MEL) and program support services provided under the PMSPL II contract will facilitate and advance the Mission’s implementation of CLA at different levels.
1 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV Table 1. Summary of PMSPL II
Performance Management and Support Program Award name for Lebanon II (PMSPL II)
Activity start date September 30, 2015 to September 29, 2020 and end date
Name of prime Social Impact implementing partner
Contract/agreement number AID-268-C-15-00001
Geographic coverage Lebanon (cities and/or countries)
Reporting period October 1, 2016 to September 30, 2017
USAID will use PMSPL II’s services to:
• develop and support the implementation of USAID/Lebanon’s Performance Management Plan (PMP);
• support implementing partners’ monitoring and evaluation efforts;
• integrate gender issues into USAID/Lebanon’s activities;
• support USAID/Lebanon’s monitoring activities;
• support USAID/Lebanon’s geographic information system (GIS) activities;
• support USAID/Lebanon’s integration to the AIDtracker Plus (AT+) system;
• provide evaluation assistance;
• build the capacity of local organizations in monitoring and evaluation;
• assist in project design, management, and reporting support;
• advance CLA implementation;
• provide architecture and engineering (A&E) services;
• provide Development Outreach and Communication (DOC) support; and
• provide program support and additional MEL services.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | 2 REPORTING PMSPL II WORK PLAN ACTIVITIES At the start of FY2017, PMSPL II submitted to the Mission its annual work plan (WP) that serves as the basis for planning and scheduling PMSPL II activities throughout the year and for monitoring the progress that PMSPL II is making. The work plan highlights the main outputs pertaining to each purpose. It is accompanied by a set of indicators as well as a timeline that estimates the schedule of execution as well as expected time duration for each sub-purpose. PMSPL II’s work plan purposes and sub-purposes also align with contract components and provide a framework that identifies how PMSPL II’s tasks serve contract objectives. This same framework provides the outline for a weekly report (a deliverable) that tracks work plan task progress and achievement. Each week, staff who are assigned a task report its status online. The weekly report is generated automatically and is part of an automated management system. PMSPL II’s management system also generates quarterly reports that draws on the weekly reports and combines the work of the preceding three months. The automatically generated quarterly report is then reviewed, condensed, and clarified.
This annual report combines all the activities and key achievements accomplished in FY2017.
PURPOSES AND SUB-PURPOSES The PMSPL II annual work plan was submitted in Q1 FY2017 to the Mission and approved in Q2 FY2017. The work plan is divided into three main purposes (aligned with the three contract components) and multiple sub-purposes as follows:
PURPOSE 1: USAID’S MEL ACTIVITIES ENHANCED • Sub-Purpose 1.1: The Mission PMP Implemented and Maintained
• Sub-Purpose 1.2: Improved Implementing Mechanism Activity Monitoring and Evaluation
• Sub-Purpose 1.3: Increased Integration of Gender into USAID/Lebanon’s Activities
• Sub-Purpose 1.4: Increased Integration of GIS into Mission and Implementing Mechanism Activities
• Sub-Purpose 1.5: Increased Integration of AT+ into Mission and IM Activities
• Sub-Purpose 1.6: Increased Field-Level Monitoring Activities
• Sub-Purpose 1.7: Improved Evaluation Assistance Provided
• Sub-Purpose 1.8: Capacity Building of Local Organizations to Monitor and Evaluate Projects Increased
PURPOSE II: INCREASED DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT • Sub-Purpose 2.1: Project Design, Management, and Reporting Requests Completed by PMSPL II
3 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV • Sub-Purpose 2.2: CLA Implementation Advanced
• Sub-Purpose 2.3: Increased Development Outreach and Communication Activities by the Mission and IMs
• Sub-Purpose 2.4: Special Studies, Assessments, and Additional MEL Requests
PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED • Sub-Purpose 3.1: IMs’ Engineering Design and Construction Implementation Are Reviewed and Monitored
• Sub-Purpose 3.2: USAID/Lebanon A&E Activity Reporting Increased and Construction Completion Certification Enhanced
WORK PLAN MEETING AND APPROVAL PMSPL II’s work plan is revised annually; this revision took place at the end of the FY2016. A meeting was held with the Contracting Officer’s Representative (COR) on September 7, 2016, to discuss the proposed work plan revisions. A first draft of the work plan was submitted on October 4, 2016. Several revisions of the work plan benefited from Mission comments and refinements of proposed tasks. A final work plan was submitted on November 21, 2016.
Following the submission, a presentation and meeting were held at SI premises with the COR to discuss PMSPL II execution of the work plan.
At the suggestion of the COR, meetings were held with each of the implementing mechanisms (IM) COR/ Agreement Officer’s Representative (AOR) to discuss how the PMSPL II work plan related to the IM. In Q2 FY2017 the annual work plan underwent final review by the Mission and received approval during the first part of Q2 FY2017. The remainder of the report highlights PMSPL II’s achievements as stipulated in the proposed work plan.
QUARTERLY REPORTS At the end of every quarter, PMSPL II submitted to the Mission quarterly progress reports highlighting the activities of the project during that quarter, as well as providing a summary of project accomplishments and performance over that period. Reports included the challenges encountered and planned activities for the next quarter.
USAID.GOV PMSPL II | ANNUAL REPORT, FY2017 | 4 KEY ACTIVITIES STATUS FOR FY2017
TABLE 2. KEY ACTIVITIES STATUS FOR Q4 FY2017
PURPOSE/ SUB-PURPOSE OUTPUTS PLANNED ACTIVITIES STATUS COMMENTS
Sub-Purpose 1.1: Output 1.1.1: Log frames Finalize the DO2 log frame Completed Internally—to be reviewed Mission PMP developed/reviewed Implemented and To be updated in FY2018 Maintained Output 1.1.2: PMP data tracked Collect FY2016 annual results and the FY2017 Completed Except Q4 FY2017 and and collected quarterly data using AT+ annual—due next quarter Update baseline and targets
Output 1.1.3: PMP PIRSs/CIRSs Completed Will restart again for revised and updated FY2018 Update PMP PIRSs/CIRSs
Output 1.1.4: PMP monitoring Update previously established schedules for Completed Will restart again for and evaluation schedule updated performance management, evaluation, FY2018 assessment, DQAs, and other monitoring tasks
Sub-Purpose 1.2: Output 1.2.1: Implementing Continue with MEL plan development support Completed Improved mechanisms supported until approved by USAID: MEL plans may be reviewed Implementing again in FY2018 Mechanism Monitoring and QITABI Completed Evaluation MENA Completed LIVCD Completed LIFE Completed BALADI RMF Completed BALADI CL Completed BALADI CAP Completed USP7 AUB Completed USP7 LAU Completed
Sub-Purpose 1.3: Ensure structural gender Prepare for and conduct the annual gender Completed Increased mainstreaming in all stages of workshop for 2017 Integration of design, planning, implementation, Gender into and evaluation of program Provide one-to-one support to IMs as needed was provided as activities needed
5 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV USAID/Lebanon’s Activities Review project docs as needed Ongoing
Initiate work on the resource guide on gender Completed integration in education
Sub-Purpose 1.4: Output 1.4.1: Activity progress PSV020 LIVCD DV Completed Increased Field- monitored and implemented in Level Monitoring compliance with USAID PSV022 BALADI CL DV Completed Activities regulations—PSVs PSV023 BALADI RMF DV Completed Completed PSV024 QITABI DV Completed PSV 026: LWP inventory Completed PSV 027: QITABI DV Y2Q2 Completed PSV 032: LWP DV Completed PSV 025: LIVCD grants inventory Completed PSV 030: BALADI CL Completed PSV 031: BALADI RMF Completed PSV 029: USP AUB Completed PSV 028: Scholarships LAU Completed PSV033: LRI DV Completed PSV 034: QITABI DV Completed PSV 035: BCAP DV Completed PSV 036: RMF DV Completed PSV 038: CL DV In progress DQA MENA
Sub-Purpose 1.5: Output 1.5.1: Data from current Update data for all IMs In progress IM Activities Data Form Increased and previous projects integrated Integration of GIS and AT+ into Output 1.5.2: Search for online UNDP Data Source Completed Mission and IM data sources finalized Activities Output 1.5.3: Standardized Ongoing Ongoing Ongoing administrative boundaries and names
Generate maps for Mission Ongoing
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 6 Generate maps for IMs Output 1.5.4: Access to the GIS Ongoing Unit Lebanon database LIVCD established Completed
Output 1.5.5: Automated field ODK form for DQA Ongoing data collection
Sub-Purpose 1.6: Output 1.6.1: IMs’ regular use and Data reporting on AT+ Ongoing Increased update of AT+ Integration of AT+ into Mission and IM Output 1.6.2: Support USAID Ongoing Activities AT+ admin and A/COR using AT+ provided
Sub-Purpose 1.7: Output 1.7.1: Effectiveness of Submit QITABI evaluation report In progress Pending approval in QI Improved USAID’s projects examined FY2018 Evaluation (relative to the stated DOs and Assistance Provided development hypothesis) Initiate MENA midterm evaluation Initiated Field work in Q1 FY2018 by PMSPL II BALADI CAP midterm evaluation Initiated Work to continue in Q2 FY2018
Output 1.7.2: Corrective actions Upon request at the different management levels facilitated
Sub-Purpose 1.8: Output 1.8.1: MEL capacity of Provide capacity-building support/training to In progress Capacity Building of USAID local partners/grantees USAID partners to increase monitoring and Local Organizations improved evaluation capability and effectiveness to Monitor and Evaluate Projects Output 1.8.2: Lebanon’s capacity Identify two local organizations, provide them In progress Increased to monitor and evaluate technical assistance and training to advance enhanced their ability and competence to conduct monitoring and evaluation activities
Sub-Purpose 2.1: Output 2.1.1: USAID Mission CDP PAD submission Ongoing Work continues in FY2018 Project Design, project design process supported Management, and PAD consolidating DO2 activities Initiated Work continues in FY2018 Reporting Requests Completed by PMSPL II Train USAID staff on project design No request made Work with design team provides this result
Output 2.2.1: MEL tool updated Pending CLA intervention In progress and utilized
7 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV Sub-Purpose 2.2: Output 2.2.2: CLA plan SOW development: CLA Mission self- Pending CLA intervention will be CLA Advanced developed assessment conducted using the CLA Maturity initiated in Q1 FY2018; tasks Implementation Matrix might be revised according to the intervention schedule CLA action plan developed following the Pending Mission’s self-assessment
Sub-Purpose 2.3: Output 2.3.1: Public awareness of Deliver weekly FB calendar Ongoing Increased USAID assistance and program Development achievements supported Deliver weekly media coverage report Ongoing Outreach and Communication Activities by the Output 2.3.2: Communication Prepare FB posts based on input and feedback Ongoing Mission and IMs materials for USAID Mission of IMs developed and packaged
Output 2.3.3: Periodic logistical Attend and support IM events As per Mission request support for USAID DOC unit provided
Output 2.3.4: Program Finalize award for USAID documentary and Completed information dissemination and corresponding promotional activity development outreach know-how provided USAID video production In progress Contract awarded
USAID posters In progress Purchase order agreed to
Sub-Purpose 2.4: Output 2.4.1: Mission’s decision- Basic Education Gender Assessment Completed Uploaded to the DEC Special Studies, making process facilitated Assessment, and Additional MEL Output 2.4.2: Identification of Identify potential development partners and No activities Requests potential PPP partners and partnership opportunities Completed by partnership opportunities PMSPL II Output 2.4.3: Proactive Engage with Lebanon’s civil society, local Remaining alert to engagement with Lebanon’s civil stakeholders, private sector, economic actors, opportunities society and economic actors to and diaspora to identify development partners explore Mission development partner opportunities
Sub-Purpose 3.1: Output 3.1.1: Engineering designs, Conduct engineering, drawing reviews for Ongoing IMs’ Engineering specifications, and engineering BALADI and LWP Design and submissions are reviewed and Construction verified
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 8 Implementation Are Reviewed and Output 3.1.2: Quality assurance Conduct quality assurance visits for BALADI Ongoing Monitored and quality control are provided and LWP on the implementer’s engineering design activities
Sub-Purpose 3.2: Output 3.2.1: Increased USAID Ensure that the engineering and construction Ongoing USAID/Lebanon information about the challenges, contracts’ conditions and specifications are A&E Activity progress, and completion of work fulfilled Reporting Increased and Construction Output 3.2.2: Certificate of Issue the Defects Liability Certificate at the Upon completion of project Completion completion is issued end of the Defects Liability Period; no Certification completion certification anticipated next Enhanced quarter
Reports Reports submitted Quarterly report Q1, Q2, Q3, and Q4 FY2017 Weekly progress reports Weekly FB posts calendar Weekly media summary Monthly media report A&E reports
9 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV CHALLENGES ENCOUNTERED IN FY2017 GENDER CONSULTANT RESIGNATION During the start of FY2017 the team leader of the Education Sector Gender Analysis informed PMSPL II that she would not be able to continue with the project. There was an immediate need to identify another gender consultant to replace the previous. This hindered the scheduled initiation date for the analysis and delayed the process as a whole.
EDUCATION GENDER ANALYSES OBSTACLES Unforeseen obstacles were encountered for the data analysis and report writing of the Education Sector Gender Analyses, which hindered meeting preset deadlines. These included late approval by the Ministry of Education and Higher Education (MEHE) to access schools early in the year, which consequently delayed data collection; furthermore, additional challenges were encountered, such as teachers’ strikes and the lack of availability of some key informants to be interviewed, which resulted in the need to find alternatives.
INVOLVEMENT OF MULTIPLE PARTIES IN ASSESSMENTS/EVALUATIONS Having many parties involved in assessments, on both administrative and technical levels, made it difficult to coordinate and in some cases led to miscommunication. This was demonstrated by the three parties involved in the Education Gender Assessment (EGA) (basic education level), namely: • PMSPL II (in key informant interviews, or KIIs; data collection; coordination; management; and monitoring and evaluation, or M&E) • Information International (II) (focus group discussions, or FGDs; data collection; transcription; and translation) • EnCompass (in data coding, analysis, and drafting findings and conclusions) • Social Impact’s head office (SI/HO)
Each party, the subcontractor and PMSPL II, has a different role and operates from two different countries. As such, coordinating these multiple roles, ensuring high-quality deliverables, and meeting deadlines per the set timeline for each deliverable were time-consuming; however, PMSPL II was able to address this issue.
DELAYS IN RECEIVING COMMUNICATION MATRIX IMs received the communication matrix on the last week of March. Ideally, it should be received on the first week of April to allow for PMSPL II to plan the month in advance. The only IMs that shared their plans were USP (the American University of Beirut, or AUB) and LIVCD. In parallel, the IM Facebook pages were updated and constantly populated with more recent content.
FEW TESTIMONIAL-BASED / FIRSTHAND POSTS Because the communication matrix (or an alternative tool) was not made operational, the content of Facebook (FB) posts remains news-oriented and less focused on beneficiaries and success stories. The weekly notes continue to be the main source of content of Facebook posts. The only testimonial-based posts are shared by Lebanese American University’s University Scholarship Program (LAU USP).
CONSULTANT FOR THE QITABI EVALUATION PMSPL II initiated the recruitment process for both a team leader and short-term technical assistance
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 10 (STTA) for the QITABI evaluation. The team received over 20 CVs yet did not find a suitable candidate. SI headquarters (HQ) and PMSPL II screened more CVs and interviewed more candidates. The process of recruiting a local consultant to support the team leader was lengthy despite significant effort by PMSPL II. Identifying an education specialist with extensive experience in education was challenging and affected the evaluation process. Once recruited, the local education expert’s contribution came late, causing last-minute integrations of his findings into the report.
A&E FOR BALADI RENE MOAWAD FOUNDATION (RMF) PSV During a project site verification, a PMSPL II senior engineer identified a major deficiency in the installation of solar panels: bolts had been drilled directly into the roofs. Since this may cause serious leakages for the houses of beneficiaries, he requested that the work be suspended. Communication challenges arose between the IM team, PMSPL II, and USAID. Work suspension is a serious issue that involves USAID’s contracting office; discussions became heated. Agreement was later reached on resolution to the solar panel installation problem. However, the challenge served to put in place a communications protocol whenever A&E site visits indicated that suspension of works might be needed.
VIDEOGRAPHY RFP TIMEFRAME. Based on the request of the Mission, PMSPL II combined the videography services and the video booking services in one RFP. This proved to be challenging for production firms/individuals who do not offer booking services and gave advertising agencies a competitive advantage but at a much higher cost to the program. To address this issue, PMSPL II removed the booking component and requested a resubmission of the offers based solely on video production to allow for a fair selection.
UNPLANNED NATIONAL STRIKES AND OTHER SIMILAR EVENTS In the past year a series of strikes was carried out in Lebanon and a national day of mourning for Lebanese soldiers was held. This resulted in delays, as some governmental organizations and the private sector did not work during these events.
SUMMARY OF RESULTS TO DATE Please see Annex A for details on PMSPL II indicators and progress.
11 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV ACTIVITY IMPLEMENTATION PROGRESS
PURPOSE I: USAID MEL ACTIVITIES ENHANCED
Key Accomplishments
• Finalized log frames for DO2/IR2.2
• Completed the PMP revision, including an updated MEL schedule, revised indicator list, updated PIRS, and updated tracking table
• Updated PMP PIRS
• Received approval on MEL plans for BALADI CAP, LIVCD, MENA II, QITABI, LRI, LIFE, USP7
• Conducted DQAs for BALADI CAP, LWP, MENA II, and LRI
• Initiated a beneficiaries database with LIFE
• Conducted the annual gender workshop
• Carried out 35 activities verifications
• Received approval on the IM Activities Data Form
• GIS Unit designed 50 maps
• Designed ODK form for LWP and LIVCD inventory
• Completed LIVCD evaluation and conducted evaluations for D-RASATI and QITABI and initiated SOWs for MENA II and BALADI CAP midterm evaluations
Purpose I focuses on supporting USAID/Lebanon’s oversight and learning. It consists of three main sub- purposes that focus on PMP development and implementation, improving the IM monitoring and evaluation process, increasing field-level monitoring activities, and conducting formative and summative evaluations.
SUB-PURPOSE 1.1: MISSION PMP IMPLEMENTED AND MAINTAINED The work pertaining to Output 1.1.1 (PMP log frames developed/reviewed) focuses on developing and reviewing PMP (approved in FY2016) log frames. During FY2016, PMSPL II supported IMs in developing/revising their monitoring, evaluation, and learning (MEL) plans to measure achievement of the logical framework. PMSPL II developed a project log frame derived from the results framework. The PMSPL II team has adopted a collaborative and participatory approach, working closely with the
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 12 Development Objective (DO) teams and the Program Office to implement, review, and update the Mission PMP and logical frameworks on a yearly basis.
In FY2017, PMSPL II submitted an updated MEL schedule, revised indicator list, updated Performance Indicator Reference Sheets (PIRSs), and updated tracking tables for each of the PMP indicators.
LOG FRAMES FOR DEVELOPMENT OBJECTIVES Within Output 1.1.1, log frames for DO1 and DO2 were finalized in FY2017.
Logical frameworks will be revised in FY2018 when the new guidance is released by Policy, Planning, and Learning (PPL). PPL conducted a webinar regarding the revised ADS 201. During the Q&A session and in response to a PMSPL II inquiry, PPL confirmed that the technical note explaining how log frames are designed and how projects are linked to the CDCS is subject to modifications; a new technical note will be released by the end of FY2017. Flexibility is expected to affect the linkage between project purposes and the CDCS Intermediate Results (IRs).
PMP DATA TRACKED AND COLLECTED As for Output 1.1.2 (PMP data tracked and collected), PMSPL II proceeded with implementing the PMP in FY2016 by updating the PMP indicator tracking table, with new baselines and targets submitted by the implementing partners that had completed the development of their MEL plans. In Q1 FY2017, PMSPL II was scheduled to complete the update of the baseline and targets with PMP data and start collecting FY2016 annual results and FY2017 quarterly data using AT+.
Following the approval of the IM MEL plans, PMP data collection started retroactively for FY2016, FY2015, and FY2014, whenever applicable. PMP data collection and narrative explanations were completed for all PMP indicators.
The work was continued in Q4 FY2017, and this year PMSPL II submitted the PMP indicators tracking sheets that are used to collect quantitative data. The submitted sheets include FY2014, FY2015, and FY2016 indicators results and targets in addition to out-year targets for FY2017 and FY2018. During Q4 FY2017, PMSPL collected the PMP data that was uploaded to AT+ for Q1, Q2, and Q3 FY2017.
PMP INDICATOR UPDATES In FY2017, the PMP indicators of the results framework underwent a series of revisions and a revised list of indicators was delivered and agreed upon with the Mission towards the end of the second half of FY2017.
Based on these proposed changes, updated indicators that were in the development process or undergoing revisions—such as those related to University Scholarship Program (USP), BALADI CAP, LRI, and LIFE—were directly integrated in the MEL plan.
PMP PERFORMANCE INDICATOR REFERENCE SHEET (PIRS)/CONTEXT INDICATOR REFERENCE SHEET (CIRS) REVISED AND UPDATED Within Output 1.1.3, PMSPL II reviews the PMP to incorporate changes related to new projects, activities, and indicators. PMSPL II also updates the relevant Performance Indicator Reference Sheets (PIRSs) and ensures that the appropriate indicators at the RF levels are being tracked. In FY2017, PMSPL II updated the PMP PIRSs, taking into consideration the indicator revisions and the implementing mechanisms’ inputs.
13 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV PMP MONITORING AND EVALUATION SCHEDULE UPDATED Under Output 1.1.4, revisions include updates of the previously established schedules for performance management, evaluation, assessment, DQAs, and other monitoring tasks. In Q1 FY2017, PMSPL II, in collaboration with the Program Office and PMSPL II COR, scheduled meetings with each activity A/COR to discuss and plan the FY2017 MEL schedule, which includes evaluations, assessments, DQAs, and data verification.
Accordingly, the PMP monitoring and evaluation schedule was updated and submitted. In the second half of FY2017, and as part of the revised PMP, PMSPL II updated the PMP monitoring and evaluation schedules, taking into consideration the A/COR MEL requests that had been communicated during this year and the potential evaluation that might be carried out during the remainder of the PMP.
FIGURE 1. LWP engineer trains farmers on drip irrigation system.
CITIZEN SATISFACTION SURVEY (CSS) During FY2016, it was agreed that a “Citizen Satisfaction Survey” was to be designed and conducted with selected IMs: Lebanon Water Project (LWP), LRI, BALADI CL/RMF, and BALADI CAP). The objective of the survey is to report on the Mission PMP indicator “Percentage increase in citizen satisfaction with public services in United States Government (USG)–assisted municipalities” for several IMs.
In FY2017, as a carryover from the work and meetings conducted in FY2016, PMSPL II proceeded with the following:
• CSS Forms Template Design. PMSPL II developed a template to be circulated to the participating IMs (LRI, LWP, BALADI CAP, and BALADI CL/RMF).
• Disseminating the CSS Template. The template was sent to LRI, LWP, BALADI CAP, and BALADI CL/RMF. All the contacted implementing partners (IPs) completed the forms (except for LRI) and shared their list of municipalities. LRI submitted its forms in early Q2 FY2017.
The second phase required the consolidation of the list of municipalities where the USAID activities are being implemented. The list consisted of around 220 municipalities that constitute the sampling frame for the survey. Determining selection criteria for including municipalities in the survey remains an issue.
SUB-PURPOSE 1.2: IMPROVED IMPLEMENTING MECHANISM MONITORING AND EVALUATION As stipulated in the work plan, PMSPL II will support the IMs in MEL as per the new CDCS requirements. Such support includes review of MEL plans, alignment of MEL plans with the new PMP, providing coaching sessions to IPs on MEL fundamentals, development of MEL guides, and standardizing
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 14 and systemizing IM reporting. This work takes place throughout the year in close coordination with the Mission.
In line with Output 1.2.1 (Implementing mechanisms supported), the PMSPL II team provides technical assistance and guidance to current and future USAID/Lebanon IMs on MEL-related issues. It assists in the review of the inputs and MEL plans of ongoing and newly designed USAID projects in Lebanon and ensures that they are linked to the reporting requirements of the Mission PMP and project MEL plans. PMSPL II will also support IMs in developing MEL plans as per the updated ADS requirements.
FIGURE 2. BALADI CAP MEL plan was approved in July of Q4 FY2017.
BALADI CAP MEL PLAN The BALADI CAP MEL plan was approved in FY2016. However, in FY2017 the approved plan underwent a series of modifications to reflect more specific impact and outcome indicators and targets for issue networks under the Civic Engagement Initiative (CEI) component. Accordingly, it was reviewed and submitted to USAID; comments mainly addressed the PIRSs for newly added indicators.
In Q3 FY2017, after the Mission had reviewed the revised MEL plan, the revised version was sent to PMSPL II. PMSPL II made one additional modification pertaining to one indicator which requires BALADI CAP to update the data analysis section of the PIRSs. The revised version of the BALADI CAP MEL plan was approved in July of Q4 FY2017.
BALADI MEL PLAN In the second half of FY2016, PMSPL II suggested a series of changes to the BALADI MEL plan to be aligned with the Mission’s PMP. In the first half of FY2017, BALADI RMF and BALADI CL submitted revised MEL plans with new targets for aligned indicators. The targets for RMF were approved.
However, CL’s revised targets needed further revision based on feedback from PMSPL II. CL addressed these comments and made the necessary modifications to the document and shared the revised targets. Following CL’s submission, and as per the Mission’s request, PMSPL II reviewed the updates for finalization and identified some issues that needed further consideration. The targets are anticipated to be finalized in FY2018.
LIVCD MEL PLAN Towards the end of FY2016, PMSPL II received the LIVCD MEL plan for revision, and an in-depth review was conducted by the MEL specialists. The revised MEL plan was submitted to LIVCD accordingly.
15 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV In early FY2017, LIVCD shared a revised MEL plan that incorporated previous PMSPL II comments and recommendations, which was then submitted to USAID for approval. The MEL plan was not approved by the COR and there was a request to address a few concerns. LIVCD called for a meeting to discuss its proposed methodology to extrapolate results for indicators related to sales and to private investments. During the meeting, the PMSPL II team explained its concerns on methodology, and it was decided that LIVCD will modify the proposed methodology by referring to the Feed the Future (FTF) beneficiary-based survey guidance for the selection of the sample and by recruiting a statistician who will implement the guidance and oversee the sampling methodology. LIVCD revised its MEL plan and submitted it to the Mission; it was approved.
MENA II MEL PLAN
FIGURE 3. MENA II MEL plan received approval at the end of FY2017.
Towards the end of FY2016, MENA II was finalizing their MEL plan document and annexes, including PIRSs for all indicators, and for tracking assumptions.
At the start of the year, MENA II shared with PMSPL II an updated version of PIRSs, which PMSPL II reviewed. A series of suggestions was proposed and shared with MENA II and a meeting was held to discuss the latest version of the logical framework and concerns related to the PMP indicator measuring linkage. PMSPL II proposed sharing a suggested definition of linkages that are supported by the project, so that PMSPL II can propose to the Mission to update the PMP PIRSs accordingly. Following these modifications, the MENA II MEL plan was submitted to USAID and it received approval accordingly.
QITABI MEL PLAN The work on the QITABI MEL plan was a carryover from FY2016. At the start of FY2017, PMSPL II received QITABI’s draft MEL plan for review and sent it back with minor comments about the number of school/students/teachers reported across documents and the refinement of one indicator. Following these modifications, the MEL plan was approved.
LRI MEL PLAN In the second half of FY2017, LRI submitted a revised MEL plan to PMSPL II for review. The main was to include recommendations from the DQA exercise conducted in QI FY2017. The PMSPL II team reviewed the document and shared the comments with the LRI AOR towards the end of the quarter. Comments mainly addressed the measurement of the indicator reporting on social stability improvement. Following in-depth revision and adjustments made by PMSPL II, the MEL plan was finalized by United States Forestry Services (USFS), submitted to the AOR, and approved.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 16 LIFE MEL PLAN During FY2017, PMSPL II was assisting LIFE in finalizing its MEL plan. Within this context, an introductory meeting was held between LIFE and PMSPL II. The LIFE Chief of Party (COP) presented a brief of the project goal and interventions. PMSPL II presented the Scope of Work, with a focus on the area where a collaboration is possible between the two teams, including M&E, communication, and GIS. Following the meeting, PMSPL II reviewed the MEL plan that LIFE shared and made some revisions and suggested modifications. The LIFE team integrated PMSPL II’s recommendations, mainly the ones related to adding the standard indicators, the logical framework graphic presentation, and the missing sections of the PIRSs. In addition, the LIFE team included some illustrative evaluation questions to the plan and a section related to USAID compliance. The reviewed plan was resubmitted to PMSPL II again for further review, and the LIFE MEL lead also submitted a draft indicator performance tracking table (IPTT) to be reviewed and cleared before moving forward with the MEL plan. PMSPL II team reviewed the document and submitted the revised version to LIFE. The MEL plan was shared with the Mission and approved accordingly.
USP7 MEL PLAN During the second half of FY2017, PMSPL II received a request from the Mission to review the MEL plans for USP7 for AUB and LAU.
FIGURE 4. USP MEL plans for both AUB and LAU were approved.
In early Q4 FY2017, the Mission shared with PMSPL II an updated version of USP AUB and LAU MEL plans to be reviewed, with a focus on consistency regarding the following:
• ADS requirements; • new purpose indicator and its PIRS; • AIDtracker reporting timeframes; • CLA activities; and • alignment of the indicators table with the MEL.
The MEL plan was revised accordingly and comments were shared with the Mission.
For both LAU and AUB MEL plans, the feedback focused on developing a clear and comprehensive development hypothesis and critical assumptions, elaborating on the compliance with USAID policies and the evaluation questions, and adding the indicator tracking table. Both AUB and LAU USP MEL plans were approved by the Mission.
17 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV DQA BALADI CAP During early FY2017, a DQA session was held with BALADI CAP’s COR, COP, MEL junior specialist, and MEL consultant. It addressed three newly added indicators as follows:
• Number of entities with enhanced abilities because of USG support • Number of municipalities working inclusively with citizens to more effectively accomplish development objectives • Percentage of assisted municipalities that have improved internal systems
Only one indicator had its respective data collected, the other two are pending the selection of the municipalities that will be targeted by the project. The BALADI CAP DQA report was submitted to the Mission, which in turn provided feedback. Comments required clarifications and no changes were made to the core of the report. The revised report was resubmitted accordingly.
DQA LWP Two DQA sessions were conducted during FY2017 for LWP in the presence of LWP’s COR, LWP’s DCOP, and LWP’s MEL team. The field work was covered and completed in these sessions. The DQA report is in progress and submission is anticipated in FY2018.
DQA LRI Two DQA sessions were conducted in FY2017 with LRI and the corresponding report was submitted to the Mission. Following submission, PMSPL II received feedback from LRI’s AOR, who attended the sessions, and a revised version of the report addressing all the comments was resubmitted accordingly. The modified DQA report was shared by the Mission with LRI and further comments were made and shared with the PMSPL II team. Comments mainly concerned one indicator pertaining to the measurement of social stability. Comments were addressed by the PMSPL II team and the finalized report was resubmitted to the Mission.
DQA MENA II A DQA for MENA II was conducted in FY2017. The team conducted the DQA for seven PMP/PPR indicators (of ten total). A follow-up meeting is scheduled for FY2018 to conduct DQA for the remaining indicators; the DQA report will follow.
BENEFICIARIES DATABASE
FIGURE 5. In Q4 FY2017, it was agreed that the beneficiaries’ database will be implemented with LIFE, since it is a newly established IM.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 18 During FY2016, PMSPL II finalized an IM beneficiaries’ database, developed to ensure reliable reporting on trainings and beneficiaries among all IMs while avoiding duplication of beneficiaries under the same reported indicator. This database was designed to harmonize the translation of names and reduce the number of misspelled beneficiaries. It was agreed that the database will be tested with BALADI RMF and BALADI CL.
The execution of this item started in Q3 FY2017 with BALADI RMF. However, during implementation, the GIS specialist realized that given the large dataset that needs to be restructured manually, there is a high risk that errors might be introduced into the data. Consequently, the reporting summary may generate different results than those calculated by BALADI RMF. Therefore, PMSPL II recommended closing the pilot database project with BALADI RMF and restarting another pilot database with a more recent IM, which would allow the GIS specialist to progressively test the tools, with IMs entering the data from the outset.
In Q4 FY2017, it was agreed that the beneficiaries’ database will be implemented with LIFE, because it is a newly established IM. After receiving a copy of the database, LIFE requested a working session to review the beneficiary database and assess how it can be used internally. Some updates were performed on the database, and it was sent to LIFE so it can proceed with populating it with the relevant data. Towards the end of FY2017 a second working session was held to review the progress of data entry.
MEL ALIGNMENT PMSPL II’s support is completed in terms of alignment of the ongoing activities’ MEL plans with USAID’s PMP. MEL plans are being finalized and/or submitted for USAID approval. At the end of Q4 FY2017, the status of MEL plans’ ongoing activities was as follows:
• Lebanon Water Project (LWP): Approved
• LIVCD: Revised and approved for the extension period
• QITABI: Approved
• LIFE: Approved
• MENA II: Approved
• BALADI CAP: Revised and approved
• LRI: Revised and approved
• BALADI: Approved
• USP: Approved
MEL ASSISTANCE SESSIONS PROVIDED TO IMS A series of MEL assistance sessions was provided by PMSPL II and they are as follows:
• MENA II: An assistance session was scheduled to discuss the latest version of the logical framework and concerns related to the PMP indicator measuring linkage.
19 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV • LIVCD: Assistance sessions were provided to LIVCD to review the sales extrapolation methodology and discuss possible enhancement of the data reported.
• LIFE: Assistance sessions were designated to discuss the MEL plan development.
• LAU: A session was held to provide guidance on reporting on the PMP Indicator 2.1.3a (related to recipients benefiting from workforce development/enrollment in the USP program). Some concerns raised during the session were with the USP COR. In addition, and as a follow-up to the assistance session provided to USP, PMSPL II supported the USP COR in aligning the reporting between both USPs (AUB and LAU). Feedback and a request for adopting a similar reporting timeframe and methodology were sent to both implementing partners.
SUB-PURPOSE 1.3: INCREASED INTEGRATION OF GENDER INTO USAID/LEBANON’S ACTIVITIES PMSPL II is committed to USAID’s global gender policy goal and to the effective integration of USAID gender equality and female empowerment (GE/FE) policy principles throughout the Agency’s program cycle, from the inception of the project idea through design and implementation to the monitoring and evaluation stage. PMSPL II is the catalyst for implementing USAID’s Gender Integration Strategy. All projects in the current portfolio are scrutinized to ensure that structural gender mainstreaming is implemented in all stages of the program cycle (refer to ADS 201 and 205). In doing this, PMSPL II’s gender-integration activities cut across all its other work plan activities to ensure that GE/FE is an integral component of the project’s activities. This requires reaching out independently to build the capacity of the network of IM gender focal points.
FIGURE 6. Collaboration with EnCompass took place throughout the year.
Within Output 1.3.1 (Ensuring structural gender mainstreaming in all stages of design, planning, implementation, and evaluation of program activities), the senior gender specialist holds general meetings with all IMs (at the rate of one per year) to plan, follow up on gender-integration efforts, discuss progress towards achieving set goals and objectives, share successes and lessons learned, and conduct refresher gender trainings and new trainings as the need arises.
The sections below detail FY2017 accomplishments.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 20 COLLABORATION WITH ENCOMPASS In the first half FY2016, PMSPL II entered into an agreement with EnCompass, a subcontractor providing support on the gender component in the PMSPL II agreement. Collaboration with EnCompass took place throughout the year.
In FY2017, PMSPL II developed the FY2017 Gender Work Plan and shared it with EnCompass to outline its role in the specific tasks. A draft SOW was developed, which elaborated on the specific tasks that necessitate EnCompass’s support to PMSPL II. It focused mainly on the following:
• Basic Education Gender Analysis (BEGA)
• Development of the Gender in Education Resource Guide
• Review of project documents
• Conducting the forthcoming annual gender workshop
An agreement was reached regarding the final SOWs, estimated timeline, and level of effort (LOE). As part of the continuous collaboration, PMSPL II held regular Skype calls to coordinate the upload of data.
In the second half of FY2017, the collaboration focused on the Education Gender Analysis (see Sub- Purpose 2.4 below). A series of discussions was held with EnCompass to clarify for the hired data collection firm the different aspects of the data collection process. This was followed by periodic discussions over Skype with EnCompass to follow up on the process of coding and analysis and discuss findings and conclusions.
Moreover, discussions took place with EnCompass on the progress of the work plan, which culminated in a meeting held between PMSPL II and EnCompass in Washington, D.C.
The meeting agenda covered the following:
• Assessing the progress on the Basic Education Gender Analysis • Discussing the proposed work plan (WP) for the remaining part of FY2017 (based on comments raised by the senior gender specialist on the submitted WP draft) • Defining further steps to pursue the remaining tasks agreed upon, namely the gender workshop and the Gender in Education Resource Guide planned for the last quarter of FY2017, including agreeing on dates and contents
Finally, in the last quarter the following was achieved:
GENDER IN EDUCATION RESOURCE GUIDE This year an agreement was made with EnCompass to develop the second in the series of four resource guides to be produced throughout the life of the PMSPL II contract. This resource guide focused on best practices for integrating gender consideration in education assessments. It built on the two evaluations
21 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV conducted on D-RASATI and QITABI and benefited from the Education Gender Analysis undertaken this year.
To initiate the process, initial steps were taken to develop a technical advisory group (TAG). The purpose of the TAG was to inform preparation of a Gender in Education Resource Guide. Primary assistance for developing the resource guide was provided by EnCompass; other local experts in education were also requested to attend the TAG meeting.
To proceed, a meeting was also arranged to hold key informant interviews (KIIs) for the TAG. A team from EnCompass arrived from the U.S. to provide the necessary support in conducting the KIIs. Along with the senior gender specialist, they met with the PMSPL II team to discuss gender needs where MEL and DQA processes are concerned. They also met with five key informants from the MEHE, the Center for Educational Research and Development (CERD), the Canadian Embassy, United Nations Children’s Fund (UNICEF), and LAU’s Institute for Women’s Studies in the Arab World (IWSAW). Finally, the TAG meeting was held with the participation of 12 stakeholders from the different partner organizations working on education in Lebanon (including a number of education and gender specialists and two USAID education CORs).
Following the meeting, EnCompass submitted an outline for the Gender in Education Resource Guide in Lebanon. The outline was shared with a consultant who was recruited to work on the guide. Towards the end of FY2017, the consultant submitted the first draft, which was shared with EnCompass for review.
PROJECT DESIGN Within Sub-Purpose 1.3, the senior gender specialist participates in the different stages of project design (as the need arises) at USAID Mission meetings and with PAD/RFP development consultants to ensure that gender is adequately addressed and integrated.
FIGURE 7. This Year’s Gender Training was titled “Integrating Gender into Economic Growth and Value Chains,” deriving examples from LIVCD.
During this year, the gender specialist discussed with the governance consultants tools and means to ensure that the local governance assessment (refer to Sub-Purpose 2.4) is gender-sensitive and that the right people were interviewed to attain an accurate gender perspective. In, parallel, the gender specialist also reviewed the LIFE gender analysis document from USAID and commented on it.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 22 ANNUAL GENDER WORKSHOP PMSPL II conducted the 2017 annual gender workshop during the end of FY2017. The theme this year was titled “Integrating Gender into Economic Growth and Value Chains.” It built on the Gender in Value Chain Resource Guide, which was developed by EnCompass and which was based mainly on the Lebanon’s Industry Value Chain Development (LIVCD) project.
The event was attended by 22 staff members from six different IMs, in addition to SI and USAID staff. Two international consultants from EnCompass, in addition to PMSPL II’s senior gender specialist, facilitated the one-and-a-half–day workshop.
EVALUATION / ASSESSMENT SUPPORT During this quarter, PMSPL II initiated a midterm evaluation for QITABI (refer to the section on the QITABI evaluation). To ensure compliance with USAID’s gender requirements, the senior gender specialist reviewed the SOW for the QITABI evaluation and added comments to include a gender component sufficient to capture any successes or needs for improvement.
IM SUPPORT At the outset of FY2017, the senior gender specialist prepared the annual strategic plan for IM support on the gender-related activities and clarified the IMs’ support component in the FY2017 work plan. The work in FY2017 included the following:
• Discussions with three IMs—BALADI CAP, IM Capital, and QITABI—to outline future gender mainstreaming support in their MEL plans for Y2 and to ensure that QITABI evaluation incorporates a gender component.
• BALADI CAP training workshop within a “Community of Practice” for its new cohort of CSOs.
• LRI training workshop for LRI staff on gender sensitization (as only three of its fifteen staff members present had any prior gender knowledge).
• AUB USP personnel meeting to discuss the gender component of USP and impact of the forthcoming Education Gender Analysis on the program.
• QITABI consultant briefing on the GE/FE policy and its requirements with respect to all USAID/Lebanon evaluations, including the QITABI evaluation, and discussions on how gender should be addressed in the evaluation process. Continued discussions were also held with the SI/HO evaluation team working on the QITABI evaluation to ensure that gender was cutting across the whole process of data collection, including coding and analysis, and that the findings, conclusions, and recommendations are developed in a gender-sensitive manner.
GENDER COORDINATION / MEETINGS As part of PMSPL II follow-up on IM activities, the senior gender specialist attended LRI’s Women’s Day event “#PlantYourChange.”
To stay up to date on the developments and progress taking place on the gender issue in the country, the senior gender specialist participated in a working group organized by UNICEF on TVET. The event
23 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV proved very useful with respect to the ongoing TVET gender analysis in terms of obtaining relevant data and meeting key people involved in TVET in Lebanon.
MISCELLANEOUS GENDER MAINSTREAMING ACTIVITIES A series of miscellaneous gender-related activities were conducted this year, including the following:
• LIFE gender analysis: The senior gender specialist reviewed and submitted LIFE’s gender analysis, which was undertaken prior to its MEL plan development, to ensure that all gender issues are addressed in due time and comply with USAID’s gender integration requirement.
• LED document: The senior gender specialist reviewed the LED document to ensure gender mainstreaming and provided comments on the gender component of the project document.
• Local Development Project (LDP): The LDP project design consultant was briefed on the situation with respect to gender mainstreaming in USAID/Lebanon’s programs and shared gender-related information and documents developed from 2012 to date, as well as the compliance kits on the environment, Counter-Trafficking in Persons (C-TIP), people with disabilities, and sustainability. The senior gender specialist reviewed the draft LDP documents and proposed new framework, tools, and other documents related to project design and discussed the proper means for integrating gender in the project’s design and implementation at all stages.
• Regional gender-based violence (GBV) report: Based on a request received from the USAID Program Office (PO), PMSPL II reviewed and provided feedback on a regional report titled “Cost of Gender-Based Violence in Lebanon: Countering Gender-Based Violence in the Middle East and North Africa Region.” Furthermore, the Gender department at SI/HO requested a follow-up Skype conference call with USAID/Lebanon offices to discuss USAID’s comments on the report. The report was revised and submitted accordingly.
SUB-PURPOSE 1.4: INCREASED FIELD-LEVEL MONITORING ACTIVITIES Under Sub-Purpose 1.4, the PMSPL II team provides the Mission with data on project implementation, allowing technical offices (TOs) to compare information from their own monitoring efforts with additional sources of monitoring data and make evidence-based management decisions on the performance of their projects. PMSPL II provides USAID/Lebanon with sufficient, accurate, and verified information on the progress of technical projects within its portfolio in accordance with the approved project MEL plans and Mission PMP. The PMP Toolkit, recently revised by Social Impact, provides templates for PSV reporting, which are used as a reference for the MEL specialists.
Within Output 1.4.1 (Activity progress monitored and implemented in compliance with USAID regulations), PMSPL II conducts site visits for beneficiaries and funded activities in support of ongoing USAID project monitoring and oversight responsibility. The overall targeted number of sites visited is directly linked to the activity verifications conducted and the number of beneficiaries requested to be visited; the target is determined on a quarterly basis, taking into consideration USAID requests. Following the PSVs, PMSPL II submits PSV reports.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 24 PSV SCHEDULE UPDATE As stipulated in the work plan, every quarter a proposed PSV schedule is designed in coordination with the COR/AOR from the USAID Mission, and project site visits are initiated and completed. Following each visit, a PSV report is prepared.
At the beginning of each quarter, the PSV schedule is updated in coordination with the COR based on the needs of the Mission and is then approved. The PMSPL II team conducts the field visits and assesses projects as per the agreed-upon schedule. Eighteen verification reports were submitted during FY2017; they are listed below.
PSV 020: LIVCD DATA VERIFICATION (DV) During Q4 FY2016, an extensive data verification was carried out over several weeks by the PMSPL II team and was composed of four in-depth sessions. Following the data verification, PMSPL II prepared the PSV report and submitted it to the Mission during the first week of FY2017.
PSV 022: BALADI CL DV During the last quarter of FY2016, a data verification session was held with BALADI CL. A meeting was conducted with BALADI CL’s MEL officer and there was a review of the seven indicators pertaining to this project (mainly PPR indicators). Following the session, a DV report documenting the main issues encountered by BALADI CL was submitted to the Mission in early FY2017.
PSV 023: BALADI RMF DV
FIGURE 8. PMSPL II conducted a data verification for all indicators that were not verified in previous PSVs and no major findings or concerns were identified.
The BALADI RMF DV was conducted during the last quarter of FY2016. A report with the findings and recommendations was prepared and submitted to the Mission in FY2017.
PSV 024: QITABI DV A PSV was conducted for QITABI based on a request received from QITABI’s COR. PMSPL II staff were also informed that QITABI will undergo data verification on a quarterly basis. PMSPL II conducted a data verification for all indicators that were not verified in previous PSVs and no major findings or concerns were identified. A data verification report was prepared, reviewed, and submitted to the Mission accordingly.
25 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV PSV 025: LIVCD GRANTS INVENTORY A grants inventory for LIVCD was the first PSV requested in Q2 FY2017. The comprehensive list of non-expendable property (NXP) items was shared by LIVCD, and PMSPL II designed a statistical sample sufficient to validate the inventory. The sample list was shared with the LIVCD team, who coordinated the visit schedule. PMSPL II team also requested the environmental documentation related to those grants. Visits were conducted and no major findings were identified. All equipment listed in the inventory was verified on site except for one item that was delivered to Hermel for use by the relevant beneficiaries. The corresponding report was submitted to the Mission.
PSV 026: LWP OFFICE INVENTORY PMSPL II received a request to perform an office inventory verification. An ODK form was customized and finalized for this request to include the 97 items. The PSV was conducted and no major findings were identified; the corresponding report was submitted accordingly.
PSV 027: QITABI DV Y2Q2 As part of the regular quarterly data quality review (highlighted above), a DV session was scheduled with QITABI’s MEL team during this quarter. In the meeting, four indicators were verified. No major findings were identified and a report was submitted to the Mission accordingly.
PSV 028: USP DV – SCHOLARSHIPS LAU The LAU DV focused on one indicator (number of new and improved jobs) and the corresponding report was submitted.
The PMSPL II team conducted a DV for the USP program at AUB, focusing on one indicator (number of new and improved jobs). The team went over the data reported to date in the Annual Report and indicator tracking tables for USP programs 2, 3, 5, 6, and 7. Following the visit, a report was submitted to the AOR underlining major findings in the DV process.
PSV 029: USP DV – AUB The DV for AUB was conducted and, like PSV 028 described above, focused on one indicator (number of new and improved jobs); the corresponding report was submitted.
The PMSPL II team conducted a DV for the USP program at AUB, focusing on one indicator (number of new and improved jobs). The team went over the data reported to date in the Annual Report and indicator tracking tables for USP programs 2, 4, 5, 6, and 7. Following the visit, a report was submitted to the AOR underlining major findings in the DV process.
PSV 030: BALADI CARITAS DV Y2Q2 In FY2017, an in-depth data verification exercise for selected indicators was conducted for BALADI CL. During the course of the exercise, the PMSPL II team encountered difficulty in verifying any of the reported results, as the newly recruited MEL officer was not using any standardized templates. Accordingly, the Caritas team suggested cleaning the data, revising all the numbers, and then sharing them with PMSPL II. Following the revisions, the report was finalized and submitted to the Mission.
PSV 031: BALADI RMF Y2Q2 In FY2017, two DV sessions were conducted with the BALADI RMF MEL team. The first session was conducted; data for only one indicator was verified.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 26 The second DV session was conducted that covered all the remaining selected indicators and the corresponding report was submitted.
PSV 032: LWP DV Following the approval of its MEL plan, and the completion of the related DQA, a data verification session for LWP was scheduled. Five indicators reported on for Year 1 of the project were verified. No major findings were identified in the exercise. Revisions were suggested to some indicators and a few data collection forms. The DV report was submitted to the Mission accordingly.
PSV 033: LRI DV During FY2017, the PMSPL II team conducted a DV with the LRI team upon receiving approval of its MEL plan. No major findings were identified and the DV report was submitted accordingly.
PSV 034: QITABI DV Y2Q4 The data verification for QITABI was held with the QITABI MEL team, headed by the director of MEL and the database manager (see Figure 4). Since the revised version of the QITABI MEL plan was approved earlier in FY2017, modifications were mainly related to targets and new indicators. As per the request of the AOR, this DV was designed to focus on indicators not covered in the previous DV visits. In addition, PMSPL II also checked other indicators for consistency, double-counting, gender disaggregation, and accuracy in reporting. In parallel, PMSPL II reviewed some of the templates used for data collection and inspected the hard copies and signatures as well as the filing process for the data available. The DV report was submitted accordingly.
PSV 035: BALADI CAP DV Y2Q4 The data verification meeting for BALADI CAP was held with BALADI CAP’s COP and MEL assistant in the presence of the AOR. The MEL plan for BALADI CAP was initially developed and approved in 2014. Since then the project budget has grown from $4.3 million to $4,921,853 and the project lifespan has been extended to September 2018. A revised version of BALADI’s MEL plan was submitted and approved in August 2016. Modifications in the MEL plan were related to additional project components, activities, and indicators.
As per the request of the AOR, the DV conducted in FY2017 was designed to focus on indicators reported under the PMP and PPR. The DV report was submitted accordingly.
PSV 036: BALADI RMF DV Y2Q4 With respect to the BALADI RMF DV, the project AOR suggested focusing on the indicators not covered in the previous exercise so that all reported indicators are verified in the reporting year. Accordingly, PMSPL II team conducted a data verification session with the BALADI RMF team (including the operations and monitoring manager) and two MEL officers. The session covered all indicators reported in Q3 Y5 of the project. No major findings were identified—just minor calculation and typographical errors. Errors were communicated to the RMF team for revision. The data verification report was submitted accordingly.
27 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV
FIGURE 9. A data verification session was conducted with the BALADI Caritas team in the last week of FY2017. Most of the Caritas MEL team are newly employed, which presented many challenges.
PSV 037: LIVCD DV Y2Q4 In FY2017, a DV was to be conducted for LIVCD Q3 reported results. The LIVCD team shared the requested documents (i.e., the quarterly report and the IPTT). The PMSPL II team requested to schedule the session towards the end of FY2017, but the concerned LIVCD team members were unavailable, so the session was scheduled for FY2018.
PSV 038: BALADI CARITAS DV Y2Q4 A data verification session was conducted with the BALADI Caritas team in the last week of FY2017. Most of the Caritas MEL team are newly employed, which presented many challenges. Some important findings were observed during the meeting and were discussed with the team. The report will be submitted in FY2018.
SUB-PURPOSE 1.5: INCREASED INTEGRATION OF GIS INTO MISSION AND IM ACTIVITIES Under this sub-purpose, the PMSPL II team supports USAID/Lebanon and USAID GeoCenter to ensure the use of GIS systems and frameworks. PMSPL II supports the Mission Geographic Information System by hosting a GIS unit, housing the related equipment needed, and managing its activities.
IMDATA 001: USP DATA In the second half of FY2017, the GIS specialist received a request to update the list of USP beneficiaries in accordance with the latest data available (November 2016). In coordination with the USP AOR, who communicated the missing data with the related universities, a total of 745 students were mapped to the level of towns. A summary of the total number of beneficiaries was recorded for each town (disaggregated by USP, university, and gender). Accordingly, a new GIS layer was produced that reflects the beneficiaries.
IMDATA 002: IM ACTIVITIES DATA FORM The Mission issued a request to the GIS specialist to develop a procedure to periodically update the activities of all the IMs in GIS. Accordingly, an Excel form was designed to serve this purpose, which was intended to be shared with all IMs so they could update and submit their data within a period of two weeks after the end of each quarter. The compiled data was collected and the master geographic database was updated to ensure that all mapping is based on up-to-date information.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 28 Towards the end of FY2017 the IM activities form received the Mission’s approval. Accordingly, it was sent to each active IM, with the available data for updates and an initial deadline for submission in early FY2018. Some IMs provided their feedback in the last week of FY2017:
• MENA II submitted the form with updated data; it is ready for mapping.
• LIVCD submitted a draft form with suggestions on a compiled budget, which is being assessed for usability.
• QITABI requested a meeting to understand the objective of this data collection and the level of detail requested and to raise the issue of the tight deadline for submission.
• USP AUB discussed the form over the phone and it was agreed that they would use their existing data templates to fill the data into the proposed form without manual data entry.
This task is still in progress, and it is expected to be finalized in Q1 FY2018—specifically, receiving the updated forms from all the IMs, compiling the data into the master database, and generating a set of maps showing the distribution of the activities for all active IMs.
IMDATA 003: DEMOCRACY REPORTING INTERNATIONAL Through an initiative of PMSPL II to seek data from other international donors that could serve the USAID program in Lebanon, the GIS specialist met with Democracy Reporting International (DRI) to discuss a) the survey data collected by DRI on the capacity and performance of unions of municipalities in Lebanon and b) how PMSPL II and USAID/Lebanon could have access to and benefit from this data. PMSPL II suggested providing its GIS and mapping expertise to support DRI in its data analysis, and in return DRI would share this data with PMSPL II. To follow up, the GIS specialist provided DRI with a short technical description of the tasks that can be provided. DRI will review the suggestions with the project donor to decide on whether to proceed. Feedback is anticipated in Q1 FY2018.
SOURCE 004: SATELLITE IMAGE FOR LEBANON As part of Sub-Purpose 1.5 and within Output 1.5.2 (Search for online data sources finalized), PMSPL II received a request to compile a single satellite image covering all of Lebanon to be used for mapping and analysis in the future. PMSPL II issued a request for such imagery from the GeoCenter and received a link to download the files. However, after review, the GIS specialist advised that the maps were missing the fourth band, which is used for analysis. Accordingly, PMSPL II requested an update from the GeoCenter and images that included the fourth band were received.
Further analysis on the second set showed that there were some gaps in the images, specifically in the northeast region. Accordingly, the GeoCenter shared a third set, which included scenes of images that cover the gaps. Finally, all the scenes were mosaicked, with priority given to the most recent ones.
The outcome was a single, medium-resolution (spatial resolution of three meters) and multi-spectral (four bands) satellite image for the whole country, spanning November and December 2016. The data is ready to be used in other tasks and to be shared with the IMs when needed. A new GIS layer was added to the geodatabase.
29 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV SOURCE 005: UNIVERSITIES AND TECHNICAL SCHOOLS In FY2017, PMSPL II was asked to map the universities and the technical/vocational schools in Lebanon as accurately as possible. This data, along with the locations of schools that had previously been mapped, would be used to map activities related to the education sector much more efficiently, analyze the distribution of the different institutions within the educational sector in Lebanon, and facilitate better planning for new projects and activities.
To execute this task, the GIS specialist collected mapping data for universities (both public and private) as well as public and private technical schools and incorporated the table as a GIS layer into the master geodatabase.
As a result, three new GIS layers were compiled and incorporated into the master geodatabase:
• University level • Public technical school level • Private technical school level
SOURCE 006: UNDP DATA Progress was made in FY2017 within Output 1.5.2 (Search for online data sources finalized) to compare findings compiled by USAID/Lebanon partners with data published by UNDP.
This task was suggested by the PMSPL II team, which involved collecting data published by UNDP and comparing it to the data in the master geodatabase. After downloading and reviewing the data, the following were identified:
• Levels 1 and 2 admin boundaries have similar data in the master geodatabase.
• Some discrepancies were found at the level of municipalities, which require further assessment of which source is more reliable.
• Two new data layers were added to the master geodatabase: Hospitals and Public Health Centers.
In addition to the collected data above, UNDP, with the Ministry of Social Affairs (MoSA), published a website for mapping risks and resources (MRR), which includes the list of towns included in their assessments as well as the assigned priorities for each town. This data was geocoded to the level of towns (225 towns out of 228) and incorporated into the master geodatabase. The data is ready to be incorporated into any future map requests.
Within Output 1.5.4 (Access to the GIS Unit Lebanon database established), the GIS Unit works with the different IMs and Mission staff members to design and generate static maps and perform spatial and statistic data analysis. Accordingly, during FY2017, the following maps were produced:
DATA 003: SATELLITE IMAGE – MENJEZ At the start of FY2017, the GIS specialist received a request from LRI to extract a satellite image for the Menjez area (where LRI has activities and reforestation projects). The existing geodatabase already had
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 30 images of the area and the GIS specialist needed the approval from both LRI and PMSPL II’s CORs to submit to LRI. The approval was received and the image was properly extracted and delivered to LRI.
DATA 004: UPDATE RIVERS NETWORK During FY2017, the SI GIS specialist suggested updating the rivers network. The objective of developing such data was to produce a realistic map background. This background would be used when mapping the IMs’ activities and generate richer output maps that make it easier to interpret geographic regions.
The aim of this task is to update the existing GIS layer of the rivers network (2005) based on the most recent available satellite image (2016). The scale used for the update is 1:10,000. A total of 1,276 kilometers of permanent and seasonal streams was mapped. The updated network was compiled as a new GIS layer and stored in the master geodatabase. This task is achieved, and the new GIS layer is ready to be shared or used in any future mapping requests.
Below are the maps generated during FY2017:
MAPS 010: IMs’ Activities. An A3-sized map demonstrating the distribution of activities carried out by all the active IMs.
MAPS 011: Syrian Refugees. A map highlighting the distribution of Syrian refugees based on the latest available United Nations High Commissioner for Refugees (UNHCR) data dating to June 2015.
MAPS 012: Local Governance Assessment. Based on the Local Governance Assessment carried out by PMSPL II, the GIS specialist reviewed with the senior consultant the needs for geographically distributed data and maps to serve in his analysis. The GIS specialist reviewed existing data located on the geodatabase and researched and incorporated missing items (mainly adding an update on the count of Syrian refugees and the distribution of prisons in Lebanon). Accordingly, the GIS specialist mapped the locations of prisons and Palestinian camps in Lebanon and generated a set of eight maps:
1) Administrative boundaries, Level 1;
2) Admin boundaries, Level 2;
3) Admin boundaries, Level 3;
4) Population density;
5) Locations of prisons;
6) Locations of Palestinian camps;
7) Distribution of registered Syrian refugees; and
8) Location of Palestinian camps overlaying the population density.
MAPS 013: D-RASATI 2 Brochure Map (updated). The GIS specialist updated information on a brochure map for D-RASATI II (which was prepared and submitted in FY2016).
31 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV MAPS 014: LIVCD Value Chains. Sample maps for two value chains (avocado and olive oil) were created and several sample maps were designed. These maps were reviewed and discussed with representatives of each value chain from the LIVCD team. Based on their comments (through several rounds), PMSPL II produced a common map format. Data for a third value chain was also shared.
FIGURE 10. Sample map for olive oil value chain
Three data sets were processed (apple, avocado, and olive oil) and three final maps were produced. Later, maps for the honey, cherry, grape, and processed food value chains were also produced—a total of seven maps were produced. Towards the end of FY2017, LIVCD submitted the data from the rural tourism value chain, and the GIS specialist initiated the work. The processing and mapping of this last value chain is expected to be finalized toward the beginning of FY2018.
MAPS 015: Customer Satisfaction Survey (2). This map compiles the municipalities involved with five IMs (BALADI CAP, BALADI Caritas, BALADI RMF, LRI, and LWP), highlighting the total residents (2008), total registered voters (2016), and total registered Syrian refugees (2015). One map was also generated showing the distribution of these municipalities, classified by their count of involved IMs. These maps inform the design of a customer satisfaction survey planned for FY2018.
MAPS 016: USAID Activities Over Past Three Years. One map was produced and delivered, highlighting all USAID activities for all IMs over the past three years.
MAPS 017: A&E Site Visits. Four A3-sized maps (digital and hard copies) showing the distribution of the sites for BALADI (Caritas and RMF) and LWP activities were created. The maps were divided as follows: • One map showing all the activities in Lebanon (general view)
• Three maps showing concentrated areas (North Lebanon, Metn, and Jezzine)
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 32
MAPS 018: Gender Analysis. A gender analysis map summarizing the data from the gender assessment was created. This map identified the level of universities and the location of the involved municipalities (eight campuses). Four maps were delivered: 1. Female vs. male students in sample 2. Percentage of females per faculty 3. Percentage of males per faculty 4. Female vs. male students in sample receiving financial assistance
MAPS 019: USAID Activities in Tripoli. Three maps showing the different USAID activities that are taking place in Tripoli were produced. These maps show the activities classified by IM or by sector.
MAPS 020: USP Beneficiaries. Two maps showing the distribution and count of USP beneficiaries, aggregated at the level of towns and districts, were produced. This task is achieved.
MAPS 021: LDP Assessment. This request was made in response to the LDP project appraisal that PMSPL II is currently working on (see Sub-Purpose 2.1 below). The GIS specialist updated the vulnerable area data from UNHCR and generated two maps showing the distribution of the program’s activities cluster. This task is achieved.
MAPS 022: USAID Activities by Sector. Based on a request received from the Mission, nine maps were generated showing the distribution of the IM activities per sector. The maps were generated and submitted accordingly.
MAPS 023: USAID Activities in Akkar. The Mission requested an A3-sized map that provides an overview of all the IM activities in the governorate of Akkar. The map was processed and delivered to the Mission in JPEG and PDF format, ready to print.
MAPS 024: BALADI Activities. Based on the request of the Mission, an updated map demonstrating the activities of BALADI projects across the country was needed. Accordingly, the available data for BALADI was sent to the implementing partners (RMF and Caritas) to be updated, including Round 1 and Round 2 activities. After receiving the updates from both IPs, four maps were produced as follows: • one map for Caritas activities; • one map for RMF activities; • one map for both IMs’ activities; and • one map classifying the activities between Round 1 and Round 2.
ESTABLISH AGOL PLATFORM FOR USAID/LEBANON A new component added in this sub-purpose in FY2017 is the implementation of ArcGIS Online (AGOL). This is facilitated by special licensing arrangements with USAID’s GeoCenter, thereby providing AGOL access for selected USAID/Lebanon staff and PMSPL II support staff concerned with utilizing GIS for M&E. In FY2017, the GIS specialist initiated the first online GIS platform for the Mission to dynamically visualize and exchange geographic data with the PMSPL II team. The GIS specialist created a group in AGOL labeled “USAID: Lebanon” for all the users in Lebanon and designed a sample web app to be published for that group.
This task was placed on hold so that more detailed data on the IM activities could be developed in GIS. Once this data is ready, this task will progress again. (It is expected to relaunch in FY2018.)
33 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV GIS TECHNICAL SUPPORT – LWP Also within this output, the GIS unit provides support to IMs when requested. This year, Lebanon Water Project (LWP) requested technical support from the PMSPL II GIS specialist regarding LWP’s ongoing GIS activities. A meeting was scheduled with LWP to review and discuss an upcoming GIS activity, an on-the-job GIS training for the LRA staff. In the meeting, the anticipated training was discussed and the GIS specialist offered recommendations on the scope of work, scheduling of the training, qualifications of the trainer, materials to be delivered to the trainees, and potential information technology (IT) issues and constraints (availability of PCs, GIS software, compatibility with the generated geodatabase version).
PMSPL II also received an additional request from LWP: an assessment of the LWP geodatabase.
MISC 008: DATA REQUEST FROM REGIONAL OFFICE Under Sub-Purpose 1.5, USAID Middle East Regional Office requested a set of GIS data related to the administrative boundaries of Lebanon, the Lebanese population, and the count and distribution of Syrian refugees in Lebanon. The GIS specialist compiled the requested data as shapefiles and submitted them to the GIS specialist at the regional office.
GIS WORKSHOP GEOCENTER 2016 This year the GIS specialist could not attend the GIS annual workshop in Washington, D.C. and hence conducted a 30-minute presentation remotely using a dedicated software. The presentation was mainly a live demo showing the capabilities of the internal reporting database solution and how it helps in systemizing and speeding up periodic reporting.
Within Sub-Purpose 1.5 and pertaining to Output 1.5.5 (Automated field data collection), the GIS specialist designed and generated an ODK forms for several IMs as listed below.
ODK 003: LWP INVENTORY CHECK An ODK form was designed for LWP inventory check (refer to Sub-Purpose 1.4), containing a list of 97 items to be checked. The form was uploaded into ODK Aggregate and was ready to be used by the MEL officers. Moreover, the two MEL specialists who will be conducting the PSV and using the form were trained on the use of ODK with an applied example using LWP inventory check. When the MEL team conducted the PSV and collected the required data, which was downloaded locally, it was compiled into the ODK database and a report was generated.
ODK 004: LIVCD INVENTORY CHECK The GIS specialist also designed an ODK form for the LIVCD inventory check and uploaded it into ODK Aggregate. After PMSPL II’s MEL team conducted the PSV (refer to Sub-Purpose 1.4) and collected the data, it was downloaded locally, compiled into the ODK database, and 11 reports were generated (one per grant).
SUB-PURPOSE 1.6: INCREASED INTEGRATION OF AT+ INTO MISSION AND IM ACTIVITIES Within this purpose (IMs’ regular use and update of AT+), the CLA specialist mentors USAID and IM personnel on AT+ and provides ongoing support and coordination for USAID/Lebanon on the use of AT+ by collecting IMs’ data and working collaboratively with the chief information officer (CIO) in Washington to vet and upload data to AT+.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 34 Under this sub-purpose, the PMSPL II team ensures the transition to and use of AT+ by the Mission and its partners. AT+ is a cloud-based USAID management information system intended to streamline performance management and reporting processes.
AT+ COACHING / SUPPORT In FY2017, within Output 1.6.1 (IMs’ regular use and update of AT+), a series of coaching sessions was conducted as follows:
• One session was conducted for the two new users of Lebanon Water Project. • Two were conducted for the two new users from LAU. • Two were conducted for BALADI Caritas new users. • One was conducted for the MENA II. • One was conducted for an additional new user from LAU.
Also within this output, support was provided for BALADI RMF in creating new GIS locations for the municipal activities on AT+.
AT+ QUARTERLY / ANNUAL REPORTING As part of Sub-Purpose 1.6 and within Output 1.6.1, the CLA specialist works closely with the IMs to ensure that they are reporting on performance data, conducted tasks, and geographic locations using AT+.
Following the alignment of IMs’ MEL plans during the first half of FY2017, IMs submitted their targets and indicators to be uploaded to AT+ by the Mission and the FY2016 reporting periods were opened for all IMs. All IMs completed their FY2016 reporting on AT+ except for Haigazian University (HU) and Caritas.
Within Sub-Purpose 1.6 and pertaining to Output 1.6.2 (Support USAID AT+ Admin and A/COR using AT+ provided), PMSPL II supports the A/CORs in uploading and publishing indicator baselines and targets. The CLA specialist reviews the partners’ data upload, synchronizes AT+ reported data with the USAID PMP/PPR reports developed by PMSPL II, and ensures that relevant indicators are uploaded to IM portals.
By the end of Q4 all IMs had completed their Q1, Q2, and Q3 FY2017 quarterly reporting, except for the following: • BALADI Caritas, due to delays in target approvals and the recruitment of new MEL focal points; • BALADI CAP (Q3), due to delays in the recruitment of MEL focal points and revision of the MEL plan.
Q4 FY2017 reporting is due in October 2017.
PPR QUARTERLY / ANNUAL DATA COLLECTION FY16 The PPR FY2016 data collection/reporting requirements and guidance were scheduled to be released by USAID in mid-October of this quarter. Upon release, PMSPL II recognized that the new guidelines were slightly different from those of previous years, and more information was requested.
Following this stage, IMs were requested to report their PPRs on AT+, including results, explanations,
35 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV and future indicator performance analysis; in parallel, PMSPL II completed the other narrative sections, such as future indicator performance and relation with the Mission objective. The data was completed and compiled by the first week of November; PMSPL II generated the PPR indicator tables and submitted them to USAID within the specified deadline.
Following the submission of the PPR indicator tables to the Program Office, PMSPL II received a request for further clarification regarding some of the PPR reported indicators. PMSPL II contacted the IPs to get further explanations on the reported results and resubmitted the reports.
USAID AT+ SUPPORT Within Sub-Purpose 1.6 and pertaining to Output 1.6.2 (Support USAID AT+ Admin and A/COR using AT+ provided), PMSPL II supports the A/CORs in uploading and publishing indicator baselines and targets. The CLA specialist reviews the partners’ data upload, synchronizes AT+ reported data with the USAID PMP/PPR reports developed by PMSPL II, and ensures that relevant indicators are uploaded to IM portals.
To initiate the FY2016 annual and FY2017 quarterly reporting, PMSPL II provided support to USAID AT+ Admin in uploading the baseline and targets for active IMs. Additional support was provided in reviewing the IMs’ uploaded data, adjusting the IMs’ portals when needed. Several adjustment requests were received from QITABI, AUB, LAU, and LWP.
Following the alignment of all MEL plans with USAID PMP, PMSPL II provided support to the USAID AT+ Admin in uploading the PMP PIRSs on AT+. As such, all water and higher education PIRSs, in addition to four basic education PIRSs were uploaded to the system. The civil society, governance, and DO2 indicators are pending.
Work on updating and uploading the remaining PIRSs will continue in FY2018.
SUB-PURPOSE 1.7: IMPROVED EVALUATION ASSISTANCE PROVIDED BY PMSPL II As per USAID requests, summative or formative evaluations were to be conducted during FY2017. Based on USAID Mission–identified evaluation objectives and questions, PMSPL II develops the necessary evaluation SOW that incorporates stakeholder views on evaluation questions that are to be answered by the evaluation. Evaluation, Quality, Use, Impact (EQUI) principles are incorporated in the SOW to ensure that high-quality evaluations are conducted by certified evaluation team leaders. A final SOW is agreed upon by PMSPL II and USAID. The evaluation SOW elaborates the methodology to be used, the evaluation questions to be answered, and basic information about the project to be evaluated. It also sets the expected deliverables, budget, and execution timeframe.
During FY2017, the following evaluations were conducted:
LIVCD EVALUATION In FY2016, PMSPL II carried out and completed the LIVCD midterm evaluation. The work was executed by both a local and international expert alongside the PMSPL II team, with the draft report submitted in FY2016. In FY2017, the report underwent additional revisions as revised data became available. The PMSPL II team reviewed the revised version of the report, incorporated the necessary editing, and
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 36 submitted the final version to the Mission. The Mission director cleared the final evaluation report and it was uploaded to DEC.
D-RASATI II EVALUATION During the second half of FY2016, PMSPL II conducted an in-depth final performance evaluation for D- RASATI II. The findings were intended to be used to help develop future education sector work in Lebanon. After completing the SOW and the corresponding field work and data collection, the evaluation team proceeded with the analysis of data collected. Qualitative data was coded and analyzed and preliminary findings, conclusions, and recommendations were drafted.
The team prepared the preliminary findings presentation that was submitted during FY2017. A presentation highlighting the interim findings was delivered at the Mission. Following the meeting, PMSPL II prepared the first draft of the evaluation report. Following Mission feedback, the report was shared with other stakeholders including USAID’s PPL office and implementing partner World Learning, which also provided input.
Upon receiving all comments from the different stakeholders, PMSPL II incorporated them in the report and submitted the final version. A revision matrix, a table that combines all the comments and their related feedback, was also attached to the final evaluation report. The report was approved and cleared by the Mission and uploaded to the DEC.
QITABI EVALUATION In FY2017, following the work conducted on the D-RASATI evaluation and since a team of international consultants specialized in the educational sector was formed (particularly the Lebanese educational sector), USAID/Lebanon expressed its interest in conducting a midterm evaluation for QITABI. An evaluation SOW was prepared and approved by the Mission. Accordingly, the execution phase was launched. However, two main challenges were encountered: access to the QITABI project database and the recruitment of an evaluation team leader.
Recruitment of evaluation team: Following a lengthy recruitment, the PMSPL II team identified several candidates to act as the EQUI team leader for the assignment. The selected team leader for the D-RASATI II evaluation was also recruited for the QITABI evaluation, as he is an EQUI-qualified evaluation team leader. At the same time, SI recruited and hired a local education expert to assist with focus group discussions. A local firm for data collection was selected. In addition, two senior PMSPL II MEL specialists were assigned to the team. For the position of local senior education specialist, a candidate with extensive experience with the Ministry of Education and Higher Education was selected. This person brought an insider’s perspective to an assessment of QITABI training materials and activities.
37 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV [photo redacted]
FIGURE 11. An in-depth midterm evaluation was conducted for QITABI in FY2017.
Developing evaluation methodology: In parallel to the recruitment process, PMSPL II drafted the evaluation methodology, then prepared and submitted the necessary documents to MEHE, including an official school visits request letter addressed to the Director General, containing the names of the schools, principals, and teachers participating in the FGD; the location and dates of the FGDs; and the questions and tools to be used in the evaluation.
Capacity building of local data collection firm: A data collection firm was contracted to carry out the data collection and FGDs. Accordingly, a training session was conducted for the firm’s moderators and note takers. The training session focused on FGD protocols, including the evaluation questions, note-taking guidelines, probing questions, and other relevant topics.
Submission of inception report: Prior to executing the field work, the evaluation team submitted the inception report to USAID. This included the introduction, methodology, FGD and KII matrix, data collection tools, and analysis process.
Data collection: Following submission of the inception report, the evaluation team began collecting data. A total of 36 FGDs were conducted with principals, teachers, Ana Aqra Early Grade Reading (EGR) facilitators and trainers, Department of Orientation and Governance (DOPS) coaches, and CERD trainers. In parallel, the team scheduled and conducted a total of 25 KIIs with USAID and project stakeholders, including staff members from World Learning, Ana Aqra, Management Systems International (MSI), America-Mideast Educational and Training Services, Inc. (AMIDEAST), MEHE, and CERD. Data collection was completed accordingly.
Out-brief presentation: Following the data collection phase, the evaluation team completed data coding and data analysis. This was followed by a preliminary presentation for the Mission director that focused mainly on evaluation, methodology, and preliminary findings. A second presentation was also conducted for USAID that focused on findings, conclusions, and recommendations.
Interviews with QITABI and CERD: While the PMSPL II team was finalizing the evaluation, a second round of interviews was conducted by the local senior education consultant. The consultant interviewed QITABI project staff members and CERD staff. The interviews focused on 13 questions identified by the evaluation team leader. These questions were to ensure that a local perspective on QITABI activities
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 38 and products was captured. The local senior education specialist’s findings were integrated into the evaluation draft report.
Towards the end of FY2017, QITABI’s final evaluation was submitted to USAID/Lebanon. Following the submission, comments were received from both the Mission and World Learning (the implementing partner). The report was revised accordingly and shared with the Mission.
Final approval for the evaluation report is anticipated in FY2018.
MENA II MIDTERM EVALUATION Towards the end of FY2017, a request was issued by the Mission to conduct a midterm evaluation with MENA II. The evaluation is intended to explore the effectiveness of the strategic model embedded in MENA II and of project interventions. Specifically, the evaluation questions will review the rationale, current performance to date, and likely effectiveness of the three respective aspects of the MENA II approach outlined above.
Accordingly, PMSPL II developed a brief SOW including a detailed methodology, an evaluation matrix, and an illustrative time table. This SOW will be used as the basis to recruit the needed consultant.
The MENA II evaluation should adhere to EQUI standards. Accordingly, prior to conducting the evaluation, the team that will be assigned to this evaluation needs to be EQUI-certified and is requested to finalize the EQUI team leader training to ensure compliance with EQUI protocol.
BALADI CAP MIDTERM EVALUATION In FY2017, preparatory work was under way for the BALADI CAP midterm evaluation. USAID shared the BALADI CAP midterm evaluation SOO with PMSPL II. A meeting was then held at the Mission with the team who will be involved in this evaluation process. A midterm evaluation SOW was developed and shared with the Mission during the last week of FY2017. The SOW outlined the evaluation’s objectives and questions, an illustrative methodology, the profile of the evaluators, and a tentative schedule.
It is anticipated that the MENA II and the BALADI CAP midterm evaluations will commence in FY2018.
SUB-PURPOSE 1.8: CAPACITY BUILDING OF LOCAL ORGANIZATIONS TO MONITOR AND EVALUATE PROJECTS INCREASED Identification of two local organizations through a selection process took place during the second half of FY2017. Local firms, as identified through an RFP for data collection services, have been shortlisted. The project team intends to proceed in FY2018 with interviewing these firms, with the purpose of advancing their capacity to do digital data collection, performance evaluations (PEs), and impact evaluations (IEs) to an international standard. Two local firms will be selected after the interview process.
39 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV PURPOSE II: DIRECT SUPPORT TO USAID’S PROGRAM MANAGEMENT INCREASED
Key Accomplishments • Issued LED RFP • Submitted CDCS stocktaking report • Provided support to the Community Development Project (CDP) PAD design team and submitted CDP SOO, SOW, and deliverables table • Delivered Rural Tourism booklet for all USAID-related projects across the country • Populated USAID/Lebanon Facebook page on weekly basis • Recruited production company to produce USAID/Lebanon video • Finalized USAID graphic designer vacancy and announced to the public • Completed and submitted the basic education and higher education levels of the Education Gender Assessment • Received approval and clearance on the three reports for the Education Gender Assessment—basic education, higher education, and technical and vocational education and training (TVET)
Purpose II (Direct Support to USAID’s Program Management Increased) includes establishing and supporting USAID collaborating, learning, and adapting (CLA) systems and tools, initiating knowledge management, support for DOC, and support for the project design process.
SUB-PURPOSE 2.1: PROJECT DESIGN, MANAGEMENT, AND REPORTING REQUESTS COMPLETED BY PMSPL II Under this sub-purpose, the PMSPL II team provides support for the project design process: project design planning and execution, program documentation preparation, reviews, and editing. PMSPL II ensures the implementation of USAID/Lebanon’s CDCS during the project design process and provides training to USAID/Lebanon’s staff in project design planning and execution, using USAID’s most up-to- date programming guidance to help them develop effective programs and projects with sustainable results based on best practices and lessons learned locally, regionally, and globally.
In FY2017, activities under this sub-purpose were a carried over from work initiated in FY2016.
LED DESIGN Work on the LED design was initiated and carried over from the previous PMSPL contract. In FY2015, PMSPL II developed a concept paper for the LED and, during the FY2016 period, additional work was invested in the PAD development phase.
In the second half of FY2016, the PAD pertaining to the LED design was developed and shared with the Mission for review and input. In FY2017, PMSPL II received feedback from the Mission and addressed the comments in the PAD. Following the finalization of the PAD, PMSPL II supported USAID in preparing the RFP for LED. The LED project had been awarded by the end of FY2017.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 40 LOCAL DEVELOPMENT PROJECT / COMMUNITY DEVELOPMENT PROJECT PAD During the second half of FY2017, USAID requested the support of PMSPL II in the development of a LDP PAD. Accordingly, PMSPL II recruited a project design expert, held a series of meetings, and developed a results framework.
The first draft of the PAD and some of its annexed documents were submitted to the design team at the Mission. As work was progressing, the Mission changed the name of the project from LDP to Community Development Project (CDP). A first revision of the PAD narrative document and all its annexes was submitted to Mission staff, who in turn shared comments and feedback. The Mission requested to structure the document so that it reflects an SOO for indefinite delivery, indefinite quantity (IDIQ) contracts and an illustrative SOW for the procurement of some of the project’s components. Towards the end of FY2017, the project design consultant submitted a revised CDP SOO, SOW, and deliverables table, which had been updated according to edits made by the design team. This work will continue in FY2018 with the addition of an MEL plan as an annex to the PAD, which will become a part of the RFP anticipated for November.
CONSOLIDATED PAD FOR DO2 The Mission requested advice from the PMSPL II project design expert on designing a PAD for DO2 that would consolidate the activities under DO2 in one PAD with an associated project-level MEL. Work began on this last quarter. This work will continue in Q1 FY2018.
SUB-PURPOSE 2.2: CLA/KNOWLEDGE MANAGEMENT (KM) ADVANCED IMPLEMENTATION In FY2016, Mission interests moved from an exclusively knowledge management consideration to the more broad-based CLA framework that mirrors USAID/PPL developments. In FY2016, PMSPL II adopted its work plan to align with new Mission interests.
Within Output 2.2.1 (MEL tool updated and utilized), PMSPL II developed a tool in FY2016 to effectively track and follow on related findings and recommendations generated from MEL reports and other PMSPL II activities. This MEL tool was used in FY2017 to focus on what PMSPL II learned through site visits, assessments, and MEL. USAID/Lebanon seeks to use knowledge gained in future management and/or programing.
PMSPL II collects on a quarterly basis findings and recommendations generated from PMSPL II MEL activities and develops relevant action plans with key persons at USAID/Lebanon. CLA findings and recommendations are mainly generated from field monitoring reports, data quality assessments, evaluations, and project reviews.
During FY2017, the MEL tool was updated to include all FY2016 recommendations and then was shared with USAID. To date, no feedback has been received from USAID and the work is pending further request for action.
In FY2017, under Output 2.2.2 (CLA plan developed), PMSPL II focused on supporting USAID/Lebanon in developing and implementing a CLA action plan as requested by PPL and as described in ADS 201.3.2.16. The ADS outlines the information to include in a CLA plan and describes the processes that missions can use to understand their current CLA practice. As part of this process, PMSPL II held a PMP update meeting with the Program Office to introduce the Mission’s CLA requirements. In parallel, PMSPL II
41 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV initiated the development of a CLA SOO that clarifies the Mission’s CLA priorities/engagement and the PMSPL deliverables in terms of initiating the CLA implementation. The draft SOO for CLA intervention was submitted to USAID. An SOW will follow in FY2018.
PMSPL II also met with the Mission’s new technical officers and Program Office director; discussions were held about introducing CLA into the evaluation process. During a conference call with PMSPL II’s new CLA expert (who was recruited for this purpose), in-depth discussions took place revolving around MEL plans and a means of including CLA in adaptive management.
MISSION CDCS MID-COURSE STOCKTAKING In compliance with the ADS 201 requirements, a CDCS mid-course stocktaking that reviews CDCS validity is to take place every three years. This is a new ADS requirement, and a kickoff meeting with the Program Office was held in the second half of FY2017. The meeting initiated the CDCS mid-course stocktaking process and emphasized PMSPL II’s supporting role working alongside the Mission.
Within the Mission’s CLA interest, the Program Office kicked-off the CDCS midterm stocktaking process, which, as per ADS requirements, aims to do the following:
1. Re-validate the results framework and its underlying assumptions or identify potential amendments to the RF for review with USAID/Washington; 2. Reinforce continuity and institutional knowledge among new staff; 3. Re-engage stakeholders and donor partners and facilitate stronger relationships with and among them; 4. Focus on learning from monitoring data, evaluations, partners, program participants, or other sources of information to guide adaptations; and 5. Look ahead to the next CDCS, including identifying future analytic needs and knowledge gaps.
The process involved stakeholders’ engagement; meetings were scheduled with implementing partners, donors, and UN agencies. Completed responses were received from the Chamber of Commerce, Industry, and Agriculture of Beirut (CCIAB) and the Association of Lebanese Industrialists (ALI), which cover the economic growth sector. The PMSPL II team participated in all the meetings, which ran from May until the end of June.
PMSPL II submitted the CDCS stocktaking report that summarizes the survey and document review findings; the report analyzed the development environment at a macro level along with the stakeholders’ collaboration.
Comments on the report were received from the program officer and one technical officer. The comments were addressed and the report was returned along with a table of PMP indicators showing the actuals and the targets. Furthermore, the Mission submitted an action memo to USAID/Washington and concluded the activity.
As a result of this activity, further CLA initiatives may be launched in FY2018.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 42 SUB-PURPOSE 2.3: INCREASED DEVELOPMENT OUTREACH AND COMMUNICATION ACTIVITIES BY THE MISSION AND IMPLEMENTING MECHANISM As part of Sub-Purpose 2.3, PMSPL II established a DOC position that supports USAID’s DOC Unit in the Program Office and works with the DOC Unit to manage outreach events, develop and package communication materials, and simulate DOC activities by the IM.
Within Output 2.3.1 (Public awareness of USAID assistance and program achievements supported), PMSPL II provides direct support to USAID’s DOC Unit. Specifically, the DOC specialist, in collaboration with USAID DOC, organizes public awareness campaigns and engages the media in creating visibility for USAID activities, including awareness of international days to which USAID is a significant donor (e.g., Water Day). She also compiles program information from the different AORs/CORs.
During FY2017, many tasks were accomplished within the DOC Unit.
FACEBOOK ADMINISTRATOR ACCESS In FY2017, the Mission provided PMSPL II’s DOC specialist with administrator access to the Facebook page. This allows the PMSPL II DOC specialist to upload Facebook posts, to monitor post performance, plus gives the DOC specialist access to viewer statistics of the page. It is worth mentioning that all posts on Facebook that are uploaded by PMSPL II are cleared by the Mission. This is done through a column on the weekly Facebook calendar that specifies status (i.e., approved, not approved, needs update, etc.).
USAID FACEBOOK PAGE / FACEBOOK WEEKLY CALENDAR One of the main communication tools used by the Mission is the USAID/Lebanon Facebook page, as it serves as a platform for posting daily updates and interacting with external audiences. On a weekly basis, the communication specialist at the Mission sends a note to PMSPL II’s DOC specialist, who in turn formulates it into Facebook posts and submits the weekly Facebook calendar accordingly. A Facebook calendar was submitted on a weekly basis to the Mission to populate the page with relevant news and updates.
The posts are classified as follows:
• Recognized days and events: Special posts were customized for national/international events, days, and the back-to-school period. • IM activity posts: One of the main objectives of an FB page is to highlight and promote the key events conducted by the IMs. Hence, the majority of FB posts emphasized IM activities and news. • Themed #Achievements_in_2016 posts: A series of Arabic posts highlighting USAID/Lebanon achievements across different sectors was launched during the first half of January. • U.S. Embassy posts: The Mission requested that customized posts be posted on the U.S. Embassy’s FB page. In FY2017, PMSPL II’s DOC specialist prepared six draft posts to acknowledge women’s day, three of which were posted on the U.S. Embassy’s Facebook page. It is worth mentioning that the U.S. Embassy shared USAID/Lebanon Facebook posts on a regular basis, as the content reflects achievements and accomplishments in the country. • US Ambassador and VIP visits: A series of posts included news that reflected on the Ambassador’s visits or VIP visits.
43 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV • USAID-centric posts: These posts are for work or activities directly funded by USAID and not a particular implementing mechanism, including the UNICEF grant to the educational sector and the Tripoli Film Festival.
FIGURE 12. IM news and events represent the major content for Facebook posts.
• Beneficiary-based posts: A series of posts highlighting achievements made by USAID beneficiaries, including awards won by USP scholars and high sales by an LIVCD partner in the cherry festival in Bhamdoun.
SUCCESS STORIES / PRESS RELEASES / DOCUMENTARY / BRANDING Within Output 2.3.2 (Communication materials for USAID mission developed and packaged), most of the activities this year focused on producing communication materials based on activities conducted by IMs that can be disseminated to the media. The DOC specialist worked closely with IMs to develop “newsworthy” stories that can be promoted on Facebook through paid ads (SI signed a contract with digital marketing agency for a period of three months, and powerful stories were promoted to reach a larger audience).
RURAL TOURISM COMMUNICATION
FIGURE 13. A 60-page rural booklet was delivered by PMSPL II.
A request was received by the LIVCD COR to 1) prepare a Rural Tourism Booklet that would cover all the USAID projects involved in this sector and 2) review the rural tourism fact sheet intended to be distributed in the Rural Tourism Forum.
Rural Tourism Fact Sheet: The Rural Tourism Fact Sheet was reviewed, and comments were
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 44 submitted accordingly. The fact sheet was distributed at the Rural Tourism Forum held in January 2017.
Rural Tourism Booklet: Work on the Rural Tourism Booklet extended over several weeks, as it necessitated collecting data on over 25 projects executed by two IMs, BALADI and LIVCD.
• Prepare a data collection template. The DOC specialist designed a data collection template that requests the main attributes of each project, including title/project name, region, budget, completion date, objectives, and accomplishments.
• Request data from IMs. Upon receiving approval on the data collection form from the Mission, emails were sent to LIVCD and BALADI to share information about their rural tourism projects.
• Compile data. LIVCD and BALADI sent their data with the requested information, and the DOC specialist initiated the compilation process.
• Editing and submission. A 50-page booklet was edited and finalized accordingly and submitted to the Mission in the last week of December.
DOC COORDINATION / MEETINGS Within Output 2.3.3 (Periodic logistic support for USAID DOC Unit provided), the DOC specialist identified the need to define a more strategic method of developing the communication component with USAID.
Coordination meeting with Mission: Two DOC coordination meetings were held in the first half of FY2017. The first coordination meeting took place with PMSPL II’s COR and Mission communication specialist. The purpose of this meeting was to discuss Facebook progress and how to push communication material from the IMs. It was agreed in the meeting that the Mission will share USAID’s communication strategy with the IMs so they can develop a communication activity mechanism.
A second coordination meeting was held at the Mission to discuss progress and streamlining the IM activities, especially on receiving updated content and planning the activities ahead of time.
EVENTS LOGISTICS / PREPARATION (USAID/IM) Within the events logistics/preparation component, the DOC specialist provides support to the IMs/Mission from initial preparation to the execution and follow-up stages. During FY2017, the DOC specialist provided support to both the Mission and IMs and produced the needed communication material as listed below.
Mission: A VIP delegation from USAID came to Lebanon to inspect some of the projects carried out by the IMs. The DOC specialist was present during their field visit to the water pump station in Jeita to take photographs. These photos were sent to the communication specialist and posted on Facebook the same day. IM Capital: The DOC specialist attended the IM Capital Confideo Venture Mentoring Program launch and took pictures of the event, sending selected photos to the USAID communication specialist. That same night a Facebook post of the event appeared.
LIVCD Rural Tourism Forum: The DOC specialist reviewed the LIVCD Arabic press release and
45 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV updated the Mission on the required modifications and suggestions. The DOC specialist attended the LIVCD Rural Tourism Forum held at Le Royal Hotel, collecting photos and updating the Facebook post accordingly.
FIGURE 14. PMSPL II suggested a testimonial from the son of a female beneficiary in the LRI project.
LRI Women’s Day event: The DOC specialist reviewed the communication material prepared by LRI and provided feedback. The DOC specialist also attended the LRI Women’s Day event, collected photos, sent materials to the USAID communication specialist on the same night of the corresponding Facebook post, and reviewed the press release. In addition, PMSPL II suggested to LRI the inclusion of a male beneficiary to highlight the importance of women’s role. The suggestion corresponds to the fact that gender issues and women’s empowerment extend to men and women alike. The suggestion was adopted by LRI, and the son of one of their beneficiaries wrote a poem that was very well received during the event.
IM Capital Seeders graduation event: Support was provided to IM Capital in the preliminary preparation of the IM Capital Seeders graduation event. It included an in-depth review of the media list and requests to remove media that should not be included.
Recruitment of video production house and graphic designer: Support was provided to the Mission for recruiting a production house and a graphic designer for the USAID poster. Refer to Output 2.3.3 (Periodic logistical support for USAID DOC Unit provided) below.
USAID VIDEO As part of Sub-Purpose 2.3 and within Output 2.3.3 (Periodic logistical support for USAID DOC Unit provided), a request was made by the Mission to prepare a short video on USAID achievements in Lebanon. The request also included a section that requires booking services in media outlets (online and TV). In FY217, an expression of interest was announced and 17 bidders were shortlisted. The approved RFP was shared with the selected list of offerors. PMSPL II selected a production firm towards the end of FY2017 to start working on the video in Q1 FY2018.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 46 GRAPHIC DESIGNER During the end of FY2017, PMSPL II received a request for graphic design services—specifically, the preparation of posters and a roll-up banner to be placed in USAID/Lebanon offices. An RFP was prepared and shared with the Mission. After receiving clearance, the announcement was made and 22 applications were received. After reviewing all the applications, five were shortlisted and a comparison matrix was designed accordingly.
It is anticipated that the graphic designer will be selected in Q1 FY2018 and the work will commence thereafter.
TRAINING / COACHING Finally, within this sub-purpose and pertaining to Output 2.3.4 (Program information dissemination and development outreach know-how provided) the following was accomplished by the DOC specialist:
• Attending and participating in a DOC training at the Mission conducted for the new DOC specialists at LIVCD, LIFE, and LWP.
• Contacting digital marketing firms for training on developing relevant content for Facebook pages. This was not pursued further by the Mission and will be considered in FY2018.
REPORTING Finally, the DOC specialist submits, on a regular basis, different types of reports to the communication specialist at the Mission. The reports submitted in FY2017 included the following:
• Weekly media coverage report: The DOC specialist submits on a weekly basis to the communication specialist at the Mission a report that includes any media coverage for IM or Mission events. The weekly report lists the media coverage including the main points covered in each piece of news. • Monthly media coverage report: A monthly media coverage report is submitted on a rolling basis. It presents statistics on coverage by type and by IM. • Nine-month media report: A report that highlights the total amount of coverage attained over nine months, the IM with the highest coverage, the news with the most coverage, and the most popular type of news.
• USAID communication survey: Based on an email received from the communication specialist, the DOC specialist provided support in the responses sent by USAID headquarters (HQ) on the communication and media activities of the Mission in Lebanon. • Best-performing FB posts: This quarter, the DOC specialist was given administrator access to the USAID/Lebanon page. A request was made on the best-performing posts. A report that included the post date, title, link, reach, reactions/likes, and shares was generated by the DOC specialist, highlighting the following:
o The three best-performing organic posts o The three best-performing paid posts
MISCELLANEOUS ACTIVITIES PMSPL II encourages team members to attend third-party events to stay abreast of developments and
47 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV progress in the development sector that would bring new ideas and benefit to the quality of work produced by the team.
Accordingly, the DOC specialist attended the following two events in FY2017:
• The launch of the first Lebanese Evaluation Society (LebEval) launch event. The launching conference included an MP as a keynote speaker and covered presentations on: 1) Elements of a National Evaluation system in the Sustainable Development Goals era, 2) Evaluation in Lebanon: A myth, utopia or the road to future? as well as 3) a National Evaluation Policies and System in Lebanon from a gender and equity lens roundtable.
• Press conference invitation. Launching the “Municipalities under the Spotlight” campaign. The conference focused on the importance of transparency and accountability at the municipal level. During the conference, the campaign organizers launched a website that allows municipalities to upload their financial documents and statements. The website is limited to medium-sized and large municipalities; it does not yet cater to small municipalities that do not have the resources to produce such documents.
SUB-PURPOSE 2.4: SPECIAL STUDIES, ASSESSMENT, AND ADDITIONAL MEL REQUESTS COMPLETED BY PMSPL II Sub-Purpose 2.4 (Special Studies, Assessment, and Additional MEL Requests Completed by PMSPL II) emphasizes PMSPL II support for decision making at the Mission on development issues of growing importance in Lebanese society.
Within this sub-purpose and pertaining to Output 2.4.1 (Mission’s decision-making process facilitated), PMSPL II meets with USAID or is assigned tasks by it that identify special studies or assessments for which technical assistance is needed. The contract agreement indicates the preparation of annual and periodic analyses and assessments that examine the effectiveness of USAID’s projects relative to the stated DOs and the development hypothesis. PMSPL II anticipates two or three such assignments each year, although ad hoc needs may arise.
PERFORMANCE SUMMARY REVIEW BALADI – RMF AND CL This assignment was the first conducted and completed in FY2017 based on a request from USAID to submit a performance summary review for the BALADI program. The purpose of the report is to summarize BALADI (RMF and CL) performance for the last year or year and a half and assess performance of their activities. The information was based on the site visits that PMSPL II team conducted: A&E, DV, DQA, other site visits…). PMSPL II finalized the report and submitted it in November of 2016.
EDUCATION GENDER ANALYSIS The Education Gender Analysis was initiated in the fourth quarter of FY2016 at the request of the Mission to assess the impact of classroom learning from a gender perspective. This request was made as USAID/Lebanon planned to embark on a set of new education activities and a mandatory requirement to design them with a strong gender component.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 48 This analysis is divided into three levels: basic education, higher education, and TVET. Below are the accomplishments for each.
Basic Education Level For the basic education level, PMSPL II conducted the desk review, finalized the inception report, and designed the tools and field guides. Upon receiving approval from MEHE to proceed with the gender analysis the field work commenced.
The primary data collection was conducted by a data collection firm; the data was then uploaded, coded, and analyzed by EnCompass. After reviewing the findings and conclusions developed by EnCompass, a presentation to share findings, conclusions, and recommendations with USAID was prepared and an external consultant was hired to write the report. PMSPL II submitted the report to the Mission at the end of the year. Based on the Mission’s feedback, the report was revised. It was approved and placed on the DEC.
Higher Education Level The work on the higher education level component was initiated with the data collection; the analysis phases were completed and a first draft report was submitted accordingly. After PMSPL II received feedback from the Mission, the report was submitted. Following final reviews, the report was made final and a redacted version was uploaded to the DEC.
TVET Level For the TVET component, the analysis phase included a literature review followed by an inception report. When the inception report was submitted to USAID and approved, the data coding and analysis were conducted. The conclusions and recommendations were presented to USAID. It was followed by the corresponding draft report. Comments were received on the draft report. A final version and a redacted version of the TVET report are to be submitted in FY2018.
LOCAL GOVERNANCE ASSESSMENT During the last part of FY2016, PMSPL II received a request from USAID to conduct an LGA based on an SOO. A meeting was scheduled with the Mission to discuss the purpose and scope of the assessment. Following the meeting, PMSPL II drafted the work plan, which is an annex to the SOW; the execution, field work, and data collection were conducted in early FY2017.
The corresponding report was prepared by the team leader and it was submitted to the Mission. Comments from the Mission on the report were received and shared with the team leader and the local expert for their responses. A revised report, which addressed the comments on the content made by the LGA team at the Mission and which had been restructured to create a better flow of information, was submitted to the Mission. Further comments were made by the Mission, which were addressed in another round of revisions. The final report was resubmitted to the Mission.
PUBLIC-PRIVATE PARTNERSHIP (PPP) OPPORTUNITIES As part of PMSPL II’s efforts to engage the public and private sectors, a meeting was held with the country representative (Lebanon) from DRI. DRI is providing a legal research assistant for the Parliamentary Subcommittee on Decentralization. The meeting sought to update PMSPL II information regarding municipalities and unions of municipalities. DRI has conducted a survey of 66% of the unions of municipalities to gather information on their needs, including for local policing, solid waste management,
49 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV and other topics. PMSPL II offered GIS support to the project in exchange for the data. (Refer to Sub- Purpose 1.5.)
These data would support municipal selection for the forthcoming CDP. Potential cooperation discussions are anticipated in Q1 FY2018.
DRI has been itself researching the new public-private partnership law as it pertains to use by municipalities to improve service delivery (primarily utilities). PMSPL II has begun its own research into the new PPP law for a similar purpose, as it may facilitate engagement with municipalities under CDP.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 50 PURPOSE III: USAID’S ARCHITECTURE AND ENGINEERING SERVICES ENHANCED
Key Accomplishments • Completed design review for 118 construction projects executed by IMs (BALADI, LWP, and LRI)
• Completed eight PSVs for BALADI construction projects and submitted eight PSV reports
Under this purpose, the PMSPL II team supports USAID oversight and management of engineering and construction activities executed under USAID/Lebanon projects as well as the provision of quality assurance and quality control services for design, tendering, and execution of those activities. This purpose will consist of two sub-purposes that focus on 1) supporting the implementing mechanisms with their engineering design activities, supervision, and management of engineering and construction contracts; 2) informing and reporting to USAID/Lebanon on all issues and challenges that might compromise the completion of the engineering and construction activities; and 3) issuing construction completion certification.
The key staff person for Purpose III is the senior engineer, who provides oversight to the subcontracted local A&E firm. In FY2016, a subcontract agreement was signed with Dar al Handasah Nazih Taleb (DAHNT), which was assigned as the local A&E firm for this component. The A&E subcontractor is issued with Task Orders under an IDIQ subcontract agreement that complement the fulfillment of the sub-purpose outputs listed below. Given the increased work load for the LWP design reviews and site inspections, PMSPL requested and received approval for an additional quality management engineer, who will be recruited next quarter. The new engineer will improve tracking of A&E oversight activities and reporting.
SUB-PURPOSE 3.1: INCREASED SUPPORT PROVIDED FOR IM ENGINEERING DESIGN ACTIVITIES A&E MEETINGS As part of Sub-Purpose 3.1 and in accordance with Output 3.1.1 (Engineering designs, specifications and engineering submissions are reviewed and verified), PMSPL II hosted regular meetings between DAHNT, the senior engineer, DCOP, and COP. This purpose of the meetings was to discuss and resolve how best to report A&E findings to the Mission. The outcome of the meeting and suggestions were shared with the Mission.
In the first half of FY2017, PMSPL II attended two meetings with BALADI CL and RMF to solve issues related to two sites. In both meetings, the USAID AOR and the IMs’ engineers were present, in addition to PMSPL II and DAHNT engineers.
In line with Sub-Purpose 3.1 and within Output 3.1.2 (Quality assurance and quality control are provided on the implementer’s engineering design activities), the senior engineer and the subcontracted A&E firm conducted extensive field oversight, inspections, and verification to support the review of the design activities.
51 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV By the end of FY2017, PMSPL II enhanced its managerial approach to BALADI design reviews. The A&E design review protocol, as it pertains to BALADI projects, called for reports, but direct verbal communication was a more efficient means of resolving simple problems and lack of clarity. It was determined that there should not be more than two cycles of design review reporting for each project. If more than two review reports were raised (indicating underlying problems), then a meeting was called to resolve outstanding issues and to avoid a third round of time-consuming document review. The meetings and informal communication reduce the administrative burden on all stakeholders. Minutes of these meetings, however, need to be documented.
Furthermore, meetings were held with LRI and BALADI to streamline the DR process and clarify findings.
FIGURE 15. The A&E component in FY2017 also included DV for LWP.
LWP infrastructure project designs are complex, and design reviews require a wide range of expertise to provide needed quality assurance. To facilitate efficient design review, it was established that a first step was to confirm that all design documents had been received by DAHNT. Initial meetings with LWP on design review focused on how best to facilitate quality assurance while dealing with the complexities of LWP. As with BALADI projects, the need for open engineer-to-engineer communications was acknowledged. For the implementation phase, PMSPL II proposed that individual site engineers be assigned to each of the five LWP infrastructure activities. DAHNT is to provide these engineers. The site engineers are the focal point for information about the status of the LWP activities. Furthermore, DAHNT was asked to formulate a long-term task order for LWP quality assurance. The purposes of the long-term task order are to reduce administrative burdens and to increase responsiveness needed for field monitoring and design review. These task orders are generic and provide access to the core engineers needed for the LWP monitoring. Meetings between PMSPL II and DAHNT put in place the outlines of these task orders, and DAHNT submitted draft long-term task orders.
Meetings were held with LWP, PMSPL II, DAHNT, and LWP’s construction contractors (LWP deploys multiple construction contractors) to review the DAHNT findings of the first LWP design review. Many issues were resolved or clarified during this meeting, with the construction contractors agreeing to respond with needed additional documentation and analysis.
IM’S ENGINEERING ACTIVITIES In FY2017, PMSPL II engineer and DAHNT reviewed 118 design reviews, 115 for BALADI (RMF and CL), 3 for LWP, and 2 for LRI. Eight site verification visits for BALADI projects were also conducted this
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 52 year (see Annex A for details); the detailed reports submitted to the Mission included updates on the progress of each construction activity under the Mission’s project(s), with challenges and recommendations for resolutions highlighted. Furthermore, these reports include detailed information regarding the contractors compliance with design specifications, quality, safety, and environmental standards.
53 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV MANAGEMENT AND ADMINISTRATIVE ISSUES This section highlights major issues under contract and administration as well as general project administration.
CONTRACT ADMINISTRATION ELEMENTS On October 1, 2015, SI was awarded a new five-year contract, PMSPL II. Under this contract, the SI team continues to provide performance MEL of USAID activities and projects in Lebanon, in addition to providing oversight for A&E services. PMSPL II also assists USAID/Lebanon with the day-to-day information needed to make management decisions and provides field-monitoring support to USAID/Lebanon staff, especially for activities located outside Beirut.
Contract administration elements include human resources, procurement, financial reporting, security, and general operations. These functions are the responsibility of the Lebanon-based project accountant and the operations manager. Oversight and guidance on local project administration are provided by COP and DCOP. PMSPL II’s oversight and guidance are conducted by SI’s executive vice president for programs, the project management unit (PMU), the project manager, and the project assistant, all located in Arlington, Virginia. Together, the local and home-based staff ensure compliance with USAID regulations.
Contract Modification 6 was approved this quarter. Modification 6 realigned the budget, added a second driver, and added a second engineer under the A&E component.
During this year the following was achieved:
• FY2017 work plan submitted • Annual Report submitted • QI, Q2, Q3 FY2017 quarterly reports submitted • Local and international consultants for the following were recruited:
o the Local Governance Assessment o education sector gender analysis o D-RASATI II final evaluation o PAD for a proposed new project o project design expert for the LDP PAD o team leader for QITABI midterm evaluation o local consultant education specialist for QITABI midterm evaluation o local consultants for the EGA • Timely and accurate monthly invoices submitted
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 54 LESSONS LEARNED There are several lessons learned and recommendations to highlight. Among the key lessons learned are the following:
• Local specialists in evaluation: The challenge faced in the recruitment of the QITABI evaluation specialist was a lesson learned in qualifications set for recruitment; setting extremely high qualifications limits the number of qualifying applicants. In addition, the extensive experience of the PMSPL II team itself may offset the need for local experts in many sectors. • Scope of Work: Designing the right Scope of Work is critical for the deliverable of any USAID service request, as it underlines the specification of the job, the deliverables, methodology, work plan, expertise, and reporting format. All requests (evaluations, assessments, and special studies) made by USAID should preferably be based on the SOW to ensure successful deliverables for a given service. • Notification of stakeholders: It should be customary for PMSPL II to ask USAID to provide notification to stakeholders involved in a specific service to help facilitate the work carried out. This will help prevent any possible delays that could arise. • Factor in delays with public sector: Based on the evaluations and assessments that involve the public sector, the team should account for delays when dealing with the public sector and allow more time for any research. • Ensure that ministerial (government) approvals are in place before an evaluation is launched: Delays in the QITABI evaluation and the basic education sector gender analysis may have been avoided had approval from the Ministry of Education and Higher Education been in place and confirmed before these two activities were launched. Internal Review Board certification also needs to be in place before an evaluation or assessment is begun. • Larger survey sample with back-up: Based on the Education Gender Analysis, the sample should contain a back-up list of schools to fill in for schools that refuse to participate in the FGDs. • Limit the number of partners/parties in evaluations: Having multiple consultants and partners in for an evaluation creates communication and workflow hindrances and should be reduced to ensure a more streamlined workflow. • Extend field work phases: Field work should be extended to accommodate any delays that are caused by external factors, including religious holidays and summer vacations, as well as the slow workflow in the public sector. • Divide RFP per phases of work to allow for fair competition between bidders: Based on the videography RFP issues, combining the video production with the booking proved to be cumbersome. Since each component pertains to different non-linked phases, in the future two separate RFPs should be issued in one announcement.
• Adopt clear evaluation matrices for recruitment/subcontracting: PMSPL II referred to a very clear evaluation/comparison matrix when reviewing the bids received for the videography services. This matrix proved to be very helpful in grading the submissions and comparing the
55 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV different offers. More importantly, it provided a reference with which to track the progress of the work. It should be used in future assignments, such as the upcoming graphic design request.
• Video posts: Videos that are too long will lose viewers’ interest; most Facebook visitors will watch a video up to one minute in length. Anything longer has to be very interesting or very audience-specific.
• Shorter Facebook posts: Most Facebook visitors check the page via their mobile phones, so the shorter the post, the better. This avoids presenting visitors with the “Read More” option, which many may not click.
• Tagging on Facebook posts: The USAID Facebook posts tags third parties involved in the news—e.g., private sector, IMs, and others—which attracts organic traffic and increases exposure.
• Sponsored FB posts: Sponsored Facebook posts created higher awareness in the online sphere on USAID/Lebanon projects and activities. They are required to create a buzz around impactful achievements and announcements.
• A&E findings communication: Following the challenge faced during one site visit, it was decided not to communicate the findings to IMs in the field, as doing so may result in some misunderstanding. Major findings are to be communicated instantly to USAID only and to IMs in writing. Engineers’ meetings are very helpful for clarifying findings to IMs. • Review only complete construction designs: PMSPL II should not provide design review on preliminary or partially submitted designs. Only completed designs should be reviewed.
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 56 CRITICAL ASSUMPTIONS
CONTEXT FOR ACHIEVING TARGETS AND GOALS OF THE CDCS In general, the status of critical assumptions and causal relationships defined in the RF continue to hold. However, data gathered for the QITABI evaluation showed that the number of Syrian students in public schools increased significantly, even exceeding the number of Lebanese students in some public schools. This may affect the way that QITABI supports public schools in overcoming this pressure without major changes to the related IRs.
In addition, the Government of Lebanon (GOL) initiated the process of budget setting; after 12 years without a renewed approved budget, this process, should it result in adopting a new budget, will have an impact on IM implementation. IMs working in some sectors (especially education and water) may need to assess these effects.
CRITICAL ASSUMPTIONS FOR PMSPL II During FY2017, the following events related to critical assumptions occurred:
• The immediate neighborhood of PMSPL II offices remained calm, with no noticeable changes in security.
• Access to USAID/Lebanon’s Program Office and staff remained excellent throughout the quarter. PMSPL II continued to enjoy a positive relationship with the Mission staff and IMs.
• Following the election of the new president, political tension seems to be lower.
Military operations near Aarsal, Baalbeck, and Akkar did raise tensions in those areas. Progress towards achieving PMSPL II’s performance indicator targets may be constrained should the following critical assumptions prove untrue:
• The operating environment in Lebanon remains sufficiently stable and secure to allow planned PMSPL II activities to proceed.
• The PMSPL II team continues to have access to USAID/Lebanon’s Program Office and Development Objective (DO) teams (A/CORs) for sufficient consultations and guidance to support the implementation of this plan.
None of the PMSPL II critical assumptions has been violated, and work continued as normal.
57 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV ANNEX A: PROGRESS SUMMARY Achieved versus planned progress for the period is disaggregated by gender, geographic area, and other relevant factors (see table below).
FY2017 reporting table.xlsx
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 58 ANNEX B: REPORTS SUBMITTED
TABLE 3. REPORTS SUBMITTED
Q1 FY17 Q2 FY17 Q3 FY17 Q4 FY17
Quarterly Reports Q4 FY2016 QIFY2017 Q2 FY2017 Q3 FY2017
Annual Reports FY2016
PSVs PSV020 LIVCD DV PSV 026: LWP inventory PSV 030: BALADI CL PSV033: LRI DV
PSV022 BALADI CL DV PSV 027: QITABI DV Y2Q2 PSV 031: BALADI RMF PSV 034: QITABI DV
PSV023 BALADI RMF DV PSV 032: LWP DV PSV 029: USP AUB PSV 035: BCAP DV
PSV024 QITABI DV PSV 025: LIVCD grants inventory PSV 028: Scholarships LAU PSV 036: RMF DV
PSV 038: CL DV
A&E PSVs/Design Review DR 028: BALADI RMF quality DR 058: BALADI RMF Douma DR 092: BALADI RMF Kfaryashit DR 120: BALADI RMF (DR) Reports assurance procedure and youth club building; 4th submission solar; 4th submission Hrar Garden templates
DR 030: BALADI RMF Menjez DR 059: BALADI RMF Jezzine DR 093: BALADI RMF Jezzine DR 119: BALADI CL solar energy Park Park; 2nd submission Fatri ecotourism area; 2nd submission
DR 029: BALADI CL Rmeich DR 061: BALADI CL Bab Mareaa DR 094: BALADI RMF Kaitouly DR 121: BALADI CL basketball court power plant chocolate factory; 2nd submission Kawkaba prefab houses; 5th submission
DR 043: BALADI CL Ramlieh DR 063: BALADI CL Baaloul solar DR 095: BALADI CL Qsaibe DR 123: BALADI CL solar energy; 2nd submission farm Garden; 3rd submission Qab Elias Ecotourism; 2nd submission
DR 031: BALADI CL Zawtar DR 064: BALADI CL Kfarmishki DR 091: BALADI RMF Toula DR 124: LWP 1 cultural center solar; 3rd submission community center; 4th submission Upgrading of water facilities in Ghazze, Baaloul, and Barr Elias
DR 034: BALADI CL Khiara Argo DR 057: BALADI RMF Menjez DR 099: BALADI CL Deir Mimas DR 128: BALADI CL food processing solar energy; 2nd submission multipurpose area; 2nd submission Ainata waterproofing
59 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV DR 037: BALADI CL Chiah DR 066: BALADI CL Ramlieh DR 098: BALADI CL Rmeich DR 122: BALADI RMF rehabilitation of football court solar energy; 4th submission basketball court; 5th submission Batloun Bridges
DR 038: BALADI RMF Yahchouch DR 067: BALADI RMF DR 100: BALADI CL Gharb El DR 127: LRI Mhaidthe cultural center; 2nd submission Beshmezzine; solar energy Aala Argo food processing deforestation
DR 040: BALADI RMF Batloun DR 065: BALADI RMF Bcharre DR 102: BALADI CL Majdel Baana DR 126: LRI Maqne Kiosk trails; 3rd submission sports club; 2nd submission rehabilitation
DR 041: BALADI RMF Toula DR 068: BALADI RMF Batloun DR 101: BALADI CL Qab Elias DR 129: BALADI CL community center Kiosk; 2nd submission ecotourism Ainata waterproofing; 2nd submission
DR 042: BALADI CL Kahale old DR 070: BALADI CL Chiah DR 105: BALADI CL Qsaibe DR 125: LWP 2 Bekaa mill; 3rd submission rehabilitation of football court; 2nd garden; 3rd submission Water meters submission
DR 044: BALADI RMF quality DR 071: BALADI CL Baaloul solar DR 106: BALADI CL Jabal El DR 132: BALADI RMF assurance procedure and farm Sheikh sports stadium; 2nd Ehmej cold rooms; 6th templates; 2nd submission submission submission
DR 045: BALADI RMF Bcharre DR 072: BALADI CL Bab Mareaa PSV 008 BALADI RMF Bhanine DR 131: BALADI CL trails; 2nd submission power plant Qab Elias Ecotourism; 3rd submission
DR 047: BALADI CL Rmeich DR 074: BALADI RMF Toula DR 109: BALADI CL Deir Mimas DR 136: BALADI RMF basketball court; 2nd submission community center; 3rd submission multipurpose area; 3rd submission Kaitouly chocolate factory; 4th submission
DR 048: BALADI CL Kawkaba DR 073: BALADI CL Khiara Argi- PSV 009 BALADI RMF Tal Abbas DR 134: BALADI CL prefab houses; 3rd submission food processing; 2nd submission Qsaibe Garden; 5th submission
DR 046: BALADI RMF Maasser El DR 069: BALADI CL Rmeich DR 104: BALADI CL Kawkaba DR 133: BALADI CL Shouf irrigation; 3rd submission basketball court; 3rd submission prefab houses; 4th submission Kawkaba prefab houses; 6th submission
DR 049: BALADI RMF Douma DR 075: BALADI CL Bab Mareaa DR 106: BALADI CL Jabal El DR 130: BALADI CL youth club building; 2nd submission power plant; 2nd submission Sheikh sports stadium; 2nd Araya Garden submission
DR 050: BALADI RMF Fatri DR 079: BALADI RMF DR 107: BALADI RMF Tanourine DR 137: BALADI RMF ecotourism area Beshmezzine solar energy; 2nd recreation area Ehmej cold rooms; 7th submission submission
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 60 DR 051: BALADI RMF Maasser El DR 078: BALADI CL Qsaibe DR 110: BALADI CL Gharb El DR 138: BALADI CL Shouf irrigation; 4th submission retaining wall Aala agri-food processing; 2nd Ainata waterproofing; submission 3rd submission
DR 052: BALADI RMF Maasser El DR 080: BALADI CL Bouhayra DR 108: BALADI RMF Ehmej cold DR 140: BALADI RMF Shouf irrigation; 5th submission activity building rooms; 4th submission Batloun Bridges; 2nd submission
DR 053: BALADI RMF quality DR 081: BALADI CL Khiara agri- DR 113: BALADI CL Bouhayra DR 135: BALADI RMF assurance procedure and food processing; 3rd submission activity building; 2nd submission Jezzine Park; 3rd templates; 3rd submission submission
DR 054: BALADI RMF Toula DR 083: BALADI CL Bab Mareaa PSV 012 BALADI RMF Douma DR 139: BALADI RMF community center power plant; 4th submission Batloun information center; 2nd submission
DR 055: BALADI RMF Douma DR 077: BALADI CL Majdel Baana DR 114: BALADI RMF DR 143: BALADI RMF youth club building; 2nd submission sports club Beshmezzine solar energy; 4th Hrar Garden; 2nd submission submission
DR 056: BALADI CL Ramlieh DR 082: BALADI CL Anjar food DR 115: BALADI RMF Kaitouly DR 141: BALADI RMF solar energy; 3rd submission processing building chocolate factory; 3rd submission Bhanine irrigation; 3rd submission
DR 085: BALADI CL Deir Mimas DR 116: BALADI RMF Douma DR 144: BALADI CL multipurpose area Youth club building; 6th submission Ainata cooling package
DR 086: BALADI CL Chiah DR 117: BALADI RMF Batloun DR 146: BALADI RMF rehabilitation of football court; 3rd Kiosk; 3rd submission Ehmej RW; 7th submission submission
DR 089: BALADI CL Qsaibe PSV 010 BALADI CL Gharb El DR 142: BALADI CL garden; 2nd submission Aala Ainata waterproofing; 4th submission
DR 084: BALADI CL Rmeich PSV 011 BALADI RMF Kfaryashit DR 147: BALADI RMF basketball court; 4th submission Jezzine Park; 4th submission
DR 087: BALADI CL Jabal El DR 148: BALADI RMF Sheikh sports stadium Kaitouly Chocolate factory; 5th submission
DR 090: BALADI CL Baaloul solar DR 145: BALADI CL farm; 3rd submission Qsaibe Garden; 6th submission
61 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV DR 149: BALADI CL
Construction Quality Int. Control Procedures
DR 150: BALADI RMF
Fatri ecotourism area; 3rd submission
DR 152: LWP
Upgrading of water facilities in Ghazze, Baaloul, and Barr Elias
DR 153: BALADI RMF
Douma Youth Club building
DR 151: BALADI RMF
Bhanine irrigation; 4th submission
DR 155: BALADI RMF Batloun information center; 3rd submission
DQAs BALADI CAP DQA LRI
DQA LWP
Evaluations LIVCD midterm D-RASATI final QITABI midterm
Assessments BALADI performance summary Local Governance Assessment Basic Education review Gender Analysis
Special Studies CDCS mid-course Stocktaking
USAID.GOV PMSPL II | ANNUAL REPORT FY2017 | 62 ANNEX C: FINANCIAL REPORT [redacted]
63 | PMSPL II | ANNUAL REPORT, FY2017 USAID.GOV Social Impact
2300 Clarendon Boulevard, Suite 1000 Arlington, VA 22201 USA