Final Evaluation of the Shabake Project

The Shabake final evaluation will be a systematic and objective assessment of the project, its design, implementation and results. The aim is to determine the relevance and fulfilment of objectives, efficiency, effectiveness, impact, and sustainability. The evaluation should provide information that is credible and useful, enabling the incorporation of lessons learned into the decision-making process of both EF and its partner organizations, AFD, and other donors.

Principles underpinning the approach in each of the above-mentioned task are:

1. Impartiality and independence of the evaluation process from the programming and implementation functions.
2. Credibility of the evaluation, through use of appropriately skilled and independent experts and the transparency of the evaluation process, including wide dissemination of results.
3. Participation of stakeholders, including end-beneficiaries, in the evaluation process, to ensure different perspectives and views are considered.
4. Usefulness of the evaluation findings and recommendations, through timely presentation of relevant, clear and concise information to decision makers.

SPECIFIC OBJECTIVES:

The following output indicators are to be evaluated:

Under component 1:

1. 1. Percentage of NGO staff at each organization reporting that their organizational and technical capacities have improved as a result of the capacity building component.

Evaluation SO1: Capturing partner NGOs perceptions on the extent of the benefit of the capacity building actions to their organization.

Under Component 2:

2.1. Number of NGOs that have successfully achieved the targets set out in their VRPs.

2.2. Percent of newly developed policies or procedures that were utilized in each vulnerability reduction project.

2.3. Percentage of NGO staff reporting being more equipped to deliver quality services as a result of the capacity building received.

Evaluation SO2: Assessing the partners progress towards target on their VRPs and the quality of implementation.

Evaluation SO3: Assessing the partners ability to introduce and mainstream improvements to their organizations and to their VRPs as a result of component 1.

Evaluation SO4: Assessing the partners NGO staff’s benefit and ability to deliver better services under the VRP as a result of the skills gained through the capacity building actions.

Under Component 3:

3.1: Number of partner NGOs demonstrating active participation in national coordination platforms and working groups.

3.2: Number of partnerships agreed with international donors as a result of the networking activities.

3.3: Number of donors and INGOs that have adopted the multi-donor framework towards localization and capacity building.

Evaluation SO5: Assessing the partners participation in national coordination platforms and their contribution to relevant working groups/task force meetings as a result of the intervention.

Evaluation SO6: Assessing new partnerships created as a result of the Shabake localization activities.

Evaluation SO7: Assessing donors and iNGOs status regarding the multi-donor framework towards localization and capacity building.

Under Component 4:

4.1. Number of businesses benefiting from economic recovery projects reporting restoration of income flow/income security.

4.2. Number of income-generating activities supported in target locations.

4.3. Number of affected persons reporting improved access to livelihood opportunities in target locations.

4.4. Number of women reporting improved access to livelihood opportunities in target locations.

Evaluation SO8: Assessing the 6 new partner NGOs progress against indicators under this component and the quality of their implementation.

Research Questions:

Under Component 1:

• What are the partner NGOs’ perceptions on the extent of the benefit of the capacity building actions to their organization? (Relevant to all 12 partners)
• What are the partner NGOs levels of improvement in their ability to assess their strengths and weaknesses? (Relevant to the original 6 partners only)
• What are the partner NGOs perceptions on the overall self-assessment process and their experience with the consultants? (Relevant to the original 6 partners only)
• What are the partner NGOs perceptions on the extent of the benefit of the capacity building support? (Relevant to all 12 partners)
• What are the partner NGOs perceptions on the extent of the benefit of the equipment purchases in improving their operations? (Relevant to the original 6 partners only)

Under Component 2: (Strictly related to the original 6 partners only)

• Are the partner NGOs reaching the quantitative targets of their VRPs while adhering to the best quality of implementation?
• Are the partner NGOs introducing and mainstreaming improvements throughout their organization and in their VRPs, as a result of the capacity building action plan and the technical support from EF?
• Are the partner NGO staff able to deliver better quality of services in the VRPs as a result of the skills and knowledge they gained through the capacity building actions?

Under Component 3: (Relevant to all 12 partners)

• Are the partner NGOs participating in national coordination platforms?
• Are the partner NGOs contributing to national working groups and national task force meetings?
• Were there any new partnerships with donors created as a result of the Shabake localization activities?
• Were there any donors or iNGOs who adopted the multi-donor framework towards localization and capacity building?

Under Component 4: (Relevant to the 6 new partner NGOs only)

• What progress do the 6 new partner NGOs report under this component?
• What could be done better?

General research questions: (Relevant to all 12 partners)

• What is the perception of the NGO partners on the quality of the partnership with EF within the Shabake project thus far?
• How do the NGO partners perceive the flexibility and adaptability of the Shabake project especially in light of the multiple crises that affected Lebanon in 2020?
• What could be done better to improve the overall impact of the Shabake project?

In addition to the above-mentioned research questions, the following topics and outcome indicators are to be assessed as well: (Relevant to all 12 partners)

• Cost-effectiveness of the project.
• Percentage of local NGO staff reporting improved contribution to national coordination platforms for crisis prevention and management.
• Percentage of local NGO staff reporting that their organization has become better integrated into the aid ecosystem.
• Percent of beneficiaries targeted by partner NGOs reporting that the services offered to them responded to their needs.