External Evaluator For A Youth Project

Terms of reference – Consultancy – Final evaluation of the EU-funded project Empowerment of Syrian refugee youths in Lebanon The EU-funded project Empowerment of Syrian refugee youths in Lebanon started in November 2013 in Beirut, South Lebanon and Bekaa for a period of two years. It is implemented by Amel Association International in partnership with the American Near East Refugee Aid (ANERA), Youth for Development (YFD) and Culture and Science Foundation (CSF). The project aims at contributing to the sustainable empowerment of Syrian refugee youths in Lebanon, specifically through enhancing the professional capacities and life skills of these youths. Each of the aforementioned partners contributed to the attainment of these objectives by implementing different activities based on their area of expertise. Based on its experience in non-formal education and youth empowerment, and in addition to its role in implementing project activities, ANERA was assigned, among other activities, the responsibility of handling the final evaluation of the project. In order to conduct the final project review, ANERA is seeking a consultant to assess the implementation, impact, and sustainability of the project; this review is to be conducted between the beginning of September and 15th of October 2015. The sections below include: Background Review process How to apply     Background Amel: Amel Association International is a non-governmental organization, recognized as a public utility by presidential decree 5832 in 1994. In addition, Amel is a non-profit, non- sectarian organization that supports the most underprivileged populations in Lebanon, through various programs involving health care, psychosocial support, rural development, vocational training, child protection and the promotion of human rights. Amel was founded in 1979 in response to the Israeli invasion of South Lebanon in 1978, which caused the massacre and displacement of the population and affected the infrastructure of the country. Amel achieved a considerable task in the fields of relief and emergency assistance through the coordination of 27 community and health centers, field hospitals, a civil defense team and 30 ambulances. The Association has also initiated several programs, including vocational training, support for people living with disabilities and rural development. Amel has also involved thousands of people in programs related to Human Rights promotion as well as inter-community dialogue.    ANERA: The American Near East Refugee Aid (ANERA) is a non-governmental organization founded in the United States of America in 1968 and registered in Lebanon under decree number 115 in 2007. ANERA is non-political and non- religious and is one of the largest American non-profits working solely in the Middle East for over 45 years. ANERA Lebanon office has been implementing successful projects serving Palestinians, Lebanese, Syrians and other underprivileged populations in the country. Through non-formal education projects, ANERA addresses the educational needs of youth and children, involving vocational training, life-skills training, literacy programs and sports activities. In addition to its educational program, ANERA implements a multi-million dollar in-kind program to provide much needed medicines, medical supplies and relief items to underserved communities all around the country, as well as a wide range of health and hygiene promotion activities. For the purpose of economic development, ANERA works in rural development through agricultural and small-business-development projects. And in times of emergency, ANERA provides basic emergency assistance and support to affected communities.     The project The grant contract of the project Empowerment of Syrian refugee youths in Lebanon was signed between Amel and the delegation of the European Union in Lebanon in February 2013, for an effective start in November 2013. The project was expected to be implemented over a period of 24 months, until the end of October 2015, with a total budget of €1,142,422.02. The project was designed to be implemented in 6 centers as follows: Beirut (3 centers): YFD - Mar Elias Camp, Amel – Chiyah, and Amel – Hay el Sellom South Lebanon (1 center): CSF – Saida Bekaa (2 centers): Amel – Ersal and Amel – El Ain The overall objective of the project is to contribute to the sustainable empowerment of Syrian refugee youths in Lebanon, with the specific objective of enhancing the professional capacities and life skills of Syrian refugee youths in Lebanon. To achieve these objectives, relevant activities were designed and being implemented as follows:   Vocational and technical training for 1500 Syrian refugee youths (micro labor market studies, technical training – IT, languages, employability - vocational training);   Work-related experience for 450 Syrian refugee youths (contact with employers, preparatory session, internships, community services and apprenticeships);   Personal development activities for 1500 Syrian refugee youths (conflict resolution and communication training, "Explore your rights" Human Rights, International Humanitarian Law and refugees' rights information sessions, health awareness sessions, training of trainers, design of tool kits);   Psychosocial support activities for 4250 Syrian refugee youths (recreational, cultural, artistic and sport activities, psycho-social - including psychological - support).   The target group is 4,250 vulnerable Syrian refugee youths (including Palestinian refugees from Syria) between 15 and 30 years old, ensuring that at least 50% of the target group would be female. Other beneficiaries include host communities (i.e. Lebanese and Palestinian youth from communities hosting refugees from Syria).       Review Process The final review process should take place to assess the program’s implementation and results based on the standard evaluation criteria of relevance, effectiveness, efficiency, impact and sustainability. Objectives The review is expected to assess the project performance in its totality and more specifically to: identify if the program was properly designed to meet targeted needs through evaluating and assessing program theory, logic, conceptual components and assumptions assess the progress made towards achieving the project’s specific objective and results based on the log frame and the M&E plan Investigate whether the resources (financial, human, and materials) have been used efficiently and effectively for the well-being of the target community. assess the sustainability of the program, particularly focusing on the partnering approach and the capacity and willingness of Amel and its partners to sustain the program’s achievements   These Evaluation Terms of Reference specify five primary objectives, namely to assess the a) relevance, b) effectiveness, c) efficiency, d) sustainability and e) impact of the project. It is expected that the evaluator will divide these objectives into three broad stages of the project cycle: project design, implementation and management, and achievements.   Methodology The review process will be conducted in a consultative and participatory approach including field visits to project sites, meetings with project beneficiaries and stakeholders. Review methods should be a combination of quantitative and qualitative methods with the relevant project’s stakeholders, partners and beneficiaries. Data collection methods may include but are not limited to secondary data information, general observations, surveys, Key Informant Interviews (KII) with main stakeholders/partners, and focus group discussions (FGD). The consultant is expected to develop the appropriate methodology and tools that would best capture the objectives of the evaluation.   Proposed Methodology   The evaluation will be following but not limited to the below methodologies:   •    Quantitative evaluation targeting youth graduates based on the M&E plan. •    Qualitative evaluation with teachers of the Amel centers, project partners, project manager, teachers, specialists, etc….   Data Collection and Analysis The meetings and the qualitative data collection will be completed by the consultant as a facilitator, and a note taker will be present during the FGDs and the KIIs. For the FGDs and the KIIs, thematic analysis of the data will be completed in order to discern patterns and come up with conclusions that would reflect the views and the perceptions of the participants. The information collected during the FGD will be used to triangulate the quantitative data for a holistic understanding of the evaluation results. For the quantitative data collection, it will be completed in each of the areas by selected data collectors hired by the consultant and supervised by him/her. Appropriate statistical tests will be employed pending the type and measurement scale of the outcomes and independent variables (e.g., continuous, nominal, or ordinal). Data will be analyzed with statistical significance set at 0.05. Responsibility Matrix Role Responsibilities and tasks Consultant ·         Develop and submit the evaluation methodology (sample selection, quantitative & qualitative methodology) ·         Submit evaluation matrix ·         Develop data collection tools ·         Pilot testing of the tools ·         Recruit and train data collectors ·         Recruit and train data entry clerk ·         Supervise and assure the quality of quantitative data collection ·         Conduct in depth data analysis ·         Provide weekly feedback to ANERA team ·         Prepare a power point presentation of the main finding ·         Present finding to staff and partners ·         Draft the Evaluation report ·         Finalize the Evaluation report based on feedback from all stakeholders ·         Submit a 2 pager summary fact sheet (English and Arabic). ANERA ·         Finalize the evaluation ToR ·         Provide feedback on evaluation methodology  and matrix ·         Provide feedback on data collection tools ·         Follow up with the consultant on data collection and analysis ·         Provide feedback on data analysis ·         Provide feedback on final evaluation report Amel Project Manager ·         Logistical support in planning and organizing data collection ·         Feedback into results of the final evaluation   Organization and Logistics The recruited consultant will be in charge of finalizing logistical issues related to the transportation to the different areas where data collection will be completed. As for the location for completing the different meetings (KIIs, FGDs, validation meetings, etc.), it will be in the partners’ offices in the different areas. Deliverables 1.   Evaluation Methodology (including Evaluation Matrix) 2.   Validated and tested data collection tools 3.   Thematic in-depth analysis of qualitative data 4.   Data sets (excel or SPSS formats) 5.   Tabulation of results including descriptive analysis and associations 6.   Final Evaluation report* (see below) 7.   Power Point presentation of the findings 8.   2 pager fact sheet summary (English and Arabic). *Final report of findings containing the following: assessment of the project performance, based on project documents and reports; the main lessons learnt and recommendations for future work. The final report should be logically structured, contain evidence-based findings, conclusions lessons and recommendations and should avoid unnecessary and irrelevant analysis. A draft report should be submitted for review by 8 October, 2015. ANERA will provide comments on the draft report and the consultant will finalize the report in light of these comments, and return to ANERA by 15 October 2015.   Schedule and budget The final review process is expected to take place between the beginning of September and end of October.  Overall budget for the process shall not exceed $8,000.