Masarouna Final Evaluation

         

 

Masarouna Final Evaluation

TERMS OF REFERENCE

 

Oxfam is a global movement of people who are fighting inequality to end poverty and injustice. Across regions, from the local to the global, we work with people to bring change that lasts.

OVERVIEW

Title and brief description of the requirement

Consultant for Masarouna Final Evaluation

Delivery location

Beirut, Lebanon

Contract start date

July 23, 2025

How to apply

Interested candidates are invited to submit:

 

1. CVs of consultants and/or role of each consultant recruited under the scope of this assignment for firms; 
2. A technical proposal which includes a detailed top-line methodology and a workplan for the assignment; 
3. A financial proposal detailing all costs associated with the assignment; 
4. 2-3 samples of similar work done in the past two years; 
5. Registration and official government documents, if applicable. Noting that 8.5% will be deducted from the total amount if not registered. 

 

Deadline for submission of offers

15 July, 2025

Specific considerations

N/A

 

1. BACKGROUND AND CONTEXT

Oxfam has been working in Lebanon since 1993 providing humanitarian assistance to vulnerable people affected by conflict, and promoting economic development, good governance at a local and national level, and women’s rights through Oxfam’s work with partners. Oxfam also works with local partners to contribute to the protection and empowerment of marginalized women and men.  

Between June 2022 and July 2025, Oxfam in Lebanon implemented a Dutch Ministry of Foreign Affairs-funded project titled “Masarouna”. The project aimed  to support young people in achieving more freedom to enjoy their Sexual and Reproductive Health and Rights (SRHR) on the path toward more inclusive societies. The project aimed to improve social justice for young people, empowering them to reclaim civic spaces and speak up for their SRHR to make their societies more inclusive, underpinned by principles of equality and non-discrimination. The project focused on two pathways:  

   

Pathway 1 is focused on influencing with and by young people for their SRHR, direct influencing of decision-makers, service providers and other stakeholders, and challenge harmful traditional social and cultural norms and values, countering misconceptions and misbeliefs by providing accurate and up-to-date information on the importance of SRHR for young people.   

Pathway 2 is focused on strengthening civil society and reclaiming civic space. We worked with young people and supported their inclusion in civil society, built partnerships, and safeguarded and reclaimed space for young people’s voices.   

Rationale

In the context of Masarouna’s final evaluation in Lebanon, the selected evaluation objectives are intentionally streamlined and context-specific, rather than reflecting the full scope of a traditional, comprehensive evaluation. This is due to the fact that Oxfam Novib, as the lead of the Masarouna consortium, is concurrently conducting a full-fledged final evaluation at the consortium level, including Lebanon’s consortium and implementing partners involved. That broader evaluation will encompass the full range of standard evaluation components, including design, outcomes, management, partnerships, value for money, and cross-cutting themes, such as Theory of Change, youth engagement and others. Accordingly, the Lebanon-specific evaluation focuses on key priorities most relevant to the national implementation context, with an emphasis on the effectiveness, relevance, and sustainability of interventions related to youth-led advocacy, SRHR, and civic space. This tailored approach ensures complementarity with the consortium-wide evaluation, avoids duplication of effort, and generates actionable insights specific to the Lebanese context and Oxfam’s partnerships with local actors and informal groups.

2. SPECIFICATION OF WORK REQUIRED

Oxfam is looking to hire a consultant/consultancy firm to conduct a final evaluation on the Masarouna project covering the project implementation period between June 2022 and July 2025. The goal of the final evaluation is to assess design and delivery of Masarouna project and progress made towards the Specific Outcomes and Overall Objective noted above.   Evaluation Objectives

The following table is a guide to the proposed evaluation questions, linked  to the six OECD/DAC criteria for evaluation: 

DAC Criteria

Evaluation Objective

Evaluation Questions

Relevance

Evaluate the relevance design of the Masarouna programme in Lebanon in relation to Oxfam’s original project proposal and the national context for SRHR and civic space.

- To what extent did the project’s design, strategies, and interventions respond to the priorities and needs of young people, CSOs and informal groups in Lebanon?
 - How well did the programme reflect the socio-political and civic space context, including shifts in SRHR policy and youth needs, access to information and digital space, access to funding, policy and regulatory frameworks, CSOs legitimacy and accountability ?

Effectiveness

Evaluate the extent to which Masarouna achieved its intended outcomes in Lebanon, including youth-led advocacy, SRHR promotion, and civic engagement.

- How effective was Masarouna in achieving its intended and unintended positive and negative outcomes?
 - Were there differences in results by gender, region, group type, or strategy (e.g., digital vs. community-based)?
 - What internal and external factors influenced the achievement of results?

Coherence

Evaluate how Oxfam and its partners—including informal groups—coordinated with other actors working on youth and SRHR in Lebanon.

- How did Oxfam and its partners align with other SRHR and youth-focused initiatives?
 - What synergies or tensions emerged with external stakeholders or within the civic ecosystem?
 - Was there internal coherence between Masarouna’s components (advocacy, awareness, capacity building)?

Efficiency

Evaluate the use of financial, human, technical, and relational resources under the project, especially given contextual constraints.

- How efficiently were resources used to achieve results given constraints like currency devaluation, civic space limitations, and security risks?
 - Were the project’s operational and decision-making processes cost-effective and adaptive?

Impact

Evaluate the extent to which Masarouna contributed to long-term changes in SRHR awareness, youth engagement, and advocacy capacities.

- What were the broader effects of the project on SRHR discourse and youth-led structures?
 - Did Masarouna lead to transformative outcomes in civic engagement and feminist organizing?
 - How did beneficiaries and stakeholders perceive the project's long-term contribution?

Sustainability

Evaluate the likelihood that Masarouna’s outcomes will be sustained after project closure and what factors support or hinder this.

- To what extent are the outcomes and changes achieved by the project likely to be sustained?
 - What capacities, partnerships, or institutional practices established are most likely to support continued youth-led advocacy and SRHR efforts?
 - What risks or gaps might undermine sustainability?

 

3. METHODOLOGY 

 

The final evaluation will be conducted using a mixed-methods approach, incorporating both quantitative and qualitative data collection techniques. The methodology should be guided by Oxfam’s feminist MEAL principles[1] and the evaluator is expected to develop and present a detailed methodology for Oxfam’s review and approval during the inception phase. 

 

The evaluation must ensure that data collection processes are safe, inclusive, and context-sensitive, taking into account the civic space limitations, gender and power dynamics, and safeguarding considerations relevant to the Lebanese context.

 

The methodology must make use of existing monitoring and evaluation data generated throughout the Masarouna project, including (but not limited to):

 

• Outcome harvesting data
• Capacity Assessment Tool (CATool) results
• Informal group profiles and activity documentation
• Baseline and Midterm Review insights
• Learning workshop brief

 

In addition, qualitative data collection should be conducted including (but not limited to):

 

• Key Informant Interviews (KIIs): Engagement with project stakeholders, including young people, implementing partners, and policymakers.
• Focus Group Discussions (FGDs): Gathering qualitative insights from project beneficiaries and grassroots organizations.

 

The approach must be participatory and feminist, engaging key stakeholders in reflective and inclusive ways, taking into consideration Oxfam’s Feminist MEAL principles throughout the process. This includes:

 

• Youth participants, especially those engaged in advocacy, campaign design, or SRHR work.
• Local partners, sub-grantees and informal youth groups involved in project implementation.
• Oxfam staff (e.g., project manager, MEAL staff, and field team).
• Relevant local actors who collaborated or engaged with Masarouna initiatives.

 

The consultant is expected to provide the following deliverables: 

• An inception report detailing methodological approach and tools to be used 

• Actors’ engagement Workshop’s facilitation tools 

• Cleaned database (qualitative, quantitative) 

• Report with findings and recommendations (including consolidation/synthesis of the results from different sources) 

• Final revised report - number of revisions depend on the quality of the submitted document 

• Power Point Presentation of the findings  

• A fact sheet with main findings and recommendations 

• Validation and actors’ engagement Workshop delivery 

• Workshop report with findings, recommendations, action points and strategic decisions captured throughout the discussions during the event 

  

The final evaluation report (25-30 pages) must be comprised of the following sections: 

• Executive summary 
• Introduction 
• Methodology:  
• How the data was collected, analysed, and validated (design study, sampling, protocols for data collection, criteria for disaggregation) 
• Including challenges and limitations that must be considered to understand and interpret findings 

Key findings: 

• Critical analysis of the collected data through statistical treatment  
• Actionable recommendations emerging from the analysis including: 
• Suggested reflections or adaptations to the Theory of Change or MEAL framework for future projects. 
• Analysis of outcome- and output-level achievements and any unintended results. 
• Emerging learning questions that should inform future advocacy,SRHR work, shrinking civic space and current worldwide budget limitations and cuts. 
• Lessons to inform the design, implementation, and MEAL of similar upcoming projects. 

Annexes:  

• A copy of all tools, surveys and questionnaires used for data collection (qualitative or quantitative) 
• Data sets (original and cleaned) including any field notes 

 

Planned timeline

Activity / Milestone

Outputs or Deliverables

Estimated days

Timeline

Development and validation of methodology and tools

Data collection tools and methodologies

7

July 23, 2025-July 30, 2025

Submission of an inception report

Inception report

2

July 31, 2025- August 2,2025

Consultations/Data collection

Data generation

8

August 4, 2025-August 11, 2025

Data management and sensemaking

Data generation

3

August 12, 2025-August 15, 2025

Substantiation and Validation of preliminary findings and analysis

Validation and sense making

1

August 16, 2025

Development of a fact sheet with main findings and recommendations

Fact sheet

1

August 18, 2025

Validation and actors’ engagement Workshop (Planning & delivery)

Validation workshop

2

August 19, 2025-August 21, 2025

First Draft report write-up

Report draft

3

August 22, 2025-August 25, 2025

Final draft-report submission

Final report

3

August 26, 2025- August 29, 2025

 

4. EXPERIENCE OR PROFILE REQUIREMENTS

The company/ individual(s) should have the following competencies:

Essential

• Prior experience working on research/projects specific to SRHR in sensitive context. 

• A minimum of 5 years of experience in conducting evaluations. 

• Knowledge of gender-sensitive and feminist approaches. 

• Exposure to principles of partnering and local leadership. 

• Excellent communications skills in English, including advanced writing skills. 

• Strong communication and writing skills in Arabic are mandatory. 

• Familiarity with Oxfam’s work or other international NGOs will be an advantage. 

 

5. APPLICATION PROCESS

Submission instructions

Quotations and applications must reach Oxfam no later than 15/07/2025 GMT+3, midnight.

Responses must be submitted in English, electronically to: lebanonprocurement@oxfam.org.uk

The subject of the email should be: [Masarouna Final Evaluation – Proposal Submission + [Name of bidder]]

Any questions, remarks or requests for clarification can be sent up to 7 days before the submission deadline in writing. The (anonymised) questions will be answered to all applicants.

Administrative requirements

To be shortlisted for evaluation against award criteria, the following documents must be submitted with this application:

 

Documents to be submitted

Importance

1

• Supplier Quotation/Proposal (description of the goods/services/works provided as per the specification, including any details of quality, brand and a clear indication of pricing
• CVs of consultants and/or role of each consultant recruited under the scope of this assignment for firms; 
• A technical proposal which includes a detailed methodology and a workplan for the assignment; 
• A financial proposal detailing all costs associated with the assignment; 
• 2-3 samples of similar work done in the past two years; 
• Registration and official government documents, if applicable. Noting that 8.5% will be deducted from the total amount if not registered.  

• All prices must appear in USD, with unit prices, total price and with a breakdown of applicable taxes (specify the VAT rate if applicable)

 

Mandatory

2

Proof of registration: The bidders also must include a copy of their registration at the relevant Chamber of Commerce and / or document showing self-employed tax registration.

Mandatory

3

Evidence of previous work / references

[List of similar publications or any other documents proving similar experience and technical and thematic knowledge]

Mandatory

 

Evaluation and award criteria

 

The quotations will be assessed according to the following criteria and distribution of points:

 

Award Criteria

Max. points

Technical criteria

Capability / competence of bidder to perform the work / service required

Demonstrated expertise and experience in […]

10%

Previous experience with Oxfam

8%

Previous experience with the NGO sector

6%

Positive references/reputation

8%

Knowledge of country, context, languages

8%

 

 

Quality of products/ services and ability to meet requirements

Meeting technical specifications OR Level of understanding of work/service required

10%

Added value of items or services offered (ex. quality, warranty, after-sales support)

10%

Ability to meet delivery dates OR Reliability of plan proposed

10%

 

70%

Ethical and Sustainable criteria

Ethical / Sustainable

Ethical criteria (to be defined)

2%

Sustainability/environmental criteria (suggestions for relevant criteria are available here)

2%

Clearly indicated alignment with Oxfam values

2%

Gender equity and diversity criteria (example: …)

2%

Health & safety criteria (to be defined)

2%

TOTAL:

10%

Financial criteria

Financial offer

Total cost of the offer, all services included (without added tax)

20

TOTAL:

100%

 

Oxfam withholds the right to conduct interviews with one or more potential suppliers before an award decision is made. The purpose of the interview is to seek further clarification on the submitted quotations and learn more about the background and previous experiences of the potential suppliers and their teams.

6. OTHER CONDITIONS

Conditions for participating in the procurement process are detailed in the Terms & Conditions of Bidding

7. CODE OF CONDUCT

Oxfam is committed to integrity in its operations and supply chains and ensuring high ethical standards. Complying with all laws and regulations and ensuring fair competition are fundamental to this commitment. We actively promote these principles and standards, and expect all Oxfam suppliers to demonstrate commitment towards them.

All consultants/applicant are required to agree and adhere to the Oxfam Supplier Code of Conduct, whereas individuals (including consultants) must sign the Oxfam Non Staff Code of Conduct[2]. These Codes of Conduct set out the specific standards and principles in the areas of human and labour rights, environmental impact and anti-corruption that suppliers must follow.

8. ANNEXES

• Conflict of interest declaration form for 3rd parties
• Safeguarding policy

 

[1] https://www.scribd.com/document/813036676/Oxfam-Canada-Feminist-MEAL-Gu…

 

[2] Non-Staff Code of Conduct applies for any self-employed individuals or contracted employees of suppliers who are working on Oxfam sites, or who have access to Oxfam materials, or who may represent Oxfam in any manner but are not part of Oxfam’s legal entity)