EIDHR Endline and Final External Evaluation Consultant

Project Title

Challenging Stereotypes, Providing Services, Convening, and Advocating: A multi-layer approach to promote LGBTQ rights in Lebanon

Donor

European Instrument for Democracy & Human Rights (EIDHR)

Partner

Qorras

Subgrantees

Helem, MOSAIC & Skoun, SEEDS for Legal Initiatives, Marsa

Project Location

Lebanon

Project Duration

January 2020- March 2022

Evaluation to be conducted in

April 2022 – May 2022 (approximately 25 days)

Project Overview

Oxfam seeks an external consultant for an endline study and a final external evaluation of our project Challenging Stereotypes, Providing Services, Convening, and Advocating: A multi-layer approach to promote LGBTQ rights in Lebanon, which is funded by the European Instrument for Democracy & Human Rights (EIDHR).

Issues related to LGBTI are still considered taboo in Lebanon, and limited research has been conducted to fully understand them. Despite a slow positive shift in the situation, data still highlights different forms of societal discrimination against LGBTI individuals. Interviews, testimonies, and community-centered documentation have consistently emphasized that LGBTI individuals go about their lives balancing multiple concerns, including surviving legal situations and familial and social manifestations of violence. The minimal to absent legal shields, combined with social norms and prejudices facilitate the translation of discrimination into acts of violence.  They also compromise the experience of queer individuals in the medical sector, preventing them from seeking the needed or desired medical care.  While sexual health and psychosocial support is provided by some local organizations, these services are largely limited to the capital city of Beirut and are not widely available. This Action has been co-designed by Oxfam (applicant) and Qorras (co-applicant), with the consultation of members of the LGBTI community in Lebanon and selected service providers.

In summary, the Action responds to the aforementioned needs through three main components:

(1)Increase  in  knowledge  (Output 1):  Providing  opportunities  for  members  of  the LGBTI community  to narrate  their  stories  and showcase different  aspects  of  their  lives through  alternative  and impactful approaches to counter misconceptions and myths among the public, and eventually increase the level of awareness among the public. Under this output, the team implemented four interlinked initiatives -namely Queeroutes, Qomics, Tajassod, and Podcasts. These  initiatives  aim at  networking  with LGBTI individuals  from  different  regions  in Lebanon,  generating  information  on  their  everyday  realities,  documenting  cases  of  societal  and  legal discrimination, and translating the results into different forms of creative knowledge including a second cycle of a comics, public installations, maps, interactive events, an information guide, and podcasts. While these initiatives aim to increase the level of knowledge and awareness among the public, they also serve as safe venues for LGBTI individuals to engage with one another and express themselves.

(2) Provision of services (Output 2): For this component, four CSOs (Helem, Marsa, SEEDS for Legal Initiatives, and MOSAIC with Skoun) were selected to receive sub-grants in order to provide legal, health, and Mental Health and Psychosocial Support (MHPSS) services. The services provision component responds to the gaps in services that were identified and seeks to improve access to services.

(3) Advocacy and networking (Output 3): This component aims to bridge between the awareness building and service provision components through the production of evidence-based policy documents and networking events. The policy documents are expected to utilize information on the level of knowledge and health needs as monitored by the team.  The documents will be distributed to the attendees of the networking event, and policy/law makers.

Partner and Sub-grantees

The EIDHR project brings Oxfam together with Qorras. Qorras, being a grassroots local organization, has strong contextual knowledge, wide networks with LGBTI individuals, and a rich background in LGBTI initiatives. In addition, Qorras has a unique expertise in knowledge creation through different forms of creative arts and alternative approaches.

Moreover, each of the four sub-grantees bring in their specific knowledge and expertise to the Action. SEEDS has been working on raising awareness on legal rights in Lebanon, in addition to advocating for necessary legal reforms and providing legal assistance to marginalized groups. Additionally, SEEDS has a long experience in the fight for the rights of LGBTI persons in Lebanon and has been providing legal assistance and counselling to LGBTI persons.

Helem is the first LGBTQIA+ rights organization in the Arab world. Its mission is to lead the struggle for the liberation of LGBITQ+ people and other people with non-conforming sexualities and/or gender identities from all sorts of violations of their individual and collective civil, political, economic, social, and cultural rights.

Marsa has been operating as a sexual health center in Beirut since 2011. Over the span of 9 years Marsa has provided more than 22,000 services that include education, counselling, medical, and psychological consultations. The center caters to everyone however it prioritizes individuals who are particularly affected by stigma and other barriers to sexual health services.

Finally, MOSAIC is a holistic program committed to improve the health and well-being of marginalized and vulnerable groups in Lebanon and beyond. MOSAIC provides specialized and comprehensive services for marginalized groups, research and advocate for policy reform, develop knowledge and capacities on SOGIESC (Sexual Orientation & Gender Identity/Expressions, and Sex Characteristics) issues, and engage the societies in the fight against human rights violations. Skoun is a Lebanese non-profit NGO that helps people with addiction problems claim their lives by providing a non-judgmental and caring environment of client-centred treatment and counselling.

Project Impact and Objectives

Impact: Contributing to the protection and promotion of LGBTI rights in Lebanon

General Objective: Supporting local CSOs organizations to effectively reduce discrimination and promote the fundamental legal, health, and psychosocial rights of LGBTI individuals

Output1: Stereotypes of LGBTI individuals are challenged through different forms of “creative knowledge”

A1.1 Development of a framework to challenge stereotypes and clear misconceptions on LGBTI individuals through “creative knowledge” initiatives

A1.2 Implementation of   knowledge   creation   initiatives   to   increase   awareness   on LGBTI experiences, foster dialogue, and strengthen linkages between individuals

1. Queeroutes establish a relationship between the use of public sphere and LGBTI stories, while highlighting the different roles and forms of discrimination faced by the group
2. Tajassod: This initiative aims to increase the level of knowledge and networking between trans individuals living in different areas in Lebanon.
3. Qomics: This is an initiative that takes the shape of an online series that follows the story of a small number of queer individuals in a city that could be Beirut.
4. Podcast: Qorras  will  identify  specific  themes  that may  be  controversial,  and  require  a  space  for  safe discussions to occur, that result from the research and events and transform them into a series of recorded discussions that will be edited into a series of podcasts

Output2: Access to safe legal, health, and MHPSS services for LGBTI individuals is facilitated

A2.1 Mapping of specific legal, health and MHPSS service provision needs and gaps for LGBTI community at the national level

A2.2 Implementation of sub-granting for service provision

Output3: Rights of LGBTI individuals  are  advocated  for  through  evidence-production  and convening events

A 3.1 Development of advocacy products

A3.2 Convening of a networking event

Purpose of Final External Evaluation

The goal of this external final evaluation is to 1) conduct an endline study which aims at collecting data on documented violations against the rights of LGBTI individuals and how they have changed following the EIDHR project, and 2) to provide an objective analysis of the project’s performance in terms of progress and process, relevance, coherence, effectiveness, efficiency, sustainability, and the extent to which the project is contributing to enabling the desired impact. This includes assessing the outcomes achieved through the implementation of the project activities and verifying to which extent the project’s activities contributed to the protection and promotion of LGBTI rights in Lebanon. The evaluation should also present results, conclusions and document key lessons learnt from project implementation. It should provide clear recommendations that can guide Oxfam for the implementation of future projects.

External Evaluation Objectives

• To conduct an endline study (using but not necessarily limited to quantitative methods) that aims at measuring the degree to which the Action has contributed to the protection and promotion of LGBTI rights in Lebanon. Specifically, the evaluation is required to provide input on the Impact Indicator of the project: “% decrease in the documented violations against the rights of LGBTI individuals”
• To assess the project relevance examining whether the legal, health and Mental Health and Psychosocial Support services provided to LGBTI individuals is consistent with the emerging needs, priorities, and possibilities;
• To evaluate the adequacy and effectiveness of the project implementation, delivery of project outputs and outcomes in comparison to the targets set for the performance indicators in the project MEAL framework; including (but not limited to):
• The impact of the knowledge creation component on challenging/changing the stereotypes around LGBTI individuals
• The degree to which this Action led to an increase in the access to safe legal, health and MHPSS services for LGBTI individuals
• The impact of the policy products and networking event on advocating the rights of LGBTI individuals.
• To assess the design, planning, delivery and management of the project by Oxfam, its partner, and the sub-grantees in accordance with Oxfam Programme Standards;
• To identify and assess key internal and external factors that have contributed to, affected, or impeded the achievements of the project, and how Oxfam, partner and sub-grantees have managed these factors;
• To draw key lessons and learning from the project and make recommendations that will help inform the design of Oxfam’s future projects around LGBTI issues;

Target Audiences

The primary audience and users of the evaluation findings will be Oxfam’s project team, management, technical advisors, partner staff, sub-grantees staff and donor.

External Evaluation Criteria and Key Questions

The following is a guide to the proposed evaluation questions, which must adhere to OECD/DAC criteria for external evaluation.

Relevance:

• To what degree does the project design and intervention respond to the needs of the targeted LGBTI community in Lebanon? Is it still relevant to their needs and priorities given the rapidly changing context (Economic crisis, Beirut blast, Covid19, etc.)?
• Was project design consistent with the Do No Harm principle? and with a Safe Programming approach?
• What was the level and quality of participation of the beneficiaries, the partner and the subgrantees in project design?
• To what extent have the key contextual changes that arose during implementation been influencing and informing project implementation?

Efficiency: Are the partnership and management arrangements functional and conducive to the project objectives being achieved within the project timeframe?

Effectiveness:

• Has the project proceeded well towards the achievement of its outcomes?

• Stereotypes of LGBTI individuals are challenged through different forms of creative knowledge
• Access to safe legal, health and MHPSS services for LGBTI individuals is facilitated
• Rights of LGBTI individuals are advocated for through evidence-production and convening events

• To what extent were the specific objectives and key results achieved?
• What were/are the major factors which influenced the achievement or non-achievement of the objectives and results? To what extent were the strategies and implementation approaches adapted to overcome contextual challenges?

Sustainability: How likely will services and effects be sustained beyond the duration of the project? What evidence is there to suggest the project's interventions and/or results will be sustained after project end?

Impact:

• What evidence is there that the project contributed to the achievement of its overall objective: Contributing to the protection and promotion of LGBTI rights in Lebanon
• Has the project contributed to a decrease in the documented violations against the rights of LGBT individuals? If yes, by how much?

The external evaluation should also draw key lessons and learning from the project and make recommendations that will help inform Oxfam’s formulation and design of future projects targeting the LGBTI community

Methodology:

The evaluation must be conducted in line with evaluation best practices, use quantitative and qualitative data, and draw upon both primary and secondary data collection techniques. The evaluation methodology must make use of existing data from community needs assessment, and other available monitoring and evaluation data that Oxfam’s MEAL team will provide. The methodology should seek the views of the key stakeholders such as:

• Targeted beneficiaries
• The implementing partners: Marsa, SEEDS for Legal Initiatives, Helem, MOSAIC/Skoun
• Co-applicant: Qorras
• Oxfam staff involved in the implementation of the project (ex. PM, coordinators)

The evaluator is expected to develop a detailed methodology that will be reviewed and approved by Oxfam.

Timeframe, Key Activities, and Expected Level of Effort

Timeframe

The evaluation is to be carried out in April and May 2022, with the final report submitted to Oxfam as per the timeline below. The exact dates will be confirmed with the selected consultant(s).

Total expected level of effort: 40 working days

• Review essential documents of the project, including but not limited to the original project proposal, sub-granting applications, interim and final reports, and existing internal and external research reports. Propose endline and evaluation questions based on the review. (8 days, all documents will be shared by Oxfam via the online platform Box);
• Develop a detailed methodology and plan for the endline study (to be endorsed by Oxfam) (1 day);
• Develop a detailed evaluation plan (to be endorsed by Oxfam) (1 day);
• Primary data collection (14 days, a mix of in person and remote);
• Data analysis and preparation of endline study report (6 days);
• Data analysis and preparation of draft evaluation report (6 days);
• Validation workshop (0.5 days);
• Finalize the endline study report and send it to Oxfam (2 days);
• Finalize the final evaluation report and send it to Oxfam (2 days).

Consultant Qualifications

• Demonstrated experience (minimum 5 years) in evaluation of humanitarian and governance-related programs
• Proven track record of producing gender data, learning, and related program recommendations
• Familiarity and/or previous exposure or work in human rights, LGBTI+ rights, gender and sexuality fields
• Excellent skills in research and data collection
• Experience working in the context of Lebanon
• Strong verbal communication skills in Arabic and English and facilitation skills
• Excellent report-writing and presentation skills in English and Arabic
• Inclusive, respectful, and non-discriminatory attitude

Expected Outputs

1. Develop a detailed methodology and plan (to be submitted after the document review but before the data collection - to be endorsed by Oxfam), outlining the proposed methodology including budget, timeline and data collection tools for the endline study;
2. Develop a detailed inception report and evaluation plan (to be submitted after the document review but before the data collection - to be endorsed by Oxfam), outlining the proposed methodology including budget, timeline and data collection tools for the final evaluation;
3. Draft endline report (English), with up to 2 rounds of comments/reviews before validation, to be presented to Oxfam and partners;
4. Draft evaluation report (English), with up to 2 rounds of comments/reviews before validation, to be presented to Oxfam and partners; 
5. Online validation workshop and slide deck (English and Arabic) to present and discuss draft findings with Oxfam, the co-applicant Qorras and the sub-grantees;
6. Final endline report incorporating Oxfam, Qorras and sub-grantees comments.
7. Final evaluation report incorporating Oxfam, Qorras and sub-grantees comments.

Please note that Oxfam will review all outputs and provide comments for the consultant to consider and incorporate. Partner comments must also be taken into account before the final report is submitted and approved.

Instructions for interested consultants

Costs to include in the offer: Consultants should include the following costs in their proposed budget: daily rate, cost of travel (in the case of an international consultant living outside Lebanon), per diems, communication costs, miscellaneous costs (e.g. visa costs, depending on nationality of consultant).

Note that payment will be made based on the budget in the offer (not based on actual expenses incurred by the consultant). No receipts will be requested from the consultant towards the end of the evaluation.

Codes of Behaviour

The evaluation process must adhere to Oxfam’s guidelines for the ethical conduct of evaluations and research. The consultant and team are expected to consider key ethical implications at every stage of the evaluation.

Sharing and Using Findings

Oxfam International’s Policy on Program Evaluation requires Confederation members to act on the commitment to transparency by making public the Executive Summary and a Management Response to all final evaluations.

Disclosure

Although free to discuss with the authorities on anything relevant to the assignment, under the terms of reference, the consultant is not authorized to make any commitments on behalf of Oxfam. All data collected as part of this consultancy belongs to Oxfam and public dissemination of the data and evaluation products can only be done with the written consent of Oxfam.