Transformative Political Identities For Gender Equality In Jordan, Iraq And Lebanon - Final Evaluation

Terms of Reference –Final Evaluation   Lana: Transformative Political Identities for Gender Equality in Jordan, Iraq and Lebanon 1. Background: In partnership with leading civil society organisations and with funding from the Norwegian Ministry of Foreign Affairs, Oxfam GB is implementing a two year project which is part of a longer term five year initiative aimed at bringing about change in the lives of women across Jordan, Iraq and Lebanon. The phase I of the project is intended to address the focal problem identified: “increasing level of women’s disempowerment and lack of participation in social, economic and political spheres” and in particular the first three identified root causes: 1) Perception of women’s role; 2) Power and control and 3) Governance systems. During phase I, the project focuses on building a base of men and women change-makers, from diverse backgrounds, working in their communities to raise awareness of gender roles and women’s political participation thus driving change one individual at a time; and increase women’s political participation by bringing men and women together and empowering them to advocate for increased women’s political participation. The concept of change makers is centred on recruiting women and men who believe in gender equality and equal power relations. They are provided with educational materials and simple messages and in turn they start to change others and recruit more change makers who would carry on the same mission, multiplying the impact of the project. Oxfam believes a combination of factors coalesce to strengthen women’s position to advocate for their rights and play an active role in the development of their countries. This includes strong, cohesive networks that allow a diversity of women to raise their voices collectively; training and mentoring that enable women to increase their skills and confidence to participate in and influence governance systems and processes; will to transform discriminatory attitudes, values and behaviours that subordinate and marginalise women; accountable states able to ensure gender equality; and inclusive civil society organisations that respond to the needs of grassroots communities, with strong links between local and national CSOs.   Oxfam recognises four broad spheres that influence women’s opportunities to participate in decision making including: The personal (a woman’s personal capacity, confidence and context have a strong influence on her capacity to act and be heard); The political (includes participation in public and traditional decision-making structures and processes and access to leaders who can influence change); The social (includes norms and attitudes as upheld by the media or cultural institutions as well as civil society organisations, particularly women’s organisations, which provide women with a platform or strengthen their capacity to have their voices heard) The economic (gendered norms and responsibilities for housework and care work drastically reduce women’s access to paid work and makes them more dependent on men and reduces their capacity to get organised and participate in decision-making structures and processes).   The project adopted the Asia We Can campaign methodology. This approach is based on two interlinked models of change. The first one pertains to the process of attitude-belief-practice change among individuals and is based on the ‘Stages of Change theory’ developed by psychologists Prochaska and DiClemente in 1982 and refined in 1992. 2. PROJECT OUTLINES: Overall Goal (5 years approach): Women and men reject all forms of discrimination that give rise to gender inequality, contributing to a more equal, violence-free and democratic society in the MENA region   Specific Objective (2 years project): Women in targeted communities of Jordan, Lebanon and Iraq enjoy increased participation and decision making within the private and public sphere Result 1: Women and men in targeted communities are mobilized and have improved perceptions of gender equality and women’s political participation Result 2: Change makers and their allies are actively engaged in joint advocacy for increased women’s political participation Result 3: Improved cooperation and capacity of project partners and key stakeholders through joint learning and actions   (Please refer to detailed logframe in annex 1)   Project implementing partners The project will be implemented with 3 partners, one in each country: Arab Renaissance for Democracy and Development-Legal Aid  (Jordan) Women Empowerment Organization (Northern Iraq in Kurdish Territory) ABAAD – Resource Centre for Gender Equality (Lebanon) CFUWI– National Committee for the follow up of Women’s Issues (Lebanon)   Detailed location Iraq: Northern Iraq in Kurdish Territory Jordan: Zarqa governorate and East Amman Lebanon: South (Sidon), Beirut (Beirut), Mount Lebanon (Baabda) and Nabatiye (Natabiye)   Targeted Beneficiaries and targeted groups Direct and indirect beneficiaries as per proposal: Location Direct tier 1 (men and women): Change Makers   Direct tier 2 (men and women): Change Makers Indirect: Men and Women from the communities   Year 1 Year 2 Year 1 Year 2 Year 1 Year 2 Iraq 120 220 240 390 2,480 4,880 Jordan 120 220 240 390 2,480 4,880 Lebanon 120 220 240 390 2,480 4,880 Total per year 360 660 720 1,170 7,440 14,640 Grand total (2 years) 1,020 1,890 22,080   Target groups Target groups will also include sub-national and national authorities, including bar associations, private sector that will be targeted by change makers to influence gender equality on issues of importance for women. Women’s organizations at national level will be targeted to join leading community change makers in collations to build alliances to target policy makers on issues related to enforcing mechanisms to implement endorsed laws and to promote actual implementation of full citizenship. Political parties and youth will be targeted to influence their agenda pertaining women’s rights and full citizenship that are currently influenced by political identities based on tribal, sectarian and confessional interests. 2. Purpose of the Final Evaluation (FE) The FE’s purpose is to enable Oxfam and implementing partners to review project process, evaluate its results, and document lessons learnt in order to guide the development of phase 2. The evaluation shall specifically seek to achieve the following: -          Assess project impact by identifying changes in people’s lives, as compared to beginning of the project and set objectives, outcomes and outputs, and inform project final reporting; -          Highlight project successes and shortcomings (both at theory of change and implementation levels) and identify significant factors that facilitated or impeded the delivery of outputs, outcomes, purpose and overall objective; -          Identify key lessons learnt from the present project, and incorporate them in recommendations for design of future phases, including review of the suggested theory of change. 3. Methodology: The selected evaluator/consultant is anticipated to be as independent as possible and will work with Oxfam team to refine and agree on the final methodology, but it is expected that the latter will include the below components: -          Desk review (of programme design documents i.e. proposal, log-frame, theory of change, baseline study, monitoring data, as well as reports and produced documents/publications); -          Field visits to Lebanon (6 governorates above), Jordan (Zarqa), and North Iraq - Kurdistan including: Meeting with OGB programme staff and partner organisations Survey with a representative sample of project target groups and final beneficiaries Focus group discussions with different groups of project beneficiaries using participatory techniques; Interview with key stakeholders; It is important to note that Oxfam seeks to have a participatory evaluation approach. The task will be very much aiming at participatory review and learning exercise for the project team (Oxfam and partners) and when possible key stakeholders. The evaluation will be based on evidence as per logframe indicators as well as other relevant data and source of information. 4. Suggested Evaluation Questions The evaluation will cover at least the 3 main areas outlined in Oxfam evaluation policy: -          Progress towards a program’s or projects outcomes and impact; -          Oxfam’s contribution and value-added to the programme ; -          The programme cost effectiveness The evaluation is also expected to cover several additional areas in line with the DAC criteria (Relevance, Effectiveness, Efficiency, Impact, and Sustainability)   Suggested evaluation questions will be refined in conjunction with the successful consultant(s).   1.       What significant changes have occurred in women’s lives and to what extent are these likely to be sustained? (impact) What has been the impact of interventions on targeted communities in the three countries in particular in relation to contributing to a more equal, violence-free and democratic society? Are there differences between different groups and locations? How far did the project positively contribute to increasing women’s participation and decision making within the private and public sphere? Are there any unexpected outcomes? What are the project’s shortcomings and their internal/external factors? How far has working with Change makers and their allies had a positive effect on advancing women’s political participation? What indications do we have that the changes that the project has contributed to for increased women’s political participation will last?   How far has greater equity been achieved between women and men and other groups? What was the contribution of Lana to women’s overall empowerment and gender equality in the three countries? Was OGB and partners’ approach in addressing gender effective? Has the approach of involving Change Makers and allies positively impacted gender equality? Did the overall project intervention create or contribute to any adverse effect related to gender equality? How far had the intervention contributed to women and men rejecting all forms of discrimination?   What changes in policies, practices, ideas, beliefs and attitudes have occurred in specific institutions, groups and individuals? Have women and men’s perceptions of gender equality and women’s political participation improved? How far are Change Makers and allies engaged in advocating for women’s political participation? Have attitudes of people in communities changed towards women positively? Has the number of laws in favour of women increased in the targeted countries? Has the project contributed in bringing about any positive change in policies? What are the changes in beliefs, practices, and policies that women perceive in their communities? How far has the project contributed to these changes? What was its added-value?   How effectively and appropriately have those the project seeks to benefit been involved at relevant stages through the process? Have far have women from target communities been involved in the design, implementation, and monitoring of the project? How far have Change Makers, allies and community leaders been involved in the project? How was women’s and other beneficiaries’ feedback sought? Did the intervention suit priorities and policies of people and communities it is intended to benefit? Did the project define specific tools and approaches to enhance participation of beneficiaries and accountability?   How effectively and appropriately have we worked with others and involved them in relevant stages through the process? How far was the engagement of communities, allies and Change Makers effective and enough to support increase in women’s political participation in targeted communities? What other actions the project could have implemented and/or could implement in phase 2 with communities to increase women’s political participation? How and how far were local partners involved in programme management? What were the factors contributing to or impeding partners’ involvement (availability, interest, capacities...)? What have been the benefits of or difficulties with this involvement? What difference did the partnership make to the programme achievements? What has been Oxfam added value to the partnership? How far did the project enhance or contribute in improving cooperation and capacity of project partners and key stakeholders and relations between partner organisations and their constituencies and other CBOs/NGOs/relevant stakeholders?   How effectively and efficiently have our resources been used? How well did partnership and management arrangements work and how did they develop over time? How well did financial systems work? Which strategies have proven to be more effective/influential to achieve the outcomes? What have we done to ensure sustainability of approaches and benefits? What are the prospects of sustainability of benefits, services, and some key activities after the funding stops? What are the recommendations for strengthening sustainability in future project stages? Could the project have allocated resources in a different ways with better outcomes? How cost effective was the project as a whole, and in some particular elements?   To what degree have we learnt from this experience and shared the learning with others and ourselves? What will we now do differently, or what will we do more of? How well were the activities, outputs, outcomes and impact monitored? Which part of the programme MEAL system worked well and what can be improved? Which systems and mechanisms give a clear link between activities, outputs, outcomes and the impact? What are the improvements that can be done? Did the project establish mechanisms for joint learning and experience-sharing? Were learning of the project communicated to partner organisations, beneficiaries, and stakeholders? Did learning contribute in enhancing capacities of staff? How far has the learning been used to improve the quality, outcome and impact of the programme? Was learning from this project used in other projects implemented by partner organisations? What are the main lessons learnt? What are conditions and choices for replication and/or scaling up of this project? 4. Evaluation Process and Timeline: The consultancy is expected to take place between September 2015 and November 2015. Please note that reviews will be made on a rolling basis and appointment may be done before deadline. Time-frame will be flexible based on availability and proposed methodology. Action By when Who Submission of applications to Oxfam 21 July 2015 Oxfam Review of applications; short-listing; appointment 24 August 2015 Oxfam Expected start date 1 September 2015 Consultant Review of key documents and Interview with key informants for elaboration of methodology 7 September 2015 Consultant Agreement on evaluation plan and methodology 21 September 2015 Oxfam, partners, and consultant Conducting FE 22 Sept - 12 Oct 2015 Consultant Submission of first draft of FE report 26 October 2015 Consultant Comments and feedback on draft 9 November 2015 Oxfam and Partners Submission of final report 16 November 2015 Consultant       5. Outputs: Expected outputs include: -          An agreed evaluation plan and methodology -          A presentation of initial evaluation findings/first draft for discussion with Oxfam and partners -          A draft report of the evaluation: The Consultant is responsible for submitting a draft report (electronic copy) within 10 days after completion of the evaluation. The feedback will be provided within one (1) week after the submission of the draft report -          Full final evaluation report, of approximately 30 pages, of publishable quality with a stand-alone executive summary of no more than 4 pages. The final report will be produced in one week (7 days) following date of submission of comments. It will include changes/modifications, agreed between Oxfam and the consultant. Main report sections are as follows (Details of the report outlines will be shared and discussed with the Supervisor upon contracting): Executive Summary Introduction Evaluation Findings/answered questions Conclusion and lessons Learned Recommendations The report shall systematically answer the key questions asked, fairly and clearly represent views of different actors/ stakeholders, and give the clear conclusions substantiated by the available evidence. In addition, the final report should contain the following annexes, as well as any other relevant material: Initial and final Terms of Reference for the evaluation Itinerary and final timetable List of events attended List of persons interviewed List of documents reviewed Summary of field visit Workshop presentation of findings 6. Governance and management of the evaluation: The Consultant will directly report to the Lana Project Manager The Consultant will work closely and in consultation with Oxfam and partners project team in each country. 7. Budget: The budget for this task is approximately 25,000 USD including all type of expenses (travel, per-diem, transportation, calls, etc.). Payment will be done in two instalments: 25% upon contract signature and 75% upon approval of the final report by Oxfam. 8. Skills and Competence: Oxfam is looking for a consultant or a team of consultants with strong record in conducting evaluations for Gender Equality programmes. Specific skills and competencies we seek include: -          Demonstrable experience of producing high-quality, credible evaluations (samples required) -          Familiarity with different methodologies for evaluation, and the additional factors involved in advocacy evaluation -          Demonstrable experience of working with/evaluating NGO work -          Proven experience of gender issues within M&E; -          Familiarity with issues related to gender equality and legal protection; -          Knowledge of gender, women's rights and theory of change; -          Excellent writing and verbal communication skills in English. Arabic skills are an asset; -          Ability to write concise, readable and analytical reports and understanding of public communications -          Knowledge of issues related to CEDAW, Personal Status and Family laws across the region is an asset.  (Annex 1= Project Logframe)   Intervention Logic Objectively verifiable indicators Means of verification Important assumptions Overall Goal – 5 year approach Women and men reject all forms of discrimination that give rise to gender inequality, contributing to a more equal, violence-free and democratic society in the MENA region   Evidence of improvements to the implementation of CEDAW in Lebanon, Jordan and Iraq   Key NGOs, women’s organisations and academics in Lebanon, Jordan and Iraq report increased activity and impact of social movements rejecting all forms of discrimination against women   Change in ranking of target countries in human rights, particularly women’s rights, and democracy indices   Portfolio of evidence comprising National and Shadow CEDAW Reports, feedback from CEDAW committee, press releases   Interviews with key NGOs and academics at baseline and final evaluation       Annual reports and indices for Arab states for democracy and human rights watchdogs   Specific Objectives Women in targeted communities of Jordan, Lebanon and Iraq enjoy increased participation and decision making within the private and public sphere     Improved perception of women in targeted communities of their role and participation in decision making by EoP Number of cases that highlight decision-makers and opinion-formers taking an open progressive stand on women’s rights and full citizenship at local and national level by EoP; By EoP, percentage of Change Makers who can:   -          Report increased and positive engagement with women’s participation in the public and private sphere -          Report actions to promote gender equality and women’s participation and leadership in each targeted community;     Mid-term review and Focus Group Discussions   Portfolio of evidence comprising opinion polls, media coverage, case studies       Survey with a representative sample of change makers based on unified template   Both security and political situation in target communities and countries does not deteriorate  Governments are responsive to claims for protecting and advancing women’s rights   There are no major natural and/or manmade disasters in the targeted countries   Newly elected governments and political parties are responsive and willing to engage with existing CSOs, including human and women’s rights organizations   Results Result 1: Women and men in targeted communities are mobilised and have improved perceptions of gender equality and women’s political participation             Percentage of targeted men and women change makers  who  demonstrate positive changes in their perception of gender roles and report actions promoting  women’s participation by EoP compared to baseline;   Percentage of women and men (not change makers) in  targeted communities who respond positively on issues related to women’s political participation by EoP against the baseline; Survey with a representative sample of change makers based on unified template     Mid-term report and endline survey         The reputation and credibility of the project partners in the communities where these work remain the same Willingness of women and men in the communities to partake in the process of change Religious/tribal leaders are receptive to programme focus and approach and allow women to engage/participate in the programme     Result 2: Change makers and their allies are actively engaged in joint advocacy for increased women’s political participation   Number of joint statements or advocacy initiatives undertaken by the fora at national level compared with advocacy strategy developed by EoP; Level of satisfaction of fora’s members in relation to agreed criteria (e.g. effectiveness and representation, women’s leadership, women’s organisations) by EoP   Number of targeted opinion formers and decision makers who show improvement in their perception of women’s political participation by EoP;     Advocacy strategy and Portfolio of comprising case studies, media coverage, record of joint statements etc   Member feedback,  interviews with active members using satisfaction scoring (midterm and endline)   Opinion formers perception questionnaire adapted for women's rights (List of targets from partners)/Baseline and Endline       Governance systems are in place and functioning e.g. parliament, ministries etc         Result 3: Improved cooperation and capacity of project partners and key stakeholders through joint learning and actions   Evidence of significant, positive changes  (against  the baseline)in the strategies and/or practices of partners and targeted key stakeholders based on regional learning by EoP, with emphasis on women’s organisations, coalitions and networks:   Number of joint regional actions on women’s political participation undertaken by partners and alliance members, with emphasis on women’s organisations, coalitions and networks by EoP Interviews with partners and targeted stakeholders Review of ToR and report from exposure visits         Portfolio of evidence comprising record of joint regional statements policy papers, newsletter, website Governance systems are in place and functioning e.g. parliament, ministries etc The newly enforced laws do not hinder and/or undermine the role of CSOs in the governance systems Women’s rights agenda remain high on the national and international levels Women’s right organizations and their allies are willing to come together around one cause Negative attitudes towards foreign funded CSOs do not dominate the public space Activities Inception Phase:       Recruitment of key project  staff       Regional Programme Inception Workshop       Country Inception workshops       Conduct baseline (Jordan, Iraq, Lebanon)       Publication the outcomes of the baseline and fact sheets for each country       Power mapping and analysis in each of the target countries       Capacity needs assessment of partners               Result 1: Women and men in targeted communities are mobilised and have changed their perceptions of gender roles and women’s full citizenship.       1.1.   Technical training  of partners and allies as per capacity-needs assessment and change-makers approach from South Asia at the regional training       1.2.   Community mobilization/consultations – awareness raising on the programme and approach (community consultations)       1.3.   Recruitment and training of change makers (ideally 50% men and 50% women)       1.4.   Develop and implement  annual action plan and agree on priories (including minimum standards on gender equality within the groups/alliance members etc)       1.14    Training of  1,890  tier 2change makers and educating over 22,000 men and women on women full citizenship and gender roles       1.15.       Learning and mentoring support for change makers       1.16.       Visibility and outreach of change makers’ experiences       1.17.       Annual event - Change maker of the Year at the regional level               Result 2: Change makers and their allies are actively engaged in joint advocacy for increased women’s political participation       2.1.         Formation an apex fora of change makers and alliance members , including prominent activists       2.2.         Defining the mandate and the vision of the fora, modus operandi and governance structure       2.3.         Tendering the research on gender       2.4.         Develop strategies around an issue affecting women’s full participation in public and private sphere       2.5.         Organized campaigns around gender roles, women’s rights and citizenship rights               Result 3: Improved cooperation and capacity of project partners and key stakeholders through joint learning and actions       3.1.       Annual Project reviews – 2       3.2.      Exposure visits – cross countries       3.3.      Joint regional actions – partners, alliance members and change makers               MEAL       Development of MEAL plan       Internal midterm review and learning review meeting       Final  evaluation       Audit – annual       End line survey           9. Applications: Applicants with the experience and skills described above are invited to submit the below: A CV for each consultant; A one-page cover letter introducing the applicant(s) experience and how the skills and competencies described above are met, with concrete examples. Please also use this cover letter to indicate applicant’s availability; An outline of no more than 2 pages of the proposed process including methodology and arrangements; A one-page budget covering all major anticipated costs; One example of a previous similar task. Applications should be submitted to lebanonjobs@oxfam.org.uk by 21 July 2015 with Final evaluation – Lana in the subject line.   Please note that reviews will be made on a rolling basis and appointment may be done before deadline. Oxfam encourages consultant teams to apply for the simultaneously advertised Lana Endline consultancy. Oxfam reserves the right to pick the same consultant for both assignments.