CALL FOR PROPOSAL
International and National
TERMS OF REFERENCE FOR THE FINAL EVALUATION
Project : HAMORIS (Hamenus Mortalidade no Risku ba Inan Sira)
Position Title : Final Evaluation Consultant
Duration : 20 days
Place of Assignment : Dili, Timor-Leste
Reporting to : Alison Darcy (Assistant Country Director – Programs)
Project Duration : FY17/18 – FY20/22
Donor : DFAT (Australian Department of Foreign Affairs and Trade)
Expected Start Date : End of February 2022
Completion Date : Mid May 2022
A. Background
CARE International is a worldwide humanitarian and development organization fighting global poverty, with a special focus on working with women and girls to bring lasting change to their communities. As a non-religious and non-political organization, CARE works with communities to help overcome poverty by supporting development projects and providing emergency relief. We know that supporting women and girls is one of the most effective ways to create sustainable development outcomes.
CARE Australia is a member of the CARE International Confederation. We strive for a world of hope, inclusion and social justice, where poverty has been overcome and people live in dignity and security.
2. CARE International in Timor-Leste:
CARE International in Timor-Leste’s (CITL) 15-year Long-Term Program, ‘Women and girls in Rural Disadvantaged Areas’, seeks to address underlying causes of poverty through direct programming, partnerships (with civil society, government and private sector) and advocacy, in the following key areas:
- Improving women’s sexual, reproductive and maternal health, and rights, including access to supervised delivery and family planning.
- Improving women’s economic empowerment, including skills, linkages to markets and services, and ability to withstand shocks.
- Improving quality and access to education, with a particular focus on supporting girls’ decision-making and leadership.
- Strengthening women’s voice, meaning enhancing women’s decision-making and leadership role within families, communities, institutions and the wider society and addressing gender-based violence.
The HAMORIS project aligns with key area 1 of the Long-Term Program: Sexual, Reproductive and Maternal Health (SRMH).
B. Project
The HAMORIS project builds on the previous ANCP Safe Motherhood Project (2015 – 2017) with an overall goal to reduce maternal mortality and morbidity. The project focuses on increasing demand for quality maternal health services in 44 aldeias (hamlets) in 10 sucos (villages), 7 sucu (villages) in Covalima Municipality and 3 sucu (villages) in Ermera, Timor-Leste. The project follows the Mother Support Groups (MSG) model to engage women, provide information and raise awareness, and facilitate change to harmful beliefs and practices through CARE’s Social Analysis and Action (SAA) process. Engaging men and boys is a critical component of CARE’s gender equality strategy, and this project engages men through establishing Father Support Groups (FSG), that have a similar focus as the MSGs. The project also continues to refine an inclusive governance approach, (i.e. CARE’s Community Score Card (CSC)), that complements the SAA process, and empowers service users and service providers to address service quality issues in maternal health.
C. Project goal
CITL’s HAMORIS project contributes to lasting reductions in maternal mortality and morbidity by increasing the number of women in targeted communities utilizing appropriate and quality maternal health services.
Project outcomes
The outcome of the HAMORIS project are:
- Increased access and utilization of quality SRMH services by women and men;
- Improved gender relations at family and community levels.
Previous evaluations
The purpose of the baseline was to provide an information base on which to monitor and assess an activity’s progress and effectiveness during implementation and after the implementation. The objective of the baseline was:
- Consolidate existing information in relation to SRMH indicators, gender inequality indicators and information on protection risks associated with accessing primary health care services.
- Compliment incomplete or data of poor quality relevant to the activities being implemented within the context of the HAMORIS project.
The main purpose of the Mid-Term Review (MTR) was for the MTR Team Leader to work with the HAMORIS Team/Gender and Program Quality Unit (GPQ) to assess the progress of project activities from 1 July 2017 to 31 of March 2019 (using the 2018 Baseline, and 2018 Gender and Power Analysis as a marker), and provide recommendations to inform the future direction of the project (1 of April 2020 – 31 June 2022).
D. Objectives of the final evaluation
- Assess the projects progress and impact from 2017 to 2022 against the DAC criteria: relevance, coherence, effectiveness, efficiency, impact and sustainability
- Assess any unintended consequences (positive or negative), such as building individual or community resilience, or supporting local leadership.
- Assess extent to which the mid-term review findings and recommendations have been addressed
- Assess impact against the project monitoring, evaluation and learning framework and theory of change
- Assess extent to which the project has progressed gender equality in the three domains of CARE’s Gender Equality Framework (agency, relations, structure)
- Assess extent to which the project has progressed disability inclusion (e.g. inclusion in activities, or achievement of positive outcomes, for people with disabilities).
- Generate any key lessons learnt and recommendations for future CARE projects and other key stakeholders
- Assess extent to which the project has supported The Ministry of Health and target communities to respond and adapt to COVID-19
E. Target Audience
Primary target audience for the project final evaluation: CARE Australia, DFAT (donor), CARE International in Timor-Leste
Secondary target audience for the project final evaluation: Ministry of Health at national and municipal level, community leaders and community members, National Audit Team under Prime Minister’s Office, local partners (RHTO, ARC and IMI), and other development partners in Timor-Leste
F. Key Outputs and Responsibilities of the Consultant/s:
- Desk review of relevant project documents: Project design, baseline, mid-term review, data collection tools for baseline and mid-term review, Gender and Power Analysis, AdPlans and Performance Reports (2017-2021), Community Score Card Report, Monitoring and Evaluation Framework and Monitoring and Evaluation Plan, Theory of Change.
- Draft an Evaluation Plan (in English) to be shared with CARE for one round of comments, including:
- Timeline
- Proposed approach (including ethical considerations)
- Detailed methodology and sample frame
- Final evaluation report structure
- Quantitative and qualitative data collection tools (Tetum and English). CARE will share the baseline and mid-term review collection tools
- Develop data enumerators and team leader training for tools and data collection
- Deliver training to data enumerators and team leaders
- Manage data collection and quality control
- Lead the data and information analysis
- Preliminary PowerPoint presentation to project team of findings and recommendations
- Final presentation to CARE staff and other interested stakeholders.
- Draft evaluation report (in English) of no more than 25 pages, excluding annexes, for up to three rounds of comments by CARE. This should include a 4-6 page summary of the report’s key learnings and recommendations (Executive Summary).
- Final evaluation report (no more than 25 pages, excluding annexes).
G. Roles and Responsibilities of CARE
- Share key project documents with the Consultant/s
- Provide a briefing to Consultant/s on project and safety and security
- Recruit data enumerators and team leaders
- Organize and coordinate field logistics (including travel, accommodation, per diems) for project team, data enumerators and team leaders
- Organize and coordinate project participants to participate in the evaluation
- Review and provide comments on the evaluation plan
- Review and provide comments (up to three rounds) on the draft evaluation report
- Coordinate logistics for the draft findings and recommendations presentation
- Translate final report into Tetum
H. Reporting Arrangements
The consultant(s) will work under the overall guidance of the
Assistant Country Director – Programs, Alison Darcy (Alison.darcy@careint.org) and the HAMORIS Project Manager, Apolinario Dos Santos (Apolinario.dossantos@careint.
The Senior Monitoring and Evaluation Officer, Junita Castanheira (junita.castanheira@careint.
I. Duration of the Consultancy
The duration of the consultancy is 20 working days. The final report, incorporating CARE’s feedback, is due to CARE on 20 May 2022.
J. Suggested Work Plan
Activities |
Tentative Timeframe[1] |
Final Evaluation Consultant |
Desk review of project documents |
March 3, 2022 |
1 day |
Consultant review the draft question for interview etc. have drafted project team |
March 10 - 11, 2022 |
2 days |
Develop data collection tools |
March 14, 15, 2022 |
2 days |
Submit Evaluation Plan for review and approval |
March 16, 2022 |
1 day |
Update data collection tools after review and time requirement for review of tools by Care |
March 17, 2022 |
1 day |
Training preparation for enumerators and team leader |
18 March 2022 |
1 day for preparing training materials |
Delivering Training to enumerator and team leader |
March 21 - 22 , 2022 |
2 days for training delivery, in Dili |
Data and information analysis |
April 11-13, 2022 |
3 days |
Presentation of initial findings to CARE for validation purposes |
April 20, 2022 |
1 day |
Review and consolidation the comment and feedback |
April 21-22, 2022 |
2 days |
Submission of Draft Evaluation Report |
May 02, 2022 |
1 day |
Submission of Final Evaluation Report |
May 11-12, 2022 |
2 days |
Presentation of findings and recommendations to CARE (and other interested NGOs, DFAT Post) |
May 21, 2022 |
1 day |
TOTAL |
20 days |
K. Payment Schedule
- 20% upon submission and acceptance of the evaluation plan report.
- 50% upon submission of the draft report.
- 30% upon submission of the final consultancy report.
L. Submission Requirements
- Submit technical and financial proposals separately.
- The technical proposal should not exceed 10 pages in length and should include the proposed approach and activities for the implementation and management of the consultancy and an operational work plan with timelines.
- Submit financial proposal including tax.
- CV of team leader and team members (if relevant).
- Examples of past work
- At least two referees (Direct Supervisors)
M. Selection Criteria
- Degree in Social Science or a relevant field
- Experience in leading mixed methods evaluations, preferably in the maternal/sexual reproductive health sector in Timor-Leste
- Demonstrated knowledge and experience in sexual reproductive and maternal health
- Excellent English report writing skills
- Spoken and written Tetum skills are highly desirable
- Strong knowledge and experience in gender equality and inclusive development
- Experience in working with international organizations or NGOs, including abiding by their child protection, and prevention of sexual harassment, exploitation and abuse policies
- Experience in delivering engaging data collection training to data enumerators and team leaders
Contact and further Information
CARE International in Timor-Leste
alison.darcy@careint.org & apolinario.dossantos@careint.
0 Comments