END-LINE EVALUATION CONSULTANCY - ADRA

HAHAN | Hamutuk Hadia Nutrisaun Familia (Together Improving Family Nutrition) Project

 

TERMS OF REFERENCE

END-LINE EVALUATION CONSULTANCY

 

Summary

 

Assignment Title	End Line Evaluation
Purpose	Measure to what extend the project has reached its outcomes (2019-2022) in comparison with the baseline information. Assess the relevance, effectiveness, efficiency, sustainability, and level of gender mainstreaming of the project to date Provide “baseline” and recommendation to inform future programming for the remaining period of the project (2022-2027) including exit plan for the last 6 months of the project in Viqueque.
Primary Methodologies	Participatory methods, Qualitative and Quantitative Data Collection
Dates and Duration	September-October 2021. Total 23 working days
Language Required	English
Reporting to	Marsaulina Pasaribu, Programs Director – ADRA Timor-Leste marsaulina.pasaribu@adra.tl
Consultancy days	23 days

 

Organization Background

The Adventist Development and Relief Agency (ADRA) is a global humanitarian organization with a vision to serve humanity so that all may live as God intended – free from poverty and disadvantage. ADRA Timor-Leste belongs to the worldwide ADRA network, comprised of over 120 country offices, and has developed its expertise specifically in WASH, nutrition, agriculture, sustainable livelihoods, value chain development, saving and loan program, and humanitarian response.  ADRA is experienced in integrated rural development programming and management. ADRA Timor-Leste has a national office in Dili and one field office located in Viqueque.  ADRA Timor-Leste was established in 2010 holding registration in Timor-Leste with the Ministry of Justice and has developed strong working relationships with national level government and local authorities.

 

About HAHAN Project

Hamutuk Hadiak Nutrisaun Familia (HAHAN) Project is a project implemented by ADRA Timor-Leste since 2019 to support the development of marketable food production for farming households in 7 sucos in Viqueque Municipality. The project’s goal is to improve wellbeing and resilience for agriculture-based communities in Viqueque Municipality.

The goal of improving wellbeing and resilience was chosen to encapsulate the broad impact the project seeks by integrating interventions supporting livelihoods (market-oriented chicken, egg, and vegetable production) and health (nutrition, water supply). Resilience refers to the focus on creating sustainable marketable agriculture production that includes the implementation of conservation agriculture practices.

The project goal will be achieved through 2 Outcomes:

• Outcome 1:  Farmer households maximize opportunities for marketable food production
• Outcome 2:  Farmer households adopt good nutrition and hygiene practices

Consultancy Purpose

The End Line Evaluation will focus on evaluating and analyzing the progress to date of the project in relation to the indicators outlined in the project Results Measurement Table, as well as looking at the aspects of Accomplishment, Effectiveness, Efficiency, Sustainability and Inclusion.

 

The consultancy will use a range of participatory appraisal methods, as well as draw on available data, reports and observations, prepare an end line survey report, and consult it with the project team for validation.

A recommended exit plan for Viqueque and next steps for other possible municipality/ies should also be in the report. These will serve as the strategy and actions to support sustainability of the outcomes beyond the funding period and key steps to address these.

 

The end line review aims to achieve the following outcomes and outputs:

RESULT	INDICATOR (s)
Outcomes 1.
Farmer households maximize opportunities for marketable food production	Number of household start new initiative in commercial food production still active during the end line survey.
	Increasing in quantity of commercial food produced among the project participants (%)
	Number of adults with disability who successfully obtain a livelihood as a result of skills training or capacity building
Output 1.1.
Farmer households acquire improved business and marketing skills	90% of trained participants reporting increased confidence in having the appropriate business and marketing skills and knowledge to use the learned techniques in business and marketing skills (target 108 out of 120 participants at least 50% female)
	Number of saving and loan group established (target 8)
	Number of poor women and men who increase their access to financial services
Output 1.2.
Farming households diversify food usage and increase production capacity	90% of trained participants reporting increased confidence in having the appropriate food production and usage skills and knowledge to use the learned techniques
	Number of people who participated in training and vocational training to assist them to access increased and sustainable livelihoods
Outcomes 2.
Farmer households adopt  good nutrition and hygiene practices	Number increase in U5 nutrition status in the target community by June 2023
	Number increase of HH consuming more diverse food groups in the last 24 hours of the survey by 2022 (target TBA after the Baseline
	Number increase in the diversity of foods consumed in the last 24 hours of the survey by 2022
	Number HH with increased access to safe water by 2022 (target 60 HH)
	Number  of women and men (and where specified girls and boys) with increased access to safe water
Output 2.1.
Households gain improved access to water	Number of CAP processes conducted
	Number of small scale water systems constructed
	Number of GMF and GUF groups trained and active by end of the project (at least 50% of group members are female)
	Number of KG water systems constructed (target 12)
	Number  of water points built or upgraded
	Number (x) of water points built or upgraded in accordance with accessible design guidelines for Australia's aid program
Output 2.2.
Households have improved knowledge of nutrition and health principles	90% of trained participants reporting increased confidence in having the appropriate nutrition and health skills and knowledge to use the learned techniques (target 338 out of 375 participants, at least 70% female)
	Number  of people with increased knowledge of hygiene practices

 

Scope of Work 

 

This end line evaluation shall review the key points against the project progress; and recommend key step for a sustainable continuation plan.

• Accomplishment

• To what degree the planned activities and the outputs of the project has been achieved?
• Achievement in terms of outcomes and goals base on log-frame indicators

• Efficiency

• To what extent have the resources been well used in achieving project outcomes? What has been the quality of the outputs?
• To what extent have the project resources and capacities been appropriate to manage the project effectively?
• Have potential synergies between the project with other government/development agencies/community-based organizations/private sectors been optimized?

• Impact/Effectiveness

• How have the project outputs, short, medium and long-term outcomes been achieved?
• To what extent have the activities fostered increased production of nutritious food at community level?
• What unintended outcomes (positive and negative) have occurred as a result of the project activities?

• Sustainability

• Are the project results/benefits likely to be resilient to risk and sustained?
• To what extent are the project establishing/enhancing capacity, processes and systems likely to be sustained?
• Any good practice to be captured for dissemination in future?
• Do the project participants and local institutions have the capacity to sustain the impacts of the development process.

• Inclusion

• To what extent and how effectively have gender equality and inclusion issues been addressed in the project?
• What are the likely effects of the project on dynamics on gender and inclusion?

Data collection method

The review will use a mix method approach comprised of both quantitative and qualitative data collection methods. This study is to be conducted within the target area of 4 suco’s in Viqueque Municipality, Timor-Leste. The review shall be conducted in forms of survey, key informant interview, in-depth interviews, and focus group discussions, if needed All data collection and analysis needs to be strongly linked to the Results Measurement table, and fundamentally measure project contribution over the life of the project.

Expected Deliverables

The end-line Evaluation’s written outputs will include: 

• Inception Report which should not exceed 5 pages, includes initial work plan and proposal for the end line evaluation outlining the proposed methodology, survey tools, process of data collection and analysis as well as final set of data-collection tools for all indicators in the log frame. This report should be submitted to ADRA Timor-Leste for review and approval 5 days after signing of the contract.
• Draft report to be presented to ADRA Timor-Leste 10 days after completion of field work.
• Final report in English not exceeding a length of 35 pages (excluding annexes) which includes:

• Acknowledgements
• Glossary/Acronyms
• Introduction
• Executive Summary (with brief summary {bulleted} of key findings, and recommendations)
• Methodology (clear description of methodologies used to ensure the basis for future measurements)
• Limitations of the study.
• Findings of the study, including accomplishment per indicator.
• Accomplishment, efficiency, effectiveness, sustainability and inclusion issues of the project.
• Exit plan recommendations.
• Conclusions
• Recommendations with clear guidance how these can be captured in the redesign or other projects
• Appendices
• Report must include relevant photos, graphs and quotes.

Duration and Timeline

The end-line Evaluation shall be expected to complete within 23 working days beginning September until October 2021. The budget of the End-line Evaluation will be offered as a package.

 

No	Activities	Duration
1	Inception Report Development	2 days
2	Tools/Questioner development	3 days
3	Enumerator Training and Logistic Preparation	3 days
4	Evaluation Field Work	5 days
5	Data Analysis and Report Writing	6 days
6	Finalizing the Report	2 days
7	Travel days to Viqueque (return)	2 days
	TOTAL	23 days

Required Qualifications and Experience

• Highly preferred if the consultant/s are already in Timor-Leste.
• A master’s degree in agriculture, social science or relevant field, or recognised equivalent work experience.
• Experience in designing and conducting baseline, end line, and other comparable quantitative surveys.
• Excellent report writing skills.
• Excellent language proficiency in English and Tetum (or collaboration with a Tetum/English translator)
• The applicant(s) have the right to request for more clarifications.
• In-depth knowledge of Timor-Leste
• Examples of previous high quality work available upon request

The consultant(s) will be expected to abide by ADRA’s Child Protection Code of Conduct and Preventing Sexual Exploitation, Abuse and Harassment policies and will undergo Criminal History Check and reference checks. 

Application Process

Consultant(s) who meet the above requirements should submit an expression of interest, which should include the following:

• A suitability statement, including commitment of availability for the entire period of the assignment.
• A narrative proposal which should include the following information (at a minimum):
• Technical proposal with clear methodology including types of data collection tools and analysis.
• CV of key consultant(s) attached to the technical proposal clearly showing the qualification and experience of the consultant and his/her team
• Proposed budget
• Proposed timeline
• Contacts of three organizations recently worked with.

 

How to Apply

All interested and qualified consultant should send application to: domingos.sinorio@adra.tl 

 

Deadline for applications: All applications should be submitted by (Tuesday 28^th September 2021 by 09:00 am). Application received after this time will not be considered.