TERMS OF REFERENCE FOR FINAL EVALUATION CONSULTANCY

TERMS OF REFERENCE FOR FINAL EVALUATION CONSULTANCY

Integrated Emergency Response to flood affected populations in Hiran & Middle Shabelle Regions of South &Central Somalia Project

ACRONYMS
CED Centre for Education and Development
HARDO Humanitarian Action for Relief and Development Organization
HH Household
M&E Monitoring & Evaluation
ON Oxfam Novib
TOR Terms of Reference

I. BACKGROUND
South Central Somalia has been experiencing following the deyr/El nino rains. These floods has adversely affected the Belet weyne, Jowhar and Balcad regions in Hiran and Middle Shabelle regions of South Central Somalia It’s against this backdrop that Oxfam Novib in partnership with HARDO and CED implemented an emergency response to cover the flood affected communities in Hiran and Shabelle regions for the period beginning October 2012 to January 2013 period targeting over 2000HHs.

The program goal was to directly improve the livelihoods the affected communities through the provision of safe clean water and improving their access to hygiene and sanitation. Following the end of the program, ON in partnership CED and HARDO is set to carry out an end of project evaluation to establish the project successes, gaps, lessons learnt and best practices that may be applied to other programs

The project stakeholders include the community, beneficiaries, ON, CED and HARDO.

II. EVALUATION PURPOSE & OBJECTIVES.
The end of project evaluation is aimed at assessing the achievement of the overall and specific objectives based on project proposal, current data and direct observation as well provide the project achievements, gaps, lessons learnt and provide recommendations and best practice that focus on key components for future projects.

The specific evaluation objectives;
1. To determine the effectiveness of the program implementation process
2. To determine the direct and indirect impacts of the interventions as related livelihoods and WASH
3. To determine the projects achievements and gaps
4. To establish the effectiveness of the co-ordination among stakeholders and areas for improvement
5. To provide the best practices/recommendations that may used in the future programming

Oxfam Novib together with its implementing partners (HARDO & CED) are the main stakeholders of the evaluation.

III. EVALUATION CRITERIA

The evaluation will mainly entail the following criteria;

1) Relevance/appropriateness- how appropriate were the inputs and activities as related to the local needs? What value did the intervention add to the local context?
2) Effectiveness-Have the objectives led to the achievement of the expected results? Did the assumptions/risks affect the project? How effective was the risk management?
3) Efficiency-Did the project use the most efficient process; Did the project use the most cost-effective approach or could other approaches produce the same results at a more reasonable costs
4) Sustainability-What sustainability mechanisms are in place to ensure the livelihoods continue to be maintained?
5) Impact; What impact (intended and unintended) has the program had on the beneficiaries/HHs and the project area as a whole.

IV. EVALUATION METHODOLOGY

To sufficiently address the key questions raised above, the evaluation will need to adopt methodologies that combine both qualitative and quantitative research techniques.The Consultant is expected to propose his/her methodology for the evaluation which should include but not limited to:

 Conducting a household survey and data analysis
 Qualitative data collection and analysis
 Secondary data analysis
 Production of an evaluation report
 Participate in the initial sharing of the report to ON and incorporate feedback

The proposed research methods will require application of some of the techniques below:
 Review project design documentation? Quality of the M&E framework; was the right information captured
 Review various narrative reports
 Review project budget and available financial reports.
 Cross-sectional sample surveys/household interviews with beneficiaries
 Key informant interviews
 Field observations
 Focus group discussions
 Meetings

V. EVALUATION TEAM
The evaluation team will comprise of the consultant who will have overall responsibility of designing, implementing and coordinating the entire evaluation process guided by the TOR Oxfam and partners will have the responsibility of availing all the pertinent logistics and coordinate the evaluation
The community will participate in the key informant interviews, focused group discussions and household surveys

VI. EVALUATION LOGISTICS
The consultancy is expected to take a total of 26 days within the month of June/July 2013.The consultant as outlined in the work plan below;
Activity No. of days
Literature Review 1
Design of data collection tools 2
Interview with Oxfam staff/partners 1
Travel to project location 3
Preparation and Briefing in Hiran& Shabelle 2
Induction of field data collectors
Field visit/data collection 10
Data entry/Coding
Travel to Nrb 1
Data analysis and report writing 3
Draft report presentation 3

Include suggestions and presentation of final report
Grand Total 26

VII. PRODUCTS
The key deliverables will include;
a) Draft evaluation report outlining general findings
b) Power point presentations of key findings of the evaluation to be presented during a stakeholder meeting.
c) Final report, one original signed/certified hard-bound copy
d) Electronic copy saved on a CD that includes all photos of the evaluation exercise

The final version of the Evaluation report will follow the following format and be no more than 50 pages in length, excluding annexes;
i. Title page
ii. Table of Contents
iii. Acronyms
iv. Acknowledgments
v. Executive Summary
vi. Background and Project Description
vii. Purpose of the Evaluation
viii. Scope of the Evaluation
ix. Evaluation methodology
x. Results/findings
xi. Discussions-, a description of results, summary analysis of evaluation findings
xii. Conclusion, Lessons learned and Recommendations.
xiii. Annexes:
a. Evaluation Tools
b. TOR for research
c. Other relevant documents

VIII. PROPOSED BUDGET & REMUNERATION
To be discussed with the prospective consultancy firm.

Consultant expertise:
The consultant should have a thorough undertaking of livelihoods and WASH framework with regards to development. In addition the following skills:
1. Advanced and demonstrated data collection skills both in qualitative and quantitative data.
2. A post graduate degree (MSc, MA, etc.) and above in, Social Sciences, WASH or other related field
3. Excellent written and verbal skills for the development of reports, tables, and presentations. Demonstrated ability to describe results of analysis to a wide variety of stakeholders
4. Evidence of having generated quality reports of evaluations
5. Ability and willingness to travel to the field

How to apply:

Interested consultants should send the information listed below to email address: vacancy.Heca@oxfamnovib.nl

1) Evaluation bid (up to 3 pages) – outlining the approach in undertaking the evaluation
2) Latest curriculum vitae (of consultant and any supporting team members)
3) Evidence of relevant previous experience and / or names and contact details of references with good knowledge of your previous work.
4) Sample report of evaluation conducted contact names of organization submitted to.

Note: This should not be taken as a full time engagement for the consultant(s) but rather time specific assignment as in the work plan above.
Deadline 07 June 2013