Evaluation on the impact and sustainability of IOM Somalia Projects in Somalia

Vacancy No. :SVN/IOMSO/024/2015

Consultancy title: Evaluation on the impact and sustainability of IOM Somalia Projects in Somalia

Type of contract : IOM Individual Consultancy Contract

Duration : 75 Days

Duty station : Nairobi, Kenya with expected travel to Federal Government of Somalia- Mogadishu, Puntland - Garowe and Bossaso , Somaliland-Hargeisa

Job family: Project Support

Organizational unit: Project Development and Monitoring

Reporting directly to : Team Leader, Project Development and Monitoring Unit (PDMU) Overall supervision by : Project Development Officer

II. Organizational Context and Scope

Since 2006, IOM has been implementing large-scale humanitarian and development projects in all areas of Somalia. While its coordination and liaison office is located in Nairobi, Kenya, IOM Somalia and its 225 staff members support project implementation through four field offices in Somalia (Mogadishu, South Central; Hargeisa, Somaliland; Bossaso and Garowe, Puntland) as well as a Way Station in Dhobley.

With generous funding from the Government of Japan, IOM has supported over 300,000 beneficiaries with humanitarian and capacity building assistance since 2009; this includes provision of: primary healthcare, water, sanitation and hygiene (WASH)-related services, livelihoods opportunities, support to counter trafficking and border management, and placing of 54 advisors to improve the capacity of government institutions to deliver vital services to their constituents. Some of the ongoing activities were built on the previous implemented activities through Japan-funded projects.

While IOM has been implementing projects directly, it has also worked closely with local implementing partners (IPs), in particular in areas where access for international organizations is limited. IOM liaises and coordinates with UN agencies, NGOs and other actors in the target areas. In addition, IOM collaborates closely with the Federal Government of Somalia as well as federal, regional and local administrations and authorities and works hand-in-hand with its donors to ensure successful project implementation.

III. Responsibilities and Accountabilities Objectives and Scope of Evaluation

The purpose of the evaluation is to provide the project stakeholders - Government of Japan and IOM - with an analysis of appropriateness, relevance, effectiveness, efficiency and sustainability of the Japan funded projects since 2012. It will evaluate results achieved against expected goals and objectives, inputs and outputs set forth in the project documents and the respective phases of implementation. The evaluation will offer strategic and operational recommendations which will inform future programs on how to effectively align with current national and regional priorities. The scope of the evaluation will cover key outcomes of the projects targeting selected activities. The geographic coverage of the evaluation will be Somalia.

Key evaluation issues will be to establish and/or assess:

· Appropriateness, relevance, effectiveness, efficiency and sustainability of the project (with an emphasis on specific activities).

· Project concept and design and its relevance to humanitarian and development activities.

· An analysis of how efficiently project planning and implementation were carried out. This includes assessing the extent of organizational structure, managerial support and coordination mechanisms used in supporting the project.

· Extent to which the project was able to achieve the project’s objectives and results and what progress was made towards their achievement.

· Project’s contribution to capacity development at three levels - individual, organizational and systemic.

· Delivery process of the project results - outcomes and outputs.

· Project delivery mechanisms including institutional arrangements and how these supported or constrained project delivery.

· Level and rate of delivery of project resources and activities against overall objectives.

· Key risks and challenges faced during implementation of activities and their impact.

· Lessons learned and recommendations for future interventions under Japanese funding and similar projects.

· Effectiveness of the partnerships that have been created through the project.

· The overall and lasting impact of the project.

****Evaluation Questions:****

In pursuit of the overall objectives of the evaluation, the following key questions will be addressed:

Relevance–design and focus of the project

· To what extent did the project achieve its overall objectives?

· To what extent were the results (impacts, outcomes and outputs) achieved?

· Were the inputs and strategies identified? Were they realistic, appropriate and adequate to achieve the results?

· Was the project relevant to the identified needs?

· How effective was the management processes and their appropriateness in supporting delivery?

Effectiveness and impact

· Was the project effective in delivering desired/planned results?

· To what extent did the project’s M&E mechanism contribute to meeting project results?

· What difference has been made to the project beneficiaries?

Efficiency of implementation of the project

· Was the project implementation well planned involving staff and other key stakeholders?

· Was the process of achieving results efficient? Specifically did the actual or expected results (outputs and outcomes) justify the costs incurred?

· Did project activities overlap and duplicate other similar interventions (funded internally and /or by other donors)?

· Are there more efficient ways and means of delivering more and better results (outputs and outcomes) with the available inputs? Could a different approach have produced better results?

Sustainability and replicability

· To what extent are the benefits of the projects likely to be sustained after the completion of this project?

· What is the likelihood of continuation and sustainability of project outcomes and benefits after completion of the project?

· What are key factors that will require attention in order to improve prospects of sustainability of project outcomes and the potential for replication of the approach?

· How could the project be improved to ensure increased sustainability? Particularly, in relation to future project design and management. Provide a set of recommendations for similar initiatives that IOM may embark on.

Lessons Learned

· Key lessons learned throughout the period of the project which can be utilized to guide future strategies, projects or agencies.

· Were there any significant changes in the project design or the project context? What were the reasons for these and can any lessons be learned from this for application elsewhere?

· How did the project take into account gender dimensions?

· For whom could these lessons have relevance and how do they relate to any innovative aspects of the project?

Methodology of Work and Evaluation

The evaluation will use a combination of methodologies, which will include desk reviews and field visits.

****I.****Desk Review.The consultant will undertake a desk review of relevant documents to get acquainted with the project, including project documents, annual work-plans, project progress reports, existing interim and final reports submitted to the donor and other relevant documents.

After the desk review, the consultant will provide suggestions on locations to be visited and these should be provided in the inception report validated by the Supervisor.

****II.****Field Visits. The consultant will conduct in-depth interviews with project partners and staff involved in the design and implementation of the project, hold discussions with selected stakeholders in Somalia, as well as visit some selected locations in the region that have benefitted from the project and focus group discussions with project beneficiaries.

****III.****Validation Workshop. The consultant will present their draft findings in a validation workshop that will bring together project managers. This workshop will discuss the first draft of the studies and make appropriate recommendations to be addressed by the consultant.

IV.Reporting and Supervision. The consultant will work under the overall supervision of the Team Leader, PDM Unit in Nairobi and in consultation with the reference group. A reference group is established to enhance the quality of evaluation. The group assists the Supervisor in reviewing the terms of reference, the inception report and the draft report. Evaluation of the contract will be made against the benchmarks and deliverables set for the assignment for the consultant at the end of the contract duration.

****Expected Deliverables****

Note: The lead consultant will be responsible for leading the evaluation and ensuring a high-quality output (report).

****1. Inception Report****

An inception report will be developed, which will demonstrate that the consultant understands the TOR. The consultant will also provide the evaluation methodology and work plan, which will be discussed and validated by IOM staff.

****2. Draft Desk and Field Research Reports, and Final Consolidated Research Reports****

To be written in clear, concise and detailed English with a clear format and an easy-to-read executive summary and info graphics.

****3. Final Reports:****

A draft report shall be prepared for discussion by the Reference Group; inclusion of comments shall lead to the final report. Final Evaluation Report, in hard and soft copy (MS Word and Acrobat Reader) that should at least include the following contents:

1. Executive summary
2. Introduction
3. Methodology used
4. Development context under which the programme was implemented
5. Assessments according to the criteria and questions defined
6. Findings and conclusions
7. Lessons Learnt
8. Recommendations
9. Annexes: terms of reference, persons consulted, documents reviewed

IV. Competencies

The incumbent is expected to demonstrate the following technical and behavioural competencies

Behavioural

1) Takes responsibility and manages constructive criticism;

2) Works effectively with all clients and stakeholders;

3) Promotes continuous learning; communicates clearly;

4) Takes initiative and drives high levels of performance management;

5) Plans work, anticipates risks, and sets goals within area of responsibility;

6) Displays mastery of subject matter;

7) Contributes to a collegial team environment;

8) Creates and promotes a respectful office environment free of harassment and retaliation;

9) Maintains excellent communication and writing skills;

10) Pays meticulous attention to detail;

11) Personal commitment and drive for results, and adaptability in the workplace;

12) Handles sensitive situations diplomatically and cultivates productive relationships;

13) Demonstrates ability to maintain accuracy and confidentiality in performing responsibilities;

14) Abides by the prevention of sexual exploitation and abuse (PSEA);

15) Incorporates gender-related needs, perspectives, and concerns, and promotes equal gender participation;

16) Displays awareness of relevant technological solutions;

17) Works with internal and external stakeholders to meet resource needs of IOM. Technical a) Delivers on set objectives in hardship situations;

b) Effectively coordinates actions with other implementing partners;

c) Works effectively with local authorities, stakeholders, beneficiaries, and the broader community to advance country office or regional objectives.

V. Education and Experience

1. Master’s degree in social sciences, international relations studies, development studies or related fields. PhD will be an added advantage.
2. The consultant should have at least 5 years’ experience in the design and execution of evaluation systems, conducting evaluation of projects including impact assessment, and with proven ability to assess project activities and achievements against objectives and impact.
3. Knowledge and experience in social research methodology in both qualitative and quantitative methods.
4. Demonstrated contributions to evaluation and impact assessment in previous engagements of similar nature.
5. Demonstrable ability to work with and build relationships with stakeholders from diverse backgrounds in government institutions, development partners, regional and international actors on complex issues.
6. Highly developed analytical skills with ability to produce high quality analytical reports and policy papers.
7. High organizational and facilitation skills and ability to handle complex tasks with tight deadlines.
8. Effective communication skills, English language fluency and ability to write clearly, concisely and comparatively.
9. Prior experience and/or existing presence in Somalia will be an added advantage.

VI. Languages

Required Fluent English Advantageous Somali

HOW TO APPLY:

****Method of Application****:Interested candidates should submit CV and a cover letter indicating the ****Vacancy Notice Number (SVN No)**** with three professional referees and their contacts (both email and telephone) to:recruitmentsomalia@iom.int

CLOSING DATE:06 October 2015

****ONLY SHORT-LISTED APPLICANTS WILL BE CONTACTED.****