End Project Evaluation - Community Empowerment to Demand and Access Justice (CEADJ)

1. BRIEF OVERVIEW OF THE PROJECT Oxfam’s Urban Governance Programme has been implementing a project titled “Citizens’ Empowerment to Access and Demand Justice” since 2010. The geographical coverage of this project has been the City of Nairobi especially Kibera, Mukuru and Korogocho informal settlements. This project is co-financed by the European Union and Oxfam GB, and is implemented in partnership with Kenya Private Sector Alliance (KEPSA) and Umande Trust.

The overall goal of this project is to “contribute to improvement on the rights of the poor and marginalised residents of urban informal settlements and integrate them into the judicial and executive systems at all levels”. Its specific objective is “communities in urban informal settlements are empowered to access and demand for more responsive justice and local governance systems”.

The project has three results as follows: o Nairobi Non-State Actors capacity to engage in urban policy influencing and practice improved. o Urban poor and marginalised access to information on rights and redress in the informal and formal courts improved. o Nairobi based Non-State Actors are coordinated, linked to and representing the urban poor communities on justice and human rights.

Specific details of the project activities are contained in the relevant project documents. In October 2012, the project was amended to enable it address some of issues affecting the slum communities through political and policy advocacy during and after elections. In particular, the amendment introduced three aspects into the project namely participatory documentation of the service needs of slum (Kibera, Mukuru and Korogocho) communities; commiting political aspirants to peaceful campaigns, incorporating the slum problems as component of the aspirants’ priorities in leadership and accountable leadership; and capacity building of the elected members of Nairobi County Assembly and executive officials to enable them serve Nairobians effectively. This project is scheduled to formal closure at the end of July 2013.

1. PURPOSE OF THE ASSIGNMENT The main objectives of the evaluation are to: o Assess implementation of the project by Oxfam and partners during the three years against the key targets evaluation criteria (efficiency, effectiveness, relevance, sustainability, impact etc). o Assess the effects of the project on the target communities against the programme outcomes. o Document the learning and best practices of the project that include gender and accountability to our partners, beneficiaries, donors and stakeholders.
2. OBJECTIVES OF THE EVALUATION o To evaluate the CEADJ project’s effectiveness and efficiency. o To assess the relevance of the CEADJ project inputs to the micro and small scale traders, and the slum communities. o To assess the quality of outputs, outcomes and results of the project as listed in the proposal. o To evaluate the inclusion of cross cutting issues that include gender consideration, vulnerable and marginalized groups and accountability to the stakeholders. o To intrerogate the project’s theory of change. o To assess the coordination between Oxfam and partners, relevant stakeholders, government agencies and other NSAs operating in the project areas. o To identify good practices and key lessons learnt and make recommendations for future improvement of similar programmes based on evaluation findings.
3. KEY QUESTIONS EXPECTED OF THE EVALUATION A. Appropriateness and Relevance o Did the design and implementation of the project use specific criteria to target those who were most vulnerable? o Were the procedures used for needs identification and targeting appropriate, transparent and community based? o Did the affected population (both female and male) have adequate space for informed and adequate participation during the design and implementation stages? o How did the programme adapt to the changing governance needs and conditions? o Were the project activities relevant to the context? Was it the right intervention? Did it complement other actors work?

B. Efficiency o Did the project implementation follow the agreed project timeframes? If not what factors lead to the change in its delivery?? o Were all inputs delivered on time? o Were appropriate implementation methodologies applied in all circumstances? o Did Oxfam and partners get cooperation from relevant stakeholders? o How did the programme adapt to changing needs if any? o To what extent did Oxfam and partners factor the recommendations from donor’s field visits and feedback on progress reports provided by donors? o What mechanisms were put in place by the project to address emerging gender issues?

C. Effectiveness and Coordination o To what degree were the expected results achieved against set objectives and indicators? o Did the activities listed in the proposals result in achievement of the specific objectives and attainment of outputs? How true was the envisaged theory of change in light of programme implementation? o What promoted or undermined the achievement of results? o Did Oxfam and partners have adequate technical expertise/capacity to implement project? o To what extent has the beneficiary data (disagregated by gender) been collected and used in decesion making in the programme?
o How effective was the coordination with other actors during programme implemention?

D. Sustainability o To what extent is the programme impact sustainable over the longer term? o Do the local community leaders support the initiatives that were taken by the project? o To what extent was the project linked to Oxfam’s existing programmes? o Were there clear exit strategies put up by the Oxfam and partners? o Has the project activities changed the livelihoods and coping mechanism of the communities, men and women in any meaningful way or long term basis?

E. Impact o What were the notable immediate impacts and likely long term impact of the project? o Were there any specific gender impacts by the project? o Were there any unintended impact from the project (both negative and positive)? o What measures were put in place to incorporate cross cutting themes like gender and accountability?
o Are there any exceptional experiences that should be highlighted e.g. case-studies, stories, best practice? o

1. METHODOLOGY This evaluation will involve reviewing of the project documents to ascertain all contractual areas are evaluated as well as the other relevant literature, meetings and interview with a broad range of stakeholders including donor, project partners, local government representatives, beneficiaries and community opinion leaders. The evaluator(s) will be responsible for assessing the project and management issues, breifing and debriefing with key stakeholders, and production of the report. They will be required to carry out the exercise dilligently which will include: o Developing a detailed evaluation work plan and evaluation methodology which will be shared and agreed upon with Oxfam before commencement of the actual work.
   o Participating in the initial briefings with Oxfam and partner teams to ensure that the evaluation team is clear on the expectations of this evaluation. o Developing evaluation tools which will be submitted to Oxfam and will be discussed and agreed upon by the two parties before the field work. o Reviewing the project materials and other relevant literature in order to have adequate understanding of the project and maximize incremental learning. o Discussing with Oxfam, the implementing partners’ staff, other stakeholders including government line departments, CSOs and opinion leaders in the project areas to get their feedback to reach conclusions against benchmarks. o Conducting field visits to collect data through a combination of data collection methods that include PRA methodologies. It is expected that the team will incorprate gender and ensure representative involvement of the beneficiaries and also non-beneficiaries in the evaluation.
   o Ensuring that the data is collected and analyzed by gender and data sets (if requested should be submitted to Oxfam). o Presenting to Oxfam and partners the key findings and allow the team opportunities to give feedback and agree on action points, lessons and recommendations. o Submitting draft report to Oxfam and partners for review, comments and inputs which will be taken into consideration before submission of the final report. o Document and submit two quality case studies focusing on best practices and lesson learnt as evidence from any of the three informal settlements. Confidentiality of issues discussed shall be safeguarded by the evaluation consultant.

5.1. Sample Sizing: The consultant(s) will determine the appropriate sample sizes in consultation with Oxfam. These figures will take into consideration the activities carried out in the specific informal settlements. The consultant(s) will visit these sites and interview the beneficiaries and stakeholders on the relevant project questions and objectives.

1. SKILLS AND EXPERIENCE The desired specification and qualities of the consultant(s) are as hereunder: o Post Graduate qualification in Governance, Programmes Management, Development Studies or Economics or any other relevant Social Science Degree. o Proven background in evaluating governance projects with in-depth knowledge of partnerships and project cycle management. o Strong interpersonal and analytical skills. o Familiarity with the urban informal settlements in Kenya. o Experience of effective interaction with local and national organizations, government departments, and marginalized communities in informal settlements in Urban areas. o Conversant with application of cross cutting themes like gender mainstreaming, and gender competence, MEAL and advocacy. o Good spoken and written communication skills in Kiswahili and English. o Proven experience of using participatory rural appraisal tools as means of data collection for programme evaluation.
2. EVALUATION REPORT The production of the evaluation report will be the liability of the evaluator(s) covering all the evaluation questions, objectives and areas outlined in the ToRs. Oxfam and partners’ staff will be responsible for coordinating the evaluation exercise. The evaluation report shall be: o Produced in English language and should be simple in expression (jargon free). o Maximum of 30 pages with some short annexes. o The report format and text, should be an A4 paper size in Times New Roman font size 11. o The evaluator(s) will be liable to submit at least one hard copy and an electronic version of the evaluation report in Word Version by the agreed deadline.

7.1. Outline of the Evaluation Report The evaluation report should contain at MINIMUM different elements mentioned below. All parts should be clearly distinguished from each other and of sufficient quality. o Cover page o Table of contents o Executive summary that can be used as a complete document. The executive summary should include the major findings of the evaluation and summarise conclusions and recommendations. o Methodology, its justification and limitations if any. o Findings addressing all the evaluation questions as well as the unexpected outcomes. o Conclusions presenting summary of the findings on the basis of evaluation questions. o Lesson learned and recommendations which should be clearly related to conclusions. o Report annexes that include: Confidentiality of information: All documents and data collected will be treated as confidential and used solely to facilitate analysis. Where necessary, the respondents will not be quoted in the reports without their permission.

7.2. Anticipated Outputs o Work Plan for the evaluation o Evaluation tools o Final Evaluation Report addresssing all objectives, evaluation questions and including clear recommendations. o Two case studies as evidence of programme outcomes/impact

1. TIME FRAME The whole program evaluation process will take approx 20 days that include: preparation, field work with partners and stakeholders, and report writing. The expected date of the start of program evaluation is 15th July 2013.
2. BID REQUIREMENTS Consultants who meet the above requirements should submit bids, which at minimum include the following: o Suitability statement, including commitment to availability for the entire assignment. o Brief statement of on the proposed evaluation methodology including a detailed work plan. o Detailed financial proposal, including daily costs. o Updated curriculum vitae that clearly spell out qualifications and experience. o Contacts of three organizations that have recently contracted the consultant to carry out relevant evaluation.

N/B: The entire bid should be a MAXIMUM OF FIFTEEN (15) PAGES inclusive of CVs and Budgets. Bids not meeting this requirement will not be considered.

1. REPORTING LINES The consultant shall work under the supervision of the Urban Programme Coordinator with strong liaison with the MEAL Advisor and field management staff and Oxfam’s Urban Programme Governance Officer.

How to apply:

Interested and qualified consultants should send their applications before or by 11th July 2013 at 5.00 P.M and indicate APPLICATION FOR CEADJ PROJECT EVALUATION in the subject line to the email address below:

kenyajobs@oxfam.org.uk