Country: Kenya
Duration: 5 weeks
Reporting to: The Evaluation Steering Committee
Background on the Conflict / Context
Dadaab refugee camp in Kenya was established in the year 1991 to settle refugees who were displaced following the inter-clan conflicts that broke out in Somalia.
Background on the thematic area in this context (e.g. not NRC intervention specific but for example the WASH situation in the country)
NRC is currently the lead WASH partner for UNHCR providing Water, Sanitation and Hygiene promotion to the refugees living in Hagadera and Kambioos camps.
The sanitation standards among the target population still remain a challenge despite significant improvements over the years.
NRC’s Presence and Activities in the Country
The Norwegian Refugee Council (NRC) has been in operation in Dadaab since 2007 under the NRC Horn of Africa, Uganda, South Sudan and Yemen mission which currently covers 8 countries.
Over the years, NRC has been working closely and in coordination with UNHCR and other humanitarian agencies in providing basic and life-saving services to the refugees and host community.
Outside of Dadaab (Garissa County), NRC runs similar projects in the Kakuma (XX County) targeting refugees mainly from South Sudan and in Mandera (YYY County) targeting mainly internally displaced persons (IDPs).
NRC’s Intervention (related to the core competency to be evaluated)
NRC has been implementing a full package of water supply, sanitation (including solid waste management), and hygiene promotion activities in the two camps – Hagadera and Kambioos, while working as the implementing partner of UNHCR.
The specific project to be evaluated
In 2016, NRC has planned to carry out an evaluation of the Dadaab WASH programme in order to assess the progress towards achieving the overall objective, which is in line with the NRC Kenya WASH strategy.
The table below summarizes NRC’s specific interventions with reference to the evaluation:
Activity
|
Period
|
Water supply expansion (pipe
networks, tap stands, storage tanks, etc.) |
April 2012 to June 2016
|
Water supply operation and
maintenance (boreholes, pipe networks, etc.) |
April 2012 to June 2016
|
Emergency water supply
|
April 2012 to June 2016
|
Water treatment and water quality
monitoring |
April 2012 to June 2016
|
Latrine construction
|
April 2012 to June 2016
|
Solid waste management
|
April 2012 to June 2016
|
Hygiene promotion
|
April 2012 to June 2016
|
Cholera preparedness and response
|
September 2015 to June 2016
|
Renewable energy and other
innovations |
March 2014 to June 2016
|
Partnerships with other humanitarian
actors, commercial and government agencies |
April 2012 to June 2016
|
2. Purpose of Evaluation and Intended Use
The planned WASH programme evaluation is part of the NRC’s strategic plan for improving programme quality and effectiveness.
The main purposes of the evaluation exercise are to:
Determine the level of progress towards achieving the overall goal of the WASH programme, as per the NRC Kenya WASH Strategy.
Address the following key questions;
- Has NRC been able to reach the right people through the WASH programme?
- Were the interventions relevant to the achievement of the overall WASH goal?
- Was NRC able to address the basic and life-saving needs of the target group, in line with agreed strategies and as per the internationally recognized and recommended standards?
- If any, how has the WASH programme contributed to durable solutions for the refugees in Dadaab camps?
- How well were the interventions coordinated?
- Were there constraints, if any, encountered towards achieving better effectiveness within the programme and how well were they mitigated?
- What evidence is there (if any) that learning (M&E) from previous WASH projects were incorporated into the implementation strategies?
- Determine and document the level of preparedness and the extent to which NRC responded to cholera outbreaks in Dadaab camps, including the most recent the ongoing cholera outbreak.
- How were NRC’s interventions coordinated with other actors?
- What key lessons learnt that could be utilized to help improve NRC’s preparedness and response towards similar crisis in the future?
- Identify and document innovations, best practices and areas of learning opportunities.
- What are the positive aspects and how can we can build on these in the future?
- What are the negative aspects we should avoid or improve on?
- What could be the solutions to those problems?
3. Scope of Work and Lines of Inquiry
Evaluation Scope:
The evaluation work shall be carried out in Hagadera and Kambioos refugee camps, covering the period between April 2012 and June 2016.
The evaluator will be expected to perform the following main tasks:
- Design the evaluation methodology and relevant tools to be used.
- Develop the evaluation matrix
- Conduct a desk review of available documents e.g. project proposals, project reports, M&E matrices, logical frameworks, budgets, work plans, any relevant documentation, and the current WASH situation in the whole of Dadaab refugee camps.
- Carry out consultations with the WASH actors in Dadaab and key stakeholders (UN agencies, NGOs and the Government).
- Document specific innovations, best practices and lessons learnt during the years.
- Conduct training of enumerators.
- Conduct visits to the project sites.
- Compile draft report and submit to the evaluation committee for review
- Prepare final report (using the NRC’s evaluation reporting format to be provided by the start date) and submit to NRC.
The consultant shall ensure that all key stakeholders are involved in the evaluation process:
- NRC
- Project beneficiaries – individuals/households/families i.e. persons of concern in Hagadera and Kambioos camps; ensure that related gender issues are considered with participation from women, men, girls, boys, youth, elderly persons and those with special needs, key informants, camp leaders, WASH committees, community workers e.g. hygiene promoters.
- UNHCR, UNICEF and Government line ministries.
- Other organizations operating in Dadaab
- Clearly indicate how data shall be collected and analyzed, and should be able to answer the key evaluation questions.
- Deepen the understanding of the quantitative results from the baseline and other surveys.
- Capture qualitative information not covered in the surveys.
- Investigate how the beneficiaries’ new knowledge and strengthened capacities gained through the project are being applied in practice.
- Highlights advocacy issues encountered during the project implementation and how it could be improved.
- Address innovation or added value to NRC and entire Dadaab refugee operation.
All NRC evaluations are required to respond to two additional ‘Evidence Case Study’ which address a strategically important questions for NRC.
NRC’s programme staff, Monitoring and Evaluation team, and the senior management team do follow up on the findings and recommendations from evaluations conducted under any specific programme.
This evaluation, including the case studies will contribute to an annual learning review which feeds into annual strategic planning processes.
Evaluation Principles
- The views expressed in the report shall be the independent and candid professional opinion of the evaluator. The evaluation will be guided by the following ethical considerations:
- Openness – of information given, to the highest possible degree to all involved parties
- Public access – to the results when there are not special considerations against this
- Broad participation – the interested parties should be involved where relevant and possible
- Reliability and independence – the evaluation should be conducted so that findings and conclusions are correct and trustworthy
An evaluation steering committee has been established with the following NRC staff members:
- Mohamed Bundu – Area Manager Dadaab, Kenya (Chairperson)
- Neil turner – Country Director Kenya
- Catherine Nyokabi – Grants Coordinator Kenya
- Mohamed Biely – Regional M&E Manager
- Under recruitment – Regional WASH Advisor
- Richard Bauer – Global WASH Advisor
- Lian Bradley – Global M&E Advisor
- To establish and approve the Terms of Reference of the evaluation;
- Select the external evaluator/consultant;
- Review and approve the proposed evaluation methodology/strategy and relevant tools to be developed by the evaluator;
- Monitor the evaluation process
- Review and comment on the draft evaluation report;
- Approve the final report
- Establish the dissemination and utilization strategy.
- Project proposals, including narrative, work plans, logical frameworks and budgets.
- KAP surveys reports and relevant assessments.
- Final reports for the WASH projects funded by the different donors.
- M&E matrices
- WASH Strategy for NRC Kenya.
- Security briefing and situational updates.
- Make available, counterpart staff for necessary support in the field
- Make prior contact with relevant stakeholders
- Provide transportation and accommodation needed during the evaluation. Meanwhile, the evaluator is expected to arrange for own meals and other necessary upkeeps for the period of the assignment.
All NRC evaluations should include the following:
- An inception report (see separate guidelines)
- A presentation of findings and recommendations which are discussed and validated and key learnings documented.
- Draft Report
- Final Report
The evaluation work shall take a maximum of 5 weeks, starting by 27th June 2016. Field work in Dadaab is expected to take about 3 weeks.
The consultant shall work under the supervision of the Area Manager (SC Chairperson) or his deputy, with some guidance from the M&E Team and technical support from the line Technical Advisors based at the Country and Head Office.
Deliverable
|
Timeline
|
Detailed work plan
|
3 days after the signing
of the contract |
Desk study – review of project
documents, good practice M&E approaches, etc. |
1 week after the signing
of the contract |
Data collection tools e.g.
methodology, interview guides, stakeholder questionnaires, observation checklists |
1 week after the signing
of the contract |
Evaluation matrix
|
1 week after the signing
of the contract |
Training of enumerators
|
1st week from
the evaluation start date |
Meeting of relevant stakeholders,
interviews, field visits/work. |
2nd & 3rd
week from the evaluation start date |
Draft report and findings presented
to the evaluation committee |
4th week from
the evaluation start date |
Final report
|
5th week from
the evaluation start date |
- Demonstrated 5 years’ experience in planning, formulation and implementation of WASH projects
- Previous experience conducting similar tasks in camps or conflict-affected contexts such as Dadaab
- Excellent report writing skills
- Excellent communication skills; experience facilitating trainings/workshops will be an advantage
- Knowledge of the international humanitarian standards such as Sphere and WHO, related to WASH sector.
- Previous experience working with international humanitarian organizations or UN agencies.
- Master or Bachelor’s Degree in WASH/Public Health or related fields.
Interested Firm / Consultant should submit a maximum 6 page EOI indicating:
- Interest letter; outlining methodology and tools for data collection, management and analysis to be used, and the approach briefing note.
- CV (as annex) or outline of relevant skills and experience possessed by the consultant who will be carrying out the tasks and any other personnel who will work on the project.
- Examples of relevant work, with contacts of at least three organizations, preferably in the last 5 years that have contracted the consultant/firm to carry out WASH Programme evaluation or WASH combined with other sectors e.g. Health/Nutrition, Education.
- Detailed financial proposal, including consultancy fee.
- Be able to complete the assignment within the proposed timeframe (no later than 29th July 2016)
- Proposal including, outline of evaluation framework and methods, including comments on the TOR, proposed timeframe and work plan (bids over 6 pages will be automatically excluded).
- Proposed evaluation budget
- CVs and evidence of past evaluations for each team member