Evaluation database

Evaluation report

2013 Liberia: An evaluation of ECHO- Funded Water, Sanitation and Hygiene (Urban WASH- II) Project in Monrovia, Liberia



Author: WASHealth Solutions: Stephen Ntow

Executive summary

"With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System". Within this system, an external independent company reviews and rates all evaluation reports. Please ensure that you check the quality of this evaluation report, whether it is “Outstanding, Best Practice”, “Highly Satisfactory”, “Mostly Satisfactory” or “Unsatisfactory” before using it. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report."

Background:

In the year 2012 UNICEF in partnership with NGO partners embarked upon implementation of an ECHO-Funded Urban WASH project in deprived communities around Monrovia. Although the project was contracted under emergency WASH conditions there were far reaching development and sustainability considerations at all levels of the project. The project has become known as Urban WASH-II (UW-II: SM120084). The project was meant to deliver sustainable water, sanitation and hygiene promotion services to deprived urban slums to ensure continuous availability of the facilities and voluntary change in WASH behaviours long after the project is over. This assignment therefore is to establish the extent to which the facilities and processes proposed have been met as part of the UW-II project.

Purpose/Objective:

1. Objectives of the assignment
The purpose of the assignment is to provide data which should enable UNICEF report to ECHO on the indicators and targets listed in Urban WASH-II SM120084. In addition the evaluation was meant to assess the impact, coverage, coherence, relevance/appropriateness, effectiveness and efficiency of the project.
1.1 Specific objectives
i) To provide analysis of urban WASH II (SM120084) project achievements and setbacks against planned results, assess the project’s intervention logic, promote accountability, and assist future improvements in performance.
ii) To provide data which will allow UNICEF to report to ECHO on the indicators and targets listed in the urban WASH II: SM120084 proposal.

Methodology:

A stratified random sampling method was adopted to represent different sections of communities and to reflect the following characteristics of the population under review. These include; population, social, literacy (formal education), cultural, economic indicators and also access to WASH facilities and services. A convenient sample of 456 was drawn from 12 out of 18 communities selected at random. A combination of conventional and participatory methods was used to gather both quantitative and qualitative. The software Statistical Package for Social Sciences (SPSS) was used to process and generate frequencies and cross tabulations. This was done in collaboration with Liberia Institute of Statistics and Geo-Information Services (LISGIS).

Findings and Conclusions:

The major source of primary data was collected from mothers with children less than five years old. Almost all of them have lived in the community more than six months preceding the date of interview. A period considered long enough to express relevant opinions about Urban WASH – II project. They have a varied background ranging from none formal education to tertiary level education.

Almost all the planned outputs and services have been completed and those under construction are close to completion but the intended contribution to reduction in suspected cases of cholera is yet to be realised in the numbers reported at the Cholera Unit.

Recommendations:

To a large extent the project has achieved most of the original objectives. The project has created management capacity and it is financially sustainable in the short to term. It’s objective to contribute to reductions in suspected cholera and other diarrhea diseases have however not been achieved. Also, some specific targets have performed below average performance of other sections. The least performing areas included:
a. Garbage collection and disposal.
b. Promotion, proper use and monitoring the use of WaterGuard.
c. Increase in diarrhoea diseases despite the intervention.
The project was found to be coherent having complied with most sector policies and the provisions in project proposal. It was found to be relevant and appropriate as it sought to reach the poor and diarrhea prone communities of Monrovia. Monitoring arrangements put in place to ensure project accountability was followed closely. The project was also found to be effective and efficient. There is no information on how lessons from the previous project (urban WASH-I) have been adopted and systematically implemented as lessons to enhance the outcome of the current and future project.
Some WASH committees lack some capacities and so do the communities lack the ability demand and hold their committee to account for their stewardship. Some sector agencies have expressed dissatisfaction with their partial involvement during project implementation.

Lessons Learned:

There is no information on how lessons from the previous project (urban WASH-I) have been adopted and systematically implemented as lessons to enhance the outcome of the current and future project. As part of this report however, the following are lessons identified so far:
1. Although sector policies are widely circulated, the mere awareness does not necessarily ensure compliance.
2. The creation and subsequent training of WASH committees will not naturally lead to effective performance. They need some hand-holding, support and post implementation/construction monitoring to ensure good performance.
3. When poor communities have several WASH needs. Working with them to identify and solve initial problems empowers them to identify and articulate new and emerging issues.
4. The implementation of WASH projects do not immediately and directly relate to declines in suspected cases of Cholera and diarrhoea diseases.



Full report in PDF

PDF files require Acrobat Reader.


 

 

Report information

Year:
2013

Country:
Liberia

Region:
WCARO

Theme:
Water and Environmental Sanitation

Type:
Evaluation

Language:
English

New enhanced search