We’re building a new UNICEF.org.
As we swap out old for new, pages will be in transition. Thanks for your patience – please keep coming back to see the improvements.

Evaluation database

Evaluation report

2017 Angola: Formative Evaluation of Angola Country Programme (2015-2019)



Executive summary

With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System (GEROS)". Within this system, an external independent company reviews and rates all evaluation reports. The quality rating scale for evaluation reports is as follows: “Highly Satisfactory”, “Satisfactory”, “Fair” or “Unsatisfactory”. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report, and the executive feedback summary labelled as ‘Part 3’

Background:

 The evaluation covers all activities implemented during the period 2015 – September 2017 within each programme commponent (Child Survival and Development, Water, Sanitation and Hygiene Promotion, Education, Social Policy, Child Protection, Communication). A special focus should be placed on three specific areas aiming to assess the contribution of the CP for:  I. Substantial decrease in child and maternal mortality; II. Expansion of birth registration within the civil registration and vital statistics system; & III. Expansion of large-scale social assistance scheme to vulnerable families.

It is anticipated that the evaluation will outline lessons learned and recommendations which will be useful in contributing to the growing body of knowledge for the coming Mid-term review and UNPAF planning cycle. The evaluation serves as an important accountability function, providing relevant units of UNICEF, Ministry of Planning, ESARO Regional office, UNICEF HQ, national stakeholders and partners with an impartial assessment of the results achieved so far.

Purpose/Objective:

To provide lessons and recommendations on the progress made towards the results formulated
in the 2015-2019 UNICEF ACO CPAP and inform the Mid-term review (MTR) of
the Country Programme. In addition, the evaluation will be used to ensure that UNICEF
Angola Country Program design is relevant with the new GoA strategic plan (2018-
2022) and UNICEF global strategic plan (2018 -2021).

Methodology:

The methodological framework for conducting this Formative Evaluation of UNICEF Angola Country Programme (2015-2019) was based on the United Nations Evaluation Group (UNEG) Norms and Standards for Evaluation and the OECD Glossary of Key Terms in Evaluation and Results Based Management (2002), as well as by the UNICEF guidelines.

Furthermore, the evaluation team adheres to following UN and UNICEF norms and standards, and copies of all these documents will be provided upon request: i) United Nations Evaluation Group (UNEG) Standards for Evaluation in the UN System, ii) United Nations Evaluation Group (UNEG) Norms for Evaluation in the UN System, (including impartiality, independence, quality, transparency, consultative process), iii) Ethical Guidelines for UN Evaluations and the UNICEF procedure for ethical standards in research, evaluation, data collection and analysis will guide the overall process, iv) UNICEF adapted evaluation report standards and GEROS, and v) The evaluation should incorporate the human rights-based and gender perspective and be based on Results Based Management principles and logical framework analysis.

This evaluation of the CP aimed to achive results as a formative evaluation that will allow gathering information to understand strengths, weaknesses, opportunities and lessons learned. We understand the evaluation process as a systematic collection of information about the activities, characteristics and outcomes of a specific program to determine its merit or worth. If a program is judged to be of merit, it is also important to determine whether it is worth its cost. Evaluation provides credible information for improving programs, identifying lessons learned, and informing about future resource allocation.

Findings and Conclusions:

The programme results of the UNICEF CP are highly relevant for enabling UNICEF to
better align and respond to Angola government priorities.
Despite the CPAP was initially designed for providing institutional support to major
priorities (UPSTREAM models) a shift in national priorities has obliged UNICEF to redirect
staff and resources to provide a direct delivery of commodities and services (downstream
level).
UNICEF’s work is highly valued by other UN agencies due to its reputation and high implementation
capacity at provincial and local level. It has been a strategic partner in several
joint initiatives related to the areas of health and education and it has also demonstrated
its leadership and effective capacity to coordinate and respond to humanitarian crisis
UNICEF has been able to promote its work joining efforts with other important donors
like the EU who has shared common goals and priorities through two important projects
in the area of WASH, Birth Registration, Social Protection and Child Protection.
UNICEF Angola organisational structure is considered appropriate for the implementation
of the CP, as it was designed at the beginning of the period. However, some management
positions and the resource mobilization vacancy need to be filled in order to ensure
the effective implementation of the CPAP during the following two years. In addition, the
high maintenance personnel costs of the office and the changing context related to the
downward trend on resource mobilization and the raise of humanitarian emergencies,
might require ACO to restructure the office for the following CP period.
UNICEF contributed in a critical manner and with great impact for the health of the
children and mothers in angola; namely: provision of food supplements, logistical support
in child vaccination campaigns, monitoring of water quality for human consumption,
maternal and child health, VIH, provision of mosquito nets and other supplies

Recommendations:

Given the socio-economic and cultural diversity of the country, the impact of geographical
dispersion on equity of access and limited resources, it is recommended to maintain
the upstream intervention mechanisms (mainly capacity building and advocacy) together
with a downstream approach with a focus on most deprived geographic areas, most deprived
aged group, cross-cutting areas

Given the evidence obtained these years, the current different context, as well as a new
Unicef Strategic Plan, an exercise of updating the Country Program should be done with
a short and medium term visión, with outcome integration and more focused and result-
oriented approach.

It is recommended to align the Angola UNICEF CP with the UNICEF Strategic Plan 2018
– 2021. It should be strengthen the ability to scale up equity-focused programming and
advocacy, including focusing interventions on the most disadvantaged children and providing
more emphasis in mainstreaming gender equality across the organization’s work,
in line with Gender Action Plan, 2018-2021.

Lessons Learned:

In the first years of implementation of the Country Program (2015-2019), the formative evaluation found the following two lessons learnt:

a) CLTS (Community-Led Total Sanitation) Programme in the area of WASH, benefiting 320 communities and more than 200,000 people, stands as a great achievement. This initiative started as a focused project in 2008 and after a decade became a public policy. Along this decade, this intervention presented innovative models of sanitation service provision and was close to the ground and providing ongoing support to institutional partners at national and sub national level. Based on its success, the ruling party integrated CLTS into its electoral program and committed itself to the national strategy of total sanitation led by the community. Through this experience, ACO identified policy innovations relative to sanitation, especially at a local level, and assisted to the government in devising ways to scale them up.

b)   School feeding represents another field of learning. This governmental program was studied recently trying to identify the impact of nutrition on learning. Although the progress made is still low in terms of educational achievement, the results of the study allowed ACO to assess which programs can be implemented to improve children access to school. The possibility of having food at school incentive children go to school. The implementation of the School Feeding program supposed the interaction of the Ministry of education and Ministry of Agriculture to give school snacks using local products (promoting local economies). Based on this initiative, ACO identified and documented local efforts (even ones at small scale) to improve social outcomes like child nutrition or access to education.



Full report in PDF

PDF files require Acrobat Reader.


 

 

Report information

Year:
2017

Country:
Angola

Region:
ESAR

Type:
Evaluation

Theme:
Program Excellence

Partners:
Government of Angola, and NGO partners

Language:
English

Sequence:
2017/007

New enhanced search