2013 Egypt: Country Programme Evaluation
Author: Christian Privat (leading author), Rocio Sanz, Ola Mandil, Nader Kellini and Nihad Rageh
"With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System". Within this system, an external independent company reviews and rates all evaluation reports. Please ensure that you check the quality of this evaluation report, whether it is “Outstanding, Best Practice”, “Highly Satisfactory”, “Mostly Satisfactory” or “Unsatisfactory” before using it. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report."
The report presents the results of the Country Programme Evaluation based on the Country Programme of Cooperation (CPC) between UNICEF and the Government of Egypt (2007-2011). The evaluation covers also 2012 as the CPC that was extended one more year due to the uncertainty prevailing in the country, in the aftermath of the Egyptian revolution.
Throughout the country programme cycle, UNICEF Egypt has completed a series of evaluations of several programmes; however, the Young Child Survival and Development (YCSD) and Child Protection programmes, together with the HIV/AIDS and Early Child Development Programme sub-components were never evaluated. These are the focus of the present Country Programme Evaluation (CPE).
The primary audience of this evaluation is the UNICEF country office; the secondary audience is mainly partners from Government, NGOs and other civil society actors.
The scope of the CPE covers the current Country Programme (CP) (2007-2012), with focus on the following country programme components:
1) Reducing child and maternal mortality and morbidity;
2) Addressing malnutrition and micronutrient deficiencies;
3) School improvement to promote quality education;
4) Improving protection of children from violence, abuse and discrimination; and
5) Reducing vulnerability to HIV-AIDS.
The geographic scope of the evaluation corresponds to the areas covered by the programmes mainly on the national level and the local level in Upper Egypt Governorates (mainly Assiut, Menya, Sohaq and Qena) as well as Cairo and Alexandria.
The present report includes the context in which the CPE is implemented, the methodology, the findings for each programme component subjected to this evaluation, as well as cross-cutting issues, lessons learned, conclusions, and recommendations.
The main objectives of the Evaluation are the following:
1.Assess the relevance and appropriateness of target CP components
2.Evaluate the effectiveness, efficiency and sustainability of the outcomes achieved
3.Assess the coherence and focus of the CP in Egypt
4.Assess the gender, HRBA and equity focus of the CP
5.Assess the comparative advantage, partnerships and coordination mechanisms of UNICEF in Egypt
6.Provide an analysis on how UNICEF could position itself strategically to add value in response to national needs and changes in the national development context
The UNICEF Country Office in Egypt valued the importance of having a Country Programme Evaluation (CPE) to feed into the preparation of the new country programme document. Therefore, the main purpose of this CPE was to feed into the upcoming strategy development ensuring that the next country programme targets the needs identified after the revolution as well as the recommendations highlighted to ensure sustainability and effectiveness of the interventions in the future. In that sense, the CPE focused on strategic directions and provided an assessment of the relevance, design and focus of the CPC, its effectiveness and efficiency, as well as of the role, of UNICEF’s support to the realization of children’s ad women’s rights. The CPE also addressed the dimensions of sustainability and connectedness of supported initiatives, in a context of high political volatility and uncertainty.
The evaluation was designed to involve the participation of UNICEF staff, implementing partners and stakeholders such as government and local institutions, civil society, academia, villages, communities and direct beneficiaries. The participatory approach was followed to consider the views of both duty bearers and right holders in contributing to protecting and promoting children’s rights within the framework of the different programmes and subcomponents.
The CPE provided evaluative insights for evidence-based strategic decisions about positioning UNICEF in the country, its strategic approaches and programmes, its partnerships, its operations design and implementation.
The evaluation reviewed the major results to determine the extent to which UNICEF effectively impacted the situation of children and women in Egypt overall. Based on the most recent guidelines produced by UNICEF HQ, the CPE was human rights-based, equity focused and gender sensitive.
In accordance with its participatory approach, the evaluation started with a National Consultation Workshop, held on September 4th, 2012, with the purpose of gathering inputs from partners on the evaluation approach as well as the Country Programme components’ implementation.
Fieldwork data was mainly gathered: by conducting Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) with beneficiaries from target populations, partner institutions and implementing governmental staff in different levels as well as UNICEF staff; and by making first-hand observations, collecting surveys, and reviewing documents and literature.
Field visits included four Governorates namely Cairo, Alexandria, Assiut and Sohag. For the YCSD programme, fieldwork focused on Cairo, Assiut and Sohag; for HIV-AIDS on Alexandria and Cairo; for Child Protection on the four Governorates; and for Education on Cairo, Assiut and Sohag.
Findings and Conclusions:
The programme is relevant, linked with National Priorities. Programme design was participatory
Some interventions have pilot nature
Clear ownership by the Government. Strong linkages at the field level
Programme objectives were partially achieved. Positive impact on FHU performance
No consensus on sustainability of the interventions (due to lack of strong governance structure and professional capacity at MoH/FHUs). Potential for replication at a wider scale
Relevant programme, linked with the national priorities
Interventions have more a pilot nature than a national implementation
Participation of beneficiaries was minimal in the design and implementation
Ownership strong with MoHP. Other stakeholders were not as involved in the programme
Most of the expected results were partially achieved. Some, not achieved (e.g. home-based care)
Limited geographic coverage
Sustainability and replicability at a large scale are major challenges
Child Protection component
Relevant and aligned National Priorities. Results complementary to those of other organization working in the same sector.
Programme design suitable to the country context and the organizational set-up of government Designed according to results-based standards, but most indicators did not have a baseline
Programme successful in promoting the Child Protection Mechanism
A large part of the programme expected results were achieved or partially achieved
Capacity development initiatives are more likely to be sustained if build on clear evidence
The programme complements policies and strategies of GoE
Partners see this programme as essential to improve the education system in Egypt
GoE acknowledges ownership
Increased awareness among the schools outside the target group
Most the expected results were achieved or partially achieved
Sustainability not assured (stakeholders not sure on the ability to keep facilities operational)
1.Adapt the interventions to respond to new emerging demands
2.Strengthen equity by including school age children
3.Increase the involvement and role of civil society
4.Design should address the scaling up from the beginning
5.Provide services in the field with innovative solutions
6.Ensure sustainability, supporting institutional development
7.Having an emergency plan
1. Awareness campaigns, with the participation of PLHIV
2. Government and civil society should be involved in joint programming
3. Include the following domains: 1) HIV and breastfeeding, 2) HIV and Hep C, 3) slum areas, 4) Elimination of MTCT
4. Capacity building should be inclusive to ensure the involvement of communities
5. Re-activate home-based programme for PLHIV
6. Sustainability – Joint programming
7. The HIV programme should have plans ready to manage emergencies
Child Protection component
1. Knowledge generation and exchange on the situation of children
2. Establishing set of indicators on child protection issues when developing capacity building initiatives
3. Expand partnership. Develop strategic partnerships
4. Results frameworks and budgets to be aligned to assess the expenditure with respect to the best interest of the child.
5. Define structure and dynamics for the CPC
6. Development of monitoring systems (not simply case monitoring)
7. Provide partners with tools for gender mainstreaming
8. Support cross-programme synergies with education, health and community awareness
1. MoE should develop targeted strategies to meet the needs of the schools
3. ECO should continue lobbying for the implementation of the Resource Rooms
3. Leadership training. The MoE should require teachers’ certification for promotion
4.Refreshing training or promotion exams
5. Revisiting the focus of Resource Rooms. Education tools to equip the Resource Rooms should address each individual separately
Key lessons learned for each programme component are reported in the executive summary of the report.
Full report in PDF
PDF files require Acrobat Reader.