Author: Elayne Gallagher (Team Leader)
“With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System". Within this system, an external independent company reviews and rates all evaluation reports. Please ensure that you check the quality of this evaluation report, whether it is “Outstanding”, “Good”, “Almost Satisfactory” or “Unsatisfactory” before using it. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report.”
Albania is a Delivering as One pilot as was mandated by GA to conduct a country led evaluation of the pilot progress.
The purpose of the evaluation as defined in the Terms of Reference is to assess the progress made by the One UN pilot against the strategic intent, and to assess its role and contribution to the support of national policies and strategies for achievement of national development results. Further, in attention to programme delivery for the period 2007-2009, the evaluation shall examine the value added by the One UN which aims to bring together the expertise and resources of the entire UN system including resident and non-resident agencies in delivering development assistance and technical cooperation under a single, unified programme.
The evaluation follows the Results Based Framework in examining the programme strategy, the institutional structure, the sectors and thematic areas to assess the progress towards outcomes and to identify the inter-relationships of a number of development interventions. The evaluation also assesses the relevance, effectiveness, efficiency and sustainability under the five ones: One Programme, One Budget, One Leader, Harmonized Business Processes and One Voice.
Findings and Conclusions:
The evaluation finds the DaO pilot in Albania as having succeeded in its initial mission, and has transformed the orientation and engagement of the UN system in Albania. Overall, the DaO pilot has been received positively by development partners, government ministries, agencies and their counterpart line ministries, and some sections of civil society as well. There is greater awareness and better understanding of the UN system's broad and deep expertise, which enable a better identification and matching of needs and priorities. At the same time the experiences with the UN’s neutrality and support of EU accession, advocacy on gender issues, as well as the improved coordination with counterparts, have been the most memorable indicators of the improved response of the DaO to Albania's priorities.
The findings and conclusions of this evaluation have resulted in a number of recommendations, which have been divided into six groups: i) Programme Formulation; ii) Implementation arrangements; iii) Results Matrix and Budgetary Framework; iv) Resource Mobilization and Allocations: v) Performance Appraisals; and vi) Decisions to be implemented at higher levels. These are summarized below and details can be studied in the Recommendations section. NOTE: UNICEF DOES NOT CONCUR WITH MOST RECOMMENDATIONS AS THE METHODOLOGY AND THE EVIDENCE DOES NOT SUPPORT THESE ADEQUATELY.
Lessons Learned (Optional):
The Delivering as DaO Pilot in Albania provides some useful lessons to serve the cause of system-wide reforms, which, together with lessons from other pilots, would serve as useful guidance as well as reality checks, for countries that wish to consider DaO approaches, which are as challenging as promising.
Lesson 1: Commitment of the UN Country Teams/HQ, Government and donors are the most critical pre-requisites for DaO pilots.
Lesson 2: Delivering as DaO still means different things to different people.
Lesson 3: The Ones are interdependent and any Cherry-picking among the Ones would undermine the DaO principle.
Lesson 4: A DaO approach requires a major shift in mindsets- individual as well as institutional for all partners.
Lesson 5: In absence of eased corporate requirements and incentive mechanisms - Pilots impose costs on the individual without matching rewards.
Lesson 6: DaO does not imply a bigger UN.
Lesson 7: DaO models are not 'reversible experiments'.
Lesson 8: Accountability and Responsibility warrant matching levels of Authority and Enforcement.
Lesson 9: Individuals will still make the difference.
PDF files require Acrobat Reader.