We’re building a new UNICEF.org.
As we swap out old for new, pages will be in transition. Thanks for your patience – please keep coming back to see the improvements.

Evaluation database

Evaluation report

2017 Nigeria: INDEPENDENT EVALUATION OF UNICEF NIGERIA TRAINING INVESTMENTS



Author: Universalia Management Group

Executive summary

With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System (GEROS)". Within this system, an external independent company reviews and rates all evaluation reports. The quality rating scale for evaluation reports is as follows: “Highly Satisfactory”, “Satisfactory”, “Fair” or “Unsatisfactory”. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report, and the executive feedback summary labelled as ‘Part 3’.

Purpose/Objective:

UNICEFs’ recognizes Capacity Development (CD) an important component of achieving results for children and are geared toward realization of children’s rights . As part of the UNICEF global strategic mission, it ensures that capacities of individuals and institutions are built by gaining new skills, knowledge and expertise. In sync with this mission, UNICEF has developed individual and institutional capacities for thousands of individuals and many institutions across the globe and in Nigeria as well over each country programme period durations. Over the years UNICEF Nigeria has invested heavily in, consequently evaluating the past efforts over a long period of time is critical for organizational learning and to new and innovative ways to improve. Consequently, it is critical to gain a better understanding of the factors contributing to successful initiative.
Capacity Development is a major strategy promoted as part of the 2014- 17 strategic plan. More than 6 out of 7 outputs explicitly refers to capacity development.  Capacity development at individual, organizational and institutional levels has always been one of the main UNICEF implementation strategies. Support to individual and community capacity development is often provided through trainings which is a crosscutting strategy that is expected to transfer skills and for target to gain new knowledge that will promote positive social norms and behaviors, including demand for services by the right holders from duty-bearers. To strengthen the capacity of Nigerian governments at all levels, UNICEF Nigeria focuses on training and technical assistance to reform government institutions and improve service provision; by for example, strengthening supply chain management; piloting models for scaling up, using Federal, States and Local Government Systems.

Methodology:

The evaluation adopted mixed methods for the data collection and was conducted in six phases:
 Launch call (August 2016),
 Evaluability Assessment (September 2016)
 Inception mission to UNICEF Nigeria’s offices in Abuja and visits to six field offices to establish data sources (September 2016)
 Data collection in eight States in Nigeria (November 2016-January 2017)
 Data analysis and report writing (February-April 2017)
 Validation of findings and submission of final report (April 2017)
Following (a) two launch conference calls with UNICEF Nigeria’s M&E division (August 2016); (b) an assessment of information available and missing, presented in the Evaluability Assessment (September 2016);  (c) a three-day inception mission to UNICEF Nigeria’s offices in Abuja, including phone conversations with field offices (September 2016); (d) visits to six field offices to establish data sources and data collection in eight States in Nigeria  (November 2016-January 2017); (e) data analysis was conducted and followed by report writing (February-April 2017). (f) A debrief presentation was conducted in UNICEF Nigeria country office to validate the evaluation’s findings and conclusions and collect stakeholders’ perceptions and feedback. The report was then revised to its final version (April 2017).
This evaluation is aligned with the obligations of evaluators relating to independence, impartiality, credibility, conflicts of interest, and accountability.
The following section outlines the approach adopted to complete this assignment.

Findings and Conclusions:

Evaluation findings were mixed in terms of relevance. Beyond the various notable efforts to meet the national training needs, UNICEF Nigeria’s Training Investments were not designed as a coherent programme and lack an explicit theory of change. In the absence of a national capacity gap analysis, trainings are scattered, which undermines relevance of the portfolio of training investments.
UNICEF Nigeria’s individual training activities respond to a certain extent to the needs of participants with opportunities for some possible improvements. However, the current training participant selection processes give no insurance as to how targeted its portfolio of trainings is in terms of selection of beneficiaries. The evaluation the evaluation noted the absence of a comprehensive national training strategy where trainings are strategically planned to respond to national training needs.  From a design perspective, all sectors except the Child Protection sector adopt the same approach of delivering trainings through Training of Trainers (ToT). In terms of monitoring and evaluation, some efforts are made to monitor training participants’ learning at the field level. However, the monitoring of participants’ reaction, learning, changes in behaviour and impact is not systematic.
Based on all data collected and analyzed training activities, there is a high potential for effectiveness in terms of reaction and changes in behaviour.  Survey respondents found the training to be favorable and engaging where they acquired useful knowledge. In terms of efficiency, the evaluation concluded that the ToT approach is a contributing factor to efficiency. In conclusion, a considerable effort is put forth by UNICEF in Nigeria for the delivery of trainings to facilitate the implementation of UNICEF’S Country Programme in Nigeria. However, the planning process is not part of an overarching country strategy, which leads to a diversity of trainings that runs the risk of dispersal.

Recommendations:

 Recommendation 1: UNICEF in Nigeria should develop a comprehensive country training strategy to design trainings proactively, as opposed to focusing on individual punctual training activities that support specific aspects of programme implementation.
 Recommendation 2: UNICEF in Nigeria should further monitor and evaluate its trainings by adopting monitoring and evaluation mechanisms and developing M&E instruments, guidelines and templates for training activities that systematically collect data on all training activities, expenditures and results.
 Recommendation 3: UNICEF in Nigeria should ensure appropriate data management through the establishment and management of a database on trainings

Lessons Learned:

Findings are also lesson learned




Full report in PDF

PDF files require Acrobat Reader.


 

 

Report information

Year:
2017

Country:
Nigeria

Region:
WCAR

Type:
Evaluation

Theme:
Management Excellence

Partners:
Nigeria Country Office

Language:
English

Sequence:
2017/001

New enhanced search