Evaluation database

Evaluation report

2013 Pakistan: Evaluation of UNICEF Programmes to Protect Children in Emergencies: Pakistan Country Case Study



Executive summary

"With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System". Within this system, an external independent company reviews and rates all evaluation reports. Please ensure that you check the quality of this evaluation report, whether it is “Outstanding, Best Practice”, “Highly Satisfactory”, “Mostly Satisfactory” or “Unsatisfactory” before using it. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report."

Background:

The case study of UNICEF programmes on child protection in emergencies (CPiE) in Pakistan is part of a global evaluation commissioned by UNICEF. The evaluation is based on the global Child Protection Strategy (2008) and Core Commitments for Children in Humanitarian Action (CCCs, 2010) considering the effectiveness of the protective environment strategy in pre-emergency, response and recovery phases.

The Pakistan case study aimed to review the country’s child protection programme in terms of appropriateness, effectiveness, quality, efficiency, coordination and sustainability as well as the cross-cutting issues of equality and participation. It emphasized links between formal and less formal components of the system, investments in social change, the use of technical guidance, capacity in monitoring child rights violations, advocacy and knowledge management. It not address current organizational priorities such as resilience and UNICEF’s Monitoring Results for Equity System, as it preceded these developments. More specifically, the case study covered child protection activities in response to the floods in 2010 and 2011/2012, with a focus on Sindh province, which was badly affected in both years, and during the complex emergency in Khyber Pakhtunkhwa and the Federally Administered Tribal Areas (FATA), which has been ongoing since 2009.

Data collection methods included semi-structured interviews, review of data and reports, and focus group discussions involving 267 participants – children, adolescents, women, members of child protection committees and community leaders. A team of two international consultants undertook the interviews and eight local consultants conducted the focus groups. Field work was undertaken in September 2012. Due to security constraints it was not possible for the international consultants to undertake planned visits to Khyber Pakhtunkhwa and FATA.

Purpose/Objective:

The objectives at global and country level were to:
- Analyse the programme in relation to the OECD-DAC criteria24 and against the CCCs, taking account of emergency preparedness, response and recovery phases
- Assess the integration of key organizational principles and approaches, including equity, gender, community participation and human rights
- Identify key successes and gaps (what works, what does not work and why) in armed conflict and natural disaster
- Provide recommendations for policy and management decisions.

Methodology:

Methods used for data collection were: (a) analysis of reports and databases (UNICEF annual reports, donor funding data, human resources data, assessments, reports to donors, government policies, reseach reports, sub-cluster partner reports, etc.); (b) semi-structured interviews with UNICEF staff, government officials at all levels and NGO implementing partners (see list of interviewees in annex 3 and interview guide in annex 5); (c) structured discussions with child protection sub-cluster partners at central level in Islamabad and in Mirpurkhas in Sindh; and (d) focus/activity groups with adolescents in Badin, Mirpurkhas, Jalozai and the Swat Valley. The totals were 24 groups with 267 participants, 145 female and 122 male (see table 5, page 13 of the report).

Findings and Conclusions:

The analysis of findings begins with a review of programme appropriateness in the light of priority protection issues identified by children and women and data on risks. Programme outcomes are subsequently identified against the structure of the CCCs, followed by analysis of effectiveness, efficiency, sustainability and cross-cutting issues of equity and participation.

Recommendations:

The recommendations in the evaluation report are addressed to the UNICEF country office, but many would be undertaken together with government departments and/or child protection colleagues in the CP sub-cluster or working groups as proposed.



Full report in PDF

PDF files require Acrobat Reader.


 

 

Report information

Year:
2013

Country:
Pakistan

Region:
ROSA

Theme:
Child Protection - Other

Type:
Evaluation

Language:
English

New enhanced search