We’re building a new UNICEF.org.
As we swap out old for new, pages will be in transition. Thanks for your patience – please keep coming back to see the improvements.

Evaluation database

Evaluation report

2015 Moldova: Evaluation of the project on HIV prevention among MARA and EVA



Executive summary

End-of project evaluation of the interventions aimed to promote an integrated approach to developing services for most-at-risk adolescents and youth implemented during March 2012- December 2014

With the aim to continuously improve transparency and use of evaluation, UNICEF Evaluation Office manages the "Global Evaluation Reports Oversight System". Within this system, an external independent company reviews and rates all evaluation reports. Please ensure that you check the quality of this evaluation report, whether it is “Outstanding, Best Practice”, “Highly Satisfactory”, “Mostly Satisfactory” or “Unsatisfactory” before using it. You will find the link to the quality rating below, labelled as ‘Part 2’ of the report.

Purpose/Objective:

The main purpose of the evaluation
To assess end of project results and achievements in relation to the project objectives and document good practices, lesson learned for future programming.

Specific objectives

  1. To assess the improvement of the first-line aid for project beneficiaries (vulnerable and excluded youth)
  2. To evaluate coordination and capacity of professionals to provide quality services through the circles of solidarity
  3. To measure the increase of HIV/AIDS awareness on the part of the young people.
  4. To evaluate contribution of the project to improvement of government policy on vulnerable youth.

Methodology:

Desk review of the available information on project documents, activity reports, laws strategies and regulations, monitoring and evaluation report and other relevant sources was analyzed and summarized for the report. 
Individual interviews with project coordinators, direct and representatives of partner organizations as key informants.
 Interviews with coordinators and key informants assessed the views of key stakeholders in how successful the project was and its sustainability, the comparative advantage of UNICEF and Non-Governmental Organizations (NGOs) as implementers, and opinions about impact and sustainability of the project after its end.
Interviews with direct beneficiaries gained a diversity of opinions of beneficiaries from different categories as defined in the project document, sought diversity to include equal representation of boys and girls, younger and older ages and participation of different ethnicities.

Findings and Conclusions:

The project responded adequately to the needs of boys and girls in the districts and was well received by both target groups and partners of this project. The component of strengthening circles of solidarity took into account existing institutional and human capacities and built further these capacities.
Implementation objectives and programmatic targets were fully met. The targets were achieved or surpassed for most key indicators.
Different groups have been reached by the project in each of the project sites. The outreach deployed three strategies: (1) community actions, aiming the general youth in public spaces; (2) mobile outreach, aiming to identify MARA at EVA by going in specific places where vulnerable youth gathers for primary contact and (3) outreach with specific groups, after risks and vulnerabilities have been identified.
Some elements of the project have a higher degree of sustainability than others. The interviews with project implementation teams, partners and outreach workers revealed that the activity that has the highest potential for sustainability is the established circles of solidarity and their strengthened capacity to work with MARA and EVA, as it has built the capacity of existing structures and service providers and have managed to establish personal and professional networks and cross-referrals at local level that were not there before the project.
The project was gender sensitive and has equally targeted boys and girls with sensitivity towards gender balance of peer outreach workers. The project has encouraged and brought adolescent participants as outreach workers in its core activities and the outreach work has been designed and implemented by adolescent peers with their ideas and approaches embedded in continuous improvement and adaptation of approaches for community-based work.

Recommendations:

  1. Build on local experience and capacity to further improve the MARA programs.
  2. To provide further support and focus on continuing cross-sector collaboration and strengthen circles of solidarity. The case-management of each MARA accessing at least one service in the circle of solidarity should be prioritized and strengthened, so that no matter the entry point, the adolescents receive available services for time as needed.
  3. Diversify and prioritize efforts to reach out to MARA and EVA. More focus should be placed on the choice of the modalities to outreach to the most vulnerable segments, finding and establishing appropriate seeds, as well as identifying and employing appropriately skilled outreach workers and volunteers with capacity to work with MARA.
  4. Strengthen and continue developing the component of street-based assistance to children, particularly in Chisinau. It is very important to continue focused support on implementing a street-based program in Chisinau, continuing advocacy to establish sufficient capacity for this effort, change the paradigm of street assistance, and advocate for municipal financial support for this program.
  5. Continue support to further monitoring of use of diversion schemes for children at risk and those in conflict with the law.
  6. Strengthen the capacity of the M&E system to track client pathways throughout the circle of solidarity and establish an M&E component to measure outcomes and impact.
  7. Operationalize and implement the developed and approved national policies.

Lessons Learned:

The initial planning stage took much longer than expected for both the project implemented through NGO TDV Balti in five sites and for the project in Chisinau. The teams in five sites thought they needed more steer and outside technical support to understand how to better approach and what is realistic and feasible given the available resources and context.
A key lesson learned from this project was the initial assessment of the capacity to penetrate to the most vulnerable and the most at-risk groups of adolescents through chosen modalities of outreach and using peers. The level of outreach to most vulnerable adolescents highly depended on the previous experience of the NGOs to work with adult key populations, an experience extrapolated to target younger groups.
While the project has managed to build many sustainable activities through circles of solidarity and capacity strengthening of service providers, and work at policy level, the peer-led outreach is the first one to be discontinued after project end and has not been integrated in the current services in the five sites. Of note is that in Chisinau, it appears that the use of public structures has increased the sustainability of the outreach component, based on progress reports, but given that this happened only in the last few months during project extension, it is premature to assess sustainability and quality of this outreach work.



Full report in PDF

PDF files require Acrobat Reader.


 

 

Report information

Year:
2015

Country:
Moldova

Region:
CEE/CIS

Theme:
HIV/AIDS - Young People

Type:
Evaluation

Institution:
Center for Health Policies and Studies (PAS Center)

Language:
English

New enhanced search