List of projects

List of Projects:

BRASIL PROXIMO
Description: The Brasil Proximo program stems from the innovative collaboration agreement signed between the Presidency of the Federative Republic of Brasil and the Umbria, Marche, Tuscany, Emilia Romagna and Liguria.
The overall objective of the program is to improve the living conditions of vulnerable groups in the Brasilian society according to the geographical priorities of the Federal Government. Specific objective of the program is instead to reinforce the “federative” policies (Federal Government, States and Municipalities) with regards to area-based development strategies favoring micro-enterprises, Small and Medium Enterprises, and cooperatives.
Within this framework, the Scuola Sant’Anna was appointed to implement the assessment process. Adopting a “critical friend” approach, the Evaluation Unit will then provide a systematic analysis of the programme, highlighting its most innovative features, while also conveying specific recommendations to improve the activities implemented by the programme.
The assignment foresees a mid-term review and a final evaluation. In the evaluation process the Scuola will use the OECD-DAC criteria and will carry out two field missions in Brasil (one of which is ongoing).
Client: Regions of Tuscany, Umbria, Marche, Emilia Romagna and Liguria.
Donor: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Timeframe: 2010-2015.
Type of assignment: mid-term and final evaluation.
Number of projects evaluated: 1.
Budget: 6,77 million euro.

COUNTRY PROJECT SENEGAL FONDAZIONI 4 AFRICA
Description: Fondazioni4Africa has represented the first instance in which four Italian leading bank foundations pooled resources to initiate joint development cooperation projects. The project enacted in Senegal aimed to improve the economic and social conditions of the populations living in rural and suburban areas of Senegal by promoting highly innovative initiatives for integrated development, entailing coordinated actions in various sectors (agriculture, fisheries, herding, microfinance, and sustainable tourism). Also peculiar to the initiative have been a series of pilot actions to harness the potential of the associations of the Senegalese diaspora resident in Italy to the development of their home-country, coupled with a strategy of reinforcement of the associations themselves.
The Scuola Superiore Sant’Anna was then tasked to set up a monitoring system for the initiative, to act as a “critical friend”- that is to flag possible shortcomings in planned and implemented activities and to advise donor, management and partners on possible improvements- and finally to undertake a final comprehensive evaluation of the project. In furtherance of the mandate received the Evaluation Team revised more than 1,000 project documents, and during 4 field missions held some 400 interviews.
Client: Fondazioni4Africa.
Donor: Fondazione Cariplo, Compagnia di San Paolo, Fondazione Cariparma and Fondazione Monte dei Paschi di Siena.
Timeframe: 2008-2014.
Type of assignment: independent monitoring, mid-term and final evaluation.
Number of projects evaluated: 1.
Budget: 6 million euro.

MACEDONIA, CITIES OF STIP AND PRILEP: IMPROVEMENT OF THE QUALITY OF LIFE AND INTEGRATION OF ROMA COMMUNITIES
Description: Ex post evaluation of the project “Macedonia, Cities of Stip and Prilep: improvement of quality of life and integration of Roma Communities”, realised by the NGO INTERSOS and financed by the Italian Ministry of Foreign Affairs. The project, carried out from 2004 to 2007, aimed to support marginalised Roma communities by improving hygienic conditions of Roma settlements, increasing the level of Roma children literacy, supporting the organization of multicultural initiatives to favour integration between Roma and Macedonians.
The evaluation was entrusted to assess the relevance of the intervention objectives and their level of achievement, to express an opinion on efficiency, effectiveness, impact and sustainability of the project, to identify good practices and lessons learned in order to improve future technical assistance interventions. The evaluation was realised using the Theory of Change Methodology. To achieve its objectives, the assignment included a field mission in Macedonia.
Client: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Donor: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Timeframe: 2013.
Type of assignment: ex-post evaluation.
Number of projects evaluated: 1.
Budget: 1,56 million euro.

II AGREEMENT ON DEBT FOR DEVELOPMENT SWAP BETWEEN ITALY AND PERU
Description: Signed in January 2007, the II Agreement debt for development swap between the Government of Italy and the Government of disciplined the swap of a bilateral debt amounting to roughly 72 million USD (principal and cumulated interests) to be credited in various instalments to a specific fund denominated Italian Peruvian Fund. The resources generated have then been used to fund development projects geared towards the reduction of poverty jointly agreed by the two parties. As of 2013, three different calls for proposals allowed to finance 89 projects in the following sectors: economic development, infrastructures, social sector, local capacity building, and environment.
The Italian Ministry of Foreign Affairs entrusted the Scuola Superiore Sant’Anna to undertake an interim evaluation covering the 2007-2013 period. The evaluation was to ascertain the coherency between the policy of the Italian Directorate General for Development Cooperation and the priorities of the Peruvian Government as well to make an appraisal of the functioning of the Italian-Peruvian Fund.

The Evaluation Team relied on a variety of sources of information as to ensure triangulation of information, reliability of data, and credibility of findings, including: background literature; over 400 between Programme documents, and reports from previous evaluation and monitoring activities of the Italian-Peruvian Fund; semi-structured interviews and focus groups with more than 100 persons; case studies and on-site visits realized during a field mission held in June 2013.
Client: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Donor: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Timeframe: 2013.
Type of assignment: mid-term evaluation.
Number of projects evaluated: 1.
Budget: 72 million USD.

TUSCANY REGION INTERNATIONAL DEVELOPMENT PROJECTS
Description: The Region of Tuscany devotes every year substantial resources to development cooperation activities through a number of different funding lines. Among those two are particularly critical in pursuing the policy objectives of the Region, that is the one that supports the so-called “micro-projects”, and the one devoted to finance the geographic “coordination roundtables”.
Indeed, given the high number of actors that undertake development cooperation actions –NGOs, local authorities, universities, trade unions, associations and CBOs, and so on– the Region has set up a number of geographic roundtables (Asia, Africa, Latin America, Europe, Middle East and Mediterranean Basin) whose objective is to promote synergies and coordination among the different players as well as to design joint projects that the Region will then finance. On the other hand, mindful that such a system could exclude smaller players, the Region has also a funding line devoted to micro-projects, that those development projects for which the maximum contribution elicited is in the range of 20 thousand euro.
Within this framework the Scuola Superiore Sant’Anna was tasked to ascertain the coherency of the projects financed through the two above-mentioned funding lines with the Regional Plan on Development Cooperation and its strategic objectives, to assess the quality of the projects financed, and to formulate recommendations as to improve overall management and projects’ follow up.
As for the evaluation of the micro-projects funded between 2007 and 2011, a pool of 12 projects financed over the years in Africa, Middle East, Latin America and Asia was selected to test their level of efficiency, effectiveness and sustainability. For two of the selected projects, one initiative aimed at supporting mentally disabled youth and another one in support of local development planning, field visits have been held, respectively in Nicaragua and Bosnia and Herzegovina.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2012-2013.
Type of assignment: final evaluation.
Number of projects evaluated: 12.
Budget: 4 million euro.

TUSCANY REGION INTERNATIONAL DEVELOPMENT INITIATIVES
Description: The Region of Tuscany displays quite an unique system of decentralized cooperation. A key feature of the very same system are the geographic coordination roundtables (Asia, Africa, Latin America, Europe, Middle East and Mediterranean Basin) whose objective is to promote synergies and coordination among the many actors as well as to design joint projects that the Region will then finance.
Within this framework the mandate entrusted to the Evaluation Unit called for the monitoring and final evaluation of the 10 projects undertaken by the geographic coordination roundtables and financed by the Region of Tuscany for the year 2009.
The Evaluation Team has then proceeded to set up a monitoring mechanisms (designing the formats, establishing the procedures) and to revise with the projects partners the monitoring and evaluation frameworks proposed with regard to benchmarks and milestones.
The monitoring service then aimed to describe the ongoing activities and the projects’ intermediate results, as well as to identify eventual problems and to formulate useful recommendations to redirect the interventions. As for the final evaluations of the 10 projects these assessed relevance, effectiveness, efficiency and sustainability of the initiatives based on a desk review of the available documentation and on the outcomes of in-depth interviews with projects partners.
Field missions have been possible as to gather primary data and interviews beneficiaries and stakeholders for two of the projects: one in one in Albania (rural development, social inclusion, gender equality and institutional capacity building) and a second one in Lebanon (health, social inclusion and local capacity building) within the framework of the UNDP Art Gold Initiative.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2010-2013.
Type of assignment: independent monitoring and final evaluation.
Number of projects evaluated: 10.
Budget: 2 million euro.

“NETSAFRICA” SOUTH AFRICAN-TUSCAN NETWORK
Description: NetsAfrica aimed to enhance the process of administrative decentralisation in the Republic of South Africa, with a view to consolidate the role of local institutions on the path towards democratization and peace, as well as the realisation of effective policies and services to fight poverty and ensure access to basic services. NetsAfrica purposes were: i) to improve the capacity of the Department of Cooperative Governance and Traditional Affairs (COGTA) in supporting the path of strengthening local institutions under the new reform of local government, with particular reference to the issue of public participation and empowerment of communities; ii) to increase the capacity of Eastern Cape and Gauteng provinces and of 4-5 districts/municipalities within the same provinces, in the formulation of policies and services to fight poverty and ensure access to basic services. NetsAfrica activated direct relationships between Tuscan local and regional bodies and similar institutional levels in South Africa to foster the development of local policies and/or innovation in the management of social services.
The evaluation had two main objectives: i) provide NetsAfrica partners with a mid-term analysis of specific case studies and ongoing activities in order to identify main weaknesses and strengths of the programme and, if necessary, to readdress and improve programme strategies; ii) provide NetsAfrica partners and the wider public with an overall final independent assessment of the programme and identify key lessons learned with the aim of capitalising on experiences and improving future strategies. The assignment included two field missions in South Africa.
Client: Tuscany Region.
Donor: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Timeframe: 2010-2012.
Type of assignment: mid-term and final evaluation.
Number of projects evaluated: 1.
Budget: 4 million euro.

ASSESSMENT OF THE TUSCANY REGION POLICY TO PROMOTE A CULTURE OF PEACE IN THE PERIOD 2007-2010 AND EX POST EVALUATION OF THREE STRATEGIC PROJECTS
Description: i) Elaboration of an evaluation framework to assess to what extent the objectives of the Tuscany Region policy to promote a culture of peace and respect of human rights in its territory and in developing countries were reached in the period 2007-2010.
ii) Ex post evaluation of three strategic projects directly promoted and financed by the Region in the period 2007-2010. The projects were implemented in Tuscany and they concerned: the annual human rights meeting addressed to secondary school students organised by the Region; an international college located in Tuscany that provides a multi-cultural education to students coming from disadvantaged third countries; an international poetry festival.
iii) Statistical compilation of micro-projects financed by the Tuscany Region to promote a culture of peace in the Tuscany schools in the period 2007-2010 by open call for proposals.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2011.
Type of assignment: ex-post evaluation.
Number of projects evaluated: 3.
Budget: approx. 5 million euro.

TECHNICAL ASSISTANCE TO THE TUSCANY REGION IN DESIGNING ITS INTERNATIONAL DEVELOPMENT INITIATIVES
Description: The Region of Tuscany displays quite an unique system of decentralized cooperation. A key feature of the very same system are the geographic coordination roundtables (Asia, Africa, Latin America, Europe, Middle East and Mediterranean Basin) whose objective is to promote synergies and coordination among the many actors as well as to design joint projects that the Region will then finance.
Within this framework the Evaluation Unit was trusted with the ex-ante evaluation of 34 project proposals put forward by the geographic coordination roundtables between 2009, 2010 and 2011 (total value of the projects more than 5 million euro, regional funding 3.52 million euro).
The procedure did not include a selection of the best project proposals based on a merit list, but rather was meant to improve the projects’ design quality through a two-pronged evaluation procedure and a “critical friend” approach.
The work was then organized in the following six phases: i) definition of the Terms of Reference for the submission of project proposals in accordance with regional strategic documents; ii) definition of the evaluation criteria; iii) first evaluation round: evaluation of submitted projects using the double-blind review process, finalization and transmission to the Region of the evaluation results; iv) meetings between the evaluators and each applicant to debate on the first assessment results, explaining the reasons for judgments and acquiring more information and details on project plan from the project designer; v) second evaluation round: according to the requests and suggestions of the evaluators, project designers had the possibility to integrate and modify their proposals so new projects were evaluated again according to the double-blind, then the Evaluation Unit elaborated and transmitted to the Region the results of the second evaluation round; vi) drafting and transmission to the Region of a final report focused on the analysis of the evaluation process’ results with specific observations and recommendations, aimed at improving project quality (e.g., changes in the structure of the grant application form or changes in the score assigned to each evaluation criterion, etc.).
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2009-2011.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 34.
Budget: approx. 5 million euro.

CULTURE OF PEACE MICRO-PROJECTS FINANCED BY THE REGION OF TUSCANY
Description: In the framework of the Regional Strategy to enhance a Culture of Peace in Tuscany, the Evaluation Unit was entrusted to carried out the ex-ante evaluation of 203 applications submitted to the Tuscany Region from 2006 to 2011 on the occasion of the annual call for proposal to select relevant micro-projects to be financed (total value of the projects around 2 million euro, regional funding around 1 million euro). In particular micro-projects – proposed by Tuscan local authorities, schools, NGOs and associations – aimed to implement development education and awareness raising activities mainly addressed to pupils, students and teachers of the Tuscany schools and universities.

The objective of the ex-ante evaluation was to verify that the financed micro-projects had clearly articulated their intervention logic and could effectively contribute to the regional goals in promoting a culture of peace. The evaluation of the quality of the submitted projects was made using the double blind review process.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2006-2011.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 203.
Budget: 2 million euro.

MICRO-PROJECTS FINANCED BY THE TUSCANY REGION
Description: Ex ante evaluation of 544 micro-projects proposals in the field of decentralised cooperation submitted to the Tuscany Region from 2004 to 2011 in response to its annual call for proposal (total value of the projects around 10 million euro, regional funding 4.79 million euro). Micro-projects – presented by Tuscan local authorities, NGOs and associations – aimed to implement development actions in many different sectors (rural development, capacity building, institutional building, education, vocational training, social inclusion, natural resources protection, economic development, etc.) and in all geographical areas.
The aim of the ex-ante evaluation was to ascertain that the financed micro-projects were relevant and well designed in order to contribute to achieving the objectives of the Tuscany International Decentralised Cooperation Strategy. The evaluation of the interventions quality was made using the double-blind review process.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2004-2011.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 544.
Budget: 10 million euro.

MONITORING OF THE INTERNATIONAL HEALTH PROJECTS FINANCED BY THE TUSCANY REGION
Description: Monitoring of projects financed by the Tuscany Region to improve health in developing countries in 2007 (23 interventions) and in 2008 (24 interventions) through two different funding lines.
Monitoring was meant to supervise projects’ activities and to verify whether they were likely to meet the objectives and performance targets, as well as formulate recommendations as to addressed perceived shortcomings. Monitoring also aimed to give useful recommendations to improve the implementation of the Tuscany Region International Health Strategy with regards to its effectiveness and efficiency.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2009-2010.
Type of assignment: independent monitoring.
Number of projects evaluated: 47.
Budget: approx. 4 million euro.

ASSESSMENT OF THE INTERNATIONAL HEALTH COOPERATION MICRO-PROJECTS FINANCED BY THE TUSCANY REGION
Description: Ex ante evaluation of 95 health international cooperation projects submitted to the Tuscany Region in 2007, 2008, 2009 and 2010 in response to a yearly open call for proposal of the Region.
Ex ante evaluation aimed to ensure that the financed micro-projects had clearly articulated their intervention logic and could contribute to the Tuscany International Health Cooperation Strategy. The evaluation of the projects proposals was made using the double-blind review process.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2007-2011.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 95.
Budget: approx. 2 million euro.

FIRENZE-ASMARA KM 0
Description: The project “Firenze-Asmara KM 0”, carried out from 2004 to 2007, was jointly promoted by the Med School of the University of Florence, the Meyer Pediatric Hospital and the Careggi Teaching Hospital and financed by the Region of Tuscany.
The initiative aimed to improve the public health services in the country by supporting the staff already working in Asmara hospitals and hence it aimed at: i) to ameliorate the structural and functional condition of the emergency department of the only children hospital in the Country, the Mekane Hiwet Pediatric Hospital; ii) to set up an emergency department in the Orotta Teaching Hospital of Asmara; and finally iii) to establish a Public Health School in Eritrea.
The final evaluation was entrusted to ascertain relevance, efficiency, effectiveness, impact and sustainability of the programme. To achieve its goals, during the final assessment the Evaluation Unit realised a field mission in Eritrea that allowed to collect primary data and interview beneficiaries and other stakeholders.
The evaluation findings were widely discussed with project partners and the donor. The outcome of the evaluation proved instrumental for the Region of Tuscany decision to have monitoring and evaluation of all its health cooperation projects rather than just on an ad hoc basis.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2007-2008.
Type of assignment: final evaluation.
Number of projects evaluated: 1.
Budget: approx. 2 million euro.

SUPPORT TO THE ACTIONS AGAINST THE DISCRIMINATION OF THE AKA PYGMY MINORITY IN CENTRAL AFRICAN REPUBLIC
Description: The Scuola Sant’Anna was commissioned by the Italian NGO COOPI to carry out the final evaluation of the international cooperation project “Support to the actions against the discrimination of the Aka Pygmy Minority in Central African Republic” co-funded by the European Initiative for Democracy and Human Rights (EIDHR). The project value was approximately 1 million euro, it began in 2003 and ended in 2006 and was implemented by COOPI in partnership with the Diocese of Mbaiki and the Centrafricain Observatoire des Droits de l’Homme.
On the basis of the obtained results the final evaluation of the project aimed to asses effectiveness, impact and sustainability in order to: i) realise and submit to EuropeAid a final external evaluation of the initiative; ii) formulate useful suggestions to implement a second phase of the intervention; iii) analyse COOPI methodology in working in the field of minority rights defense and promotion. To accomplish the final evaluation a field mission in Central African Republic was carried out.
Client: COOPI.
Donor: European Commission – EuropeAid.
Timeframe: 2006.
Type of assignment: final evaluation.
Number of projects evaluated: 1.
Budget: 1 million euro.

ASSESSMENT OF SOCIAL INCLUSION INITIATIVES FINANCED BY UNICOOP TIRRENO
Description: The consumers cooperative Unicoop Tirreno (food retail) contracted the Scuola Sant’Anna to evaluate 58 projects in the field of social inclusion and local cohesion in order to finance the most relevant initiatives. The evaluation of the quality of the submitted projects was made using the double-blind review process.
The total value of the project proposals was around 10 million euro and the total amount of grant funds was 350,000 euro.
Client: Unicoop Tirreno.
Donor: Unicoop Tirreno.
Timeframe: 2006.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 58.
Budget: 10 million euro.

EX POST EVALUATION OF PROJECTS AIMED TO PROMOTE A CULTURE OF PEACE
Description: Ex post evaluation of 8 projects financed by the Tuscany Region in 2004 to promote a culture of peace in the Tuscan schools. The evaluation meant to understand the effective results achieved by the initiatives and to what extent the projects had contributed to the objectives of the regional strategy to enhance public awareness on peace and human rights issues.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2006.
Type of assignment: ex-post evaluation.
Number of projects evaluated: 8.
Budget: 200.000 euro.

SEENET PROGRAMME – LOCAL GOVERNMENTS AS DEVELOPMENT ENGINES
Description: The Seenet Programme – Local governments as development engines, was promoted by the Tuscany Region and Istria Region and co-funded by the Italian Ministry of Foreign Affairs. The goal of the Programme, carried out in collaboration with the Italian NGOs Ucodep (now Oxfam Italy) and Cospe, was to promote the development of a network of local governments aimed at the institutional strengthening and the improvement of managerial competences in the field of economic development planning, and of public services. The project involved 21South-East European local authorities from Albania, Bosnia and Herzegovina, Croatia, Kosovo, Macedonia, and Serbia. In Italy 22 local authorities joined the network.
The main purpose of the evaluation entrusted to the Scuola Superiore Sant’Anna was to provide the Seenet Programme with a systematic analysis to improve its performance. The assessment aimed also to highlight strengths, weaknesses and innovative aspects, and to understand whether it was deemed useful and, if so, how to plan a second phase of the programme.
The evaluation has foreseen a field mission in Bosnia and Herzegovina, Croatia and Serbia.
Client: Tuscany Region.
Donor: Italian Ministry of Foreign Affairs – Directorate General for Development Cooperation.
Timeframe: 2004-2006.
Type of assignment: mid-term evaluation.
Number of projects evaluated: 1.
Budget: 4 million euro.

GEO, YOUTH AND EMPLOYMENT
Description: The GEO project, presented by the Province of Massa-Carrara in partnership with the Province of Lucca and of La Spezia and carried out between December 2002 and February 2005 with the financial support of the European Union, was addressed to young unemployed people living in geographically near and economically similar zones. The project aimed to promote local development actions to boost the economy of these areas, traditionally rich in cultural and touristic resources, to overcome fragmentation and particularism by creating synergies in order to offer new employment opportunities to young people.
In order to submit to the European Social Fund the external evaluation of the project, the three partner Provinces entrusted the Scuola Superiore Sant’Anna to carry out the final appraisal of the GEO project according to the following criteria: effectiveness, efficiency, sustainability, innovation and transferability. In addition to these criteria, the Evaluation Unit also took into consideration two additional evaluation criteria, i.e. relevance of the original design and impact.
Client: Province of Massa Carrara.
Donor: European Commission – European Social Fund.
Timeframe: 2005.
Type of assignment: final evaluation.
Number of projects evaluated: 1.
Budget: 2 million euro.

DEVELOPMENT INITIATIVES AFTER THE TSUNAMI EMERGENCY IN SOUTH-EAST ASIA
Description: After the Indian Ocean earthquake and tsunami hat occurred on 26 December 2004, the Tuscany Region decided to launch an open call for proposals to finance development cooperation initiatives to undertaken in the affected South-East Asian countries. The budget of the call was around 1,5 million euro.
Within this framework the Tuscany Region assigned to the Scuola Superiore Sant’Anna the ex-ante evaluation of the 3 submitted project proposals. The evaluation of the was made using the double-blind review process.
Client: Tuscany Region.
Donor: Tuscany Region.
Timeframe: 2005.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 3.
Budget: 1,5 million euro.

DEVELOPMENT COOPERATION PROJECTS FINANCED BY THE PROVINCE OF LIVORNO
Description: The Evaluation Unit was entrusted to carried out the ex-ante evaluation of 15 applications submitted to the Province of Livorno in response to a call for proposal to select relevant development cooperation projects.
The evaluation of the quality of the project proposals was carried out with the double-blind review process.
Client: Province of Livorno.
Donor: Province of Livorno.
Timeframe: 2004.
Type of assignment: ex-ante evaluation.
Number of projects evaluated: 15.
Budget: 90.000 euro.