Program & Policy Evaluation

Measuring a project’s progress through key indicators and evaluating its impact on beneficiaries are crucial in making sure program budgets are spent efficiently and effectively to attain the goals set out. High-quality monitoring and evaluation of programs allows development practitioners to better gauge their impact while improving service delivery. In particular, learning from past experiences and efficiently planning and allocating resources allows them to demonstrate accurate results and remain accountable to their key stakeholders. 

Can Father Training Programmes Help Reduce Gender-Based Violence: Lessons from a Parenting Intervention in Turkey

Gender and Women's Empowerment

Globally there is a growing interest in the design and implementation of preventive gender-based violence programs that target men. This article seeks to extend literature on the impact of father training programs on fathers’ attitudes about parenting and gender-based violence, by using a case study from a father-training program in Turkey for men with children of ages 3-6 and 7-11 years old. The paper finds modest improvement in fathers’ approaches and attitudes towards democratic parenting, violence and gender equality. The evidence of moderate effectiveness of the intervention programme aligns with the subset of other systematic research studies in the literature. Even though the programme impact is limited, the intervention is successful for two reasons (i) in recruiting men for a parenting program, in a country where cultural and social pressures to adhere to the conventional masculinity is a norm, (ii) in learning lessons and evolving the parenting intervention programme by gaining new advocates by conducting corporate-wide projects, seminars on fatherhood and gender equality for keeping fatherhood discussion alive, forming local father networks to sustain learning outcomes after programme implementation, alongside the Father Support Programme.

📖 Read the paper on SSRN

July 24, 2019

Myanmar Dry Zone Social Protection Project Endline Assessment

Poverty, Cash Tranfers

“Dry Zone Social Protection Project” has been implemented by HelpAge International in collaboration with the Mandalay YMCA to help vulnerable households in the Dry Zone to cope and manage risks. This three-year project had the objective to expand social protection by enhancing informal community-based mechanisms and practices; strengthening government and community capacity to protect the poor; and delivering cash benefits to vulnerable groups (people with disabilities and older people). The project ended in December 2018. The locations of the project were a total of 180 villages with 30 villages in each of six target townships of two regions of Myanmar. In addition to the two different baseline surveys collected at the beginning of the project, two endline surveys were collected to measure change in vulnerability and social protection over the course of the project and also measure the impact of the cash transfers. In collaboration with ODI, Development Analytics assisted with the endline assessment's study design, data analysis, and reporting on the findings.

May 2018 - December 2018

Decentralised Evaluation of the ECHO funded Emergency Social Safety Net (ESSN) in Turkey

Poverty, Cash Tranfers

Turkey is the country with the largest refugee population in the world with 3.9 million refugees, 3.6 million of whom are Syrians as of April 2019. The Emergency Social Safety Net Programme (ESSN) started being implemented at the end of 2016 and aimed to provide at least 1 million refugees with an unconditional and unrestricted cash transfer of 100 TL per month (which was raised to 120 TL later on) making it the largest ever EU-supported humanitarian cash transfer programme. The programme is available to all foreigners with refugee status who live off-camp and are under temporary protection or international protection. The programme is funded by the European Commission through European Civil Protection and Humanitarian Aid Operations (ECHO) and is implemented through the Turkish government social welfare system by means of an ATM cash card. The WFP is a key stakeholder in the project and worked closely with ECHO to design and implement the programme. The interim evaluation assesses the first year of the programme’s implementation and is aimed to be used to inform decision-making in the second year. In collaboration with Oxford Policy Management, Development Analytics was involved in organising fieldwork, carrying out focus group discussions and key informant interviews, and conducting qualitative data analysis.

 

 

📖 Download the report 

April 2017 - October 2018

Interim Evaluation of Women's Human Rights Trainings​

Gender, Women’s Empowerment, Human Rights

In the scope of the project “More and Better Jobs for Women: Women’s Empowerment through Decent Work in Turkey”, an Implementation Agreement with Women for Women’s Human Rights-New Ways (WWHR) was signed to deliver a women’s human rights training for 2000 women and human rights seminars for 1250 men and women in project provinces of Ankara, Bursa, Konya, and İstanbul. Women’s human rights training is provided to women participating in the vocational training courses offered by the municipalities in project provinces in line with the work-plan of the project. The monitoring and evaluation of the training aimed to measure the effectiveness, quality of the training in various aspects, as well as to receive recommendations on how to improve the training for the second phase, as planned to take place in September 2016 until the end of December 2016.

The purpose of the evaluation is to:

 

1.     Determine if the training has made progress towards its stated objectives and outcomes and explain why/why not;

2.     Provide recommendations on programme improvement and further action for the second phase of training between September-December 2016.

3.     Where necessary, identify the possible needs to refine content, duration, methodology, trainer approach

May - September 2016

Impact Evaluation Capacity Building for Eastern and South-eastern Anatolia Development Agencies

Impact Evaluation Training

Many countries and governments around the world have prioritized impact evaluations of existing programs in order to base fiscal decisions on evidence-based results of the impact of programs. In this respect this project titled “Impact  Evaluation Capacity Building for  Eastern and South-eastern Anatolia Development Agencies” aimed to contribute to sustainable and evidence-based policy making in regional development in Turkey by increasing the analytical capacity of regional development agency staff in eastern and southeastern regions of the country through trainings and capacity building in quantitative counterfactual impact evaluation methods. 

 

The project was led by the Eastern Anatolia Development Agency (Doğu Anadolu Kalkınma Ajansı - DAKA) with the technical support provided by Development Analytics and Institute for Fiscal Studies (IFS). The project was funded by the European Union under the Civil Society Dialogue between EU and Turkey – IV – Regional Policy and Coordination of Structural Instrument Grant Scheme.

📖 Download the handbook titled "Impact Evaluation Methods in Evaluating Development Programmes and Applications from Turkey" here.

February 2016 - August 2017

Impact Evaluation Capacity Building for Eastern and South-eastern Anatolia Development Agencies

Impact Evaluation, Capacity Building

This project titled “Impact  Evaluation Capacity Building for  Eastern and South-eastern Anatolia Development Agencies” aims to contribute to sustainable and evidence-based policy making in regional development in Turkey, by increasing the analytical capacity of regional development agency staff in eastern and southeastern regions of the country through trainings and capacity building in quantitative counterfactual impact evaluation methods. Many countries and governments around the world have prioritized impact evaluations of existing programs in order to base fiscal decisions on evidence-based results of the impact of programs.

 

The project is led by the Eastern Anatolia Development Agency (Doğu Anadolu Kalkınma Ajansı - DAKA) with the technical support being provided by Development Analytics and Institute for Fiscal Studies (IFS). The project is funded by the European Union under the Civil Society Dialogue between EU and Turkey – IV – Regional Policy and Coordination of Structural Instrument Grant Scheme. Read more...

 

February 2016 - August 2017

Final Evaluation of the Pilot Implementation of SCORE Methodology in Turkey

Sustainability, Employment

Sustaining Competitive and Responsible Enterprises (SCORE) is a practical training and in factory counselling programme to increase the productivity of small to medium-sized enterprises (SMEs) while promoting respect for workers’ rights. The programme demonstrates best international practice in manufacturing and service sectors and helps SMEs to participate in global supply chains. The intervention in Turkey targeted SMEs in Turkey in a selected province; Kocaeli to improve the competitiveness and productivity levels of the selected SMEs through strengthening the workplace cooperation and working conditions to ensure scaling up SCORE programme by the relevant government agencies and industry organizations to enable a larger number of SMEs to benefit from the SCORE in Turkey. The final evaluation of the Project aimed to assess the results of the work done in order to properly report on the results as well as define the steps for possible further project development in the improvement of working conditions in SMEs and SME efficiency and productivity. The evaluation applied the key criteria of relevance, effectiveness, efficiency, sustainability and impact potential. To this end, a fieldwork composing of in-depth interviews had been conducted, and original data collected through i) these qualitative interviews, and ii) quantitative surveys from the programme participants.

December 2015 - April 2016

Final Global Evaluation of the Decent Work in the Green Economy Project

Sustainability, Employment

The ILO project “Decent Work in the Green Economy” has focused on the employment aspects of national efforts to transition to a green economy. The project was implemented in 3 countries Mexico, China, and Turkey. The global evaluation report was undertaken in this project after carrying out the local interviews in Turkey and receiving local country reports for Mexico and China. The report followed the guidelines indicated in the TOR and included: (i) the project’s relevance and effectiveness; project achievements against immediate objective and expected outputs; (ii) emerging outcomes and impacts of the interventions; (iii) lessons learned and recommendations for future projects of similar focus.

March - July 2015

Final Evaluation Report for "A Fair Start for Young Children in Turkish Rural Communities" Project

Early Childhood Care and Education, Gender and Women's Empowerment

“A Fair Start for Young Children in Turkish Rural Communities” project was conducted by the Mother Child Education Foundation (AÇEV) in Tokat durnig 2012-2015. The purpose of the project was two-fold: (i) to improve the physical, mental, social and emotional development of young children in rural Turkey by engaging them in an early childhood education program, and (ii) to increase the community awareness in early childhood education.  The mixed methods evaluation of the project utilized quantitative data that was collected from treatment and control villages in the baseline and post-test surveys, qualitative data from 16 focus groups with beneficiary and non-beneficiary mothers and fathers in the program area, and in-depth interviews and a short quantitative survey of teachers in the final phase of the program. 

November 2014-August 2015

Impact Evaluation of the Hüsnü M. Özyeğin Rural Development Program in Eastern Turkey

Rural Development, Impact Evaluation, Aid Effectiveness

The Özyeğin Rural Development Program was launched in January 2009 in project villages in Bitlis with the aim of reducing rural poverty by investing in improving the returns to the assets of the poor: mainly by means of investments in agricultural technology and human development. This final evaluation report considers the impact of the Özyeğin Rural Development Program by looking particularly at changes in economic and human development related outcome indicators five years after the launch of the program. A household survey was collected from treatment and control villages just before the start of the programme in 2009 and and later in 2014. The survey instrument includes modules on agricultural activities, migration, household assets, income & consumption, time use, social networks, access to education and health services, and women’s empowerment. The fieldwork was funded by the Hüsnü M. Özyeğin Foundation while Development Analytics was responsible for the design of the impact evaluation study, the design of the survey instrument, training of enumerators in the field, training of data entry staff, econometric analysis and preparing the final report.

📖 Download the report 

December 2008 - March 2014

Impact Evaluation of UN-Women Father Training for Violence-Free Families Project

Women’s Empowerment

The project evaluated the impact of a 3-year project funded by the UN- Women Trust Fund for Reducing Gender-Based Violence and implemented in Turkey by the Mother Child Education Foundation (AÇEV). The Father Training for Violence-Free Families Project (FTVFFP) aims to prevent violence against women and girls (VAW/G) by engaging men in a comprehensive and community-based violence prevention program. Throughout the three-year project, fathers and their wives were trained in a program that aims to foster democratic, anti-violent and gender-sensitive attitudes and behaviours within the family. The impact evaluation study used a mixed methods methodology using both quantitative surveys and qualitative focus groups and key informant interviews. 

The evaluation aimed (i) to measure improvements and changes in outcomes as a result of the trainings, in terms of  the fathers’ attitudes towards their children and wives, and the mothers’ awareness of violence and the existing legal structure in Turkey for protecting against VAW/G; (ii) to describe the external and contextual factors that may have also been at play and influenced the factors measured during the evaluation;  (iii) to identify the strengths, weaknesses, challenges and trends in the project activities that have implications for strengthening its future administrative, programmatic and strategic directions.

 

📖 Download the report 

 

March 2014

Socioeconomic Impact of Mining on Local Communities in Africa

Welfare and Poverty Measurement, Africa

This analysis focuses on finding the socioeconomic impact of mining on local communities in 2 case countries in Africa: Tanzania and Mali. More specifically, the impact of the extractive activity on households’ welfare and children’s nutrition and education indicators was examined. Data used in the study are coming from various sources such as Demographic Health Surveys (DHS), Household Budget Surveys (HBS) and Censuses of Population of the two countries. Information on the location, opening date and actual production of mines in Tanzania and Mali were also used. According to the data provided by the World Bank on the operation of mines in these two countries, the first mine started operating in Tanzania in 1998 and the in Mali in 1997. The study follows a diffs-in-diffs methodology looking at outcome variables before the setting up of the mines and about a decade after the mines have been in existence. In order to have a good understanding of the impact of gold extraction on the outcomes different specification methods were employed throughout the analysis regarding the choice of treatment units, the treatment variable and control units. 

March 2014 - June 2014

Tools to Assess Value for Money in Agriculture: Agriculture Sector Dialogue

Impact Evaluation, Agriculture, Capacity Building

This project involved the preparation of a key-note paper and case studies describing ex-ante and ex-post quantitative evaluation methodologies in agriculture in Africa. The paper reviewed a list of about 30 studies using ex-ante and ex-post impact evaluations that have been conducted in Africa in the agricultural sector and selected studies that highlighted applications of each methodology to African case studies.  In addition, two in-depth case studies were prepared on Mali and Malawi's agricultural sector program impact evaluations.  The case studies included interactive sessions providing the context of the policy to the policymakers, and asking them questions in each step to solve pieces of the puzzle, thus imparting in them the necessary tools for discussion and selection among various methodologies and techniques. The keynote paper and case studies were presented in Johannesburg at the CABRI Tools to Assess Value for Money in Agriculture: Agriculture Sector Dialogue on April 14-15, 2014.  The two-day workshop was attended by delegates from Ministries of Finance and Agriculture from 13 CABRI member African countries. 

 

📖 Download the Keynote Paper: "Tools to assess value for money in Agriculture

📖 Download the Case study for Mali

📖 Download the Case study for Malawi

 

📖Read our article: "Development Analytics delivers Training on Impact Evaluation Methods in Agriculture to Ministerial Delegates from 13 African Countries"

October 2013 - June 2014

Please reload

Related Projects

 

impact evaluation turkey, qualitative analysis turkey, development analytics turkey, quantitative analysis  turkey, social policy turkey, qualitative research turkey, FGD turkey, focus group discussions turkey, policymakers training turkey, training turkey, ECD turkey, early childhood education turkey, Women's Empowerment turkey, childcare turkey, education turkey
impact evaluation MENA, qualitative analysis MENA, development analytics MENA, quantitative analysis  MENA, social policy MENA, qualitative research MENA, FGD MENA, focus group discussions MENA, policymakers training MENA, training turkey, ECD MENA, early childhood education MENA, Women's Empowerment MENA, childcare MENA, education MENA
impact evaluation middle east, qualitative analysis middle east, development analytics middle east, quantitative analysis  middle east, social policy middle east, qualitative research middle east, FGD middle east, focus group discussions middle east, policymakers training middle east, training turkey, ECD middle east, early childhood education middle east, Women's Empowerment middle east, childcare middle east, education middle east

تقييم الاثر ، التحليل النوعي ، التحليلات التنموية  ، تحليلات كمية ، اسياسات اجتماعية، البحث النوعي ، جلسات تركيز  ، مناقشات مجموعة التركيز ، تدريب صناع السياسة  ، تدريب  ، تعليم مبكر، ، تعليم الطفولة المبكرة  ، تمكين المرأة ، رعياة الطفولة ، التعليم 

Kalitatif , yapıcıların eğitimi, eğitim, erken çocukluk eğitimi, Kadınların Güçlendirilmesi, çocuk bakımı, eğitimanaliznicel analiz, sosyalpolitika, nitel araştırma, politika

CONTACT US

research@developmentanalytics.org

Emirgan Mah, Emirgan Mektebi Sokak. No:31, 34467 Sarıyer/İstanbul, Turkey

+90 (212) 277 86 41

 

9 Marlborough Court OX2 0QT Oxford, UK 

+44 7857006512

Development Analytics provides evidence based research for social program and policy development. Our main areas of study are poverty, education, health, social protection and the overall distributional impact of social policies. We specialize in large scale data analysis and statistical methods for social research. Our clients include central governments, international development organizations, NGOs (as well as corporate clients with a social responsibility vision). We provide our clients with research and tools to (i) understand and diagnose social problems, (ii) devise programs to tackle these issues and (iii) to measure and rigorously evaluate their results.