Project Grant Evaluation
RHSP initiative’s aim is to contribute to creating a generation of Roma professionals in the medical field who would contribute to improving access to quality health services for Roma communities, as well as helping dismantle negative stereotypes about Roma with their own positive examples as Roma qualified professionals. Until now RHSP has been the only regional program of the kind targeting Roma medical students. Since it was launched in 2008 and until summer of 2015, RHSP provided support to 527 Roma medical students from the four countries. Based on desktop research, program administrative data, and survey methodology, the main objective of this tracer study is to investigate the degree in which the RHSP program contributed to a successful academic and professional trajectory of its beneficiaries after seven years of program implementation, as well as the degree to which its beneficiaries managed to enter the labor market upon graduating.
Compiled and written by Inka Píbilová and Iveta Klusáková, this mid-term external evaluation of Together to Preschool summarizes the project's progress since beginning in November 2012. Together to Preschool aims to promote quality preschool education and desegregated primary schooling for socially disadvantaged Roma. The project has since provided access to preschool education for disadvantaged, mainly Roma children aged three to six in two Ostrava neigbhorhoods: Poruba and Mariánské Hory – Hulváky. The project is being implemented by Beleza Ostrava o.s. and White Rhinoceros (Bily Nosorozec o.p.s.). Donors and partners are the Roma Education Fund and Ostrava Municipality. The project will run till October 31, 2015.
Mnohé studie zdůrazňují, že čím dříve budou mít sociálně znevýhodněné děti přístup ke kvalitnímu předškolnímu vzdělání, tím jednodušší budou mít přístup ke vzdělání jako takovému. Zároveň poukazují na to, že segregace dětí (i v předškolních zařízeních) vede později k horším studijním výsledkům. Kvalitní předškolní vzdělávání a nesegregované základní vzdělávání pro sociálně znevýhodněné Romy (ale i děti z majority vesrovnatelných podmínkách) jsou hlavními cíli hodnoceného projektu Společně do školky. Tento projekt poskytuje přístup k předškolnímu vzdělávání pro znevýhodněné, převážně romské děti ve věku 3 až 6 let ve 2 lokalitách v Ostravě: Poruba a Mariánské Hory – Hulváky. Realizovaly jej Beleza Ostrava o.s. a Bilý Nosorožec o.p.s. Dárci a partneři projektu jsou Romský vzdělávací fond a Magistrát města Ostravy. Rozpočet projektu činí 210,447 EURO (asi 5,8 mil. Kč) na období od 1. listopadu 2012 do 31. října 2015.
- A Tracer Study - The Academic and Professional Trajectory of the Roma Education Fund`s Law and Humanities Scholarship Program's Student Beneficiaries 2014
After 10 years of implementing Law and Humanities [scholarship] Program and following the request of one of the Program’s donors, REF proceeded towards investigating the degree in which the respective Program contributed to the academic trajectory of its beneficiaries, as well as whether the beneficiaries managed to enter the job market on positions relevant for their studies after obtaining higher education degrees. The main reason for doing this is for identifying the ways in which the REF Scholarship Program could be better tailored to respond to the needs of its beneficiaries and to help them become successful in their initial career stages. This tracer study presents the results of this investigation.
Inclusive education, in its broadest sense, has been recognized as one of the priorities of the Government of the Republic of Serbia as shown in the Law on The Foundation of Education (LoFE). To aid the implementation of the LoFE and support the development of inclusion in the Republic of Serbia, the World Bank has introduced and funded the Delivering of the Local Implementation Services (DILS) project that, inter alia, included school grants and municipal grants for the promotion of education inclusion. The main objective of this study was to evaluate the effects of the two components of the DILS project related to education:a) the program "Strengthening schools for inclusive education" at the school level, which includes training for school staff and grants for school projects and b) grant program "Education Inclusion of Roma" (DILS/REF program).
As part of the commitments undertaken under the Decade of Roma Inclusion, the Roma Health Project (RHP) of OSF, together with the Roma Education Fund (REF) (Hungary), joined efforts with the purpose of providing support for health education, mentorship and health advocacy training for students in medical schools, nurses colleges and medical vocational education, as well as for resident doctors of Roma origin. The Roma health scholarship program, “Leadership in Health: A Generation of Professionals in the Health Care System” addresses the most urgent issues faced by the largest European minority in the health care system.
The Roma Health Scholarship Program under the name of “Roma Leadership in Health: a Generation of Health Professionals” was set up in 2008 by the Open Society Foundations Public Health Program (OSF PHP) in cooperation with the Roma Education Fund (REF) and financed by OSF. The aim of the program was to provide support for health education, mentorship and advocacy training for Roma in Central, Eastern and Southern European countries, with a pilot project in Romania. The program objectives were to create a stratum of Roma health professionals and to combat discriminatory behavior and racist attitudes towards Roma among the health professionals. The project was piloted in Romania and was rolled out in Bulgaria in 2009 and extended to Macedonia and Serbia in 2010.
- External Evaluation Outcome Assessment and Lessons Learnt from Swedish Development Cooperation with Macedonia (1999–2012)
In October 2011, Sida commissioned Indevelop to carry out an “Outcome assessment and lessons learnt from Swedish Development Cooperation with Macedonia (1999-2012)”. The title of this report summarises well the main aim of this study, i.e., identifying results on an outcome level as well as providing a better understanding of what the Swedish Government and Sida could learn from the processes of the last decade´s development cooperation with Macedonia. This evaluation cites the Roma Education Fund throughout, with a case study of its Macedonian activities on page 141.
- Executive Summary of the External Evaluation of REF-supported Project in Croatia "From preschool to full integration September 2011 – June 2012"
The National Centre for External Evaluation of Education provides assessment of the entire project implementation involving parents, children, teachers, Roma teacher assistants. Special focus is put on the quality and pedagogical impact of the preschool programs. NCEE will carry out a thorough initial survey and the final assessment of the implementation of the project which will provide basis for evaluation. The following report contains data on the initial assessment which was carried out during February 2012. The aim of the initial assessment was to inquire elements of quality of the program from preschool education to full integration. With a goal to identify the initial status and to improve the program an initial external evaluation of the quality of the program was performed. The children were involved in the assessment along with the ones involved in the realization of the program.
- External Evaluation of REF-supported Project in Macedonia "Scholarship, Mentoring and Tutoring for Secondary Roma students" 2012
The general aim of the project “Scholarship, Mentoring and Tutoring for Roma Secondary Students” (MAC 052) is through positive interventions to improve the retention and achievement rate of all Roma students enrolled in secondary school. The project is managed by the Department for Promotion and Development of Education in the Languages of Minorities, in the frames of the Ministry of Education and Science and is based on two main pillars: providing scholarships to secondary school Roma students with a GPA of at least 3.00 and providing mentorship and tutorship support to all Roma students enrolled in secondary education. The main project beneficiaries during the past two project implementation years were: 784 students (444 in 2009/10 and 611 in 2010/11, 271 of which second-year grantees) recipients of scholarship and mentorship support, a pool of students (about 100 in 2010/11) which were not financially supported but received mentorship/tutorship support, 84 secondary schools throughout the country where the project activities were taking place and 353 teachers selected as mentors or tutors. This evaluation report provides an assessment of the first two years of project implementation (2009/10 and 2010/11 school years) with regards to the project efficiency, effectiveness and impact.
- External Mid-term Evaluation of “Inclusive Quality Pre-Primary and Primary Education for Roma/Egyptian Children" 2011
The goal of the Save the Children in Albania (SCiA) project is to “provide children from different ethnic groups with the opportunity to interact and socialize, learn about each other, thus improving interethnic relations among the mainstream schools students and wider community”. The four-year SCiA project started in April 2008 and has been financed by Roma Education Fund, Medicor, Save the Children Sweden and Save the Children Norway.
The evaluation research of the Romaversitas Foundation requested by the Roma Education Fund (REF) was carried out by the Kurt Lewin Foundation. The first phase of the research was conducted between October 2010 and January 2011, while the second phase took place in July and August 2011. The study discusses – among others – the aims, history, impact, results of the Foundation; the components of the services offered for the participants; the requirements to be completed by the students; the operation of the organization; its financial situation; strengths and weaknesses; main problems and the recommendations for the solution of these problems.
The Romaversitas Project is one of the few efforts made in the Republic of Macedonia aimed at improving university education of the Roma population. It has established itself not only among the Roma, but also among the non-Roma student population. The Romaversitas Project demonstrates a high degree of successfulness in the realization of the set goals and objectives and achievement of the set indicators. The evaluation confirmed the high degree of satisfaction on the part of the RV Project beneficiaries with their participation therein. The majority of Romaversitas students beneficiaries progress successfully in their studies and achieve the academic standards expected in higher education. The support of the tutors and their participation in the other RV Project activities are directly related to their success in the studies.
The project evaluation of “Support for High School Roma Students in Romania” was based on a research methodology which included: (1.) the analysis of documents and data evidence gathered throughout the implementation of the project; (2.) in-depth interviews with more than 58 beneficiaries of the programmes, as well as 13 mentors and nine professors that have taught the students selected in this project; additionally, a focus group was conducted with eight parents of beneficiaries from Reghin - Mureș and extensive discussions have been carried out with the manager of the project and other members of the implementation team; (3.) analysis of quantitative data – the database created during the programme by the implementers has been completed by updating and adding supplementary information (in electronic format) gathered through filling in questionnaires concerning the situation of 156 project beneficiaries.
The evaluation was conducted on the behalf of the Foundation Resource Center for Roma Communities (RCRC) by Claudiu Marius Ivan and Roxana Georgiana.
- External Evaluation Report of REF-supported “Romas Graduate and Enhance Their Lives, Phase 1 and 2” in Macedonia 2009-2011
The general aim of the project “Scholarship, Mentoring and Tutoring for Secondary Roma Students” (MAC 052) is through positive interventions to improve the retention and achievement rate of all Roma students enrolled in secondary school. The project is managed by the Department for Promotion and Development of Education in the Languages of Minorities, in the frames of the Ministry of Education and Science and is based on two main pillars: providing scholarships to secondary school Roma students with a GPA of at least 3.00 and providing mentorship and tutorship support to all Roma students enrolled in secondary education. The main project beneficiaries during the past two project implementation years were: 784 students (444 in 2009/10 and 611 in 2010/11, 271 of which second-year grantees) recipients of scholarship and mentorship support, a pool of students (about 100 in 2010/11) which were not financially supported but received mentorship/tutorship support, 84 secondary schools throughout the country where the project activities were taking place and 353 teachers selected as mentors or tutors. This evaluation report provides an assessment of the first two years of project implementation (2009/10 and 2010/11 school years) with regards to the project efficiency, effectiveness and impact.
- REF-supported Projects in Slovakia for Preventing/reversing Segregation of Romani Children in Special Education_EN_2010
As of November 2009, REF had committed a total of EUR 622 790 to six projects implemented by four non-governmental organizations aimed at directly preventing and/or reversing the streaming of Romani children in special education in Slovakia. REF’s decision in early 2010 to commission a comparison of the different approaches supported to date in this area took into account three main factors: (1.) Preventing/reversing segregation of Romani children in special education can be expected to remain a priority of REF activity in Slovakia for the foreseeable future; (2.) The only external evaluation conducted to date on any of the projects aiming directly at prevention/reversal of segregation in Slovakia provided few quantitative data and no guidance on how the evaluated project might be improved in case of continuation; (3.) The Slovak Ministry of Education’s expressed interest in the results of one such project suggests that it would be interested in receiving information also on like-minded projects supported by REF in Slovakia, such that the findings of a comparative evaluation of all such projects could serve as a starting point for developing a model in cooperation with the Slovak government. The evaluation was conducted in mid-2010 under the leadership of Marek F. Hojsík of the Roma Institute in Bratislava, who was selected through an open tender procedure.
The evaluation report is available for download in English and Slovak.
- REF-supported Projects in Slovakia for Preventing/reversing Segregation of Romani Children in Special Education_SLO_2010
Táto správa bola spracovaná ako súčasť výstupov externého hodnotenia realizovaného tímom expertov vedených Marekom F. Hojsíkom z Rómskeho inštitútu v Bratislave (ďalej „konzultant“). Spracovanie hodnotenia si vyžiadal Rómsky vzdelávací fond (REF) a konzultant bol vybraný zo strany REF v otvorenom výberovom konaní. Externé hodnotenie pokrýva šesť projektov podporených zo strany REF, ktoré boli implementované na Slovensku štyrmi mimovládnymi organizáciami (ďalej „príjemcovia grantov“) a boli zamerané na predchádzanie alebo odstraňovanie segregácie rómskych detí v špeciálnom vzdelávaní (pozri tabuľku 1: Zoznam hodnotených projektov podporených zo strany REF.
After supporting Roma Access Program (RAP) for three academic years, Roma Education Fund (REF) has requested an external evaluation of RAP. The evaluation was conducted between November-December 2009. The methodology for assessment combined questionnaire for students (34 answers), interviews with students, program management, tutors, and members of the evaluation committee (21 interviews) and two focus groups with students and alumni. The evaluation was conducted between November-December 2009.
The Provincial Department of Education and Culture, Council for Roma Integration in the Autonomous Province of Vojvodina and Roma Students Association won a grant competition to offer Secondary School Scholarships supported by REF (2007-2011) in order to facilitate Roma students’ development and advancement in their secondary school studies on the territory of the Autonomous Province of Vojvodina. This report evaluates the actual project implementation through interviews with the responsible parties, in addition to presenting two case studies in two schools that investigate the local realization of the program.
The objective of this evaluation is to assess the management and project implementation; assessment the beneficiaries’ school achievments, school attendance and relationships with peers and with teachers; assess the efficiency and results provided by the mentorship scheme of the program; elaborate school-based case studies with the aim of summing up lessons learnt and monitoring the school environment. It was presented by Attila Papp Z., PhD.
- External Evaluation of Integrated and Inclusive Educational Programs and School Desegregation Measures for Roma Children
The project under evaluation is funded by the Roma Education Fund (REF) and is an enhancement of the project “Developing and Promoting Inclusive and Sustainable Educational Programs for Roma Children through Integration." The evaluation determined that the project’s three main commitments were fulfilled: (1.) to provide Roma pupils attending the summer kindergarten with a detailed curriculum and daily meals and drinks, and to provide voucher support for their enrolment in the first grade; (2.) to provide Roma elementary school pupils with after school activity support, and (3.) to provide complementary education program for Roma parents on early childhood development. Furthermore, from its six specific objectives, five were found to have been met based on statistical analysis, with one (No. 4) being attainable in several years: (1.) to increase the enrolment rate of Roma children in first grade compared to previous years; (2.) to reduce the school drop-out rate of Roma pupils with focus on first grade to a level comparable to the school drop-out rate of non-Roma pupils; (3.) to increase the school attendance rate of Roma pupils to a level comparable to the school attendance rate of non-Roma pupils; (4.) to improve the school performances of Roma children towards an Annual Average Mark of 3 (good); (5.) to accelerate the school desegregation process with focus on first grade in at least five schools/communities; (6.) to increase the involvement of Roma parents, children, youth, leaders and activists in the education process and school life.
- External evaluation report of REF supported project in Serbia entitled "Functional Basic Education of Adult Roma"_2009
This is the final report from the final external evaluation of the project Functional Basic Education of Adult Roma (hereinafter: “FBEAR Project“). For the purposes of Institute for Pedagogy and Andragogy of the Faculty of Philosophy in Belgrade (hereinafter: “IPA“) and Roma Educational Fund (“REF“) the evaluation was conducted by Zdenka Milivojević, Evaluation Consultant. Evaluation was carried out in two parts: the first part was conducted from May to August 2007, and the second part, which included the additional questions for evaluation from the Roma Education Fund (REF), was conducted on 13 December in Niš and 14 December in Belgrade. The report presents the key findings from the final external evaluation and was submitted to the IPA and REF representatives in February 2008.