External Project Grant Evaluation
- Executive Summary of the External Evaluation of REF-supported Project in Croatia "From preschool to full integration September 2011 – June 2012"
The National Centre for External Evaluation of Education provides assessment of the entire project implementation involving parents, children, teachers, Roma teacher assistants. Special focus is put on the quality and pedagogical impact of the preschool programs. NCEE will carry out a thorough initial survey and the final assessment of the implementation of the project which will provide basis for evaluation. The following report contains data on the initial assessment which was carried out during February 2012. The aim of the initial assessment was to inquire elements of quality of the program from preschool education to full integration. With a goal to identify the initial status and to improve the program an initial external evaluation of the quality of the program was performed. The children were involved in the assessment along with the ones involved in the realization of the program.
- External Evaluation of REF-supported Project in Macedonia "Scholarship, Mentoring and Tutoring for Secondary Roma students" 2012
The general aim of the project “Scholarship, Mentoring and Tutoring for Roma Secondary Students” (MAC 052) is through positive interventions to improve the retention and achievement rate of all Roma students enrolled in secondary school. The project is managed by the Department for Promotion and Development of Education in the Languages of Minorities, in the frames of the Ministry of Education and Science and is based on two main pillars: providing scholarships to secondary school Roma students with a GPA of at least 3.00 and providing mentorship and tutorship support to all Roma students enrolled in secondary education. The main project beneficiaries during the past two project implementation years were: 784 students (444 in 2009/10 and 611 in 2010/11, 271 of which second-year grantees) recipients of scholarship and mentorship support, a pool of students (about 100 in 2010/11) which were not financially supported but received mentorship/tutorship support, 84 secondary schools throughout the country where the project activities were taking place and 353 teachers selected as mentors or tutors. This evaluation report provides an assessment of the first two years of project implementation (2009/10 and 2010/11 school years) with regards to the project efficiency, effectiveness and impact.
- External Mid-term Evaluation of “Inclusive Quality Pre-Primary and Primary Education for Roma/Egyptian Children" 2011
The goal of the Save the Children in Albania (SCiA) project is to “provide children from different ethnic groups with the opportunity to interact and socialize, learn about each other, thus improving interethnic relations among the mainstream schools students and wider community”. The four-year SCiA project started in April 2008 and has been financed by Roma Education Fund, Medicor, Save the Children Sweden and Save the Children Norway.
The Romaversitas Project is one of the few efforts made in the Republic of Macedonia aimed at improving university education of the Roma population. It has established itself not only among the Roma, but also among the non-Roma student population. The Romaversitas Project demonstrates a high degree of successfulness in the realization of the set goals and objectives and achievement of the set indicators. The evaluation confirmed the high degree of satisfaction on the part of the RV Project beneficiaries with their participation therein. The majority of Romaversitas students beneficiaries progress successfully in their studies and achieve the academic standards expected in higher education. The support of the tutors and their participation in the other RV Project activities are directly related to their success in the studies.
- External Evaluation Report of REF-supported “Romas Graduate and Enhance Their Lives, Phase 1 and 2” in Macedonia 2009-2011
The general aim of the project “Scholarship, Mentoring and Tutoring for Secondary Roma Students” (MAC 052) is through positive interventions to improve the retention and achievement rate of all Roma students enrolled in secondary school. The project is managed by the Department for Promotion and Development of Education in the Languages of Minorities, in the frames of the Ministry of Education and Science and is based on two main pillars: providing scholarships to secondary school Roma students with a GPA of at least 3.00 and providing mentorship and tutorship support to all Roma students enrolled in secondary education. The main project beneficiaries during the past two project implementation years were: 784 students (444 in 2009/10 and 611 in 2010/11, 271 of which second-year grantees) recipients of scholarship and mentorship support, a pool of students (about 100 in 2010/11) which were not financially supported but received mentorship/tutorship support, 84 secondary schools throughout the country where the project activities were taking place and 353 teachers selected as mentors or tutors. This evaluation report provides an assessment of the first two years of project implementation (2009/10 and 2010/11 school years) with regards to the project efficiency, effectiveness and impact.
The project evaluation of “Support for High School Roma Students in Romania” was based on a research methodology which included: (1.) the analysis of documents and data evidence gathered throughout the implementation of the project; (2.) in-depth interviews with more than 58 beneficiaries of the programmes, as well as 13 mentors and nine professors that have taught the students selected in this project; additionally, a focus group was conducted with eight parents of beneficiaries from Reghin - Mureș and extensive discussions have been carried out with the manager of the project and other members of the implementation team; (3.) analysis of quantitative data – the database created during the programme by the implementers has been completed by updating and adding supplementary information (in electronic format) gathered through filling in questionnaires concerning the situation of 156 project beneficiaries.
The evaluation was conducted on the behalf of the Foundation Resource Center for Roma Communities (RCRC) by Claudiu Marius Ivan and Roxana Georgiana.
The monitoring research of the Romaversitas Foundation requested by the Roma Education Fund (REF) was carried out by the Kurt Lewin Foundation. The research was conducted
between October 2010 and January 2011.1
- REF-supported Projects in Slovakia for Preventing/reversing Segregation of Romani Children in Special Education_EN_2010
As of November 2009, REF had committed a total of EUR 622 790 to six projects implemented by four non-governmental organizations aimed at directly preventing and/or reversing the streaming of Romani children in special education in Slovakia. REF’s decision in early 2010 to commission a comparison of the different approaches supported to date in this area took into account three main factors: (1.) Preventing/reversing segregation of Romani children in special education can be expected to remain a priority of REF activity in Slovakia for the foreseeable future; (2.) The only external evaluation conducted to date on any of the projects aiming directly at prevention/reversal of segregation in Slovakia provided few quantitative data and no guidance on how the evaluated project might be improved in case of continuation; (3.) The Slovak Ministry of Education’s expressed interest in the results of one such project suggests that it would be interested in receiving information also on like-minded projects supported by REF in Slovakia, such that the findings of a comparative evaluation of all such projects could serve as a starting point for developing a model in cooperation with the Slovak government. The evaluation was conducted in mid-2010 under the leadership of Marek F. Hojsík of the Roma Institute in Bratislava, who was selected through an open tender procedure.
The evaluation report is available for download in English and Slovak.
- REF-supported Projects in Slovakia for Preventing/reversing Segregation of Romani Children in Special Education_SLO_2010
Táto správa bola spracovaná ako súčasť výstupov externého hodnotenia realizovaného tímom expertov vedených Marekom F. Hojsíkom z Rómskeho inštitútu v Bratislave (ďalej „konzultant“). Spracovanie hodnotenia si vyžiadal Rómsky vzdelávací fond (REF) a konzultant bol vybraný zo strany REF v otvorenom výberovom konaní. Externé hodnotenie pokrýva šesť projektov podporených zo strany REF, ktoré boli implementované na Slovensku štyrmi mimovládnymi organizáciami (ďalej „príjemcovia grantov“) a boli zamerané na predchádzanie alebo odstraňovanie segregácie rómskych detí v špeciálnom vzdelávaní (pozri tabuľku 1: Zoznam hodnotených projektov podporených zo strany REF.
After supporting Roma Access Program (RAP) for three academic years, Roma Education Fund (REF) has requested an external evaluation of RAP. The evaluation was conducted between November-December 2009. The methodology for assessment combined questionnaire for students (34 answers), interviews with students, program management, tutors, and members of the evaluation committee (21 interviews) and two focus groups with students and alumni. The evaluation was conducted between November-December 2009.
The objective of this evaluation is to assess the management and project implementation; assessment the beneficiaries’ school achievments, school attendance and relationships with peers and with teachers; assess the efficiency and results provided by the mentorship scheme of the program; elaborate school-based case studies with the aim of summing up lessons learnt and monitoring the school environment. It was presented by Attila Papp Z., PhD.
- External Evaluation of Integrated and Inclusive Educational Programs and School Desegregation Measures for Roma Children
The project under evaluation is funded by the Roma Education Fund (REF) and is an enhancement of the project “Developing and Promoting Inclusive and Sustainable Educational Programs for Roma Children through Integration." The evaluation determined that the project’s three main commitments were fulfilled: (1.) to provide Roma pupils attending the summer kindergarten with a detailed curriculum and daily meals and drinks, and to provide voucher support for their enrolment in the first grade; (2.) to provide Roma elementary school pupils with after school activity support, and (3.) to provide complementary education program for Roma parents on early childhood development. Furthermore, from its six specific objectives, five were found to have been met based on statistical analysis, with one (No. 4) being attainable in several years: (1.) to increase the enrolment rate of Roma children in first grade compared to previous years; (2.) to reduce the school drop-out rate of Roma pupils with focus on first grade to a level comparable to the school drop-out rate of non-Roma pupils; (3.) to increase the school attendance rate of Roma pupils to a level comparable to the school attendance rate of non-Roma pupils; (4.) to improve the school performances of Roma children towards an Annual Average Mark of 3 (good); (5.) to accelerate the school desegregation process with focus on first grade in at least five schools/communities; (6.) to increase the involvement of Roma parents, children, youth, leaders and activists in the education process and school life.
- External evaluation report of REF supported project in Serbia entitled "Functional Basic Education of Adult Roma"_2009
This is the final report from the final external evaluation of the project Functional Basic Education of Adult Roma (hereinafter: “FBEAR Project“). For the purposes of Institute for Pedagogy and Andragogy of the Faculty of Philosophy in Belgrade (hereinafter: “IPA“) and Roma Educational Fund (“REF“) the evaluation was conducted by Zdenka Milivojević, Evaluation Consultant. Evaluation was carried out in two parts: the first part was conducted from May to August 2007, and the second part, which included the additional questions for evaluation from the Roma Education Fund (REF), was conducted on 13 December in Niš and 14 December in Belgrade. The report presents the key findings from the final external evaluation and was submitted to the IPA and REF representatives in February 2008.