Session Information
11 SES 06 B, Factors Impacting on the Quality of Education
Paper Session
Contribution
School self-evaluation has become more and more important for the quality assurance of educational systems of many OECD countries. Since the eighties a variety of self-evaluation practices have emerged. Also, several goals have been ascribed to school self-evaluation: on the one hand accountability to central authorities or local stakeholders, on the other hand stress on the potential for school improvement. Recent recommendation by OECD indicates the need to align external evaluation with school self-evaluation in order to improve school quality.
Despite the growing attention toward school self-evaluation, research on this topic is still lacking and far from being exhaustive. Little attention has been given to assess the impact of self-evaluation on school improvement. Research evidences suggest that school self-evaluation is perceived as positive from school leaders and teachers; its usefulness concerns mainly the potential for improving teachers attitudes toward professional development and toward school improvement. On the other hand, there are unsufficient findings that school self-evaluation has a positive effect on students’ outcomes. Some studies evaluated the use of feedback in self-evaluation that aims at improving school performance. These findings show a limited use of such feedback by schools. Other studies have pointed out the problem of validity and reliability of the self-evaluation process carried out by schools. Blok et al. (2008) analyzed school self-evaluation reports finding significant shortcoming. The self-reports did not seem to be useful as a basis for accountability or for school improvement. A way of improving school self-evaluation validity is to connect it with external evaluation procedures. According to Nevo (2002), external evaluation can stimulate the internal evaluation process and improve its scope and validity. However, it has been pointed out that externally initiated self-evaluation may decrease school compliance and thus many of its positive impact on schools. Also, school self-evaluation that mainly focus on the measures of productivity or output can have paradoxical effects on teachers and schools: it might lead to resistance, destroying strategic compliance.
Literature reserach shows that, despite positive views of school self-evaluation, more research is needed on the quality of the process of self-evaluation carried out by schools in order to assess its validity and its use in the context of schools’ and students’ outcome improvement. Given the increasing importance attributed to school self-evaluation by national policies and by schools themselves, assuring validity is the basic requirement for expecting a positive impact on improvement.
Starting form such concerns, our study intended to assess the quality of the self-evaluation process carried out in 290 Italian schools involved in the Vales project. The Vales project, promoted by the Ministry of Education and by the National Institute for the Educational Evaluation of Instruction and Training (INVALSI) is a pilot study aimed at testing the validity of instruments and procedures for school evaluations, it is a preliminary step in the implementation of the National Evaluation System (enacted in 2013 which extend school evaluation to all Italian schools). Vales schools implemented self-evaluation and then received a visit by a team of external evaluators. Self-evaluation and external evaluation were strongly connected: first of all, they shared the same theoretical framework. Schools were asked to analyze the same areas evaluated by external teams, using the same set of indicators. School self-evaluation was supported by INVALSI; the schools received data about their performance in several areas (students’ achievement, educational and management processes) and information about national average data to compare their position; they also received a self-evaluation report format and a sourcebook. Self-evaluation reports were then used by external evaluators as one of their sources of information during school visits.
Method
Expected Outcomes
References
Blok H., Sleegers P., Karsten S. (2008) Looking for a balance between internal and external evaluation of school quality: evaluation of the SVI model, Journal of Education Policy, 23:4, 379-395. Chapman C., Sammons P. (2013) School Self-evaluation for School Improvement: What works and why? Project Report. CfBT Education Trust. Durrant J., Dunnill R., Clements S. (2004) Helping schools to know themselves: exploring partnerships between schools and Higher Education Institutions to generate trustful, critical dialogue for review and development. Improving Schools, 7(2), 151–170. Ehren M.C.M., Altrichter H., McNamara G., O’Hara J. (2013). Impact of school inspections on improvement of schools—describing assumptions on causal mechanisms in six European countries. Educational Assessment, Evaluation and Accountability, 25(1), 1-41. Janssens F.J.G., Amelsvoort G.H.W.C.H. van (2008) School self-evaluations and school inspections in Europe: an exploratory study. Studies in educational evaluation, 34 (1). pp. 15-23. Ladd H.F. (2012). School Accountability: To what ends and with what effects? Keynote address for Conference on Improving Education through Accountability and Evaluation: Lessons from Around the World, Rome, Italy. Retrieved January 29, 2015. http://fds.duke.edu/db/attachment/2050. MacBeath J. (2008) Leading learning in the self-evaluating school, School Leadership & Management: Formerly School Organisation, 28:4, 385-399. MacBeath J. (2002) Scotland: Schools speaking for themselves, School-Based Evaluation: International Perspective, vol. 8, 243-259. Nevo D. (2002) Dialogue Evaluation: combining internal and external evaluation, School-Based Evaluation: International Perspective, vol. 8, 3-16. OECD (2013) Synergies for Better Learning: An International Perspective on Evaluation and Assessment, OECD Reviews of Evaluation and Assessment in Education, OECD Publishing, Paris. Ozga J. (2009) Governing education through data in England: from regulation to self-evaluation. Journal of Education Policy, 24(2), 149–162. Scheerens, J., Van Amelsfoort H.W.C.G., Donoughue C. (1999) Aspects of the organizational and political context of school evaluation in four European countries. Studies in Educational Evaluation 25: 79–108. Schildkamp K., Vanhoof , Petegem van P., Visscher A. (2012) The use of school self-evaluation results in the Netherlands and Flanders, British Educational Research Journal, 38:1, 125-152. Schildkamp K., Visscher A. (2010) The utilisation of a school self‐evaluation instrument, Educational Studies, 36:4, 371-389. Vanhoof J., Petegem Van P. (2011) Designing and evaluating the process of school self-evaluations. Improving Schools, 14 (2), 200–212. Vanhoof J. Petegem Van P. [2006]How to Match Internal and External Evaluation? Conceptual Reflections from a Flemish Perspective. Antwerp University, Belgium, 20th International Congress for Effectiveness and Improvement. http://www.fm-kp.si/zalozba/ISBN/978-961-6573-65-8/261-277.pdf.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.