Session Information
11 SES 06 A, Internal and External Evaluation of Educational Effectiveness (Part 1)
Paper Session to be continued in 11 SES 08 B
Contribution
In this paper we present a selection of results from the investigation “National and international evaluations as policies for improvement in Spanish education within the European context”, funded by Autonoma University of Madrid’s 2nd competitive call for Multidisciplinary Research Projects. This research project aims to answer two key questions: (a) are external evaluations a tool to improve education in Spain? And (b) how do teachers value the processes applied for implementing external evaluation devices and their effects?
External tests have been applied for decades, but it can be stated that, in the current context of globalisation, new senses have arisen or been strengthened in relation to them (Dale, 1999; Monarca, 2015; Tarabini and Bonal, 2011). In any case, even though there is usually a consensus on the need to set up evaluation systems at government level (Tiana, 1996a; Eurydice, 2010), there are disagreements on their nature, implementation and impact concerning schools and actual education practices (Fullan, 2006; Nichols & Berliner, 2007; Monarca, 2012; O´Neill, 2013; Ozga, 2009; Stobart, 2008).
In this regard, the literature on this topic reflects a debate at both theoretical and practical levels, related to the following issues, among others:
1. The aim of national tests. Two aims are usually identified (Tiana, 1996b): tests are administered (a) to certify performance or the competences acquired at the end of a process and to make decisions on the basis of results; and (b) to generate improvement-oriented knowledge to better the education system: policies, schools, teaching, etc. (Boudett et al., 2005); nevertheless, this last objective is a matter of great controversy due to the fact that it is many times limited or even absent (Nichols and Berliner, 2007; Román and Murillo, 2009; Stobart, 2008). On the other hand, it is necessary to take into account that, according to certain interpretative frameworks, external evaluations have non-explicit objectives concerning regulation, control and persuasion.
2. The content and characteristics of these tests. In this case the debate turns around the relevance of contents, their contextualisation, the kind of cognitive functions they promote, their frequency, what they really measure, etc.
3. Their impact on education, the curriculum and teaching. Experts have put forward that external evaluations have a series of effects on the development of the curriculum in general, on particular aspects of teaching and on the configurations of the representations of quality in education (Nichols and Berliner, 2007; Abrantes, 2010; Ozga, 2009). In the literature, we have identified the following effects: they alter the conception of curriculum and teaching as something integral and comprehensive, they modify the use of school time, they favour summative evaluation to the detriment of formative evaluation, they promote competition among schools, etc.
4. The use of tests’ results and control and monitor of quality in education. This topic has two main lines of reasoning: one line is linked to the use of results in relation to improvement in education as a central argument for governments. The other refers to usage in relation to control, regulation and persuasion. In both cases it is necessary to take into account the way in which results are published, both by the government and the media (Figazzolo, 2009).
5. The explicit or implicit conceptions of external evaluations in general and in particular tests. This issue cuts across the others and is related to the interpretative frameworks underlying the topic of external evaluations.
The aim of this study is to get to know the perceptions and valuations of teachers and school managing teams in the different Comunidades Autónomas (Spanish administrative regions) concerning the processes of external evaluation and in relation to these five issues.
Method
Expected Outcomes
References
Abrantes, P. (2010). Políticas de avaliação e avaliação de políticas: o caso português no contexto ibero-americano. Revista Iberoamericana de Educación, 53, 25-42. Boudett, K. P.; City, E. A. & Murnane, R. J. (Eds.) (2005). Data Wise: A Step-by-Step Guide to Using Assessment Results to Improve Teaching and Learning. Cambridge: Harvard Education Press. Dale, R. (1999). Specifying globalization effects on national policy: a focus on the mechanisms. Journal of Education Policy, 14(1), 1-17. Eurydice (2010). Pruebas nacionales de evaluación del alumnado en Europa: objetivos, organización y utilización de los resultados. Madrid: Ministerio de Educación. Figazzolo, L. (2009). Testing, ranking, reforming: impact of PISA 2006 on the Education Policy Debate. Bruselas: Education International. Fullan, M. (2006). Beyond Turnaround Leadership. San Francisco: Jossey-Bass. Monarca, H. (2012). La influencia de los sistemas nacionales de evaluación en el desarrollo del currículo. Perfiles Educativos, 34(135), 164-176. Monarca, H. (2015). Sistemas de evaluación: disputas simbólicas y configuración de prácticas educativas en los procesos de globalización y reforma del Estado. In H. Monarca (coord.), Evaluaciones externas. Mecanismos para la configuración de representaciones y prácticas en educación (pp. 17-42). Buenos Aires: Miño y Dávila. Nichols S. & Berliner D. (2007). Collateral damage: The effects of high-stakes testing on America’s schools. Cambridge: Harvard Education Press. O´Neill, O. (2013). Intelligent accountability in education. Oxford Review of Education, 39(1), 4-16. Ozga, J. (2009). Governing education through data in England: from regulation to self‐evaluation. Journal of Education Policy, 24(2), 149-162. Román, M. & F. J. Murillo (2009). La evaluación de los aprendizajes escolares: Un recurso estratégico para mejorar la calidad educativa. Revista Iberoamericana de Evaluación Educativa, 2(1), 4-9. Stobart G. (2008). Testing times. The uses and abuses of assessment. Londres: Routledge. Tarabini, A. & Bonal, X. (2011). Globalización y política educativa: los mecanismos como método de estudio. Revista de Educación, 355, 235-255. Tiana, A. (1996a). La evaluación de los sistemas educativos. Revista Iberoamericana de Educación, 10, 37-61. Tiana, A. (1996b). Los dilemas de la calidad y el papel de la evaluación. Temas para el Debate, 20, 46-51.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.