Judging the Quality of Teaching: Basque and European Perspectives on the Evaluation of School Leaders
Author(s):
Paul Cammack (presenting / submitting)
Conference:
ECER 2017
Format:
Paper

Session Information

11 SES 09 A, Do Assessments Help with Improving Schools' Quality?

Paper Session

Time:
2017-08-24
13:30-15:00
Room:
W2.10
Chair:

Contribution

The paper aims to demonstrate lessons that can be learnt about evaluation of schools and teachers using examples drawn from a transnational Erasmus+ project 'Evaluation of School Leaders and Teachers' Practice.' The paper aims to stimulate reflection amongst participants on the potential for comparative studies for personal reflection and for professional development of school leaders and school inpsectors.

This paper will have two, interlocking components;

  1. To share findings about similarities and differences in the evaluation of school leaders and of teachers drawn from a number of European countries. This section will illustrate alternative approaches to the evaluation of schools and teachers that demonstrate an on-going, formative approach to evaluation that is collaborative and participatory.
  2. To demonstrate how comparative studies can lead to meta-cognition that goes beyond the scope of the topic that forms the focus of a transnational project. This section will draw on Mezirow’s theory of ‘perspective transition’ to illustrate the challenges and opportunities presented by reflection on transnational differences in professional practice.

Reflective practice is seen as an important component of developing teaching and learning (Ghaye, 2010) and international projects create opportunities for high-quality professional learning through comparative studies of education which can provide insight into one’s own and others’ professional practices (Dale, 2005). Systems and procedures for the evaluation of school leaders and teachers’ practice vary widely from country to country ( Eurydice Report, 2013) with differences in philosophical approach, aims and purpose, design and implementation, and consequences and impacts of evaluation systems. 

This paper will consider the experiences and opinions of school leaders and school inspectors in the Basque Country following the introduction of a formative system of school evaluation. The paper will use this evidence to demonstrate some of the opportunities and constraints posed by transnational learning about the evaluation of school leaders in two directions: Firstly, in considering how school leaders and inspectors in the Basque Country drew upon experience and perspectives from other countries and adapted these to local contexts. And secondly;  in considering how experiences drawn from the Basque context can be interpreted and used in other countries.

Method

This study draws upon data gathered as part of an on-going transnational Erasmus+ project. The data are drawn from a focus group of school leaders in the Basque Country and from school inspectors from Romania, Basque Country, Lithuania, Portugal and Italy. The data were gathered in focus group discussions and in project development meetings. Meetings were recorded and conversations transcribed after the meetings. The transcribed conversations were coded using in-vitro codes and analysed by the author and checked with participants within the project as a form of triangulation. The study used a methodology informed by McCracken’s ‘long interview’ approach (McCracken, 1988). This approach suggests a four stage procedure, starting with a literature review to raise awareness of the topic that is used to inform reflection and to formulate an appropriate research design. An open-ended data collection process produces raw material that is used to derive analytic categories from the data. The analytical methods use an iterative approach to the interview transcripts and notes taken during the interviews based upon the five stages of analysis suggested by McCracken (1988). Briefly, significant statements are identified and reflected upon before being linked to other observations from the same respondent and from other participants in order to isolate themes in the data and these are used to construct central arguments derived from the literature, the data and the analysis. This is an ‘inductive analysis’ approach whereby patterns and themes emerge from the data during analysis rather than being established before data is collected (Bowen, 2006). A ‘sensitizing concepts’ approach (Blumer, 1954 cited in Bowen, 2006) was adopted during data analysis to suggest directions for further analysis and reflection in order to discover, understand and interpret the data. This approach conforms to a ‘naturalistic research’ approach using inductive analysis and significant levels of trustfulness (Bowen, 2006; Lincoln and Guba, 1985). Themes gradually were uncovered by a combination of detailed consideration of the data at individual participant level and across participants combined with reflection on material identified in the literature review. These themes were firmly rooted in the responses of participants and developed to higher levels of abstraction during the stages of McCracken’s (1988) stages of analysis to become significant overarching themes.

Expected Outcomes

This paper will present findings drawn from a transnational Erasmus+ project on the Evaluation of School Leaders and Teachers’ Practice to reveal a variety of perspectives on the nature, purpose and characteristics of the evaluation of school leaders and teachers. The paper will draw on experiences of participants in the project to demonstrate how experience of alternative practices can be used as a basis for reflective enquiry within a process of Mezirow’s ‘perspective transformation’ to inform professional practice for a variety of stakeholders, including inspectors, school leaders and teachers. The paper will demonstrate that learning within transnational projects operates in multi-directional ways and at varying levels. It will show evidence that knowledge transfer operates in 'import' and 'export' manners which can be subject to a number of filters that can influence and transform meanings and interpretations. This has implications for the sharing of experience and practice in trans-national contexts. In addition, the paper will provide examples of how experience in transnational projects can lead to meta-cognitive outcomes that transcend the original context of the project.

References

Bowen, G. A. (2006). Grounded theory and sensitizing concepts. International journal of qualitative methods, 5(3), 12-23. Brauckmann, S., & Pashiardis, P. (2010). The clash of evaluations: in search of the missing link between school accountability and school improvement-experiences from Cyprus. International journal of educational management, 24(4), 330-350. Dale, R. (2005). Globalisation, knowledge economy and comparative education. Comparative education, 41(2), 117-149. European Commission/EACEA/Eurydice (2013): Key data on teachers and school leaders in Europe. Luxembourg Publications Office of the European Union. European Commission/EACEA/Eurydice, (2015) Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Luxembourg: Publications Office of the European Union. Ghaye, T. (2010). Teaching and learning through reflective practice: A practical guide for positive action. Routledge. Isoré, M. (2009). Teacher Evaluation: Current Practices in OECD Countries and a Literature Review. OECD Education Working Papers, No. 23. OECD Publishing (NJ1). Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry (Vol. 75). Sage. McCracken, G. (1988). The long interview (Vol. 13). Sage. Mezirow, J. (1997). Transformative learning: Theory to practice. New directions for adult and continuing education, 1997(74), 5-12. OECD (2013), Teachers for the 21st Century: Using Evaluation to Improve Teaching, OECD Publishing Phillips, K., Balan, R., & Manko, T. (2014). Teacher Evaluation: Improving the Process. Transformative Dialogues: Teaching & Learning Journal, 7(3). Santiago, P., & Benavides, F. (2009, December). Teacher evaluation: A conceptual framework and examples of country practices. In OECD-Mexico workshop ‘Towards a teacher evaluation framework in Mexico: international practices, criteria and mechanisms’. Schleicher, A. (2012). Preparing teachers and developing school leaders for the 21st century: Lessons from around the world. OECD Publishing, Paris Stronge, J. H. (2005). Evaluating teaching: A guide to current thinking and best practice. Corwin Press.

Author Information

Paul Cammack (presenting / submitting)
University of Cumbria, United Kingdom

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.