The Role and Usage Strategies of Feedback Information at Principal Level - Case Studies from Norway and Germany
Author(s):
Barbara Muslic (presenting / submitting) Anne Berit Emstad (presenting)
Conference:
ECER 2012
Format:
Paper

Session Information

01 SES 05 C, Learning about Teacher Learning

Parallel Paper Session

Time:
2012-09-19
11:00-12:30
Room:
FCEE - Aula 2.9
Chair:
Janne Pietarinen

Contribution

In the course of the recent test-based school reforms in Germany national standards and standardized student’s assessments in Grades 3 and 8 were implemented in order to improve instruction of teachers and school quality. This instrument of a new paradigm should mainly help to strengthen the accountability and to foster the autonomy at classroom and school level. Moreover, the feedback information resulting from these tests is intended to promote the communication and cooperation between the actors at administrative and school level.  In this context the principals have the most important role at school level, especially as a key mechanism for school improvement (May & Supovitz 2010). Furthermore, they influence (indirectly) the effectiveness of schools and student achievement (Leithwood & Jantzi 2000, West et al. 2000).

In Norway school-based evaluation is required by the regulation of the education act. The schools must assess the extent to which the organization, resourcing, and teaching programs of the school contribute to the achievement of the national curriculum objectives, and the intention is to promote teachers’ understanding of the curriculum objectives and how to achieve them. In 2003 a comprehensive web-based publicly available digital resource called «Skoleporten» was introduced. The resource provides information about the organization and resourcing of every school in Norway, along with information on students’ backgrounds and achievements. The intention was that the information «Skoleporten» provided would be a resource in school-based evaluation.             

Regarding the usage of feedback information, international empirical results show a high correlation with the degree of teacher's professionalism, organisational characteristics of schools and specific attributes of school systems (Visscher & Coe 2003). In this connection Luhmann (2006) assumes that decisions are basic elements within organisations, on which change processes can be found. Feedback information of standardized student assessments might have an impact on these decisions and their premises (which are persons, communication structures and program). Thus, there might be different strategies in using feedback information.

Based on that theoretical background the paper focuses the principals´ role and their usage strategies of feedback information in the dimensions     

- involvement of staff

- reflection/analyses of the results

- use of results for school development and 

- decisions/consequences

based on the results in the countries Norway and Germany.

Method

The results of the paper are based on data from qualitative case study projects in Germany and Norway (Kroon & Sturm 2000). In Germany we conducted about 240 semi-structured interviews with actors from several levels of the school system (principles, teachers, heads of department and school administrators) in 20 secondary schools in four federal states (Berlin, Brandenburg, Thuringia and Baden-Wurttemberg). The transcribed interviews were analyzed by qualitative content analysis (Krippendorf 2004, Mayring 2010). The evaluation procedure includes controlling validity by methods of communicative validation and checking the interrater reliability (Cohen 1960). The Norwegian study involves a sample of six Norwegian primary schools which had implemented a formative school evaluation model. The study is mainly based on interviews. The interviews were conducted from a phenomenological perspective, where the research participants’ experiences were explored (Moustakas 1994). A total of six principals, one assistant principal, 18 teachers and one group of students in every school were interviewed. The interviews were transcribed and then analysed. Data was structured through coding and categorisation (Strauss & Corbin 1998). The evaluation reports and other documents (e.g. project plans, reflection notes, and organizational analyses) were also analyzed.

Expected Outcomes

The relevance of this paper is particular evident in the international comparison: The paper explores the principals` role and their usage strategies in the context of test-based school reforms in two different low-stakes testing countries. Because of the higher structured Scandinavian educational system it is supposed that in Norway, compared to Germany, the professionalism of the principals is more pronounced – also in handling feedback information. Additionally, we gathered information about what helps and what hinders the use of feedback data to improve school outcomes and development. First, the findings in both countries show differences in how, and how much the principals involve the teachers in interpreting, analysing and reflection of the data and results. Second, the use of feedback for development may also depend on how the principal facilitate and prioritize the process of using the feedback data, if and how it`s used. And third, both the first and the second may affect both decisions and consequences for school improvement. We argue that the principals and the organisational characteristics of schools (e.g. institutional regulatory structures) influence the use of feedback information based on standard tests and school evaluation results.

References

Cohen, J. (1960): A coefficient of agreement for nominal scales. In: Educational and Psychological Measurement 20 (1). Cousins, J. & Leithwood, K. (1986): Current empirical research on evaluation utilization. Review of Educational Research 56 (3), 331-364. Krippendorff, K. (2004): Content Analysis. An Introduction to Its Methodology. 2nd Edition. Thousand Oaks, CA: Sage. Kroon, S. & Sturm, J (2000): Comparative Case study Research in Education. Methodological Issuues in an Empirical-Interpretative Perspective. In: Zeitschrift für Erziehungswissenschaft, Jg.3. H 4, S.559-576. Leithwood, K. & Jantzi, D. (2000): The Effects of Transformational Leadership on Organisational Conditions and Student Engagement. In: Journal of Educational Administration 38(2): 112-29. Luhmann, N. (2006): Organisation und Entscheidung. Wiesbaden: VS-Verlag. 2. Aufl. May, H. & Supovitz, J. A. (2010): The Scope of Principal Efforts to Improve Instruction. Educational Administration Quarterly, 47(2) 332–352. Mayring, P. (2010): Qualitative Inhaltsanalyse. Grundlagen und Techniken Weinheim: Beltz. 11. Aufl. Moustakas, C. (1994): Phenomenological research methods. Thousand Oaks, Calif.: Sage. Strauss A. & Corbin J. (1998): Basics of Qualitative Research. Grounded Theory Procedures and Technique. 2nd Edition. Newbury Park, London: Sage. Schildkamp, K. & Visscher, A. (2009): Factors influencing the utilisation of a school self-evaluation instrument. Studies in Educational Evaluation. Shulha, L. & Cousins, J. (1997): Evaluation use: theory, research, and practice since 1986. American Journal of Evaluation, 18(1), 195. Torres, R. & Preskill, H. (2001): Evaluation and organizational learning: Past, present, and future. American Journal of Evaluation, 22(3), 387. Visscher, A.J. & Coe, R. (2003): School Performance Feedback Systems. Conceptualisation, Analysis, and Reflection. School Effectiveness and School Improvement, 14 (3), 321-349. West, M., Jackson, D., Harris, A. & Hopkins, D. (2000): Leadership for School Improvement. In: Riley, K. & Seashore-Louis, K. (eds.): Leadership for Change. London: Routledge Falmer, 33-41.

Author Information

Barbara Muslic (presenting / submitting)
Freie Universität
Faculty of Educational Science and Pychology
Berlin
Anne Berit Emstad (presenting)
NTNU Trondheim (Norwegian University of Science and Technology)

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.