Contrastive Patterns Of Coordination Regarding The Usage Of Mandatory Test-Data On Principal And School Supervising Authority Level
Author(s):
Carolin Ramsteck (presenting / submitting) Barbara Muslic (presenting) Harm Kuper Uwe Maier Tanja Graf
Conference:
ECER 2013
Format:
Poster

Session Information

26 SES 05.5 PS, General Poster Session

General Poster Session

Time:
2013-09-11
12:30-14:00
Room:
FUAYE
Chair:

Contribution

This paper empirically addresses the principals' and school supervising authorities' role and function within the implementation of test-based school reforms in the low-stakes testing environment of Germany. It explores how the relation of principals (representing the domain of the organization) and school supervising authority (representing the environment of schools) is affected by mandatory tests in the multilevel structured German school system. The analysis aims to identify particular patterns of conducive respectively obstructive actions regarding the usage of mandatory test-data on both levels.

The sobering German school performance in international student assessments was a critical juncture and led to a paradigm shift: national standards and mandatory tests in grades 3 and 8 were implemented. These instruments are meant to improve school quality and teacher instruction. They should foster accountability and school autonomy. Furthermore, the feedback information resulting from mandatory tests are intended to promote communication and cooperation between different actors at school.

The international school effectiveness research shows that principals are crucial for the success of an innovation at school level. In regard to mandatory test-data principals are deemed the key mechanism for data based decisions and for school improvement (May & Suppovitz 2010). They have a mediate impact on the effectiveness of schools (West et al. 2000). Their influence in case of the test usage is based upon their understanding of leadership and their comprehension of the "organisation school". It is distinguished between two concepts: The Autonomous Professional Organisation versus the Managed Professional Organisation (Thiel 2008). In a Managed Professional Organisation principals take joint actions with teachers and department heads. They act according to the distributed leadership (Harris 2008) and entrust responsibility to subordinated levels. As mandatory test-data serve a macro-approach by providing information for accountability and assuring school quality, the school supervising authority as well is confronted with this instrument (Lange 2003). It is meant to support schools to strengthen their autonomy and to improve their outcome on a test-data basis. Governance research shows that the handling of mandatory test-data on school supervising authority level is dependent on the authority’s managerial style and their organisational concept. Research differs between variable types (Conventional Bureaucracy, Distanced Management, New Management, Pedagogical Bureaucracy) of supervisory acting that all cause different usages of data (Brüsemeister/Newiadomsky 2008). For the analysis of these processes we refer to the theory of neo-institutionalism, too. From this perspective schools were seen as loosely coupled organisations which are difficult to change. There is evidence that test-based school reforms strengthen organisational coupling and thus eminently affect the relations organisation-interaction and school-environment (Rowan 2006, Verhaege et al. 2010).

This analysis was conducted to determine conducive and obstructive patterns of action regarding the usage of mandatory test-data on the level of principals and school supervising authorities. Two questions are of particular relevance:

1) How do principals address and coordinate school actors relating to the development of school and educational quality based on mandatory test-data?

2) What kind of relationship and cooperation regarding the usage of mandatory tests between these actors can be identified?

Method

Our qualitative research project is based on a contrastive within- and cross-case study design (Yin 2009). It employs individual semi-structured interviews with different actors on all levels of the educational system. Two interview intervals over two years were carried out in order to capture developments concerning the coordination amongst the different actors. Altogether 229 interviews were conducted with actors from different levels of the school system (principals, teachers, department heads and school supervising authorities). For answering the research questions from above, all the interviews (in total 57) from the principals’ (35) and school supervising authorities’ (17) level were used. The transcribed interviews were analysed with qualitative content analysis by different coders (Mayring 2010). To ensure quality throughout the whole qualitative procedure, different methods of validation were deployed. Validity was checked by Cohens Kappa. This measured value indicates the interrater reliability (Cohen 1960). For the school supervising authorities’ and principals’ system of categories we found Cohens Kappa between good and acceptable. Validity of construct was evaluated by triangulation of methods and by consensual and argumentative validation. In conclusion contrasting case studies were developed within the different federal states as well as across the states based on the interview data.

Expected Outcomes

On the principals' level the data suggests that the concept of Managed Professional Organisation promotes the acceptance and usage of mandatory test-data. The data on the school supervising authority level indicates that the type New Management strengthens the communicative process across the different levels. This type is supposed to foster mandatory tests and its usage. The findings show that principals as well as school supervising authorities have an impact on the usage of low stakes standardised tests. With their adoption of organisational types and management styles, both levels can influence how the other levels at school are connected and how intensively they use test-data. In the poster we will present different types and concepts on principals' and school supervising authorities' level. The coordination between both levels in reference to mandatory test-data and regarding to the differences between the participating states will be considered, too. The results have a relevance for national and international comparisons. As this reasearch closes a gap regarding the empirical analysis of principals' and school supervising authorities' usage of mandatory test-data in Germany, the comparison with data from other countries, e.g. the Netherlands, where a modernized type of school supervising authority already had been implemented, is useful.

References

Brüsemeister, T./Newiadomsky, M. (2008): Schulverwaltung - Ein unbekannter Akteur? In: Langer, R. (Hrsg.): „Warum tun die das?“. Governanceanalysen zum Steuerungshandeln in der Schulentwicklung. Wiesbaden: VS Verlag für Sozialwissenschaften, S. 73-93. Cohen, J. (1960): A Coefficient of Agreement for Nominal Scales. In: A Coefficient of Agreement for Nominal Scales 20, H. 1, S. 37-46. Harris, A. (2008): Distributed Leadership: According to the Evidence. In: Journal of Educational Administration 46, H. 2, S. 172-188. Lange, H. (2003): Schulaufsicht zwischen normativen Anforderungen und faktischen Wirkungsmöglichkeiten. In: Zeitschrift für Pädagogik 49, Beiheft 47, S. 137-155. May, H./Suppovitz, J. A. (2010): The Scope of Principal Efforts to Improve Instruction. In: Educational Administration Quarterly 47, H. 2, S. 332–352. Mayring, P. (2010): Qualitative Inhaltsanalyse. In: Mey, G./Mruck, K. (Hrsg.): Handbuch Qualitative Forschung in der Psychologie. Wiesbaden: VS Verlag, S. 601-613. Rowan, B. (2006): The New Institutionalism and the Study of educational Organizations: Changing Ideas for Changing Times, in: Meyer, H.-D.& Rowan, B. (Ed.): The new institutionalism in education, Albany, NY. Thiel, F. (2008): Die Organisation der Bildung – eine Zumutung für die Profession? In: Ehrenspeck u.a. (Hrsg.): Bildung: Angebot oder Zumutung? Wiesbaden: VS Verlag, S. 211ff. Verhaeghe, G., Vanhoof, J., Martin, V., van Petegem, P. (2010). Using school performance feedback: Perceptions of primary school principals. School Effectiveness and School Improvement, 21/2, 167-188. West, M./Jackson, D./Harris, A./Hopkins, D. (2000): Leadership for School Improvement. In: Riley, K./Seashore-Louis, K. (Hrsg.): Leadership for Change. London: Routledge, S. 33-41. Yin, R. K. (2009): Case Study Research. Design and methods. Los Angeles: Calif.

Author Information

Carolin Ramsteck (presenting / submitting)
Pädagogische Hochschule Schwäbisch Gmünd
Institut für Erziehungswissenschaften
Schwäbisch Gmünd
Barbara Muslic (presenting)
Freie Universität
Educational Science & Psycology
Berlin
Freie Universität Berlin, Germany
Pädagogische Hochschule Schwäbisch Gmünd, Germany
Freie Universität Berlin
Arbeitsbereich Weiterbildung und Bildungsmanagement
Berlin

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.