Session Information
23 SES 02 A, Forms of Assessment in Global Settings
Paper Session
Contribution
Evaluation has expanded radically in the public sector as part of the broad governance doctrine New Public Management (NPM) (Pollitt and Bouckaert, 2011). Within this doctrine market mechanisms have been introduced to enhance transparency and accountability, and in school governance to support competition between schools, free school choice, enhance quality in education and effective schools (Lubienski 2009; Merki, 2011). Evaluation systems are indispensable to school governance characterized by results-based management and increased local autonomy (Elstad, 2009; Mintrop and Trujillo, 2007), and without measuring outputs and performance and checking students and teachers regularly today’s school governance models will not work. Although evaluation is a cornerstone in local school governance it has not been studied much in this context.
The purpose of this paper is to explore use, functions and constitutive effects of evaluation in local school governance, and factors affecting evaluation use in local school governance.
The paper takes departure in governance and policy research, evaluation and knowledge exchange theory. While evaluation systems are central to school governance they need to be conceived and studied from a governance perspective with many actors at different levels involved (Bouckehart and Halligan, 2006; Ozga, 2009; Rose, 1999).The role of the municipality in a country’s education system largely depends on the division of power between levels of government, and the mandate and discretion given to local governments and independent schools (Holmgren et al, 2012) which in turn embeds and steers evaluation (Hanberger, 2012).
The Swedish school system is described as one of the most decentralized and market-oriented systems in the world (Lundahl, et al 2013; Holmgren et al, 2012; Baggesen, 2007) and one supposedly allowing self-governance and extensive discretion to municipalities (Lidström, 2011). The discretion varies over time, depending on changes in national school governance and other factors such as being subjected to global and transnational education governance as a member of the EU and OECD (OECD, 2011). If, for example, PISA results impact on local school policy discourses and local school governance is an empirical question waiting to be answered.
Conceptual framework
The term evaluation system is used as an umbrella term for different systems for monitoring and evaluation and refers to “the procedural, institutional and policy arrangements shaping the evaluation function and its relationship to its internal and external environment…” (Liverani & Lundgren, 2007: 241).
An evaluation can be used by school actors in different ways and also have functions not directly related to actors’ utilization of the evaluation, such as providing legitimacy for an organisation or governance model.
Constitutive effect refers to systemic effects of evaluations such as shaping what is considered collectively significant in a society and in the policy discourse (Dahler-Larsen, 2013), e.g. passing grades in high school or making informed free school-choice on a school market.
Local school governance refers to local actors’ (e.g. district school boards, independent local school boards and parents) influencing, steering and governing of schools.
While there is not much previous research to rely on, an explorative case study approach is used. We take as a presumption that how evaluation and evaluation systems are used and what functions and effects they have depends on many factors, including conditions in multi-level school governance and factors in the local context. Variations in school performance, socio-economic environment, local school policy, economic factors could explain differences in the way evaluation systems function in local school governance.
Contextual factors affecting evaluative knowledge use are explored and interpreted against knowledge exchange theory (Contandriopoulos et al., 2010) accounting for such as issue polarization and institutional arrangements.
Method
Expected Outcomes
References
Baggessen Klintgaard (2007) Do Welfare State Regimes Determine Public Sector Reforms? Choice Reforms in American, Swedish and German Schools, Scandinavian Political studies, 30(4):444-468. Bouckaert, G. & Halligan, J. (2006) ‘Performance and Performance Management’, in Peters, G. & Pierre, J. (eds.) Handbook of Public Policy. London: Sage. Contandriopoulos D, Lemire M, Denis J-L and Tremblay É (2010) Knowledge exchange processes in organiza¬tions and policy arenas: a narrative systematic review of the literature. Milbank Quarterly 88(4): 444–83. Dahler-Larsen, P. (2013) “Constitutive effects of Performance Indicators”, Public Management Review, DOI: 10.1080/14719037.2013.770058. Elstad, E. (2009) ‘Schools which are named, blamed and shamed by the media: scholl accountability in Norway’ Educ Asse Eval Acc, 21:173-189. Hanberger, A. (2012) Framework for exploring the interplay of governance and evaluation, Scandinavian Journal of Public Administration 16(3),9–28. Holmgren, M., Johansson, O., Nihlfors, E. and Skott, P., 2012 ‘Local School Governance in Sweden: Boards, Parents and Democracy’, Journal of School Public Relations, 33:8-28. Howarth, D. & Griggs, S. (2012) ‘Poststructuralist Policy Analysis’ in Fischer, F. & Gottweis, H. (eds.) The Argumentative Turn Revisited. Public Policy as Communicative Practice. Durham/London: Duke University Press. Lidström, A. (2011) Sweden: Party-dominated subnational democracy under challenge? The Oxford Handbook of Local and Regional Democracy in Europe:261-281. Oxford, Oxford University Press. Lingard, B. and Sellar, S. (2013) ‘Catalyst data’: Perverse systemic effects of audit and accountability in Australian schooling. Journal of Education Policy DOI: 10.1080/02680939.2012.758815 Liverani, A. & Lundgren, H. (2007) ‘Evaluation Systems in Development Aid Agencies. An Analysis of DAC Peer Reviews 1996-2004’, Evaluation,13(2):241-256 Lubienski, C. (2009). Do Quasi-Markets Foster Innovation in Education? A Comparative Perspective. OECD Education Working Papers,No.25, OECD Publishing. Lundahl, Lisbeth; Erixon Arreman, Inger; Holm, Ann-Sofie & Lundström, Ulf (2013) Educational marketization the Swedish way. Education Inquiry 4(3):497-517 Merki, K.M. (2011) Special issue: Accountability systems and their effects on school processes and student learning’. Studies in Educational Evaluation,37:177-179. Pollitt, C. & Bouckaert, G. (2011) Public Management Reform: A Comparative Analysis - New Public Management, Governance, and the Neo-Weberian State. Oxford: Oxford University Press. Mintrop, H. & Trujillo, T. (2007) ‘The Practical Relevance of Accountability Systems for School Improvement: A Descriptive Analysis of California Schools’, Educational Evaluation and Policy Analysis, 29(4):319-352. OECD (2011) OECD Reviews of Evaluation and Assessment in Education, SWEDEN Ozga, J. (2009) ‘Governing education through data in England: from regulation to self-evaluation’ Journal of Education Policy, 24(2):149-162. Rose, N. (1999) Powers of Freedom. Cambridge: Cambridge University Press.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.