School reforms based on external accountability, standards, and external support in Chile: improving what and for whom?
Author(s):
Conference:
ECER 2014
Format:
Paper

Session Information

11 SES 14 JS, Checking Effectiveness by Evaluating Schools

Paper Session Joint Session NW 09 and NW 11

Time:
2014-09-05
15:30-17:00
Room:
B231 Sala de Aulas
Chair:
Martin Goy

Contribution

Background and Objectives 

Similar global school reforms are increasingly implementing everywhere in the globe. As many european countries, Chile has recently introduced a set of policy strategies to improve schools serving most disadvantaged communities. Under the assumption that they will improve the quality and equity of education, the Chilean Government implemented during 2009 and 2011, while reinforcing mix school provision, for/profit schools, and vouchers, three new key reforms to tackle underachievement in Chilean public-funded primary schools: (i) The creation of the Agency for Quality of Education (which will classify schools every year in four categories under the risk of being closed if they do not improve outcomes in the national standardised test of learning in mathematics and language –SIMCE- which measure the fulfilment of the national curriculum); (ii) The Preferential Additional Funding Plan which provide more economic resources peer student under the condition of the elaboration of an Improvement Plan where schools should set goals in terms of test outcomes (SIMCE) for a short term period (4 years); (iii) under the framework of the previous policy, schools can obtain additional funding to contract external support from organisation called ATEs, a new publicly funded market of school support. They are the political and policy answer to the student movement occurred during 2006. The principles underlying such reforms are: self-monitoring schools to improve as well as external steering-from-distance state control, test-based conditioned funding; competence between schools; school performance state control, in other words, the assumption that schools will improve via the adoption of efficient and innovative business-based organisational management.

This three-year research project is a mix method inquiry aiming at to understand how new accountability-based reforms in Chile has impacted on school practices at pedagogical, equity, and organisational level. In particular, this research project offer evidence regarding the specific mechanisms by which such policies act into schools reshaping issues like curriculum depth, students tracking, school selection, test-based decision-making, and contested dilemmas among staff and management team. Crucially, this research shows in detail how head teachers and their collaborators’ team change the educational purposes of education at local level in response to, and to meet, national policies. On the whole, the paper attempts to put into question what is really being improved and in benefit of whom.

 These are the main questions to be addressed:

  • Are these policy tools producing deep and genuine school change?
  • How do match these initiatives the emotional, pedagogical, social, and affective students needs in disadvantaged contexts?
  • How is education being (re)conceptualised and (re)defined in the light of these policy tools?

 Conceptual Approach

 As a global pattern, by accountability school reforms, we refer to the external policy tools, which introduce a new education governance system in which state governs by distance using in parallel weak support and severe consequences and pressure: intensive testing (not assessment), compulsory standardisation (not local curriculum adaptation neither innovation), severe consequences upon schools (not trust neither building-capacity support), and competence and conditioned funding (not cooperation among schools). There is increasing international evidence that such policies has proved to fail in improving equity in education as well as expand the learning opportunities and meet the educational needs of all students from different backgrounds (Sahlberg, 2011; Ravitch, 2010; Alexander et al., 2010; Hargreaves & Shirley, 2009; Wolf & Janssens, 2007).

Conversely, this research project was attempting to ask whether such new reforms were promoting what has been identified internationally like long-term school improvement tools: internal school accountability (Elmore, 2010); capacity-building, staff collaboration, and strategic coherence; professional capital promoting and support (Fullan & Hargreaves, 2012); distributed and adaptive leadership (Day et al., 2008; Harris, 2012). 

Method

The research used a mix method strategy. On the one hand, schools located in Santiago of Chile were organised according to value-added indicators to study schools with a range of outcomes in terms of their contribution to their students beyond what is expected. The purpose was to relate ‘successful’ or not outcomes to a set of practices at school level: what kinds of learning experiences are providing (in) effective schools as result of policy pressures. On the other hand, with the purpose of studying in-depth the change of practices at school levels, eight schools were selected according their value-added indicators. Two-year in-depth qualitative data collection was conducted on schools of different levels of value-added over time. It was estimated using prior-attainment and controlling by endogeneity problems (Carrasco & San Martin, 2012). A diverse range of data collection were employed over the schools were visited in three different moments over two years. About 300 people were interviewed (head teachers, teachers, external supporters, etc.). Observations were undertaken to teachers meetings, school level curriculum activities, school meetings with external teams, etc. Also, school documents were analysed. The paper will offer, nuanced, thick and detailed descriptions of school processes through the following empirical issues: • Use of extra funding introduced by SEP for new resources • Work with external agencies (ATEs): curriculum and assessment. • Preparation, planning, and Data use coming from SIMCE (national standardised test) • SEP Quality Assurance Framework use: diagnosis, plan, monitoring. • Extra-support staff collaboration and organisation • Organisation of pupils according to prior-attainment, behavioural difficulties, special needs.

Expected Outcomes

Main results are organised in three key issues: (i) some schools while are improving on mathematics and learning, are dramatically downplaying other educational outcomes: As new policies put strong pressure on the gaining of tests results, the lesson time of areas as history, drama, music, sports are reduced in favour of practicing test on basic subjects; (ii) Internal school capacities and professional development are paradoxically being deteriorated: external accountability reshaped teaching, testing reshaped planning, external private support introduced continuous assessment and planning but it will include to teachers on their design or analysis. While some group of teachers (teaching the testable subjects) are included and considered, others are marginalised of training and development (those teaching year-lessons with difficult to teach students); (iii) internal inequality is introduced as extensive tracking is introduced: since schools should show performance short term progress, there are not incentives to deal with students facing a range of emotional, cognitive, family, and learning difficulties. Strategies as tracking, grouping, admissions policies, expulsion, and others are introduced. Finally, the value-added measures seem to present an important degree of ubiquity as it does not relate to any kind of school internal reform. However, we found two cases study schools who were re-shaping, co-implementing national policies and providing education differently: they are implementing long-term school change projects based on collegiality, internal accountability and offering significant learning experiences. It is not clear that the new waves of policy initiatives are helping to produce long-term and substantive improvement for all. Conversely, those initiatives are restructuring Chilean schools and the nature of education in a country –according to OECD indicators- with high levels of school segregation, social inequality, and socioeconomic gaps in educational outcomes.

References

Alexander, R. (2010) (editor) Children, their World, their Education. Final Report and Recommendations of the Cambridge Primary Review Routledge. Day, C., Sammons, P., Hopkins, D., Leithwood, K. and Kingston, A. (2008) “Research into the impact of school leadership on pupil outcomes: policy and research contexts” School Leadership and Management 28(1): 5-25 Fullan, M. & Hargreaves, A. (2012) Professional Capital. Transforming Teaching in every School. Routledge. Hargreaves, A. & Shirley, D. (2009) The Fourth Way. The inspiring future for educational change. Corwin SAGE Company, NY. Luyten, H., Visscher, A. and Witziers, B. (2005) "School effectiveness research: from a review of the criticism to recommendations for further development". School Effectiveness and School Improvement, 16(3): 249-279. Ravitch, D. (2010) The death and life of the great American School System. How Testing and Choice Are Undermining Education. Basic Books, California Sahlberg, P. (2010) Finnish Lessons- What can the world learn from educational change in Finland?. Teachers College Press, Columbia University. Wolf, I. & Janssens, F. (2007) ‘Effects and side effects of inspections and accountability in education: an overview of empirical studies’, Oxford Review of Education, Vol. 33, No. 3, July 2007, pp. 379–396.

Author Information

Alejandro Carrasco (presenting / submitting)
Universidad Catolica de Chile
Faculty of Education
Santiago
Universidad Catolica de Chile, Chile
Universidad Catolica de Chile, Chile

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.