Using large scale assessment data for school improvement: A decade of data
Author(s):
Helen Wildy (presenting / submitting)
Conference:
ECER 2013
Format:
Paper

Session Information

26 SES 05 JS, Assessment, Effectiveness and School Improvement

Paper Session
Joint Session with NW 11

Time:
2013-09-11
11:00-12:30
Room:
D-311
Chair:
Samuel Gento

Contribution

In the past decades, schools in developed nations have been experiencing the double challenge of increasingly decentralised structural arrangements coupled with strenthening accountability demands. Often this is described as a situation in which, as the rope lengthens, the noose tightens, or balancing the dilemma of autonomy and accountability (Wildy, 1998; Arcia, Macdonald, Patrinos & Porta, 2011). Some argue that large scale assessment regimes serve as instruments for educational reform. However, others believe that such regimes are the work of the devil, imposing constraints on the curriculum and leading to unethical exclusions of students.

This paper addresses the question: How can school systems use large scale data to centrally encourage and support school improvement, in a context of increasing decentralisation of authority?

It is proposed that the balance among variables such as authority to hire and fire teachers, responibility to formulate school budgets, and curriculum design and content relate in different ways to the level of student achievement, as measured internationally by PISA (Wößmann, Lüdemann, Schütz & West, 2007).  PISA provides comparable data on 15 year students for  41 countries including member countries of the OECD. However, it is not always obvious how accountability operates to stimulate school improvement or what accountability measures make a difference.

The paper reports the experiences of one educational authority in Western Australia that has taken seriously  the use of national assessment data, as well as international assessment and state-level exit examination data. Structures of support and pressure have been implemented now for 8 years, using 12 years of data.

This paper provides an example of how assessment regimes are used for accountability and also to drive improvement in student learning, and how this pressure is balanced with support within a context to evolving school level autonomy.

 

 

Method

Over 8 years, a range of technologies have been used, from pen and paper, to floppy discs, to compact discs, and web based programs, each offering increasingly more sophisticated access to a wide range of data displays. Multiple sources of data are represented as longitudinal data at schools level and by individual student, value added measures, and individual student growth charts, with comparisons between school and like schools, whole state and whole country. Accompanying the software development has been professional development, mandated, and targetted at the role of the school leader in interpreting and using assessment data to drive student learning improvement. The paper also reports some case studies depicting uses to which these schools are now putting the data.

Expected Outcomes

The study reveals how the educational authority applied a model of gradual withdrawal across its 152 schools, spread throughout the state of Western Australia, an area one third the size of Europe. Over a period of 8 years, principals and teachers in these schools have shifted from a state of fear and ignorance about the use of data to a deep and thoughtful embracing of a wide range of types of data. In the process, knowledge and expertise about forms of data and their interpretation, as well as application of school level processes and structures, shifted from the external university staff who worked with the education authority personnel, through to school consultants with responsibility for large groups of schools, to school-appointed staff. By 2013, the role of the university research team has diminished to one of providing data through accessible software and researching the use of the data.

References

Arcia, Gustavo, Harry Patrinos, Emilio Porta, and Kevin Macdonald, 2011. “School Autonomy and Accountability in Context: Application of Benchmarking Indicators in Selected European Countries.” Regulatory Institutional Framework, Benchmarking Education Systems for Results, Human Development Network. The World Bank, Washington DC. Glenn,C., Groof, J., & Cara Stillings Candal, C (eds.) Balancing freedom, autonomy and accountability in education volume 4 Wildy, H. (2004). The Data Club: Helping schools use accountability data. In M. Wilson (Ed.), Towards Coherence between Classroom Assessment and Accountability (pp.155-168). 103rd Yearbook of the National Society for the Study of Education, Part II. Chicago, Il: University of Chicago Press. Wildy, H. (2009). Making local meaning from national assessment data. Professional Educator, 8(3), 32-35. Wildy, H. (2012, August). Using data to drive school improvement. Refereed conference proceedings of the Research Conference of the Australian Council for Educational Research, Perth, WA. Wildy, H. & Louden, W. (2000). School restructuring and the dilemmas of principals’ work. Educational Management and Administration, 28(3), 173-184. Wöbmann, L. et al. (2007), “School Accountability, Autonomy, Choice, and the Level of Student Achievement: International Evidence from PISA 2003”, OECD Education Working Papers, No. 13, OECD Publishing. http://dx.doi.org/10.1787/246402531617

Author Information

Helen Wildy (presenting / submitting)
The University of Western Australia
Faculty of Education
Crawley

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.