Session Information
23 SES 07 A, Policy Landscapes in Flux: Multi-scalar Perspectives on Autonomy, Assessments, and Accountability Reforms in Education
Symposium
Contribution
Expectations for schools to use data from a variety of sources to improve the education they offer have been increasing globally (Verger & Skedsmo, 2021). Over time, what data is and means has expanded from only considering standardised national large-scale assessments. In the Italian school autonomy and accountability system, schools’ own analysis and reflection about data both received from central administration and produced locally are expected to be used for didactic and organizational improvement. In this research, the use by schools of internally and externally produced data of organisational, administrative, assessment, pedagogic nature and beyond is analysed. These include national tests, schools’ self-evaluation reports, grades, teacher observation, demographic data, and more. Research on data use in the Italian context is particularly limited. Specifically, no research has been conducted following the conceptualization of data going beyond national assessment data. Pastori and Pagani (2016) report a growing trust in the validity of data from national assessments results, but difficulty in making use of it because of time, skills necessary to analyse data, and lack of habit in engaging is such processes. This research seeks to understand to what extent and how data use processes and routines happen in Italian schools, what facilitates them, what schools consider as data and their attitudes towards it. The paper specifically analyses how school organizational and political context, individual factors, and the accountability system mediate data use, and whether and how data influences pedagogical and organizational decisions in schools. This study uses data use conceptualisations and frameworks (Coburn and Turner, 2011; Spillane, 2012) to study data use in education in a specific Southern-European low-stakes accountability context. It places emphasis on the use of data for equity purposes (Datnow & Park, 2018), through a conceptual model for critical data-driven decision making (Dodman et al., 2021), and embraces the notion of data-informed decision making rather than data-based decision making (Schildkamp et al., 2019). Methodologically, this qualitative study uses interviews of principals and teachers in 12 primary and lower-secondary schools, selected to guarantee variety of socio-economic context, in the city of Rome. Expected results include limited structured use of data, positive attitudes regarding conceptualization of data beyond national assessment results, organizational and data literacy barriers for data use. It is also anticipated that ideas of data use include data use to increase equity, but that processes for this to happen may not be structured or systematically present.
References
Coburn, C. E., & Turner, E. O. (2011). Research on data use: A framework and analysis. Measurement: Interdisciplinary Research & Perspective, 9(4), 173-206. Datnow, A., & Park, V. (2018). Opening or closing doors for students? Equity and data use in schools. Journal of Educational Change, 19, 131-152. Dodman, S. L., Swalwell, K., DeMulder, E. K., View, J. L., & Stribling, S. M. (2021). Critical data-driven decision making: A conceptual model of data use for equity. Teaching and Teacher Education, 99, 103272. Pastori, G., & Pagani, V. (2016). Cosa pensate dei test INVALSI? Dirigenti scolastici, insegnanti e studenti provenienti dalla Lombardia descrivono la loro esperienza. Journal of Educational, Cultural and Psychological Studies, 2016(13), 97–117. Schildkamp, K., Poortman, C. L., Ebbeler, J., & Pieters, J. M. (2019). How school leaders can build effective data teams: Five building blocks for a new wave of data-informed decision making. Journal of educational change, 20, 283-325. Spillane, J. P. (2012). Data in practice: Conceptualizing the data-based decision-making phenomena. American Journal of Education, 118(2), 113-141. Verger, A. & Skedsmo, G. (2021). Enacting accountability in education: exploring new policy contexts and theoretical elaborations. Educational Assessment, Evaluation and Accountability, 33(3), 391-402.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.