Session Information
09 SES 10 C, Modelling Student Growth and Assessment Processes in School Contexts
Paper Session
Contribution
This paper presents a large-scale institutional research project examining the drivers of student literacy growth in Kazakhstan. The study focuses on students in Grades 3, 4, and 7 across 13 schools within the BI Education network and aims to identify student-, teacher-, and family-level factors associated with literacy development over an academic year. While literacy outcomes are a central concern in international education systems, there remains a need for context-sensitive, data-informed approaches that move beyond cross-sectional achievement measures.
The study is guided by a value-added framework and contemporary models of school effectiveness, which emphasise growth-oriented assessment, instructional quality, and the role of home learning environments. Rather than relying solely on end-point achievement scores, the project examines literacy development longitudinally by administering equated initial and final literacy assessments. This approach allows for the estimation of student growth “beyond what might be expected,” accounting for prior achievement and contextual factors.
The research addresses three core questions:
(1) What student-level, teacher-level, and parental factors predict growth in literacy achievement across Grades 3, 4, and 7?
(2) To what extent do pedagogical practices and classroom-level variables explain variation in literacy growth after controlling for student background characteristics?
(3) How can value-added analysis be used to identify classrooms demonstrating high, moderate, and low contributions to student literacy growth?
The conceptual framework integrates multilevel models of learning with value-added analysis to capture the nested structure of educational data (students within classes, classes within schools). Student literacy growth is conceptualised as an outcome influenced by instructional practices, school organisation, and family-level support. The study also incorporates follow-up qualitative querying of selected classrooms to contextualise quantitative findings and explore pedagogical practices associated with higher-than-expected student growth.
The international relevance of this research lies in its methodological contribution and its focus on literacy development within a rapidly reforming education system. By combining psychometrically robust literacy assessments, multilevel modelling, and value-added analysis, the study offers an evidence-informed framework applicable to other education systems seeking to strengthen literacy outcomes through growth-oriented evaluation rather than high-stakes accountability alone. Findings are expected to inform both policy and practice by highlighting effective pedagogical and organisational conditions for literacy development.
Method
The study employs a longitudinal, quantitative research design complemented by targeted qualitative follow-up. Participants include students in Grades 3, 4, and 7 from 13 BI Education schools in Kazakhstan, with students nested within classes and schools. Literacy assessments are administered four times during the academic year, with equated initial and final tests used to estimate student growth in reading literacy. Literacy assessments are developed and validated using both Classical Test Theory and Modern Test Theory, including Rasch modelling. Item response data are analysed using the R programming language, with established psychometric packages used to estimate reliability, item functioning, and student ability. Common-item equating is applied to ensure comparability between initial and final assessments. In addition to student assessments, structured questionnaires are administered to parents and teachers. Parent surveys collect information on educational background, home literacy resources, reading practices, and parenting behaviours. Teacher surveys capture qualifications, pedagogical practices, instructional strategies, and classroom organisation. These instruments allow for the examination of both individual- and class-level predictors of literacy growth. Multilevel regression modelling is employed to analyse predictors of literacy development, accounting for the hierarchical structure of the data (students nested in classes, classes nested in schools). Final literacy ability estimates serve as dependent variables, with student-, teacher-, and school-level characteristics included as predictors. Value-added analysis is subsequently conducted to identify classrooms demonstrating high, moderate, and low contributions to student literacy growth. To contextualise quantitative findings, follow-up qualitative querying is conducted in selected classrooms. This non-invasive approach focuses on classroom culture, instructional practices, and student–teacher interactions, providing interpretive depth to the statistical results. Together, these methods offer a comprehensive and ethically grounded approach to understanding literacy development in school settings.
Expected Outcomes
The study is expected to identify key student-, teacher-, and family-level factors associated with literacy growth across primary and lower secondary grades. Anticipated findings include differential effects of pedagogical practices, classroom organisation, and home literacy environments on student growth, even after controlling for prior achievement. Value-added analysis is expected to reveal meaningful variation between classrooms, highlighting instructional contexts in which students demonstrate higher-than-expected literacy gains. These findings will support a shift from deficit-oriented interpretations of achievement toward growth-focused evaluation of teaching and learning. The integration of quantitative and qualitative evidence is expected to provide actionable insights into effective instructional practices and classroom conditions that support literacy development. The findings will be relevant for school leaders, policymakers, and researchers seeking to design professional development, curriculum support, and assessment systems aligned with evidence-informed improvement. More broadly, the study is expected to contribute to international discussions on literacy assessment, value-added modelling, and the ethical use of educational data to support student learning rather than punitive accountability.
References
OECD. (2013). Synergies for Better Learning: An International Perspective on Evaluation and Assessment. Paris: OECD Publishing. Ainscow, M., Chapman, C., & Hadfield, M. (2020). Changing education systems for equity and excellence. Educational Research, 62(3), 1–17. Costello, R., Elson, P., & Schacter, J. (2008). An introduction to value-added analysis. Journal of Catholic Education, 12(2), 195–212. Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Danish Institute for Educational Research. Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.