Session Information
09 ONLINE 23 B, Use of LSA Data for National Evaluation Puposes
Paper Session
MeetingID: 892 2675 8259
Code: 746294
Contribution
Education in Europe should be inclusive and fair. Inclusive for giving all students a chance to receive a good quality education and fair – it should not be influenced by students’ socio-economic background (European Commission/EACEA/Eurydice, 2020; Frønes et al., 2020).
OECD PISA results show that, with variations, students’ achievements are related to socio-economic status (SES) (OECD, 2019). In Latvia, the SES level of a school has a greater influence on students’ achievement than SES of students’ family (Geske et al., 2015), therefore students should have equal opportunities to access schools with high SES, regardless of their socio-economic background.
In 2021 a new Law on Administrative Territories and Populated Areas came into force in the Republic of Latvia. To reduce fragmentation, the number of municipalities and State cities was reduced from 119 to 43. Regional reform as a regional development issue might help students from families with lower SES get closer to schools with higher SES. To assure that more schools have high SES in municipalities, it is necessary to reorganize and optimize the school network and student achievement analysis can be used to make evidence-based decisions. As the majority of schools in Latvia are municipal schools, municipalities share the responsibility for assuring the quality and equity of education within the schools of their governance.
Over the last few years, Latvia has taken part in many international large-scale assessment (ILSA) programs e.g. IEA (International Association for the Evaluation of Educational Achievement), ICCS (International Civic and Citizenship Education Study), PIRLS (Progress in International Reading Literacy Study) and TIMSS (Trends in International Mathematics and Science Study), as well as in OECD PISA (Programme for International Student Assessment). ILSA data has a crucial advantage in comparison with national assessments: it’s free from any local influence so the results are independent and comparable regardless of the changes that take place in the current country. It provides data for research on a variety of issues as well as has strong methodological foundations, which allows secondary analysis for a better understanding of trends in education (Hernández-Torrano & Courtney, 2021).
The main differences in approaches between IEA studies and OECD’s PISA are that IEA studies focus on curriculum based knowledge and skills, as well as samples students according to their grade, while OECD focuses on competencies that will be necessary for student’s adulthood and samples regarding the age (Rocher & Hastedt, 2020). However, IEA and OECD studies can be merged (Strietholt & Scherer, 2018). Merging data files helps to increase the number of variables and therefore gives a wider range of information as well as gives the possibility to obtain new results (Sarwar et al., 2013).
Although international data allows the comparison across different education systems and shares the techniques, organizational structures, and policies that can help to improve the existing education system (Cresswell et al., 2015) national assessments are irreplaceable for national education quality and performance analysis within a particular education system, therefore in this particular study, there were used data from both national examinations and ILSA.
Research questions are:
- How to use ILSA data to evaluate students’ achievement in municipalities?
- What is the level of education quality in municipalities of Latvia?
Research objectives are:
- to identify how ILSA data can be used for evaluating students’ achievement in municipalities;
- to investigate the quality and equity of education in different municipalities of Latvia.
Method
Achievement data of each ILSA (PIRLS 2016, ICCS 2016, PISA 2018, and TIMSS 2019) study and three centralized ISCED level 3 maturity exams (in Mathematics, Latvian, and English in 2018, 2019, and 2020) were recalculated for every student so that the means are 500 and standard deviations - 100. The overall result for each municipality was obtained by calculating the average value. A similar procedure was implemented for calculating students’ SES in all ILSA studies for each municipality.
Expected Outcomes
The results show a positive and relatively high correlation (R=0.79) between students’ SES and their academic achievement in ILSA at the municipality level. In addition, the study showed a positive correlation between ILSA (ISCED level 1 and ISCED level 2) and centralized maturity exams of ISCED level 3. That proves the validity of the used method. The combined and separate analysis of students’ achievement of ILSA and state maturity exams provides extensive information on differences in the quality of education. Results also show a positive, relatively high correlation (R=0.76) between student achievement and the economic activity of municipalities. The study proved that it is legitimate to combine ILSA and results of state examinations to obtain the assessment of education quality in municipalities.
References
1.Clarke, M., & Luna-Bazaldua, D., (2021). Primer on Large-Scale Assessments of Educational Achievement. National Assessments of Educational Achievement;. Washington, DC: World Bank. https://openknowledge.worldbank.org/handle/10986/35494 License: CC BY 3.0 IGO 2.Cresswell, J., Schwantner, U., Waters C. (2015), A Review of International Large-Scale Assessments in Education: Assessing Component Skills and Collecting Contextual Data, PISA, The World Bank, Washington, D.C./OECD Publishing, Paris. 3.European Commission/EACEA/Eurydice (2020). Equity in school education in Europe: Structures, policies and student performance. Eurydice report. Luxembourg: Publications Office of the European Union. 4.Frønes T.S., Pettersen A., Radišić J., Buchholtz N. (2020) Equity, Equality and Diversity in the Nordic Model of Education—Contributions from Large-Scale Studies. In: Frønes T.S., Pettersen A., Radišić J., Buchholtz N. (eds) Equity, Equality and Diversity in the Nordic Model of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-61648-9_1 5.Geske, A., Grīnfelds, A., Kangro, A., Kiseļova,R., Mihno L., (2015). Monograph Series: Educational Research in Latvia, Nr. 8. Quality of Education: International Comparison. Latvia in OECD Programme for International Student Assessment. Riga: University of Latvia 2015, ISBN 978 -9934 -527 -44 -9. p 335 pp. 6.Hernández-Torrano, D., & Courtney, M.G.R. (2021) Modern international large-scale assessment in education: an integrative review and mapping of the literature. Large-scale Assess Educ 9, 17. https://doi.org/10.1186/s40536-021-00109-1 7.Karakolidis, A., Duggan, A., Shiel, G. et al. (2021) Examining educational inequalities: insights in the context of improved mathematics performance on national and international assessments at primary level in Ireland. Large-scale Assess Educ 9, 5. https://doi.org/10.1186/s40536-021-00098-1 8.OECD (2019), PISA 2018 Results (Volume II): Where All Students Can Succeed, PISA, OECD Publishing, Paris, https://doi.org/10.1787/b5fd1b8f-en. 9.Rocher, T., & Hastedt, D. (2020). International large-scale assessments in education: a brief guide IEA Compass: Briefs in Education No. 10. Amsterdam, The Netherlands: IEA 10.Sarwar, G.S., Zerpa, C., Barneveld, C.V., Simon, M., & Brinson, K. (2013). Merging Large-Scale Assessment Data for Secondary Analysis: Experiences with EQAO's Data. Journal of Education and Learning, 2, 44-54. 11.Strietholt, R., & Scherer, R. (2018). The contribution of international large-scale assessments to educational research: Combining individual and institutional data sources. Scandinavian Journal of Educational Research, 62(3), 368–385. https://doi.org/10.1080/00313831.2016.1258729 12.Yang Hansen K.,& Johansson S. (2020) Student Assessment in the Landscape of International Large-Scale Studies. In: Harju-Luukkainen H., McElvany N., Stang J. (eds) Monitoring Student Achievement in the 21st Century. Springer, Cham. https://doi.org/10.1007/978-3-030-38969-7_21
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.