Session Information
09 SES 02 A, Fairness and Validity in High-Stakes Testing (Part 1): Fair by Design? Measurement Issues and Equity in High-Stakes Admissions and National Testing
Symposium
Contribution
In developing the national tests in Social Studies, a critical issue is to ensure that the items work in the same way for different classifications of students, i.e. that the test fair and show no signs of severe Differential Item Functioning (DIF). Social Studies is a mandatory subject in the Swedish compulsory school, covering a wider range of content than, for instance, the subject of Civics. In Sweden, the national tests are intended to be digitalized and the proportions of items with selected response format are also intended to increase. As a consequence, the proportion of items with a constructed response format will decrease. It is important analyse the consequences of this shift for different subgroups of students. However, preliminary analyses (Löfstedt & Bergh, 2025) show that there are indeed DIF across genders with respect to different item formats, where boys commonly find selected response item formats easier compared to girls. In addition, in a forthcoming article (Löfstedt & Bergh, 2026) it is concluded that there is a risk that students following the syllabus of Swedish as a second language to be disadvantaged compared to the general student population, if the proportion of selected response items is increased. The purpose of this study is to analyse DIF across genders and Swedish language syllabus groups, taking into account potential subgroup interactions. The study is based on data from the Swedish national test in Social Studies collected in 2018, 2019, 2022 and 2023. The data are analysed by means of the Polytomous Rasch Model (Rasch, 1960/1980; Andrich, 1978). The results reveal that there are indeed important DIF effects across genders and Swedish language syllabus groups, having significant implications for subgroups of students. Thus, as the test result influences the student’s final subject grade, the results of this study may have implications for student opportunities for upper secondary school program admission. However, the patterns are clarified by also taking into account the subgroup interactions (gender by Swedish language syllabus) in the DIF analyses. In addition, consequences of the item format shift are discussed from a test dimensionality perspective.
References
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrica, 43 (4), 561-573. Löfstedt, A., & Bergh, D. (2025, September 2–3). The question of gender in national testing: Potential implications of format change as a consequence of digitalization for subgroups of students—Experiences from the Swedish national test in social studies [Conference presentation]. Frontier Research in Educational Measurement (FREMO), Oslo, Norway. Löfstedt, A., & Bergh, D. (2026, in press). Investigating DIF: The role of response format for students following the syllabus for Swedish as a second Language – Experiences from the Swedish National Tests in Social Studies. Nordidactica 2025:2. Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests (Copenhagen, Danish Institute for Educational Research). Expanded edition (1980) with foreword and afterward by Benjamin D. Wright. Chicago: The University of Chicago Press.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.