Session Information
12 SES 06 A JS, Joint Symposium - From Log Data to Research Data: Quality, Documentation, Reuse, and Protection in Large-Scale Educational Studies - NW 09, NW 12 and NW 27
Joint Symposium Session
Contribution
Digitalization has profoundly reshaped data production in educational research. Technology-based assessments now generate large volumes of log-files holding process-oriented data, while at the same time expectations regarding transparency, reproducibility, and data reuse have increased across the social sciences. Against this background, educational researchers face a dual challenge: managing technically complex data such as log files and embedding these data within broader infrastructures and governance frameworks that enable responsible sharing and reuse. This symposium brings together four complementary contributions that address these challenges across different stages of the research data lifecycle.
Three of the contributions focus specifically on log data from technology-based large-scale assessments, examining issues of documentation, data quality, and data protection. The fourth contribution deliberately broadens the perspective by examining educational research data more generally within a national social science repository. Together, the presentations situate log data within the wider ecosystem of educational research data practices rather than treating them as a standalone methodological innovation.
The first contribution, by Breitwieser addresses the challenge of making log data reusable through adequate documentation. Log data are inherently context-dependent: Individual events can only be interpreted in relation to the digital system that generated them. Documentation is crucial in helping secondary researchers to understand this relation. Drawing on examples from international large-scale assessments and digital learning environments, the presentation illustrates why conventional documentation formats are often insufficient. It compares alternative strategies, such as enhanced system descriptions and log-data replays, and concludes with practical recommendations and proposed minimum standards for documenting log data in a way that supports transparency, reproducibility, and secondary use.
The second contribution, by Borisova, examines data protection challenges associated with sharing and reusing log data under the General Data Protection Regulation (GDPR). With the shift to online testing, large-scale assessments increasingly collect detailed behavioral traces that may constitute personal data even after direct identifiers are removed. Drawing on experiences from TIMSS 2023, the presentation discusses challenges related to transparency, purpose limitation, and re-identification risk. It illustrates how legal requirements can be addressed through improved participant information, technical safeguards, and contractual measures, while still enabling scientifically meaningful data access.
The third contribution, by Sibberns, critically examines the widespread assumption that machine-generated data are inherently clean and error-free. Based on empirical experiences from ILSA log-file processing, the presentation demonstrates how technical failures, programming inconsistencies, and administrative deviations introduce systematic errors into log data. It discusses methods for identifying such issues and compares strategies for handling them, emphasizing that preprocessing decisions have substantive analytical consequences and must therefore be explicitly documented.
The fourth contribution, by Heers, shifts the focus from specific data types to research data infrastructures. Using metadata from SWISSUbase, Switzerland’s national social science data repository, the presentation profiles educational research datasets in terms of data types, institutional affiliations, and regional distribution. These patterns are compared with publicly available information on education research outputs to identify gaps and areas of underrepresentation. The analysis highlights structural and cultural barriers that continue to limit data sharing in education research and discusses how repositories can address these challenges through tailored support, guidance on ethical and practical issues, and incentives aligned with FAIR principles.
Taken together, the symposium highlights that the scientific value of both log data and educational research data more broadly depends on coordinated attention to data quality, documentation, legal compliance, and infrastructural support. By combining log-data–specific perspectives with a repository-based analysis, the symposium aims to foster a more integrated and reflexive approach to research data practices in large-scale educational studies.
References
Becker, B., Neuendorf, C., & Jansen, M. (2022). Nutzung von Logdaten in der empirischen Bildungsforschung—Eine Bedarfsanalyse. https://doi.org/10.5281/ZENODO.7030996 Chen, G., Liu, Y., & Mao, Y. (2024). Understanding the log file data from educational and psychological computer-based testing: A scoping review protocol. PLoS ONE, 19(5), e0304109. European Union. (2016). General Data Protection Regulation (EU) 2016/679. Goldhammer, F., Hahnel, C., Kroehne, U., & Zehner, F. (2021). From byproduct to design factor: On validating the interpretation of process indicators based on log data. Large-Scale Assessments in Education, 9(1), 1–25. Heers, M. (2023). Data sharing in the social sciences. FORS Guides. Kroehne, U., & Goldhammer, F. (2025). Software tools for analyzing log data. In Innovative Digital-Based International Large-Scale Assessments. Springer. Late, E., & Ochsner, M. (2024). Re-use of research data in the social sciences. PLOS ONE, 19(5), e0303190. Wilkinson, M. D., et al. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.