Session Information
12 SES 07 A, Symposium: Open Science, Replicability, Reproducibility and Transparency in Systematic Reviews
Symposium
Contribution
Research on educational technologies continues to be predominantly shaped by Western research traditions and learning theories (Bulfin et al., 2013; Hew et al., 2019). In addition, much of the extant empirical evidence originates from so-called WEIRD countries (Henrich et al., 2010), meaning western, educated, industrialized, rich, and democratic contexts. This pattern is also visible in recent work on learning analytics (Baek & Doleck, 2024) and bibliometric studies in human–computer interaction (Linxen et al., 2021). Drawing back on empirical research on artificial intelligence in higher education as an example, the presented mapping review (Sutton et al., 2019) examines the extent to which this field remains influenced by WEIRD publications. Following the PRISMA guidelines for systematic reviews (Page et al., 2021), the authors developed an extensive search string and applied pre-determined inclusion and exclusion criteria. Studies were included if they were primary studies that addressed students in tertiary education, clearly focused on AI in higher education, implemented a (quasi)experimental study design, incorporated a distinct method section, and were written in languages that were translatable by DeepL. Following the rigorous application of exclusion criteria during multiple rounds of screening titles and abstracts, as well as the full texts, 249 studies were deemed eligible for inclusion and data extraction. The preliminary results of this review indicate that publication structures have shifted, with almost one third of studies originating from China. However, most studies do not report participant characteristics, raising doubts about whether this geographic shift necessarily reflects more inclusive research practices. The presentation will discuss these findings and their implications for both future research and the responsible use of AI in education.
References
Baek, C. & Doleck, T. (2024). Learning Analytics. A Comparison of Western, Educated, Industrialized, Rich and Democratic (WEIRD) and Non-WEIRD Research. Knowledge Management & Learning, 16(2), 217-236. Bulfin, S., Henderson, M., & Johnson, N. (2013). Examining the use of theory within educational technology and media research. Learning, Media and Technology, 38(3), 337–344. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). Most people are not WEIRD. Nature, 466(7302), 29–29. Hew, K.F., Lan, M., Tang, Y., Jia, C., &Lo, C.K. (2019). Where is the “theory” within the field of educational technology research? BJET, 50, 956-971. Linxen, S., Sturm, C., Brühlmann, F., Cassau, V., Opwis, K., & Reinecke, K. (2021). How WEIRD is CHI? CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 143, 1-14. Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., ... & Moher, D. (2021). Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement. Journal of clinical epidemiology, 134, 103-112. Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019). Meeting the review family: exploring review types and associated information retrieval requirements. Health Information and Libraries Journal, 36(3), 202-222.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.