Session Information
12 SES 08 A JS, Research Syntheses in the Diverse Research Field of Digital Learning: Methodological Approaches, Dynamic Processes and Reflections on Open Science
Joint Symposium NW 12 and NW 16
Contribution
During the height of the COVID-19 pandemic, teachers, school leaders and policymakers needed evidence quickly, in order to inform emergency remote education policy and practice. This paper reports on a rapid review of 89 K-12 studies from around the world, undertaken following the first 7 months of the pandemic. Owing to the frequently changing landscape of the pandemic, a rapid review was chosen over a more extensive systematic review, as this allowed for streamlining and omitting aspects of the reviewing process to enable quicker dissemination (Hamel et al., 2020; Tricco et al., 2020). The rapid review was still undertaken using a transparent and replicable search strategy (Gough et al., 2012), but the number of databases searched was limited to four and a formal quality assessment was not undertaken, although any studies that did not include explicit details of participants with clear empirical data were excluded. This review was also intended to be a living rapid review (Elliott et al., 2014), updated regularly with new studies meeting the inclusion criteria, particularly through the use of machine learning via Microsoft Academic Graph within the evidence synthesis software EPPI-Reviewer (Thomas et al., 2023). Whilst this was initially achievable, the sheer volume of research that has been published on teaching and learning during the pandemic quickly became overwhelming for only one researcher to keep up with, coupled with a changeover of machine learning provider within EPPI-Reviewer to OpenAlex (Priem et al., 2022). This paper will therefore discuss the benefits and challenges of conducting both rapid reviews and living reviews, reflecting on this COVID-19 example, and provide advice for conducting similar reviews in the future.
References
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603. https://doi.org/10.1371/journal.pmed.1001603 Gough, D., Oliver, S., & Thomas, J. (Eds.). (2012). An introduction to systematic reviews. Sage. Hamel, C., Michaud, A., Thuku, M., Skidmore, B., Stevens, A., Nussbaumer-Streit, B., & Garritty, C. (2020). Defining Rapid Reviews: a systematic scoping review and thematic analysis of definitions and defining characteristics of rapid reviews. Journal of Clinical Epidemiology. Advance online publication. https://doi.org/10.1016/j.jclinepi.2020.09.041 Priem, J., Piwowar, H., & Orr, R. (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. ArXiv. https://arxiv.org/abs/2205.01833 Thomas, J., Graziosi, S., Brunton, J., Ghouze, Z., O'Driscoll, P., Bond, M., & Koryakina, A. (2023). EPPI-Reviewer: advanced software for systematic reviews, maps and evidence synthesis [Computer software]. EPPI-Centre Software. UCL Social Research Institute. London. https://eppi.ioe.ac.uk/cms/Default.aspx?alias=eppi.ioe.ac.uk/cms/er4 Tricco, A. C., Garritty, C. M., Boulos, L., . . . Straus, S. E. (2020). Rapid review methods more challenging during COVID-19: Commentary with a focus on 8 knowledge synthesis steps. Journal of Clinical Epidemiology, 126, 177–183. https://doi.org/10.1016/j.jclinepi.2020.06.029
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.