Session Information
27 SES 11 A, Focus on Student Perspectives, Motivation and Culture of Teaching
Paper Session
Contribution
Higher education is undergoing significant changes. The demand of changing the instructional approach from a traditional teacher-centred approach to a project-based or problem-based student-centred approach is widely discussed [Schreurs & Dumbraveanu, 2014]. Also, digitalization leads to an increase in digital tools, including online interaction, which open new opportunities for increasing the individualization of education in terms of location, time, content, and pace of learning. All these significantly raises the demand for the quality of teaching and instructional design [Educause, 2021].
At the same time, due to the digitalization of education, learning analytics is becoming an essential growing field of study and practice in education worldwide. The data on the instructor’s work and the students’ learning activities could be analyzed to enhance learning outcomes and the educational environment. Learning data is used in primary, secondary, and tertiary education and lifelong learning. The exampling areas of its application are: learner`s motivation, learning styles detection, performance prediction, etc. [Bravo-Agapito et al., 2018]. Data for analysis may be extracted from various digital environments, such as LMS [Schumacher, et al., 2018], MOOCs [Feng et al., 2019], applications. Learning data may be analyzed through different methods, like factor analysis, regression, correlation mining, causal data mining, path mining, clustering, text mining, classification [Bravo-Agapito et al., 2018]. Importantly, data-driven decision-making in education may provide feedback to instructors, informing them on the possible way of the course improvement [Schifter et al., 2014].
However, two problems can be stated. First, the problem of the current instructional design models is that course design improvements are usually implemented at the end of the course, which does not benefit the current learning group. It is difficult for teachers to get and interpret current data and plan timely interventions. Considering this, learning analytics can provide new opportunities to gain valuable insights into student learning behaviour. But there are limited ways of using learning analytics for instructional design improvement now, not many cases were described in the research literature, and no systematic literature review on this topic currently exists [Schmitz et al., 2017]. At the same time, there is an apparent demand among instructional designers and teachers to use learning analytics in the design and/or redesign of courses [Muljana & Luo, 2021].
The other side of the problem is the challenge posed by learning analytics. Despite learning analytics providing data on specific, observable behaviour in real time, there is a lack of clear contextual frameworks that lead teachers and instructional designers to interpret the information. Instructional design can be seen as a framework allowing to capture pedagogical intent that can provide context for understanding different sets of data [Lockyer et al., 2013].
Thus, despite the great possibilities of learning analytics, its resources have not yet been used efficiently in instructional design improvement. There is a severe gap between the theory and practice of instructional design and the possibilities of learning analytics. This gap should be bridged through the development of the theory and practice of instructional design that could contribute to the constant improvement of educational products through their redesign based on evidence-based approaches, including learning analytics.
The first step to bridge this gap is to map the existing research literature in the intersection of learning analytics and instructional design. The research question for the proposed scoping literature review is whether this field provides suggestions to course quality enhancement, how elaborated this field is, what results it came to and what gaps are looking forward to being addressed by education researchers in the future.
Method
The research will be performed as a scoping review aiming at the following aspects, formulated for current research basing on (Munn at al.): 1) identifying the types of available evidence of learning analytics applications for informing and improving instructional design; 2) examining how research is conducted in such a field, which methods are applied, which theories are discussed and which data is used; 3) discovering the gaps in the knowledge base. At the first stage of the review research, the original papers and reviews satisfying the search request “learning analytics AND instructional design” in article title, abstract and keywords will be derived from the major bibliometric databases Scopus and Web of Science. At the second stage, those papers that do not have an open full text will be extracted from the sample. Next, two scholars will independently read these papers to manually extract the authors’ name and affiliation, research questions, applied methods and data, research results, practical implications, as well as limitations. Finally, the authors will discuss their results to elaborate the decision on the review results.
Expected Outcomes
The suggested review will result in a map of the research in the intersection of learning analytics and instructional design. It will deliver the scholars and institutions working in this field, theories, methods and data that are used, and the outcomes that have been achieved by those scholars so far. In general, this review will answer the question of whether this field provides suggestions to course quality enhancement, how elaborated this field is, what results it came to and what gaps are looking forward to being addressed by education researchers in the future. It will help to state new research questions in this field knowing that they are original and haven’t been answered yet. The newcomers to the field of learning analytics for informing instructional design will get a map of the research centres and leading scholars they might consider for potential cooperation.
References
Frick T.W., Myers R.D., Dagli C., Barrett A.F. Innovative learning analytics for evaluating instruction. A big data roadmap to effective online learning. Routledge, 2021. · Lockyer L., Heathcote E., Dawson S. Informing pedagogical action: Aligning learning analytics with learning design // American behavioral scientist. 2013. Vol. 57, no 10. P. 1439-1459. · Lester J., Klein C., Johri A., Rangwala H. (Eds.). Learning analytics in higher education. Current innovations, future potential, and practical applications. Routledge, 2019. · Lodge J.S., Horvath J.C., Corrin L. Learning analytics in the classroom. Translating learning analytics research for teachers. Routledge, 2018. · Muljana P.S., Luo T. Utilizing learning analytics in course design: voices from instructional designers in higher education. Journal of computing in higher education. 2021. Vol. 33, No. 1. P. 206-234. · Munn Z., Peters M. D., Stern C., Tufanaru C., McArthur A., Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC medical research methodology. 2018. Vol. 18, no 1.P. 1-7. · Schifter C., Natarajan U., Ketelhut D.J., Kirchgessner A. Data-driven decision-making: Facilitating teacher use of student data to inform classroom instruction. Contemporary issues in technology and teacher education. 2014. Vol. 14, no 4. P. 419-432. · Schmitz M., Van Limbeek E., Greller W., Sloep P., Drachsler H. Opportunities and challenges in using learning analytics in learning design. European conference on technology enhanced learning. Springer, Cham. 2017. P. 209-223. · Sclater N., Peasgood A., Mullan J. Learning analytics in higher education. Jisc, 2016. · Siemens G., Dawson S., Lynch G. Improving the quality and productivity of the higher education sector. Policy and strategy for systems-level deployment of learning analytics. Canberra, Australia: Society for learning analytics research for the Australian office for learning and teaching. 2013. 31 p. · Wong B. T. M. Learning analytics in higher education: an analysis of case studies // Asian association of open universities journal. 2017. Vol. 12, no 1. P. 21–40. DOI: 10.1108/aaouj-01-2017-0009.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.