Performing Context Intervention Mechanism Outcome-logic Analyses on School Interventions Aimed at Personalised Learning with ICT
Conference:
ECER 2017
Format:
Poster

Session Information

16 SES 04.5 PS, General Poster Session

General Poster Session

Time:
2017-08-23
12:00-13:30
Room:
W4.corridor (Poster Area)
Chair:

Contribution

This study explores the implementation and evaluation of interventions for personalised learning with ICT in Dutch primary and secondary schools using Context Intervention Mechanism Outcome-logic analyses (CIMO; Denyer, Tranfield & van Aken, 2008). The study is embedded in a government supported education project, entitled ‘A Breakthrough in Education and ICT’, which seeks to support student learning using ICT in an efficient and effective way to meet the individual differences between students. Within this project 38 secondary  schools received funding for two consecutive school years (2015/2016 & 2016/2017) to design and implement innovations related to personalised learning and ICT. For the design of school-specific interventions, the schools were supported by the sector organisation of secondary schools. Also, 87 primary schools were implementing innovations related to personalised learning and ICT. As a result of 125 schools being in charge of designing their own interventions related to personalized learning and ICT, the scale, content and focus of the school-specific interventions varied largely amongst the participating schools. The objective of our research is to study the implementation of the school-specific interventions and its effects on student learning, motivation and self-regulation skills through a CIMO-logic. The analysis concerns a case-comparative analysis technique which makes it possible to study implementation and evaluation of innovations across cases. With this study, we expect to generate insights in how schools optimally implement learning environments with ICT to accommodate for differences in students’ needs. The main research question is:

How do secondary schools implement school-specific interventions related to personalised learning with ICT and what are the outcomes of these interventions for students’ motivation, self-regulation and cognitive performance?

 

Conceptual framework

The use of technology in schools has recently received increasing interest for integrating ICT to support personalised learning (Vandewaetere,  Desmet, & Clarebout, 2011). Personalised learning is often used as synonym for self-regulated learning, differentiated instruction and adaptive teaching (Prain et al., 2013). In our study, we define personalised learning as the organization of learning environments in such a way that students’ learning experiences are tuned to students’ needs. We are especially interested in the way teachers enact ICT-integrated personalised learning environments to meet students’ needs. According to Corbalan, Kester and Van Merriënboer (2006) adaptation to students’ needs can be either a result of teacher control, student control or shared control. In this approach, differentiated instruction can be seen as personalised learning through a teacher controlled learning environment and students’ self-regulated learning as typically student-controlled. These different forms of personalised learning have been suggested to impact students’ learning, motivation and development of self-regulation skills (Van Merriënboer & Kirschner, 2013). However, little is known about how schools integrate technology-enhanced learning environments with personalised pedagogies and what its effects are on students’ cognitive and affective outcomes (Robinson & Sebba, 2010; Vandewaetere, Desmet & Clarebout, 2011).

 

Topic of poster

This research is characterized by a large variety of case-studies of school-based interventions related to personalised learning and ICT. The poster discusses the CIMO-logic technique that we perform to compare the similarities and differences between the implementation and outcomes of these multiple school-specific interventions (Denyer, Tranfield & van Aken, 2008). Most studies about innovations in schools report little about mechanisms that can explain why a certain intervention produces a certain outcome. The CIMO-logic has previously proved to be useful for distinguishing effective mechanisms in school change (cf. Authors, 2015). This analysis technique is characterized by a chain reasoning of interventions to mechanisms and outcomes (see Methods). We will discuss our experiences and assets of using this technique in our study.

 

Method

During the school year 2016/2017, we study school-specific interventions of 125 primary and secondary schools using the following research instruments and data sources: classroom observations, student and/or teacher interviews, student and/or teacher questionnaires, conversations with school management, school documents, and log books. For each school, we wrote a customized research plan and assigned a researcher from our team to the school to perform the research. Because each school had a different intervention, the focus of each school-specific research plan differed accordingly. Yet each school research plan addresses the general research questions about the intended, realised and attained intervention (Van den Akker, 2003) as well as the effects of each intervention. We measured student outcomes in a similar way; by measuring motivation, self-regulation and cognitive performance using student questionnaires and student grades scores in a pre-post-control group design. To measure student motivation, the Situational Motivation Scale (SIMS; Guay, Vallerand & Blanchard, 2000) was used and additionally students’ perceived self-efficacy and teacher autonomy support were measured. For student self-regulation, the Children’s Perceived use of Self-Regulated Learning Inventory (CP-SRLI) was used (Vandevelde, Van Keer & Rosseel, 2013). In order to generate an overview of all relevant information for the cross-case comparison in the CIMO-logic, we describe in a matrix the following components for each school: 1) School context; 2) Problem statement, history, and implementation strategy of the intervention; 3) Students and teachers involved in the intervention; 4) Intervention characteristics (intended and realised); 5) Experiences of students and teachers; 6) Student outcomes(cognitive performance, motivation, self-regulation). This matrix was then analysed with the use of CIMO-logic (Denyer, Tranfield, & van Aken, 2008). This logic involves a chain reasoning starting with a specific Context, for which the design proposition suggests a certain Intervention type, to produce, through specified generative Mechanisms, the intended Outcome(s). In our project the Context is the school context where the intervention takes place. The Intervention are the activities the school performs on personalised learning and ICT in the primary process. The Mechanisms were described in terms of variables that explain the realisation of effective interventions (from the perspective of teachers and students). The Outcomes were defined in terms of attained results on students’ performance, motivation and self-regulation. First for each school, these four themes (Context, Intervention, Mechanism and Outcomes) were coded. Then these four themes were connected using the chain reasoning of the CIMO-logic.

Expected Outcomes

The schools designed interventions aimed to increase students’ performance, motivation and self-regulation. We study the extent to which these outcomes are realised by taking into account the relations between school’s Context, Intervention characteristics, Mechanisms and Outcomes. At the time of writing, the data collection and analyses are still ongoing, so no predictions could be made on the expected results to the research question how schools realise personalised learning and ICT. Nonetheless, the expected outcomes relate to the benefits of the methodology used to generate insight in how schools can optimally design learning environments with ICT to accommodate for individual differences in students’ needs. First, CIMO-logic appears to allow an analytical approach that can foster the complexity of school change combining technology-integrated innovations and changes in pedagogies towards more personalised learning. Second, the power of CIMO-logic lies in its context-sensitive approach to understand why, what works within a certain context, to solve which problem. Third, the methodology accommodates for research into large-scale national innovations where ownership of how the innovation is designed and implemented belongs to the schools and does no longer need to be ‘controlled’ in order to study it (frequent problem in randomized-controlled-trial design applied in educational research).

References

Authors (2015) Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2006). Towards a personalized task selection model with shared instructional control. Instructional Science, 34, 399-422. Denyer, D., Tranfield, D., & van Aken, J.E. (2008). Developing design propositions through research synthesis. Organization Studies, 29, 393-413. Guay, F., Vallerand, R. J., & Blanchard, C. (2000). On the assessment of situational intrinsic and extrinsic motivation: The Situational Motivation Scale (SIMS). Motivation and Emotion, 24, 175-213. Prain, V., Cox, P., Deed, C., Dorman, J., Edwards, D., Farrely, C., et al. (2013). Personalised learning: lessons to be learnt. British Educational Research Journal, 39(4), 654-676. Robinson, C. & Sebba, J. (2010). Personalised learning through the use of technology. Computers and Education, 54, 767-775. Van den Akker, J. (2003). ‘Curriculum perspectives: an introduction.’ In van den Akker, J., Kuiper, W. and Hameyer, U. (Eds). Curriculum Landscapes and Trends. Dordrecht: Kluwer Academic Publishers. Vandewaetere, M., Desmet, P., & Clarebout, G. (2011). The contribution of learner characteristics in the development of computer-based adaptive learning environments. Computers in Human Behavior, 27(1), 118-130. Vandevelde, S., Van Keer, H. & Rosseel, Y. (2013). Measuring the complexity of upper primary school children’s self-regulated learning: A multi-component approach. Contemporary Educational Psychology, 38(4), 407-425. Van Merriënboer, J. J. G., & Kirschner, P. A. (2013). Ten steps to complex learning. A systematic approach to four-component instructional design. New York: Routledge.

Author Information

Monika Louws (presenting / submitting)
Leiden university, Netherlands, The
Lysanne Post (presenting)
Leiden university, Netherlands, The
Utrecht university, Netherlands, The
Utrecht university, Netherlands, The
Oberon Research and Consultancy, Netherlands, The
Leiden university, Netherlands, The

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.