Examining Educational Design Research As Form Of Teacher Professional Learning: A Latent Growth Curve Analysis
Author(s):
Ryan Dunn (presenting / submitting) John Hattie Terry Bowles
Conference:
ECER 2016
Format:
Paper

Session Information

01 SES 09 C, Approaches to Professional Development Research

Paper Session

Time:
2016-08-25
13:30-15:00
Room:
OB-H2.12
Chair:
Linda Hobbs

Contribution

Topic/Objective

With schools across England, Wales and Northern Ireland required to implement a new National Curriculum, it is timely explore how other systems have approached such a large-scale undertaking. In the United States, schools have been implementing the Common Core State Standards (CCSS) for the past 5 years. The introduction of the CCSS has led schools, districts and systems to intensify their focus on teacher professional learning to ensure the standards are implemented with fidelity.  The purpose of this study is to explore the experiences of teachers who participated in a district-wide Educational Design Research (EDR) project, as a form of professional learning, during the 2014-2015 school year.

EDR is the systematic study of designing, developing and evaluating educational programs, processes and products (Plomp, 2007). Presently, there is a push for classroom teachers to undertake forms of teacher inquiry, such as practitioner research.  The justification is that high performing, or top tier, systems in the Organization for Economic Co-operation and Development (OECD) “support research undertaken by teachers to drive innovation and school system improvement” (DEECD, 2012, p. 15).  Similarly, in Shanghai teachers are “encouraged to identify a particular aspect of learning and examine the theory and evidence base, then trial different teaching practices drawing on their findings” (Jensen, 2012, p. 23).  However, further exploration into teacher inquiry (and the key determinants that influence teacher learning), is required if this is to be successfully implemented in other systems.  

Data for this quantitative study was collected from 345 teachers in an urban school district in California via an online self-report survey. The teachers’ participated in a mathematics professional learning project that required participants’ to attend four full-day learning workshops complimented by in-classroom support throughout the 2014-2015 academic year.

 

Research Questions

1. How do the teachers perceive their own change as a consequence of the Educational Design Research project?

2. How does teacher practice change as a consequence of their participation in the Educational Design Research project?

3. How do the teachers perceive changes in student behaviours as a consequence of the Educational Design Research project?

Theoretical Framework

Timperley, Wilson, Barrar and Fung (2007) developed a theoretical framework comprising 84 different characteristics of the professional learning environment likely to impact on student outcomes. These characteristics were distilled into 7 elements considered to be effective for promoting professional learning opportunities that impacted on student outcomes. How the 7 elements relate to EDR are briefly explained below:

  1. Extended time for opportunities to learn; EDR is an iterative process that utilizes a cycle of analysis, design and development, evaluation and refinement
  2. External expertise was typically necessary; EDR advocates external expertise to work in collaboration with practitioners to analyze practical teaching and learning problems, develop solutions using research design principles, then testing and refining the solutions
  3. Teachers’ engagement in learning at some point was more important than initial volunteering; EDR encourages active participation of practitioners in the various cycles of the research
  4. Prevailing discourses challenged; EDR is process oriented, where the focus is on understanding and improving interventions.  Iterative cycles of exploration and alternative solutions are inherent
  5. Opportunities to participate in a professional community of practice were more important than place; EDR is collaborative and participative
  6. Consistency with wider trends in policy and research; EDR is theory oriented where the design is based on a theoretical framework, so interventions are consistent, and draw from, current research and/or policy 
  7. Active school leadership; EDR requires school leaders to actively organize a supportive environment to promote professional learning opportunities and the implementation of new practices in the classroom. 

Method

Methodology Anderson and Shattuck (2012) characterized EDR as: situated in real educational contexts, focusing on the design and testing of interventions, using mixed methods involving multiple iterations, stemming from partnership between researchers and practitioners, yielding design principles, and concerned with an impact on practice. The hypothesis to be tested is that teachers who participate in EDR in an intensive ongoing manner will display measureable improvement in their teaching practice and subsequent impact on the students they teach. This is based on notion that EDR meets the requirements outlined for effective teacher professional learning (Barab, 2005; Cochran-Smith & Fries, 2001; Darling-Hammond, 2004; Desimone, 2009; Hall & Herrington, 2010; Hawley & Valli,1999; Ingvarson et al. 2005; Nelson, 2010; Timperley et al. 2007). As evidenced by Ormel, Pareja, McKenney, Voogt and Pieters (2012) “practitioners have prominent roles in the projects” (p.981) which led to the hypothesis that being actively involved in educational research will encourage teachers to think more deeply about how to best provide student learning, as well as how to accurately determine their impact on the students they teach. Methods The 29-item questionnaire was developed based on Patterson’s (2001) Level of Implementation Framework. The questionnaire was used to assess self-reported changes in teacher practice and student behaviour. Teachers completed the questionnaire four times over the course of one academic year. A Confirmatory Factor Analysis (CFA) was conducted to assess the construct validity of the two scales (teacher practices and student behaviour). Reliability was analysed using Cronbach’s alpha. To empirically test the extent to which EDR impacted teachers practice, latent growth curve modelling will be used. Growth curve modelling was chosen to ascertain change over-time (Bollen & Curran, 2006; Duncan & Duncan, 2004). The model will be tested using latent growth methods, using AMOS with maximum likelihood estimation.

Expected Outcomes

While the four waves of data for this qualitative study have been collected, the latent growth curve analysis has yet to be conducted, therefore the outcomes at this stage of submission are not yet known. However, Supovitz and Turner (2000) found that dramatic changes in teaching practice emerged only when professional development experiences were deeper and more sustained than is typical. When investigating the research practice gap in education, Aubusson, Steele, Dinham and Brady (2007) contended, “one possible approach is stimulation of teacher research as a way of promoting teacher learning” (p. 134). They suggested three conditions that needed to be present for teacher research to be transforming: a culture of inquiry that respected teacher voice; collaboration over a sustained period of time; and intellectual challenge and stimulation (p. 134). EDR meets these three conditions. This empirical research will offer insight into whether EDR impacts on teachers practice as it is espoused to do so (McKenney and Reeves, 2014).

References

Aubusson, P., Steele, F., Dinham, S., & Brady, L. (2007). Action learning in teacher learning community formation: informative or transformative?. Teacher Development, 11(2), 133-148. Bollen, K. A., & Curran, P. J. (2006). Latent curve models: A structural equation perspective (Vol. 467). John Wiley & Sons. Duncan, T. E., & Duncan, S. C. (2004). An introduction to latent growth curve modeling. Behavior therapy, 35(2), 333-363. Jensen, B., Hunter, A., Sonnemann, J., and Burns, T. (2012) Catching up: learning from the best school systems in East Asia, Grattan Institute. McKenney, S., & Reeves, T. C. (2014). Educational design research. In Handbook of research on educational communications and technology (pp. 131-140). Springer New York. Ormel, B. J., Roblin, N. N. P., McKenney, S. E., Voogt, J. M., & Pieters, J. M. (2012). Research–practice interactions as reported in recent design studies: still promising, still hazy. Educational technology research and development, 60(6), 967-986. Patterson, R. R. (2001). Using the theory of planned behavior as a framework for the evaluation of a professional development workshop. Microbiology Education, 2, 34. Plomp, T. (2007). Education Design Research: an introduction. In T, Plomp and N, Nieveen (eds), An introduction to design research. Netherlands Institute for Curriculum Development. Supovitz, J. A., & Turner, H. M. (2000). The effects of professional development on science teaching practices and classroom culture. Journal of research in science teaching, 37(9), 963-980. Timperley, H., Wilson, A., Barrar, H., & Fung, I. (2007). Best evidence synthesis iterations (BES) on professional learning and development. Wellington, NZ: Ministry of Education. Zeichner, K.M. & Noffke, S.E. (2001). Practitioner research. In V. Richardson (Ed.), Handbook of research on teaching, pp. 298-332. Washington, DC: American Educational Research Association.

Author Information

Ryan Dunn (presenting / submitting)
Melbourne University
Melbourne
Melbourne University, Australia
Melbourne University, Australia

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.