Two dimensions of consistency in teacher effectiveness: preliminary findings from Hong Kong, Shenzhen and Guangzhou
Author(s):
James Ko (presenting / submitting)
Conference:
ECER 2015
Format:
Paper

Session Information

11 SES 02 A, School Based Factors Impacting on the Quality of Education (Part 1)

Paper Session to be continued in 11 SES 04 A

Time:
2015-09-08
15:15-16:45
Room:
102.Oktatóterem [C]
Chair:
Rita Birzina

Contribution

Despite the long history of research on teaching, this subject is still regarded as a poorly understood area. On one hand, a set of characteristics distinguishing effective teaching across classrooms have been identified (Muijs & Reynolds, 2005). On the other hand, teacher effectiveness does not seem to be a static, invariant characteristic of a teacher, but varies in a number of dimensions of differentiation, namely, time stability, subject consistency, differentiation by people, differentiation by working environment, and teacher’ expected roles (Campbell et al., 2003). The evidence indicates that the complexity of studying teacher effectiveness partly lies in the range of individual differences and characteristics of settings.
Different approaches in studying teaching effectiveness have shortcomings. School effectiveness research shows that teacher effectiveness is often the largest variable after the various student factors are considered, but it contributes little to the understanding of classroom processes, and its overreliance on standardized tests to capture learning growth is often criticized (Sammons, 1999). Meta-analysis on teaching has identified some classroom processes that have a larger effect than others (Hatti, 2009), but is often based on small-scale research that investigates classroom processes in isolation, with little relevance to the dynamics in the classroom. The classroom observation approach is the most informative on the classroom processes, but is resource-intensive and subject to raters’ prejudices (Wragg, 1999). Although classroom observation protocols cannot capture all processes in the classroom, studies are also rarely replicated with the same instruments or their instruments were validated internationally, making the accumulation of knowledge difficult (Teddlie et al., 2006).
Local research on teaching practices in Hong Kong is rare, but exceptions are informative on expertise teaching (Tsui, 2003), washback effect on teaching (Cheng, 1999), paradigm shift teaching practices (Cheng & Mok, 2008), and consistency in teacher effectiveness (Ko, 2010). A study on teaching, however, would be more meaningful if it can be linked with student learning, such that classroom processes can be seen as purposeful interactions between the teacher and the students. To address the above-mentioned limitations, the current study aims at the objectives stated below and frames teaching and learning against a background where the examination has become the ethos of education and teacher effectiveness covers a variety of competencies beyond the classroom (Cheng & Tsui, 1996):
1. To examine how teacher effectiveness can be maintained or vary across classrooms where students and situations differ.
2. To understand how classroom practices may affect learning processes and goal orientation of students.
3. To investigate how goal orientation and self-regulated learning can facilitate teaching and learning over time.

Method

The current study adopted the classroom observation approach to observe teaching practices of teachers who vary in teaching experience, but systematically varied the teacher and the lesson samples in terms of the subject taught and school level. This design allowed for better understanding on whether teachers can maintain their effectiveness across classrooms where students and situations differ and on how their effectiveness can affect students’ learning processes and orientation to learning. Effective teaching is expected to reinforce the intrinsic motivation to learn and strengthen deep learning, both considered to be prerequisites for lifelong learning. At this stage, video clips of over 400 lessons of 200+ Math and English teachers were collected and analyzed with a multi-trait, multi-method approach. Digital video of each lesson was viewed by at least two raters. Thus, inter-rater reliability can be measured and further enhanced by employing trained research postgraduate students as raters. All raters rated each lesson using the two aforementioned classroom observation protocols (i.e., Lesson Observation Form for Evaluating the Quality of Teaching (QoT) by van de Grift et al. (2007) and van de Grift and van der Wal (2011) and Low inference and High inference Observational Protocols of Dynamic theory of educational effectiveness by (Creemers & Kyriakides; 2008; 2013) to measure teaching effectiveness by quantitative ratings.

Expected Outcomes

In our preliminary findings, the majority of the teachers were found effective in only some of the teaching dimensions and their consistency varied considerably across contexts. Only very few teachers can be effective in most dimensions and in most lessons. Thus, the major purpose of the first phase, that is, to examine how teacher effectiveness is maintained or varies across classrooms where students and situations differ by classroom observation, is met. Further analyses are now conducted to establish a Rasch model to show the relative level of difficulty of different teaching behaviors. A major attempt for the analysis is to characterize variations in teacher effectiveness in the zone of teaching consistency and the developmental path of teachers (in Figure 1), as suggested by Ko (2010). Significance The current research contributed to a better understanding of teaching and learning in Hong Kong, in comparison with Shenzhen and Guangzhou, especially because empirical research on teaching practices and teacher effectiveness in these cities is rare. The results of the current study provided an update on the characterization of the Chinese teacher and learner following the substantial findings by Watkins and Biggs (2001). An understanding of the effect of goals on classroom practices and student outcomes is relevant because the objectives of education and academic structure have changed. Specifically, the interventions to be initiated by the teachers will determine whether the detrimental effects of the examination-oriented culture can be overcome when teachers and students take control of the orientations of their work and assessments.

References

Cheng, L. (2004). The washback effect of a public examination change on teachers' perceptions toward their classroom teaching. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing. (pp. 147-170). Mahwah, NJ: Erlbaum. Cheng, Y. C., & Mok, M. M. (2008). What effective classroom? Towards a paradigm shift. School Effectiveness and School Improvement, 19(4), 365-385. Cheng, Y. C., & Tsui, K. T. (1996). Total teacher effectiveness: new conception and improvement. International Journal of Educational Management, 10(6), 7-17. Creemers, B. P., & Kyriakides, L. (2013). Improving quality in education: Dynamic approaches to school improvement. Routledge. Creemers, B., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Routledge.   Ko . J. Y-O. (2010). Consistency and variation in classroom practice: A mixed-method investigation based on case studies of four EFL teachers of a disadvantaged secondary school in Hong Kong. An unpublished thesis. Nottingham, UK: University of Nottingham. Muijs, D., & Reynolds, D. (2005). Effective teaching: Evidence and practice (2nd ed.). London: Sage. Tsui, A.B. (2003) Understanding expertise in teaching: Case studies of ESL teachers. Cambridge: Cambridge University Press. van de Grift, W. (2007). Quality of teaching in four European countries: a review of the literature and application of an assessment instrument. Educational Research, 49(2), 127-152. van de Grift, W., & van der Wal, M. (2011). Measuring the development of professional competence among teachers. Paper presented at ICSEI Conference, January 4-7, Limassol, Cyprus. Watkins, D. A., & Biggs, J. B. (Eds.). (2001). Teaching the Chinese learner: Psychological and pedagogical perspectives. Hong Kong University Press.

Author Information

James Ko (presenting / submitting)
Hong Kong Institute of Education, Hong Kong S.A.R. (China)

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.