Are Internal And External Observers Equally Suitable To Perform Classroom Observations?

Session Information

01 SES 04 B, Teacher Learning through Classroom Observation

Paper Session

Time:
2017-08-23
09:00-10:30
Room:
K3.16
Chair:
Iris Uffen

Contribution

The view on the professional role of teachers is subject to change, as is the view on how teachers need to develop professionally. In the past, teachers were seen as autonomous professionals who worked and professionalized isolated in their own classroom. In the last two decades, this view proved no longer sufficient and teachers were increasingly expected to professionalize in collaboration (Hargreaves, 2000; Verloop, 2003).
One of the main developments in professional development of teachers is peer review and peer feedback (Thurlings, 2012). In a review study, Coe, Aloisi, Higgings, and Major (2014) discuss a common form of peer review and – feedback: classroom observation followed by a formative, collegial consultation. Although they underpin the effectiveness of this approach, they highlight that the literature emphasizes to involve not only peers (from now on called ‘internal observers’) in classroom observations, but also other observers, such as external observers from outside the school. Several reasons can be given why different observers might be needed.
First, there are some difficulties with observations in general that might affect observations from internal and external observers in a different way. From a methodological viewpoint, a challenge in observation lies in the quality of the observer’s inference: the observer needs to translate the observed to the construct of the observation instrument the most objectively as possible (Kerlinger & Lee, 2000). Differences between observations done by internal and external observers might occur due to the fact that internal observers already know the teacher, the class and the school.
Second, issues regarding the relationship between teacher and observer can potentially influence the observation. Coe et al. (2014) discuss ‘political issues’ that play a role in classroom observation, such as trust and authority. Hobson and McIntyre (2013) report that teachers seem more unwilling to welcome an internal observer to their classroom, because of fear to the opinion of colleagues. An internal observer might be more sensitive to these kind of feelings of an observed teacher. If the observation and consultation disturbs the relationship between the observer and teacher, the impact in the case of peer observation is greater on both observer and observed teacher and the risks are higher, since afterwards they still see each other on a regular basis.
In addition, research by Hargreaves (2004) gives us an interesting insight in collegial interactions among teachers. His research shows that collegial interactions have the tendency to focus on supporting each other instead of discussing each other’s teaching practice. Colleagues tend to avoid disagreement. If this is the case, development may be counteracted or even ineffective teaching behavior is perpetuated.
Studies on the differences between the valuation of a lesson by an internal or external observer are rare and there is no empirical evidence yet of any potential differences. Given the aforementioned general challenges of classroom observation and the issues regarding the relationship and interactions between observer and observed teacher, our hypothesis is that internal observers are less critical than external observers when performing a classroom observation.
This leads to our research question: are internal observers from the own school less critical when observing a lesson than external observers from outside the school?

Method

The study involves 560 secondary school teachers (53% female, 47% male) of 15 schools in the north of the Netherlands. On average, the teachers have around 16 years of teaching experience (SD=11). The teachers teach a wide variety of subjects and they teach in all school levels and grades in regular secondary education in the Netherlands. The teachers are observed two times with a time interval of three to twelve months between the observations. The observations were done by observers who are or have been teachers themselves and all the observers are trained in the use of the standardized and widely validated ICALT observation instrument (International Comparative Analysis of Learning and Teaching) (Van de Grift, Maulana, & Helms-Lorenz, 2014; Van den Hurk, Houtveen & Van de Grift, 2016; Van der Lans, Van de Grift & Van Veen, 2016). The instrument includes 32 items on teaching behavior of a teacher. The scores on these items can be conducted to the statistical measure Warms’ Ɵ that indicates the teaching quality shown during the lesson (Rasch modeling approach: Van de Grift, Maulana, & Helms-Lorenz, 2014). Of the 560 participating teachers, 457 teachers are observed two times. Of these 457 teachers, 184 teachers were observed only by an internal or external observer and 173 teachers were observed by an internal observer and an external observer. We divide the teachers in two groups: (1) teachers who are observed the second time by an internal observer (N=184), and (2) teachers who are observed the second time by an external observer (N=273). In both groups 52% of the teachers is female and 48% is male and in both groups the average years of teaching is 16 (group 1: SD=14, group 2: SD=15). The percentages of school subjects the teacher teach, is similar in both groups as well (group 1: 45% alfa, 43% beta and 12% gamma, group 2: 48% alfa, 42% beta and 10% gamma).This supports the possibility of random selection in both groups. We conduct a t-test to check if the groups are comparable in terms of starting positions (score on the first observation) and we use an ANOVA to see if internal or external observers value a lesson differently. We use a Multiple Classification Analysis to control for the starting position and time interval between the first and second observation.

Expected Outcomes

Even after correcting for several background variables, preliminary results show no significant difference between the scores (Warms’ Ɵ) on the ICALT instrument of teachers who are observed first by an internal observer (N=104) and teachers who are observer first by an external observer (N=456) (internal observers: M=1.19, SD=1.13, external observers: M=1.24, SD=1,43, p=.113). It is a first indication that internal and external observers measure the quality of teaching in a similar way. When looking at the growth of teachers who are observed the second time by an internal observer (group 1) and the teachers who are observed the second time by an external observer (group 2), we find a small difference in the mean scores (group 1:M=1.88, SD=1.38, group 2: M=1.65, SD=1.35), but after correcting for the starting position and the time interval, this difference becomes negligible and no effect is shown (group 1: M=1.79, group 2: M=1.78, ƞ2=.007). Therefore, it seems that our hypothesis has to be rejected: based upon these results internal and external observers give similar scores to observed teachers. In our paper we will present further results, including a third observation.

References

Coe, R., Aloisi, C., Higgins, S., & Major, E.L. (2014). What makes great teaching? Review of the underpinning research. Retrieved from http://www.suttontrust.com/wp-content/uploads/2014/10/What-Makes-Great-Teaching-REPORT.pdf. Hargreaves, A. (2000). Four ages of professionalism and professional learning. Teacher and Teachings: History and practice, 6(2), 151-182. Hargreaves, A. (2004). The emotional geographies of teachers’ relations with colleagues. International Journal of Educational Research, 35(5), 503-527. Hobson, A.J., & McIntyre, J. (2013). Teacher fabrication as an impediment to professional learning and development: the external mentoring antidote. Oxford Review of Education, 39(3), 345-365. Kerlinger, F. N., & Lee, B. H. (2000). Foundations of behavioral research ( 4th ed). London: Wadsworth Thomson Learning. Thurlings, M.C.G. (2012). Peer to peer feedback : a study on teachers’ feedback processes. Maastricht: Universitaire Pers Maastricht. Van de Grift, W., Helms-Lorenz, M., & Maulana, R. (2014). Teaching Skills of Student Teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement. Studies in Educational Evaluation, 43, 150-159. Van der Lans, R.M., Van de Grift, W.J.C.M., & Van Veen, K. (2017). Developing an Instrument for Teacher Feedback: Using the Rasch Model to Explore Teachers' Development of Effective Teaching Strategies and Behaviors. The journal of experimental education (1-18). http://dx.doi.org/10.1080/00220973.2016.1268086 Van den Hurk, H.T.G., Houtveen, A.A.M., & Van de Grift, W.J.C.M. (2016). Fostering effective teaching behavior through the use of data-feedback. Teaching and Teacher Education, 60 (2016), 444-451. Verloop, N. (2003). De leraar. In N. Verloop, & J. Lowyck (Red.), Onderwijskunde, een kennisbasis voor professionals (pp. 194-249). Groningen/Houten: Wolters-Noordhoff.

Author Information

Iris Uffen (presenting / submitting)
University of Groningen
Teacher Education
Groningen
University of Groningen, Netherlands, The
University of Groningen
University of Groningen
Groningen

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.