The Best of Us: Teachers Spillover Effect in the Context of Teacher Evaluation
Author(s):
Karin Roa Tampe (presenting / submitting)
Conference:
ECER 2016
Format:
Paper

Session Information

ERG SES D 06, Policies and Education

Paper Session

Time:
2016-08-22
13:30-15:00
Room:
OB-E1.19
Chair:
Helene Ärlestig

Contribution

Nowadays the educational systems depend critically, among other factors, on attract and educate good teaching staff and to retain teachers of good performance to reach a high quality (EFEE-ETUCE; UNESCO; Isoré). Close to the professional logic based on expertise and auto regulation (Freidson), a long list of countries have been implemented schemes of bureaucratic rationalization, based on centralized systems of administration, evaluation and payment for results associated with the New public management. (Leicht and Fennell; Alexander; Evetts; Hargreaves and Fullan; Middlehurst and Kennie). Consistently, the professional performance is considered to be an individual result that can be modified by means of incentives, form of comprehension of the professional work that has been understood as a professional individual entrepeneurship (Evetts; Middlehurst and Kennie; Sisto and Fardella).

This individual approach has being criticized by those authors in professional theory who sustains that performance depends rather on different factors, among which we can find the school objective, the school´s  work policies and the social dynamic between co-working teachers (UNESCO; Valencia and Manzi; Santiago, Benavides, Danielson, Goe & Nusche; Jornet, Gonzalez-Such & Sanchez-Delgado). In this sense, and from a methodological perspective valid around the world, measuring teaching performance only on an individualistic postulation assumes the implicit risk of threatening the validity of the measurements, contributing results slanted so they ignore explanatory relevant factors of this performance (UNESCO; OCDE; Yuan).

In line with this critic, different authors have indicated that the analysis of good professional performance has to consider the effect of peer social processes that explain some positive results, that has being described as peer effect or spillover effect (Eisenberg; Goldhaber and Anthony; Jackson and Bruegmann; Valencia and Manzi). For example, some evidence shows that a major presence of teachers with quality certifications in a school, as well as a major number of candidates to the accreditation increases the probability of other teachers of obtaining it (Santelices et al.; Valencia; Goldhaber & Anthony). In the same way, the incorporation of teachers with high degree of qualification has a positive impact on their peers´ teaching practice, especially in beginning teachers (Jackson & Bruegmann; Heck; McLean; Yuan).

In order to explain the spillover effect, it has been indicated the role of diffusion of acquired cultural capital to explain how low performance professionals workers increase they cultural background when they works with high qualifications workers (Battu, Belfield and Sloan). The cooperation and mutual learning between co-working teachers permits a sharing of the kind of knowledge that improves teaching performance. Within this perspective the role of social processes to share knowledge and social support plays a key role (Goldhaber & Anthony; Mycue). Another explanations is the motivation, personnel or hint, to leveling the own conduct to achieve the performance of some exemplary teachers in the regular performance or in evaluations standardized (Jackson & Bruegmann; Battu, Belfield & Sloan). Finally, it has been considered the observation of the work of others as a relevant process, as long as it is accompanied of reflection and a feedback about the observed performance (Barth).

The investigations before presented, all of them of quantitative character, have limitations at the moment of raising what processes and what conditions are associated with the peer or spillover effect that is related to good professional performance of the teachers. Of there that emerges as question of investigation: what social processes and conditions have been lived by teachers of good performance on the occasion of the educational evaluation, and what meaning and distinctive elements do they emerge of them?

Method

This research, pioneer in Chile, looks forward to determinate how the relationship between co-working teachers (peers) has an influence on Teaching Evaluation Test (TE) individual results. In order to evaluate this impact, we have implemented a qualitative research of exploratory and descriptive scope. With this we intend to conceptualize the experiences and meaning that teachers gave to their working relationships within the school. In order to systematize this conceptualization, we have chosen the methodological approach of Grounded Theory. With this, we can compare and analyze information (codes and categories) in an iterative manner, in order to get the principal facts and attribution given to their experiences by the teachers. Once this process has being done, in a second stage of this work and using an axial codification, we provided potential explanatory models for the object of this investigation based on broader categories (Strauss and Corbin, 1990). The data collection has done through in-depth interviews to sixteen teachers between September 2015 and April 2016. The participants were selected under a procedure of theoretical sampling (Strauss and Corbin, 1990). For determining the take-off sample, we used four criteria. The first one was the selection of teachers who approved the TET during the last two years. This criteria allowed us to assure interviews with teachers with a good performance and who remembered the facts and the personal meaning attributed to the Test. The second and third criteria were the selection of teachers with diversity about years of professional experience who taught in a specific type of school defined in terms of size (large and medium). Both criteria of years of experience and the size of the school were an important criteria when this factors affect the social relationship between co-corking teachers. The fourth emergent criteria was gender. In effect, the performance of female teachers evaluated trough the Teaching Evaluation Test (Evaluación Docente) has been historically better than male teachers. Takin into account this distribution of results, it was important to differentiate gender as a criteria for sample take-off. The participation of the ten teachers in this research was voluntarily. The identity of the teachers and the information provided was manage by the investigators as confidential. Every interview was recorded, transcribed under protocol and codified by the leading investigator and another qualified research assistant.

Expected Outcomes

To descriptive level the principal social processes for peer effect that are perceived associated with a good performance in the evaluation, as well as in the daily work, are the collaborative work and the social support. These are carried out in a direct way by means of working together concerning the material to delivering interpreting keys and correcting it in group in several occasions. The most consulted teachers are recognized by his experience and good result in the evaluation that allows them to interpret keys and own semantics of the evaluation. The participants also declare the indirect influence happened by the context, where the fear of the discredit in which have fallen down some teachers with poor results in the previous years stimulate major efforts to approve the evaluation. In general the peer effect would take place with major facility in the colleges in which it exists a good climate and formal instances promoted by the authorities for the collaborative work. This one is valued of equal form by men and women and in all the stages of the career cycle, and more difficult to obtain in big schools, in which the communication is perceived obstructed. Product of the axial analysis structured a scheme in which the social influence between peers arises in the context of a protection strategy for which the teachers contribute knowledge and facilitate the professional reflection, which it they removes from the risks of a proved evil. This form of professional horizontal loyalty allows to break the loneliness imposed by the format of TE and his scheme of consequences. For same the good performance is valued as the result of having defied the individual logic at the base of the system opposite to an evaluation that they consider to be fictitious, sterile and scary.

References

Alexander, R. (2001). Culture and pedagogy: International comparisons in primary education. Oxford: Wiley-Blackwell. Barth, R. (2006). Improving relationships within the schoolhouse. Educational Leadership, 63(6), 8-13. Battu, H., & Belfield, C. & Sloane, P. (2003). Human capital spillovers within the workplace: Evidence for Great Britain. Oxford Bulletin of Economics and Statistics, 65(5), 575-594. Evetts, J. (2011). A new professionalism? Challenges and opportunities. Current Sociology, 59(4), 406-422. EFEE/ETUCE (2015). ESSDE Outcome Joint Declaration EFEE/ETUCE on “The promotion of self-evaluation of schools and teachers”. Working paper Freidson, E. (1994). Pofessionalism reborn: Theory, prophecy and policy. Chicago: The University of Chicago Press. Goldhaber, D. & Anthony, E. (2004). Can teacher quality be effectively assessed? CRPE Working Paper, 6, 1-39. Hargreaves, A. & Fullan, M. (2012). Professional capital. transforming teaching in every school. Estados Unidos: Routledge. Heck, R. (2007). Examining the relationship between teacher quality as an organizational property of schools and students’ achievement and growth rates. Educational Administration Quarterly, 43(4), 399-432. doi:10.1177/0013161X07306452 Isoré, M. (2009). Teacher Evaluation: Current Practices in OECD Countries and a Literature Review”, OECD Education Working Papers, No. 23, OECD Publishing. http://dx.doi.org/10.1787/223283631428 Jackson, K. & Bruegmann, E. (2009). AssociationTeaching students and teaching each other: The importance of peer learning for teachers. American Economic Journal, 1(4), 85-108. doi:10.1257/app. 1.4.85 Leicht, K. & Fennell, M. (1997). The changing organizational context of professional work. Annual Review of Sociology., 23, 215-231. Middlehurst, R. & Kennie, T. (1997). Leading professionals: Towards new concepts of professionalism. In J. Broadvent, & Dietrich, M. & Robert, J. (Eds.), The end of the professions? (1a ed., ). Estados Unidos: Routledge. Santelices, V., Valencia, E., & Taut, S. & Manzi, J. (2010). The importance of contextual and personal variables in explaining teacher performance in a standards-base measure. Santiago de Chile. 1-30. Santiago, P., Benavides, F., Danielson, C., & Goe, L. & Nusche, D. (2013). Teacher evaluation in chile. . (OECD: Reviews of Evaluation and Assessment in Education). UNESCO. (2007). Educación de calidad para todos: Un asunto de derechos humanos. (Documento de Discusión). Buenos Aires: UNESCO. Valencia, E. & Manzi, J. (2011). Desempeño docente: Relaciones con antecedentes de los profesores y su contexto. In J. Manzi, R. González & Y. Sun (Eds.), La evaluación docente en chile. (1a ed., pp. 179-193). Santiago de Chile: Facultad de Ciencias Sociales-MIDE UC. Yuan, K. (2015). A value-added study of teacher spillover effects across four core subjects in middle schools. Education Policy Analysis Archives, 23(38), 1-24.

Author Information

Karin Roa Tampe (presenting / submitting)
Universidad de los Andes
Education Faculty
Santiago

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.