Measuring the Latent Construct of ‘Reflectivity’ in Quantitative Studies among Student Teachers: Challenges and First Results of Instrument Analyses
Author(s):
Katrin Kreilinger (presenting / submitting) Birgit Ziegler
Conference:
ECER 2017
Format:
Paper

Session Information

10 SES 05 C, Reflectivity in Teacher Education

Paper Session

Time:
2017-08-23
13:30-15:00
Room:
K1.04 Auditorium 3
Chair:
Oliver McGarr

Contribution

Objectives

Reflectivity as a core competency of teachers has been a hot topic in teacher training as well as teacher education research for many years now. Griffiths and Tann (1992) describe the wide-spread rejection of scientific theories as guidelines for teaching. Various studies reported results that (student) teachers did not challenge their personal beliefs, but emphasized the importance of practical experiences, while oftentimes questioning the value of scientific theories and university education (e.g. Griffiths & Tann 1992, Terhart et al. 1994, Anselm 2010). Empirical approaches to assess teachers’ reflective action or their attitudes towards reflective practice in quantitative terms must rely on reliable and valid instruments to measure these constructs. In this talk, an instrument to measure different aspects of attitudes towards reflective practice and the results of scale analyses will be presented, challenges for the measurement of this latent variable will be exposed, and conclusions for the improvement of the instrument will be drawn.

The instrument is used in a research project at the Technische Universität Darmstadt. Our goal is to analyse the effects of newly implemented offers of counselling for freshmen student teachers concerning their professional development in their first year of studies, focussing on the effects on their attitudes towards reflection and their teacher beliefs. To fit our purposes within the project the instrument has to meet the following requirements: It should be applicable with freshmen students having no teaching experiences. Still, to avoid an ambiguous, superficial phrasing, the items had to have a clear reference to professional teaching activities. In consequence, we opted for items addressing students’ attitude towards reflective action in the classroom context instead of assessing reflective action. Most existing scales (e.g. Kember et al. 2000, Felten 2005) do not fully meet those requirements.

 

Theoretical Approach and Research Questions

Griffiths and Tann (1992), like e.g. Mezirow (1997), distinguish several hierarchically ordered levels of reflection: Reflection-in-action consists of two forms of reflection. Reflection-on-action, on the other hand, incorporates three forms of reflection. The three forms of reflection-on-action take place after action and require increasing structuring of the assessment and analysis of situational information. Only at the highest level, retheorising and reformulating, persons challenge their personal beliefs and also scientific theories. A person who is able to reflect on all five levels is called a reflective practitioner (cp. Griffiths & Tann 1992).

Building on Griffiths and Tann, Niggli (2004) deducted a model to depict student teachers’ patterns of interest in reflection. Besides student’s general level of interest in reflection-on-action, the model distinguishes student teachers’ willingness to either reflect action based on pedagogical theories (reflection through retheorising and reformulating) or to reflect action based on practical rules and teacher role models (reflection through practical experience). As a fourth component, we added a popular teacher belief to Niggli’s model: one’s personality as key to professional success as a teacher (cp. Calderhead 1996, Hartmann & Weiser 2007). In accordance with Griffiths and Tann (1992), someone holding but not questioning a pronounced teacher belief shows ‑by definition‑ a low level of reflection on the level of retheorising and reformulating. Moreover, theoretical assumptions state a general reluctance of persons to question their beliefs (e.g. Pajares 1992). Hence, approval of specific beliefs should correlate with a low level of interest in reflection-on-action in general.

Subsequently, our precise research questions are: a) Do factor analyses confirm the postulated factor structure of our measurement instrument? b) Does a strong belief in the importance of personality traits for professional success as a teacher correlate negatively with a general interest in reflection-on-action and, furthermore, with reflection through retheorising and reformulating?

Method

Methods The data was obtained from two samples of freshman student teachers (n = 171) at a German University in the years 2015 and 2016 (one sample per cohort). 115 persons (67.3 %) studied to become teachers at grammar schools, 56 persons (32.7 %) studied to teach at vocational colleges. The survey was conducted in two formats, as online- and as paper-pencil version. On the basis of first analyses using a sub-sample we obtained information on the quality of the scales measuring general interest in reflection-on-action (4 items, Niggli 2004, shortened version), reflection through retheorising and reformulating (4 items, Niggli 2004, shortened version), belief in the importance of personality traits (5 items). Due to unsatisfactory results of scale analyses and our objections with regard to content, Niggli’s (2004) scale on reflection through practical experience was excluded from further data collection and analyses. Scale analyses were conducted using SPSS factor analyses procedures with a fixed number of factors and reliability testing with Cronbach’s α. To validate our preliminary results (see below), confirmatory factor analyses will be carried out. Findings will be presented at the conference. To test our assumptions about interrelations between various scales, correlation analyses were conducted.

Expected Outcomes

Results Findings of the factor analysis with fixed number of factors confirmed the theoretically postulated factor structure. Indicators of scale reliability showed satisfactory to good results (Cronbach’s α .59 - .80). Detailed scale analyses show a strong trend of approval to questionnaire statements and small variance regarding general interest in reflection-on-action (mean 4.92, SD .60, scale 1-6). Alternative approaches for an improved measurement will be discussed. Results of correlation analysis support the assumption that students’ belief in the importance of personality traits for professional success correlate negatively with the level of interest in reflection through retheorising and reformulating (r = -.33**). However, there is no significant correlation between the belief in the importance of personality traits and general interest in reflection-on-action.

References

List of References Anselm, S. (2010). „Wissen ist gut, doch Können ist besser.“ In: Abel, J. & Faust, G. (Eds.). Wirkt Lehrerbildung? Antworten aus der empirischen Forschung. Münster a.o.: Waxmann, 155-163. Calderhead, J. (1996). Teachers: Beliefs and Knowledge. In: Berliner, D. C. & Calfee, R. C. (Eds.). Handbook of Educational Psychology. New York a.o.: Routledge, 709-725. Felten, R. v. (2005). Lernen im reflexiven Praktikum. Eine vergleichende Untersuchung. Münster a.o.: Waxmann. Griffiths, M. & Tann, S. (1992). Using Reflective Practice to Link Personal and Public Theories. Journal of Education for Teaching, 18(1), 69-84. Hartmann, M. & Weiser, B. (2007). Unbewusste Inkompetenz? … Selbstüberschätzung bei StudienanfängerInnen. In: Kraler, C. & Schratz, M. (Eds.). Ausbildungsqualität und Kompetenz im Lehrerberuf. Wien: Lit Verlag, 37-55. Kember, D., Leung, D. Y. P., Jones, A., Loke, A. Y., McKay, J. & Sinclair, K. et al. (2000). Development of a Questionnaire to Measure the Level of Reflective Thinking. Assessment & Evaluation in Higher Education, 25 (4), 381-395. Mezirow, J. (1997). Transformative Erwachsenenbildung. Baltmannsweiler: Schneider Verlag. Niggli, A. (2004). Welche Komponenten reflexiver beruflicher Entwicklung interessieren angehende Lehrerinnenn und Lehrer? – Faktorenstruktur eines Fragebogens uns erste empirische Ergebnisse. Schweizerische Zeitschrift für Bildungswissenschaften, 26(2), 343-364. Pajares, M. F. (1992). Teachers‘ Beliefs and Educational Research: Cleaning Up a Messy Construct. Review of Educational Research, 62(3), 307-332. Terhart, E., Cerwenka, K., Ehrich, K., Jordan, F. & Schmidt, H.J. (1994). Berufsbiographien von Lehrern und Lehrerinnen. Frankfurt a.M. u.a.: Peter Lang.

Author Information

Katrin Kreilinger (presenting / submitting)
Technische Universität Darmstadt
Darmstadt
Technische Universität Darmstadt, Germany

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.