Pre-service Teachers’ Cognitive Reasoning: A Think Aloud Study of Scenario-based Decision-Making
Author(s):
Conference:
ECER 2017
Format:
Paper

Session Information

10 SES 10 C, Teacher Educators: Research methods and perspectives

Paper Session

Time:
2017-08-24
15:30-17:00
Room:
K1.04 Auditorium 3
Chair:
ML White

Contribution

Introduction

In teacher education the three main factors for successful teaching are: (1) cognitive ability; (2) background experience; and (3) non-academic capabilities (Cochran-Smith & Fries, 2005). Internationally there is an increasing focus on the assessment of pre-service teachers’ (PSTs) non-academic capabilities (Council for the Accreditation of Educator Preparation, 2013). Despite the variety of measures used to assess non-academic capabilities (e.g., personality tests, interviews, personal statements), results on the validity of these methods have been mixed (e.g., Metzger & Wu, 2008; Young & Delli, 2002).

Australian teacher education is currently under increasing pressure to identify and assess PST’s non-academic capabilities prior to entry (AITSL, 2015, Bowles, Hattie, Dinham, Scull, & Clinton, 2014). However,greaterattention is needed on how to best support the development of non-academic capabilities within teacher education programs.  Since Situational Judgement Test (SJT) methodology has been shown to be a reliable and valid way of assessing non-academic attributes (Patterson, Zibarras, & Ashworth, 2015). The aim of the study was to explore the reasoning processes of a group of PSTs by using context-specific scenarios and follow up Think Aloud interviews.

 

Research Questions

  1. What PSTs’ reasoning processes emerge when they are asked to verbally respond to a complex teaching scenario?
  2. What beliefs and motives underpin the cognitive reasoning of PSTs when they consider a range of responses to a challenging teaching situation?

 

Conceptual Framework

The overarching theoretical framework for this study is Bandura’s (1997) Social Cognitive Theory, with learning defined as an active cognitive process. Critical to the learning process is recognition of the reciprocal interactions occurring amongst personal, environmental, and behavioural factors. This study focused on the personal component and how some aspects of beliefs and motivations are operating ‘on the surface’ (explicitly) and other aspects are operating implicitly or without conscious thought (Motowidlo & Beier, 2010; Schultheiss & Brunstein, 2010). The research was carried out using a modified model based on current SJT research with PST’s (see Klassen, et al., in press). This model of implicit and explicit beliefs and motives was used to frame and draw inferences on the reasoning of pre-service teachers.

Method

Methodology A mixed methods study was adopted using an explanatory research design, with a qualitative main data set (quan → QUAL; Creswell & Plano Clarke, 2011). Data sets were collected and analyzed separately. Findings from the quantitative data helped inform the inferences drawn from the qualitative Think Alouds (TA). Quantitative data were collected via two questionnaires: (1) scenario-based SJT items set in a Primary (K-6) teaching context and (2) Secondary (Year 7-12) teaching context (Klassen, et al., 2017). Each scenario-based item had possible responses to rank from 1 (most appropriate) to 5 (least appropriate). Both questionnaires included validated self-report measures of teacher self-efficacy, personality, motivation, and adaptability. Cognitive processing study protocols (see Swanson, O'Connor & Cooney, 1990) informed the qualitative data collection from Think Aloud interviews. For the interviews, one scenario-based item was randomly selected (out of 32) for Primary and one (out of 27) for Secondary. The PSTs were asked to “think aloud” while making their decisions in how they should respond to the hypothetical situation. Researchers’ interactions with each participant were kept to a minimum to ensure the thinking process was as natural as possible and to avoid over-influencing participants (e.g. over prompting; Charters, 2003). A total of 148 Masters of Teaching PSTs (Primary and Secondary) from 5 campuses in regional Australia were invited to complete the questionnaire. A majority (N = 120) provided questionnaire data with 12 (6 primary and 6 secondary) provided qualitative data through TA interviews. The questionnaire data (quantitative) supplemented the qualitative focus of the study. Overall, the quantitative analysis of the two scenarios provided a broad picture of how a PST cohort judges a challenging teaching scenario. Quantitative data provided a general agreement between the appropriateness rankings provided by PSTs and those suggested by expert teachers for each of the responses. The individual TA interviews provided a richer understanding of PST thinking processes, choices and commonalities. Given the nature of cognitive processing, the data drawn from TA interviews is often incomplete, with the thinking process proceeding more rapidly then speech. Therefore, our analytical strategy consisted of three levels suggested by Fonteyn, Kuipers, and Grobe (1993): Phrase Analysis, Assertion Analysis, and Script Analysis. The modified model (Klassen et al. (in press), which proposes a balance of PST implicit and explicit theories of teaching-related behaviours, informed the study interpretations.

Expected Outcomes

The PSTs agreed with the expert scoring on preferred choice to the scenario however, ranking of the remaining choices were variable. Each scenario was scored out of 20 (based on a pre-determined expert key). Primary PSTs scored highly with a mean of 17.3 (SD=1.9) and Secondary PSTs had a mean of 15.8 (SD=2.0). Think Alouds were used to establish the reasoning behind the rankings. The TA analysis addresses the first research question on the reasoning processes. The TA three step methodology and findings follow: (1) Phrase analysis, a process of coding to gain insights into working memory provided a final list comprised of 7 shared key concepts: Action, Personal, Communication, Context, Expertise, Interpersonal/Relationships, and Expectations. (2) Assertional analysis established a set of relevant assertions (relationships between concepts) during the reasoning process: Meaning (a truth), Value (significance or value), and Causal (cause & effect). (3) Script Analysis established a set of operators (reasoning processes): Study (consider/reflect); Justify (explain & justify– should/would/could); Choose (making a decision); Best choice (final decision). The operators explain the predominant reasoning common to all. The second research question sought to understand the beliefs and motives that underpin cognitive reasoning. The research went beyond behavioural tendencies (i.e., what would you do?) to ascertain the implicit and explicit influences that underpin motives and beliefs (i.e., what should you do?). Personal factors were central to the PSTs reasoning, while the environment (scenario) became the basis of the required decisions. Evidence of explicit motivations became clear through statements of personal beliefs related to confidence, and perceived environmental expectations. The implicit motivations centred on relational and performance outcomes. This research is significant as it draws awareness to the task of teacher education programs in developing PST congruence in implicit and explicit reasoning when confronted with challenging situations.

References

Australian Institute of Teaching and School Leadership [AITSL] (2015). Strengthened accreditation of initial teacher education programs. Accessed 6 December 2016 from www.aitsl.edu.au/initial-teacher-education/ ite-reform-strengthened-accreditation Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman. Bowles, T., Hattie, J., Dinham, S., Scull, J., & Clinton, J. (2014). Proposing a comprehensive model for identifying teaching candidates. The Australian Educational Researcher, 1-16. Charters, E. (2003). The use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Education Journal, 12(2) Cochran-Smith, M., & Fries, K. (2005). Researching teacher education in changing times: Politics and paradigms. Studying Teacher Education: The Report of the AERA Panel on Research and Teacher Education, 69-109. Council for the Accreditation of Educator Preparation [CAEP] (2013). Standards. Accessed 15th December 2016 from http://www.caepnet.org/standards/standard-3 Fonteyn, M. E., Kuipers, B., & Grobe, S. J. (1993). A description of think aloud method and protocol analysis. Qualitative Health Research, 3(4), 430-441. Klassen, R. M., Durksen, T. L., Kim, L., Patterson, F., Rowett, E., Warwick, J, Wolpert, M.A.(2017). Developing a proof-of-concept selection test for entry into primary teacher education programs. International Journal of Assessment Tools in Education, 4(2), 96-114. Klassen, R., Durksen, T., Rowett, E., & Patterson, F. (2014). Applicant reactions to a situational judgment test used for selection into initial teacher training. International Journal of Educational Psychology, 3(2), 104-124. Motowidlo, S. J., & Beier, M. E. (2010). Differentiating specific job knowledge from implicit trait policies in procedural knowledge measured by a situational judgment test. Journal of Applied Psychology, 95(2), 321. Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2nd ed). London: Sage Publications Metzger, S. A., & Wu, M. (2008). Commercial teacher selection instruments: The validity of selecting teachers through beliefs, attitudes, and values. Review of Educational Research, 78(4), 921-940. Schultheiss, O., & Brunstein, J. (2010). Implicit motives. UK: Oxford University Press. Swanson, H. L., O'Connor, J. E., & Cooney, J. B. (1990). An information processing analysis of expert and novice teachers' problem solving. American Educational Research Journal, 27(3), 533-556. Young, I. P., & Delli, D. A. (2002). The validity of the teacher perceiver interview for predicting performance of classroom teachers. Educational Administration Quarterly, 38(5), 586-612.

Author Information

Lynn Sheridan (presenting / submitting)
University of Wollongong, NSW, Australia
Wollongong
University of Wollongong
Faculty of Social Science, School of Eductaion
Not Wollongong
University of New South Wales, NSW, Australia

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.