Teachers’ Decision for Grade Retention: Data-based or Intuition-driven?
Author(s):
Conference:
ECER 2015
Format:
Paper

Session Information

11 SES 12 A, Employing Research and Evaluation Data to Improve Education

Paper Session

Time:
2015-09-11
09:00-10:30
Room:
102.Oktatóterem [C]
Chair:
Buratin Khampirat

Contribution

The decision for grade retention is an important decision in schools since it has an impact on students’ academic career and socio-emotional adjustment (Hall & Hord, 2006; Kelchtermans, 2009). Grade retention is a controversial response to students who are not academically and/or socially ready for the next grade. Given the abundance of research examining the efficacy of grade retention, it is important that the decision for grade retention is a well-informed decision (Kelchtermans, 2009). International research shows that Belgium has high repetition rates in comparison to other European countries (Eurydice, 2011), but there seems to be limited information regarding how these retention decisions are made (Hall & Hord, 2006). It appears that in most schools, the decision to retain is a subjective one, primarily based on teacher appraisal (Beijaard & Verloop, 1996; Hall & Hord, 2006; Verloop, Van Driel, & Meijer, 2001). Since students’ lives are affected profoundly by the decisions that teachers make, the challenge lies in questioning the way teachers make these decisions. Yet, it appears that little is known about teachers’ decision-making (Harteis et al., 2012).

To understand the processes involved in making decisions, decision-theory can be used as an infrastructure (Gati et al. 2010). Research has shown that decisions vary in the degree to which they rely on intuitive and analytical processes (Epstein, 2008; Kahneman & Frederick, 2005; Klein, 2008; Witteman, van den Bercken, Claes, & Godoy, 2009). When teachers make decisions, their search for information may be internal, retrieving knowledge from their intuition, or may be external: collecting data. For many years, decisions of teachers were primarily based on  intuition (Creighton 2007, Earl and Katz 2006). The last decade however, a strong belief has grown among a wide variety of stakeholders that the quality of decisions increases in proportion to the extent to which these decisions are based on data (Schildkamp & Ehren, 2013). In practice, the intuitive and data-based grounds of teachers’ decisions are interrelated and cannot be separated from one another (Spencer, Detrich, & Slocum, 2012). According to Whitehurst (2002) data-based decision making needs to integrate the professional wisdom of the teacher with the best available data in making decisions. Professional wisdom can help weighting the best available data in relation to values and contextual factors and refines the source of information by retaining relevant and valuable data and discarding the rest (Spencer et al., 2012). However, this may bring possible pitfalls. Teachers often suffer from information overload. Therefore they might use heuristics – cognitive short cuts – which allow easier procedures to reach to a decision (Kahneman & Frederick, 2005; Tversky & Kahneman, 1981). According to Kahneman and Frederick (2005) errors of intuitive decision making can be detected and corrected by the rational part of decision making. Data-based decision making can challenge and complement intuitive judgments by collecting and analyzing data to add additional information to the process, before the decision is made (L Earl & Louis, 2013).

Because of the high stakes involved with the decision for grade retention there is a need for thoughtful, defensible decisions preceded by the analysis of different information sources. In the case of data-based decision making in schools, previous research focused predominantly on the perspective of school leaders (Day et al., 2008; Stevens, Brown, Knibbs, & Smith, 2005). There is a need for research on the equally important perspective of teachers (Downey & Kelly, 2011). Therefore, this study sets out to explore and explain the role of intuition and data in the decision-making processes of teachers.

Method

With the aim of exploring the decision-making processes of teachers and providing in depth answers to the present research questions, we used a qualitative research design including semi-structured in-depth interviews. Taking into account the point of saturation, interviews were taken with 17 teachers in the first year of primary education (Guest, Bunce, & Johnson, 2006). Participating teachers registered voluntarily after a web-based call or were directly contacted by the researcher. Teachers were not suggested or obliged by the principal in any way. The teachers were contacted by the researcher in June, at the end of the school year and the specific precondition for this research was elaborated. All of the respondents had to be teachers in first year of primary education who recently had a case of grade retention at the end of the first year of primary education. At the start of the interviews teachers were asked to describe a decision concerning grade retention they found hard to make retrospectively. This is called the critical incidents method, because it focuses attention on the key elements that were important during the process being described (Klein, 2008). According to Klein, (2008) if you can get teachers to tell you about tough cases, then you have a pathway into their perspective. The in-depth interviews had an average duration of one hour and were conducted by a single researcher and subsequently transcribed ad verbatim and coded using Nvivo 10. Using the theoretical framework as a starting point, the coding process was mainly deductive. General codes, such as ‘Information Search’ were distracted from the theoretical framework and were specified through several subcodes, such as ‘Internal Search’ and ‘External Search’. To test the construct validity of the coding, a second researcher coded two interviews independently. The inter-rater reliability (Cohen’s Kappa) is 0.95 (Miles & Huberman, 1994). From theory as well as from the input of participants was searched for similarities and differences in the interviews to deduce cross-case interview results (Miles & Huberman, 1994). Thereby, we followed the principles of framework analysis (Maso & Smaling, 1998).

Expected Outcomes

This study shows that teachers have a great deal of trust in their internal information sources: intuition is the main information source to define the problem and guides the search for information. In the search for information, intuition appeared to have a pivotal role: intuition is mentioned as the most important source of information, gives direction to the external information search and serves as a lens through which teachers look at data. Information provided by data is taken into account in the evaluation of alternatives, but is weighted and evaluated by the touchstone of intuition. Intuition serves as the main basis for the evaluative criteria that are used as a guidance for the decision rules. A theoretical framework was tested and refined in the context of teachers’ decision-making. This may be valuable in further research on decision making and data use. A second contribution of this study lies in its value for practice since insight in the decision-making processes of teachers will help to define how the quality of the decisions within schools can be optimized.

References

Beijaard, D., & Verloop, N. (1996). Assessing Teachers' Practical Knowledge. Studies In Educational Evaluation, 22(3), 275-286. Blackwell, R., Miniard, P., & Engel, J. (2006). Consumer Behaviour. Mason. Earl, L., & Katz, I. (2002). Leading Schools in a Data-Rich World. Earl, L., & Louis, K. S. (2013). Data Use: Where to from Here? In K. Schildkamp, M. Kuin Lai & L. Earl (Eds.), Data-based Decision Making in Education (pp. 193-207). Dordrecht: Springer. Epstein, S. (2008). Intuition from the perspective of cognitive experiental self-theory. New York: Erlbaum. Eurydice. (2011). Grade Retention during Compulsary Education in Europe: Regulations and Statistics. Brussels: Education, Audiovisual and Cultural Executive Agency. Hall, G., & Hord, S. M. (2006). Implementing change: patterns, principles and potholes (2nd ed.). Bosten: Pearson Education Inc. Harteis, C., & Billet, S. (2013). Intuitive expertise: Theories and empirical evidence. Educational Research Review, 9, 145-157. Kahneman, D., & Frederick, S. (2005). A Model of Heuristic Judgement. In J. H. Keith & R. G. Morrison (Eds.), Cambridge Handbook of Thinking and Reasoning (pp. 267-293). Cambridge: Cambridge University Press. Kelchtermans, G. (2009). Who I am in how I teach is the message: self-understanding, vulnerability and reflection. Teacher and Teaching, 15(2), 257-272. Schildkamp, K., & Ehren, M. (2013). Data-based Decision Making in Education. Dordrecht: Springer. Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based Practice: A Framework for Making Effective Decisions. Education And Treatment of Children, 35(2). Tversky, A., & Kahneman, D. (1981). The framing of decisions and the pschychology of choice. Science, 211, 453-458. Verloop, N., Van Driel, J., & Meijer, P. C. (2001). Teacher knowledge and the knowledge base of teaching. International Journal of Educational Research, 35, 441-461. Whitehurst, G. J. (2002). Evidence-based Education. Paper presented at the Student Achievement and School Accountability Conference, U.S.

Author Information

Kristin Vanlommel (submitting)
University of Antwerp
Institute of Information and Educational Sciences
Antwerp
Jan Vanhoof (presenting)
University of Antwerp
Antwerpen
University of Antwerp, Belgium

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.