Non Satis Scire: To Know Is Not Enough: Assessment Of Student-teachers’ Competence As New Teachers
Conference:
ECER 2014
Format:
Paper

Session Information

10 SES 03 C, Learning to Teach: Competence, wellbeing and reflection

Paper Session

Time:
2014-09-02
17:15-18:45
Room:
B226 Sala de Aulas
Chair:
Gerry Czerniawski

Contribution

Introduction

Objective

Assessment and evaluation are increasingly important in all educational sectors. In teacher education programmes, text-based self-evaluations are generally used to assess student-teachers’ competence as new teachers (Fox, White, & Kidd, 2011; Winsor, Butt, & Reeves, 1999). However, this kind of written self-evaluation does not give valid evidence of teacher competencies that are typically used to guide the curriculum of teacher education programmes. Consequently, observation of student-teachers’ performance are increasingly used for assessment, such as class observations, teaching materials and tests. Simultaneously, assessment is used for both formative and summative purposes: assessments are not only used to measure student-teachers’ competencies, but also to feed back student-teachers which competencies they possess, in what phase of development they are and how they can acquire teacher competencies. The objective of this paper is to provide insight into how multiple assessments of student-teachers’ competence as new teachers can be designed in an efficient and effective way.

 

Theoretical framework

In teacher education programmes, written portfolios or text-based self-evaluations are generally used to assess student-teachers’ competence as new teachers (Fox, White, & Kidd, 2011; Winsor, Butt, & Reeves, 1999). In their assessment portfolios, student-teachers can include, for instance: their ideas regarding teaching, summaries of relevant theories, samples of lesson plans, observational notes on their teaching, and reflections upon their teaching practices. While such documents cover a wide range of knowledge and competence, striking discrepancies are known to exist between the competencies reflected in a written portfolio and the competencies observed in actual classroom practice. That is, student-teachers can sometimes present excellent written portfolios while their teaching performance is evaluated by school and university supervisors as rather weak (cf. Darling-Hammond & Snyder, 2000) and vice versa (cf. Burroughs, 2001; Uhlenbeck, 2002). In contrast to such indirect sources of data, video recording allows direct teaching evidence to be included in an assessment portfolio. Compared to written portfolios, video portfolios are likely to provide information on a wider variety of teacher competencies and more specific information on the contexts in which the competencies are demonstrated.

                However, performance in class is not the only competence student-teachers should acquire; they also learn to do research in their own practice. Moreover, knowledge of pedagogy, subject matter, classroom management and school organization are equally important for an accurate performance of teachers in school. This combination of teacher competencies asks for multiple assessment procedures in teacher education.

Method

Methods In a Dutch national project, Non satis scire, teacher trainers of all 13 Dutch universities collaboratively design, implement, and evaluate both formative and summative assessments of student-teachers’ competence as new teachers. Four assessment forms have been addressed: 1) knowledge tests on learning and instruction, 2) plans for research on teaching practice, 3) web-based video clips of teaching practice and 4) self-evaluations for student-teachers’ reflection. In a multiple-case study research design, 27 interventions were carried out, spread over the four forms of assessment. Data was collected of 335 minor students, 644 master students, and 252 teacher educators from 13 universities. A pre-test and post-test questionnaire was administered to students and teacher educators to evaluate the four interventions. In addition, all educational materials (study guides, readers, tests, video clips, student reflections, research plan, feedback forms and completed assessment rubrics) were collected and analyzed. A mix-method analysis procedure was used. Multivariate analyses of covariance were used to examine possible differences in evaluation before and after the interventions. In these analyses, each intervention condition was compared with the three others. Qualitative content analyses were used to study the educational materials and link the interpretations of the quantitative data.

Expected Outcomes

Results and conclusions The multivariate analyses of covariance do not show a significance increase in teacher educators’ use of the particular assessment procedure, compared to the control condition (consisting of each of the assessment form that was not part of the intervention condition in the particular analysis). Teacher educators in the intervention condition did generally differ in use of the particular assessment compared to those in the control condition, but these differences already existed a priori. This means that teacher educators apparently decided to participate in the interventions that included the assessment form they already used in their regular practice. The quantitative analyses on the level of students are not performed yet. Previous qualitative analyses show the particularities of using the four forms of assessments. One of the results from analysis of the educational materials was that teacher educators used the assessments in formative way, instead or at least in addition to summative assessments. This result align with observations from Admiraal, Van Duin, Hoeksma, & Van de Kamp, 2011) that teacher educators strongly prefer the role of mentor or coach, guiding students during their learning process, instead of the role of assessor, which includes judging the quality of students’ competence. Assessment procedures and criteria were developed and evaluated for testing student-teachers’ knowledge of teaching, for assessing a written research proposal, for judging video clips of teaching practices and student-teachers’ self-evaluations. In the next years, these procedures and criteria will be used as input for curriculum changes in teacher training programmes.

References

References Admiraal, W., Hoeksma, Kamp, M.-T. van de, Duin, G. van. (2011). Assessment of teacher competence using video portfolios: Reliability, construct validity and consequential validity. Teaching and Teacher Education, 27, 1019-1028. Burroughs, R. (2001). Composing standards and composing teachers. Journal of Teacher Education, 52, 223-232. Darling-Hammond, L., & Snyder, J. (2000). Authentic assessment of teaching in context. Teaching and Teacher Education, 16, 523-545. Fox, R. K., White, C. S., & Kidd, J. K. (2011). Program portfolios: documenting teachers’ growth in reflection‐based inquiry. Teachers and Teaching: Theory and Practice, 17, 149-167. Uhlenbeck, A. (2002). The development of an assessment procedure for beginning teachers of English as a foreign language. Leiden, the Netherlands: University of Leiden. Winsor, P. J. T., Butt, R. L., & Reeves, H. (1999): Portraying professional development in preservice teacher education: can portfolios do the job? Teachers and Teaching: Theory and Practice, 5, 9-31.

Author Information

Wilfried Admiraal (presenting / submitting)
Leiden University, Netherlands, The
University of Amsterdam, Netherlands, The
University of Amsterdam, Netherlands, The
Utrecht University, Netherlands, The
Eindhoven Technical University, Netherlands, the
Amsterdam University of Applied Sciences, Netherlands, the

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.