Testing, testing 1 2 3… Impact of frequency of student assessment and assessment methods on students’ academic performance.
Author(s):
Cay Gjerustad (presenting / submitting) Vibeke Opheim (presenting)
Conference:
ECER 2014
Format:
Paper

Session Information

09 SES 10 B, Impact and Perceptions of Assessment

Paper Session

Time:
2014-09-04
15:30-17:00
Room:
B012 Anfiteatro
Chair:
Sirkku Kupiainen

Contribution

During the last years Norwegian schools have increased the emphasis on monitoring students learning and achievements. An important factor in this work is more use of assessment. The purpose of this paper is to examine how the frequency of assessment is related to students’ academic performance, and whether this varies for different assessment methods.

Assessing students’ achievements is an important source of information for learning and teaching, and may provide feedback to both students and teachers regarding own performance and how to improve this (Hattie and Timperley, 2007; Yin et al., 2008). Several researchers have suggested that an important aspect of assessment is feedback to the students (Yin et al., 2008; Black and Williams, 2009). Basol and Johanson (2009) found that the effect of frequent testing varied substantially depending on whether the assessment involved feedback to the students or not. The finding implies that assessment is positive on its own, but that feedback to students based on the assessment increases the effect.

Two meta-studies on how the frequency of assessment relates to academic performance suggest that more frequent assessment is positively related to student’s academic performance (Bangert-Drowns, Kulik and Kulik, 1991; Basol and Johanson, 2009).

Frequent assessment probably involves monitoring the learning process and feedback to the students, factors that could explain the found positive effects. In addition, it is plausible that both students and teachers need to learn how to use the applied method to get the most out of it. Therefore, more frequent use may lead to improved gains from the assessment, something that could be positive for the academic performance.

Neither Bangert-Drowns and colleagues (1991), nor Basol and Johanson (2009) suggests that there may be upper limits for how much testing that is advisable. However, Bangert-Drowns and colleagues (1991) found large effects of one or a few tests, but smaller effects of additional testing. The difference in exam scores between those with none versus one previous test was substantial, whereas the difference between one versus several tests were relatively small. This suggests that a few tests during a course increase the end result substantially, and that testing beyond this has limited effect. However, frequent assessment may also induce stress and frustration among the students, particularly among the weak performance students. Dutro and Selland (2012) suggest that children’s experience from assessment may be important for how they perceive themselves and for their engagement at school. This may reduce the positive effects of assessment.

The current paper will expand knowledge regarding the frequency through examination of the relationship between the frequency of assessment and academic performance. Is this relationship linear, where higher frequency is more positive, or is it curvilinear, suggesting that there is an upper limit for the frequency of assessment?

Furthermore, the paper will examine the relationship between frequency and academic performance for a variety of assessment methods. Different methods may be differently related to academic performance because they provide different information to the student and teacher. Apart from Basol and Johanson (2009), who found some support for positive effects of multiple choice tests, few studies have examined whether different assessment methods vary regarding their relationship to academic performance. 

Method

The paper draws on data from The Pupil Survey, which is a national survey in Norway conducted annually with pupils and students in primary and secondary school as informants. The analyses are based on the answers given by students in 10th grade, the last year of the compulsory school, in 2010. Around 54 000 students in 10th grade participated in the survey that year, which gives a response rate of 85 percent. In addition to questions regarding assessment methods and academic performance, the survey also contains questions on a large number of themes related to school climate, such as disturbances in class and students’ motivation. The information in the Pupil Survey is merged with register data on school characteristics, such as socioeconomic background and immigrant status. This allows for multivariate analyses controlling for several factors both at students’ individual level and at school level when examining the relationship between assessment and performance. The analyses are conducted using three-level (school, class and individual) multivariate analyses (random and fixed effects models, linear regression).

Expected Outcomes

Preliminary analyses suggest that the frequency of assessment is connected to academic performance, and that this relationship differs for the examined assessment methods. The relationship is positive for written tests and homework hearing: more frequent use of these assessment methods is related to higher achievements. The relationship is negative for portfolio assessment: more frequent use of this method is related to lower achievements. Oral presentation is not found to be connected to academic performance. The findings prevail controlling for school characteristics and students’ characteristics. Additional analyses suggest a curvilinear relationship between the methods of assessment and academic performance. For portfolio assessment and homework hearing, a u-shaped relationship is found. This means that those reporting either high or low frequency of this method also report higher academic performance than those reporting mediate use of the method. The reverse relationship is found for written tests: those reporting either high or low frequency of this method also report lower academic performance than those reporting mediate use of the method. The findings are discussed in light of previous research on assessment. Central topics here are teachers’ competences in and experience with the use of various assessment methods, and how the amount of assessment may influence student’s perceptions of themselves and their own performance. The analyses are based on students’ reported experiences of their teachers’ use of various teaching methods, thus the findings will also be discussed related to studies on students’ interpretations and responses to classroom activities.

References

Bangert-Drowns, R.L, Kulik, J.A. and Kulik, C.L.C. (1991) Effects of frequent classroom testing. Journal of educational research, 85(21): 89-99. Basol, G. and Johanson, G. (2009) Effectiveness of frequent testing over achievement: a meta-analysis study. International journal of human sciences. 6:2. Available: http://www.insanbilimleri.com.en Black, P. and William, D. (2009) Developing the theory of formative assessment. Educational Assessment Evaluation and Accountability, 21(1): 5-31. Hattie, J. and Temperley (2007) The power of feedback. Review of educational research. 77(1): 81-112

Author Information

Cay Gjerustad (presenting / submitting)
NIFU
Oslo
Vibeke Opheim (presenting)
NIFU
Oslo

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.