The interplay between theory and research: Using Rasch analysis to strengthen feedback to schools for improved learning(symposium1919)
Conference:
ECER 2009
Format:
Symposium Paper

Session Information

09 SES 10 A, Rasch Measurement in Educational Contexts (Part 3)

Symposium. Continued from 09 SES 09 A, continued in 09 SES 11 A

Time:
2009-09-30
14:45-16:15
Room:
HG, HS 50
Chair:
Tjeerd Plomp
Discussant:
Eugenio Gonzalez

Contribution

The challenge for any education system is to be able to provide quality education for participants in the system. It is not surprising that there has been a re-emphasis on quality education internationally. Researchers in Europe, in particular the Netherlands and Belgium are exploring issues of feedback to schools in order to improve education (see Schildkamp, 2007; Van Petegem and Vanhoof, 2005). While questions such as ‘what information schools need’ and ‘how to present information’ are key, the role that statistics can play to make the task easier rather than more complex is also important. The research to be presented is part of a research project conducted by the Centre for Evaluation and Assessment at the University of Pretoria, South Africa. The aim of the project to explore feedback provided to schools as a result of a school-based monitoring system. The research question addressed in this paper is how can complex information based on performance data be presented in an accessible manner? The conceptual framework for the study draws on the frameworks proposed by Visscher (2002) and Van Petegem and Vanhoof (2005) amongst others. While design research using a mixed methods approach is followed for the broader project this paper focuses specifically on the role of Rasch analysis in the development of a feedback prototype given at the school-level. In total 40 schools (20 primary and 20 secondary schools) are currently participating in the project. A sample of Grade 1 (N=1390) and Grade 8 (N=1323) learners were randomly selected. These pupils completed the assessments as part of the monitoring systems. The assessments were linked to the curriculum at Grade 1 and Grade 8 in terms of the various learning outcomes each item exhibits. A dichotomous Rasch model, using Winsteps software, was used in order to ascertain the difficulty of each of the items as well as the ability levels of the pupils. Five difficulty levels or thresholds were constructed from the items, which corresponded to the ability levels of pupils. Based on this a matrix was developed to identify content areas in which pupils would need improvement. The research is still in progress. A report on the results for the language component will be given at the conference.

Method

Expected Outcomes

References

Schildkamp, K. (2007). The utilisation of a self-evaluation instrument in primary education. Published PhD Dissertation. Enschede: The University of Twente. van Petegem, P & Vanhoof, J. (2005). Feedback of performance indicators: A tool for school improvement? Flemish case studies as a starting point for constructing a model for school feedback. Revista Eletronca Iberoamericana sobre Calidad, Eficacia y Cambio en EducaciÓn, 3(1), 222-234. Retrieved January 30, 2007, from http://www.ice.deusto.es/rinace/reice/vol3n1_e/VanPetegemVanhoof.pdf. Visscher, A. J. (2002). A framework for studying school performance feedback systems. In A. J. Visscher and R. Coe (Eds.), School improvement through performance feedback (pp. 41–72). Lisse: Swets & Zeitlinger Publishers.

Author Information

University of Pretoria
Centre for Evaluation and Assessment
Pretoria
235
University of Pretoria, South Africa

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.