Session Information
09 SES 07 C, Methodological Issues in Large-scale Assessments
Parallel Paper Session
Contribution
Computers form a major and integral part in today’s student life. Thus, the role of computers has been discussed in several fields of education (Senkbeil & WiIttwer, 2007; Vendlinski & Stevens, 2002). Furthermore, computer-based testing (cbt) has gained a huge influence on both Large-Scale-Assessments and everyday teaching, with the latter in the context of formative assessment (i.e. Black & Williams, 1998), for instance. cbtnot only simplifies the process of obtaining individual feedback, cbt also helps identifying individual strengths and weaknesses immediately (i.e. Tierney & Charland, 2007).
However, in order to use computer-based testing as an equivalent for paper-based testing (pbt), mode-effects have to be investigated thoroughly. Therefore, the following issues must be studied: (1) Do students reach the same results when doing the paper-based test compared to the computer-based test, respectively? (2) Does the underlying competence model hold for both testing modes? Furthermore, several aspects such as computer knowledge and skills, as well as other covariates (sex, social background, ethnic background) have to be considered. Only by including these aspects, it can be determined whether (3) those aspects form a disadvantage within the testing mode’s dependence.
Particularly in German research and explicitly for the field of research in spelling, such aspects have not been to major concern.
In this paper, the issues mentioned above will be considered within range of a spelling test originally developed for paper-based testing (pbt). Herefore, a mode-effect-study was conducted with a sample of approximately 500 students in grade 5 five. 50 Percent of the students took the computer-based test while the other 50 percent completed the paper-based test. All students taking part in the survey also filled out a questionnaire concerning topics such as computer usage and motivation. This allows us to draw further conclusions concerning subgroups of the sample that might be disadvantaged by the test mode. Furthermore, each student was given an introduction on keyboard typing and hereafter performed a typing test. The herewith-collected data gives a deeper insight into the relation between ability to type on a keyboard and spelling competence.
The test is based on a theoretical linguistic framework containing five sub skills, which has been verified in several studies in grade 4 and 5 (Blatt et al, 2011). These studies and their results give a reference frame for the comparison of both modes. They, hence, are an indispensable prerequisite for the mode-effect study.
Method
Expected Outcomes
References
Black, P. & Wiliam, D (1998). Assessment and Classroom Learning. Assessment in Education 5(1) pp. 7-71. Blatt, I., Voss, A., Kowalski, K. & Jarsinski, S. (2011). Empirische Modellierung und Messung von Rechtschreibkompetenz. U. Bredel (edt) Weiterführender Orthographieunterricht (Deutschunterricht in Theorie und Praxis). Baltmannweiler: Schneider Verlag Hohengehren. Kröhne, U. & Martens, T (2011).Computer-based competence tests in the national educational panel study. Zeitschrift für Erziehungswissenschaft. Special issue, 14 (2) pp. 169-186. Senkbeil, M. & Wittwer, J. (2007). Die Computervertrautheit von Jugendlichen und Wirkungen der Computernutzung auf den fachlichen Kompetenzerwerb. PISA-Konsortium Deutschland (eds.), PISA 2006. Die Ergebnisse der dritten internationalen Vergleichsstudie. Waxmann. pp. 277-307. Tierney, R. D., & Charland, J. (2007). Stocks and prospects: Research on formative assessment in secondary classrooms. Paper presented at the Annual Meeting of the American Educational Research Association, Chicago, IL. Vendlinski, T. & Stevens, R. (2002). Assessing student problem-solving skills with complex computer-based tasks. Journal of Technology, Learning, and Assessment, 1 (3).
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.