Issues in International Large-Scale Assessments

Session Information

09 SES 07 A, Symposium: Issues in International Large-Scale Assessments

Symposium

Time:
2009-09-29
15:30-17:00
Room:
HG, HS 50
Chair:
Tjeerd Plomp
Discussant:
Claus Carstensen

Contribution

Abstract for symposium proposal: International assessments such as TIMSS and PIRLS have seen rapid growth in terms of participating member countries. Additionally, methodological and substantive research in the area of large-scale assessment has enjoyed rapid growth as these assessments assume an increasingly important place in international education policy discussions. This expansion has opened a number of interesting research areas, many of which are currently being pursued around the world and within the European Union. The need for continued research in this area is exemplified by the following quote. “The demands of extending the application of large-scale assessment technologies to new subject matter areas as well as to an increasing diversity of countries whose linguistic, economic, and cultural circumstances are vastly different have challenged developers, methodologists, and psychometricians to create solutions that are as reliable as they are elegant.” (Wagemaker, Kirsch, 2008, p. 5) In response to this call, the proposed symposium will present a set of papers on issues related to the development, use and interpretation of large-scale assessment (LSA) results. The papers in this symposium examine several issues surrounding LSA and make use of this rich data resource with specific emphasis on either substantive or methodological concepts applied to International Association for the Evaluation of Educational Achievement (IEA) studies. Two of the proposed papers address complex issues related to LSA data such as the multilevel structure of the data and the construction and use of imputed test scores. While two of the papers make use of simulated data to explore methodological issues, all papers employ empirical data collected as part of LSA programs such as TIMSS to illustrate and support their findings. The objectives of this symposium are to: (1) examine how LSA can assist educational researchers in identifying factors describing effective schools; (2) analyze the influence of curriculum non-coverage on scale scores; (3) show the advantages of using plausible values over traditional point estimates of individual proficiency; and (4) investigate the degree to which person and item parameters are recovered as a function of matrix sparseness and sample size. The symposium will provide a forum for interested educational researchers to discuss possible uses of IEA data for international research. Symposium participants include researchers and practitioners who have been conducting research in international assessment for a number of years. These participants have unique and valuable insights and knowledge about practical and theoretical issues related to international LSA.

Method

See symposium paper abstracts below

Expected Outcomes

See symposium paper abstracts below

References

References for all symposium paper abstracts below - Beaton, A. E., & Zwick, R. (1992). Overview of the National Assessment of Educational Progress. Journal of Educational Statistics, 17(2), 95-109. - Johnson, E. J. (1992). The design of the National Assessment of Educational Progress. Journal of Educational Measurement 29(2), 95-110. - Mislevy, R. J. (1991). Randomization-based inference about latent variables from complex samples. Psychometrika, 56, 177-196. - Mislevy, R. J., Beaton, A. E., Kaplan, B., & Sheehan, K. M. (1992). Estimating population characteristics from sparse matrix samples of item responses. Journal of Educational Measurement 29(2), 133-161. - Mislevy, R. J., Johnson, E. G., & Muraki, E. (1992). Scaling procedures in NAEP. Journal of Educational Statistics, (17)2, 131-154. - Mullis, I., Martin, M., Gonzalez, E., Chrostowksi, S., (2004). TIMSS 2003 International Mathematics Report. TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College - Wagemaker, H. & Kirsch, E. (2008). Introduction. In: IERI Monograph Series. Issues and Methodologies in Large-Scale Assessments. Volume 1, IEA-ETS Research Institute

Author Information

International Association for the Evaluation of Educational Achievement (IEA)
Data Processing and Research Center (DPC)
Hamburg
54
IEA-ETS Research Institute
Philadelphia
220
IEA
DPC
Hamburg
54
IEA-DPC
RandA
Hamburg
54
Educational Testing Service
International Association for the Evaluation of Educational Achievement (IEA), Germany

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.