Session Information
09 SES 12 C, Setting Performance Standards in Large-scale Assessments
Research Workshop
Contribution
This workshop will cover the basic steps involved in setting standards for large-scale assessments, and will review commonly-used methods. Considerations in evaluating the validity, advantages and disadvantages of standard setting methods and results will also be reviewed. The topics covered will be the following: Fundamental concepts for standard setting; required steps for all standard setting methods; types of methods; the Modified Angoff and Bookmark methods; scale anchoring procedures.
Method
Expected Outcomes
References
Cizek, G. J., & Earnest, D. (2015). Standard setting. In S. Lane, M. Raymond, & T. Haladyna (Eds.), Handbook of test development. New York: Routledge. Pitoniak, M. J., & Cizek, G. J. (in press). Standard setting. In C. Wells & M. Faulkner-Bond (eds.), Educational measurement: From foundations to future. New York: Guilford. Cizek, G. J. (Ed.) (2012a). Setting performance standards: Foundations, methods, and innovations. New York: Routledge. Cizek, G. J. (2012b). An introduction to contemporary standard setting: Concepts, characteristics, and contexts. In G. J. Cizek (Ed.). Setting performance standards: Foundations, methods, and innovations (pp. 3-14). New York: Routledge. Cizek, G. J. (2012c). The forms and functions of evaluations of the standard setting process. In G. J. Cizek (Ed.). Setting performance standards: Foundations, methods, and innovations (pp. 165-178). New York: Routledge. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3–19. Zieky, M.J. (2001). So much has changed: how the setting of cutscores has evolved since the 1980s. In Cizek, G.J. (Ed.), Setting Performance Standards, p. 19-52. Mahwah, NJ: Lawrence Erlbaum Associates. Lewis, D. M., Mitzel, H. C., Green, D. R. (June, 1996). Standard Setting: A Bookmark Approach. In D. R. Green (Chair), IRT-Based Standard-Setting Procedures Utilizing Behavioral Anchoring. Paper presented at the 1996 Council of Chief State School Officers National Conference on Large Scale Assessment, Phoenix, AZ. Mitzel, H. C., Lewis, D. M., Patz, R. J., & Green, D. R. (2000). The Bookmark Procedure: Cognitive Perspectives on Standard Setting. Chapter in Setting Performance Standards: Concepts, Methods, and Perspectives (G. J. Cizek, ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.