Setting Performance Standards in Large-scale Assessments - Workshop

Author(s):

Eugenio Gonzalez(presenting / submitting)

Conference:

ECER 2016

Network:

09. Assessment, Evaluation, Testing and Measurement

Format:

Research Workshop

Session Information

09 SES 12 C, Setting Performance Standards in Large-scale Assessments

Research Workshop

Time:

2016-08-26

09:00-10:30

Room:

NM-F107

Chair:

Eugenio Gonzalez

Contribution

This workshop will cover the basic steps involved in setting standards for large-scale assessments, and will review commonly-used methods. Considerations in evaluating the validity, advantages and disadvantages of standard setting methods and results will also be reviewed. The topics covered will be the following: Fundamental concepts for standard setting; required steps for all standard setting methods; types of methods; the Modified Angoff and Bookmark methods; scale anchoring procedures.

Method

The workshop will consist of a lecture on the methods, procedures and steps necessary to conduct a standard setting process for an assessments, and will provide actual examples and results of programs where these standard setting procedures haven implemented.

Expected Outcomes

At the end of the workshop participants will be able to distinguish between the different standard setting methods, and will have basic information to decide between them. They will also have information about its applications to large-scale assessments, and in comparison with scale anchoring procedures.

References

Cizek, G. J., & Earnest, D. (2015). Standard setting. In S. Lane, M. Raymond, & T. Haladyna (Eds.), Handbook of test development. New York: Routledge. Pitoniak, M. J., & Cizek, G. J. (in press). Standard setting. In C. Wells & M. Faulkner-Bond (eds.), Educational measurement: From foundations to future. New York: Guilford. Cizek, G. J. (Ed.) (2012a). Setting performance standards: Foundations, methods, and innovations. New York: Routledge. Cizek, G. J. (2012b). An introduction to contemporary standard setting: Concepts, characteristics, and contexts. In G. J. Cizek (Ed.). Setting performance standards: Foundations, methods, and innovations (pp. 3-14). New York: Routledge. Cizek, G. J. (2012c). The forms and functions of evaluations of the standard setting process. In G. J. Cizek (Ed.). Setting performance standards: Foundations, methods, and innovations (pp. 165-178). New York: Routledge. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3–19. Zieky, M.J. (2001). So much has changed: how the setting of cutscores has evolved since the 1980s. In Cizek, G.J. (Ed.), Setting Performance Standards, p. 19-52. Mahwah, NJ: Lawrence Erlbaum Associates. Lewis, D. M., Mitzel, H. C., Green, D. R. (June, 1996). Standard Setting: A Bookmark Approach. In D. R. Green (Chair), IRT-Based Standard-Setting Procedures Utilizing Behavioral Anchoring. Paper presented at the 1996 Council of Chief State School Officers National Conference on Large Scale Assessment, Phoenix, AZ. Mitzel, H. C., Lewis, D. M., Patz, R. J., & Green, D. R. (2000). The Bookmark Procedure: Cognitive Perspectives on Standard Setting. Chapter in Setting Performance Standards: Concepts, Methods, and Perspectives (G. J. Cizek, ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

Author Information

Eugenio Gonzalez (presenting / submitting)

ETS, Germany

Search the ECER Programme

Search for keywords and phrases in "Text Search"
Restrict in which part of the abstracts to search in "Where to search"
Search for authors and in the respective field.
For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.