Conference:
ECER 2009
Format:
Symposium Paper
Session Information
09 SES 07 A, Symposium: Issues in International Large-Scale Assessments
Symposium
Time:
2009-09-29
15:30-17:00
Room:
HG, HS 50
Chair:
Tjeerd Plomp
Discussant:
Claus Carstensen
Contribution
Given the scope of large-scale assessment programs such as TIMSS, PIRLS and PISA, innovative assessment designs are needed to ensure maximum content coverage while minimizing the exam burden for any particular student. Matrix sampling of items is commonly used to measure the wide content domain and to ensure that each examinee is administered a sufficient number of items to accurately estimate proficiency distributions while minimizing individual testing time. Under these designs, students are administered just a small subset of the available items (Beaton & Zwick, 1992; Johnson, 1992), resulting in a sparse response matrix that poses challenges for estimating student proficiency. Plausible value methods (Mislevy, 1991; Mislevy, Beaton, Kaplan & Sheehan, 1992; Mislevy, Johnson & Muraki, 1992) are a common approach for generating proficiency estimates; however, proficiency and item parameter estimates are influenced by the sparseness of the response matrix and sample size.
The current paper seeks to empirically investigate the degree to which person and item parameters are recovered as a function of matrix sparseness and sample size when different scaling and proficiency estimation methods are used under an incomplete matrix design. To explore this issue, we simulate data according to several matrix sample designs with varying sparseness and sample sizes, calibrate the items, and obtain proficiency estimates with several approaches.
Method
Expected Outcomes
References
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.