Session Information
99 ERC SES 04 I, Assessment, Evaluation, Testing and Measurement
Paper Session
Contribution
Formative assessment places greater emphasis on bidirectional contributions between the students in the assessment process (Yorke, 2003), as well as advocates an equal teacher-student relationship. To promote student learning, both stakeholders are expected to be fully engaged in the learning process (Black & Wiliam, 1998), instead of measuring student performance unilaterally (Wiggins, 1998). Although formative assessment is well established in western classroom practices and is required as one underpinning literacy for teachers (Popham, 2011), when the idea of formative assessment was introduced to Confucian heritage countries in Asia, tensions for K‒12 teachers arose due to the perennial convention of overemphasizing summative assessment in school.
Profoundly influenced by Confucianism, teachers in China may perceive formative assessment as a novel assessment paradigm that contradicts their traditional mindset on assessment. Take Chinese teachers as an example, many of them seem to be reluctant to this reform (Zhan, 2021). Moreover, schooling in these countries has been constantly shifted to virtual online classroom platforms since the COVID-19 pandemic. Given that online classrooms largely constrain the effectiveness of the implementation of assessment (Khan & Khan, 2018), the different classroom modes complicate the teacher formative assessment practices.
However, there is a paucity of research on teachers’ overall literacy of formative assessment in the eastern Confucian heritage countries (Zhan, 2019). There is also a need to design and develop a psychometrically sound and culturally responsive inventory instrument in the field of formative assessment literacy in the Confucian cultural context. Thus, I attempt to design and validate a first easternized online inventory to evaluate teachers’ capacity for formative assessment acquisition and authentic application. The whole process includes four phases under the guide of an exploratory sequential mixed-methods design. Building on the interviews and the prior inventories on relevant domains (e.g., Campbell & Mertler, 2004; Yan & Pastore, 2022), I plan to categorize the dimensions as five scenarios, consisting of 1) face-to-face classroom, 2) online classroom, 3) after-school assignments and tasks, 4) feedback, 5) ethical concerns. Each contains six multiple-choice questions and each question has one best answer. The inventory will be uploaded to www.wjx.cn, a Chinese online open survey website, and automatically code the correct answer as 1 point while the incorrect answers as 0 points. Thus, the total grade for one participant is 30 points and each subsection values 6 points.
In particular, I am fully aware of the unique characteristics of Confucian heritage culture and its ubiquitous impact on teacher assessment practices. Therefore, all the questions are edited in line with the authentic local classroom settings. For example, I will emphasize student dignity considerations to replace the typical western inventory questions about privacy risks.
The expected findings will contribute to the initial investigation of the status of formative assessment literacy for K‒12 teachers in Confucian heritage culture and locate the specific factors influencing the building and practice of teachers in this domain. Eventually, the inventory will be used to gather evidence to inform in-service and preservice teacher professional development programs.
Method
Given that educational assessment is a complex phenomenon that is difficult to measure solely on quantitative or qualitative information, and Confucian K–12 school contexts are unique through the lens of the social and cultural aspects (Berthrong & Berthrong, 2000). Therefore, we employ an exploratory sequential mixed-method research design (Creswell, & Plano Clark, 2018). The main research thread is: (1) Qualitative method: we intend to conduct a series of semi-structured interviews with 10 in-service teachers from elementary, junior high, and senior high schools to portray an initial picture of the status of teacher formative assessment literacy in Shanghai, China. (2) Quantitative method: building on the prior inventories on assessment literacy around the world, and the outcomes from the first-phase interviews, we will vernacularize and design a five-point Likert-type response questionnaire and a multiple-choice scale to explore how teachers perceive, comprehend, and practice formative assessment. About 300 teachers from 12 grades and all major disciplines will be invited as participants. In this phase, we will examine the construct validity of the quantitative data using exploratory factor analysis. (3) Qualitative method: As a necessity of exploratory sequential design, we will aim to verify the quantitative findings by conducting a new round of qualitative method. Thus, we will invite 3 cohorts of teachers and 1 group of school administrators from three-level schools to participate in the final focus group. Their consensus of formative assessment literacy will conduce to hone the quantitative findings and finally conflate and summarize the overall findings.
Expected Outcomes
The overarching aim of this study is to design and validate a psychometrically sound and culturally responsive inventory in the Confucian culture context, which can be used as a tool for K–12 teachers’ overall formative assessment literacy. This study can directly depict the current state of Chinese K–12 teachers' formative assessment literacy. I expect to explore the advantages and disadvantages of formative assessment literacy in authentic settings and how Confucianism influences the building of formative assessment literacy for teachers. Further, it can gather the total grade of a teacher’s general comprehension on formative assessment and five subtotal grades convergent from three dimensions: conceptual, practical and socio-cultural for prospective analysis. Accordingly, the insights from this study could be used as suggestions for ongoing educational practices. By extension, this inventory could be harnessed as an underpinning tool for higher educational institutions to review and redesign pre-service and in-service teacher professional development programs focusing on improving teachers’ formative assessment literacy in Confucian contexts.
References
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139–148. Berthrong, J. H., & Berthrong, E. N. (2000). Confucianism: A short introduction. Oneworld Publications. Campbell, C., & Mertler, C. A. (2004). Assessment Literacy Inventory. https://learn.maricopa.edu/courses/811364/quizzes/1226231 Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). Sage. Khan, S., & Khan, R. A. (2018). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24(1), 661–677. https://doi.org/10.1007/s10639-018-9797-0 Popham, W. J. (2011). Assessment literacy overlooked: a teacher educator's confession. The Teacher Educator, 46(4), 265-273. https://doi.org/10.1080/08878730.2011.605048 Wiggins, G. P. (1998). Educative assessment: Designing assessments to inform and improve student performance. Jossey-Bass. Yan, & Pastore, S. (2022). Are teachers literate in formative assessment? The development and validation of the Teacher Formative Assessment Literacy Scale. Studies in Educational Evaluation, 74, 1–41. https://doi.org/10.1016/j.stueduc.2022.101183 Yorke, M. (2003). Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education, 45(4), 477–501. https://doi.org/10.1023/A:1023967026413 Zhan, Y. (2021). What matters in design? Cultivating undergraduates’ critical thinking through online peer assessment in a Confucian heritage context. Assessment & Evaluation in Higher Education, 46(4), 615–630. https://doi.org/10.1080/02602938.2020.1804826 Zhan, Y. (2019). Conventional or sustainable? Chinese university students’ thinking about feedback used in their English lessons. Assessment & Evaluation in Higher Education, 44(7), 973–986. https://doi.org/10.1080/02602938.2018.1557105.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.