Session Information
09 SES 12 B, Effective Instruction Across Contexts
Paper Session
Contribution
Ensuring effective learning and teaching requires a strong assessment culture in schools where teachers and students are supported to use assessment and assessment data to increase learning outcomes. This assessment culture is characterised by a shared understanding of assessment principles, processes, and practices, common assessment language to have a common reference for discussing the competing understanding and conceptualisations (Davison, 2013), strong leadership support (Christoforidou & Kyriakides, 2021; Davari Torshizi & Bahraman, 2019), student engagement in assessment (Hannigan et al., 2022), and presence of enabling and supporting mechanisms (Alonzo, Leverett, et al., 2021). There are various approaches used and reported in the literature to build a strong assessment culture, including teacher-led initiatives (Adie et al., 2021), school-led whole-school approach to building teacher capacity (Hopfenbeck et al., 2015), development and implementation of assessment framework or tools (Prytula et al., 2013), and enactment of the system-level policy (Verhoeven & Devos, 2005). However, assessment is context-based (Alonzo, Labad, et al., 2021), and thus, building a strong assessment culture requires a deep analysis of personal, social-emotional, conceptual, paradigmatic, practical, contextual, structural, organisational, and policy contexts of the school to determine the best strategies to support students and teachers.
This paper demonstrates how schools develop their assessment culture by using a situational analysis to explore the various elements influencing the school’ assessment culture to have an in-depth understanding of the situation. In this study, we worked with school leaders and teachers of five schools to develop their context-dependent assessment culture. To achieve the aims of our study, the following research questions will be answered:
- What are the dominant discourse around assessment that exist in schools?
- What are the major issues/debates that influence teachers’ assessment practices?
- What are the temporal, spatial, political, and socio-cultural issues that shaped the current assessment culture of the school? and
- Who are the key decision makers and implementers of assessment reform in schools?
Theoretical Framework
The activity theory was used as a theoretical framework to build a strong assessment culture of participating schools. The activity theory (Engeström, 1987) is based on Vygotsky's (1978) proposition on the primacy of culture rather than individual cognition in mediating action, learning, and meaning-making. In this view, the social interactions of individuals within the community facilitate learning. This view will help explain how teachers’ interactions within the school (i.e., with other teachers, school leaders, students, parents/carers) and at the system level influence their understanding, views, beliefs, perceptions and knowledge about assessment. In addition, the activity theory is useful for understanding how different factors work together to influence various socially and culturally mediated activities to achieve the intended outcomes.
Specifically, the third generation of activity theory was used (Engeström, 2015). This theory describes the six elements and how they interact. These include the subjects (people who are the focused of the study/engaged in activity), roles of the objects (experiences, knowledge and physical products), tools (documents, resources, etc), and community (people or stakeholders), rules (policy, codes, conventions, agreements), division of labour (division of activity amongst participants in the activity). The subjects work as part of the community to achieve the object or the outcome of the activity. Their interactions are guided by the rules and divisions of labour. The quality of the interactions among objects, tools and the community determine the quality of the outcomes. In other words, the tools mediate the relationships between the subject and the object of activity. The ultimate goal is to transform the object into outcomes, and this requires the effective use of tools available in the system.
Method
We used a situational analysis to explore the various elements influencing the school’ assessment culture. Situational analysis is an extension of grounded theory where the analysis is not confined to human action but to a broader situation (Clarke et al., 2017). The situation includes non-human actors, discourses, debates, issues, implicated actors, power relations, among others. The situational analysis provides us a lens to capture the complex and heterogenous nature of building an assessment culture and how the various elements, actors, and factors intersect. The strong adherence of situational analysis to context in analysing the situation, in this study, the assessment culture, resonate the context-dependent nature of assessment. Seven school leaders (principals, deputy principals, department heads) and seven teachers from each participating schools were invited to participate in this study. Focus group interviews were conducted to collect data. The use of focus group is deemed appropriate to the aims of the research and to answer the research questions. This method allowed for participants to interact with each other, discussing their responses, reacting to other participants’ responses, which create a richer discussion, with various perspectives critiqued and examined (Bryman, 2016). The interviews were audio-recorded, and no identifiable information was gathered except for the respective schools of teachers and school leaders. The school label is critically important for school level analysis to ensure that the strategies to be developed and implemented adhere to the context of individual schools and addresses the needs and aspirations of the school community. The interview data were analysed following the six steps outlined by Braun and Clarke (2022). We ensured the credibility of our research through prolonged engagement (the project runs from 2022-2026), rapport building (we built a strong partnership with schools), iterative questioning (the interviewers are skilful), data triangulation (multiple sources of data), member checking (focus group transcripts were sent to the participants to review), and inclusive coding (two researchers will engage in iterative coding). In addition, the dependability of our research was ensured through describing our inclusion criteria of participants. Our co-design with school leaders and teachers ensure that all involved in the process agree to the interpretation of the data and use of the findings. Moreover, we adhered to the conformability of the research by engaging in a reflexive practice to ensure that our beliefs, views, perceptions, knowledge, and skills about assessment will not influence the research process to reach bias-free results.
Expected Outcomes
Initial analysis of the interview transcripts revealed key themes, including aspiration for using assessment (support learning, adopt teaching, evaluation of teaching effectiveness, and meet reporting and accountability requirements); key decision makers and implementers of assessment reform in schools (higher authorities, principal, deputy principals, department heads, teachers, parents, students); non-human elements in enacting assessment reform in school (technology, resources, funding); dominant discourses around assessment hindering or supporting teachers’ assessment practices (e.g., validity and reliability of teachers’ assessment, high-stake tests, rigid curriculum); major issues/debates in schools about the use of assessment (e.g., formative versus summative; accountability versus learning function of assessment); major issues/debates at the system level or wider academic community that impacts school assessment practices (e.g., reliance on national data; using assessment for performance evaluation, labelling of schools based on assessment data, budget cut); temporal elements impacting school assessment practices (curriculum reform, change of school leadership, disruptions, international testing); spatial elements impacting school assessment practices (school location, school type/classification); political/economic issues (budget cut, representation of assessment in national policies, competing advice); and socio-cultural issues (power relations among actors, diversity of students, parental expectations). After the completion of data collection in term 1 2025, we will generate “situational maps”, “relational maps”, “social maps” and “positional maps” that will highlight the internal and external environments of the school, including elements to identify opportunities and challenges for building a strong assessment culture of the five participating schools. We will work closely with school leaders and teachers at each school to co-develop their own theory of change (ToC) to describe and illustrate what and how the desired assessment culture is expected to develop (Reinholz & Andrews, 2020). Using the CHAT as the guiding framework, we will identify the subjects, objects, tools, rules, community, and division of labour necessary to build an assessment culture.
References
Adie, L., Addison, B., & Lingard, B. (2021). Assessment and learning: An in-depth analysis of change in one school’s assessment culture. Oxford Review of Education, 47(3), 404-422. https://doi.org/10.1080/03054985.2020.1850436 Alonzo, D., Labad, V., Bejano, J., & Guerra, F. (2021). The policy-driven dimensions of teacher beliefs about assessment. Australian Journal of Teacher Education, 46(3). https://ro.ecu.edu.au/cgi/viewcontent.cgi?article=4761&context=ajte Alonzo, D., Leverett, J., & Obsioma, E. (2021). Leading an assessment reform: Ensuring a whole-school approach for decision-making [Original Research]. Frontiers in Education, 6(62). https://doi.org/10.3389/feduc.2021.631857 Braun, V., & Clarke, V. (2022). Thematic analysis: A practical guide. Sage. Bryman, A. (2016). Social research methods (4th ed.). Oxford University Press. Christoforidou, M., & Kyriakides, L. (2021). Developing teacher assessment skills: The impact of the dynamic approach to teacher professional development. Studies in Educational Evaluation, 70, 101051. https://doi.org/https://doi.org/10.1016/j.stueduc.2021.101051 Clarke, A. E., Friese, C., & Washburn, R. S. (2017). Situational analysis: Grounded theory after the interpretive turn. SAGE Publications. https://books.google.com.au/books?id=d4ktDwAAQBAJ Davari Torshizi, M., & Bahraman, M. (2019). I explain, therefore I learn: Improving students’ assessment literacy and deep learning by teaching. Studies in Educational Evaluation, 61, 66-73. https://doi.org/https://doi.org/10.1016/j.stueduc.2019.03.002 Davison, C. (2013). Innovation in assessment: Common misconceptions and problems. In K. Hyland & L. Wong (Eds.), Innovation and change in English language education (pp. 263-275). ROutledge. Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach. Engeström, Y. (2015). Learning by expanding: An activity-theoretical approach to development research. Cambridge University Press. Hannigan, C., Alonzo, D., & Oo, C. Z. (2022). Student assessment literacy: indicators and domains from the literature. Assessment in Education: Principles, Policy & Practice, 1-23. https://doi.org/10.1080/0969594X.2022.2121911 Hopfenbeck, T. N., Flórez Petour, M. T., & Tolo, A. (2015). Balancing tensions in educational policy reforms: Large-scale implementation of Assessment for Learning in Norway. Assessment in Education: Principles, Policy & Practice, 22(1), 44-60. https://doi.org/10.1080/0969594X.2014.996524 Prytula, M., Noonan, B., & Hellsten, L. (2013). Toward instructional leadership: Principals' perceptions of large-scale assessment in schools. Canadian Journal of Educational Administration and Policy(140). Reinholz, D. L., & Andrews, T. C. (2020). Change theory and theory of change: what’s the difference anyway? International Journal of STEM Education, 7(1), 2. https://doi.org/10.1186/s40594-020-0202-3 Verhoeven, J. C., & Devos, G. (2005). School assessment policy and practice in Belgian secondary education with specific reference to vocational education and training. Assessment in Education: Principles, Policy & Practice, 12(3), 255-274. https://doi.org/10.1080/09695940500337231 Vygotsky, L. (1978). Mind and society: The development of higher mental processes. Harvard University Press.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.