Session Information
32 SES 14 A, Charting Toward Organizational Democracies - Methodological Strategies for Comparative Analysis in PAR PART 3
Symposium
Contribution
Assessment of democratic competencies can include many different approaches. In the Horizon Democrat project, a new competence model for responsible democratic citizenship was developed, focusing on four key competencies: participation, deliberation, judgment and critical thinking, and democratic resilience (Toscano et al, 2023). Based on that, an assessment and evaluation model (strategy and tools) was co-created in a Living Lab setting (Schuurmann, 2015) and adapted in various contexts, offering more profound insight into usefulness and effectiveness, aiming to identify the more promising strategies and tools to be adopted in a broader scale. In the initial development phase of the assessment model and tools, we drew from the logic of the newly created Democrat model, Bloom’s and SOLO taxonomies (İlhan & Gezer, 2017), and the reference framework of competences for democratic culture (Council of Europe, 2021). The model included first developing more elaborate descriptors for the four competence areas. These descriptors differentiated into four levels: minimal, basic, intermediate, and advanced. Various instruments were also created, such as an assessment table for teachers/practitioners and student self-assessment forms. These were combined with evaluation strategies such as research diaries and focus groups. The national teams were then instructed to adapt this model and the instruments within the national living lab settings based on contextual needs, such as the age of participants, types of interventions, preferences of practitioners, etc. but keeping the overall logic of the assessment, including the four competence areas and four levels. In this presentation, we will focus on how such a co-creative approach worked (drawing from the Deweyan perspective of democracy as practice and the participatory action research logic within a living lab setting) for developing an assessment model and instruments, e.g. whether the way it was set up allowed for sufficient co-development, how the practitioners and national teams adapted the model and tools, how much collaboration there was in and between organizations etc. The insights are based on the written material and artifacts gathered, notes from meetings, workshops, and one-to-one communication, and interviews with teams of the Democrat National Living Lab. Learning is linked to knowledge from previous research on co-creation, research-practice partnerships, and the knowledge appropriation model (Ley et al., 2022) as well as research on the assessment of citizenship competencies (e.g. Daas, 2019; Daas et al., 2023; Waatainen & Chu, 2024).
References
Council of Europe (2021). Assessing competences for democratic culture: principles, methods, examples. Retrieved from here. Daas, R. (2019). Assessment of citizenship competences Retrieved from: https://core.ac.uk/download/pdf/489769283.pdf Daas, R., Dijkstra, A. B., Karsten, S., & ten Dam, G. (2023). An open-ended approach to evaluating students’ citizenship competences, 17461979231186028. Dewey, J. (1916 / 1997). Democracy and education, Free Press. Dewey, J. (1933). How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process. D.C. Heath and Company. İlhan, M., & Gezer, M. (2017). A comparison of the reliability of the Solo-and revised Bloom's Taxonomy-based classifications in the analysis of the cognitive levels of assessment questions. Pegem Journal of Education and Instruction, 7(4), 637. Ley, T., Tammets, K., Sarmiento-Márquez, E. M., Leoste, J., Hallik, M., & Poom-Valickis, K. (2022). Adopting technology in schools: European Journal of Teacher Education, 45(4), 548-571. Schuurman, D., De Marez, L., & Ballon, P. (2015). Living Labs: a systematic literature review. Open Living Lab Days 2015. Toscano, B. V., Toscano; Kalev, L.; Kostakos, G.; Krueger, K. (2023). Conceptual Framework and Vision: https://democrat-horizon.eu/deliverables/ Waatainen, P. J., & Chu, M. W. (2024). A Situated Lens to Designing Assessments of Citizenship Competency. Democracy and Education, 32(2), 2. Westheimer, J. (2015). What Kind of Citizen? New York; London: Teachers College Press.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.