WS F - ICCS 2022 – How to Analyze Secondary Students’ Civic Knowledge and Attitudes Towards Democracy

• Booking Name: Tuesday Morning Workshop F
• Time: 9:30 - 11:45
• Facilitators: Ana Maria Mejia-Rodríguez and Sabine Meinck

The primary objective of this workshop is to explore how data from international assessments can be used for research regarding outcomes and contexts of civic and citizenship education. The workshop will put emphasis on how data from studies conducted by the IEA (International Association for the Evaluation of Educational Achievement) could provide further insights for policy and practice.

As a leading organization in the field of educational research for more than 60 years, the IEA promotes capacity building and knowledge sharing to facilitate innovation and foster quality in education. IEA studies approach the reality of educational learning outcomes in all its complexity by collecting a huge variety of background information that can be related to students’ achievement, knowledge, and attitudes.

This course will introduce participants to the IEA International Civic and Citizenship Education Study (ICCS) 2022. The ICCS 2022 database was published in February 2024 and provides a fresh and rich source for secondary research of outcomes related to civic and citizenship education (CCE) across the world, and in particular in Europe with more than 20 European countries and education systems participating. ICCS 2022 is the 3rd cycle of IEA’s study on CCE, following the administrations in 2009 and 2016.

The course will include an overview of ICCS, covering its background, conceptual framework and design. It will present some key findings from the 2022 data collection. Participants will be introduced to the survey instruments and database, and be provided with access paths to data sources, technical documentation, analysis guides and software tools. There will also be a presentation about available variables such as students’ civic knowledge, their attitudes towards civic principles and democratic values, characteristics of teachers of that student cohort, and class- and school-level learning contexts.

With this information, participants will formulate and discuss research questions that can be addressed with ICCS 2022 data. The instructors will be available to mentor the development of research ideas and design as well as to answer data related and technical questions. Research questions from individual attendants will be presented to all participants in order to provide opportunities to share ideas.

No prior knowledge about large-scale international studies is required. Basic knowledge about statistical analysis is not required but is an advantage.

Draft Agenda:

9:30-9:40 Introduction (10 mins)

• Introduction of participants and their research interests
• IEA – mission, studies, topics, audiences

9:40-9:50 ICCS (10 mins)

• Main research focus, framework
• ICCS 2022 Highlighted results
• Instruments, outcome variables and scales
• Access and availability of data files, technical documentation, analysis guides and software tools

9:50-10:30 Group work (40 mins)

• Participants will form working groups
• Each group will receive selected questionnaire materials and information on the corresponding variables (e.g., perceptions and background) of ICCS 2022
• Participants will develop their own research questions that could be answered with the information collected in ICCS 2022
• Each group presents one or two research questions and gets feedback from facilitators and audience

10:30-10:40 Example Analysis (10 mins)

• Live demo of analysis of example research questions
• Discussion of analysis and results

10:40-11:40 Group work (60 mins)

• Participants practice analyzing the ICCS data with support by the facilitators
• A few participants could present their analysis, which will be discussed with audience and facilitators

11:40-11:45 Summary & closing (5 mins)

• Questions, summary & conclusions
• Invitation to advanced data analysis seminars and initiation of collaborative work

References:

• Afana, Y., Brese, F., Kowolik, H., Cortes, D., & Schulz, W. (forthcoming). ICCS 2022 user guide for the international database. International Association for the Evaluation of Educational Achievement (IEA).
• Schulz, W., Ainley, J., Fraillon, J., Losito, B., Agrusti, G., Damiani, V., & Friedman, T. (2024). Education for Citizenship in Times of Global Challenge. The International Civic and Citizenship Education Study 2022 International Report. Cham: Springer.
• Schulz, W., Fraillon, J., Losito, B., Agrusti, G., Ainley, J., Damiani, V., & Friedman, T. (2023). IEA International Civic and Citizenship Education Study 2022 assessment framework. Springer. https://doi.org/10.1007/978-3-031-20113-4
• Schulz, W., Friedman, T., Fraillon, J., & Losito, B. (forthcoming). ICCS 2022 technical report. International Association for the Evaluation of Educational Achievement (IEA).

Requirements - IMPORTANT:

• Participants should bring a laptop.
• Facilitators will hand out USB sticks with published ICCS material (assessment framework, questionnaires) that can be used during the group work.
• Participants who would like to practice analysis should
• Download and install the IEA IDB Analyzer (https://www.iea.nl/data-tools/)
  • Have either SPSS, SAS, or R installed on their laptop prior to the workshop
  • Bring the ICCS 2022 international database on their laptops (https://iea.nl/index.php/data-tools/repository/iccs)

• You are only eligible to attend this workshop if you are registered as participant of ECER.
• Please do NOT register for more than one workshop. We will cancel double bookings.
• Should you not be able to attend, please cancel your reservation, as there might be a waiting list.