Session Information
23 SES 12 A, International large-scale assessments
Paper Session
Contribution
In December 2024, the Israeli Ministry of Education released the national results of the 2023 TIMSS international assessment, which highlighted a significant decline in students’ performance compared to prior years. Israeli students ranked 23rd in mathematics and 25th in science, reflecting drops of 60 and 36 percentage points, respectively, compared to the 2019 assessment. These results have reignited a longstanding debate regarding Israel’s educational evaluation policy.
Israel joined the global movement of international assessments in 2003. As noted by policy researchers, this movement embodies international expectations for standardizing educational systems (Camphuijsen, 2020; Feniger, 2018; Jude, Teltemann, Parcerisa, Fontdevila, & Verger, 2021; Verger, Parcerisa, & Clara, 2019). These assessments aim to guide education systems in cultivating the "ideal learner," equipping students with the skills required to meet 21st-century challenges. Consequently, education has become a focal point for external stakeholders, such as the business sector, whose influence often aligns with policymaker priorities and shapes evaluation policies (Lingard, Martino, & Rezai-Rashti, 2013). Lingard and colleagues (2013) have identified these trends as reflecting the values and principles of New Public Management (NPM), which emphasize accountability and global benchmarking. These external interventions underscore the growing expectation for education systems to adopt standardized metrics of performance.
The disappointing results in the 2023 TIMSS assessment have further exposed deep divisions within Israeli evaluation policy. Since 2003, persistent dissatisfaction with student performance in international assessments has spurred reforms aimed at increasing accountability through external evaluations and aligning curricula with occupational skill demands. A significant outcome of these efforts was the establishment of the National Evaluation and Measurement Authority (NEMA), tasked with developing external and internal evaluation methodologies. However, the volatile political and educational landscape in Israel has given rise to competing stakeholders and ideologies, complicating policy implementation.
This research seeks to explore the impact of NPM principles on Israeli educational policy by examining how these values shape evaluation frameworks and stakeholder expectations. Using qualitative methods, the study incorporates an analysis of formal policy documents, such as legislation and government records, alongside informal materials, including professional reports and meeting protocols. Interviews with policymakers and political leaders provide further insights into the dynamics of policy design and enactment.
The qualitative thematic analysis applies Bacchi’s "What’s the Problem Represents" (WPR) methodology, rooted in Foucau's critical theory (Bacchi & Goodwin, 2016; Bacchi, 2020). This approach identifies how policy problems are constructed and represented, illuminating the roles of bureaucracy, external stakeholders, and excluded actors in shaping the discourse
Method
The qualitative research aims to understand the influence of the NPM on the educational evaluation policy. Gibton (2015), recommended using content analysis to understand the motivations and powers involved in shaping policies. Therefore, the study included extensive analysis of formal policy documents, such as legislation and governmental registers. As well as informal policy documents such as press interviews, protocols, and unofficial professional reports. Moreover, the research included 15 in-depth interviews with politicians and other high-level policy-makers in the Israeli education system. Based on Carol Bacchi’s critical methodology, the qualitative thematic analysis is based on Foucault's critical approach (Bacchi & Goodwin, 2016; Bacchi, 2020). Bacchi's methodology identifies the problems and solutions implemented by the policy. The methodology, What the Problem Represented? (WPR) highlights "problems" and their representation in the public domain. This encapsulates the influence of bureaucracy and the relationship among external stakeholders. Furthermore, Bacchi recommended considering the blind spots of the policy by highlighting those who do not take part in framing the policy and its legalities. The WPR's innovative methodology uses structured questions to identify "problems" and their representation and those involved in policy design. Those questions also refer to the policy's implementation and publicity. The WPR questions highlight exclusive actors and obstacles to the policy and its implementation. The research procedures included collecting documents from formal sites and the official Israeli archive. Some of the stakeholders delivered informal documents as well as official reports. After reviewing more than 200 documents relevant to the subject of the evaluation policy, we limited the data to 60 documents only. The in-depth interviews with stakeholders (politicians, ministers, management level in the education system, and professionals) took place mostly via the Zoom platform or by phone. The interviews were recorded, but the information and citations were kept confidential. The analysis included questioning both documents and interview protocols based on WPR methodology indicators: (1) description of the problem and its representation; (2) those who were involved in the policy and identifying the problem; (3) the implementation of the policy; and (4) those who were exclusive from the policy and the policy barriers.
Expected Outcomes
The findings reveal that the poor performance of Israeli students in international assessments has been framed as a macro-level problem, leading to the development of evaluation policies centered on external assessments to enhance accountability and curricular alignment. However, an alternative perspective advocates for the use of diverse internal evaluation tools to address pedagogical needs and support the learning process. Despite their ideological differences, both approaches share a common goal of improving academic achievement and preparing students for contemporary challenges. Nevertheless, a pervasive lack of trust in the education system and structural instability has fostered a pendulum-like policy environment, oscillating between external accountability measures and internal pedagogical improvement strategies. This study highlights the need for a reconciliatory approach that integrates the strengths of both paradigms to achieve a cohesive and adaptive evaluation policy capable of addressing the multifaceted demands of modern education. This research contributes to the discourse on education policy by highlighting the intersection of global influences and local challenges in shaping Israel’s evaluation framework. By addressing the limitations of relying solely on external or internal evaluations, it advocates for a balanced approach that integrates accountability with pedagogical relevance. These insights provide a pathway for reimagining education policy to support meaningful learning outcomes, adaptability, and alignment with contemporary educational goals.
References
Bacchi, C. (2020, July). Policy as Discourse: What does it mean? Where does it get us? Discourse: Studies in the Cultural Politics of Education, 21(1), 45-57. Retrieved Augost 2023, from https://doi.org/10.1080/01596300050005493 Bacchi, C., & Goodwin, S. (2016). Poststrudtual Policy Analyses. New York: Palgarve pivot Camphuijsen, M. (2020). From Trust in the Profession to Trust in Results: A Multi-Level Analysis of Performance-Based Accountability in Norwegian Education. Barcelona: Department of Sociology The Autonomous University of Barcelona. Feniger, Y. (2018). Evidence-based decision making or a tunnel vision effect? TIMSS, problem definition and policy change in Israeli mathematics education. Critical Studies in Education(Volume 61, 2020 - Issue 3), 363-379. Retrieved February 2022, from https://www.tandfonline.com/doi/full/10.1080/17508487.2018.1448877?scroll=top&needAccess=true Jude, N., Teltemann, J., Parcerisa, L., Fontdevila, C., & Verger, A. (2021). Understanding the PISA Influence on National Education Policies: A Focus on Policy Transfer Mechanisms. In A. Wilmers, & J. Sieglinde , International Perspectives on School Settings, Education Policy and Digital Strategies (pp. 182-194). Toronto: Verlag Barbara Budrich. Verger, A., Parcerisa, L., & Clara , F. (2019). The growth and spread of large-scale assessments and test-based accountabilities: a political sociology of global education reforms. Educational Review, 71(1), 5-30. Retrieved April 2024, from https://doi.org/10.1080/00131911.2019.1522045 Lingard, B., Martino, W., & Rezai-Rashti, G. (2013). Testing regimes, accountabilities and education policy: commensurate global and national developments. Journal of Education Policy, 539-556. Retrieved February 2022, from https://www.tandfonline.com/doi/abs/10.1080/02680939.2013.820042 .
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.