Session Information
23 SES 12 A, International large-scale assessments
Paper Session
Contribution
The United Arab Emirates (UAE) participates in the Programme for International Student Assessment (PISA) as part of a long-term strategy, starting with Vision 2021 and continuing with the recently announced UAE Centennial Plan 2071. These strategies set priorities of excellent education, a future-focused government, a diversified knowledge economy, and a happy and cohesive society (UAE, 2024). In the UAE, PISA participation is advocated for in government documents as creating “a complete transformation of the current education system” (UAE Ministry of Education, 2018). The UAE has consistently ranked low, and for the 2022 test, the UAE was ranked in the bottom half of the 81 participating countries for mathematics (43rd), reading (48th), and science (47th), with scores labeled significantly below the Organization for Economic Cooperation and Development (OECD) average for each section (OECD, 2023b). The Ministry of Education’s involvement in PISA has gone beyond understanding the students and is more aimed toward engaging with extensive global comparisons based on rankings with specific goals of rising in the PISA rankings. The UAE has invested heavily in PISA as the government enabled 24,600 students to participate in the 2022 PISA sample (OECD, 2023a).
The OECD publishes educational research based on the results of PISA, thereby continually increasing the visibility, scope, scale, and explanatory power of the assessment (Sellar & Lingard, 2014). This research tends to be secondary data analysis, technical analyses critiquing the constructs or bias, and impact or policy studies examining the influence of PISA on governance, policy borrowing, and accountability structures (Hopfenbeck et al., 2018). This study fits within that third category, analyzing the PISA results and connecting them with implications of relying on PISA for knowledge and policy guidance (Grek, 2010) also informed by comparative policy analysis using systems theory to understand policy borrowing influenced by Steiner-Khamsi (2014, 2004).
PISA demonstrates a culture of comparison that is intentionally disconnected from local policy, local context, and the idiosyncrasies of a particular place. Previous research has shown this to be problematic. The findings from PISA have created a constant stream of information about countries and education, primarily through comparison (Gulson et al., 2017). Significant research has found that context matters so much that global comparative quantitative research is rarely sufficient for solving local education problems (Crossley, 2014). In the UAE, Matsumoto (2019) has described the cultural mismatch that occurs as the UAE attempts to borrow education policy approaches from other countries. While the UAE and other Middle Eastern countries examine comparisons and draw conclusions about their schools, there is little explanation of the comparative data or guidance about the next steps for schools (Morgan, 2018).The UAE has specifically looked to Europe and the West to borrow education policy, even as they struggle to reconcile differences in values and loss of their own culture (Romanowski et al, 2018).
The PISA results compare every participating country on each part of the test, most often as a ranking. Various computed indices are compared in the results, and countries that do not fit the patterns are described in the accompanying text. This research was conducted by analyzing each mention of the UAE in the four main results documents for PISA 2022 to understand how the UAE is portrayed and the contextual information provided about the country. Critical thematic analysis (Braun & Clarke, 2017) revealed the uniqueness of UAE schools, students, and PISA results.
Method
The methods for this research were document analysis and analysis of my observations during the PISA Announcement of Results event for the UAE in December 2023. The four documents analyzed were PISA 2022 Results Volume I: The State of Learning and Equity in Education (OECD, 2023b), PISA 2022 Results Volume II: Learning During – and From – Disruption (OECD, 2023c), the UAE-specific document PISA 2022 Results: Factsheets-United Arab Emirates (OECD, 2023a), and PISA 2022: Insights and interpretations (Schleicher, 2023). A critical thematic analysis was conducted (Braun & Clarke, 2012) to develop themes based on how the documents portrayed the UAE. Every mention of the UAE in the documents was recorded to understand the UAE results and context. Excluded from the analysis were repeated mentions of the same information, tables or charts that included the data for all participating countries, methodology footnotes, and lists of many example countries without any other information. Retained in the analysis were instances when the UAE was mentioned alone or with a few other countries as a unique case to explain differences between a country and the results of others or to exemplify a pattern. After the exclusions, 70 mentions of the UAE were retained. Each mention of the UAE was paraphrased for the content of the mention, and the number of countries listed was noted. From these paraphrases emerged the sub-themes: school admissions, parents, student behavior, teachers, technology use, private schools, quality assurance, questionnaire sleepers, school autonomy, and performance gaps due to a gender gap, immigrant student gap, public vs. private schools, or socioeconomic status (SES). The main themes of results, school characteristics, and student characteristics emerged from these sub-themes. The mentions tend to demonstrate when the UAE differed notably from a trend, was unique compared to other countries, or was among the most notable participating countries.
Expected Outcomes
Comparison is a prominent feature of PISA results data. The effect of this comparison has been described by many, including Sellar et al. (2017), as promoting a “global education race” through comparison and rankings. Considering the uniqueness of the UAE, the results potentially undermine the usefulness of PISA data, especially as it is presented primarily through comparisons. Generally, a country was mentioned in the results document to describe when it exemplified a trend or demonstrated something comparatively different from most countries. The UAE was often mentioned— comparably more than any other country—with clear indications of the UAE’s remarkable uniqueness. When data was presented in areas the UAE could hope to improve, it was often accompanied by an explanation about an idiosyncrasy of the UAE, indicating that what works in other countries would likely not apply. The uniqueness of the UAE makes PISA results of little use to future education policy decisions. Attempts to engage in policy borrowing, especially in an attempt to improve PISA scores, seem likely to fail. While the current discourse indicates that the UAE Ministry of Education intends to intensify its efforts to improve PISA scores, this includes consequences for teachers in the country, as noted by Morgan (2018). By continuing to rely on PISA to define education, policy options may be constrained while ignoring the UAE's uniqueness. This has the effect of potentially discarding policy options and reforms that could genuinely make a difference for the specific needs of the country, its students, and the country’s ambitions for the future. While the OECD originated as a primarily European collaboration based on economic progress for democratic countries, this has expanded to include countries like the UAE that aim to fit into comparisons like PISA, with goals of being seen as a major player in the world.
References
Braun, V., & Clarke, V. (2017). Thematic analysis. In C. Willig & W. Stainton Rogers (Eds.), The SAGE Handbook of Qualitative Research in Psychology (2nd ed.). SAGE Publications Inc. Crossley, M. (2014). Global league tables, big data and the international transfer of educational research modalities. Comparative Education, 50(1), 15–26. https://doi.org/10.1080/03050068.2013.871438 Gulson, K. N., Lewis, S., Lingard, B., Lubienski, C., Takayama, K., & Webb, P. T. (2017). Policy mobilities and methodology: A proposition for inventive methods in education policy studies. Critical Studies in Education, 58(2), 224–241. https://doi.org/10.1080/17508487.2017.1288150 Grek, S. (2010). International organisations and the shared construction of policy ‘problems’: Problematisation and change in education governance in Europe. European Educational Research Journal, 9(3), 396–406. https://doi.org/10.2304/eerj.2010.9.3.396 Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. https://doi.org/10.1080/00313831.2016.1258726 Matsumoto, A. (2019). Literature review on education reform in the UAE. International Journal of Educational Reform, 28(1), 4–23. https://doi.org/10.1177/1056787918824188 Morgan, C. (2018). The spectacle of global tests in the Arabian Gulf: A comparison of Qatar and the United Arab Emirates. Comparative Education, 54(3), 285–308. https://doi.org/10.1080/03050068.2017.1348018 OECD. (2023a). PISA 2022 Results: Factsheets-United Arab Emirates. OECD Publishing. https://www.oecd.org/publication/pisa-2022-results/webbooks/dynamic/pisa-country-notes/74e92cf9/pdf/united-arab-emirates.pdf OECD. (2023b). PISA 2022 results volume I: The state of learning and equity in education. Paris: PISA, OECD Publishing. https://doi.org/10.1787/53f23881-en OECD. (2023c). PISA 2022 results volume II: Learning during – and from – disruption. Paris: OECD Publishing. https://doi.org/10.1787/a97db61c-en Romanowski, M. H., Alkhateeb, H., & Nasser, R. (2018). Policy borrowing in the gulf cooperation council countries: Cultural scripts and epistemological conflicts. International Journal of Educational Development, 60, 19–24. https://doi.org/10.1016/j.ijedudev.2017.10.021 Schleicher, A. (2023). PISA 2022: Insights and interpretations. OECD Publishing. https://www.oecd.org/pisa/PISA%202022%20Insights%20and%20Interpretations.pdf Sellar, S., & Lingard, B. (2017). The OECD and global governance in education. In B. Lingard, G. Rezai-Rashti, & W. Martino (Eds.), Testing regimes, accountabilities and education policy (0 ed.). Routledge. https://doi.org/10.4324/9781315666082 Steiner-Khamsi, G. (Ed.). (2004). The global politics of educational borrowing and lending (Repr.). Teachers College Press. Steiner-Khamsi, G. (2014). Cross-national policy borrowing: Understanding reception and translation. Asia Pacific Journal of Education, 34(2), 153–167. https://doi.org/10.1080/02188791.2013.875649 UAE. (2024). UAE Centennial 2017. About the UAE. https://u.ae/en/about-the-uae/strategies-initiatives-and-awards/strategies-plans-and-visions/innovation-and-future-shaping/uae-centennial-2071 UAE Ministry of Education. (2018). National and international assessments. https://www.moe.gov.ae/En/ImportantLinks/InternationalAssessments/Pages/International-Assessments.aspx
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.