Session Information
28 SES 11 A, International Organisations and the Rise of a Global Metrological Field
Symposium
Contribution
With the advent of SDG4, the production of globally-comparable learning data has become an institutional priority for the UNESCO Institute for Statistics (UIS). Half of the SDG4 targets relate to learning outcomes and skills, and require the development of internationally-comparable measurements of learning. The transition into the SDGs era represents therefore a critical moment for the UIS – particularly as learning metrics exhibit some particularities that set them apart from the rest of indicators produced by the UIS. Thus, the production of global learning metrics relies necessarily on data suppliers other than statistical offices and national governments – most notably, cross-national assessments, whose rapport with the UIS is much less institutionalized. In addition, the UIS has not approached the production of global learning metrics as a solo endeavour – but has sought the collaboration of a wide range of organizations and experts as a means to secure both the technical validity and the legitimacy of this measurement exercise. The quantification needs brought about by the new agenda have thus tended to reinforce relations of political and technical interdependence among a variety of stakeholders involved in the production and harmonization of learning data. This presentation enquires into such dynamics through a case study on the production of the global indicator corresponding to Target 4.1, relative to the proportion of children achieving a minimum proficiency level in reading and mathematics. The research aims at gaining insight into the mechanics of global quantification, and specifically to understand the transformative impact of such an inherently collaborative project on the agendas and relationships of the partaking organizations. To this end, the study builds on a combination of documentary analysis and 41 semi-structured interviews, and reconstructs the process through which this indicator has been coupled to specific data suppliers, statistical routines and reporting standards over the course of the 2015-2019 period. The results of investigation indicate that the growing centrality of assessment data has been seized by cross-national assessments as an opportunity to consolidate and expand their outreach – a process that inevitably creates issues of rivalry and overlap, sometimes exacerbating decade-long conflicts. The collective nature of this measurement process has also laid bare the fact that multiple (and contradictory) expectations are placed on assessment data. While the UIS has managed to strike a balance between these competing priorities by promoting the merits of fit-for-purpose data, the viability and costs of such a heterodox approach remains to be seen.
References
Gorur, R. (2017). Towards productive critique of large-scale comparisons in education. Critical Studies in Education, 58(3), 341–355. King, K. (2017). Lost in translation? The challenge of translating the global education goal and targets into global indicators. Compare: A Journal of Comparative and International Education, 47(6), 801–817 Lagroye J. (1997) Sociologie politique, Paris: Dalloz-Presses de la FNSP Lascoumes, P., & Le Galès, P. (2004). Gouverner par les instruments. Paris: Presses de la Fondation Nationale des Sciences Politiques. Maroy C. & Pons, X. (2019) Introduction. In C. Maroy & X. Pons (Eds.), Accountability Policies in Education: A Comparative and Multilevel Analysis in France and Quebec, (pp. 1–12). Cham, Switzerland: Springer. Meyer, J. W., Boli, J., Thomas, G. M., & Ramirez, F. O. (1997). World society and the nation-state. American Journal of Sociology, 103(1), 144–181. Ozga, J. (2013). Accountability as a policy technology: Accounting for education performance in Europe. International Review of Administrative Sciences, 79(2), 292–309. Porter, T. M. (1996). Trust in Numbers: The Pursuit of Objectivity in Science and Public Life. Princeton, NJ: Princeton University Press.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.