PISA in public debate: the case of Portugal
Conference:
ECER 2015
Format:
Paper

Session Information

23 SES 09 B, The Impact of PISA on National Education Policies

Paper Session

Time:
2015-09-10
11:00-12:30
Room:
418.Oktatóterem [C]
Chair:
Ulrike Hohmann

Contribution

The Programme for International Student Assessment (PISA) is an international instrument, a comparative evaluation, which takes place every three years under the auspices of The Organisation for Economic Cooperation and Development (OECD), in collaboration with a growing number of associated countries, considering the performance of more than one million students (Turner, 2006: 46; OECD 2007a; 6). Aiming to provide indicators on the effectiveness of education systems, PISA measures the knowledge and competencies of 15 years old students in mathematics, science and reading literacy. Launched in 1997, the first cycle occurred in 2000, and continued in 2003, 2006, 2009 and 2012. Future surveys beyond 2015 are expected, as attested in the PISA Governing Body of (PGB) held in Seoul in October 2013 (OECD / EDU, 2013), where new proposals for specific areas to be evaluated were discussed (OECD/EDU, 2013b).

This study derives from a broader European research of PISA reception (Afonso & Costa, 2009; Bajomi et al, 2009; Cattonar et al, 2009; Grek, Lawn, & Ozga, 2009; Mons & Pons, 2009; Rostás et al, 2009). Herein considered a regulatory knowledge instrument (see Carvalho, 2009, 2012), PISA is seen as a point of reference for international monitoring of education systems (OECD, 2007b, p.1 and 17; cf. Carvalho & Costa, 2011), being characterized by its policy direction, and enabling governments to extract political lessons from its reports (Carvalho, Afonso & Costa, 2009).

Portugal has not escaped from PISA’s authority. PISA data, made available across the world, reinforces the argumentative capacity of actors in the public debate and of governments’ decision-making processes: between 2001 and 2007, there were 11 policies that Portuguese governments justify with the PISA reports (Afonso & Costa, 2011).  Therefore, the presentation is focused on PISA as a regulatory instrument that seeks to influence policy makers through the dissemination of best practices. We analyse the debate held by politicians and other actors involved in the Portuguese public action, during the first three PISA cycles (2000-2006), and we make an incursion at the way the debate has evolved in recent surveys (PISA 2009, 2012). To achieve this, we studied the set of voices attracted by PISA. Thus, we’ve been focused on the actors’ speeches that seek to influence decision-making processes, by means of influence and pressure, by putting on the political agenda, specific themes, and requesting several solutions to the problems identified: MPs, journalists, teachers, trade unionists, researchers, and bloggers.

Therefore, PISA is here examined as a public action instrument, "which aims to support and participate in the coordination work of public action in education" (Carvalho, 2009: 1010), being supported by a soft regulation conception (Carvalho, 2012; Costa, 2011).

Conceptually, we rely on the Sociology of Public Action, in which public policies are understood as a collective action (Lascoumes & Le Galès, 2012), a "continuous flow of decisions" (Muller, 2004), resulting from a process involving multiple actors, collective and individual, and not only the State and formal authorities. It is this idea that there are other actors with relevant participation in the policy-making process that matters here and that justifies the relevance of observing the public debate around PISA, and the arguments used to justify its use in the decision making processes. The approach allows us to analyse the new modes of regulation, by capturing the multiplicity of regulatory processes, which are increasingly complex and multidimensional processes (Barroso, 2006).

Method

The documental corpus includes a daily newspaper (Public Journal) and weekly newspaper (Express), the online specialized press in education (Educare, Education page), as well as a social movement website (Freedom & Education Forum), teachers' federations (Fenprof Fne) websites, and the blogosphere. Moreover, the analysis has focused on legislation and on Parliamentary Debates (DAR).

Expected Outcomes

Results show that the discursive rhetoric around PISA, which is used in public debate, does not seem to be reflected in an effort of knowledge appropriation. The way mass media present PISA and its results is simplified and condensed in texts that are merely focused on the place the country occupies on the 'ranking' and to the basic information conveyed when reports are launched. Nevertheless, the debate is lively and inflamed with regard to accountability. Concerning the content of the public debate, it is focused on literacy, the education system, teachers, and sociocultural and economic conditions of students, autonomy and school management and the State inefficiency. As for the characteristics that contribute to the importance of the PISA debate in public action, they are: the discursive ambivalence, the rhetoric of modernization and the logic of comparability. Scientific debate and the criticism of the Programme are dim. Moreover, the PISA credibility takes place in the context of public action, that is to say, through the credibility assigned to it by public action, where it is invoked and convoked, and naturalized as credible. Also, the symbolic importance of data and of the rationality of numbers in political processes are stressed. In fact, more than a scientific and rational solution actors in public action use the credibility of the instrument for the benefit of the ideas and policies they want to implement. Moreover, the debate is dynamic, although not very deep, and legitimizes contradictory argumentations. Allowing Individuals to introduce topics on the public schedule that reflects their own agendas and pre-existing arguments, contributing to the creation of an atmosphere of collective scrutiny and political tension.

References

AFONSO, N., & COSTA, E. (2009). A influência do PISA na decisão política em Portugal: o caso das políticas educativas do XVII Governo Constitucional Português. Sísifo. Revista de Ciências da Educação, 10, 53-64. AFONSO,N, & COSTA, E. (2011). A circulação e o uso do PISA em Portugal: o que dizem os políticos. In: CARVALHO L.M. (Org.). O Espelho do Perito. Inquéritos internacionais, conhecimento e política em educação- o caso do PISA. VLG:FML, 107-125. BAJOMI, I. et al. (2009). The Reception of PISA in Hungary. Project KNOWandPOL. BARROSO, J. (Org.). (2006). A Regulação das políticas públicas de educação: espaços, dinâmicas e actores. Lisboa: Educa. CARVALHO, LM. (2009). Governando a educação pelo espelho do perito: uma análise do PISA como instrumento de regulação. Educação e Sociedade, 30, 109, 1009-1036. Disponível em: http://www.cedes.unicamp.br. CARVALHO, LM. (2012). The Fabrications and Travels of a Knowledge-Policy Instrument European Educational Research Journal, 11, 2. CARVALHO, L.M., & COSTA, E. (2011). Fabricando o Espelho do Perito: a construção de conhecimento pericial no mundo PISA. In: CARVALHO L.M. (Org.). O Espelho do Perito: Inquéritos internacionais, conhecimento e política em educação – o caso do PISA. VNG: FML, 41-62. CARVALHO, L.M., AFONSO, N., & COSTA, E. (2009). PISA - Fabrication, circulation and use in 6 European Countries. KNOWandPOL. CATTONAR, B. et al. (2009). Usage et Circulation des enquêtes PISA en Communauté française de Belgique. KNOWandPOL. COSTA, E. (2011). O Programme for International Student Assessment (PISA) como instrumento de regulação das políticas educativas, Ph.D. Thesis – IEUL, Lx. GREK, S., LAWN, M., & OZGA, J. (2009). Study on the Use and Circulation of PISA in Scotland. KNOWandPOL. MONS, N., & PONS, X. (2009). The reception of PISA in France. Knowledge and Regulation of the Educational System. KNOWandPOL. LASCOUMES, P. & LE GALES, P. (2012). Sociologie de l'action publique. Armand Colin. MULLER, P. (2004). Les Politiques Publiques. Paris: PUF. OECD (2007a). PISA – The OECD Programme for International Student assessment, 2007a. Available at: http://www.pisa.oecd.org/dataoecd/51/27/37474503.pdf. OECD (2007b). PISA 2006. Sciences Competencies for Tomorrows World. Paris: OECD. OECD/EDU/PISA/GB (2013)14. (2013). Beyond PISA 2015: a longer-term strategy of PISA 36th meeting of the PGB. ROSTÁS, Z. et al. (2009) Use and Circulation of PISA in a Romanian Contex. KNOWandPOL. TURNER, R. (2006). El Programa Internacional para la Evaluación de los Alumnos (PISA). Una perspectiva general. Revista de Educación, extraordinario, 45-74.

Author Information

Estela Costa (presenting / submitting)
Instituto de Educação, Universidade de Lisboa, Portugal
Instituto de Educação, Universidade de Lisboa, Portugal
Instituto de Educação, Universidade de Lisboa, Portugal
Instituto de Educação, Universidade de Lisboa, Portugal

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.