Session Information
23 SES 11 C, Political analyses of policy and quality assessment
Paper Session
Contribution
I have an Ivy League education, smart guy, good genes. I have great genes and all that stuff, which I’m a believer in.
Donald Trump, 2016
Education policy is often presented as though it should be above politics - neutral and benign (Broadfoot, 2021). But policy decisions are always political (Whitty, 2002), constructed at particular moments, with historical, cultural, institutional and political events shaping them. As such, the dynamics differ considerably across countries. Policies are created by people, whose purposes and positions vary. Although a great deal of work has been conducted on the sociology of education policy, the underlying, personal beliefs and values of policy actors and whether these cohere into logics that link with specific assessment policy choices has not been researched.
Beliefs regarding the purpose of education may underpin policy preferences and the perceived utility of certain assessment technologies. For some, assessment primarily serves a selection function, which will tend to social reproduction because of the educational advantages afforded to the privileged (Sirin, 2005). IQ-ists interpret social reproduction as a product mainly of genetics (Smith-Woolley et al., 2018), with implications for educational investment and the kinds of assessments required. For example, it has been argued that children should be segregated into vocational or academic education at an early age (Terman, 1919, p92) and that policies aimed at reducing the attainment gap are wasteful and unfair channelling of funds from the genetically advantaged (Hernstein, 1971).
Research on policy documents does not unveil the intricacies of these belief systems, especially as they present a ‘front stage’ rather than the ‘backstage’ of people’s presentation (Goffman, 1993 cited by Serpa & Ferreira, 2018). Policy environments represent interactions between actors with different beliefs and agendas and with different primary stakeholder audiences in mind. Transparency regarding these beliefs and their connection with policy may not be readily apparent, since actors understand they may not be palatable (see Gillborn et al., 2022, for obfuscations in the English policy context). For these reasons, we approached this research using in-depth interviews with policy elites as a first stage.
We focus on educational assessment policy in England as a specific case, as assessment has a widely recognised impact on distribution of opportunities in society. Whilst the UK parliament has overarching responsibilities across the United Kingdom, there are delegated responsibilities for education in the devolved governments of Scotland, Wales and Northern Ireland. The contexts differ in each constituency. Unusually, England has a regulated market for educational assessment, with an accompanying neoliberal hegemony.
Assessment policy in England has been frenetic this century under successive governments, associated with changes of Minister (13) as well as political party (4) in power. Although we might anticipate alignment of political values (eg left-right wing) with policies (eg progressive-traditional), this is not always observed. It is possible that all parties in power have been captured by neoliberal hegemony. Additionally, a policy may be justified utilising different political rationales.
Policies associated with previous governments in England are often undone by the next regime, only to be reinvented in similar form. The literature has depicted the cyclical and nugatory nature of reform as driven by weak policy memory. This neglects the political and value-driven nature of reform. Beliefs regarding the purpose of education underpin policy preferences and the perceived utility of certain assessment technologies. Policy analysis research has theorised how assessment policies internationally have common features which align with drivers of social justice, engagement and inclusion, or with a neoliberal emphasis on the economy, meritocracy, standardisation, excellence and accountability. This research investigates the impact of powerful individuals’ political ideologies on their assessment policy preferences.
Method
At the time of submission, data collection is on-going. Between 25 and 30 interviews with political and policy elites will be conducted. Interviewees will be from across the political spectrum, including politicians and special advisors (such as Ministers and parliamentary Select Committee Members), senior civil servants responsible for delivering assessment policy (including Chief Regulators and Chief Inspectors of Schools), key influencers of assessment policy (special advisers to Ministers, think tank heads), senior teacher leaders (heads of unions and school chain leaders) and those responsible for delivering qualifications (exam board CEOs). Interviews will explore participants’ political beliefs, ideas about meritocracy, social values and their assessment policy preferences. Interviewees will be named, enabling the data to be explored in the context of their roles and publicly stated positions. The interview schedule is lightly structured, to allow the researchers to be responsive to the interviewees’ roles and sphere of policy influence (Bowe, Ball and Gold, 1992). A thematic analysis will be conducted, in which shared patterns of meaning will be sought across the data. The initial coding framework will be guided by the data and the research literature in combination. The sociological and policy literature has connected ideological, populist, neoliberal and meritocratic approaches with educational assessment policy preferences. For example, the association of neoliberalism and beliefs about meritocracy with standardised testing (e.g., Grek et al., 2009; Santori, 2023), and elsewhere, the move to more flexible forms of assessment in the pursuit of more progressive socially just policies (e.g., Randall et al., 2022). The literature has also documented assessment beliefs centred on the genetically determined and fixed nature of intelligence (IQ-ism), which have been associated with neoliberal and populist views (Winston, 2018). The coding framework will be initially applied to the data from two interviews, then reviewed and adjusted as appropriate. Two researchers will be involved in this phase of analysis. All data will then be analysed by one researcher with an inter-coder check of a quarter of the interviews. Inter-coder reliability will be calculated and the codes revisited considering any disagreements. At each of these stages, the framework will be discussed to provoke a reflexive dialogue. Reflections on the positionality of the researchers will be an important part of these discussions. The final framework will then be applied to the data. Codes will then be clustered into themes, with particular attention to the relationship between ideology and assessment policy preferences.
Expected Outcomes
This paper is the first in our research programme on this topic, situated in the context of policymaking in England. With changing geopolitical positions in Europe and more widely, comprehending the way that worldviews are likely to infuse educational policy is imperative. Research programmes in varied domains have concluded that ideology is a robust predictor of a wide range of attitudes, preferences, judgments, and behaviours. In the US, conservatives have been found to express less favourable attitudes toward science, scientists, and their claims, in comparison with liberals (Azevedo and Jost, 2021). In the US, UK and Germany, womens’ and men’s political ideologies were stronger predictors of their support for gender equality than perceived personal and societal inequality (Sevincer et al, 2023). Indeed, Jost et al. (2008) found that liberals were significantly more positive about foreign films, big cities, poetry, tattoos, and foreign travel, while conservatives were more positive about fraternities and sororities, sport utility vehicles, alcohol, and television. While this research is specific to England, the theoretical underpinnings and methodology will be of interest across countries with varying socio-political and economic structures. Indeed our purpose in this presentation is to engage with colleagues across Europe and beyond regarding the likely commonalities, contradictions or extensions to the model that might be necessary to extent this work to different societies. We seek to trace the political and policy connections, first in England, with a view to an expanded international programme of research with different demographic groups and across socio-political structures in different countries. We anticipate conceptual, theoretical and methodological lessons will arise from this initial research stage, since a null finding of association between political values and policy preferences is just as interesting as finding clear relationships.
References
Azevedo, F., & Jost, J. T. (2021). The ideological basis of antiscientific attitudes: Effects of authoritarianism, conservatism, religiosity, social dominance, and system justification. Group Processes & Intergroup Relations, 24(4), 518-549. https://doi.org/10.1177/1368430221990104 Bowe, R., Ball, S. J. & Gold, A. (1992) Reforming education and changing schools (London, Routledge). Broadfoot, P. (2021). The sociology of assessment: Comparative and policy perspectives: The selected works of Patricia Broadfoot. Routledge. Daniels, H., Thompson, I. & Tawell, A. (2019). After Warnock: The Effects of Perverse Incentives in Policies in England for Students with Special Educational Needs. Frontiers in Education, 4, 36, https://doi.org/10.3389/feduc.2019.00036 Gillborn, D., McGimpsey, I. & Warmington, P. (2022). The fringe is the centre: Racism, pseudoscience and authoritarianism in the dominant English education policy network. International Journal of Educational Research, 115, 102056. Grek, S., Lawn, M., Lingard, B., Ozga, J., Rinne, R., Segerholm, C., & Simola, H. (2009). National policy brokering and the construction of the European Education Space in England, Sweden, Finland and Scotland. Comparative Education, 45(1), 5–21. https://doi.org/10.1080/03050060802661378 Hernstein, R.J. (1971). I.Q. Atlantic Monthly, 43-64. September. https://gwern.net/doc/iq/1971-herrnstein.pdf Jost, J. T., Nosek, B. A., & Gosling, S. D. (2008). Ideology: Its Resurgence in Social, Personality, and Political Psychology. Perspectives on Psychological Science, 3(2), 126-136. https://doi.org/10.1111/j.1745-6916.2008.00070.x Randall, J., Slomp, D., Poe, M., & Oliveri, M.E. (2022). Disrupting White Supremacy in Assessment: Toward a Justice-Oriented, Antiracist Validity Framework. Educational Assessment, 27(2), 170–178. https://doi.org/10.1080/10627197.2022.2042682 Santori, D. (2023). Numbers, Markets, and Meritocracy. In: The Quantified School. Palgrave Macmillan, London. Serpa, S., & Ferreira, C. M. (2018). Goffman's backstage revisited: Conceptual relevance in contemporary social interactions. International Journal of Social Science Studies, 6, 74. Sevincer, A. T., Galinsky, C., Martensen, L., & Oettingen, G. (2023). Political ideology outdoes personal experience in predicting support for gender equality. Political Psychology, 44(4), 829-855. Sirin, S.R. (2005). Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research. Review of Educational Research, 75(3), 417-453. https://doi.org/10.3102/00346543075003417 Smith-Woolley, E., Pingault, JB., Selzam, S. et al. (2018). Differences in exam performance between pupils attending selective and non-selective schools mirror the genetic differences between them. npj Science Learn 3, 3. https://doi.org/10.1038/s41539-018-0019-8 Terman, L.M. (1919). The measurement of intelligence. The Riverside Press Limited. Edinburgh. Whitty, G. Making Sense of Education Policy: studies in the sociology and politics of Education. Sage. Winston, A. S. (2018). Neoliberalism and IQ: Naturalizing economic and racial inequality. Theory & Psychology, 28(5), 600-618. https://doi.org/10.1177/0959354318798160.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.