Before and After: Performative Accountability and the UK Research Assessment Exercise
Author(s):
Conference:
ECER 2008
Format:
Paper

Session Information

23 SES 04B, The Audit Society (Part 2)

Paper Session continued from 23 SES 03B

Time:
2008-09-10
16:00-17:30
Room:
B1 114
Chair:
Florian Waldow

Contribution

This paper uses data from the submissions and ratings from the UK Research Assessment Exercise 2001 (data on staff selection, income, research groups, methodologies, audiences, and areas on expertise) to reflect on the shifts in public understandings of researcher accountability over the past few decades at the level of institutional (rather than individual) accountability. In particular, it looks at what has been described as a decline of professional, ethical and communicative modes of accountability in favour of more technical, managerial and bureaucratic ones. This was accompanied by a conceptual change, from accountability as responsibility and communicative reason to accountability as hierarchical answerability (with corresponding shifts in values, concepts of public good, and hierarchies of knowledge). In recent years, attempts have been made to develop generally acceptable hybrids between professional accountability (i.e., accountability that resides within education and research communities and relies on conceptions of intrinsic excellence and on professional ethics – Winch, 2001) and bureaucratic accountability (i.e. financial concepts of accountability and auditability, transposed to the context of professionals being held to account by third parties such as government and administrative structures or corporations – Biesta, 2004). The UK RAE may be described as one such attempt. However, rather than producing accountability regimes with wider legitimacy, it – and other initiatives along similar lines - has been criticised by commentators for having aggravated the “erosion of professional power from state governments and the corporate community” (Webb, 2005, p.191). Despite the RAE intending to recognise and draw together the standards of excellence characteristic to the education research communities and the measures of performance favoured by the state administration, arguably in the end the emphasis fell firmly on the latter. The data analysed in the paper suggest that, while effective at screening out poor quality research (due to the peer review processes at its core), the RAE also endangered pockets of expertise and emerging research cultures, through the cutting of funds for lower-rated institutions. This had to do less with the quality of the peer reviewing, and more with the managerial logic of the exercise, which presupposed: commensurability of research quality across sub-fields, types of institutions, and types of research cultures and communities; meaningful aggregation of quality at institution level; the value of competition and selectivity in creating quasi-markets of state-funded research; and the theoretical possibility of comprehensive assessments of submissions (as opposed, for example, to peer-reviewing a representative sample of publications, or to skimming through large submissions to gain a flavor of the overall “performance”). Many of these are deep-cutting issues that are unlikely to be addressed by simply replacing the RAE with a more quantitative assessment exercise, such as currently proposed in the UK.

Method

The paper draws on work commissioned by the British Educational Research Association and aimed at gathering information about the distribution of educational research expertise across different types of institutions throughout the UK, post-RAE 2001. The strategies for data gathering and analysis were multifold, ranging from survey of education departments and overview of newspaper articles, to analysis of the authorship of academic journal articles after 2001, and analysis of the RAE 2001 submissions.

Expected Outcomes

The paper argues that, in a post-RAE context (given plans to replace the current RAE with a more metrics-centred exercise), neither the reinforcement of targets, indicators, standards and techniques of managerial accountability, or the closure of academia to external scrutiny, is likely to be the way forward. Rather, what is needed is a restoration of the discursive, democratic and ethical dimensions of the relationship between research, the public, and policy.

References

Biesta, G. (2004) Education, accountability, and the ethical demand: Can the democratic potential of accountability be regained? In: Educational Theory, 54(3), pp. 233-250. Joint Funding Councils of the United Kingdom (1996) Research Assessment Exercise: The Outcome. Kerr, D., Lines, A., MacDonald, A., and Andrews, L. (1998) Mapping Educational Research in England. An analysis of the 1996 Research Assessment Exercise. NFER and HEFCE. O’Neill, O. (2002) A Question of Trust. BBC Reith Lectures, 2002. Oancea, A. (2007) Procrustes or Proteus? Trends and practices in the assessment of education research. In: International Journal of Research Methods in Education, 30(3), pp. 243 - 269. Oancea, A. (2005) Authorship patterns of research articles in three UK-based academic journals. In: Research Intelligence, 91. Oancea, A. (2004) The distribution of educational research expertise – findings from the analysis of RAE 2001 submissions (I, II). In: Research Intelligence, 87; 88. Pollard, A. and Bassey, M. (1999) Paper submitted to the Task Group on Education Research for RAE 2001. Ranson, S. (2003) Public accountability in the age of neo-liberal governance. In: Journal of Education Policy, 18(5), pp. 459–480. Webb, T. (2005) The anatomy of accountability. In: Journal of Education Policy, 20(2), pp. 189-208. Winch, C. (2001) Accountability and relevance in educational research. In: Journal of Philosophy of Education, 35 (3), pp. 443-459.

Author Information

University of Oxford
Department of Education and Institute of Ageing
Oxford

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.