Framing, and re-framing, educational measurement to support sustainable development – a case study from India
Author(s):
Sarah Richardson (presenting / submitting)
Conference:
ECER 2017
Format:
Paper

Session Information

07 SES 07 A, Innovative Global Projects

Paper Session

Time:
2017-08-23
17:15-18:45
Room:
W3.09
Chair:
Dana Moree

Contribution

Rigorous, systematic assessment of student learning has become a familiar element of education systems in most European nations. While not without its detractors, the use of standardised assessment to diagnose weaknesses, and to evaluate subsequent interventions to address these, have become broadly regarded as fundamental to the improvement of student learning outcomes. Policy makers, school principals and teachers in many European countries rely on the insights that assessment can provide and generally understand its importance in contributing to learning. Procedures and protocols established by the OECD’s PISA (OECD 2015) and the IEAA’s TIMSS and PIRLS (IEAA 2017), among others, have gained widespread acceptance and the ability to benchmark between countries, as well as within countries, is increasingly valued.

 

Such assumptions are not widespread in many parts of the world however. The Millennium Development Goals (United Nations 2015a) focused on improving school attendance. This appears to have had some impact and there was a clear increase in enrolment in primary education between 2000 and 2015. Question marks remain, however, about the standard of education offered to those students who are now in school. There is little evidence that learning is being optimised across the board, and there remain significant concerns that the quality of education is far from what will be needed to ensure sustainable development into the future.

 

Concerns about educational quality are reinforced by the prevalence of classroom practices that remain characterised by rote learning, enormous class sizes, poor quality school infrastructure and inadequate teacher training. Formal examinations exacerbate, rather than mitigate, the level of apprehension not only due to the way in which assessment materials are designed – and what is measured - but also by appearing to indicate that large proportions of students perform very well indeed, with very few deemed to perform below expectations. While convenient for political posturing, the apparently limited correlation between exam results and actual capabilities augers poorly for the ability of current examination systems to inform improvements in learning outcomes.

 

As a consequence of these concerns, the Sustainable Development Goals focus on ‘inclusive and quality education for all’ (United Nations 2015b). Drawing on the trend in European nations, the focus on quality could be expected to encompass a significant amount of attention on implementing standardised and rigorous assessment to help lift learning outcomes. European countries will inevitably play a vital role in ensuring the achievement of the Sustainable Development Goals. It is therefore of paramount importance that they understand the extent to which their experiences and expertise can be brought to bear in the context of developing countries.

 

This paper draws on the experience of a European supporting reform in educational assessment in one of the largest states of India in the form of a research project in which novel approaches to assessment are piloted. The paper draws attention to the many underlying assumptions that anchor approaches to assessment in Europe and discusses the extent to which they need to be reframed if assessment is to support sustainable development in developing countries.

The author has previously implemented large scale standardised assessment across many European countries, including Belgium, the Czech Republic, Finland, Italy, The Netherlands and Norway. Taking this as the starting point, the paper explores the components of the different phases of assessment – from preparation to implementation to analysis to reporting – and considers the ways in which European models could be reconceptualised when faced with a developing educational environment. It concludes by highlighting structural, practical, philosophical and cultural issues that require addressing if European models for the assessment of student learning can help support sustainable development around the world.

Method

The research work that forms the basis of this paper is applied, involving a team of educational experts schooled in the European traditions of assessment working collaboratively with educational officials and teachers in one of the largest states in India. The research project involves piloting assessment methods that would be entirely familiar in the European context but that are considered ground-breaking in the research context, and that are regarded by some stakeholders as a threat to the status quo of assessment practices and the structures that they reinforce. The methodology used is one that comprises a series of evaluations, consultations, workshops, discussions and fieldwork experiences. In all of these the team of experts has engaged with large numbers of individuals responsible for the implementation of assessment in their respective districts of the state and introduced them to new ways of undertaking all of the components associated with large scales assessment. The team has also worked closely with state officials responsible for the oversight of assessment implementation and operations throughout the state, those who are tasked with designing assessment materials and those whose roles involve the analysis and reporting of assessment data. The current project has focused on assessments in the disciplines of mathematics, the state language and science. The grades of focus have been three, five and eight (all of which are considered to be at the primary level in India). Drawing on extensive experience working on assessment materials, implementation and data analysis used by students around the world, the expert team have had to question the applicability of their expertise as they have faced the many challenges of the environment in which the assessment is taking place. Their experiences, and the creative adaptations they have had to make, sheds light on the extent to which assumptions about what assessment is, the role that it plays and how it can be implemented need to be re-considered when situated in the context of a developing country.

Expected Outcomes

At the time of writing this abstract the main fieldwork phase is yet to commence, but by the end of fieldwork it is anticipated that data will have been collected from around 60 thousand students in sampled schools included in the pilot across the state. By the time the paper is due to be presented, all data will have been analysed and reported, and responses gathered from the wide range of stakeholders involved in this research project. Considering that the approach taken in this project is one in which relatively innovative and unfamiliar models are being trialled, there is a high degree of anticipation as to the extent it will be accepted among students, parents, teachers, school principals and policy makers. These aspects will be fully explored in the paper. The research project is posited as the first step in a reformulation of assessment in India and hence the outcomes of this project will be of significant importance in determining the extent to which European approaches to assessment can be implemented in India, and in other developing countries.

References

IEA (2017) Our Studies. Accessed 14 January 2017 from http://www.iea.nl/our-studies Organisation for Economic Cooperation and Development (2015) Programme for International Student Assessment. Accessed 14 January 2017 from http://www.oecd.org/pisa/ United Nations (2015a) Millennium Development Goals Report. Accessed 14 January 2017 from http://www.un.org/millenniumgoals/2015_MDG_Report/pdf/MDG%202015%20rev%20(July%201).pdf United Nations (2015b) Goal 4: Ensure inclusive and quality education for all and promote lifelong learning Accessed 14 January 2017 from http://www.un.org/sustainabledevelopment/education/

Author Information

Sarah Richardson (presenting / submitting)
Australian Council for Educational Research
India
New Delhi

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.