We Want Feedback! The I.D.E.A. Research Project
Conference:
ECER 2016
Format:
Paper

Session Information

22 SES 11 C, Student Learning and Evaluation

Paper Session

Time:
2016-08-25
17:15-18:45
Room:
NM-J109
Chair:
Patrick Baughan

Contribution

Over the time, the higher education systems have been exposed to deep and radical transformations. Different processes such as, standardization, diversification, privatization, and internationalization have brought deep institutional changes. Many are the problems that higher education systems have had to deal with: first of all the pervasive attention on teaching-learning quality considered both at institutional and individual level. This concept brings together the most varied aspects such as curricula design, attention to learning context, students’ services support (OECD, 2012), and the recognition of a different kind of assessment of students’ learning outcomes.

In the European area, the widespread diffusion of Dublin Descriptors, following the Bergen Conference (2006) and the Bologna Process (1999) has led to an assessment that is more transparent and aligned with the higher education system and quality assurance process.

European higher education institutions have started to develop internal systems of quality assurance (ENQA). In Italy this system has been designed and implemented by ANVUR.

Five are the main phases of the quality assurance process: 

  1. Define learning outcomes and program outcomes;
  2. Design and plan courses and modules;
  3. Monitor and assess learning outcomes;
  4. Foster improvement actions;
  5. Supply with documentary evidence what is done and realized.

The emphasis on measurement and assessment of learning has darkened further purposes related to assessment and reduced the role and the importance of the main subjects involved in the teaching-learning process (Rust, Price, O’Donovan, 2003). The assessment should not, in fact, just be aimed to determine what students have acquired in terms of contents at the end of a module or program (traditional and instrumental view). Assessment should allows teachers to provide students with information about their learning so they can become «more effective, self-assessing, self-directed learners» (Angelo, Cross, 1993: 4). A considerable scientific literature about feedback and assessment emphasises the influence of the assessment in the teaching-learning process (Hattie, 2009; Popham, 2008). However, sometimes assessment seems to be irrelevant and not supportive both for teachers and students (Taras, 2010; Brown, 2006; Warren, Nisbet, 1999; Torrance, Pryor, 1998). This raises a variety of questions:

  • How much does assessment improve students learning?
  • Do teachers provide useful, appropriate, and timely feedback?
  • Do they allow students to recognize and understand elements that can lead to an improvement in their performance?

There is a strong drive internationally in higher education to support a new assessment culture. Remarkable are the efforts to outline a different kind of assessment that should be more sustainable (Boud, 2006) and useful in order to foster students’ learning process (Price et al., 2012). Assessment practice in the Italian higher education system has become more complex, serves different purposes, and involvers various stakeholders because it tries to combine two main instances:

  1. The implementation, for the first time, of a national quality assurance system;
  2. The requests for a teaching-learning process designed in order to promote learning outcomes aligned with the Dublin Descriptors. The implant of learning outcomes has an impact on teaching, learning, and assessment that is uncertain and a matter debate and contrasting views.

This paper reports the rationale and the research design of the IDEA project that is an ANVUR (Italian National Agency for University Quality Assurance) approved and granted research project. The project is aimed to the implementation of an assessment model that, in one hand, can be able to enhance the role of feedback for the improvement of the teaching-learning process, and, on the other hand, can produce concrete and relevant “evidence” within the higher education quality assurance system.

Method

The IDEA research project moves from these main questions: • What kind of feedback the Italian university teachers provide to students? • Is feedback consistent with the teaching organization of the course? • Is feedback provided functional to the improvement of the teaching-learning quality? • How students use feedback? • Is feedback useful to progression of their learning? • What are the key factors for an effective feedback practice? The project aims to understand and improve assessment practices. In an evidence-based perspective (Singh, Ramya, 2011; Slavin, 2008) it wants to consolidate practices functional to an “aware” decision-making process. The IDEA research project is aimed to: • Analyse assessment practices within the Italian higher education system with a special regard to these elements: exams, grades, and feedback (Phase 1); • Find more frequent problems that teachers and students have with feedback (Phase 2); • Identify what are the main characteristics of a good and effective feedback (Phase 2); • Design a model of feedback practice that may be embedded both to the teaching-learning process and to the quality assurance system (Phase 3). A critical need to re-look into assessment practices in Italian higher education system is implied by this study. The auspice is that IDEA project could help to a widespread diffusion of assessment culture within the Italian higher education system in order to reduce the negative accountability effects and improve the overall quality of teaching-learning processes. Although the context of this paper is the Italian higher education system, we think the paper has relevance to international debate on teaching, learning, and assessment practices in the higher education context.

Expected Outcomes

The project will cover a time of 14 months. Authors will present and share during the Conference the rationale, the research design and some row data from the implementation and validation of the feedback model developed.

References

Angelo, T.A., Cross, K.P. (1993). Classroom Assessment Techniques. San Francisco: Jossey-Bass Publishers. Boud, D. (2006). Sustainable Assessment: Rethinking Assessment for the Learning Society. Assessment & Evaluation in Higher Education, 22(2), pp. 151-167. Brown, G.T.L. (2006). Teachers’ Conceptions of Assessment: Validation of an Abridged Instrument. Psychological Reports, 99, pp. 166-170. Hattie, J.A.C. (2009). Visible Learning: A Synthesis of Over 800 Meta-analysis Relating to Achievement. Abingdon: Routledge. Popham, W.J. (2008). Transformative assessment. Alexandria, VA: Association for Supervision and Curriculum Development. Price, M., Rust, R., O’Donovan, B., Handley, K., Bryant, R. (2012). Assessment literacy: The Foundation for Improving Student Learning. Oxford: OCSLD. Rust, C., Price, M., O’Donovan, B. (2003). ‘Improving students’ learning by developing their understanding of assessment criteria and processes’. Assessment and Evaluation in Higher Education, 28(2), pp. 147-164. Singh, M., Ramya, K.R. (2011). Outcome Based Education. International Journal of Nursing Education, 3(2), 87-91.
 Slavin, R.E. (2008). Evidence-based reform in education: What will it take?. European Educational Research Journal, 7(1), pp. 124-128. Taras, M. (2010). Assessment for Learning: Assessing the Theory and Evidence. Procedia Social and Behavioural Sciences, 2(2), pp. 3015-3022. Torrance, H., Pryor, J. (1998). Investigating formative assessment: teaching, learning and assessment in the classroom. Buckingham: Open University Press. Warren, E., Nisbet, S. (1999). The relationship between the purported use of assessment techniques and belie,fs about the uses of assessment. In J.M. Truran, K.M. Truran (Eds.), 22nd Annual Conference of the Mathematics Education and Research Group of Australia (pp. 515-521). Adelaide, SA: MERGA.

Author Information

Serafina Pastore (presenting / submitting)
University of Bari
Education, Psychology, Communication
Bari
Monica Pentassuglia (presenting)
University of Verona
Department of Philosophy, Education and Psychology
Verona
University of Bari, Italy
University of Bari, Italy
University of Bari, Italy

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.