Assessment Dynamics In Higher Education: An Integrated Narrative In The Field Of Social Sciences
Author(s):
Conference:
ECER 2014
Format:
Paper

Session Information

22 SES 03 A, Teaching, Learning and Assessment in Higher Education

Paper Session

Time:
2014-09-02
17:15-18:45
Room:
B020 Anfiteatro
Chair:
Johanna Annala

Contribution

This paper is part of a wider research project entitled “Assessment, Teaching And Learning In The Portuguese And Brazilian Higher Education: Realities And Perspectives” (AVENA Project, funded by Foundation for Science and Technology; project reference PTDC/CPE-CED/114318/2009). This project is based on the assumption that teachers’ knowledge, conceptions and experience are related to the way they organize the teaching and the assessment. The research carried out highlights the role that teaching and assessment can play in learning improvement (e.g. Stiggins, 2004; Figari & Achouche, 2001). In particular, Black & Wiliam (1998) emphasized three results of broad scope and great significance: a) the systematic practice of formative assessment substantially improves students’ learning; b) the students who most benefit from formative assessment are those that have more learning difficulties; and c) the students that attend lessons in which formative assessment is predominant obtain better results in external assessment exams. The publication of the Black & Wiliam text (1998) led to the resumption of empirical research and theoretical construction based on renewed epistemological visions, in new developments of learning and curricular theories and a variety of contributions such as those coming from sociology, the cognition sciences, anthropology and communication theories (e.g. Black & Wiliam, 2006; Gardner, 2006; Harlen, 2006; Stiggins & Chappuis, 2005; Gipps & Stobart, 2003). But what can one say of solid foundation, based on the empirical research and theoretical reflection that has been produced in recent years? Essentially, the literature enables research and development areas to be highlighted such as: a) consolidating a theory of formative assessment that can back up and support the classroom practices; b) describing and analyzing assessment and teaching practices that are implemented in real classrooms, with real students, relating them to their academic success; c) articulating the learning, the teaching and the assessment; d) understanding the relationships between learning, teaching and assessment, making the classroom and all of its complexity the unit of analysis, instead of the teacher or the students individually; and e) understanding the relationships between formative assessment and summative assessment as well as their practical implications. Some overviews of the literature and other work carried out in Portugal and Brazil show that in these countries there is a considerable amount of research about learning and assessment in non-higher education contexts (e.g. Fernandes, 2009, 2006; Esteban, 2003; Hoffmann, 1998). However, the research at the higher education level carried out in the two countries is still threadbare, taking into account the need to understand a set of critical issues that help to improve what and how the students learn. Regarding this state of the art, our research project main question was: How can the systems of teachers and students’ conceptions with regard to teaching, learning and assessment be characterized? Therefore, the overriding aim of the research was to describe, analyze and interpret the teaching and assessment practices carried out in different Portuguese and Brazilian Universities and Courses. This paper analyzes, specifically, the perspectives and practices of teachers and students regarding assessment processes, concerning two Courses of the University of Minho (Portugal), in the field of Social Sciences: Degree in Education and Master in Psychology and data collection took place in two Subjects, one of each Course. The data analysis resulted in an integrated narrative, so our aim in this paper is to present some of the obtained results, framed in the context of the broader AVENA Project.

Method

The overriding problem of the research project derived from the need to understand the relationships between a variety of elements: a) teaching and assessment practices of teachers; b) teachers’ conception systems about teaching, assessment and learning; c) students’ conception systems about teaching, assessment and learning; d) nature of the assessment tasks used in the classrooms; e) frequency, distribution and nature of the feedback used; and f) students’ participation in the teaching, assessment and learning processes. In this sense, it was crucial that a considerable part of the research data was obtained in the real context of the classrooms and through interaction and close contact with students and teachers. Furthermore, it was considered important to gather information from a high number of teachers and students of different courses/subjects from four fields of knowledge: Social Sciences; Arts and Humanities; Engineering and Technology and Health Sciences. As such, data obtained from quantitative and qualitative nature enabled the description, analysis and interpretation of phenomena of interest that were associated to the problem and the guiding questions of the research: semi-structured interviews; classroom observation; observation of group meetings; written reflections of the participants; focus groups; written reflections of the researchers; surveys. The qualitative data was analyzed using content analysis (Yin, 2003; Wolcott, 1994; Merriam, 1988; Erickson, 1986; Evertson & Green, 1986). With regard to the analysis of the quantitative data, the usual descriptive and inferential statistical procedures were used (e.g. Kirk, 1984). In methodological terms, the integrated narrative of Social Sciences we present resulted from the triangulation of data obtained from two semi-structured interviews with two teachers, one from each Subject; two focus group interviews (eight students, four from each Subject) and classroom observation: 38 hours (20 hours in Education and 18 hours in the Master of Psychology).

Expected Outcomes

In terms of outcomes, although there was a predominance of the summative assessment regarding the Subject integrated in the curriculum of the Master in Psychology and a preponderance of the formative assessment concerning the Subject integrated in the curriculum of the Degree in Education, both teachers considered important to develop formative assessment practices as a way of regulating the teaching-learning process. They also emphasized the importance of feedback mechanisms and their role in terms of student learning, but also recognized that students do not always value this component; on the other hand, they pointed out that the lack of time may influence the quality and the effectiveness of the work done in this sense. Another aspect mentioned by the teachers relates to student participation in the assessment dynamics, in terms of giving them the opportunity to make suggestions for amendments to the forms of assessment at the beginning of the semester, either by resorting to mechanisms of self-assessment and peer assessment; however, the teachers revealed the latter is not adequately taken into consideration by students. In summary, the conclusions of this research highlight the importance of: a) developing systematic practices of formative assessment; b) promoting the active participation of students in the assessment processes and c) using mechanisms of feedback. Nevertheless, we also acknowledge some aspects that we would like to explore and understand in future investigations and which are related to the need to assess the relationship(s) between time-effectiveness of the feedback given by teachers, as well as the need to find dynamics that improve student involvement in the processes of self-assessment and peer assessment.

References

Black, P. & Wiliam, D. (1998). Assessment and classroom learning. In Assessment in Education: Principles, Policy & Practice, 5, 1, 7-74. Black, P. & WILIAM, D. (2006). Assessment for learning in the classroom. In J. Gardner (Ed.), Assessment and learning (pp. 9-25). London: Sage. Erickson, F. (1986). Qualitative methods in research on teaching. In M. Wittrock (Ed.), Handbook of research on teaching (pp. 119- 161). New York: MacMillan. Esteban, M. T. (2003). Escola, currículo e avaliação. São Paulo: Cortez. Evertson, C. M. & Green, J. L. (1986). Observation as inquiry and method. In M. Wittrock (Ed.), Handbook of research on teaching (pp. 162- 213). New York: MacMillan. Fernandes, D. (2006). Vinte anos de avaliação das aprendizagens: uma síntese interpretativa de artigos publicados em Portugal. In Revista Portuguesa de Pedagogia, 40, 3, 289-348. Fernandes, D. (2009). Avaliação das aprendizagens em Portugal: investigação e teoria da actividade. In Revista Sísifo. Avaliação em Educação: Perspectivas Ibero-Americanas, n.9, 87-100. Figari, G. & Achouche, M. (2001). L’activité évaluative réinterrogée: Regards scolaires et socioprofessionnels. Bruxelles: De Boeck. Gardner, J. (2006). Assessment and learning: An Introduction. In J. Gardner (Ed.), Assessment and learning (pp. 1-5). London: Sage. Gipps, C. & Stobart, G. (2003). Alternative assessment. In T. Kellaghan & D. Stufflebeam (Eds.), International handbook of educational evaluation (pp. 549-576). Dordrecht: Kluwer. Harlen, W. (2006). On the relationship between assessment for formative and summative purposes. In J. Gardner (Ed.), Assessment and learning (pp. 103-118). London: Sage. Hoffman, J. (1998). Avaliação: pontos e contrapontos. Porto Alegre: Mediação. Kirk, R. (1984) Elementary statistics. Monterey, CA: Brooks/Cole. Merriam, B. (1988). Case study research in education: A qualitative approach. San Francisco: Jossey-Bass Publishers. Stiggins, R. (2004). New assessment beliefs for a new school mission. In Phi Delta Kappan, 86, 1, 22-27. Stiggins, R. & Chappuis, J. (2005). Using student-involved classroom assessment to close achievement gaps. In Theory into Practice, 44, 1, 11-18. Wolcott, H. (1994). Transforming qualitative data. London: Sage. Yin, R. (2003). Case Study Research: Design and Methods. Thousand Oaks, CA: Sage.

Author Information

Márcia Aguiar (presenting / submitting)
University of Minho
Institute of Education
Braga
University of Minho
Braga
University of Minho, Portugal

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.