Session Information
11 SES 01 A, Measuring Quality in Institutions of Higher Education
Paper Session
Contribution
This paper focuses on the evaluation of teaching in Higher Education. We assess the quality of teaching based on the perceptions of students and teachers, and analyze its association to student, teacher and course factors. The agreement between students and teachers’ perceptions is also evaluated.
Our study has two main purposes: to find out how teachers and students of the Health School of Vila Nova de Gaia evaluate its’ teaching quality; and to ascertain how appropriate is the use of the Student's Evaluation of Educational Quality (SEEQ) questionnaire on both students and teachers as a way to evaluate teaching quality.
The evaluation of teaching in higher education is relatively recent in the European and Latin American context, although quite traditional in the Anglo-Saxon one. According to Fernández, Mateo and Muñiz (1996) this type of assessment has its origins in the late 1920’s in North America, standing nowadays as a universal institutional practice.
Muñoz Cantero, Ríos de Deus and Abalde Paz (2002) and Simões (2000) report that the evaluation of teaching quality in higher education, based on the perceptions of students, may gain consistency in the majority of universities. In fact, it’s becoming one of the most important dimensions related to quality in higher education institutions. It can be stated that without assessing teaching quality in higher education, the improvement of pedagogical issues might become just rhetoric (Santos Rego, 2000).
According to Centra (2003), there is a wide variety of publications on teacher’s performance assessment and on its models. Indeed, there are over 2,000 studies referenced on ERIC database, by different authors from different countries.
Ramsden (1991) states that teacher assessment by students has been assumed by governments as a valid performance indicator, as well as a direct measure of students’ satisfaction with their college experience and, in particular, a quality indicator of teaching (Marsh & Roche, 1994; Marsh, 1987; Ramsden, 1991; Santiago, Tavares, Taveira, Lencastre, & Gonçalves, 2001). Harvey (2003) suggests that the integration of results of attitudinal and affective nature conveyed by students’ perceptions might be an empowerment effort, making institutions more responsive to their needs and ensuring higher levels of satisfaction.
According to Marsh (1987), students’ evaluations of teaching effectiveness are multidimensional, reliable and stable, depending more on the instructor who teaches the course rather than on the course that is taught; these evaluations are relatively valid against a variety of indicators of effective teaching, relatively unaffected by a variety of variables hypothesized as potential biases.
A longitudinal study conducted by Marsh and Hocevar (1991), which evaluated changes in teaching performance based on students perceptions (following 195 teachers over a 13-year period), concluded that there is a consistent standard assessment of teachers’ competence.
Fraser (1991) pointed out some advantages on the perception approach to evaluate teaching: it is less expensive than classroom observations, which require specialized and experienced observers; it is based on the evaluation of the actual experience of students in a specific environment, while evidence from observation is usually restricted to a limited period of time; and it involves the judgment of all students in the class, while observation techniques typically involve a single observer.
On the other hand, it is important to develop assessment methods that include teaching self-assessment, providing different perspectives on evaluation.
In two studies where teachers performed their self-assessment based on the same instrument used by students, Marsh (1987) concluded that: the factor structure of both questionnaires is identical; the level of agreement between student/faculty in each dimension of the questionnaire is significant; in most cases, mean differences between multimethod analysis provides support for the discriminant and convergent validity of the evaluations.
Method
Expected Outcomes
References
Centra, J. A. (2003). Will teachers receive higher student evaluations by giving higher grades and less course work? Research in Higher Education, 44(5), 495–518. Feldman, K. A. (1976). Grades and college students’ evaluations of their courses and teachers. Research in Higher Education, 4(1), 69–111. doi:10.1007/BF00991462 Fernández, J., Mateo, M. A., & Muñiz, J. (1996). Valoración por parte del profesorado de la evaluación docente realizada por los alumnos. Psicothema, 8(1), 167–172. Fraser, B. J. (1991). Two decades of classroom environment research. In B. J. Fraser & H. J. Walberg (Eds.), Educational environments: Evaluation, antecedents, and consequences (pp. 3–27). Elmsford, NY: Pergamon. Harvey, L. (2003). Student feedback. Quality in Higher Education, 9(1), 3–20. Marsh, H. W. (1987). Students’ evaluations of University teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11(3), 253–388. Marsh, H. W., & Hocevar, D. (1991). Students’ evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period. Teaching and Teacher Education, 7(4), 303–314. Marsh, H. W., & Roche, L. A. (1994). The use of students’ evaluations of university teaching to improve teaching effectiveness. Canberra. Marsh, H. W., & Roche, L. A. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52(11), 1187–1197. Morais, N., Almeida, L. S., & Montenegro, I. M. (2006). Percepções do ensino pelos alunos: Uma proposta de instrumento para o Ensino Superior. Análise Psicológica, 1(XXIV), 73–86. Muñoz Cantero, J. M., Ríos de Deus, M. P., & Abalde Paz, E. (2002). Evaluación docente vs. evaluación de la calidad. Revista ELectrónica de Investigación y EValuación Educativa (RELIEVE), 8(2), 103–134. Ramsden, P. (1991). A performance indicator of teaching quality in higher education: the course experience questionnaire. Studies in Higher Education, 16(2), 129–150. Santiago, R. A., Tavares, J., Taveira, M. do C., Lencastre, L., & Gonçalves, F. (2001). Promover o sucesso académico através da avaliação e intervenção na Universidade. Avaliação: Revista da Rede de Avaliação Institucional da Educação Superior, 6(3), 31–44. Santos Rego, M. A. (2000). Vector pedagóxico e profesorado universitario: sentido e sensibilidade. Innovación Educativa, (10), 29–42. Simões, G. (2000). A avaliação do desempenho docente: contributos para uma análise crítica (p. 112). Lisboa: Texto Editora.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.