Session Information
11 SES 10 B, Self Evaluation within Higher Education Establishments
Paper Session
Contribution
The present paper studied the effects perceived by the professors of Nursing Degrees of an evaluation process promoted by the National Council for Higher Education Evaluation (CNAVES) and carried out by the Evaluation Council of the Portuguese Polytechnic Institutes Association (ADISPOR).
The systematic analysis of this evaluation process led us to the following questions: what was the purpose of this evaluation process? How was the work carried out by the External Evaluation Committees (CEA) perceived by the Institutions? What did the persons responsible for the courses do with the recommendations? Did the process promote improvements in the courses? Did it encourage the development of an institutional quality culture?
As a result, we established as the main purpose of this study to understand to what extent the evaluation process to which the nursing degrees were submitted was seen as having contributed to the improvement of the courses and the development of an institutional quality culture.
A set of more specific goals was also established, which helped to define the direction to be followed throughout the study:
a) Understanding the global perception that the leaders of the institutions, the institutional coordinators, the schools coordinators, the professors involved in the evaluation process and also those not involved in the evaluation process, had on its usefulness for the improvement of the Nursing degrees;
b) Identify the fields, amongst those included in the evaluation process, to which this process had been considered more relevant in the improvement of the degrees in Nursing;
c) Identify possible differences between the three groups of subjects in the several fields included in the evaluation process, regarding the assessment about the utility of the evaluation process to the improvement of the nursing degrees.
d) Assess if there was a real contribution of the evaluation process to the development of an institutional quality culture in the schools where the nursing degrees in study were being lectured;
e) Understanding how the contribution of the reviews of the External Evaluation Committees for the improvement process of the Nursing degrees was perceived, either in general and by the different groups of subjects;
f) Knowing whether the institutions/schools where the nursing degrees were evaluated, developed an effort to implement the recommendations resulting from the work of the External Evaluation Committees, and why;
g) Check if there were bias differences regarding the several aspects of the evaluation process, between participants who had integrated External Evaluation Committees and subjects who did not participate in them.
As to the fields to which the evaluation process might or might have not contributed, we used those defined in the Guidelines for the Evaluation Procedure (2002) by the External Evaluation Committees: a) course organization; b) functioning of the program; c) Scientific work associated to the course; d) human resources available; e) facilities; f) equipment; g) results; h) working environment; i) quality culture; j) course dissemination; k) social image of the course.
These were also the fields used in the construction of a questionnaire, in the planning of the interviews that were made and in the categorization of the content analysis that was done to the interviews and to the Committees’ evaluation reports.
Method
Expected Outcomes
References
Conselho Nacional de Avaliação do Ensino Superior CNAVES. (2006). Review of the quality assurance and accreditation policies and practices on the portuguese higher education. Self-evaluation report. Lisboa: CNAVES Costa, A. & Andrade, V. (2003). Percurso da Avaliação no Ensino Superior Politécnico Público. Lisboa: ADISPOR, Conselho de Avaliação El-Kawas, E. (2006). Accountability and quality assurance: new issues for academic inquiry. in Forrest, J. & Altbach, P. (Eds.). International handbook of higher education. (pp. 23-37). Dordrecht: Springer. Engebretsen, E., Heggen, K. & Eilertsen, H. (2012). Accreditation and Power: A Discourse Analysis of a New Regime of Governance in Higher Education. Scandinavian Journal of Educational Research. 56(4). 401-417. Acedido a 2013-03-26 em http://dx.doi.org/10.1080/00313831.2011.599419. Fielding, N. (2012) The Diverse Worlds and Research Practices of Qualitative Software. FQS: Forum Qualitative Social Research 13(2), art.12. Acedido a 2012-06-25 em http://www.qualitative-research.net/index.php/fqs/issue/view/40 Guba, E. & Lincoln, Y. (1994). Competing Paradigms in Qualitative Research. In, Denzin, N. & Lincoln, Y. (Ed) Handbook of Qualitative Research. (pp. 105-117). California: Sage Publications, Inc. Harvey, L. (2004-2012). Analytic Quality Glossary. Quality Research International. Acedido a 2013-02-20 em http://www.qualityresearchinternational.com/glossary/ López Segrera, F. (2012). La segunda conferencia mundial de la educación superior (UNESCO, 2009) y la visión del concepto de acreditación en las conferencias de UNESCO (1998-2009). Avaliação: Revista da Avaliação da Educação Superior (Campinas). 17(3). pp. 619-636 McDavid, J. C. & Howthorn, L. R. L. (2006). Program evaluation & performance measurement – An introduction to practice. Thousand Oaks: Sage Publications Inc. Sanyal, B. C. & Martin, M. (2006). Garantía de la calidad y el papel de la acreditación: Una visión global. In, GUNI. La educación superior en el mundo 2007, Acreditación para la garantía de calidad: qué está en juego? (pp. 3-17). Madrid: Ediciones Mundi-Prensa Stufflebeam, D. (2000). Foundational models for 21st century program evaluation. In, Stufflebeam, D., Madaus, G. & Kellagan, T. (Eds.). Evaluation Models, Viewpoints on educational and human services evaluation (pp. 33-83). Boston: Kluwer Academic Publishers Vlăsceanu, L., Grünberg, L. & Pârlea, D. (2004). Quality Assurance and Accreditaion: A Glossary of Basic Terms and Definitions. Bucharest: CEPES – UNESCO European Center for Higher Education. Acedido a 2007-09-13 em http://www.cepes.ro/publications/papers.htm
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.