Qualitative case meta-evaluation on the Evaluation of University Students’ Learning Experiences in three European regions and its implications for Taiwan

Author(s):

Chao-Yun, Robert HUANG

Conference:

ECER 2008

Network:

22. Research in Higher Education

Format:

Paper

Session Information

22 SES 04A, Developing Internationalism in Higher Education (Part 2)

Paper Session

Time:

2008-09-10

16:00-17:30

Room:

B2 213

Chair:

Laurence Edward Lomas

Contribution

At present, European countries are attempting to establish the European Higher Education Area (EHEA) by 2010. For achieving this objective, they not only to harmonize different national higher education systems and the recognition of diplomas, but also to develop more adequate conceptions of evaluation to gain a clear understanding of the current situation. The main purpose of this study is to investigate current situation and its implications of “Evaluation of University Students’ Learning Experiences ” in Europe through a case study on one research project, which was financed by "the Foundation of European Regions for Education and the Training " during the years 2001 and 2002, in which 4037 students of three European regions (Baden-Württemberg region in Germany, Rhôhe-Alpes region in France, Catalonia region in Spain) have been asked in this dynamogenic evaluation. It hopes to deeply identify with university students learning motivation, expectations, values and future career possibilities and its purpose is to highlight key issues that should be emphasized in the preparation of establishing the EHEA. The Qualitative case meta-evaluation research method is adopted in this study, by means of the documentary analysis and depth interviewing with participants; we try to examine the new concepts and methodology employed in this European evaluation research project. After analyzing on the evaluation items, the outcomes and the future perspectives, we propose the different suggestions to the researchers who attempt to do similar evaluations in Taiwan. There are five concrete purposes of this study: 1. To examine the content of European evaluation research project and to do the semantic analysis of the questionnaire（with the translation from French to Chinese）。 2. To understand the organization of researchers, the evaluation procedures, the evaluation approach and its efficacy. 3. To find the social background and theoretical foundations of this evaluation project, to clarify the practical meaning of dynamogenic evaluation and also the future influent factors. 4. By observations interview with the directory of evaluators and students and also meeting or workshop participation in France or Europe, to verify the changing and improvement of university teaching and learning from “the function of regulation”. 5. To compare with the similar evaluations of Taiwan and to develop the adequate evaluation indicators and evaluation models. Keywords: university evaluation, evaluation of learning experiences, educational evaluation, qualitative case studies, qualitative evaluation, European Higher Education Area (EHEA)

Method

The Qualitative case meta-evaluation research method is adopted in this study, by means of the documentary analysis and depth interviewing with participants; we try to examine the new concepts and methodology employed in this European evaluation research project. After analyzing on the evaluation items, the outcomes and the future perspectives, we propose the different suggestions to the researchers who attempt to do similar evaluations in Taiwan.

Expected Outcomes

There are five concrete purposes of this study: 1. To examine the content of European evaluation research project and to do the semantic analysis of the questionnaire（with the translation from French to Chinese）。 2. To understand the organization of researchers, the evaluation procedures, the evaluation approach and its efficacy. 3. To find the social background and theoretical foundations of this evaluation project, to clarify the practical meaning of dynamogenic evaluation and also the future influent factors. 4. By observations interview with the directory of evaluators and students and also meeting or workshop participation in France or Europe, to verify the changing and improvement of university teaching and learning from “the function of regulation”. 5. To compare with the similar evaluations of Taiwan and to develop the adequate evaluation indicators and evaluation models. 　

References

Own Publications Publication in Chinese (Publication in Chinese, English title : Huang, Ch.-Y,R(2006). Educational Administration in France. In. F. S. Chiang & Y. H. Chung (Eds.), Comparative Study on the Education Administration in the different countries,(pp.301-354). Taipei:Wu Nan.)　 (Publication in Chinese, English title : Huang, Ch.-Y,R(2007a).Study on the Secondary Education Reforms in France. Bulletin of National Institute of Educational Resources and Research,34,179-212.) (Publication in Chinese, English title : Huang, Ch.-Y,R(2007b). The Systematic Evolution and The Current Reform of French Higher Education. Bulletin of National Institute of Educational Resources and Research,35, 213-238.) (Publication in Chinese, English title : Huang, Ch.-Y,R(2007c). The Founding of Departments of Sciences of Education : A Review of Its History and an Analysis of the Current State. Bulletin of National Institute of Educational Resources and Research,36,211-230.) ( Publication in Chinese, English title : Huang, Ch.-Y,R(2007a, October).Study on the Evaluation of University Students' Learning Experiences in three European regions. Forum for Educational Evaluation in East Asia: Emerging Issues and Challenges, (Abstract:162-163). October, 20-21, 2007, National Taiwan Normal University, Taipei, Taiwan.) (Publication in Chinese, English title: Huang, Ch.-Y,R(2007b, october). Analysis of the difference between Inclusion Research Paradigms and Practices for the students with Autism in France. 2007 Special Education Conference on the dialogue between theories and practices,(Full text: 275-296). October, 20, 2007, National Taipei University of Education, Taipei, Taiwan.) ( Publication in Chinese, English title: Huang, Ch.-Y,R(2007, November). Defend the Equality of Educational Opportunities: Analysis of Equality of Educational Opportunity's Reform and School Division Policy in France(Défendre l'égalité des chances:Analyse de la réfrome de l'égalité des chances et la politique de sectorisation en France). International Conference on Justice Society and Education Initiatives of Administration, (Abstract:147-149). October, 20-21, 2007, National Taiwan Normal University, Taipei, Taiwan.) Publication in French or English Huang, Ch.- Y, R. (2003). School placement of autistic children in France: a case for qualitative evaluation research. Paper presented at ECER (European Conference on Educational Research), Hamburg, Germany. 17- 20 September 2003. Huang, Ch.- Y, R. (2004). Évaluation de la prise en charge des enfants autistes à l'école. Contribution de recherche presentée dans 7e Biennale de l'Éducation et de la Formation. Lyon. 14-17 avril 2004. INRP – APRIEF. Disponible sur : http://www.inrp.fr/Acces/Biennale/7biennale/Contrib/affich.php?&num=7027 Huang, Ch.-Y, R. (2005a). La prise en charge des enfants autistes à l`école :Realités et exigences. Thèse de doctorat de Sciences de l'éducation soutenue le 12 mai 2005 a l'Université Pierre Mendès France, Grenoble 2. Avec la mention : Très Honorable avec Felicitations.Résumé de thèse est disponible sur le site de INRP - Veille Scientifique. Huang, Ch.- Y, R. (2005b). Est - il possible d'éduquer tous les enfants ? une recherche anthropologique sur la scolarisation des enfants autistes. Communication de recherche presentée dans le Colloque International Quelle idée de l'homme pour le pédagogue ?,Vannes- Arradon. 30 juin - 2 juillet 2005. Université Catholique de l'Ouest Bretagne Sud. References of this paper: Bergson, H. (1912). L’évolution créatrice. Paris : Félix Alcan. Bourdieu, P.& Passeron,J.-Cl.(1964). Les héritiers : les étudiants et la culture. Paris : Minuit. Bourdieu, P.& Passeron,J.-Cl.(1970). La reproduction : éléments pour une théorie du système d'enseignement. Paris : Minuit. Chabal, R. (Ed.)(2007). L'Enseignement supérieur en France - Etat des lieux et propositions. Récupéré le 5 septembre 2007 http://www.enseignementsup-recherche.gouv.fr/rapport/2007/enseignementsupmai2007.pdf Clarke, A. & Dawson, R. (2003). Evaluation research: An introduction to principles, methods and practice. Thousand Oaks. SAGE. Davidson, J.(2005). Evaluation methodology basics:The nuts and bolts of sound evaluation. Thousand Oaks:SAGE. Fetterman, D. M. (2001). Foundations of empowerment evaluation. Thousand Oaks: SAGE. Fetterman, D. M. (2002). Empowerment evaluation: Building communities of practice and a culture of learning. American Journal of Community Psychology. Vol. 30, N° 1. 89- 102. Fetterman, D. M.(2005). A window into the heart and soul of empowerment evaluation. In. D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation principles in practice, (pp.1-26). New York: The Guilford Press. FREREF(2007). Les régions membres et les institutions associés. Récupéré le 15 septembre 2007 de FREREF (Fondation des régions européennes pour la recherche en éducation et en formation) http://www.freref.eu/spip.php?article90 Hadji,C. (1989). L’évaluation, règles du jeu. Paris : ESF. Hadji,C. (1992). L'évaluation des actions éducatives. Paris : PUF. Hadji,C. (1997). L’évaluation démystifiée : Mettre l’évaluation scolaire au service des apprentissages Paris : ESF. Hadji,C. (1998). Quel rapport au vrai l'acte éducatif engage-t-il ? Preuve, action éducative et savoir : de la question de la preuve à celle des savoirs utiles à l'éducateur. In. C. Hadji et J. Baillé (Eds.), Recherche et éducation : Vers une « nouvelle alliance »(pp. 81-94). Paris&Bruxelles : De Boeck Université. Hadji, C., Fernex, A., &Lima, L. (2003). Les étudiants de la région Rhône-Alpes face à leurs études. Grenoble : LSE/Région Rhône-Alpes. Récupéré le 15 septembre 2007 http://web.upmf-grenoble.fr/sciedu/lima/etudiant.pdf Hadji, C.& Lima, L. (2003). Quand les étudiants jugent leurs études, quels enseignements d’une recherche internationale? Actes du colloque de l’ADMES-RA : la pédagogie universitaire : impérieuse nécessité ou luxe inutile ? (pp. 39-54). Grenoble : ADMES-RA. Hadji, C.& Lima, L. (2004). Qualité des études et attitudes des étudiants. In T. Bargel (Ed), Heterogeneity and inequality of students: an international comparison: contribution to a conference of FREREF at the Villa Vigoni (pp. 19-22). Konstanz: Universität Arbeitsgruppe Hochschulforschung. Hadji, C., Bargel, T., & Masjuan, J.(Eds.)(2005). Etudier dans une université qui change. Le regard des étudiants de trois régions d’Europe. Grenoble: PUG. Hadji,C.(2006). Les étudiants européens face à leurs études(Keynote Speech). In. Conference on the development of higher education and international exchange of scolars (pp.K-III-1-K-III-39). Puli, Taiwan : Chinese Comparative Education Society-Taipei, Department of Comparative Education, NCNU. Hadji, C. (2006a, novembre). Les pratiques d’évaluation dans le cadre scolaire. Conférence présentée au Center for Research on Educational Evaluation and Development, National Taiwan Normal University, Taipei, Taiwan.. Hadji,C.(2006b, novembre). Quelques pratiques de travail universitaire appréhendées à travers le regard des étudiants. Conférence présentée à l’Université Tamkang, Taipei, Taiwan. Hadji,C.(2007, novembre). L’évaluation en éducation et formation peut-elle, et comment, contribuer à l’ émergence et / ou au développement d’une société de justice ? (Keynote Speech). In. International Conference on Justice Society and Education Initiatives of Administration (pp.61-94). Taipei, Taiwan : College of Education, National Taiwan Normal University. House, E. R.(2005). Qualitative evaluation and changing social policy. In. N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research Third Edition, (pp.1069-1081). Thousand Oaks: SAGE. Lacroix, S. -F. (1803/1835). Essais sur l'enseignement en général et sur celui des mathématiques en particulier. Paris: Bachelier. Récupéré le 15 septembre 2007 de Bibliothèque Nationale de France-Gallica http://gallica.bnf.fr/ark:/12148/bpt6k107598s Lima, L., & Hadji, C. (2005a). Quand les étudiants jugent leurs études. Quelques enseignements d'une recherche internationale. Papers, 76, 67-96. Lima, L., & Hadji, C. (2005b). Quand les étudiants se pronincent sur la qualité de leurs études :D’une évaluation bilian à une évaluation dynamogène . In. C.Hadji, T. Bargel & J. Masjuan(Eds.), Etudier dans une université qui change. Le regard des étudiants de trois régions d’Europe(pp.22-56). Grenoble: PUG. Meirieu, P. (2003). Le choix d’éduquer: éthique et pédagogie. Paris: ESF. MEN-DEPP(2007). Repères et référence statistiques sur les enseignements, la formation et la recherche. Paris : MEN-DEPP(Ministère de l’Education Nationale - Direction de l’Evaluation, de la Prospective et de la Performance). Mialaret, G. (2002). Les sciences de l’éducation. Paris : PUF. Patton, M. Q. (1987). How to use qualitative methods in evaluation. Newbury Park : SAGE. Patton, M. Q. (2002a). Qualitative research & evaluation methods. Thousand Oaks : SAGE. Patton, M. Q. (2002b). A vision of evaluation that strengthens democracy. Evaluation. Vol. 8(1). 125–139. Piéron, H. (1963). Examens et docimologie. Paris: PUF. Rossi,P. H., Lipsey, M.W. & Freeman, H. E. (2004). Evaluation: A systematic approach. Thousand Oaks: SAGE. Spradley, J. P. (1980). Participant observation. Orlando. Harcourt. Stake, R. E.(2005). Qualitative case studies. In. N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research Third Edition, (pp.443-466). Thousand Oaks: SAGE. Thorndike, E. L. (1910). Practice in the case of addition. American journal of psychologie, 21,483- 486. Thorndike, E. L. (1935). The psychology of wants, interests and attitudes. New York & London: D. Appleton-Century. Van der Maren, J. - M. (2003). La recherche appliquée en pédagogie. Paris&Bruxelles: De Boeck & Lacier.

Author Information

Chao-Yun, Robert HUANG

National Chi Nan University

Department of Comparative Education

PULI

215

Search the ECER Programme

Search for keywords and phrases in "Text Search"
Restrict in which part of the abstracts to search in "Where to search"
Search for authors and in the respective field.
For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.