Session Information
11 SES 07 B, Models and Strategies to Assess Quality of Education
Parallel Paper Session
Contribution
Qualitative assessment is a decisive factor in education. The topicality of assessment quality is caused by increased student competition in higher education institutions, and therefore higher demands for fair assessment. The aim of the work is to evaluate quality – validity and reliability - of assessing student professional foreign language competence with the help of the Test in one of professional areas.
Ultimate aim of professional foreign language assessment is assessing professional foreign language competence, which is a dynamic combination of professional, communicative and intercultural competences (Luka 2005). Communicative competence implies successful use of all four language skills with communicative function. Intercultural competence (Stiers 2004, Korhonen 2004) consists of communicative competence together with ability to act in intercultural context, and experience of international work. Professional competence is a combination of communicative and intercultural competences, as well as professional competence, inseparable part of which is professional experience.
Contemporary professional foreign language control works assess the use of skills and competences in situations, resembling target situation as close as possible, besides. Main qualities of professional foreign language tests are validity, reliability and practicality. Valid tests assess what they are intended to, and reliable tests do it in a systematic way.
Latvian higher education laws and regulations indicate that assessment must possess such qualities as summing up positive achievement, reflecting student development; fairness, including openness and clarity of assessment criteria; variety of the forms of assessment and adequacy: control work correspondence to the content of the study course, mainly knowledge acquired and skills and competences developed (MK noteikumi Nr. 141 "Noteikumi par valsts pirmā līmeņa profesionālās augstākās izglītības standartu, a.o. Documents).
New development in the sphere of foreign language testing in higher education institutions in EU space of education are GULT task-based tests (GULT Project description, on-line), which use authentic reading and listening materials. European researchers have developed several models for evaluating the quality in one study course (Lasnier 2007; Meder, Iske 2009; Rudzinska 2009). Integral part of these models is assessment, quality of which is evaluated with the help of such criteria as clarity, adequacy, deep approach, attractiveness, and test reliability.
Test validity is evaluated with quality model, developed by author (Rudzinska, 2011), consisting of 7 quality Criteria: Adequacy, Clarity, Attractiveness, Deep approach, Objectivity/Subjectivity; Originality/Similarity; orientation to study Process/orientation to study Result.
The nature of the criteria is different, the first 4 increase quality with higher values, but the last three criteria are dialectic ones, they combine opposite qualities: qualitative tests should be both original and standard, they should be evaluated both objectively and subjectively, and they should evaluate also process, not only study result. Quality Indicators form several (2-4) quality Criteria.
The results show that the designed model is reliable for test quality evaluation, and give some insights about the quality of the Test.
Method
Expected Outcomes
References
1. Alderson, J.C., Clapham, C. & Wall D. (1995). Language Test Construction and Evaluation. Cambridge University Press. 2. Anderson, L.W., Kratwohl, D.R. (Eds.) (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom's Taxonomy of educational objectives. New York: Longman. 3. Bachman, L.F., Palmer, A.S. (1996). Language Testing in Practice, Oxford: Oxford University Press. 4. Biggs, J. (2003). Teaching for Quality Learning at University, Maidenhead: Open University Press. 5. Bloom, B.S. (1992). Taxonomy of Educational Objectives, Cognitive Domain, Longman. 6. Dudley-Evans, T., St. John, M.J. (1998). Developments in English for Specific Purposes. Cambridge: Cambridge University Press. 7. Geske, A., Grīnfelds, A. (2006). Izglītības pētniecība: mācību grāmata augstskolu izglītības un pedagoģijas profesionālo un akadēmisko studiju programmu studentiem. Rīga: LU Akadēmiskais apgāds. 8. GULT (Guidelines for University Language Testing), retrieved 20.01.2012, from http://gult.ecml.at. 9. Korhonen, K. (2004). Developing Intercultural Competence as a Part of Professional Qualifications. Journal of Intercultural Communication, 7, pp.1-8, retrieved 12.10.2007, from http://www. immi.se/intercultural. 10. Lasnier, J.C. (2003). Quality, Version 2003, http://www.quiltnetwork.org, retrieved: 5.05.2007. 11. Luka, I. (2005). A social constructivist model for developing students’ ESP competence, Spring University. Changing Education in a Changing Society, Vol. 2, Klaipeda University, Lithuania, pp. 122-128. 12. Meder, E./Iske, S. (2009). Quality assurance by RQCC: how quality is attributed to the relation between learner and e-learning environment, Proceedings of EDULEARN09 Conference, Barcelona, Spain, July 6-8. 13. Ministru kabineta noteikumi Nr. 141 "Noteikumi par valsts pirmā līmeņa profesionālās augstākās izglītības standartu”. 20.03.2001. 14. Rudzinska I. (2011). “Meeting the Challenge of Evaluating the Quality of a Professional Foreign Language Study Course”, Paper presented at ECER-EERA European Conference on Educational Research 2011 “Urban Education”, Freie Universität Berlin, Germany, September 12-16, 2011, Education-line http://www.leeds.ac.uk/educol/documents/186959.pdf. 15. Stiers J. (2004). Internationalization, intercultural communication and intercultural competence. Journal of Intercultural Communication, 11, pp. 1-12, retrieved 12.10.2007, from http://www. immi.se/intercultural.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.