Session Information
09 SES 10 A, Assessments in Second-, Bi- and Multi-Language Settings
Paper Session
Contribution
Over the past 15 years, there have been a number of significant changes within the German educational system as illustrated in the following examples: the practice of individually fostering each school pupil is now legally binding. The evaluation of learner achievements through teachers in the classroom is of particular importance in order to gain knowledge about individual development as a basis for planning lessons that take individual differences of students into account. One vital point of time for the assessment of students’ competencies is when teachers start teaching a new class as they need reliable information about their students’ prior knowledge. In Germany the majority of students are making the transition from primary to secondary school grade 4 (age app. 10). Thus, teachers at the beginning of grade 5 need a variety of practical methods and instruments to evaluate the new students.
The project to be presented explores the possibility of diagnosing the English as a Foreign Language (EFL) competence of young learners at the end of primary school with the help of a newly developed C-test. This C-test is designed to evaluate students’ EFL competence at the beginning of secondary school. C-tests aim at measuring general language ability (e.g., Asano, 2014) and have proven to be an effective instrument for assessing learners of different languages and in various age groups – however they have not yet been adapted for very young EFL learners. The C-test is based on the „reduced redundancy principle“ (cf. Babaii & Ansary, 2001). In contrast to Cloze-tests, in C-tests only parts of words are deleted, not whole words. Ideally, C-tests consist of four to five short texts that are content neutral, suitable for the target group, non-fictitious, without dialogues and authentic. Each text consists of 20 to 25 gaps with 80 to 100 words whereby every second or third word is mutilated.
Along with the development of C-tests, several studies have researched the use of test-taking strategies while taking a C-test (e.g., Grotjahn & Stemmer, 2002; Salehi & Sanjareh, 2013). Cohen (2011, p. 317) summarizes the findings of research on C-test-taking strategies as follows: “It has been found that response strategies predominantly involve micro-level processing. Since half the word is given, students who do not understand the macro-context have been observed to mobilize their vocabulary skills in order to fill in the appropriate discourse connector without indulging in higher level processing.” This seems to be true for language learners at a beginning and an intermediate level of proficiency.
In developing the research design the following principles need to be adhered to: (1) following the requirements of C-test criteria as sketched out above, especially following the redundancy principle; (2) take the prerequisites of the young learners into account, especially by referring to the curriculum with regard to familiar topics, vocabulary, grammar, reading and writing competencies; (3) developing an instrument that allows reliable and valid testing of EFL proficiency, and (4) including the children’s perspectives in the test development.
Based on these criteria, our research questions are as follows:
- Psychometric quality of the test: Does the C-test show appropriate levels of item difficulty and item discrimination as well as a satisfactory reliability?
- Validity of the C-test: Is there at least a medium correlation between the C-test scores and the grades in English being a first indicator of the test’s construct validity?
- Test takers’ usage of strategies: Which test-taking strategies do fourth-graders apply when solving the C-test based on written reports?
Method
Expected Outcomes
References
Asano, Y. (2014). C-Tests und ‚allgemeine Sprachkompetenz‘: Theoretische Überlegungen und empirische Analysen. In R. Grotjahn (Ed.), Der C-Test: Aktuelle Tendenzen/The C-Test: Current Trends (pp. 39-52). Frankfurt/Main: Peter Lang. Babaii, E. & Ansary, H. (2001). The C-test: a valid operationalization of reduced redundancy principle? System, 29, 209-219. Cohen A. D. (2011). Strategies in learning and using a second language. Harlow, England: Longman Applied Linguistics/Pearson Education. Duff, P. A. (2014). Communicative language teaching. In M. Celce-Murcia, D. M. Brinton & M. A. Snow (Eds.), Teaching English as a Second or Foreign Language (pp. 15-31). Boston: National Geographic Learning. Eckes, T. & Grotjahn, R. (2006). A closer look at the construct validity of C-tests. Language Testing, 23 (3), 290-325. Fisseni, H. J. (2003). Lehrbuch der psychologischen Diagnostik: Mit Hinweisen zur Intervention. Goettingen: Hogrefe. Grotjahn, R. & Stemmer, B. (2002). C-Tests and language processing. In J. A. Coleman, R. Grotjahn & U. Raatz (Eds.), University Language Testing and the C-Test (pp. 115-129). Bochum: AKS. MSW (Ministerium für Schule und Wissenschaft Nordrhein-Westfalen) (2008). Richtlinien und Lehrpläne für die Grundschule in Nordrhein-Westfalen. Düsseldorf: MSW NRW. Salehi, M. & Sanjareh, H. (2013). On the comparability of C-test and Cloze: A verbal protocol approach. English for Specific Purposes World, 14 (39). Online: http://www.esp-world.info/Articles_39/Abstract_39_Salehi_Sanjareh.htm Schreier, M. (2012). Qualitative Content Analysis in Practice. London: SAGE.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.