Session Information
31 SES 08 B JS, Art, Literature and Multimodality in Language Learning
Joint Paper Session NW 29 and NW 31. Full details under 31 SES 08 B JS
Contribution
In imparting subject-specific competencies, visual stimuli often serve as the basis for classroom discourse. Images are used in every subject as they serve both as stimuli for expressions and to support learning and introduce subject-specific thematic aspects (Hallet 2008). In second and foreign language teaching, there are numerous assumptions about the potential of using images for linguistic learning (Kress & van Leeuwen 2021).
In the context of scaffolding support (Gibbons 2015), multimodal practices play a significant role: According to Gibbons (2015: 45), references to various carriers of meaning provide multiple connection points to everyday experiences and already known or learned content. Gibbons describes this strategy or didactic function of relying on visualizations or other modes of support, such as gestures, with the term 'message abundancy' (Gibbons 2015: 42–45): "Message abundancy is a significant aspect of comprehensible teacher talk and is central to effective learning. When teacher talk is integrated with other systems of meaning, it is much more likely to be understood." (Gibbons: 44–45) By combining different semiotic resources, L2 learners can activate their prior knowledge, stimulating comprehension processes and thereby eliciting output. Especially when it comes to leading learners from a concrete level of observation to a more abstract, context-reduced level, this strategy can be helpful (Kniffka, & Neuer 2008: 129). Many didactic-methodological concepts and programmes for language-sensitive subject teaching are based on the assumption that visualization and contextual embedding support a dual subject-matter-specific and associated linguistic progression.
However, in dyadic classroom communication with L2-learners, it is unclear which interactional and multimodal practices come into play in relation to image perception. How knowledge is constructed depends on the way it is presented, and the methods and media used. The form of representation influences both what is learned and how it is learned (Jewitt 2008: 241). Switching between modes of representation and thus the perception of meanings from different modalities, in particular the visual material in the school subject context, their integration and implementation in a communicative act requires multiliterate discourse competence (Jewitt 2008: 255).
Therefore, the aim of this interdisciplinary exploratory study on subject-specific image discussions with L2 learners (n = 18) in secondary schools (Germany, Hesse, May–July 2023) is to capture students' image communication in relation to specific teaching objectives, to analyse and compare discourses about images. This serves to draw conclusions about the characteristics and conditions of acquisition-supportive, learning-productive, and academically challenging practices for the use of images. By describing and analysing the subject-specific and linguistic practices of students in dyadic image conversations, the study investigates which subject-specific, visual, and associated linguistic and discursive practices and competencies play a role in image reception and the associated gain in knowledge.
Conclusions about multimodal interaction via images are drawn with reference to the foundations of multimodality (Kress 2021; Rowsell & Collier 2017) and the understanding of interactional competence according to Sert (2015: 44-50), Seedhouse (2009), Hall and Pekarek Doehler (2011: 1-3), and the conceptualisation of 'classroom discourse' as a form of media-related classroom interaction (Thomson 2022: 17-21).
Method
The current study (April 2023–July 2023) was conducted with L2 learners (n = 18) in an intensive class shortly before their transition into regular classes. Selected students, whose language proficiency was determined using C-Tests, were presented with images from introductory pages of a textbook for the subject of social studies. According to the curriculum (HKM n.d.) and teaching materials, the illustrations are intended to prepare the students for work on topics such as "Children of the World" or "Living spaces". During various dyadic interactions, which were videotaped (approximately 350 minutes), the conversation partner, a subject, and German as a Second Language teacher, supported the participants as needed, including through interactional scaffolding and strategies like "cued elicitation" (Hammond & Gibbons 2005: 23) to achieve the subject-specific learning objectives. Working with images in a school context means understanding the different resources of meaning in their interplay and in relation to the professional teaching objective. To this end, the objectives associated with the visual material, on the one hand, and the teacher's impulses for initiating mode shifts and negotiating meaning, on the other, are analysed. The focus of the analysis is therefore on the multimodal reference system of image and speech. Conversation analysis (CA) is used to reconstruct the organisation of the multimodal interaction on the pictures in relation to the associated learning objective. The focus of the data selection for the lecture is on sequences in which the L2 learners take the topics represented by the material as a starting point for their personal questions. The conversations were transcribed according to GAT 2 conventions (Selting et al. 2009) and analysed using conversational analysis (Birkner et al. 2020). This analysis particularly focused on identifying interaction sequences where visual, linguistic, or predominantly subject-specific epistemic pathways of understanding were prominent. The discourse practices were analysed in relation to the subject of observation. The reconstruction of multimodal interaction allowed for conclusions about different ways of steering in supportive, learning-productive, and academically challenging teaching scenarios.
Expected Outcomes
Conceptual foundations and curriculum guidelines for the goals linked to using images suggest that the intended learning steps are directly achievable. However, meaning arises in discourse, and learning pathways depend on the experiences and subject-specific, linguistic, and visual competencies of the learners and teachers. In specific situations, various interactional practices, and support in the form of micro-scaffolding come into play (Gibbons 2015). Through the exemplary analysis of selected discourses, it becomes clear that micro-scaffolding has different starting points depending on the individual participant: Sometimes impulses for conscious perception are required, and at other times, it involves assistance in naming the subjects of the images and their interrelations. The different cultural interpretation patterns of the participants in relation to the depicted contexts, situations, and people also indicate that differentiated support is necessary to achieve subject-specific epistemic goals. For instance, it cannot be assumed that students understand images as representations of a subject-thematic context. Depending on prior knowledge, interests, and experiences, there are often very individual starting points that determine not only the direction of observation but also the discourse. The data offer insight into the interplay of the modes of representation, image, and language, in conjunction with the perspectives and competencies of the participants. The study shows that the strategy of switching representation levels from concrete to abstract is not inherently supportive of acquisition for learners of German as a Second Language, as previously assumed. Instead, they need further support in grasping the pictorial level, establishing connections, incorporating their own prior knowledge, and transforming what is observed and described into understanding.
References
Birkner, K., Auer, P., Bauer, A., & Kotthoff, H. (2020). Einführung in die Konversationsanalyse. Berlin, Boston: De Gruyter. Gibbons, P. (2015). Scaffolding Language, Scaffolding Learning (2nd ed.). Portsmouth: Heinemann. Hall, J. K., & Pekarek Doehler, S. (2011). L2 interactional competence and development. In J. K. Hall, J. Hellermann, & S. Pekarek Doehler (Eds.), L2 interactional competence and development (pp. 1–19). Bristol, Buffalo, and Toronto: Multilingual Matters. Hallet, W. (2008). Die Visualisierung des Fremdsprachenlernens – Funktionen von Bildern und visual literacy im Fremdsprachenunterricht. In G. Lieber (Ed.), Lehren und Lernen mit Bildern. Ein Handbuch zur Bilddidaktik (pp. 212–223). Baltmannsweiler: Schneider Verlag Hohengehren. Hammond, J., & Gibbons, P. (2005). Putting scaffolding to work: The contribution of scaffolding in articulating ESL education. Prospect, 20(1), 6–30. Retrieved from http://www.ameprc.mq.edu.au/__data/assets/pdf_file/0008/229760/20_1_1_Hammond.pdf HKM – Hessisches Kultusministerium. (n.d.). Handreichung Gesellschaftslehre zur Arbeit mit den Lehrplänen der Bildungsgänge Hauptschule, Realschule und Gymnasium an den schulformübergreifenden (integrierten) Gesamtschulen und Förderstufen. Retrieved from https://kultusministerium.hessen.de/Unterricht/Kerncurricula-und-Lehrplaene/Lehrplaene/Integrierte-Gesamtschule-IGS Jewitt, C. (2008). Multimodality and Literacy in School Classrooms. Review of Research in Education, 32(1), 241–267. https://doi.org/10.3102/0091732X07310586 Kniffka, G., & Neuer, B. (2017). Sprachliche Anforderungen in der Schule. In H. Günther, G. Kniffka, G. Knoop, & T. Riecke-Baulecke (Eds.), Basiswissen Lehrerbildung: DaZ unterrichten (pp. 37–49). Seelze: Klett-Kallmeyer. Kress, G., & van Leeuwen, T. (2021). Reading Images (3rd ed.). London: Routledge. Rowsell, J., & Collier, D. R. (2017). Researching multimodality in language and education. In K. King, YJ. Lai, & S. May (Eds.), Research methods in language and education. Encyclopedia of language and education (pp. 311–325). Springer, Cham. https://doi.org/10.1007/978-3-319-02249-9_23 Seedhouse, P. (2009). The interactional architecture of the language classroom. Bellaterra: Journal of Teaching & Learning Language & Literature, 1(1), 1–13. Sert, O. (2015). Social interaction and L2 classroom discourse. Edinburgh University Press. Thomson, K. (2022). Classroom discourse competence (CDC) in foreign language teaching and language teacher education. In K. Thomson (Ed.), Classroom discourse competence. Current issues in language teaching and teacher education (pp. 13–31). Tübingen: Narr Francke Attempto. https://doi.org/10.24053/9783823393740
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.