Session Information
30 SES 11 C, Assessing ESE and Programs
Paper Session
Contribution
The aim of this project is to develop an inquiry skills measure for Year 8 students (13- to 14-year-olds) in a secondary school in Victoria, Australia. The measure is to be used to examine the readiness of the students to undertake a learning inquiry program in Year 9 on sustainability issues. The program combines sustainability education with 21st century skills learning, which is pertinent not only to the Australian curriculum (Australian Curriculum Assessment and Reporting Authority, 2015) but also education focus in Europe (United Nations Economic Commission for Europe, 2005) and in many other parts of the world (Ananiadou & Claro, 2009; Griffin & Care, 2015). This paper describes the development of the inquiry skills measure which provides information about the adjustments that may need to be made to the learning inquiry program through identifying the learning needs of the students.
To provide more context, the learning inquiry program is designed for Year 9 students (14- to 15-year-olds) and aims to promote 21st century skills (Binkley et al., 2012) and to encourage students to make informed choices and positive actions around sustainable living. During the program, students embark on an intensive four-week period of research and investigation in order to answer the question: "How can we think globally and act locally for a sustainable future?" In teams and small groups, the students will learn to generate relevant questions and seek information to answer those questions while exploring topics such as production and consumption, energy, transport, people and population, and biodiversity. At the end of the four-week inquiry cycle, students present their understanding of the topics at an exhibition that is open to the public.
In light of the scope of the Year 9 learning inquiry program, the readiness measure developed particularly focuses on assessing the kinds of connections that students are trying to make when processing and making sense of information. The construct is captured by the notion of epistemic cognition, which relates to a person’s theory of knowledge (epistemological beliefs) and the processes involved in the definition, acquisition, validation, and use of knowledge (Greene, Azevedo, & Torney-Purta, 2008; Grix, 2002). It is operationalised for the measure through examining the underlying evaluative criteria on which decisions of a person are dependent when trying to make sense of and act on information. Epistemic cognition has been theorised to underpin inquiry skills (Sandoval, 2005) and is closely related to reasoning and critical thinking (King & Kitchener, 2004). The construct overlaps with comprehension (understanding of information), but goes beyond that to involve reasoning, evaluative judgment, and decision-making.
Five levels of epistemic cognition ordered in increasing sophistication were theorised, beginning with the lowest level where a person engages with the information/task in a superficial manner and progresses to more complex connections a person might make when processing information (e.g., making comparison or examining assumptions). The levels theorised is consistent with existing developmental theories of epistemic cognition which tend to begin with a more "black-and-white" or dualistic view of the world as the starting level and approaching a more relativistic stance at the more sophisticated level (Felder & Brent, 2004). A rationale for this particular formulation of the progression is because the topic of sustainability involves complex issues that often do not have straightforward solutions. For example, recycling might help to reduce wastes but may have the unintended consequence of requiring the use of more resources (e.g., water and energy) than using raw or primary materials. To contemplate such complex issues therefore requires relational and analytical thinking beyond personal preference or "common sense".
Method
Expected Outcomes
References
Ananiadou, K., & Claro, M. (2009). 21st century skills and competences for new millennium learners in OECD countries. Paris: OECD. Australian Curriculum Assessment and Reporting Authority. (2015). Critical and creative thinking learning continuum. Sydney, Australia: Author. Retrieved from http://www.australiancurriculum.edu.au/generalcapabilities/critical-and-creative-thinking/continuum Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In P. Griffin, B. McGaw & E. Care (Eds.), Assessment and teaching of 21st Century skills (pp. 17-66). Dordrecht, The Netherlands: Springer. Felder, R. M., & Brent, R. (2004). The intellectual development of science and engineering students. Part 1: Models and challenges. Journal of Engineering Education, 93(4), 269-277. Greene, J. A., Azevedo, R. A., & Torney-Purta, J. (2008). Modeling epistemic and ontological cognition: Philosophical perspectives and methodological directions. Educational Psychologist, 43(3), 142-160. Griffin, P. E., & Care, E. (Eds.). (2015). Assessment and teaching of 21st century skills: Methods and approach. Dordrecht, The Netherlands: Springer. Grix, J. (2002). Introducing students to the generic terminology of social research. Politics, 22(3), 175-186. Irribarra, D. T., & Freund, R. (2014). Wright map: IRT item-person map with ConQuest integration R package (Version 1.1). Berkeley, CA: University of California. Retrieved from http://github.com/david-ti/wrightmap Kiefer, T., Robitzsch, A., & Wu, M. (2015). TAM: Test analysis modules R package (Version 1.6-0). Salzburg, Austria: Bundesinstitut für Bildungsforschung, Innovation & Entwicklung des österreichischen Schulwesens. Retrieved from http://CRAN.R-project.org/package=TAM King, P. M., & Kitchener, K. S. (2004). Reflective judgment: Theory and research on the development of epistemic assumptions through adulthood. Educational Psychologist, 39(1), 5-18. Masters, G. N., & Wright, B. D. (1997). The partial credit model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 101-121). New York: Springer. R Core Team. (2014). R: A language and environment for statistical computing (Version 3.1.0 GUI 1.64). Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org Robitzsch, A. (2015). sirt: Supplementary item response theory models R package (Version 1.5-0). Salzburg, Austria: Bundesinstitut für Bildungsforschung, Innovation & Entwicklung des österreichischen Schulwesens. Retrieved from http://CRAN.R-project.org/package=sirt Sandoval, W. A. (2005). Understanding students' practical epistemologies and their influence on learning through inquiry. Science Education, 89(4), 634-656. United Nations Economic Commission for Europe. (2005). Strategy on education for sustainable development. Geneva, Switzerland: Author. Wilson, M. (2005). Constructing measures: An item response modeling approach. Mahwah, NJ: Lawrence Erlbaum Associates.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.