Assessing the Impact of Active Learning Strategies on Tests Performance – a 3 Year Longitudinal Study
Author(s):
Filipe Rodrigues Silva Ferreira (presenting / submitting) Tiago Henriques- Coelho (presenting)
Conference:
ECER 2015
Format:
Paper

Session Information

ERG SES G 11, Learning and Education

Paper Session

Time:
2015-09-08
09:00-10:30
Room:
336. [Main]
Chair:
György Mártonfi

Contribution

In a twenty first century society, students are expected to balance cognitive, personal, and interpersonal abilities. In fact, business and political leaders are increasingly asking schools to develop skills such as problem solving, critical thinking, communication, collaboration, and self-management - often referred to as "21st century skills.", as mentioned in a National Research Council of the National Academies of Science report, in 2012. To achieve their full potential as adults, students need to develop a range of skills and knowledge that facilitate mastery and application of a variety of shifting subjects. Bearing this in mind, the incorporation of active learning strategies into the daily routine of classroom instruction may help students develop interpersonal skills such as complex communication and teamwork and intrapersonal skills such as resiliency and resourcefulness. Active learning can be defined as "anything that involves students in doing things and thinking about the things they are doing" (Bonwell & Eison, 1991), or as "anything course related that all students in a class session are called upon to do other than simply watching, listening and taking notes" (Felder & Brent, 2009).

Active learning strategies or techniques are based on the assumption that students learn more when they participate in the process of learning, either through discussion, practice, review, or application (Grunert, 1997). Even though this definition includes any instructional method that engages students in the learning process (often contrasting with the traditional lecture where students passively receive information from the instructor), some activities are particularly well suited to develop in an active learning class  (Felder & Brent, 2003; Petty, 2009), such as cooperative work, jigsaw discussion, think-pair-share, case study or problem based learning (students use an investigative process to discover scientific or engineering answers for themselves). Most of these strategies were chosen based on an above average effect size (Marzano, 2001; Hattie, 2009), granting a greater measure of evidence based teaching and learning.

The present study conducted a longitudinal quantitative research methodology over three school years (from 2011/ 2012 to 2013/ 2014), involving two classes of students (n=36) and the same teacher, from the seventh (approximately 12 years old) to the ninth grade (approximately 15 years old) of their schooling. Itanalyses and compares the impact of active learning strategies and traditional lecture-based strategies on student’s Geography tests performance, through a quantitative analysis of students’ scores on Lower Order Thinking and Higher Order Thinking Skills questions, based on the SOLO taxonomy (Biggs & Collis, 1982). It also analyses and compares survey data conducted amongst the students in the seventh and ninth grade about the pupils’ perspectives of the different innovations carried out in classroom during the school years.

Its main objective consisted on identifying the changes that active learning techniques have produced in student´s tests scores and student´s perceptions on their own learning process. Results show that students’ performance on contents taught through active learning techniques progressively and significantly improves in higher order thinking questions, compared to those taught by traditional teaching techniques, and that students became increasingly aware of active learning methods as a way of enhancing their own learning experience. Since international research on the same subject seems to point to the same overall conclusions (Prince, 2004; Michael, 2006)), this may lead to greater European emphasis on developing active learning in the classroom.

Method

The longitudinal study accompanied a cohort of two classes of seventh grade students (n=36), with the same Geography teacher, along three school years (from 2011/ 2012 to 2013/ 2014), during which active learning lessons were taught, interspaced with traditional lessons. Topics that were taught actively in one class were taught traditionally in the second one and vice versa (possible ethical questions advised against the use of an experimental design with a treatment and control group). At least half the curriculum was taught using cooperative work, jigsaw discussion, think-pair-share, case study, problem based learning and other features designed to address a full spectrum of student learning styles (Felder, 1993), while the rest of the curriculum was taught through more lecture and expository based lessons Throughout the study both classes held two ninety minute tests per school term. These were composed of lower and higher order thinking questions on contents taught resorting to either traditional or active based strategies. Collected students scores (repeated-measures data) in the different types of questions were examined and compared using arithmetic means (AM) and standard deviations (SD). The tests had a similar question structure throughout the three years, so they could be comparable across the grades. Relation between test performance and learning at different levels of knowledge relied upon Bigg’s structure of the observed learning outcome (SOLO) taxonomy (it is described by five sequential levels of performance: pre-structural, uni-structural, multi-structural – lower order thinking skills - relational and extended – higher order thinking skills). In comparison to Bloom’s taxonomy (Bloom, 1956) the SOLO taxonomy is more easily applied when scoring answers and it also makes the classification more evident. Furthermore, the SOLO taxonomy is organized in a learning progression manner, where the lower levels are assumed to precede the higher levels. A survey, related to students’ perceptions on active learning strategies and the learning process as a whole, was also conducted during the study´s first and last year. Quantitative data from these surveys was analyzed and compared. A diagnostic test performed by both classes before the beginning of the study showed that class B had slightly higher scores in both lower and higher order thinking scores, but the difference between the overall grade-point averages recorded by the two groups was negligible. In short, both classes began the longitudinal study with very similar test results.

Expected Outcomes

A quantitative analysis of test scores collected during the three year study shows that: despite initial fluctuations (specially in the seventh grade, where test scores decreased and standard deviation increased during the school year´s first half), the standard deviation decreased (16% to 10%), and the overall mean tests increased (66% to 77%) specially on higher order thinking questions taught by active learning (42% to 66%), compared to the same questions taught by traditional methods (48% to 55%). Lower order thinking questions taught by active learning show slightly better results (69% to 76%) than lecture taught questions (70% to 74%). Based on these results, active learning methodology seems to have a positive impact on test scores (increasing overall mean scores and decreasing standard deviation), especially on higher order thinking questions, compared to traditional learning methodology. On the other hand, active learning doesn´t seem to have such a high impact on lower order thinking question scores, compared to traditional learning methodology. The future use of paired t-test analysis or analysis of covariance (ANCOVA), may help determine two major research questions: if significant statistical differences exist between questions based on active learning or on traditional learning; if significant statistical differences exist between higher and lower order thinking questions taught via active learning techniques or traditional lecturing techniques. Comparing student’s survey results shows that students felt that interest or motivation in lesson activities remained high throughout the study. Fewer students claimed to feel under pressure during active learning classes and more students are convinced that they can learn from their mistakes, so it´s relatively ok to make mistakes. Most students claimed these activities enabled them to search and think of different solutions, and metacognition is clearly promoted, since most students state that they think about what they are learning and how they are learning.

References

Bloom, B. S. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc. Biggs, J. B., & Collis, K. F. (1982). Evaluating the quality of learning. New York: Academic Press. Felder, R.M., "Reaching the Second Tier: Learning and Teaching Styles in College Science Education," Journal of College Science Teaching, vol. 23, no. 5, 1993. Felder, R.M., & Brent, R. (2003). Learning by doing. Chemical Engineering Education 37(4). Hattie, J. (2009) Visible Learning. Routledge Marzano, R. (2001). Classroom Instruction that Works. ASCD, USA. Michael, J. (2006). Where's the evidence that active learning works?. Advances in Physiology Education, 30(4), National Research Council (2012). Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century. Washington, DC: The National Academies Press. Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York, NY: Oxford university press. Petty, G. (2009). Teaching Today a Practical Guide. Nelson Thornes Ltd. Prince, M. (2004). Does Active Learning Work? A Review of the Research. Journal of Engineering Education, 93(3).

Author Information

Filipe Rodrigues Silva Ferreira (presenting / submitting)
Colégio Casa Mãe
Geography
Paredes
Colégio Casa Mãe, Portugal

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.