A Randomized Controlled Trial of Student Success Skills: An Innovative Curriculum to Improve Academic Achievement for All Students
Author(s):
John Carey (submitting) Greg Brigman (presenting) Linda Webb
Conference:
ECER 2014
Format:
Paper

Session Information

03 SES 09 B, Underpinnings of Curriculum Change

Paper Session

Time:
2014-09-04
11:00-12:30
Room:
B111 Sala de Aulas
Chair:
Wilmad Kuiper

Contribution

The identification of effective curricula and teaching approaches that promote the development of students’ abilities to direct their own learning and engage effectively in the academic learning process is a critically important need across the international community of educators.  This presentation will report the results of a randomized controlled trial of Student Success Skills (SSS) (a classroom based school counseling curriculum) to determine its effects on the academic outcomes for participating students.  This research project was supported by a $2.7 million grant from the US Department of Education’s Institute of Education Sciences (IES) to fully fund a four-year research effort.

 

The Student Success Skills (SSS) curriculum was developed to systematically teach students fundamental learning, social, and self-management skills that have been demonstrated to link to improved academic achievement outcomes. SSS is based on a strong body of theoretical and empirical research (see Hattie et al., 1996; Masten and Coatworth, 1998; Wang et al., 1994) and uses developmentally appropriate student lessons, activities, and teaching strategies.  The curriculum has been widely used in elementary, middle, and high schools across the United States for the past ten years.  A meta analysis of the first five studies on the SSS program found an overall student gain on standardized math and reading scores equivalent to an additional full year of learning in math and ½ additional year of learning in reading (Villares, Frain, Brigman, Webb & Peluso, 2012) These five studies have supported the efficacy of the SSS program in impacting academic outcomes for students who participate in the large and small group components of the intervention  (Brigman & Campbell, 2003; Brigman, Webb & Campbell, 2007; Campbell & Brigman, 2005; Leon, Villares, Brigman, Webb & Peluso, 2010; Webb, Brigman & Campbell, 2005).  Although these studies document the positive outcomes achieved by participation in SSS, a number of important research elements have not been captured by previous studies. The purpose of the proposed project is to allow for rigorous research to evaluate both the proximal and distal outcomes resulting from whole classroom participation in SSS.

 

SSS skills and strategies through which student outcomes are improved fall into five areas: 1) Goal setting, progress monitoring; 2) Creating a caring, supportive, and encouraging classroom community; 3) Cognitive and memory skills; 4) Performing under pressure and managing anxiety; and, 5) Building healthy optimism.

 

We hypothesize that student’s participation in the SSS five (45 minute) classroom lessons and a change in teachers’ classroom practices (modeling, cueing, and coaching students to use SSS strategies) will lead to an increase in the use of SSS strategies by students (measured by the Student Engagement in School Success Skills survey.  We also hypothesize that there will be an improvement in classroom climate (as measured by the My Class Inventory).  As a result of increased SSS strategy use and improved classroom climate, we anticipate that there will be increase in the behavioral engagement, cognitive engagement, self-efficacy, and social competence of students as well as a reduction of test anxiety (measured the Student Participation Questionnaire, the Social Skills Rating System, the Motivation Strategies for Learning Questionnaire, and the Self- Regulated Learning Scale. In addition we hypothesized that there would be an improvement in academic achievement (as measured by the Florida Comprehensive Assessment Test and grades) and student engagement (measured by attendance).

Method

This study employed an experimental design with random assignment of schools (30 schools per group; 60 total schools form two large Florida districts) to either treatment or comparison conditions. SSS was implemented with fidelity checks in all the 5th grade classrooms of the Experimental schools. Comparison schools conducted and recorded “business as usual” activities. Over 4,000, 5th graders participated in this study Measures of SSS effects include teacher reports (student classroom-related social competence and engagement and a measure of classroom climate), student self-reports (cognitive engagement, behavioral engagement, self-efficacy, test anxiety, and self-regulation of learning strategies), as well as institutional data (standardized test scores, attendance, and grades). Teacher reports and student self-reports were collected for students in treatment and comparison conditions at three data collection points for one year. Process measures will assess fidelity of intervention implementation and level to which teachers modeled, cued, and coached students to use SSS strategies throughout the year. SSS was implemented by trained school counselors. Classroom teachers were also trained in modeling, cueing, and coaching the use of SSS strategies in daily learning activities to help students master the curriculum throughout the school year. The primary analyses used hierarchical linear modeling using covariates to reduce error variance, thus, increasing power. HLM addresses the clustered/multi-level nature of the data in which students are nested within schools. The meditational effects of the proximal outcomes of the intervention (e.g. increased social competence, cognitive engagement) on increased achievement were also tested.

Expected Outcomes

By the time of the ECER conference we will just be beginning Year 4 of the research project (the year dedicated to dissemination of results). As of right now, all data are collected, and the databases have been verified. We have verified that SSS was implemented with fidelity and have measured the extent to which teachers support student use of SSS strategies in the classroom (an important moderator of SSS effectiveness). HLM and meditational analyses have begun. In these analyses, we expect to demonstrate that students in the Experimental schools had higher academic achievement (replicating previous quasi-experimental studies) and engagement than students in the Comparison schools. Furthermore, we expect to be able to identify which proximal changes in students (e.g. increased self-efficacy, increased self-regulation abilities) mediate the effects of SSS on academic achievement and engagement.

References

Brigman, G. & Campbell, C. (2003). Helping students improve academic achievement and school success behavior. Professional School Counseling, 7, 91-98. Brigman, G., Webb, L., & Campbell, C. (2007). Building skills for school success: Improving academic and social competence. Professional School Counseling, 10, 279-288. Campbell, C., & Brigman, G. (2005). Closing the achievement gap: A structured approach to group counseling. Journal for Specialists in Group Work, 30, 67-82. Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills interventions on student learning: A meta-analysis. Review of Educational Research, 66, 99-130. Leon, A., Villares, E., Brigman, G., Webb, L., & Peluso, P. (2011). Closing the Achievement Gap of Hispanic Students: A School Counseling Response. Counseling Outcome Research and Evaluation, 2, 73–86. doi:10.11772150137811400731 Masten, A.S., & Coatworth, J.D. (1998). The development of competence in favorable and unfavorable environments: Lessons from research on successful children. American Psychologist, 53, 205-220. Wang, M.C., Haertel, G.D., & Walberg, H.J. (1994). What helps students learn? Educational Leadership, 51, 74-79. Webb. L., Brigman, G. & Campbell, C. (2005). Linking school counselors and
student success: A replication of the Student Success Skills approach targeting the academic & social competence of students. Professional School Counseling, 8, 407-411.

Author Information

John Carey (submitting)
University of Massachusetts
RF Fredrickson Center for School Counseling Outcome Research
Amherst
Greg Brigman (presenting)
Florida Atlantic University
Counselor Education
Boca Raton
Florida State University, United States of America

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.