External Specialist Support for School Self-evaluation: Testing a Model of Support in Irish Post-Primary Schools
Author(s):
Shivaun O'Brien (presenting / submitting) Gerry McNamara (presenting) Joe O'Hara
Conference:
ECER 2016
Format:
Paper

Session Information

09 SES 05 C, External School Evaluations and School Self-evaluations

Paper Session

Time:
2016-08-24
13:30-15:00
Room:
NM-F107
Chair:
Jana Poláchová Vaštatková

Contribution

In recent decades, self-evaluation has become a key mechanism for school improvement. Countries that have introduced school self-evaluation (SSE) generally provide a range of support measures in order to encourage school engagement in the process (European Commission 2015, OECD 2013). Such measures include: “specialist training in internal evaluation, use of external evaluation frameworks, indicators enabling schools to compare with other schools, specific guidelines and manuals, online forums, as well as advice from external specialists, and financial support.” (European Commission 2015 p.11). Despite the provision of such supports, many countries continue to experience capacity and implementation issues(OECD 2009,OECD 2013, Ryan, Chandler, & Samuels 2007, Schildkamp & Visscher 2009,  Vanhoof, Van Petegem, and De Maeyer 2009.

 This paper explores the provision of external specialist support for schools engaging in SSE, in an attempt to address implementation issues. The European Commission (2015) identify 23 countries or jurisdictions where external specialists provide support for SSE and describe external specialists as “persons not directly involved in the activities of the school carrying out internal evaluation and who support the evaluation process in various possible ways. Resource persons have expertise in the field of education or evaluation and can be from a variety of professional backgrounds (academic experts working in the areas relevant to the evaluation of schools, private consultants, teacher trainers, experts from public sector institutions” (p 54).

A model of external support was developed by the Centre for Evaluation, Quality and Inspection based in Dublin City University (DCU), Institute of Education. The model is based on previous research carried out by O’Brien (2011) which was redeveloped and updated for application in post-primary schools and involves the provision of external support in the form of a critical facilitator (O’Brien, McNamara & O’Hara 2014, 2015). This model of support was tested in five post-primary schools in Ireland over a one- year period. The research explores the previous levels of engagement by the schools in self-evaluation and then documents their engagement in the DCU facilitated process. The outputs of the SSE processes in each school are outlined as are the views of school management and participating teachers in relation to the model of support being tested.

Method

An action research methodology is employed and implemented over a one-year period in five post-primary schools. The findings presented, represent the outcomes of the first research cycle. Using a questionnaire, data was gathered on levels of engagement and attitudes of school management to the SSE process which was introduced in Ireland in 2012. The model of support was then implemented consistently in all five schools and resulted in the completion of a full SSE cycle including the gathering and analysis of data, the completion of a self-evaluation report and an improvement plan in keeping with the Irish Department of Education and Skills (2012) guidelines for SSE. Focus groups were then held with the SSE team in each of the five schools in order to explore attitudes towards the DCU Model of Support and the Principal of each participating school was also interviewed in order to ascertain the leadership perspective.

Expected Outcomes

The findings indicate that the DCU Model of Support was positively received by the Principals and SSE Teams in all five participating schools. All schools completed a full cycle of the SSE process over the course of a school year including schools that had never previously engaged in an SSE process. Overall, findings indicate that lack of time, negative perceptions and a lack of expertise among the school staff were the main reasons for non-engagement in the SSE process heretofore. Participants in the research claimed that the model of support made the SSE process easier as it is grounded in the realities of schools. The importance of the support being provided by an external expert (critical facilitator) was identified as a key element as was the leading role adopted by the critical facilitator. Despite this approach the findings indicate high levels of ownership among SSE teams and suggest that the modelling of good practice by an external expert resulted in capacity building within each school. Therefore, this model of support may have implications for the design of national supports for SSE, particularly those provided at an early stage in the introduction of such reforms or to address issues of non-engagement or poor practice where such occurs.

References

European Commission/EACEA/Eurydice. 2015. Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Eurydice Report. Luxembourg: Publications Office of the European Union. Department of Education and Skills. (2012). School self-evaluation guidelines for post-primary schools. Dublin: Department of Education and Skills. McNamara, G., & O’Hara, J. (2012). From looking at our schools (LAOS) to whole school evaluation management, leadership and learning (WSE-MLL): the evolution of inspection in Irish schools over the past decade. Educational Assessment, Evaluation and Accountability, 24, 79–97. OECD. (2013). Synergies for better learning: an international perspective on evaluation and assessment. Paris: OECD. O’Brien, S., McNamara, G. & O’Hara, J., 2015. Supporting the consistent implementation of self-evaluation in Irish post-primary schools. Educational Assessment, Evaluation and Accountability, pp.1–17. O’Brien, S., McNamara, G., & O’Hara, J. (2014). Critical facilitators: External supports for self-evaluation and improvement in schools. Studies in Educational Evaluation, 43, 169–177. Ryan, K. E., Chandler, M., & Samuels, M. (2007). What should school based evaluation look like? Studies in Educational Evaluation, 33, 197–212. Schildkamp, K., & Visscher, A. (2009). Factors influencing the utilisation of a school self-evaluation instrument. Studies in Educational Evaluation, 35, 150–159. Vanhoof, J., Van Petegem, P., & De Maeyer, S. (2009). Attitudes towards school self-evaluation. Studies in Educational Evaluation, 35, 21–28.

Author Information

Shivaun O'Brien (presenting / submitting)
Dublin City University, Institute of Education, Ireland
Gerry McNamara (presenting)
Dublin City University, Institute of Education, Ireland
Dublin City University, Institute of Education, Ireland

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.