Impact And Effects Of School External Evaluation In the Intermediate Structures Of Curricular Management
Author(s):
Natália Costa (presenting / submitting)
Conference:
ECER 2015
Format:
Paper

Session Information

ERG SES H 03, Curriculum and Education

Paper Session

Time:
2015-09-08
11:00-12:30
Room:
305. [Main]
Chair:
Meinert Arnd Meyer

Contribution

Research question: What are the impacts and effects of school external evaluation in intermediate structures of management on organizational, curricular and pedagogical levels?

Objectives:

  • Question school external evaluation in its theoretical and methodological basics;
  • Critically review school external evaluation reports, as well as the contradictories used as referential in intermediate management;
  • Understand the perspectives of teachers, school principals and department coordinators on the school external evaluation;
  • Comprehend the point of view of school principals about the impact and effects of school external evaluation on school and community;
  • Analyze the perspective of department coordinators about the impact and effects of school external evaluation on organizational dimension;
  • Characterize teachers’ perspectives on the impact and effects of school external evaluation in terms of their curricular and pedagogical practices

Theorical Framework:

Rating is common to all society and schools, as part of society, don’t escape this reality. The process of school external evaluation results of political and social pressure to appraise the performance of public institutions, since at the eyes of society is necessary to be accountable of what they do. It seems that the evaluation of institutions will solve the problems highlighted by these institutions.

Being framed in transnational and supranational regulatory processes and policies that promote accountability and responsibility (Afonso, 2009), school external evaluation is linked, among other things, to the autonomy of schools, the professional development of teachers (Alves & Flores , 2011) and the movement of effective schools and school improvement, focusing, respectively, in the studies of effectiveness and efficiency. According to authors who have defined evaluation as the formulation of a judgment and award of merit evaluation has two components when reported to an institution or organization: the internal dimension and the external evaluation, the first being the responsibility of school and the second central government. For Marchesi (2002, p.35), these types of assessment "must be carried out simultaneously, but independently of each other. Both may become essential tools to change and improve schools, "even though the effects of internal evaluation are more recognized than the external evaluation (Simons, 1999). In this context, Bolivar (2012) considers the evaluation of schools as a dialogue between the external evaluation and internal evaluation, and the external evaluation is directed to the effectiveness in terms of results and internal evaluation for process efficiency. As a result, "the dialogue between the political accountability, a culture of evaluation and school self-evaluation is becoming an increasingly important issue" Barzanó (2009, p. 69).

The Portuguese system of school external evaluation was defined by the Law No. 31/2002 of 20th December and it was never subject of a thorough appraisal. The first external evaluation practices in Portugal, streamlined by the Ministry of Education, focused on the perspective of processes, with the purpose to institutionalize formative evaluation, with emphasis on the participation of schools and the integration of the dimensions to the evaluation of the object level. The process was elapsing with some normalcy and extended to all national public schools, but suffering some changes over the first cycle of evaluation based on what was proposed by the National Education Council.

Leadership has been identified as one of the solutions to solve many problems registering an increasing interest in the subject. In the perspective of many, strong leadership leads to a more productive and efficient organization. Top leaders are supported by the work of the rest of the team and, therefore, intermediate leadership exercised by the coordinators is vital. So, it’s imperative to understand to what extent intermediate leaderships are important and what the direct impact of their work is.

Method

In order to understand all phenomena and facts surrounding this research we will use a quantitative and qualitative methodology. The quantitative approach will be used with the application of a survey to teachers (n = 50), directors (n = 50) and departmental coordinators (n = 50). Therefore, we will produce three surveys and the gathered data will be treated statistically. The qualitative approach will be used with the application of interviews and, for that, we will prepare scripts to be applied to different coordinators, such as, department, series and projects (focal groups) and another script that will be applied to the coordinator of the self-evaluation team. Without ever neglecting the objectives to be achieved and the context surrounding the data gathering it is also necessary to analyze the Portuguese external evaluation reports and the contradictories published by National Education Council (2010, 2012) and international reports (Eurydice, 2015; OCDE, 2013; OCDE, 2012). The knowledge generated by the case study and the documental analyses will help to perform a triangulation of data and find more correct and deep data. So, as research techniques, we intended to create a script for the interviews to be applied to intermediate management coordinators through a discussion group; to create a guide semi-structured interview to be applied to the coordinator of the self-evaluation team; the development of different surveys that will be applied to teachers, principals and coordinators and, also, documental analysis generated by various dissertations and thesis gathered in dimensions, such as: models of evaluation, impact and evaluation, school evaluation and quality and school external evaluation.

Expected Outcomes

We expect to gather information that helps to confirm that school external evaluation is a process gaining importance in the Portuguese context and, also, the importance of school external evaluation as the provider of a guidance that helps public schools to improve success and provide better accounts of their work. We also look forward to identify the effects felt by the departments on curricular, pedagogical and organizational levels and understand if its effects are more accentuated on curricular, pedagogical or organizational levels. At the same time we hope to comprehend in what levels Portuguese teachers understand the process of school external evaluation and what are their expectations for this process, as well, if this kind of evaluation will provide them with the tools that allows them to improve, quality, efficiency, efficacy, accountability and, in the end, success.

References

Afonso, A. (2009). Nem tudo o que conta em educação é mensurável ou comparável. Crítica à accountability baseada em testes estandardizados e rankings escolares. Revista Lusófona de Educação (13), pp. 13-29. Alves, M. Flores, M. & Machado, E. (2011). Quanto vale o que fazemos? Práticas de avaliação de desempenho. Santo Tirso: De Facto. Barzanò, G. (2009). Culturas de liderança e lógicas de responsabilização. Gaia: Fundação Manuel Leão. Bolívar, A. (2012). Melhorar os processos e os resultados educativos. Gaia: Fundação Manuel Leão. Conselho Nacional de Educação (2010). Parecer sobre Avaliação Externa das Escolas (2007-2009). Lisboa: CNE. Conselho Nacional de Educação (2012). Avaliação Externa das Escolas 2010-2011 – Relatório. Lisboa: CNE. European Commission, EACEA, Eurydice (2015). Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Eurydice Report. Luxembourg: Publications Office of the European Union. Lei nº31/2002, de 20 de dezembro – Aprova o sistema de educação e ensino não superior, desenvolvendo o regime previsto na Lei nº 46/86, de 14 de outubro (Lei de Bases do Sistema Educativo). Marchesi, A. (2002). Mudanças educativas e avaliação de escolas. In J. Azevedo (Org). Avaliação de escolas. Consensos e divergências. Porto: Edições Asa. OECD (2012). Education at a Glance 2012: Highlights. OECD Publishing. Retrieved from http://dx.doi.org/10.1787/eag_highlights-2012-en OECD (2013). Synergies for Better Learning: An international perspective on evaluation and assessment. OECD Publishing. Retrieved from http://dx.doi.org/10.1787/9789264190658-en Simons, H. (1999). A avaliação e reforma das escolas. In A. Estrela & A. Nóvoa (Orgs). Avaliações em educação: novas perspetivas. Porto: Porto Editora.

Author Information

Natália Costa (presenting / submitting)
Minho's University, Portugal

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.