Design and validation of a survey to measure: Perception of elementary teachers on student achievement in terms of key competences
Conference:
ECER 2014
Format:
Poster

Session Information

27 SES 05.5 PS, General Poster Session

General Poster Session, Chaired by Convenors of NW 27

Time:
2014-09-03
12:30-14:00
Room:
Poster Area D (between B014 - B018)
Chair:

Contribution

Introduction

Key competences are a topic of recent introduction in the Spanish educational system. The adoption of the Organic Law of Education (LOE) 2006 is directly linked to the recommendations made by European education agencies (European Commission, 2005). Competences were introduced into the curriculum of elementary education to give young students the knowledge and key competences for full participation in society. All started with the DeSeCo Project. Its conceptual framework classifies such competences in three broad categories. First, individuals need to be able to use a wide range of tools for interacting effectively with the environment: both physical ones such as information technology and socio-cultural ones such as the use of language. Second, in an increasingly interdependent world, individuals need to be able to engage with others, and since they will encounter people from a range of backgrounds. Third, individuals need to be able to take responsibility for managing their own lives, situate their lives in the broader social context and act autonomously. Each of these categories has, according DeSeCo, a specific approach, are interrelated, and collectively build the basis for identifying and defining the eight key Spanish competences. Under this proposal made by the European Union, at the Spanish level, it was defined eight key competences to be delivered along Elementary and Secondary Education: 1) Communication competence; 2) Mathematical competence; 3) Knowledge and interaction with the physical environment; 4) Data processing and digital competence; 5) Social and civic competence; 6) Cultural and artistic competence; 7) Lifelong learning; and 8) Autonomy and personal initiative.

 

It is important to noted that the incorporation of competences in the curriculum should not be understood as a single element to be developed, but should be considered as the axis around which all curricular elements must turn around. This is essential for a conceptual and methodological shifting the educational community. However, to date there no assessment tools to assess the perception of teachers on student achievement in terms of key competences. However, to date there no assessment surveys to measure the perception of elementary teachers on student achievement in terms of key competences. Their perceptions, concerns, perspectives and motivations in this process are unknown. Given that teachers are the agents to bring the change, it is necessary to see how this process is being developed.Many studies have the purpose of analyse the study of key competences (Escamilla, 2008; Moya and Luengo, 2010; Sarramona, 2004; Etelälahti and SahiRychen, 2001; Kelly, 2001; Knain, 2001; Lassnigg, Mayer, and Svecnik, 2001). The purpose of this study is to design and validate a questionnaire to measure the perceptions of elementary teachers on student learning after inclusion of key competences in the Spanish educational context.

Method

Method To assess the perception of elementary teachers about key competences it was developed a questionnaire. To study the validity of the questionnaire it was analyzed the: (a) content validity, (b) understanding validity, and construct validity. This procedure was developed following the phases proposed by Carretero-Dios and Pérez (2005). The reference construct was the perception of teachers on the inclusion of key competences in elementary education. The dimensions that define it were chosen of a selection of chapters from the LOE considered relevant by its direct relationship with the key competences. The dimensions chosen were: Aims of education, curriculum (objectives, content, methodology and evaluation principles), Students with specific educational need support, Functions of teachers, teacher education (initial and in-service), Institutional autonomy (Educational and Annual General programming) project, and financial resources. Then it was done the definition of the items that belongs to each dimension to be evaluated by a panel of experts. They were asked to rank with a likert scale, with scores from one (strongly disagree) to five (strongly agree), about the relation between the dimension and the construct, the relation of the items and the dimension, the writing style, and the level of understanding. A double scale was developed for teachers could you assess the learning of students in second or third cycle. Construct, dimensions and items were evaluated by 37 experts on the subject: (a) 17 elementary teachers whose area of specialization was psychology (four), sociology (two) and pedagogy (two per each of the following: Spanish language and literature, foreign language, social science, geography, history, physical education, mathematics, natural sciences, technology, art and visual education, music) and (b) 20 senior lecturers with a specific research interest in elementary subjects: Spanish language and literature, foreign language, social science, geography, history, physical education, mathematics, natural sciences, technology, education and plastic visual, music.

Expected Outcomes

Construct Following assessment of the experts on the adequacy, appropriateness and exhaustivity of each of the dimensions and the corresponding items, descriptive construct score was obtained. The construct had an average score of 8.76(1.09), relating to the valuation of 8.68(1.06) in exhaustivity, and 8.84(1.12) in the definition, 9.37(1.06) in exhaustivity and 9.50(0.76) in definition, from the perception of elementary teachers (n=20). The senior lecturers gave a mean score of 9.44(0.91). High values of exhaustivity 9.02(1.06) and of appropriateness to 9.17(0.94) definition are reached, obtaining a final score of the construct of 9.1(1.00). Dimensions Eight dimensions were established in the initial development of the questionnaire, each defining each key competence. After the review and assessment of the experts, these dimensions were maintained. Since high values of score in each were obtained. The assessment received by elementary teachers and senior lecturers were respectively as follows: “Communication skills” 8.68(1.39) and 9.68(0.87); “Mathematical competence” 8.92(1.09) and 9.87(0.34); “Knowledge and interaction with the physical environment” 8.77(1.20) and 9.43(1.20); “Data processing and digital competence” 8.40(1.83) and 8.93(2.14); “Social and civic competence” 8.27(1.99) and 9.00(2.03); “Cultural and artistic competence” 8.5(1.46) and 9.18(1.83); “Lifelong learning” 9.02(1.18) and 8.93(2.14); and “Autonomy and personal initiative” received a score of 8.9(1.12) by elementary teachers and 9(2.22) by senior lecturers. Items Initially the questionnaire consisted of 39 items. Later, after completing two rounds of review by the expert judges, 48 items were finally established. Since these were the items that received a high average rating by elementary teachers 8.7(1.4), and was also elevated the average score received from the senior lecturers 8.8(2.4). Conclusions The final version of the questionnaire in its original language will be displayed and discussed at the presentation of the work.

References

References Carretero-Dios, H., y Pérez, C. (2005). Normas para el desarrollo y revisión de estudios instrumentales. International Journal of Clinical and HealthPsychology, 5, 521-551. Comisión Europea. (2005). Propuesta del Parlamento Europeo y del Consejo sobre las competencias clave para el aprendizaje permanente. Extraído el 18 de octubre, 2007 de http://ec.europa.eu/education/policies/2010/doc/keyrec_ es.pdf Escamilla, A. (2008). Las competencias básicas. Claves para su desarrollo en los centros. Barcelona:Graó. Etelälahti, A., & Sahi, A. (2001). Summary report for Finland on the DeSeCo Country Contribution Process. Prepared as part of the Country ContributionProcess (CCP) conducted by the DeSeCo Project. Kelly, F. (2001). Summary report for New Zealand on the DeSeCo Country Contribution Process. Prepared as part of the Country Contribution Process (CCP) conducted by the DeSeCo Project. Knain, E. (2001).Summary report for Norway on the DeSeCo Country Contribution Process. Prepared as part of the Country Contribution Process (CCP) conducted by the DeSeCo Project. Lassnigg, L., Mayer, K., & Svecnik, E. (2001). Summary report for Austria on the DeSeCo Country Contribution Process. Prepared as part of the Country Contribution Process (CCP) conducted by the DeSeCo Project. Moya, J., y Luengo, F. (2010). La concreción curricular de las competencias básicas: un modeloadaptativo e integrado. CEE Participación Educativa, 15, 127-141. Sarramona, J. (2004). Las competencias básicas de la enseñanza obligatoria. Barcelona: CEAC.

Author Information

Lourdes Meroño García (presenting / submitting)
UCAM, University of Murcia, Spain
UCAM, University of Murcia, Spain
UCAM, University of Murcia, Spain
University of Oviedo, Spain

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.