Construct validation of an instrument to assess "Learning to learn" competence in education practitioners.

Session Information

01 SES 01 B, The Quality of Professional Development

Paper Session

Time:
2013-09-10
13:15-14:45
Room:
B-203
Chair:
Sara Bubb

Contribution

Since last decade, education has turned to a model oriented to competence development. As seen in numerous contributions (Delors, 1996; Eurydice, 2002; DeSeCo Project, 2005), this concept has become a conceptual benchmark for the design, development and organization of education.

Within this framework, the European Higher Education Area has incorporated this pedagogical orientation, noting the need to address the development of general and specific competences in all degrees.

These proposals are reflected in all curricula design of university degrees in Spain and the European Union. Specifically, at the University of Valencia, within the general competences of the degrees of the Faculty of Philosophy and Educational Sciences, it identifies the competence CG14: self-contained long life learning.

The overall objective of our research is to provide a theoretical definition of the construct "learning to learn" competence, operationalized for the design of tools for professional evaluation in education. The specific objectives are to analyze the theoretical development, research and evaluation of the competence, establishing an operational definition of the construct and its transfer to evaluation criteria, to finally provide an initial evidence of construct and content validation from interjudges assessment.

The questions that have guided our work are, among others: competence learning to learn is manifested equally throughout lifetime? Is it general or specific to each professional field? What elements or sub-competencies can be recognized in the competence "learning to learn?

Recognize this competence as a requirement for college students is a need with strong practical implications related to the quality of professional work of future graduates of our universities. It also has a general aspect, as it shares basis with all professionals, although in a given sector is specialized, making it dependent on the working area.

 

We have focused on the design of an instrument to assess the competence into education practitioners field. The phases of the research that has been carried out were as follows:

1. Defining the construct “Learning”.[g1] 

2. Operationalization of the construct definition.

3. Validation of the theoretical construct definition and representation from the selected criteria.

Our definition of competence "learning to learn" (Jornet, García-Bellido and Gonzalez, 2012), focused on education practitioners and includes three dimensions: understanding of scientific languages of the disciplinary field; knowledge and use of resources to improve professional work and attitudes towards their professional development.

We also identified sub-dimensions within each dimension evaluated, such as the identification, conceptualization, reasoning, problem solving, critical thinking and metacognition. The construct validation relied on the judgment of experts that assessed the fit to the definition, dimensions, and the evaluation criteria.

Method

The sample consisted of 21 teachers (secondary and university), of which 67% were women and 33% men. In our sample, 57% of teachers were subscribed to specific magazines of their work discipline, while 43% were not. Seven teachers were involved in innovation projects, compared to 67% who were not. The vast majority, except a person, were educational websites users. Finally, the educational work experience ranged between 1 and 27 years, although most of the participants have work experience over five years. The documentary study, which was the basis for the design of the definition of competence, was based on a review analysis on available instruments. And an empirical study that involved the following steps: design of a scale for the competence, interjudges evaluation about the representativeness of the dimensions in relation to construct definition, taking into account evaluation criteria such as: relevance of the dimension to the definition and exchange susceptibility (namely, whether it could be modified by teaching processes). The scale was administered in an online platform, and finally, data analyses consisted in reliability inter-judge, and analysis of the relevance and susceptibility to change the evaluation criteria.

Expected Outcomes

The results have provided evidence about the design of the instrument and reliability of the judgments based on the indicators that compose the different subdimensions. Regarding the internal consistency of the scale, we can say that in some dimensions could not be estimated numerically properly by a decrease in the variance -precisely because it was total consensus - broadly indicators have obtained good reliability coefficient. Regarding the criteria evaluated, we can indicate that the indicators proposed have been better evaluated from the criterion of relevance that from change susceptibility. This aspect is common in studies of judgment we have been conducting in our research group . It is easier to observe the intersubjective consensus on a clear feature, as is the dimension relevance (importance), that in a more diffuse feature (susceptibility change), in which judges are asked to carry out nearly a forecast whether that feature could be modified by the teaching-learning process. In conclusion, results are useful to redesign the instrument based on those indicators that give us greater reliability as assessed by experts to define and better operationalize the learning to learn competence.

References

Delors, J. (1996). La Educación Encierra un Tesoro. Madrid. Santillana Ediciones. UNESCO Eurydice (2002). Key competencies: A developing concept in general compulsory education.Brussels: Eurydice/European Commission. Hersh Salganik, L.; Simone Rychen, D.; Moser, U; Konstant, J.W. (2005). Proyecto DeSeCo. Definición y selección de competencias. Proyectos sobre Competencias en el Contexto de la OCDE. Análisis de base teórica y conceptual. Ver en: http://www.deseco.admin.ch Jornet, J.M.; García-Bellido, R. y Gozález-Such, j. (2012). Evaluar la competencia aprender a aprender: una propuesta metodológica. Profesorado. Revista de currículum y formación del profesorado, 16(1), 103-123.

Author Information

Rosario Garcia Bellido (presenting / submitting)
Universidad CEU Cardenal Herrera, Spain
University of Valencia
Research Methods and Diagnosis in Education
Valencia
Universidad de Valencia, Spain
University of Valencia
Methods of Research and Diagnosis in Education
Valencia

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.