Design and implementation of an evaluation scale of Information Skills for Secondary Education teachers in Spain.

Session Information

09 SES 03 B, Assessment in Higher Education (II)

Parallel Paper Session

Time:
2012-09-18
17:15-18:45
Room:
FCT - Aula 15
Chair:
Katja Scharenberg

Contribution

The development of Information and Communications Technology (ICT) has destroyed all previuos ideas regarding access, search, use and publication of information. It has also generated new communication channels and new sources of information  (Fernández, Zayas, & Urra, 2008). The Internet is, on its own merit, the most important ITC-related innovation, because it increases information, diversifies it and promotes distributed localization (Hernández Serrano & Fuentes Agustí, 2011).

«The internet has been the key driver of this paradigm shift because it has made possible the transition from analogue to digital information, and this has affected how knowledge is produced and disseminated through the effect of the internet means that this knowledge is more widely accessible than ever before» (Jones & Goff, 2011, p. 11)

It is here in this context that the concept of Information Competency emerges (American Library Association., 1989; Kong, 2008).  According to the Conference of Rectors of Spanish Universities (CRUE) and the Spanish University Libraries Network, this concept csan be defined as “the group of knowledges, skills, aptitudes and behaviours which enable individuals to recognise when they need information, where to find it, how to evaluate it and use it adequately for the purpose for which it is required”  (CRUE-TIC & REBIUN, 2009, p. 7).

This has led to the creation of a group of teachers concerned with developing training aimed at helping young people to improve their internet search skills and prevent them learning facts based on incorrect information. However, research shows that this concern is insufficient  (Head & Eisenberg, 2009; Hernández Serrano & Fuentes Agustí, 2011). Although standardized tools have not been designed for the evaluation of competency acquisition of this type, there is evidence to show that teachers lack specific training in this regard (Rodríguez Conde, Olmos Migueláñez, Pinto Molina, Martínez Abad, & García Riaza, 2011). From the perspective presented here, this lack of training on the part of teachers is the main direct cause of low student performance in Information Competencies.

The research project presented here forms part of this reality and  aims to design a valid and reliable scale for the evaluation of Information Competencies in teachers of Compulsory Secondary Education (12-16-year-olds) leading to a more exact diagnostic evaluation for the detection of deficient areas in teacher training in competencies of this type.

This research is carried out within the framework and with the financial support of the following RDI Project: Evaluación de competencias clave y formación de profesorado de educación secundarla: TIC, ALFIN Y convivencia escolar (EF-TALCO) Reference: EDU2009-08753. Financing body: Spanish Secretary of State for Research which approved the application for a research grant in 2009 within the subprogramme of non-oriented fundamental research (National Programme for Fundamental Research, 6th National RDI Programme 2008-2011).

And also with the support of the Centro Internacional de Tecnologías Avanzadas. Fundación Germán Sánchez Ruíperez (http://www.citafgsr.org/cita/)

Method

Stage I: Tool Design and Validation Once the scale has been designed, content value is determined by validation by jury. By means of a tool designed for this purpose, the jury of ten judges, all experts in different areas of knowledge related to the subject content of the test, evaluate both the relevance and clarity of all the items and the validity and strong and weak points of each of the five dimensions on the scale. Stage II: Training Programme Evaluation Design Experimental design with minimum control with pre-post test without control group (Campbell & Stanley, 1963). In order to determine the psychometric properties of the scale, which are mainly reliability and construct and predictive reliability, an Information Competency training programme is developed for fifty future secondary school teachers and the scale designed is applied as a pre-post test measure.

Expected Outcomes

The evaluation scale resulting from Stage 1 aims to evaluate the three competency components independently (Delors, 1997; Villa Sánchez & Poblete Ruiz, 2009): - Knowledge: Group of knowledges, both general and specific, and theoretical and practical. This is measured by means of an objective test consisting of 41 items. - Know-how: skills and competencies resulting from learning and experience. This is measured by two different tests: an Ordinal Scale, in which the testee has to establish the order of 4 options depending on the wording of the instructions for the item. There is a total of 12 items. A series of small online activities showing Information Competency related skills. There is a total of 8 items. - Knowing how to be: person values and attitudes. This is measured using a Pinto Attitude Scale (2009) which has already been validated by the jury. It consists of 26 likert-type items with a scale from 1 to 9. The stage 2 treatment is currently under development and results are not yet available for publication. However, data will be made available at the conference.

References

American Library Association. (1989). Presidential Committee on Information Literacy: final report. Chicago: American Library Association. Campbell, D. T., & Stanley, J. (1963). Experimental and Quasi-Experimental Designs for Research. Wadsworth Publishing. CRUE-TIC, & REBIUN. (2009). Competencias informáticas e informacionales en los estudios de grado. Recuperado a partir de http://crue-tic.uji.es/index.php?option=com_remository&Itemid=28&func=startdown&id=226 Delors, J. (1997). La educación encierra un tesoro : informe a la UNESCO de la Comisión Internacional sobre la Educación para el Siglo XXI. Madrid: Ediciones UNESCO. Fernández, M., Zayas, R., & Urra, P. (2008). Normas de competencias informacionales para el Sistema Nacional de Información en Salud. Acimed, 17(4), 1-17. Head, A. J., & Eisenberg, M. (2009). How college students seek information in the digital age. The Information School, University of Washington. Hernández Serrano, M. J., & Fuentes Agustí, M. (2011). Aprender a informarse en la red: ¿Son los estudiantes eficientes buscando y seleccionando la información? Teoría de la Educación: Educación y Cultura en la Sociedad de la Información, 12(1), 47-78. Jones, B., & Goff, M. (2011). Learning to live with data deluge and what that means for educators. Teoría de la Educación: Educación y Cultura en la Sociedad de la Información, 12(1), 9-27. Kong, S. (2008). A curriculum framework for implementing information technology in school education to foster information literacy. Computers & education., 51(1), 129-141. Pinto, M. (2009). Design of the IL-HUMASS survey on information literacy in higher education: A self-assessment approach. Information Science, 36(1), 86-103. Rodríguez Conde, M. J., Olmos Migueláñez, S., Pinto Molina, M., Martínez Abad, F., & García Riaza, B. (2011). Informational Literacy And Information And Communication Technologies Use By Secondary Education Students In Spain: A Descriptive Study. Contemporary Issues in Education Research, 4(4), 1-12. Villa Sánchez, A., & Poblete Ruiz, M. (2009). Competence-based learning: a proposal for the assessment of generic competences. Bilbao: University of Deusto.

Author Information

Susana Olmos Migueláñez Susana Olmos (presenting / submitting)
University of Salamanca
Didáctica, Organización y Métodos de Investigación
Salamanca
UNIVERSIDAD DE SALAMANCA
SALAMANCA
University of Salamanca
Didáctica, Organización y Métodos de Investigación
Salamanca
University of Salamanca, Spain

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.