Session Information
99 ERC SES 05 H, Assessment, Learning Outcomes, and Academic Development
Paper Session
Contribution
University rankings are not merely “descriptive” tools; they also operate as devices that shape expectations, organizational priorities, and strategic decisions. In this sense, rankings help to produce the world they claim to measure. Higher education is therefore influenced by a metric logic that risks narrowing the meaning of educational quality, insofar as it tends to reward what is easily commensurable. As a result, crucial dimensions of university life—such as inclusion, accessibility, and justice, which are intrinsic to education—may become marginal because they are less “countable.”
Hazelkorn (2014) notes that rankings “have encouraged the prioritization of research over teaching, and graduate over undergraduate education, with multiple implications for students and the academic profession” (p. 21). This “hierarchy” creates a structural incentive: universities tend to reallocate resources and time toward what carries greater weight in comparative measures. In the field of educational research, I highlight two related risks. The first concerns the compression of research timeframes. Educational processes are complex phenomena and typically require multi-year work and interdisciplinary approaches. Within this context, the reputational pull of rankings may inhibit the depth of theoretical research in pedagogy precisely when greater critical capacity is needed. The second risk concerns those aspects of education that are inherently difficult to submit to measurement. A clear example is the marginal position that inclusion may occupy in rankings. In the most widely used global reputational benchmarks—such as the Times Higher Education World University Rankings (THE WUR) and the Academic Ranking of World Universities (ARWU)—inclusion does not appear to function as a central axis. More recent or multidimensional instruments (for instance, those connected to the SDGs or to European benchmarking initiatives) make inclusion more visible. However, problems of indicator quality and comparability remain. Moreover, even when inclusion becomes measurable, it can still appear as an “ornamental” element: present without transforming the criteria through which we define “quality” and “knowledge.”
Within this framework, I consider Undergraduate Research (UR) as an innovative practice for knowledge production, understood as the outcome of participatory, democratic, multi-level research—across genders and generations. Although the last two decades of scholarship document relevant benefits for students and faculty, UR can be implemented in universities as a pedagogical response:
To the split between research and teaching, because it turns teaching into an inquiry-based practice and turns research into a formative experience;
To counter and prevent “ornamental” inclusion, because it treats difference as a heuristic resource: more perspectives generate more questions, greater attention to the unthought, and stronger interpretive responsibility.
However, precisely because UR is often presented today as a “high-impact practice,” it must be recognized that it is not automatically inclusive. Therefore, “unequal participation remains a central issue.” In other words, if unequal access to UR is not analysed with clarity, it tends to become normalized and to remain invisible. For this reason, pedagogy has a specific task: to investigate how UR is implemented, which students gain access, and under what modalities, constraints, and outcomes.
The paper is guided by two questions:
How, and under what conditions, can UR respond to the reputational pressure of rankings and generate educational quality and public value that cannot be reduced to metrics alone?
Which elements of this response are transferable across European contexts with different evaluative cultures and governance arrangements?
It is also necessary to define and test pedagogically grounded indicators and tools—i.e., instruments that create transparency and accountability with respect to educational aims. These indicators should include, at minimum: (a) access and equity of participation; (b) quality of the experience (intensity, duration, mentoring, recognition); and (c) tangible and intangible outcomes (epistemic competencies, agency, sense of belonging, trajectories)
Method
The methodology is situated within a qualitative-comparative design that combines document analysis and a case study, and it is guided by a Grounded Theory approach. Grounded Theory is adopted because it does not frame research as a “predefined path,” but rather as a continuously evolving map, grounded in a dialogical process between data collection, data analysis, and theory construction (Mortari & Ghirotto, 2019; Charmaz, 2014). Consistent with this framework, the analysis proceeds iteratively through coding and constant comparison, supported by memoing and the progressive refinement of interpretive categories (Glaser & Strauss, 1967; Strauss & Corbin, 1998). Phase one focuses on analysing rankings and the “regime of visibility” they produce. A content analysis will be conducted of the official methodologies of global reputational rankings (e.g., THE WUR, ARWU) and sustainability-oriented rankings/tools (e.g., THE Impact Rankings), with the aim of mapping which dimensions of quality are rewarded and with what weights, where and how inclusion and accessibility appear (or do not appear), and what organizational implications are implicitly promoted. The outcome of this phase will be a “visible/invisible” matrix, useful for interpreting the tension between reputational benchmarking and educational quality. In parallel, the review of scientific publications will draw on databases such as Scopus, ERIC, and IEEE Xplore, as well as search engines such as Google Scholar, in order to reconstruct the state of the art on rankings, metrics, inclusion, and Undergraduate Research, and to support the interpretation of findings. Phase two consists of a comparative mapping of Undergraduate Research programmes in European contexts. Through a purposive selection of 6–8 UR programmes across at least three European countries, institutional documents and programme materials will be analysed (regulations, syllabi, rubrics, access and support policies, quality documents, mentoring materials). The aim is to identify differences and recurring patterns in terms of UR typology (mentored or course-based), intensity and duration, forms of recognition, support arrangements, access criteria, and inclusion measures. Phase three corresponds to the case study within my home institution, the Università Cattolica del Sacro Cuore (Brescia campus, Italy), also designed with a participatory orientation. Data collection includes semi-structured interviews with students, faculty/mentors, and governance actors (approximately 15–25), 1–2 student focus groups with attention to underrepresented groups, observation of key moments (research meetings, tutoring), and the collection of artefacts (posters, micro-articles, logbooks). Students will also be involved as co-researchers in guided reflection and feedback activities (member checking), in order to strengthen transparency and interpretive quality.
Expected Outcomes
The paper investigates which paradigms shape the implementation of Undergraduate Research (UR), how they do so, and with what effects on access, the quality of the experience, and institutional recognition. The first expected outcome is an interpretive map of the mechanisms through which rankings and indicators reshape university priorities: which factors make UR attractive in terms of visibility, reputation, and funding, and which factors, instead, distort it—by reducing it to a performative label, fostering elitist selection, and marginalising inclusion. Second, the study will produce a typology of UR outcomes across three levels: Students: development of epistemic competencies (question formulation, evidence handling, argumentation), expansion of perceived opportunity horizons (imagined educational and career pathways), and increased critical agency and capacity to question the world. Faculty/mentors: shifts in mentoring practices, in relationships with student researchers, and in teaching repertoires; with potential effects on motivation, professional trajectories, and research productivity. Institutions and local communities: strengthening of more responsible and dialogic knowledge ecologies, with consequences for public credibility and social impact. A third expected outcome is the identification of resistances to change: organisational constraints (time, workload, incentives), cultural resistances, access barriers, and evaluative resistances. The ultimate aim is to propose pedagogically grounded indicators for UR transparency and accountability (equity of access, quality of the experience, tangible and intangible outcomes), in order to support UR as a transformative practice rather than a mere reputational signal.
References
Biesta, G. J. (2015). Good education in an age of measurement: Ethics, politics, democracy. Routledge. Carillo, M. R., Sapio, A., & Venittelli, T. (2022). The Relationship Between Teaching and Research in the Italian University System. In Teaching, Research and Academic Careers: An Analysis of the Interrelations and Impacts (pp. 225-265). Cham: Springer International Publishing. Charmaz, K. (2014). Constructing Grounded Theory (2nd ed.). SAGE. Christensen, D., Lackey, J. (Eds.). (2013). The epistemology of disagreement: New essays. OUP Oxford. Consiglio per la ricerca universitaria. http://www.cur.org/index.html European Higher Education Area. (2020). Eurydice chapter 4: Social dimension (Rome Communiqué 2020) Fabbri L., Melacarne C. (2023). Una epistemologia post-umanista della riflessività? Educational Reflective Practices, 13(1), 5-21. Glaser, B. G., & Strauss, A. L. (1967). The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine. Haeger, H., Banks, J. E., Smith, C., & Armstrong-Land, M. (2020). What we know and what we need to know about undergraduate research. Scholarship and Practice of Undergraduate Research, 3(4), 62-69. Hazelkorn, E. (2014). Rankings and the Global Reputation Race. New Directions for Higher Education, (168), 13–26. Healey, M., & Jenkins, A. (2009). Developing undergraduate research and inquiry. https://s3.eu-west-2.amazonaws.com/assets.creode.advancehe-document-manager/documents/hea/private/developingundergraduate_final_1568036694.pdf Laursen, S., Seymour, E., & Hunter, A. B. (2012). Learning, teaching and scholarship: Fundamental tensions of undergraduate research. Change: The Magazine of Higher Learning, 44(2), 30-37. Magni, F. (2022). La libertà di espressione nelle università tra USA ed Europa. Studium. Malavasi P. (2019). Educare robot? Pedagogia dell’intelligenza artificiale. Vita e Pensiero. Mortari, L., & Ghirotto, L. (a cura di). (2019). Metodi per la ricerca educativa. Carocci. ONU. (2001). Dichiarazione Universale dell’Unesco sulla diversità culturale. Polenghi, S., Massimiliano, F., & Agostinetto, L. (2018). Diritti Cittadinanza Inclusione. Pensa MultiMedia. Strauss, A., & Corbin, J. (1998). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (2nd ed.). SAGE THE. (2024). Impact Rankings. Methodology. https://www.timeshighereducation.com/world-university-rankings/impact-rankings-2024-methodology Towne, L., & Shavelson, R. J. (Eds.). (2002). Scientific research in education. National Academies Press. UN (2020). The Policy Guidelines for Inclusive Sustainable Development Goals. https://www.ohchr.org/sites/default/files/Documents/Issues/Disability/SDG-CRPD-Resource/policy-guideline-sdg4-education.pdf UN (2015). Transforming Our World: the 2030 Agenda for Sustainable Development. UNESCO, P. (2021). Reimagining our futures together: A new social contract for education. Educational and Cultural Organization of the United Nations. Vernon, M. M., Balas, E. A., & Momani, S. (2018). Are university rankings useful to improve research? A systematic review. PloS one, 13(3), e0193762.
Update Modus of this Database
The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.