Session Information
99 ERC SES 04 E, Ignite Talks
Paper Session
Contribution
Surveys are arguably the most common tool for data collection in higher education research, particularly for the study of student behaviour and social inequalities. The well-known weaknesses of survey research are issues related to sampling, response rates and lack of knowledge about the characteristics of non-respondents (Nayak & Narayan, 2019). The use of administrative data can circumvent these difficulties. Higher Education Administrative Data (HEAD) is a large set of behavioural data based on documentation with administrative software systems of higher education institutions. The data include information on student characteristics, study and examination patterns, learning curves, student success, drop-outs and length of study. It allows comprehensive data to be collected on the diversity, academic performance and behavioural patterns of entire cohorts of students, which is of interest to higher education institutions themselves. In addition to teaching evaluation, the purposes include accountability to societal stakeholders and the development of higher education structures and new public management (Beerkens, 2022).
Compared to traditional survey-based research, the collection and analysis of HEAD requires a much higher level of commitment to ethics and data protection (Florea & Florea, 2020). Therefore, the actual use is limited so far. In Europe, HEAD in the form of registry data is mainly used in the UK (e.g. Campbell et al., 2019; Chowdry et al., 2013) and Austria (e.g. Zucha et al., 2021) due to the strong centralisation of national statistical systems. Apart from a few recent studies of examination data from specific universities (e.g. Behlen et al., 2022; Pannier et al., 2020), the accessibility of HEAD in other European countries, such as Germany, remains difficult and researchers often fail to obtain the data in full (see Bandorski et al., 2019; Grözinger & McGrory, 2020). In summary, the potential of both forms of HEAD, registry data and higher education institution-specific administrative microdata, has not yet been fully exploited across Europe.
Furthermore, the data provided by management information systems is not very systematically structured or clearly organised. Depending on the internal organisation of the higher education institution, data fragments are scattered across different parts of the institutional administration, including registries, departments and faculties, and are not intended to be linked. As a result, the quality of data varies not only between higher education institutions, but also within them (Daniel, 2015). Due to the lack of IT governance modernisation, data quality is mostly affected by deficiencies such as inappropriate data structures, data duplication and conflicts (Wang & Jiang, 2022). For an in-depth study of study courses, it is necessary to find out what data is available in higher education institutions and how researchers can process it.
Using the example of Leibniz University Hannover, Germany, this article presents opportunities and challenges for the use of HEAD. It introduces the form and structure of raw data provided by higher education administration offices, followed by recommendations for the conceptual handling and organisation of HEAD.
In the long term, the growing importance of HEAD for both research and internal evaluations of higher education institutions could lead to increased networking and communication between administrative, examination and enrolment offices. The increased demand for HEAD by researchers could therefore lead to greater efficiency in the internal administration of the higher education sector by reforming IT governance structures.
Method
Using the example of HEAD from Leibniz University Hannover, a large German university, which works with software from HIS Hochschul-Informations-System eG, we present and explain the form and structure of raw data provided by higher education administrative offices. Our data sources are 1) the Admissions Office, 2) the Central Examination Office, 3) the examination boards of the individual institutes, and 4) the examination regulations of the degree programmes. The data include 1) student socio-demographics, information on enrolment, interruption of studies, and exmatriculation, 2) examination behaviour, including grades, study plan, registration and withdrawal from examinations, examination passes and number of attempts, 3) information on credit points, hearings and final failure, and 4) information on examination forms and credit points of programme modules. This example is used to explain how raw data of this type can be transformed into analysis datasets and to provide recommendations for the conceptual use of HEAD. For instance, when merging datasets from different study programmes, comparability between programmes is often limited because it is not possible to match grade point averages (Cunha & Miller, 2014). A potential solution in European higher education systems is to measure workload in terms of credit points (ECTS) per period of study, which also allows international comparative analysis.
Expected Outcomes
In conclusion, the benefits of using HEAD for educational research are clear. Not only researchers but also higher education institutions benefit from the (decentralised) collection and analysis of data. In this way, academic careers, especially those of minorities and disadvantaged groups, are documented in detail. A comprehensive assessment of diversity and quality of studies is possible, which could not be achieved with surveys due to the increasing attrition of participants. In the long term, the growing relevance of HEAD, both for research and for internal evaluation by higher education institutions, could lead to closer links and communication between their administrative, admissions and enrolment offices. It is also conceivable that campus management data could be linked with e-learning data. Greater demand for HEAD by researchers could therefore lead to greater efficiency in the internal administration of the higher education sector by reforming IT governance structures.
References
Bandorski, S., McGrory, M., & Grözinger, G. (2019). Erfolgsquoten im deutschen Hochschulwesen. Neue Erkenntnisse in einem umkämpften Feld am Beispiel Maschinenbau. die hochschule, 2019(2), 140 - 157. Beerkens, M. (2022). An evolution of performance data in higher education governance: a path towards a ‘big data’ era?. Quality in Higher Education, 28(1), 29-49. Behlen, L., Brade, R., Himmler, O., & Jäckle, R. (2021). Verhaltensökonomisch motivierte Maßnahmen zur Sicherung des Studienerfolgs (VStud). In: Neugebauer, M., Daniel, H.-D., & Wolter, A. (Eds.). Studienerfolg und Studienabbruch. Wiesbaden: Springer VS, 393-419. Campbell, S., Macmillan, L., Murphy, R., & Wyness, G. (2019). Inequalities in Student to Course Match: Evidence from Linked Administrative Data. CEP Discussion Paper. London: London School of Economics and Political Science, Centre for Economic Performance. Chowdry, H., Crawford, C., Dearden, L., Goodman, A., & Vignoles, A. (2013). Widening participation in higher education: analysis using linked administrative data. Journal of the Royal Statistical Society: Series A (Statistics in Society), 176(2), 431-457. Cunha, J. M., & Miller, T. (2014). Measuring value-added in higher education: Possibilities and limitations in the use of administrative data. Economics of Education Review, 42, 64-77. Daniel, B. (2015). Big Data and analytics in higher education: Opportunities and challenges. British Journal of Educational Technology, 46(5), 904-920. Florea, D., & Florea, S. (2020). Big Data and the ethical implications of data privacy in higher education research. Sustainability, 12(20), 1-11. Grözinger, G., & McGrory, M. (2020). Studienabbruch, Studierendenerhalt, Studienerfolg. Einordnung einer (halben) BMBF-Förderlinie. Discussion Paper Nr. 32. Flensburg: Eu-ropa-Universität Flensburg, Internationales Institut für Management und ökonomische Bildung, 1-19. Nayak, M. S. D. P., & Narayan, K. A. (2019). Strengths and weaknesses of online surveys. IOSR Journal of Humanities and Social Sciences, 24(5), 31-38. Pannier, S., Rendtel, U., & Gerks, H. (2020). Die Prognose von Studienerfolg und Studienab-bruch auf Basis von Umfrage- und administrativen Prüfungsdaten. AStA Wirtschafts- und Sozialstatistisches Archiv, 14(3), 225-266. Wang, K., & Jiang, Z. (2022). A Study on the Design of Big Data Governance Framework in Higher Education and Its Application in Student Management. Advances in Social Science, Education and Humanities Research, 635, 237-241. Zucha, V., Engleder, J., & Binder, D. (2021). AbsolventInnen der niederösterreichischen Fachhochschulen. Projektbericht. Wien: Institut für Höhere Studien (IHS), 1-198.
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.