Search

To assist higher education institutions in meeting the challenge of limited student engagement in the implementation of Learning Analytics services, the Questionnaire for Student Expectations of Learning Analytics (SELAQ) was developed. This instrument contains 12 items, which are explained by a purported two-factor structure of "Ethical and Privacy Expectations" and "Service Feature Expectations." As it stands, however, the SELAQ has only been validated with students from UK university, which is problematic on account of the interest in Learning Analytics extending beyond this context. Thus, the aim of the current work was to assess whether the translated SELAQ can be validated in three contexts (an Estonian, a Spanish, and a Dutch University). The findings show that the model provided acceptable fits in both the Spanish and Dutch samples, but was not supported in the Estonian student sample. In addition, an assessment of local fit is undertaken for each sample, which provides important points that need to be considered in future work. Finally, a general comparison of expectations across contexts is undertaken, which are discussed in relation to the General Data Protection Regulation (2018).

Student engagement within the development of learning analytics services in Higher Education is an important challenge to address. Despite calls for greater inclusion of stakeholders, there still remains only a small number of investigations into students' beliefs and expectations towards learning analytics services. Therefore, this paper presents a descriptive instrument to measure student expectations (ideal and predicted) of learning analytics services. The scales used in the instrument are grounded in a theoretical framework of expectations, specifically ideal and predicted expectations. Items were then generated on the basis of four identified themes (Ethical and Privacy Expectations, Agency Expectations, Intervention Expectations, and Meaningfulness Expectations), which emerged after a review of the learning analytics literature. The results of an exploratory factor analysis and the results from both an exploratory structural equation model and confirmatory factor analysis supported a two-factor structure best accounted for the data pertaining to ideal and predicted expectations. Factor one refers to Ethical and Privacy Expectations, whilst factor two covers Service Feature Expectations. The 12-item Student Expectations of Learning Analytics Questionnaire (SELAQ) provides researchers and practitioners with a means of measuring of students' expectations of learning analytics services.

Background: Learning Analytics (LA) is an emerging field concerned with measuring, collecting, and analysing data about learners and their contexts to gain insights into learning processes. As the technology of Learning Analytics is evolving, many systems are being implemented. In this context, it is essential to understand stakeholders' expectations of LA across Higher Education Institutions (HEIs) for large‐scale implementations that take their needs into account. Objectives: This study aims to contribute to knowledge about individual LA expectations of European higher education students. It may facilitate the strategy of stakeholder buy‐in, the transfer of LA insights across HEIs, and the development of international best practices and guidelines. Methods: To this end, the study employs a 'Student Expectations of Learning Analytics Questionnaire' (SELAQ) survey of 417 students at the Goethe University Frankfurt (Germany) Based on this data, Multiple Linear Regressions are applied to determine how these students position themselves compared to students from Madrid (Spain), Edinburgh (United Kingdom) and the Netherlands, where SELAQ had already been implemented at HEIs. Results and Conclusions: The results show that students' expectations at Goethe University Frankfurt are rather homogeneous regarding 'LA Ethics and Privacy' and 'LA Service Features'. Furthermore, we found that European students generally show a consistent pattern of expectations of LA with a high degree of similarity across the HEIs examined. European HEIs face challenges more similar than anticipated. The HEI experience with implementing LA can be more easily transferred to other HEIs, suggesting standardized LA rather than tailor‐made solutions designed from scratch. Lay Description: What is currently known about this topic: Implementing Learning Analytics is a promising but challenging task.SELAQ is a questionnaire that can be used to determine students' expectations of Learning Analytics.Several institutions in Europe applied SELAQ to implement Learning Analytics that meet the needs of their students. What this paper adds to this: This study applies SELAQ for the first time at a German university and compares the results to studies from the UK, Spain, and the Netherlands.The participating students at the German university show relatively homogeneous expectations of Learning Analytics.The expectations towards Learning Analytics of students across Europe are comparable. The implications of study findings for practitioners: Learning Analytics systems should be shared across institutions rather than being implemented separately as tailored solutions.More standardized or modular Learning Analytics systems are reasonable. [ABSTRACT FROM AUTHOR]

To assist higher education institutions in meeting the challenge of limited student engagement in the implementation of Learning Analytics services, the Questionnaire for Student Expectations of Learning Analytics (SELAQ) was developed. This instrument contains 12 items, which are explained by a purported two‐factor structure of "Ethical and Privacy Expectations" and "Service Feature Expectations." As it stands, however, the SELAQ has only been validated with students from UK university, which is problematic on account of the interest in Learning Analytics extending beyond this context. Thus, the aim of the current work was to assess whether the translated SELAQ can be validated in three contexts (an Estonian, a Spanish, and a Dutch University). The findings show that the model provided acceptable fits in both the Spanish and Dutch samples, but was not supported in the Estonian student sample. In addition, an assessment of local fit is undertaken for each sample, which provides important points that need to be considered in future work. Finally, a general comparison of expectations across contexts is undertaken, which are discussed in relation to the General Data Protection Regulation (2018). Lay Description: What is currently known about the subject matter: Accounting for student expectations allows for a service that is meaningful.SELAQ measures student expectations towards Learning Analytics services.The 12 items of the SELAQ can be explained by a two‐factor structure (Ethical and Privacy Expectations and Service Feature Expectations). What their paper adds to this: Validation of the SELAQ in three contextsA discussion of localized sources of strainAn assessment of measurement quality in each contextA general comparison of student expectations across contexts The implications of study findings for practitioners: SELAQ can be used with Spanish and Dutch students.SELAQ responses provide a much needed input from end‐users in Learning Analytics implementations. [ABSTRACT FROM AUTHOR]

Student engagement within the development of learning analytics services in Higher Education is an important challenge to address. Despite calls for greater inclusion of stakeholders, there still remains only a small number of investigations into students' beliefs and expectations towards learning analytics services. Therefore, this paper presents a descriptive instrument to measure student expectations (ideal and predicted) of learning analytics services. The scales used in the instrument are grounded in a theoretical framework of expectations, specifically ideal and predicted expectations. Items were then generated on the basis of four identified themes (Ethical and Privacy Expectations, Agency Expectations, Intervention Expectations, and Meaningfulness Expectations), which emerged after a review of the learning analytics literature. The results of an exploratory factor analysis and the results from both an exploratory structural equation model and confirmatory factor analysis supported a two‐factor structure best accounted for the data pertaining to ideal and predicted expectations. Factor one refers to Ethical and Privacy Expectations, whilst factor two covers Service Feature Expectations. The 12‐item Student Expectations of Learning Analytics Questionnaire (SELAQ) provides researchers and practitioners with a means of measuring of students' expectations of learning analytics services. Lay Description: What is already known about this topic: Understanding student expectations of learning analytics is an important challenge for higher education institutions to address.Research has measured student beliefs regarding the features and ethical procedures of a learning analytics service. What this paper adds: This study builds on prior work by developing an instrument to measure student expectations of learning analytics services.This study proposes that student expectations of learning analytics can be measured using two subscales: (a) ethical and privacy expectations and (b) service expectations. Implications for practice and/or policy: Higher education institutions should understand what students expect from learning analytics services before any implementations are actioned.Higher education institutions have a validated instrument to gauge and understand student expectations of learning analytics services.Results obtained from the instrument can be used to inform the development of specific learning analytics policies for each higher education institution. [ABSTRACT FROM AUTHOR]