Search

Background: Text comprehension research in relation to the reading medium showed that digital‐based reading represents a disadvantage compared with paper‐based reading. Most paper versus screen research; however, was conducted with university students. Objectives: This study investigated the contribution of reading medium to text comprehension and medium preference in beginner readers who use technology for school learning. The moderating role of text genre, word reading and medium preference on the reading medium effect on text comprehension was also analysed. Methods: First graders (N = 115; mean age = 6;8 years) read narrative and informational linear texts on paper and computer screen and answered main idea, literal and inferential comprehension questions. Medium preference questions and a word reading task were administered. Results and Conclusions: Logistic mixed models showed that the main idea and literal comprehension of narrative and informational linear texts were greater on screen and for higher word reading skills. Inferential comprehension was lower on screen at lower levels of word reading skills but became similar for the two media as word reading increased. Children had no clear medium preference and medium effect on text comprehension was independent of children's medium preference. The main results show that beginner readers who use technology for learning and are fast and accurate in word reading display no comprehension disadvantage in digital reading. Takeaways: Our results add to existing knowledge by clarifying how reading medium effects on beginner readers' text comprehension interact with factors such as fundamental reading skills and experience with technology. Lay Description: What is currently know about the subject matter: • Comprehension of informational texts is better on paper than on screen • Text comprehension is better on paper than on screen for independent readers from 4th grade onwards, even for those who prefer to read digitally. • Lower text comprehension on screen is related to shallow reading processing and navigation requirements of digital texts. • Shallow reading processing is related to the use of digital media for leisure. What the paper adds: • Comprehension of narrative and informational texts on screen is not disadvantaged in beginner readers who often use technology for school activities. • Word reading has a stronger role on inferential comprehension of digital texts with navigation requirements. • Word reading stronger role results in a screen comprehension disadvantage at lower levels of word reading skills. • Children have no clear medium preference and text comprehension on paper vs screen was independent of children's medium preference Implications of study findings for practitioners: • The use of technology for school activities may encourage deep text processing on screen. • Care should be taken when very young students with low reading skills are required to understand digital texts with navigation requirements. [ABSTRACT FROM AUTHOR]

Background: In the digital environment, users' academic reading behaviour has changed, working with many articles simultaneously to search, filter, scan, link, annotate and analyse content fragments. The semantic enhancement environment has been widely set with semantic technologies to offer additional and handy support for users and thus facilitate the reading process. Despite many efforts devoted to developing a semantic enhancement environment, less attention has been paid to its actual effects. Objectives: This study aims to explore the effects of a semantic enhancement environment. Methods: Elaborating on cognitive load theory and focusing on academic reading, this study compared users' cognitive load and reading effect under the semantic enhancement environment and plain text environment and verified the three hypotheses. Results and conclusions: Through experiments and statistical analysis, this study found that, under a semantic enhancement environment, users had their cognitive load reduced and their reading effect improved. Consequently, a semantic enhancement environment promotes academic reading. Takeaways: This study adds to previous literature on semantic publishing by empirically corroborating the conducive effects of semantic enhancement environment in academic reading. Additionally, it justifies semantic publishing and provides a reference for the future design of semantically enhanced reading environments. Lay Description: What is already known about this topic?: The effects of a semantic enhancement environment are open to discuss.Academic reading is fundamental to researches and hence needs promotion.Limited studies investigated the effects of a semantic enhancement environment on academic reading.Publishers require effective reading environment designs. What this paper adds?: This study constructed a semantic enhancement reading environment to conduct a reading experiment.The experiment tested cognitive load, by using WP scale, and reading effects, by answer time and answer score.Semantic enhancement environment reduces users' cognitive load, promotes users' reading effects, and bolsters users' understanding of academic reading materials, especially in microstructure content.The design of semantic enhancement reading environments needs to fully consider the features of reading materials and give users a controllable way of interaction. The implications of study findings for practitioners: Compared to plain text environment, semantic enhancement environment is preferred in academic reading.Publishers are encouraged to add semantic enhancements to their publications.This study discussed how to design an effective learning and reading environment from the perspectives of reading resources, media forms of resources, and interaction modes. [ABSTRACT FROM AUTHOR]

Background: The use of e‐exams in higher education is increasing. However, the role of student diversity in the acceptance of e‐exams is an under‐researched topic. In the current study, we considered student diversity in terms of three sociodemographic characteristics (age, gender, and second language) and three dispositional student characteristics (computer anxiety, test anxiety, and technology openness). Objectives: The main objective of this study was to investigate the relationship between student diversity and acceptance of e‐exams. Methods: Our research combined cross‐sectional analyses (N = 1639) with data from a natural experiment on the introduction of e‐exams versus the established paper‐pencil exams (N = 626) and used both self‐report and institutional data. Sociodemographic and dispositional characteristics were indirectly related to pre‐exam acceptance via expectancy variables from the Technology Acceptance Model framework. Results and Conclusions: Comparisons of post‐exam acceptance showed that practical experience with the e‐exam led to a significant increase in e‐exam acceptance, and that students with low openness toward technology particularly benefited from this effect. Students' exam performance (i.e., grades) was unrelated to the exam format or their pre‐exam acceptance of the e‐exam format, and this was true across students' sociodemographic and dispositional characteristics. Takeaway: Student diversity plays a role in e‐exam acceptance, but its influence is mitigated by first‐hand experience with e‐exams. The practical implications for higher education institutions aiming to implement e‐exams are discussed. Lay Description: What is already known about this topic: The use of e‐exams in higher education is increasingThe role of student diversity for e‐exam acceptance is unclearTechnology acceptance is predicted by expectancies towards new system What this paper adds: We investigated students' sociodemographic and dispositional diversityDiversity predicted e‐exam acceptance via the expectanciesIn a natural experiment, first‐hand experience increased e‐exam acceptanceNo difference between performance in e‐exams and paper‐pencil‐exams found Implications of the study findings for practitioners: Higher education institutions implementing e‐exams should consider diversitySupport for older students and students with low technology openness neededNo student groups systematically disadvantaged by e‐exam implementationPractice rooms can increase experience with new system before exam [ABSTRACT FROM AUTHOR]

Background: Providing feedback in massive open online courses (MOOCs) is challenging due to the massiveness and heterogeneity of learners' population. Learning analytics (LA) solutions aim at scaling up feedback interventions and supporting instructors in this endeavour. Paper Objectives: This paper focuses on instructor‐led feedback mediated by LA tools in MOOCs. Our goal is to answer how, to what extent data‐driven feedback is provided to learners, and what its impact is. Methods: We conducted a systematic literature review on the state‐of‐the‐art LA‐informed instructor‐led feedback in MOOCs. From a pool of 227 publications, we selected 38 articles that address the topic of LA‐informed feedback in MOOCs mediated by instructors. We applied etic content analysis to the collected data. Results and Conclusions: The results revealed a lack of empirical studies exploring LA to deliver feedback, and limited attention on pedagogy to inform feedback practices. Our findings suggest the need for systematization and evaluation of feedback. Additionally, there is a need for conceptual tools to guide instructors' in the design of LA‐based feedback. Takeaways: We point out the need for systematization and evaluation of feedback. We envision that this research can support the design of LA‐based feedback, thus contributing to bridge the gap between pedagogy and data‐driven practice in MOOCs. Lay Description: What is known about this topic: Learners' scale and diversity hinder timely feedback in massive open online courses (MOOCs).Learning analytics (LA) can optimise learners' support by scaling the feedback interventions. What this paper adds: We present a literature review on LA‐based feedback in MOOCs in the last 12 years.We focused on LA approaches that support instructors in providing feedback.Results show a scarcity of empirical studies related to these LA‐based tools.Results show that limited attention is paid to pedagogical and contextual aspects. Implications of the study findings for practitioners: We address knowledge gaps related to LA‐based tools for feedback in MOOCs.There is a need of LA‐based interventions to consider the course context.There is a need to evaluate the impact of LA‐based feedback in MOOCs empirically. [ABSTRACT FROM AUTHOR]

Background: The impact of mobile technology usage on student learning in various educational stages has been the subject of ongoing empirical and review research. The most recent meta‐analyses on various types of mobile technology use for potential benefits of learning covered the empirical studies up to about nine years ago. Since then, the use of mobile technology in primary and secondary education has increased tremendously, and numerous empirical studies have been conducted on this topic, but their conclusions were inconsistent. Objectives: The purpose of this systematic review is to re‐examine this issue by meta‐analyzing the empirical research studies from the last nine years, with a focus on cognitive, affective, and behavioral learning outcomes in primary and secondary education, and to examine the potential moderators that may have contributed to the heterogeneity across findings. Methods: Based on our inclusion and exclusion criteria, we found 85 studies of 78 peer‐reviewed papers (N = 9157) from electronic databases and major journals in educational technology and mobile learning between 2014 and 2022. We then examined 15 moderators that were expected to affect student learning outcomes. Results and Conclusions: Compared with traditional technology and non‐technology groups, using mobile technology produced medium positive and statistically significant effects on primary and secondary students' learning, in terms of cognitive (g = 0.498, 95% CI [0.382, 0.614]), affective (g = 0.449, 95% CI [0.301, 0.598]) and behavioural (g = 0.339, 95% CI [0.051, 0.627]) learning outcomes. Further moderator analyses revealed that student factors (i.e., community type, students' socioeconomic status), learning process (i.e., hardware used, student‐to‐hardware ratio, teaching method) and study quality (i.e., learning topic/content equivalence, degree of technology use in the control group) were among the variables that moderated the summary effect sizes for at least one learning outcome dimension significantly. The findings and their implications for researchers, policymakers and practitioners are discussed. Lay Description: What is already known about this topic: Mobile learning has become a fast‐growing research field.The benefits of mobile technology usage are related to learning outcomes.The pooled effects of mobile learning have been limited to cognitive learning. What this paper adds: This meta‐analysis focused on mobile learning versus traditional learning.The population was composed of students in primary and secondary education.Mobile technology usage contributed to higher cognitive, affective, and behavioural learning outcomes.Students from low socioeconomic backgrounds and rural areas benefited less from mobile technology interventions. Implications for practice and/or policy: Educational stakeholders need to take actions to adopt and support mobile technology usage in education.Mobile‐learning researchers need to optimize the quality of experimental studies. [ABSTRACT FROM AUTHOR]

Background: Online learning has grown significantly during the past two decades, and COVID‐19 pandemic has expedited this process. However, previous research has shown how academic dishonesty is more prevalent under these modalities. Therefore, there is the challenge of performing trustworthy remote assessments, in order to obtain valid and reliable measures of students' knowledge. Objectives: The research question that drove this research was: what actions have been proposed in contemporary research to improve remote assessment trustworthiness from a technological and pedagogical perspective? Methods: We analysed the papers accepted for the special issue titled 'Trustworthy Assessment and Academic Integrity in Remote Learning' following a deductive qualitative category coding methodology to find the main approaches. Results and conclusions: We identified eight approaches to improve trustworthiness in remote assessment: four for exams and high‐stake tests, one exclusively for performance‐based assessments, and three for any type of assessment. Our findings shift attention from academic dishonesty to trustworthy assessment, integrating recent findings of papers accepted to this special issue. Implications: Our findings deepen current understanding of trustworthy remote assessments, inviting practitioners and researchers to explore different types of assessment methods and different moments related to assessing learning. Lay Description: What is already known about this topic?: Online learning has grown significantly during the last decade.This growth increases the need for online assessment methods that can provide a valid, reliable, and fair measure of student knowledge.Research demonstrated the prevalence of academic dishonesty in online learning.There is a timely need to research and develop methods for trustworthy online assessment, as well as to raise the awareness of researchers, practitioners, and administrators, to the topic and to the solutions at hand. What this paper adds?: A review of the state‐of‐the‐art with respect to trustworthy assessment in online learning.A typology of strategies to improve trustworthy assessment, characterizing the pedagogical approach, technological method, context, and type of assessment.An analysis of different solutions, approaches, and case studies, with respect to the proposed typology.A novel approach to inform the design and implementation of valid and reliable online assessment. The implications for practitioners: The paper presents strategies and approaches for implementing trustworthy assessment in online learning.The paper provides a conceptual framework that can inform the design of valid and reliable assessments methods, and analyse both existing and newly proposed onesHighlighting the importance of including the assessment as an integral part of the instructional design phase of online learning offerings. [ABSTRACT FROM AUTHOR]

Background Objective Methods Results and Conclusions The COVID‐19 has accelerated the transition to blended learning (BL) in higher education, prompting a need for further investigation into the efficacy of self‐regulated learning strategies (SRLS) in these new educational environments.The primary goal of this research is to assess the effectiveness of SRLS in BL in higher education over the past five years, with a focus on trends, theoretical underpinnings, methodologies, and their impact on learning outcomes.This paper used the PRISMA 2020 review process for multiple rounds of screening, encompassing identification, screening, eligibility determination, and final inclusion. Following rigorous screening procedures, a total of 15 SSCI articles were ultimately chosen for analysis. The study design incorporated a comprehensive six‐part coding scheme, with the selected articles focusing on SRLS in BL environments within higher education.From 2019 to 2023, research on SRLS in BL environments in higher education has primarily focused on resource management, motivational beliefs, and metacognitive strategies, with a relatively limited emphasis on cognitive strategies. These studies have utilized a diverse range of theoretical frameworks, predominantly employing quantitative and mixed methods. Out of the 15 articles reviewed, 14 clearly indicate that SRLS have a positive impact on learning outcomes. Furthermore, this paper underscores the importance of interdisciplinary research and emphasizes the crucial role played by educators in supporting the implementation of SRLS. Future studies should delve deeper into exploring the effects of individual differences and environmental factors on SRLS. [ABSTRACT FROM AUTHOR]

Background: AI can positively influence teaching by offering support for classroom management, creating inclusive learning environments, enhancing digital skills, personalizing teaching methods, and strengthening teacher‐student relationships. Objectives: This quantitative research study investigates the opportunities, difficulties, and consequences of incorporating AI into teacher education. Methods: Data were collected through structured questionnaires from 202 college students and 68 staff members. The analysis was conducted using SPSS software. Results: The study provides a novel contribution by its thorough investigation of the diverse effects of AI on teacher education. It offers beneficial perspectives on the possible benefits and challenges, illuminating the far‐reaching changes that AI could bring to the terrain of learning and instruction and teaching methods in the time yet to come. The research sought to assess the effect of AI adoption in teacher education across five main dimensions: (i) its influence on teaching support and classroom management, (ii) its role in creating inclusive and accessible learning environments, (iii) its contribution to improving teachers' digital literacy and computer skills, and enhancing access to digital teaching resources, (iv) its positive influence on identifying students' learning styles and facilitating the adoption of diverse teaching methods, and (v) its role in strengthening teacher‐student relationships through improved interactions. Conclusion: The findings elucidate the promising opportunities that AI presents in the field of teacher education, along with the obstacles that require resolution for the effective fusion of AI educational settings. Lay Description: What is currently known about this topic?: AI has the potential to enhance various aspects of teaching, including classroom management and personalizing teaching methods.Incorporating AI into education has garnered significant interest due to its perceived benefits in improving learning outcomes. What does this paper add?: This paper provides a comprehensive investigation into the effects of AI adoption in teacher education, highlighting both the opportunities and challenges associated with its implementation.It offers insights into how AI can influence different dimensions of teaching, such as classroom management, learning environment inclusivity, and teacher‐student relationships. Implications for practice/or policy: The findings of this study underscore the importance of integrating AI into teacher education programs to leverage its potential benefits in enhancing teaching practices.Policymakers and educators should consider the implications of AI adoption in education and develop strategies to address challenges while maximizing the advantages of AI technologies in teaching and learning. [ABSTRACT FROM AUTHOR]

Background: Instructional videos constitute a pivotal component in flipped learning. Despite their significance, there is a dearth of research specifically dedicated to instructional videos within the context of flipped classrooms. This paucity has led to an empirical void in verifying the efficacy of instructional videos in flipped learning environments. Objectives: The present study endeavours to contribute to the extant literature on flipped pedagogical practices by providing empirical evidence regarding the effectiveness of instructional videos in flipped learning environments. Methods: This study employs a convergent mixed‐methods design. Forty‐five instructional videos in three subtypes were administered in two classes over a 15‐week semester. Data, both quantitative (log data from the learning management system) and qualitative (from focus group discussions at two time points), were concurrently collected from a flipped class (n = 25) and a blended class (n = 28) with the aim of gauging student engagement and learning outcomes in the flipped class and understanding video‐viewing features typical of the flipped class. Results: Both datasets corroborated that participants in the flipped class outperformed their counterparts in the blended class in terms of video‐watching, peer interaction, knowledge retention, and transfer skills. Conclusions: The instructional videos within the flipped classroom setting serve to enhance student engagement in the learning process and improve learning outcomes. The efficacy of these instructional videos in flipped learning can be further augmented through strategic approaches in both their design and implementation. Lay Description: What is currently known about this topic: The flipping pedagogy is conducive to learning.Videos play a crucial role in flipped learning.Videos prepared students for classroom activities.However, engaging students with pre‐class videos presents a challenge. What this paper adds: This paper furnishes direct empirical evidence supporting the effectiveness of instructional videos in flipped learning.It uncovers factors affecting student engagement with videos in flipped learning.It offers insights into the design and implementation of videos in flipped learning. Implications for practice: Considering facilitating conditions and affective factors when creating videos.Acknowledging learner characteristics when designing videos.Utilizing instructional strategies when implementing videos. [ABSTRACT FROM AUTHOR]

Background: Online interaction in blended learning is leveraged through social presence and convergence. However, little systematic work currently exists on how researchers have explored these challenges in higher education institutions and no studies have synthesised these challenges. Objectives: The purpose of this study is to give a novel overview of social presence and convergence to improve online interaction in blended learning in higher education. The findings will be synthesised into blended learning design principles. Method: Two systematic literature reviews, one on each challenge, were carried out through the Web of Science databases and consulting cited sources in review articles. Accordingly, 28 distinct studies were selected through the guidelines of the PRISMA statement, using predefined selection criteria. Results and Conclusions: The results show that social presence in blended learning is mostly evoked through course design, introductory f2f meetings, collaborative activities, prompt online feedback, the teacher's presence, and planned facilitation. To establish convergence, it is recommended to make basic theory available online through video clips, web‐lectures, articles, followed by simple online assignments or self‐study to increase understanding, thereby creating opportunities for deep learning during face‐to‐face through discussions and collaborative activities. Implications: This paper adds to the theory on blended learning and instructional design in higher education, and further offers an elaborate set of design principles for educational practice. Future research on instructional design may investigate in particular how a target group or student factors, are affected by the blended learning environment in order to tailor designs for a specific target group. Lay Description: What is known?: Online interaction is pivotal in blended learningOnline interaction is leveraged through social presence and convergenceSocial presence prevents the online student from feeling lonelyConvergence entails deciding the best‐suited delivery mode: online or face‐to‐face What this paper adds: A novel overview and critical analysis of social presence in blended learningA novel overview and critical analysis of convergence in blended learningA synthesis of the findings on social presence and convergenceExtraction of the findings into blended learning design principles Implications for practitioners: The teacher's presence through design and accessibility fosters students' social presencePlacing concepts online leaves room for deep learning during face‐to‐faceCollaborative activities evoke social presence and facilitate deep learningBlended learning designs should be further tailored for the target group [ABSTRACT FROM AUTHOR]

Background: In example‐based learning, examples are often combined with generative activities, such as comparative self‐explanations of example cases. Comparisons induce heavy demands on working memory, especially in complex domains. Hence, only stronger learners may benefit from comparative self‐explanations. While static text‐based examples can be compared easily, this is challenging for transient video‐based modelling examples used in complex domains because simultaneous processing of two videos is not feasible. Objectives: To allow for such comparisons, we combined video‐based modelling examples with static representations (i.e., summarizing tables) of the observed optimal and a suboptimal solution of the problem‐solving process. A comparative self‐explanation prompt asked learners to compare the different solution approaches. Our study investigated the impact of video‐based modelling examples versus independent problem‐solving on cognitive load and problem‐solving skill development. Moreover, we investigated the effects of comparative versus sequential self‐explanation prompts, depending on learners' prior knowledge. Methods: In an experiment, 118 automotive apprentices learned a car malfunction diagnosis strategy. Apprentices were divided into three groups: (1) modelling examples with comparative self‐explanation prompts, (2) modelling examples with sequential prompts, and (3) no examples or prompts. Diagnostic knowledge and skills were assessed before and after the intervention. Cognitive load was measured retrospectively. Results and conclusions: Despite no observed effects on cognitive load, modelling examples enhanced diagnostic knowledge and diagnostic skills with scaffolds, though not independent diagnostic skills without scaffolds. The need for more practice opportunities to foster independent diagnostic skills is assumed. Additionally, comparative prompts seem promising for learners with higher prior knowledge. Takeaways: Video‐based modelling examples were more beneficial for learning than practising to apply the diagnostic strategy. Static representations allow for comparisons of video examples and comparative prompts are promising for learners with higher prior knowledge (cf. expertise‐reversal effect). Further research, especially on the effects on cognitive load, is necessary. Lay Description: What is already known about the topic?: Text and video examples that model how to solve a problem are widely used in education.Text examples often include self‐explanation prompts that ask learners to compare several examples.For video examples, such comparison prompts have seldom been investigated, because comparisons are difficult to implement for transient videos. What does this paper add?: This paper shows that video examples combined with static summaries of processes that have been shown in the video example are effective and allow for comparisons of video examples.Such comparisons seem to be more promising for learners with higher prior knowledge. Implications for practice: Practitioners could combine video examples with static summaries of the processes shown in the video examples to allow for comparisons. [ABSTRACT FROM AUTHOR]

Background: This paper examines the use of augmented reality (AR) as a concept‐association tool in schools, with the aim of enhancing primary school students' learning outcomes and engagement. Conflicting findings exist in previous studies regarding the cognitive load of AR‐enriched learning, with some reporting reduced load and others indicating increased demand and poorer performance. Understanding these implications is essential for effectively leveraging AR in education. The study offers a fresh perspective on the potential of AR technology in improving educational experiences. Objectives: The primary goal of this research was to evaluate the effectiveness of an AR‐assisted concept‐association strategy for improving essential knowledge acquisition and skills outcomes, increasing cognitive load, and increasing self‐efficacy and learning motivation among primary school students. Methods: A quasi‐experimental design with a control group was employed to investigate the effectiveness of the intervention. Results and Conclusions: The results demonstrate that the implementation of the AR‐assisted concept‐association strategy effectively enhanced essential knowledge acquisition and skills outcomes, increased cognitive load, and increased self‐efficacy and learning motivation among primary school students. These findings highlight the potential of AR technology to improve the learning experience and engagement of primary school students. The study contributes to the existing literature on the effectiveness of AR technology in education, suggesting future research directions. Ultimately, it offers a practical solution for improving the learning experience by presenting a new approach for teaching using AR technology. Lay Description: What is currently known about this topic: Augmented reality (AR) technology has been increasingly explored in educational settings.Previous research has shown that AR can enhance learning outcomes and engagement among students.AR applications have the potential to serve as concept‐association tools to improve the learning experience. What this paper adds: This paper investigates the effectiveness of using an AR application as a mobile concept‐association tool in school settings.The study demonstrates that the AR‐assisted concept‐association strategy effectively enhances knowledge acquisition, skills outcomes, cognitive load, self‐efficacy, and learning motivation among primary school students.The findings highlight the potential of AR technology in improving learning experiences and engagement for primary school students.The study offers practical implications for integrating AR technology into educational settings, and suggests avenues for future research in this area. Implications for practice and/or policy: Incorporating AR applications as concept‐association tools can enhance learning outcomes and engagement in primary school settings.AR technology can be used to increase cognitive load, and to increase self‐efficacy and motivation among students.Educators and policymakers should consider integrating AR technology into teaching practices to improve the overall learning experience.Future research and exploration should be conducted to understand the full potential and limitations of AR technology in education. [ABSTRACT FROM AUTHOR]

Background: Both socially regulated learning and cognitive quality are important factors affecting collaborative knowledge building, but the current research lacks a joint quantified evaluation method that combines these two aspects. Objectives: Based on the existing framework, we proposed a joint evaluation method for regulated learning and cognitive quality in collaborative knowledge building, and further extracted the evaluation indicators. Methods: This study involved 74 learners enrolled in a course named 'the Application of Modern Educational Technology' as the subject of study, and made a case analysis with this method. Results and Conclusions: First, the indicators of this joint evaluation method could complement the indicators of traditional frequency statistics methods and facilitate an analysis of regulated learning and cognitive quality in collaborative knowledge building. Second, the group with a higher proportion of high‐level cognitive quality and socially shared regulation in collaborative knowledge building achieved better final scores. Finally, four types of groups were obtained through clustering: excellent, risky, mixed group, and highly collaborative group. This study introduced a joint evaluation method for regulated learning and cognitive quality in collaborative knowledge building and provides suggestions for future research. Lay Description: What is currently known about this topic?: Online collaborative knowledge building is increasingly important.Regulated learning and cognitive quality are considered very important for successful collaborative learning.Without quantitative methods, it is difficult to assess regulated learning and cognitive quality during collaborative knowledge building in a timely manner. What does this paper add?: This paper provided a joint evaluation method of regulated learning and cognitive quality (JERC) for online collaborative knowledge building.A case study was conducted to identify JERC's usefulness. Using descriptive statistics and visualization, it was determined that indicators of JERC can not only capture the state of cognitive quality and regulated learning status, but also elucidate the nature of that status (i.e., comprehensive, dynamic, cyclical).Through clustering analysis, four distinct groups were identified, each exhibiting different characteristics and moving patterns of regulated learning and cognitive quality over time. These patterns indicate that the quality of cognitive and regulatory learning cannot be determined solely by behavioural frequency. Moreover, an excessive proportion of individual regulation cannot predict better learning performance. Implications for practice: A computable representation model of regulated learning and cognitive quality was constructed to support automated perception and intervention in regulated learning and cognitive processing.With JERC, it is possible for researchers to capture, process, analyse and predict dynamic data to examine online collaborative knowledge building combined with shared physiological arousal events.The results of JERC can be used by researchers to develop advanced techniques, such as AI deep learning, for designing adaptive supports that can foster students' online collaborative knowledge building. [ABSTRACT FROM AUTHOR]

Background Study: Asynchronous online discussions are vital venues for collaborative knowledge construction. However, the lack of appropriate instruction designs poses challenges in promoting deep and substantive engagement with the core subject matter. This paper explores how to enhance adult students' knowledge construction in the context of asynchronous online discussions at an open university in Taiwan. Objectives: This study explores instructional designs aimed at promoting online knowledge construction among adult students and overcoming barriers to this process. Methods: This study used a convergent parallel mixed methods design to collect concurrently both quantitative data from the students' online discussion postings for content analysis and qualitative data from the focus group and individual interviews, the online open‐ended questionnaire, and the instructor's observation logs for thematic analysis. Then the results were merged in the interpretation stage. Results and Conclusion: The research highlights the significance of instructional designs in influencing students' level of knowledge construction during online discussions. The findings suggest that instructional designs that provide teacher‐led interim summaries, pose Socratic questions, and incorporate problem‐solving projects can promote higher‐level knowledge construction. However, time constraints, cultural influences, and unfamiliarity with peers negatively affected higher‐order knowledge construction. To address these challenges, culturally responsive and technologically inclusive instructional designs that take into account the specific challenges faced by adult learners are proposed to enhance learning outcomes through active participation. Limitation: The study's limited sample size warrants further research with a larger and more diverse cohort to validate the effectiveness of the proposed instructional designs. Another limitation is the lack of a robust theoretical base for the instructional strategies presented by the current action‐research study. Further examination and broader exploration in online education are needed to prop up proposed pedagogical approaches. Lay Description: What is currently known about this topic: Online discussions are essential for collaborative knowledge construction among adult students.Existing research primarily indicates that online knowledge construction often remains at a basic level, predominantly involving the sharing and comparing of information. What this paper adds: This study explores instructional designs aimed at elevating online knowledge construction among adult students at an open university in Taiwan.It identifies specific instructional strategies, such as teacher‐led interim summaries, the use of Socratic questioning, and the integration of problem‐solving projects, as effective in promoting higher‐level knowledge construction.The paper also sheds light on the challenges hindering higher‐order knowledge construction, including time constraints, cultural influences, and unfamiliarity among peers. Implications for practice and/or policy: The findings underscore the need for culturally responsive and technologically inclusive instructional designs. These should be tailored to the unique challenges faced by adult learners, particularly in asynchronous online environments.The paper suggests that such instructional designs can significantly improve learning outcomes by fostering more active and deeper participation in online discussions.It also highlights the importance of further research to validate these strategies, given the study's limited sample size and the need for a more robust theoretical foundation for the proposed instructional methods. [ABSTRACT FROM AUTHOR]

Background: Measuring students' self‐regulation skills is essential to understand how they approach their learning tasks in order to identify areas where they might need additional support. Traditionally, self‐report questionnaires and think aloud protocols have been used to measure self‐regulated learning skills (SRL). However, these methods are based on students' interpretation, so they are prone to potential inaccuracy. Recently, there has been a growing interest in utilizing learning analytics (LA) to capture students' self‐regulated learning (SRL) by extracting indicators from their online trace data. Objectives: This paper aims to identify the indicators and metrics employed by previous studies to measure SRL in higher education. Additionally, the study examined how these measurements were validated. Methods: Following the protocol of Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA), this study conducted an analysis of 25 articles, published between 2015 and 2022, and sourced from major databases. Results and Conclusions: The results showed that previous research used a variety of indicators to capture learners' SRL. Most of these indicators are related to time management skills, such as indicators of engagement, regularity, and anti‐procrastination. Furthermore, the study found that the majority of the reviewed studies did not validate the proposed measurements based on any theoretical models. This highlights the importance of fostering closer collaboration between learning analytics and learning science to ensure the extracted indicators accurately represent students' learning processes. Moreover, this collaboration can enhance the validity and reliability of data‐driven approaches, ultimately leading to more meaningful and impactful educational interventions. Lay Description: What is already known about this topic?: Measuring students' self‐regulation skills is essential for understanding their learning approaches and identifying areas requiring further support.Traditionally, questionnaires and interviews have been used to measure learners' self‐regulation; however, these methods rely on students' own views, which can sometimes be unreliable.Recently, there has been more interest in using learning analytics to measure students' self‐regulation based on data extracted from their online activities. What this paper adds?: This paper systematically analyses how previous studies used learning analytics to measure students' self‐regulation in higher education.It examines how these measurements were validated. Implications for practise and/or policy: More collaboration is needed between researcher in learning science and learning analytics is essential to ensure that the metrics and methods developed are not only theoretically sound but also practically relevant. This collaboration ultimately contributes to the design of enhanced learning experiences and outcomes. [ABSTRACT FROM AUTHOR]

Background: The emergence of ChatGPT in the education literature represents a transformative phase in educational technology research, marked by a surge in publications driven by initial research interest in new topics and media hype. While these publications highlight ChatGPT's potential in education, concerns arise regarding their quality, methodology, and uniqueness. Objective: Our study employs unconventional methods by combining altmetrics and bibliometrics to explore ChatGPT in education comprehensively. Methods: Two scholarly databases, Web of Science and Altmetric, were adopted to retrieve publications with citations and those mentioned on social media, respectively. We used a search query, "ChatGPT," and set the publication date between November 30th, 2022, and August 31st, 2023. Both datasets were within the education‐related domains. Through a filtering process, we identified three publication categories: 49 papers with both altmetrics and citations, 60 with altmetrics only, and 66 with citations only. Descriptive statistical analysis was conducted on all three lists of papers, further dividing the entire collection into three distinct periods. All the selected papers underwent detailed coding regarding open access, paper types, subject domains, and learner levels. Furthermore, we analysed the keywords occurring and visualized clusters of the co‐occurring keywords. Results and Conclusions: An intriguing finding is the significant correlation between media/social media mentions and academic citations in ChatGPT in education papers, underscoring the transformative potential of ChatGPT and the urgency of its incorporation into practice. Our keyword analysis also reveals distinctions between the themes of the papers that received both mentions and citations and those that received only citations but no mentions. Additionally, we noticed a limitation that authors' choice of keywords might be influenced by individual subjective judgements, potentially skewing results in thematic analysis based solely on author‐assigned keywords such as keyword co‐occurrence analysis. Henceforth, we advocate for developing a standardized keyword taxonomy in the educational technology field and integrating Large Language Models to enhance keyword analysis in altmetric and bibliometric tools. This study reveals that ChatGPT in education literature is evolving from rapid publication to rigorous research. Lay Description: What is currently known about this topic?: ChatGPT in education has seen a surge in publications driven by media hype.Early publications tend to lack rigour and reiterate known advantages/disadvantages.Literature reviews on ChatGPT in education have limitations in scope and depth.Some studies have explored altmetrics and bibliometrics in other fields. What does this paper add?: Combines altmetrics and bibliometrics to analyse publications of ChatGPT in education.Addresses challenges in the discourse by offering unconventional analysis methods.Identifies publication trends and investigates the relationship between media attention and citations.Determines key themes in the literature through keyword co‐occurrence analysis. Implications for practice/or policy: Expectations of continued growth in ChatGPT literature but with evolving publication trends.Distinctive characteristics of ChatGPT in education challenge keyword analysis.Proposes the development of a unified keyword taxonomy for clarity in the field.Suggests enhancing altmetrics and bibliometrics tools using Large Language Models. [ABSTRACT FROM AUTHOR]

Background: Mindfulness practices enhance executive function skills and academic achievement, spurring interest in integrating mindfulness interventions into education. Embedding mindfulness practice into a digital math game may provide a low‐cost, scalable way to induce mindfulness and boost game‐based learning, yet this approach remains unexplored. Objectives: We investigated the learning benefits of integrating mindfulness exercises in a digital math learning game and examined how students' trait mindfulness might moderate the outcomes. Methods: Two classroom studies were conducted with 404 5th and 6th grade students from six public schools in the U.S. (nStudy 1 = 227, nStudy 2 = 177). The two randomized controlled experiments assigned students to one of the three conditions: passive control (playing the digital learning game Decimal Point), story‐enriched active control, or mindfulness‐enriched condition. Trait mindfulness, learning gains, and in‐game problem‐solving (including problem‐solving duration, error count and correctness after reminder) were assessed. Study 2 included a manipulation check to better understand the effects of the mindfulness intervention. Results: Findings showed no significant differences in learning gains, problem‐solving duration or error count among the conditions. Students' trait mindfulness did not moderate these outcomes. Mindfulness reminders in the mindfulness‐enriched game led to more correct answers after errors than jokes in the story‐enriched game. Study 2 revealed that we failed to induce higher state mindfulness through the mindfulness inductions. Conclusions: Mindfulness prompts could be especially beneficial for students experiencing frustration during gameplay, warranting more exploration for digital game‐based instruction. We highlight barriers and future directions for fostering mindfulness through computer‐based instruction in classrooms. Lay Description: What is currently known about this topic?: Researchers focus on digital games as productive learning environments for math, with potential for higher learning gains compared with traditional methods. However, results are mixed, and not all games lead to improved math outcomes.Executive function (EF) skills are crucial for math learning, and mindfulness‐based interventions show promise in enhancing EF skills in school‐aged students.Embedding mindfulness practice into a digital math game may provide a low‐cost, scalable way to induce mindfulness and, in turn, boost EF skills and game‐based learning, yet this approach remains unexplored What does this paper add?: This paper presents the results of two randomized control trials investigating the feasibility and benefits of incorporating mindfulness exercises into a digital math game designed for middle school students. Benefits are compared to those of a story‐enriched and regular version of the same digital math learning game.The paper also explores variations in the effects of the mindfulness‐enriched game based on students' initial trait mindfulness levels.We observe that listening to mindfulness inductions at the beginning of game sessions do not induce mindfulness, and therefore does not benefit math learning.We find that mindfulness prompts received after recurrent errors can be beneficial for students' problem solving. Implications of study findings for practitioners: Our study provides important information on how digital learning game designers should attempt to induce mindfulness in a digital game to promote learning.Digital learning game designers should consider incorporating mindfulness exercises into their games strategically. Presenting mindfulness inductions in audio format at the beginning of game sessions may not induce mindfulness or benefit math learning. Instead, designers should focus on integrating mindfulness prompts at moments when students encounter frustration within the learning game.Beyond embedding audio mindfulness exercises in the game, learning designers should also consider alternative technological and game features to induce mindfulness within a learning game. [ABSTRACT FROM AUTHOR]

Background: Behavioural intention (BI) has been predicted using other variables by adopting the technology acceptance model (TAM). However, few studies have examined whether BI can predict learning performance. Objectives: The present study used an extended TAM to investigate whether students' BI is a predictor of their listening learning performance (LLP) through vocabulary learning performance (VLP) in the context of mobile vocabulary‐assisted listening learning by using two mobile learning tools. Methods: A total of 129 college students with a pre‐intermediate level of English were recruited as participants, and a 10‐week mobile vocabulary‐assisted, listening‐learning course was conducted in 2022. In each task of this course, the students had to learn target words from a listening passage on Quizlet and then engage in listening activities on Randall's ESL Cyber Listening Lab. Quantitative responses obtained through an online questionnaire were analysed through partial‐least‐squares structural equation modelling. Results: The analysis results indicated that BI significantly predicted LLP through VLP. Perceived ease of use (PEU) and perceived usefulness (PU) were significant antecedents of BI. However, PEU did not significantly predict PU because of the difficulty of navigating between the two technological tools used in this study. The extended model demonstrated its effectiveness in explaining listening learning performance, as evidenced by an explained variance (R2) of 69%. Conclusion: The extended model validates the influence of BI on learning performance and it can also draw teachers' focus toward the significance of enhancing students' BI to improve their listening learning performance. Pedagogical implications based on the results are provided in this paper. Lay Description: What is already known about this topic?: TAM was used to study learners' acceptance of mobile‐assisted language learning.TAM incorporates latent variables to explore mobile‐assisted language learning.Investigating factors influencing BI is a primary research focus in extended TAM literature.Mobile tools could improve listening learning and vocabulary retention. What this paper adds to that: Learning performance was considered as a dependent variable in an extended TAM.BI might predict students' learning performance in vocabulary and listening in an extended TAM.Teachers used two mobile tools to design mobile vocabulary‐assisted listening tasks.Pre‐learning the target words facilitate students' listening learning performance. Implications for practice and/or policy: We show the importance of BI on predicting listening learning performance.The impact of BI on other factors became another focus of TAM research.Results highlight pre‐learning target words' importance for better listening performance.Existing mobile tools improve listening performance, avoiding new system development. [ABSTRACT FROM AUTHOR]

Background: Learner profiles detected from digital trace data are typically triangulated with survey data to explain those profiles based on learners' internal conditions (e.g., motivation). However, survey data are often analysed with limited consideration of the interconnected nature of learners' internal conditions. Objectives: Aiming to enable a thorough understanding of trace‐based learner profiles, this paper presents and evaluates a comprehensive approach to analysis of learners' self‐reports, which extends conventional statistical methods with psychological networks analysis. Methods: The study context is a massive open online course (MOOC) aimed at promoting physical activity (PA) for health. Learners' (N = 497) perceptions related to PA, as well as their self‐efficacy and intentions to increase the level of PA were collected before and after the MOOC, while their interactions with the course were logged as digital traces. Learner profiles derived from trace data were further examined and interpreted through a combined use of conventional statistical methods and psychological networks analysis. Results and Conclusions: The inclusion of psychological networks in the analysis of learners' self‐reports collected before the start of the MOOC offers better understanding of trace‐based learner profiles, compared to the conventional statistical analysis only. Likewise, the combined use of conventional statistical methods and psychological networks in the analysis of learners' self‐reports before and after the MOOC provided more comprehensive insights about changes in the constructs measured in each learner profile. Major Takeaways: The combined use of conventional statistical methods and psychological networks presented in this paper sets a path for a comprehensive analysis of survey data. The insights it offers complement the information about learner profiles derived from trace data, thus allowing for a more thorough understanding of learners' course engagement than any individual method or data source would allow. Lay Description: What is already known about this topic: Researchers have made extensive use of data from online learning platforms—often referred to as learning trace data—to understand how learners engage in online learning activities.Surveys are often used to gather information about learners' motivation, perceptions, and other internal factors, to complement the insight gleaned from learning traces and thus create a more complete picture of the learning behaviour.When analysing survey data, the focus is usually on individual factors without considering how different factors are connected and affect one another.Psychological networks analysis is a novel analytic approach to studying complex phenomena both in psychology and education. What this paper adds: The paper uses psychological networks as a method for examining mutual relations among learners' internal factors (e.g., motivation, perceptions) measured through self‐reports before and after a course.By combining conventional statistical analysis of self‐reports with psychological networks analysis, the paper develops a comprehensive picture of learners' internal factors measured through self‐reports, one that accounts for both individual and interconnected nature of those factors.This comprehensive approach to information extraction from surveys allows for better understanding of trace‐based learner profiles, that is, profiles mined from data about learners' interaction with online learning activities. Implications for practice and/or policy: The presented method paves a way for a comprehensive analysis of the data collected from learners through surveys.It helps us gain a better understanding of learners' engagement with online learning activities.It can advance the evaluation of digital educational programs that aim to encourage changes in health‐related behaviour. [ABSTRACT FROM AUTHOR]

Background: With the growing integration of technology in education, the adoption of blended learning (b‐learning) has gained attention. B‐learning combines traditional classroom teaching with online components, holding potential to enhance student outcomes and educational efficiency. Yet, current research predominantly concentrates on higher education institutions in urban areas, creating a void in understanding its impact on K‐12 education, particularly in rural settings. Objectives: This qualitative study aims to propose recommendations for successful implementation of blended learning in rural K‐12 areas by addressing the key stakeholders influencing its adoption and identifying the main factors affecting its success. Methods: We performed a content analysis of grey literature documents detailing the implementation of b‐learning in K‐12 education. Additionally, interviews with crucial stakeholders such as teachers, principals, and experts in rural schools in South America provide insights into the challenges and prospects of b‐learning adoption in these contexts. Results and Conclusions: The study identifies pivotal stakeholders for effective b‐learning implementation, outlining their roles and addressing challenges inherent in rural settings. Recommendations for enhancing b‐learning's implementation in developing countries are also proposed. The research underscores the significance of involving diverse stakeholders such as governmental bodies, school leaders, educators, students, and families to ensure a holistic and efficient approach to blended learning. Lay Description: What is currently known about this topic: Blended Learning Definition and Benefits: Blended learning combines face‐to‐face and online instruction, enhancing student engagement and personalization by providing diverse learning pathways.Growth in K‐12 Implementation: Blended learning gained traction in K‐12 education, boosting academic outcomes, driven by recognition of learner diversity and potential in meeting students' needs.Contextual Challenges: Implementation challenges arise in low‐income households and rural areas, including limited access to technology and internet connectivity, impacting student engagement and success. What does this paper add: Focusing on Rural Dynamics: This study helps to fill a gap by investigating blended learning in rural K‐12 settings, spotlighting key players and success drivers in these unique contexts.Recommendations from Various Sources: By combining interviews and grey literature, this research generates comprehensive, practical recommendations grounded in both empirical insights and real‐world perspectives.Insights into Rural Hurdles: This paper extends the discussion on blended learning by addressing specific rural barriers, proposing family involvement, private sector partnerships for training, and tailored pedagogical strategies. Implications for practice or policy: Leadership and Collaboration: Effective school leadership and collaboration with local governments are pivotal for fruitful blended learning implementation, ensuring defined roles, responsibility, and accountability.Adaptable Curriculum Design: An adaptable, centralized curriculum aligns with recommendations, fostering efficient tracking of student progress and enabling customized learning.Engagement‐Centric Pedagogies: Recommendations spotlight interactive, student‐centered teaching methods, tailored to diverse student needs, nurturing active participation and elevated learning outcomes. [ABSTRACT FROM AUTHOR]

Background: Painting is the foundational expression across all art forms and is one of the key creative practices for fostering students' aesthetic ability and creativity within fine arts courses. Collaborative painting in the form of socially shared regulation of learning (SSRL) can be recognized as an effective strategy for enhancing creativity in both individual and group work. However, the absence of contextual experiences and collaborative spaces poses challenges for students in cultivating their creativity in painting. Objectives: The present study explores students' creativity, socially shared regulation (SSR) and positive painting behaviours using an SSRL‐based collaborative painting approach in the metaverse (Meta‐CP). Methods: Via a quasi‐experimental design, a total of 40 Chinese students in fifth grade were recruited and were randomly divided into an experimental group and a control group, with 20 students utilizing the Meta‐CP approach, while the remaining 20 students followed the conventional SSRL‐based paper‐and‐brush collaborative painting (C‐CP) approach. The Meta‐CP approach not only offers an authentic painting context and a collaborative space but also facilitates the collaborative process through the SSRL framework. The data collection included students' creative tendency, painting works and painting process. Results and Conclusions: The Meta‐CP approach effectively enhances students' creativity concerning adventure, curiosity and imagination, as well as results in the creation of more distinctive and logical artistic works. Furthermore, the approach significantly improved the quality of students' SSR. Additionally, students utilizing the Meta‐CP approach displayed more positive painting behaviours compared with those employing the C‐CP approach. Lay Description: What is already known about this topic:Collaborative painting is an effective strategy for enhancing creativity.Socially shared regulation of learning (SSRL) fosters collaborative learning.Students in collaborative painting may lack a contextual and synchronized painting space.The metaverse benefits in terms of contextual experiences and collaborative spaces. What this paper adds:Using an SSRL‐based collaborative painting approach in the metaverse (Meta‐CP) is effective in improving students' creativity.The Meta‐CP approach has the potential to improve students' quality of socially shared regulation (SSR), and positive painting behaviours. Implications for practice and/or policy:The metaverse provides an immersive synchronized painting space for art education to stimulate students' creative potential.The metaverse with proper learning strategies (e.g., SSRL) provides an effective collaborative learning environment for creation. [ABSTRACT FROM AUTHOR]

Background: Social annotation has emerged as a promising educational technology that fosters collaborative reading and discussion of digital resources among learners. While the positive impact of social annotation on students' learning process and performance is widely acknowledged, students' behavioural patterns in social annotation are underexplored. Objectives: This study investigated patterns in students' use of annotation and response behaviours in social annotation activities. We also explored how students' performance in the behavioural, cognitive, emotional, and social dimensions varied based on their behavioural patterns. Methods: We recruited 93 undergraduates who were enrolled in an elective course at a large North American University. Students were tasked with collaboratively annotating the class readings uploaded to Perusall, a social annotation platform, over 7 weeks. We used metaclustering to determine the optimal number of clusters pertaining to student behaviours. We compared the differences among clusters across multiple performance dimensions. Results and Conclusions: Two distinct clusters were identified and defined as initiators and responders. We found that responders had significantly longer active reading time and exhibited greater social annotation effort compared to initiators. However, initiators received more peer acknowledgement, as evidenced by higher upvotes. No significant difference was found in cognitive insight between initiators and responders, but responders demonstrated significantly higher cognitive discrepancy. Additionally, there were no significant differences in positive and negative tones between initiators and responders; however, responders displayed higher levels of prosocial behaviours than initiators. This study has significant practical implications regarding promoting students' collaborative learning experience in social annotation. Lay Description: What is already known about this topic: Annotation and response behaviours are two primary actions in social annotation.Understanding how students navigate through annotations and respond to their peers' contributions is essential for optimizing their learning experience.Social annotation outcomes can be assessed in the behavioural, cognitive, emotional, and social dimensions. What this paper adds: This paper revealed students' behavioural patterns in social annotation activities.This study offered a comprehensive understanding of the various dimensions of performance among students with different behavioural tendencies. Implications for practice and/or policy: The two student clusters, initiators and responders, revealed distinct engagement patterns in social annotation and informed the design of targeted scaffoldings.Responders were not passive learners since they demonstrated significantly longer active reading time, greater social annotation effort, and higher level of prosocial behaviours.Educators might not need to place significant emphasis on monitoring participants' emotional expressions in social annotation.Social annotation platforms should incorporate features that encourage and reward both initiation and response behaviours. [ABSTRACT FROM AUTHOR]

Contributions in the Special Issue: The special issue assembles papers centring around log data analysis, natural language processing, and machine learning used to advance educational assessment. They demonstrate how semi‐ and unstructured data such as log and text data can, despite their challenging nature, be handled appropriately to benefit educational assessment. In this editorial, we contextualize the special issue's contributions within the diverse field of modern technology‐based assessments. Reflection on Terminology: Moreover, we raise concerns about nowadays' use of the term artificial intelligence (AI) in scientific communication. While the contribution of AI to scientific progress is indisputable, the mere use of methods that have evolved within AI research does not necessarily render tools or studies AI‐related. We argue that academics have the social responsibility to adopt accurate terminology, given it is integral to scientific rigour and proper scientific communication. Implications: In view of the inflationary use of the term AI in science, we propose a scheme to locate one's research in the field by focusing on (1) the type of data, (2) the processing involved, and (3) the output of a study and the actions derived from it, which are situated within the (4) scope of a study. [ABSTRACT FROM AUTHOR]

Background: Given the advancement of mobile and sensing technology, the incorporation of augmented reality (AR) in context‐aware ubiquitous learning (CAUL) has offered significant benefits to oral communication development in foreign language learning. Although a great number of studies have been dedicated in this field, only a little research was conducted to formulate a facilitation framework aligning with established learning theories or pedagogies. Objectives: This review thereby examined the facilitation tenets conducive to the best practice of AR‐based CAUL projects for oral communication enhancement and further established a AR‐guided CAUL framework. Methods: The researchers systematically reviewed 17 related empirical AR studies from Web of Science from 2000 to 2021 and synthesized the results with focused second language acquisition theories. Results and Conclusions: Three practical tenets were identified, including facilitating learner‐centred pedagogies with personal and contextual learning supports, incorporating constructivist learning design, and encouraging collaborative learning and higher‐order cognitive skills. Furthermore, in accordance with the synthesized results, a facilitation framework combining situated learning, learning‐by‐doing, and social constructivist design was developed to engage students in a learning, applying, and reflecting process in formal and informal learning contexts. Major Takeaways: For the best practice of oral communication through AR, this review study offers practical facilitation tenets and theoretical framework which are in alignment with research‐proven theories. It is expected that the framework could provide frontline educational practitioners with guidance to foster students' learning outcomes and interactions. Lay Description: What is already known about this topic?: Foreign language learning has become interactive, contextual, and ubiquitous due to the development of mobile computing and sensing technologyThe incorporation of augmented reality (AR) an context aware ubiquitous learning (CAUL) is beneficial for the facilitation of oral communication in foreign language learning What this paper adds?: This paper offers practical facilitation tenets for oral communication development through AR‐based CAUL applicationsA theoretical framework is created for the best practices of AR and CAUL‐based listening and speaking projects Implications for practice and/or policy: The facilitation framework provides clear steps and details of implementation with learning theories to guide frontline educational practitioners and learnersThis paper can assist interested stakeholders to develop learning designs and effectiveness with the combination of theoretical foundation and pedagogical applications [ABSTRACT FROM AUTHOR]

Background: Learning analytics (LA) collects, analyses, and reports data from the learning environment, to provide evidence of the effects of a particular learning design. Learning design (LD) outlines the conceptual framework for a meaningful interpretation of Learning analytics data. Objectives: The study aims to identify the most relevant concepts at the intersection of learning design and learning analytics, how these concepts are integrated into more general thematic areas, and the implications for the research and practice of the learning design and learning analytics synergy. Methods: To this end, the study employs a critical interpretive synthesis (CIS) of the selected papers, and complements it with elements of systematic literature review as well as qualitative content analysis and text analytics that employ machine learning and language technology. Results and conclusions: The most important themes identified are 'analytics', 'learning', 'data', 'tools', 'research', 'framework', 'informed', 'model‐driven', 'participatory', 'technique', 'impact', insight', and 'findings'. The text analytics detected two topic rarely explicitly discussed in the literature: 'evidence‐informed instructional design approaches' and 'design‐based research'. Future research should attempt a holistic perspective towards the LD and LA synergy considering evidence‐informed instructional design approaches as part of a design‐based research methodology that implements evidence‐based teachers' practice and research‐based findings. Lay Description: What is currently known about the subject matter?: The number of studies exploring different aspects of the relationship between learning design (LD) and learning analytics (LA) has significantly increased.LD provides the context of LA and outlines the conceptual framework for a meaningful interpretation of LA data.LA collect, analyse and report data from the learning environment to improve learning design.LD and instructional design (ID) are closely related concepts and practices, although misinterpretation remains of their nature and relationship. What this paper adds to this?: Critical interpretative synthesis (CIS) approach for literature review is introduced.Text analytics to analyse the literature linking LD and LA is applied.The text analytics shows the most relevant concepts, their relationships, and how are they grouped into broader themes.The text analytics identifies 'design‐based research'(DBR) and 'evidence‐informed instructional design approaches' as important concepts that could be used in the future for improving research investigating the relationship between LD and LA. Implications of study findings for practitioners: Integrate the principles and guidelines of evidence‐informed instructional design approaches into a design‐based research process to promote effective, efficient and enjoyable learning implementing process and content types LA indicators.DBR is a natural way of integrating teachers' evidence‐based practice (LD) and research‐based findings (ID). [ABSTRACT FROM AUTHOR]

Background Objective Method Results Conclusion Stealth assessment is a learning analytics method, which leverages the collection and analysis of learners' interaction data to make real‐time inferences about their learning. Employed in digital learning environments, stealth assessment helps researchers, educators, and teachers evaluate learners' competencies and customize the learning experience to their specific needs. This adaptability is closely intertwined with theories related to learning, engagement, and motivation. The foundation of stealth assessment rests on evidence‐cantered design (ECD), consisting of four core models: the Competency Model (CM), Evidence Model, Task Model, and Assembly Model.The first step in designing a stealth assessment entails producing operational definitions of the constructs to be assessed. The CM establishes a framework of latent variables representing the target constructs, as well as their interrelations. When developing the CM, assessment designers must produce clear descriptions of the claims associated with the latent variables and their states, as well as sketch out how the competencies can be measured using assessment tasks. As the designers elaborate on the assessment model, the CM definitions need to be revisited to make sure they work with the scope and constraints of the assessment. Although this is the first step, problems at this stage may result in an assessment that does not meet the intended purpose. The objective of this paper is to elucidate the necessary steps for CM development and to highlight potential challenges in the process, along with strategies for addressing them, particularly for designers without much formal assessment experience.This paper is a methodological exposition, showcasing five examples of CM development. Specifically, we conducted a qualitative retrospective analysis of the CM development procedure, wherein participants unfamiliar with ECD applied the framework and showcased their work. In a stealth assessment course, four groups of students (novice stealth assessment designers) engaged in developing stealth assessments for challenging‐to‐measure constructs across four distinct projects. During their CM development process, we observed various activities to pinpoint areas of difficulty.This paper presents five illustrative examples, including one for assessing physics understanding and four for the development of CMs for four complex competencies: (1) systems thinking, (2) online information credibility evaluation, (3) computational thinking, and (4) collaborative creativity. Each example represents a case in CM development, offering valuable insights.The paper concludes by discussing several guidelines derived from the examples discussed. Emphasizing the importance of dedicating ample time to fine‐tune CMs can significantly enhance the accuracy of assessments related to learners' knowledge and skills. It underscores the significance of qualitative phases in crafting comprehensive stealth assessments, such as CMs, alongside the quantitative statistical modeling and technical aspects of these assessments. [ABSTRACT FROM AUTHOR]

Background: A practical test that measures the information and communication technology (ICT) skills students need for effectively using ICT in primary education has yet to be developed (Oh et al., 2021). This paper reports on the development, validation, and reliability of a test measuring primary school students' ICT skills required for effectively using ICT (the ECC‐ICT test). Objectives: Based on existing literature, three ICT use domains were identified for effectively using ICT: Effective, collaborative, and creativeuse of ICT. For these three domains, 24 corresponding teaching objectives were identified from a widely used digital literacy framework. Thirty‐four test items cover these teaching objectives in an online test. Methods: A mixed‐method approach was used for the ECC‐ICT test. Four pilot rounds (n=25) implemented qualitative interviews for cognitive validity and refining the test items, followed by a qualitative usability study(n=6). Confirmatory factor analysis and ANOVA provided quantitative insight into the large‐scale test administration(n=575). Results and Conclusions: Composite reliability of our conceptual 3‐factor confirmatory model showed that the test reliably measured primary school effective use of ICT (ω = 0.82), collaborative use of ICT (ω = 0.80) and creative use of ICT (ω = 0.64). Convergent validity (ranging from 0.41 to 0.46) was acceptable. Internal consistency (ranging from 0.84 to 0.91) and discriminant validity (HTMT values below 0.90) are good. ANOVA results show that mean test scores are higher for students in higher grade levels (p < 0.001). The post hoc Bonferroni results show that most grade‐by‐grade comparisons are significant (p < 0.001). Lay Description: What is already known about this topic: Information and communication technology (ICT) skills are finding their way into national curriculums as teachers implement more digital learning environments.Teachers currently do not have a measurement instrument for the ICT skills primary education students need to learn in a personalised way. What this paper adds: This paper gives teachers a test that reliably measures the effective, collaborative, and creative ICT skills required for primary school students to learn using ICT.To our knowledge, this test is the first of its kind.Al materials to reproduce the test are available digitally for teachers. The implications of study findings for practitioners: For policy, this test can be used to check if a student is ready to use ICT in a self‐regulated setting.With this test, teachers can assess and support students' growth on the effective, collaborative, and creative ICT skills required for primary school students using ICT. [ABSTRACT FROM AUTHOR]

Background: Virtual reality (VR) offers much potential for learning, but it challenges learners' orientation. Objectives: This paper investigates whether it is possible to use light or movement cues to facilitate orientation in a search task in a desktop‐VR environment so that participants can better attend to the learning content presented simultaneously. Methods: In two pre‐registered online experiments, we investigated the effects of cueing (light and movement) on search time, learning, and several evaluation variables. Participants were asked to find tools in a virtual workshop, while information about the respective tool was narrated. Experiment 1 (N = 60) used a within‐subject design, that is, the objects were alternately highlighted by light, movement or not. For Experiment 2 (N = 159) the narration was substantially shortened, and a between‐subject design was used. Cognitive load and presence were measured additionally. Results and conclusions: In Experiment 1, only the movement cue decreased search time, indicating automatic guidance of learners' attention. There was no effect of cueing on learning, which may be due to the average search time being substantially shorter than the narration, leaving sufficient time to attend to the narration exclusively. In Experiment 2 search times were significantly faster for both cueing methods, but only the light cue resulted in better learning outcomes, which could be explained by the slightly lower presence in the movement cue condition. Implications: Results imply that it is important to develop cues that automatically guide attention without reducing presence. Lay Description: What is already known about this topic: Virtual reality (VR) offers a lot of opportunities for the integration of educational scenarios.VR is challenging for learners with regard to orientation in a 360° environment.Regarding learning outcomes, research on the effects of cues to highlight important content in a 360° environment is still rare.Presence, defined as the feeling of being there in a VR environment, is an important prerequisite for learning in VR. What this paper adds: The influence of light and movement cues on search times and learning outcomes in a desktop‐VR environment was tested.Movement cues can reliably reduce search times (indicating successful orientation), whereas light cues only reduced search times in predictable scenarios.In a predictable scenario, light cues enhanced learning outcomes compared with movement cues.Movement cues reduced presence, which is one potential reason why movement cues did not improve learning. Implications for practice and/or policy: Using light cues might assist orientation and enhance overall performance in predictable scenarios (i.e., when learners know what kind of cue to expect).In an unpredictable setting with variable cues, light cues did not facilitate orientation, whereas movement cues did.However, movement cues reduced presence, which may have negatively affected learning outcomes. It is important to develop cueing methods that also work in more unpredictable settings, but that do not reduce presence. [ABSTRACT FROM AUTHOR]

Background Study: Virtual reality (VR) is becoming a popular technology for safety training in construction. Several VR training prototypes have been designed and tested, which show they can perform better than traditional training tools. However, most of these existing tools are not underpinned by clear pedagogical theory, and studies assessing the impact of pedagogical theories on the effectiveness of VR prototypes are still rare in the literature. Objectives: This study aims to investigate if and how the productive failure theory and the directive instruction theory have an impact on the effectiveness of VR safety training for confined space workers. Methods: The study used a randomized controlled method involving 74 participants. The effectiveness of these two training methods was assessed in terms of knowledge acquisition and retention. Results and Conclusions: The results illustrate that the productive failure training design performed better in terms of knowledge acquisition and retention. This paper introduces the Productive Failure Theory and shows the great potential of this approach for self‐service VR safety training in the field of construction. Lay Description: What is already known about this topic: PF has been proven effective in classroom‐based teaching practice.PF has been proven effective in non‐immersive virtual training.DI is a commonly used pedagogical method for VR training. What this paper adds: The present paper investigates the feasibility of applying PF theory in VR safety training.The present paper examines the pedagogical impacts of the two pedagogical approaches within VR serious games. Implications for practice and/or policy: PF can be applied to self‐help VR safety training, reducing the demand for resources such as teaching staff and venues.PF training design performed better in terms of knowledge acquisition and retention.PF has great potential for self‐help VR safety training in various fields. [ABSTRACT FROM AUTHOR]

Background: Given students' lack of self‐directed learning skills and the growing concern about implementing massive online open courses (MOOCs) in K12 education, learning strategies are needed to facilitate MOOC learning. Many studies have provided different strategies for effective learning in MOOCs. However, there is still limited research to confirm whether these strategies effectively support MOOC learning when deployed by secondary schools, which are not MOOC developers. Objectives: This mixed‐method study examines the provision of different learning strategies, including a learning guide, an academic mentoring programme, a training workshop, and a reimbursement scheme, and investigates the impact of these strategies on student learning in MOOCs. Methods: The study uses two data sources: (1) surveys with 40 participants and (2) semi‐structured interviews with 12 participants. The quantitative data were analysed with descriptive statistics and Fisher's exact test, and the qualitative data were analysed with thematic analysis. Results and Conclusion: The findings indicate that MOOC learners had positive attitudes towards the overall school support, with mentoring enjoying great popularity amongst the students. In terms of the effectiveness of the school support, the mentoring programme and reimbursement scheme were more effective than the university training and learning guide. The paper discusses the implications for researchers and educators. Lay Description: What is already known about this topic: There are a large number of K12 MOOC implementations, which are (i) STEM‐related and computer science courses, and (ii) from Europe and the USA.Limited studies provided different learning strategies for MOOC learning from the perspective of K12 schools, which are not MOOC developers.There is a need to explore MOOC initiatives encompassing a wide variety of subjects, including computer science MOOCs and non‐computer science MOOCs, in regions beyond Europe and the USA.There is also a need for further scrutiny of the effectiveness of learning strategies provided by the K12 school. What this paper adds: Our study launched the first MOOC implementation in K12, encompassing several subject areas beyond computer science in the region of Asia.Our study provided different learning strategies adopted by the K12 school, and the analysis revealed that MOOC learners took positive attitudes towards overall school support with mentoring enjoying great popularity with these students.Our study examined the effectiveness of school support and identified that mentoring and reimbursement are more effective than university training and the learning guide. Implications for practitioners: The insights gained from the study enable other K12 schools and educators to implement MOOC into existing school infrastructures successfully.These strategies provided in the MOOC implementation program can be helpful in many different online learning contexts. [ABSTRACT FROM AUTHOR]

Background: This research paper presents a cross‐sectional study that examinefs the preferences of students for hybrid teaching and learning scenarios. Unlike previous studies that merely describe hybrid scenarios, this research prioritizes them, offering evidence‐based findings for informed policy decisions. Methods: The data collection method involved eight choice‐based tasks using the conjoint analysis technique conducted with 'Sawtooth' software. The study surveyed students at a mid‐sized university across four departments in Central Switzerland. The sample analysed in this article comprised 319 respondents from the Lucerne School of Business. Results and Conclusions: Our survey found that students' own location during a teaching session played a significant role in determining participation preferences, followed by that of the lecturer. Factors that influenced students' preferences whether to attend onsite or online include workload, didactical format, perceived level of difficulty, student residence, and semester. Forms of hybrid collaboration and student–student interaction did not significantly influence student preferences. Takeaways: The value of this study lies in its evidence‐based findings for specific hybrid scenarios, which can provide useful insights for policymakers in degree programs and faculty in hybrid classrooms. This study is one of only a few to use conjoint analysis with such a high respondent rate to determine student preferences for hybrid attendance. Lay Description: What is currently known about this topic?: Student demand for hybrid teaching scenarios remains high, while many faculty find the scenario technically challenging.Opinions as to the precise features of 'hybrid' vary widely.No clear understanding of the conditions under which students will decide to attend any given class.Demand for additional exchange among online students is recommended in the literature, but often not implemented. What does this paper add?: The study uses conjoint analysis to simulate how students make attendance decisions.The study shows empirically which factors are most important to determine students' attendance.Two‐thirds of the students surveyed prefer an online option.Group composition and informal exchange do not significantly impact students' attendance preferences. Implications for practice/or policy: Students appreciate the flexibility of online learning but expect lecturers to be onsite.Difficult subjects are more likely to be attended onsite.Student residence, workload, degree program, and semester impact students' attendance preferences.No additional infrastructure is needed to encourage exchange among students. [ABSTRACT FROM AUTHOR]

Background: Augmented reality (AR) is receiving increasing interest as a tool to create an interactive and motivating learning environment. Yet, it is unclear how instructional support affects performance in AR. Objectives: This study sought to explore how varying the instructional support in AR can affect performance‐related behaviours of students with low cognitive abilities during assembly work. Methods: A total of 90 Belgian secondary school students repeatedly executed four different realistic assembly tasks. Three levels of instructional support (low, medium, and high) in AR as well as a control condition with paper instructions with a high level of detail were systematically varied across tasks and participants. Results and Conclusions: Multilevel regression analyses showed that AR instructions yielded lower assembly times and a lower perceived physical effort than paper instructions. Additionally, participants perceived tasks as less complex when given AR instructions with a high or a medium level of detail than when given a low level of detail. No effects of instructional support were established for other performance‐related behaviours, namely necessary assistance, error‐making, cognitive load, competence frustration, and stress. Effect sizes were small, at least among the instructional support conditions studied, yielding a limited base for adaptivity. Presumably, tailoring the instructional support in AR is only beneficial for highly complex tasks. The results might be useful for the design and implementation of AR in educational settings. Lay Description: What is currently known about the subject matter: Augmented reality is knowing increased use in education.Little is known about how to design effective instructional support in augmented reality. What this paper adds: This study represents an initial insight into how to personalize instructional support.The impact of instructional support on augmented reality performance of students with low cognitive abilities was investigated.The study suggests that varying instructional support may lead to differences in performance outcomes. Implications for practitioners: How instructional support is constructed may affect augmented reality learning.The results may inform the design of effective augmented reality learning environments for students with special needs.How individual, contextual, and task‐specific characteristics moderate the effectiveness of instructional support should be further investigated. [ABSTRACT FROM AUTHOR]

Background: The potential of learning analytics dashboards in virtual reality simulation‐based training environments to influence occupational self‐efficacy via self‐reflection phase processes in the Chemical industry is still not fully understood. Learning analytics dashboards provide feedback on learner performance and offer points of comparison (i.e., comparison with one's own past performance or comparison with peer performance) to help learners make sense of their feedback. Objectives: We present a theoretical framework for describing learning analytics reference frames and investigate the impact of feedback delivered through dashboards with different reference frames on occupational self‐efficacy, while controlling for workplace self‐reflection. Methods: This experimental study engaged 42 chemical operator employees, aged between 18 and 55 years, each with at least one year of experience. We utilised a two‐group design to ask two research question each with three competing hypotheses related to changes in occupational self‐efficacy, employing Bayesian informative hypothesis evaluation. Results and Conclusions: Results for the primary research question suggest that dashboards with progress reference frames do not elicit greater change to self‐efficacy than those with social reference frames, however, they may elicit equal change. Furthermore, dashboards with social reference frames may elicit greater change to self‐efficacy than those with progress reference frames. Exploratory results found that dashboards with progress reference frames may elicit greater positive directional change than those with social reference frames and that they may elicit equal directional change. These findings contribute to the understanding of self‐efficacy beliefs within the Chemical industry, with potential impacts on skill development. The research may inform the design of targeted interventions and training programs to influence self‐efficacy. From a practical perspective, this research suggests that careful consideration is needed when choosing reference frames in learning analytics dashboards due to their potential consequences on the formation of learner self‐efficacy. Lay Description: What is already known about this topic?: Learning analytics dashboards often aim to stimulate self‐regulated learning by providing feedback.Feedback plays a crucial role in simulation‐based learning and learning analytics dashboards can be a valuable tool to deliver feedback and facilitate the learning process by providing learners with insights into their performance and progress.Previous research has highlighted the importance of reference frames as critical design features of learning analytics dashboards, as they assist learners in making sense of learning analytics feedback.Self‐efficacy is a powerful determine factor of workplace performance and is influenced by mastery experiences and social modelling information. What the paper adds?: A theoretical framework describes the mediating role self‐reflection phase processes of the self‐regulated learning cycle plays in the formation of occupational self‐efficacy.This paper introduces the concept of three learning analytics reference frame components which include the performance outcome component, point of comparison component and score delta component.The paper indicates that learning analytics dashboards designed with a progress reference frame does not elicit greater change to occupational self‐efficacy than the social reference frame.Exploratory results suggest dashboards with progress reference frames might produce greater positive directional change compared to social reference frames or elicit equal change. Implications for practice?: Learning analytics system designers who use reference frames to help learners make sense of their feedback should carefully consider which reference frames they use as these decisions likely have consequences on the formation of learner self‐efficacy beliefs.For LAD designers and stakeholders, recognising the absolute change and directional shift in self‐efficacy is crucial, as LAD designs significantly influence these dynamics and guide the tailoring of effective tools.In industries like the chemical sector, where overconfidence can result in severe consequences, understanding the nuance of self‐efficacy changes is especially pertinent. [ABSTRACT FROM AUTHOR]

Background: Driven by the ongoing need to provide high‐quality learning and teaching, universities recently have shown an increased interest in using learning analytics (LA) for improving learning design (LD). However, the evidence of such improvements is scarce, and the maturity of such research is unclear. Objectives: This study is aimed to evaluate the maturity of research discussing LA‐driven LD improvements in higher education. Methods: The systematic review analyses 49 empirical papers, assesses their quality and suggests further research directions. The review elaborates on methodological (research questions, strategy and methods, LA‐LD integration theoretical backgrounds) and substantial (LA‐driven LD improvements, types of data used, LA software development) features of the papers. Results and Conclusions: The findings demonstrated the lack of theoretical alignment between LA and LD, with research tending towards user experience studies. The most frequently used research strategy was a case study; experiments were very rare. Researchers predominantly used parsing for collecting data and AI methods for analysing it; mostly used data types related to registering learners' engagement with learning activities as well as resources and tools provided in digital learning environments. Takeaways: The research area discussing LA‐driven LD improvements still has a way to go before attaining the level of full maturity. Only a third of the papers reported actual LA‐driven LD improvements; moreover, only three papers measured their effectiveness. The presented LA software was mostly at the beta or implementation stages and did not assess the impact of using this software. Lay Description: What is already known about this topic: Universities show an increased interest in using LA for improving LD.The evidence of such improvements being efficient is scarce.Learning analytics is weakly grounded in learning and teaching. What this paper adds: LA‐LD research presented in the reviewed papers cannot yet be considered fully mature.Almost half of the research was carried out using a case study approach, intrinsically challenging in terms of replication and validity. As few as three out of the reviewed studies applied an experimental approach, capable of stating the cause–effect relationship between LA and LD.All the studied papers mentioned improvements in LD, but only around a third of them reported actual improvements, another one‐third suggested potential improvements, and the rest did not come down to describing any.The LA software presented in the papers was mostly at the testing or implementation stages, and the impact of implemented software on LD has yet to be evaluated. Implications for practice and/or policy: Future LA‐LD research to become more mature may well elaborate on theoretical footing, contribute to the cause–effect relationship between LA and LD utilising experimental research design, ensure sufficient sample size.Practitioners' efforts should be directed to operationalising LD for efficient measurements, addressing pedagogical challenges when applying LA, and assessing LA‐driven improvements introduced into LD. [ABSTRACT FROM AUTHOR]

Background: Degree apprenticeships (DA) help employees gain new knowledge and skills by allowing them to study towards a university degree while working full time. For these programmes to be effective, the learning design should be adapted to the needs of these students, who are goal oriented (i.e. they want to gain only knowledge that can be applied within their workplace), have limited time for studying, and usually have not attended formal education for some time. As these programmes are relatively new, there is limited research on how these students can be supported to achieve the programmes' learning goals by using information and communication technologies. Objectives: This paper aims to understand whether a learning design that combines game‐based learning with online flipped classrooms can engage DA students in their learning and help them develop their reflective skills. Methods: Two focus groups were conducted with DA students that study at a UK Business School towards gaining the Chartered Manager status. The focus groups recordings have been analysed using reflexive thematic analysis. Results and Conclusions: The three main themes, "change can be helpful and challenging at the same time", "the ideal game", and "the effect of others", show that DA students find game‐based learning and online flipped classrooms useful, with the right support. Simulation games can be more fulfilling to DA students than quiz games, even if they take more of their out‐of‐class time. In addition, instructors are advised to work more closely with diverse teams to enable students share their work experiences and learn from each other. Lay Description: What is already known about this topic?: Online flipped classrooms offer flexibility in learning, but instructors need to find solutions to challenges, like students' limited e‐learning readiness and lack of motivation.Game‐based learning has been found to facilitate learning in general, but there is a need to identify the specific circumstances (i.e. settings, gaming elements) under which it is effective.Degree apprenticeship students need more support with their learning compared to traditional university students, as they face additional challenges in terms of family life‐work balance and connecting their learning to their working experience. What this paper adds?: Game‐based learning can be useful to degree apprenticeship students providing that focuses on the application of knowledge and provides feedback.Despite facing challenges related to maintaining work‐study‐life balance, degree apprenticeship students are willing to complete the flipped classroom's out‐of‐class activities, if they see a clear benefit from doing so.Online group activities can be challenging for degree apprenticeship students, if they are not able to form teams with other learners that work for the same organisation. The implications of study findings for practitioners: Avoid quiz‐like games and select the ones that use real‐life scenarios for degree apprenticeship students to help them link their learning to their practice.Formative feedback should be provided by both the instructor and the game to motivate degree apprenticeship students to spend the additional time to complete the out‐of‐class activities.Students should be reminded frequently of the purpose of any new learning elements (e.g. learning analytics) as they may not have the time to explore them on their own.When forming student teams based on students' workplace is not possible, spend more time in each breakout room to facilitate the online group discussion and help students bring their different working experiences together. [ABSTRACT FROM AUTHOR]

Background: Cognitive load during AR use has been measured conventionally by performance tests and subjective rating. With the growing interest in physiological measurement using non‐invasive biometric sensors, unbiased real‐time detection of cognitive load in AR is expected. However, a range of sensors and parameters are used in various subject fields, and reported results are fragmented. Objectives: The aim of this review is to analyse systematically how physiological methods have been used to measure cognitive load and what the implications are for the future research on AR‐based tools. Methods: This paper took the systematic review approach. Through screening with 10 exclusion criteria, 23 studies, that contain 3 key elements: AR‐based intervention, cognitive state examination and physiological methods, were identified, analysed and synthesised. Results: Physiological methods in their current form require reference to provide meaningful interpretations and suggestions. Therefore, they are often combined with conventional methods. Many studies investigate the effect of wearable devices in comparison with non‐AR stimuli, which has been controversial, but detection of different causes of cognitive load are on the horizon. Eye‐tracking is the method most used and most consistent in the use of its parameters. Conclusions: A multi‐method approach combining two or more evaluation instruments is essential for the validation of users' cognitive state. In addition to the AR stimuli in question, having another independent variable such as task difficulty in experiment design is useful. Statistical approaches with more data input could help establish a reliable scale. The future research should attempt to dissociate cognitive load caused by different effects such as device, instruction, and other AR techniques as well as intrinsic and extraneous aspects, in a better experimental setup with multiple parameters. Lay Description: What is already known about this topic: The efficacy of AR‐based instructional tools can be evaluated using the concept of cognitive load.Cognitive load has been conventionally measured by self‐reporting and performance.There is a growing interest in physiological measurement of cognitive load with non‐invasive biometric sensors. What this paper adds: This paper systematically analyses how physiological methods are used to measure cognitive load in AR.It synthesises the fragmented results of AR studies conducted with a range of physiological methods. Implications for practice: Combining two or more evaluation instruments is essential for the validation of users' cognitive state.Eye‐tracking is the method most used, and fixation duration is the most consistent parameter.A statistical approach with more biometric data input could help establish a reliable cognitive load scale.Future research should attempt to separate cognitive load caused by different effects and different cognitive aspects. [ABSTRACT FROM AUTHOR]

Background: Previous studies have shown that dynamic illustrations, as compared to their static counterparts, lead to higher achievement levels, especially for hand‐based procedures. Other researchers have investigated how the presence of seductive details (i.e., appealing but irrelevant adjunct displays) influences students' interest positively but their learning negatively. Objectives: The purpose of the two present studies was to investigate the effects of animated versus static presentations, combined with the presence of seductive details, on student performance on a paper‐folding task (i.e., origami) in a naturalistic school environment. Methods: Fifty‐five children (5–6 years old) participated in the first study and were randomly assigned to one of four groups. The second study was conducted with older children (72 s or third graders) and a more complex origami task. Results and Conclusions: In the first study, results demonstrated negative effects of seductive details on children's performance and time on task, but no effects of presentation format. In the second study, no negative effects of seductive details on student achievement were found, but animated illustrations significantly improved children's performance and reduced time on task. However, seductive details tended to impair learning more greatly given the presence of static, as compared to animated, presentations. Task difficulties and pupils' ability to inhibit irrelevant information may explain these results. Lay Description: What is already known about this topic: Seductive details negatively influence young children's performance.Animated illustrations have been shown to improve students' learning for dynamic procedure. What this paper adds: This is the first study investigating the influence of animated vs. static illustrations combined with seductive details on children's learning performance.Animated illustrations improve children's performance for a challenging dynamic procedure.Seductive details tended to impair more learning from static than from animated presentations.Results are discussed in relation to the task's difficulty as well as students' ability to inhibit irrelevant information. Implications for practitioners: Animated illustrations should be used when presenting dynamic procedures.Instructors should use seductive details cautiously in pedagogical documents particularly when the task is difficult. [ABSTRACT FROM AUTHOR]

Background: Augmented reality (AR) has been incorporated in context‐aware ubiquitous learning (CAUL) designs to guide learners but few of the designs adopt specific learning theories. Furthermore, there are no CAUL design models that align learning theories to CAUL effectiveness. In addition, CAUL review papers have not documented CAUL developments since AR technology has become normalized. Objectives: A phenomenological research method with expert design input was adopted to build theoretically informed CAUL design models and provide guidelines for AR‐driven CAUL. Methods: The researchers reviewed 38 empirical AR studies in education from 2016 to 2019 in seven high‐impact journals of educational technology using a taxonomy based on CAUL learning theories. Seven domain experts reviewed the findings and provided insights into current developments, patterns of variables, and the proposed AR‐guided CAUL model. The expert feedback was used to refine the CAUL models. Results and conclusions: Research into humanity‐related subjects are growing due to the features of AR, and the majority of studies were in primary education as AR corresponds well with lower‐level cognitive learning tasks. Many AR functions cooccurred with situated learning theory, inquiry‐based learning theory, and collaborative learning theory. A macro‐design model and three micro‐design models of AR‐guided CAUL with specific learning theories was proposed. Major takeaways This study offers a set of AR‐guided CAUL design models aligned with established learning theories. The variables in the CAUL studies are linked with learning theories to clearly show how AR guides learning. The models can guide instructors to meet their students' needs. Lay Description: What is already known about this topic?: Computer assisted ubiquitous learning (CAUL) can assist learners in developing various skills and knowledge.Augmented reality (AR) has been widely incorporated in context‐aware ubiquitous learning (CAUL) designs to enrich and guide learners.Lower‐level cognitive developments are research‐proven features of AR‐based systems. What this paper adds?: This paper offers a set of AR‐guided learning design modes aligned with learning theories.Humanity‐related subjects like English and history are growing due to the features of AR.Three stages of context‐aware ubiquitous learning were found: tag‐searching, image‐tracking, and panorama‐recognizing. Implications for practice and/or policy: The proposed model provides variables and patterns of the variables with learning theories to guide users.This paper can inform researchers on the potential of learning theories to guide learning designs, help instructional designers revise curricula, and help teachers by highlighting effective learning strategies to guide learners with AR. [ABSTRACT FROM AUTHOR]

Background: As more people around the globe become immigrants or refugees, an increasingly popular subsection of research has aimed to investigate how these populations use mobile‐assisted language learning (MALL) to learn the language(s) of the host country. Objectives: This study examines how the language learning, inclusion and self‐regulation are moderated by MALL different methods in immigrants and foreigners (with different backgrounds) regarding two settings (foreign language and second language). Materials and methods: We desired to explore whether MALL results in better language learning for foreigners, refugees and immigrants compared to traditional methods (physical tools) and how various factors affect MALL, such as whether MALL is utilized in a formal versus informal context. Hence, this article conducts a systematic review through a meta‐analysis and thematic analysis of 17 total quantitative and qualitative studies regarding MALL research on immigrants and refugees. Results and Conclusions Our results suggested that the MALL method is in general beneficial for second or foreign language learning, but with limitations based on the individual learner (motivations, demographics, etc.) and sociocultural factors, especially within informal contexts (e.g. fear of being seen as an immigrant when using a mobile learning app). Considering the variables that affect MALL that we observed and discussed in our review, we suggest more attention to the specific needs and potential issues refugees and immigrants may encounter when using MALL in order to create mobile applications that best aid this population in learning the host country's language(s), thus making resettlement an easier process. Lay Description: What is already known about this topic?: Mobile‐assisted language learning (MALL) technology has been identified as an effective tool for learning a language in short bite‐size lessons.The advantage of MALL for foreign language learners with no immigration status.Positive attitudes and inclusion are the highlights that should be considering in MALL for other groups of foreigners. What this paper adds?: Foreign language learners and second language learners are different groups that require different approaches of MALL.Not all MALL devices and gaming is appropriate for immigrants, refugees and other foreigners.Devices and digital tools are differently perceived by second language learners. Implications for practice and/or policy: Immigrants have different usage and attitudes toward mobile devices for learning.Applications should be learning daily‐basis but should be more culturally sensitive.Refugees and specific migrant groups need different methods when in MALL context. [ABSTRACT FROM AUTHOR]

Background: A strong knowledge of mathematics, beginning at the elementary level, is critical for participation in today's complex world. The home may be one way to facilitate individualized mathematics instruction, given that children spend more time at home than in an academic institution. Therefore, researchers are interested to see whether the home numeracy environment (HNE) can provide a solid foundation for children's mathematics understanding. Further, children's digital mathematics exploration at home is increasingly common (e.g., using math apps). Objectives: The present study evaluates the digital home numeracy practice (DHNP) model and explores its effect on children's mathematics knowledge across five domains (numeration, number operation, pattern recognition, spatial sense, and applied problem‐solving). Methods: To conduct this study, 117 Canadian parents and their children from Grade 1 through 5 completed a DHNP survey and a range of in‐person mathematics measures. Results and Conclusions: The results identified significant relations between parents and children's implicit mathematics factors (e.g., math anxiety, motivation). Children's mathematics anxiety and parents' academic estimations and expectations for their children positively predicted children's mathematics knowledge. In terms of DHNP components, parental involvement in DHNP predicted children's numeration and applied problem‐solving knowledge. Implications: Taken together, the results detail the contribution of parental and child factors to children's mathematics knowledge and suggest that parents adjust their role in DHNP according to their children's mathematics ability. Lay Description: What is (not) known about the subject matter?: Research is less developed on the impact of home technology in the mathematics learning processExisting research did not use a multi‐measure approach to assess the relationships between a variety of home numeracy factors and fundamental mathematics concepts and processes What is the contribution of this paper?: The paper highlights the importance of considering different home related factors to understand the role of home numeracy practices in children's mathematics developmentIt provides a holistic view of digital home numeracy practice (DHNP) by examining several implicit and explicit components of home numeracy environmentChildren's mathematics anxiety predicts their mathematics knowledgeParental estimation and expectation about their children's mathematics performance predicts their mathematics knowledge across several domains whereas parental role on DHNP impacts children's numeration only What are the implications of the findings?: The findings provide an understanding of the significant value of including digital mathematics practices in the study of the home mathematics environmentThe outcome of the study provides guidance for educators and researchers to better understand and leverage DHNP, and its impact on children's mathematics educationFuture research should investigate to what extent digital features should be included in the DHNP model. This will provide insights into the impact of using well‐designed apps on children's mathematics learning [ABSTRACT FROM AUTHOR]

Background: There are only few guidelines on how instructional videos should be designed to optimize learning. Recently, the effects of social cues on attention allocation and learning in instructional videos have been investigated. Due to inconsistent results, it has been suggested that the visual complexity of a video influences the effect of social cues on learning. Objectives: Therefore, this study compared the effects of social cues (i.e., gaze & gesture) in low and high visual complexity videos on attention, perceived cognitive load, and learning outcomes. Methods: Participants (N = 71) were allocated to a social cue or no social cue condition and watched both a low and a high visual complexity video. After each video, participants completed a knowledge test. Results and Conclusions: Results showed that participants looked faster at referenced information and had higher learning outcomes in the low visual complexity condition. Social cues did not affect any of the dependent variables, except when including prior knowledge in the analysis: In this exploratory analysis, the inclusion of gaze and gesture cues in the videos did lead to better learning outcomes. Takeaways: Our results show that the visual complexity of instructional videos and prior knowledge are important to take into account in future research on attention and learning from instructional videos. Lay Description: What is already known about the topic: Instructional videos are widely used in education.Learners need to timely attend to relevant content to learn successfully.Learners' attention might be guided towards relevant content with social cues (gaze and gesture of a presenter or instructor) but findings regarding learning outcomes are inconclusive. What does this paper add: This paper is the first to examine the role of the visual complexity of an instructional video in the interplay between social cues (gaze and gesture), learners' attention allocation, and learning outcomes. Implications for practice: The results show that visual complexity influences the learners' attention allocation and learning outcomes.Social cues (i.e., gaze & gesture) improved learning outcomes when controlling for learners' prior knowledge. [ABSTRACT FROM AUTHOR]

Background: Many learners struggle to productively self‐regulate their learning. To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL. To measure these processes, contemporary SRL researchers have largely utilized think aloud or trace data, however, not without challenges. Objectives: In this paper, we present the findings of a study that investigated how concurrent analysis and integration of think aloud and trace data could advance the measurement of SRL and assist in better understanding the mechanisms of SRL processes, especially those details that remain obscured by observing each data channel individually. Methods: We concurrently collected think aloud and trace data generated by 44 university students in a laboratory setting and analysed those data relative to the same timeline. Results: We found that the two data channels could be interchangeably used to measure SRL processes for only 17.18% of all the time segments identified in a learning task. Moreover, SRL processes for around 45% of all the time segments could be detected via either trace data or think aloud data. For another 27.17% of all the time segments, different SRL processes were detected in both data channels. Conclusions: Our results largely suggest that the two data collection methods can be used to complement each other in measuring SRL. In particular, we found that think aloud and trace data could provide different perspectives on SRL. The integration of the two methods further allowed us to reveal a more complex and more comprehensive temporal associations among SRL processes compared to using a single data collection method. In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL. Lay Description: What is already known about this topic: To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL.To measure SRL processes, contemporary researchers have largely utilized think aloud or trace data, however, not without challenges.Think aloud and trace data should complement each other and, when analysed concurrently, can provide a more valid and fuller picture of SRL than when analysed separately, which is typically the case in the SRL research to date. What this paper adds: We proposed a novel alignment approach to triangulate the measurement of self‐regulated learning (SRL) based on trace and think aloud data.We defined integration rules to integrate the measurement results from trace data and think aloud, which helped to provide a fuller picture of SRL.The integrated results revealed a more complex, complete and comprehensive SRL process map compared to using a single method. Implications for practice and/or policy: First, our results suggest that using a single measurement method can often reveal SRL processes only partially.Second, our findings indicated that the integration of the two measurement methods could not address all their methodological shortcomings and more research is needed towards new integrative approaches that can further reduce the number of misaligned results.In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL.More specifically, the integrated measurement of SRL can be used in the future to better (1) test the effects of instructional SRL interventions, for example, scaffolding; and (2) evaluate how learners use specific learning tools. [ABSTRACT FROM AUTHOR]

Background Studies: Captioning and repetition are widely used multimedia instructional devices for non‐native students. Generally, studies in this area have tended to focus on second language literacy skills rather than on learning new content knowledge. Additionally, posttests were administered immediately after the treatments, while the delayed influences of captioning and repetition have never been investigated. Objectives: This paper addressed these research gaps in two separate studies. More specifically, this study attempted to examine the influences of captioning and repetition on non‐native students' immediate and relayed retention. Methods: In Study One, three captioning conditions; word‐by‐word captions, closed captions, and no‐captions; were compared to examine their efficacies in immediate and delayed content knowledge retention on 82 Chinese university students. To address the limitations in Study One as the multimedia lesson was short and played only once, Study Two incorporated captioning and two repetition types in its design. One hundred and eleven Chinese university students watch a video lesson in one of four captioning and repetition conditions. Results: The statistical analyses of Study One indicated that there were no significant differences in both immediate and delayed retention test scores across the three captioning condition. Similarly, in Study Two, there were no significant differences in retention tests scores across the four captioning and repetition conditions. Findings: Neither the availability of captions nor the repetition types had any impact on the Chinese students' immediate or delayed content knowledge retention, which lent support to existing studies. Based on the research results, the limitations and future study possibilities are discussed. Lay Description: What Is Already Known About This TopicEmpirical studies on captioning have focused on immediate learning right after the treatment, so have studies on repetition.Empirical studies on multimedia lessons for non‐native students have focused on English language learning. What This Paper AddsThree types of captioning were compared to examine their efficacies in both immediate and delayed content retention of Chinese students.Two types of repetition were compared to examine their efficacies in both immediate and delayed content retention of Chinese students. Implications for Practice and/or Policy:Neither the availability of captions nor the repetition types had any impact on the Chinese students' immediate or delayed content knowledge retention.The availability of textual keywords adjacent to their corresponding graphics might have compromised the efficacy of captioning. [ABSTRACT FROM AUTHOR]

Background: This research is inspired by the challenges encountered in interpreter training, changes in learning needs in the technological era, the educational paradigm shift caused by the COVID‐19 pandemic, the lack of studies on combining virtual reality (VR)_and mobile technologies, and literature gaps in the field of the incorporation of technology in interpreter education. Objectives: This research aims to develop a mobile‐based VR application for bi‐directional English‐Chinese and Chinese‐English interpreting learning named 'Virtual Interpreting Practice' (VIP) based on an interpreting competence model and to investigate its impact on students' self‐rated language and interpreting proficiency levels as well as their declarative knowledge and operative skills as reflected in different interpreting modes (sight and consecutive) and language directions (English‐Chinese and Chinese‐English). The VIP app contains learning resources, including 13 learning modules covering both interpreting modes, practical topics and contexts, video lectures and demonstrations, fully immersive VR and non‐VR practice, glossary lists, source texts, translated texts and an online feedback platform. Methods: Thirty‐one native Chinese‐speaking English as a second/foreign (ESL/EFL) undergraduate students used the app for self‐directed learning. The data were collected by the pre‐study and post‐study questionnaires as well as the pre‐test and post‐test. Results and Conclusions: The results indicate that the use of VIP significantly raised the students' self‐rated language and interpreting proficiency levels as well as their interpreting performance in both modes and language directions. While the students performed better in sight interpreting and Chinese‐English interpreting, they achieved a significantly higher improvement rate in consecutive interpreting and English‐Chinese interpreting. Lay Description: What is already known about this topic: A number of studies have demonstrated the use of virtual reality (VR) provides users with senses of multiple presence, enhances learner engagement and motivation, and facilitates collaborative, situated, immersive and experiential learning that is not often available in traditional learning environments.The increasing availability of VR has created new opportunities in the area of mobile‐assisted language learning (MALL), paving the way for a new research area called VR‐assisted language learning (VRALL).Using VRALL, numerous benefits in various language skills have been identified, such as listening, speaking, writing and vocabulary acquisition. What this paper adds: While blending VR and mobile technologies may play a more significant role in education settings and create more advantages, the impact of this combination for interpreting learning has remained an unexplored area in higher education. This paper has addressed the research gaps in which there is a lack of VR language learning apps that are bilingual, mobile‐based and specifically designed for interpreting practice in highly immersive learning environments.The results indicate that the use of VIP significantly raised the students' self‐rated language and interpreting proficiency levels as well as their interpreting performance in both sight and consecutive interpreting and language directions (English‐Chinese and Chinese‐English).While the students performed better in sight interpreting and Chinese‐English interpreting, they achieved a significantly higher improvement rate in consecutive interpreting and English‐Chinese interpreting. Implications for practice and/or policy: The results have implications for the roles of students and teachers. The app developed in this study shifts the teacher‐led approach to student‐centred learning. While it allows more learning autonomy, its effectiveness may largely depend on students' ability to self‐regulate and engage.It appears that the effectiveness of VRALL depends on a number of individual and contextual factors, e.g. the design and functionality of the apps, availability of the internet connection and smartphones as well as learning needs and motivation. [ABSTRACT FROM AUTHOR]

Background: Digital‐first assessments leverage the affordances of technology in all elements of the assessment process: from design and development to score reporting and evaluation to create test taker‐centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and technologies of a test security framework (part of a larger ecosystem; Burstein et al., 2021) that can be used to create systems that protect the integrity of test scores. Methods: We use the Duolingo English Test to exemplify the processes and technologies that are presented. This includes methods for actively detecting and deterring malicious behaviour (e.g., a custom desktop app). It also includes methods for passively detecting and deterring malicious behaviour (e.g., a large item bank created through automatic generation methods). We describe the certification process that each test administration undergoes, which includes both automated and human review. Additionally, we describe our quality assurance dashboard which leverages psychometric data mining techniques to monitor test quality and inform decisions about item pool maintenance. Results and Conclusions: As assessment developers transition to online delivery and to a design approach that places the test taker at the centre, it becomes increasingly important to take advantage of the tools and methodological advances in different fields (e.g., engineering, machine learning, psychometrics). These tools and methods are essential to maintaining the security of assessments so that the score reliability is sustained and the interpretations and uses of test scores remain valid. Lay Description: What is known about this topic?: As more and more testing programmes transition to test taker‐centric administrations, effective measures to prevent cheating and protect content are critical to ensure the validity and integrity of scores.Two of the most common forms of cheating in online testing are (a) having someone other than the person who has registered take the test, and (b) stealing content and providing it to others to assist them in achieving a higher score. What does this paper add?: In designing a test taker‐centric digital‐first assessment, a test security framework must inform decisions from end‐to‐end (i.e., registration, onboarding, communications regarding test taker behaviours, test preparation and practice, test administration, and post‐administrative activities including scoring).Security is safeguarded through active and passive design methods; active methods include having test takers attest that they will follow the rules governing testing and informing them that they will be videoed during testing; passive methods include a computer adaptive design that limits item exposure and test overlap rates, development of a large item pool using automated item generation, and applying artificial intelligence to review test administration videos to flag unauthorized behaviours for human review. Implications: With more educational and assessment programmes transitioning to online digital models, the paper presents a comprehensive review of security issues and identifies an integrated approach for preventing cheating and other unauthorized behaviours. [ABSTRACT FROM AUTHOR]

Background Study: The research discusses the need for a paradigm shift in engineering education current practices to accommodate the digital native students. The paper emphasizes the importance of integrating disruptive technologies, namely Virtual Reality (VR) through Head Mounted Displays VR (HMD VR) and Desktop Based VR (DB VR) and comparing it with the traditional teaching methods. The research focuses on second‐year undergraduate students enrolled in a concrete structures course. Objectives: The objective of the study is to analyse the impact of DB VR and HMD VR on students' motivation, performance and workload in comparison with traditional 2D drawings. The study also aims to investigate how simulation sickness and system usability could impact students' motivation and performance when interpreting concrete structures. Methods: The study divided second‐year civil engineering students into three groups, 2D, DB VR and HMD VR. The performance and motivation levels of students were assessed based on the number of mistakes identified and an intrinsic motivation survey. Furthermore, data on system usability and simulation sickness were collected. Spearman rank correlation was conducted to analyse the relationships between the variables tested. Results: The results have shown that students' motivation and performance were much higher when using VR in general and HMD VR specifically, students' efficiency and accuracy were also observed. On the other hand, usability was found to be moderately correlated with motivation, with students rating HMD VR as the most usable approach. A moderate inverse correlation was observed between simulation sickness and motivation, indicating that higher simulation sickness led to lower motivation levels. Conclusion: The study concludes that integrating VR in general, DB VR, or HMD VR into a concrete structures course for undergraduate students can significantly improve students' performance and motivation. Furthermore, enhancing usability of any of the methods used can also improve the performance and motivation. On the other hand, simulation sickness inversely affects motivation and performance, therefore, VR developers and educators should not neglect it. Lay Description: What is already known about the topic: Traditional teaching methods in engineering education require improvement.Integrating digital technologies into engineering education enhances performance.Digital technologies can potentially enhance motivation. What this paper adds: Compares traditional teaching methods for concrete structures interpretation with virtual reality.Establishes correlations between motivation, performance and usabilityIntroduces how desktop‐based VR and head‐mounted display VR can produce varying results. Implications for practice and/or policy: Decision‐makers can use the information to integrate updated pedagogy into engineering curricula.Allows for further exploration of different digital technologies that can be used for concrete structure interpretation.Allows instructors to introduce virtual reality in their courses. [ABSTRACT FROM AUTHOR]

Background: Deep learning methods, where models do not use explicit features and instead rely on implicit features estimated during model training, suffer from an explainability problem. In text classification, saliency maps that reflect the importance of words in prediction are one approach toward explainability. However, little is known about whether the salient words agree with those identified by humans as important. Objectives: The current study examines in‐line annotations from human annotators and saliency map annotations from a deep learning model (ELECTRA transformer) to understand how well both humans and machines provide evidence for their assigned label. Methods: Data were responses to test items across a mix of United States subjects, states, and grades. Humans were trained to annotate responses to justify a crisis alert label and two model interpretability methods (LIME, Integrated Gradients) were used to obtain engine annotations. Human inter‐annotator agreement and engine agreement with the human annotators were computed and compared. Results and Conclusions: Human annotators agreed with one another at similar rates to those observed in the literature on similar tasks. The annotations derived using the integrated gradients (IG) agreed with human annotators at higher rates than LIME on most metrics; however, both methods underperformed relative to the human annotators. Implications: Saliency map‐based engine annotations show promise as a form of explanation, but do not reach human annotation agreement levels. Future work should examine the appropriate unit for annotation (e.g., word, sentence), other gradient based methods, and approaches for mapping the continuous saliency values to Boolean annotations. Lay Description: What is known about subject matter: Explainability of deep learning models is complicated by their large size, design, and complexity.Explainability methods in deep learning exist but have not been rigorously tested.Saliency maps, as a form of explainability, can be used to generate engine annotations.Human annotations can serve as basis for comparison. What paper adds to knowledge: How well human annotations work in one domain (crisis paper identification).How well two engine annotation methods match human annotations. Implications of study findings: Human annotations have reasonable reliability.Engine annotations have lower reliability than humans.Model‐based engine annotations perform better than model‐agnostic engine annotations. [ABSTRACT FROM AUTHOR]

Background: Teachers often rely on the use of open‐ended questions to assess students' conceptual understanding of assigned content. Particularly in the context of mathematics; teachers use these types of questions to gain insight into the processes and strategies adopted by students in solving mathematical problems beyond what is possible through more close‐ended problem types. While these types of problems are valuable to teachers, the variation in student responses to these questions makes it difficult, and time‐consuming, to evaluate and provide directed feedback. It is a well‐studied concept that feedback, both in terms of a numeric score but more importantly in the form of teacher‐authored comments, can help guide students as to how to improve, leading to increased learning. It is for this reason that teachers need better support not only for assessing students' work but also in providing meaningful and directed feedback to students. Objectives: In this paper, we seek to develop, evaluate, and examine machine learning models that support automated open response assessment and feedback. Methods: We build upon the prior research in the automatic assessment of student responses to open‐ended problems and introduce a novel approach that leverages student log data combined with machine learning and natural language processing methods. Utilizing sentence‐level semantic representations of student responses to open‐ended questions, we propose a collaborative filtering‐based approach to both predict student scores as well as recommend appropriate feedback messages for teachers to send to their students. Results and Conclusion: We find that our method outperforms previously published benchmarks across three different metrics for the task of predicting student performance. Through an error analysis, we identify several areas where future works may be able to improve upon our approach. Lay Description: What is already known about this topic: Open‐ended questions are used by teachers in the domain of mathematics to assess their students understanding but automated support for these types of questions are limited in online learning platforms. Recent advancements in areas of machine learning and natural language processing have led to promising results in a range of domains and applications. What this paper adds: Emulating how teachers identify similar student answers can be used to build tools that support teachers in assessing and providing feedback to student open‐ended work. Implications for practice: Developing better automated supports can increase the amount of direct feedback students receive to guide their learning. [ABSTRACT FROM AUTHOR]

Background: The use of virtual reality (VR) in medical education allows learners to make mistakes safely without risk to patients and to refine a range of clinical skills by repetition. However, there is still wide variability both between, and within countries regarding the amount of training delivered using VR, particularly in relation to intensive care medicine Objectives: To identify the range of uses, phase of development and effectiveness of VR for intensive care unit (ICU) staff training. Methods: The review followed the scoping review framework set out by Levac et al. (2010). A multi‐database search was undertaken. All study types were included if they explored the use of VR for intensive care staff (ICU) staff training. Full paper screening, data extraction and assessment of bias was carried out by a single reviewer with verification by a second reviewer. A narrative synthesis was chosen to summarize the data. Results: The search strategy identified 647 records. Following the removal of duplicates, screening of titles, abstracts and full texts, five studies were included. VR for ICU training has primarily focused on skill acquisition for surgical procedures. The majority of studies in this area were classified to be at an early stage of assessing acceptability, tolerability and efficacy. There was very low‐quality evidence that VR for ICU training is effective. Conclusions: Studies have explored the use of VR for a small number of surgical procedures and emergency patient scenarios. VR for ICU training demonstrates some potential, however further development and high‐quality research is required. Research relating to virtual reality for ICU staff training is currently of weak methodological quality and as such, no recommendations to clinical practise can be made. Wherever possible when using VR for ICU staff training it should be utilized as part of a high‐quality study. Lay Description: What is known about this topic: VR training may offer specific benefits compared to a more traditional method.VR for healthcare training has been shown to be effective in developing a range of clinical skills.The use of VR for healthcare training varies substantially in different clinical areas. What this paper adds: VR for ICU training for intensive care clinicians has mainly focused on the development of clinical skills.VR for ICU training is in the early stages of development.There is a need for further high‐quality research of VR for ICU training for effectiveness of clinical skill training.There is a need for VR training for soft or non‐technical skills. Implications of the study findings for practitioners: VR use in ICU staff training should only be considered as part of an ethically approved study. [ABSTRACT FROM AUTHOR]

Background: Social annotation (SA) allows users to collaboratively highlight important texts, make comments and discuss with each other on the same online document. This would not only accelerate and deepen learners' cognitive understanding of information, but also help build a sense of rapport, which is critical especially because of the worldwide shift from face‐to‐face class to remote education as a response to the COVID‐19 pandemic. Objective: To provide a systematic review of empirical SA studies, so that current development as well as issues in SA practices and research are identified. Methods: A total of 32 studies were identified and bibliometrical, instructional, and methodological analysis were conducted. Results and Conclusions: The United States has published the most SA research and technology‐related journals are most receptive of SA research; one‐shot quantitative designs with a sample size between 30 and 100 have been adopted most often; there is a lack of theoretical support for SA studies; higher education settings have been more frequently researched than other educational levels; SA technological features and activities have focused more on student uses and outcomes than on those of instructors; self‐designed technologies were more preferred than commercial ones; both cognitive and affective outcomes were emphasized and nearly all studies reported positive findings. Implications: Future SA studies may conduct blended designs with larger sample sizes that is grounded upon solid theoretical frameworks; more customized and affordable SA technologies that support both students and teachers should be developed. Learning analytics and emotional design may be capitalized more to meet the demand of remote education during the pandemic. Lay Description: What is Already Known About this Topic: The behaviour of annotating often helps learners obtain deeper understanding and retain longer memorization of learning content.Social annotation, which capitalizes the advantage of digital tools and collaboration, allows learners to annotate on the same document, and view each other's annotations to ignite discussion and maximize their individual learning.Social annotation has been widely used in educational settings amongst all ages of learners. What this Paper Adds: Provides a systematic review of empirical social annotation studies between 2000 and 2020, highlighting the analysis of bibliometrics, research designs, and learning outcomes and effects.Proposes a conceptual framework (the WIRE model) to guide the design and assessment of social annotation activities.Identifies challenges and gaps in existing research designs as well as instructional practices. Implications for Practice: Instructors can use the results to locate desirable social annotation technologies and design effective activities.Researchers may utilize the trend and research gaps to design future social annotation studies.Programmers can use WIRE to make an initial assessment of social annotation tool designs, and develop more customized products for formal education. [ABSTRACT FROM AUTHOR]