Search

Background: With increased use of artificial intelligence in the classroom, there is now a need to better understand the complementarity of intelligent learning technology and teachers to produce effective instruction. Objective: The paper reviews the current research on intelligent learning technology designed to make models of student learning and instruction transparent to teachers, an area we call model‐based learning analytics. We intended to gain an insight into the coupling between the knowledge models that underpin the intelligent system and the knowledge used by teachers in their classroom decision making. Methods: Using a systematic literature review methodology, we first identified 42 papers, mainly from the domain of intelligent tutoring systems and learning analytics dashboards that conformed to our selection criteria. We then qualitatively analysed the context in which the systems were applied, models they used and benefits reported for teachers and learners. Results and Conclusions: A majority of papers used either domain or learner models, suggesting that instructional decisions are mostly left to teachers. Compared to previous reviews, our set of papers appeared to have a stronger focus on providing teachers with theory‐driven insights and instructional decisions. This suggests that model‐based learning analytics can address some of the shortcomings of the field, like meaningfulness and actionability of learning analytics tools. However, impact in the classroom still needs further research, as in half of the cases the reported benefits were not backed with evidence. Future research should focus on the dynamic interaction between teachers and technology and how learning analytics has an impact on learning and decision making by teachers and students. We offer a taxonomy of knowledge models that can serve as a starting point for designing such interaction. Lay Description: What is currently known: Current learning analytics solutions are often not perceived helpful by teachers What this paper adds: Model‐based learning analytics seeks to make these systems more transparent and actionableOur review shows there is good potential that systems designed in this way would have greater impact on classroom teaching Implications for practitioners: Pedagogical‐psychological models should be an integral part of intelligent learning systems designsWe offer a taxonomy of such models and current good practices of their use as a starting point [ABSTRACT FROM AUTHOR]

Background: Text comprehension research in relation to the reading medium showed that digital‐based reading represents a disadvantage compared with paper‐based reading. Most paper versus screen research; however, was conducted with university students. Objectives: This study investigated the contribution of reading medium to text comprehension and medium preference in beginner readers who use technology for school learning. The moderating role of text genre, word reading and medium preference on the reading medium effect on text comprehension was also analysed. Methods: First graders (N = 115; mean age = 6;8 years) read narrative and informational linear texts on paper and computer screen and answered main idea, literal and inferential comprehension questions. Medium preference questions and a word reading task were administered. Results and Conclusions: Logistic mixed models showed that the main idea and literal comprehension of narrative and informational linear texts were greater on screen and for higher word reading skills. Inferential comprehension was lower on screen at lower levels of word reading skills but became similar for the two media as word reading increased. Children had no clear medium preference and medium effect on text comprehension was independent of children's medium preference. The main results show that beginner readers who use technology for learning and are fast and accurate in word reading display no comprehension disadvantage in digital reading. Takeaways: Our results add to existing knowledge by clarifying how reading medium effects on beginner readers' text comprehension interact with factors such as fundamental reading skills and experience with technology. Lay Description: What is currently know about the subject matter: • Comprehension of informational texts is better on paper than on screen • Text comprehension is better on paper than on screen for independent readers from 4th grade onwards, even for those who prefer to read digitally. • Lower text comprehension on screen is related to shallow reading processing and navigation requirements of digital texts. • Shallow reading processing is related to the use of digital media for leisure. What the paper adds: • Comprehension of narrative and informational texts on screen is not disadvantaged in beginner readers who often use technology for school activities. • Word reading has a stronger role on inferential comprehension of digital texts with navigation requirements. • Word reading stronger role results in a screen comprehension disadvantage at lower levels of word reading skills. • Children have no clear medium preference and text comprehension on paper vs screen was independent of children's medium preference Implications of study findings for practitioners: • The use of technology for school activities may encourage deep text processing on screen. • Care should be taken when very young students with low reading skills are required to understand digital texts with navigation requirements. [ABSTRACT FROM AUTHOR]

Background: In the digital environment, users' academic reading behaviour has changed, working with many articles simultaneously to search, filter, scan, link, annotate and analyse content fragments. The semantic enhancement environment has been widely set with semantic technologies to offer additional and handy support for users and thus facilitate the reading process. Despite many efforts devoted to developing a semantic enhancement environment, less attention has been paid to its actual effects. Objectives: This study aims to explore the effects of a semantic enhancement environment. Methods: Elaborating on cognitive load theory and focusing on academic reading, this study compared users' cognitive load and reading effect under the semantic enhancement environment and plain text environment and verified the three hypotheses. Results and conclusions: Through experiments and statistical analysis, this study found that, under a semantic enhancement environment, users had their cognitive load reduced and their reading effect improved. Consequently, a semantic enhancement environment promotes academic reading. Takeaways: This study adds to previous literature on semantic publishing by empirically corroborating the conducive effects of semantic enhancement environment in academic reading. Additionally, it justifies semantic publishing and provides a reference for the future design of semantically enhanced reading environments. Lay Description: What is already known about this topic?: The effects of a semantic enhancement environment are open to discuss.Academic reading is fundamental to researches and hence needs promotion.Limited studies investigated the effects of a semantic enhancement environment on academic reading.Publishers require effective reading environment designs. What this paper adds?: This study constructed a semantic enhancement reading environment to conduct a reading experiment.The experiment tested cognitive load, by using WP scale, and reading effects, by answer time and answer score.Semantic enhancement environment reduces users' cognitive load, promotes users' reading effects, and bolsters users' understanding of academic reading materials, especially in microstructure content.The design of semantic enhancement reading environments needs to fully consider the features of reading materials and give users a controllable way of interaction. The implications of study findings for practitioners: Compared to plain text environment, semantic enhancement environment is preferred in academic reading.Publishers are encouraged to add semantic enhancements to their publications.This study discussed how to design an effective learning and reading environment from the perspectives of reading resources, media forms of resources, and interaction modes. [ABSTRACT FROM AUTHOR]

Background: The sudden growth in online instruction due to COVID‐19 restrictions has given renewed urgency to questions about remote learning that have remained unresolved. Web‐based assessment software provides instructors an array of options for varying testing parameters, but the pedagogical impacts of some of these variations has yet to be examined. Objectives: The current study examines whether question order affects student performance on online college math assessments. Drawing on the literature of testing and math anxiety, we hypothesized that difficult questions near the beginning of an assessment would have a destructive effect on student confidence, which would in turn have a deleterious effect on their performance. Methods: We employed an observational 'big data' methodology, analysing 23,468 final exams completed by students in 10 different courses over eight semesters at a Math Emporium in a large technical university in the eastern United States. Students were freshmen and sophomores enrolled in non‐engineering math courses. We regressed the final score on the difficulty level of the first and second questions, controlling for several other factors. Results and Conclusions: We found that several factors—day of the week, amount of time before the deadline, number of minutes spent on the exam—have more of an impact on score than question order. This pattern was consistent across sexes. Takeaways: Our findings contradict some previous studies, which have found that difficult early questions degrade student performance, and that this affect is more pronounced in females. This work enriches our understanding of how students respond to online assessment. Lay Description: What is already known about this topic: Previous studies have had mixed results about the effect of question difficulty ordering on student performance.Furthermore, few studies have examined this issue for computer assessments. What this paper adds: We employ a novel methodology with a uniquely large data set.Our findings indicate that difficulty ordering has no effect on student performance. Implications for practice: Math instructors can use the random ordering feature of computer assessment generating tools because question order does not affect performance. [ABSTRACT FROM AUTHOR]

Background: The use of e‐exams in higher education is increasing. However, the role of student diversity in the acceptance of e‐exams is an under‐researched topic. In the current study, we considered student diversity in terms of three sociodemographic characteristics (age, gender, and second language) and three dispositional student characteristics (computer anxiety, test anxiety, and technology openness). Objectives: The main objective of this study was to investigate the relationship between student diversity and acceptance of e‐exams. Methods: Our research combined cross‐sectional analyses (N = 1639) with data from a natural experiment on the introduction of e‐exams versus the established paper‐pencil exams (N = 626) and used both self‐report and institutional data. Sociodemographic and dispositional characteristics were indirectly related to pre‐exam acceptance via expectancy variables from the Technology Acceptance Model framework. Results and Conclusions: Comparisons of post‐exam acceptance showed that practical experience with the e‐exam led to a significant increase in e‐exam acceptance, and that students with low openness toward technology particularly benefited from this effect. Students' exam performance (i.e., grades) was unrelated to the exam format or their pre‐exam acceptance of the e‐exam format, and this was true across students' sociodemographic and dispositional characteristics. Takeaway: Student diversity plays a role in e‐exam acceptance, but its influence is mitigated by first‐hand experience with e‐exams. The practical implications for higher education institutions aiming to implement e‐exams are discussed. Lay Description: What is already known about this topic: The use of e‐exams in higher education is increasingThe role of student diversity for e‐exam acceptance is unclearTechnology acceptance is predicted by expectancies towards new system What this paper adds: We investigated students' sociodemographic and dispositional diversityDiversity predicted e‐exam acceptance via the expectanciesIn a natural experiment, first‐hand experience increased e‐exam acceptanceNo difference between performance in e‐exams and paper‐pencil‐exams found Implications of the study findings for practitioners: Higher education institutions implementing e‐exams should consider diversitySupport for older students and students with low technology openness neededNo student groups systematically disadvantaged by e‐exam implementationPractice rooms can increase experience with new system before exam [ABSTRACT FROM AUTHOR]

Background: The impact of mobile technology usage on student learning in various educational stages has been the subject of ongoing empirical and review research. The most recent meta‐analyses on various types of mobile technology use for potential benefits of learning covered the empirical studies up to about nine years ago. Since then, the use of mobile technology in primary and secondary education has increased tremendously, and numerous empirical studies have been conducted on this topic, but their conclusions were inconsistent. Objectives: The purpose of this systematic review is to re‐examine this issue by meta‐analyzing the empirical research studies from the last nine years, with a focus on cognitive, affective, and behavioral learning outcomes in primary and secondary education, and to examine the potential moderators that may have contributed to the heterogeneity across findings. Methods: Based on our inclusion and exclusion criteria, we found 85 studies of 78 peer‐reviewed papers (N = 9157) from electronic databases and major journals in educational technology and mobile learning between 2014 and 2022. We then examined 15 moderators that were expected to affect student learning outcomes. Results and Conclusions: Compared with traditional technology and non‐technology groups, using mobile technology produced medium positive and statistically significant effects on primary and secondary students' learning, in terms of cognitive (g = 0.498, 95% CI [0.382, 0.614]), affective (g = 0.449, 95% CI [0.301, 0.598]) and behavioural (g = 0.339, 95% CI [0.051, 0.627]) learning outcomes. Further moderator analyses revealed that student factors (i.e., community type, students' socioeconomic status), learning process (i.e., hardware used, student‐to‐hardware ratio, teaching method) and study quality (i.e., learning topic/content equivalence, degree of technology use in the control group) were among the variables that moderated the summary effect sizes for at least one learning outcome dimension significantly. The findings and their implications for researchers, policymakers and practitioners are discussed. Lay Description: What is already known about this topic: Mobile learning has become a fast‐growing research field.The benefits of mobile technology usage are related to learning outcomes.The pooled effects of mobile learning have been limited to cognitive learning. What this paper adds: This meta‐analysis focused on mobile learning versus traditional learning.The population was composed of students in primary and secondary education.Mobile technology usage contributed to higher cognitive, affective, and behavioural learning outcomes.Students from low socioeconomic backgrounds and rural areas benefited less from mobile technology interventions. Implications for practice and/or policy: Educational stakeholders need to take actions to adopt and support mobile technology usage in education.Mobile‐learning researchers need to optimize the quality of experimental studies. [ABSTRACT FROM AUTHOR]

The adoption of Information and Communication Technologies in early childhood education is crucial for adapting traditional classrooms to the digital era. Over time, young children are increasingly using touch screen technologies such as tablets at home and in early childhood settings. However, the literature shows that there is a significant gap in knowledge of using this technology in early childhood education. Most researchers have focused on the pedagogical theory behind using touch screen devices, but there have not been many empirical studies about how these technologies affect students' learning processes. This paper presents three learning experiences where early childhood students perform educational activities using tablet computers, interactive whiteboards, and paper cards. The results show that students who used the technology were more motivated and achieved better results that those who used paper cards. Lay Description: What is already known about this topic: The use of ICT in childhood education offers new possibilities for teachers to provide new and more visual digital learning content to their students.Touch technologies seem suitable for young students. Because their motor skills are not fully developed yet, interacting with computers through a mouse and a keyboard is more difficult than doing it through natural gestures.There are many studies in higher education levels that demonstrate that proper use of ICT in education can lead to an increase of the students' motivation and learning. What this paper adds: Three empirical studies in three different childhood education classrooms to shed some light about how ICT can impact positively students learning.A comparison of interactive whiteboards and tablet computers benefits regarding more traditional methodologies in childhood education.Insights about how hardware and software can be combined to provide students a suitable learning environment in childhood education classrooms. Implications for practice and/or policy: Teachers should consider how they will create the workgroups. It is highly advisable to create heterogeneous groups taking into account the students' skills. This way, members of the same group can help each other, creating a richer learning scenario.Several teachers who participated in our studies said that they were not able to use ICT in their classrooms because they did not have enough digital competences. Our studies and the results obtained led them consider integrating technology in their classrooms. The good results obtained by the students who worked with technology changed the teachers' perspective about the use of technology in the classroom.Students showed a great interest in the use of tablet computers and interactive whiteboards, which translated into higher motivation compared with the students who solved the activities on paper. [ABSTRACT FROM AUTHOR]

Background: Online learning has grown significantly during the past two decades, and COVID‐19 pandemic has expedited this process. However, previous research has shown how academic dishonesty is more prevalent under these modalities. Therefore, there is the challenge of performing trustworthy remote assessments, in order to obtain valid and reliable measures of students' knowledge. Objectives: The research question that drove this research was: what actions have been proposed in contemporary research to improve remote assessment trustworthiness from a technological and pedagogical perspective? Methods: We analysed the papers accepted for the special issue titled 'Trustworthy Assessment and Academic Integrity in Remote Learning' following a deductive qualitative category coding methodology to find the main approaches. Results and conclusions: We identified eight approaches to improve trustworthiness in remote assessment: four for exams and high‐stake tests, one exclusively for performance‐based assessments, and three for any type of assessment. Our findings shift attention from academic dishonesty to trustworthy assessment, integrating recent findings of papers accepted to this special issue. Implications: Our findings deepen current understanding of trustworthy remote assessments, inviting practitioners and researchers to explore different types of assessment methods and different moments related to assessing learning. Lay Description: What is already known about this topic?: Online learning has grown significantly during the last decade.This growth increases the need for online assessment methods that can provide a valid, reliable, and fair measure of student knowledge.Research demonstrated the prevalence of academic dishonesty in online learning.There is a timely need to research and develop methods for trustworthy online assessment, as well as to raise the awareness of researchers, practitioners, and administrators, to the topic and to the solutions at hand. What this paper adds?: A review of the state‐of‐the‐art with respect to trustworthy assessment in online learning.A typology of strategies to improve trustworthy assessment, characterizing the pedagogical approach, technological method, context, and type of assessment.An analysis of different solutions, approaches, and case studies, with respect to the proposed typology.A novel approach to inform the design and implementation of valid and reliable online assessment. The implications for practitioners: The paper presents strategies and approaches for implementing trustworthy assessment in online learning.The paper provides a conceptual framework that can inform the design of valid and reliable assessments methods, and analyse both existing and newly proposed onesHighlighting the importance of including the assessment as an integral part of the instructional design phase of online learning offerings. [ABSTRACT FROM AUTHOR]

Background: AI can positively influence teaching by offering support for classroom management, creating inclusive learning environments, enhancing digital skills, personalizing teaching methods, and strengthening teacher‐student relationships. Objectives: This quantitative research study investigates the opportunities, difficulties, and consequences of incorporating AI into teacher education. Methods: Data were collected through structured questionnaires from 202 college students and 68 staff members. The analysis was conducted using SPSS software. Results: The study provides a novel contribution by its thorough investigation of the diverse effects of AI on teacher education. It offers beneficial perspectives on the possible benefits and challenges, illuminating the far‐reaching changes that AI could bring to the terrain of learning and instruction and teaching methods in the time yet to come. The research sought to assess the effect of AI adoption in teacher education across five main dimensions: (i) its influence on teaching support and classroom management, (ii) its role in creating inclusive and accessible learning environments, (iii) its contribution to improving teachers' digital literacy and computer skills, and enhancing access to digital teaching resources, (iv) its positive influence on identifying students' learning styles and facilitating the adoption of diverse teaching methods, and (v) its role in strengthening teacher‐student relationships through improved interactions. Conclusion: The findings elucidate the promising opportunities that AI presents in the field of teacher education, along with the obstacles that require resolution for the effective fusion of AI educational settings. Lay Description: What is currently known about this topic?: AI has the potential to enhance various aspects of teaching, including classroom management and personalizing teaching methods.Incorporating AI into education has garnered significant interest due to its perceived benefits in improving learning outcomes. What does this paper add?: This paper provides a comprehensive investigation into the effects of AI adoption in teacher education, highlighting both the opportunities and challenges associated with its implementation.It offers insights into how AI can influence different dimensions of teaching, such as classroom management, learning environment inclusivity, and teacher‐student relationships. Implications for practice/or policy: The findings of this study underscore the importance of integrating AI into teacher education programs to leverage its potential benefits in enhancing teaching practices.Policymakers and educators should consider the implications of AI adoption in education and develop strategies to address challenges while maximizing the advantages of AI technologies in teaching and learning. [ABSTRACT FROM AUTHOR]

Background: Instructional videos constitute a pivotal component in flipped learning. Despite their significance, there is a dearth of research specifically dedicated to instructional videos within the context of flipped classrooms. This paucity has led to an empirical void in verifying the efficacy of instructional videos in flipped learning environments. Objectives: The present study endeavours to contribute to the extant literature on flipped pedagogical practices by providing empirical evidence regarding the effectiveness of instructional videos in flipped learning environments. Methods: This study employs a convergent mixed‐methods design. Forty‐five instructional videos in three subtypes were administered in two classes over a 15‐week semester. Data, both quantitative (log data from the learning management system) and qualitative (from focus group discussions at two time points), were concurrently collected from a flipped class (n = 25) and a blended class (n = 28) with the aim of gauging student engagement and learning outcomes in the flipped class and understanding video‐viewing features typical of the flipped class. Results: Both datasets corroborated that participants in the flipped class outperformed their counterparts in the blended class in terms of video‐watching, peer interaction, knowledge retention, and transfer skills. Conclusions: The instructional videos within the flipped classroom setting serve to enhance student engagement in the learning process and improve learning outcomes. The efficacy of these instructional videos in flipped learning can be further augmented through strategic approaches in both their design and implementation. Lay Description: What is currently known about this topic: The flipping pedagogy is conducive to learning.Videos play a crucial role in flipped learning.Videos prepared students for classroom activities.However, engaging students with pre‐class videos presents a challenge. What this paper adds: This paper furnishes direct empirical evidence supporting the effectiveness of instructional videos in flipped learning.It uncovers factors affecting student engagement with videos in flipped learning.It offers insights into the design and implementation of videos in flipped learning. Implications for practice: Considering facilitating conditions and affective factors when creating videos.Acknowledging learner characteristics when designing videos.Utilizing instructional strategies when implementing videos. [ABSTRACT FROM AUTHOR]

Background: Online interaction in blended learning is leveraged through social presence and convergence. However, little systematic work currently exists on how researchers have explored these challenges in higher education institutions and no studies have synthesised these challenges. Objectives: The purpose of this study is to give a novel overview of social presence and convergence to improve online interaction in blended learning in higher education. The findings will be synthesised into blended learning design principles. Method: Two systematic literature reviews, one on each challenge, were carried out through the Web of Science databases and consulting cited sources in review articles. Accordingly, 28 distinct studies were selected through the guidelines of the PRISMA statement, using predefined selection criteria. Results and Conclusions: The results show that social presence in blended learning is mostly evoked through course design, introductory f2f meetings, collaborative activities, prompt online feedback, the teacher's presence, and planned facilitation. To establish convergence, it is recommended to make basic theory available online through video clips, web‐lectures, articles, followed by simple online assignments or self‐study to increase understanding, thereby creating opportunities for deep learning during face‐to‐face through discussions and collaborative activities. Implications: This paper adds to the theory on blended learning and instructional design in higher education, and further offers an elaborate set of design principles for educational practice. Future research on instructional design may investigate in particular how a target group or student factors, are affected by the blended learning environment in order to tailor designs for a specific target group. Lay Description: What is known?: Online interaction is pivotal in blended learningOnline interaction is leveraged through social presence and convergenceSocial presence prevents the online student from feeling lonelyConvergence entails deciding the best‐suited delivery mode: online or face‐to‐face What this paper adds: A novel overview and critical analysis of social presence in blended learningA novel overview and critical analysis of convergence in blended learningA synthesis of the findings on social presence and convergenceExtraction of the findings into blended learning design principles Implications for practitioners: The teacher's presence through design and accessibility fosters students' social presencePlacing concepts online leaves room for deep learning during face‐to‐faceCollaborative activities evoke social presence and facilitate deep learningBlended learning designs should be further tailored for the target group [ABSTRACT FROM AUTHOR]

Background: In example‐based learning, examples are often combined with generative activities, such as comparative self‐explanations of example cases. Comparisons induce heavy demands on working memory, especially in complex domains. Hence, only stronger learners may benefit from comparative self‐explanations. While static text‐based examples can be compared easily, this is challenging for transient video‐based modelling examples used in complex domains because simultaneous processing of two videos is not feasible. Objectives: To allow for such comparisons, we combined video‐based modelling examples with static representations (i.e., summarizing tables) of the observed optimal and a suboptimal solution of the problem‐solving process. A comparative self‐explanation prompt asked learners to compare the different solution approaches. Our study investigated the impact of video‐based modelling examples versus independent problem‐solving on cognitive load and problem‐solving skill development. Moreover, we investigated the effects of comparative versus sequential self‐explanation prompts, depending on learners' prior knowledge. Methods: In an experiment, 118 automotive apprentices learned a car malfunction diagnosis strategy. Apprentices were divided into three groups: (1) modelling examples with comparative self‐explanation prompts, (2) modelling examples with sequential prompts, and (3) no examples or prompts. Diagnostic knowledge and skills were assessed before and after the intervention. Cognitive load was measured retrospectively. Results and conclusions: Despite no observed effects on cognitive load, modelling examples enhanced diagnostic knowledge and diagnostic skills with scaffolds, though not independent diagnostic skills without scaffolds. The need for more practice opportunities to foster independent diagnostic skills is assumed. Additionally, comparative prompts seem promising for learners with higher prior knowledge. Takeaways: Video‐based modelling examples were more beneficial for learning than practising to apply the diagnostic strategy. Static representations allow for comparisons of video examples and comparative prompts are promising for learners with higher prior knowledge (cf. expertise‐reversal effect). Further research, especially on the effects on cognitive load, is necessary. Lay Description: What is already known about the topic?: Text and video examples that model how to solve a problem are widely used in education.Text examples often include self‐explanation prompts that ask learners to compare several examples.For video examples, such comparison prompts have seldom been investigated, because comparisons are difficult to implement for transient videos. What does this paper add?: This paper shows that video examples combined with static summaries of processes that have been shown in the video example are effective and allow for comparisons of video examples.Such comparisons seem to be more promising for learners with higher prior knowledge. Implications for practice: Practitioners could combine video examples with static summaries of the processes shown in the video examples to allow for comparisons. [ABSTRACT FROM AUTHOR]

Background: Both socially regulated learning and cognitive quality are important factors affecting collaborative knowledge building, but the current research lacks a joint quantified evaluation method that combines these two aspects. Objectives: Based on the existing framework, we proposed a joint evaluation method for regulated learning and cognitive quality in collaborative knowledge building, and further extracted the evaluation indicators. Methods: This study involved 74 learners enrolled in a course named 'the Application of Modern Educational Technology' as the subject of study, and made a case analysis with this method. Results and Conclusions: First, the indicators of this joint evaluation method could complement the indicators of traditional frequency statistics methods and facilitate an analysis of regulated learning and cognitive quality in collaborative knowledge building. Second, the group with a higher proportion of high‐level cognitive quality and socially shared regulation in collaborative knowledge building achieved better final scores. Finally, four types of groups were obtained through clustering: excellent, risky, mixed group, and highly collaborative group. This study introduced a joint evaluation method for regulated learning and cognitive quality in collaborative knowledge building and provides suggestions for future research. Lay Description: What is currently known about this topic?: Online collaborative knowledge building is increasingly important.Regulated learning and cognitive quality are considered very important for successful collaborative learning.Without quantitative methods, it is difficult to assess regulated learning and cognitive quality during collaborative knowledge building in a timely manner. What does this paper add?: This paper provided a joint evaluation method of regulated learning and cognitive quality (JERC) for online collaborative knowledge building.A case study was conducted to identify JERC's usefulness. Using descriptive statistics and visualization, it was determined that indicators of JERC can not only capture the state of cognitive quality and regulated learning status, but also elucidate the nature of that status (i.e., comprehensive, dynamic, cyclical).Through clustering analysis, four distinct groups were identified, each exhibiting different characteristics and moving patterns of regulated learning and cognitive quality over time. These patterns indicate that the quality of cognitive and regulatory learning cannot be determined solely by behavioural frequency. Moreover, an excessive proportion of individual regulation cannot predict better learning performance. Implications for practice: A computable representation model of regulated learning and cognitive quality was constructed to support automated perception and intervention in regulated learning and cognitive processing.With JERC, it is possible for researchers to capture, process, analyse and predict dynamic data to examine online collaborative knowledge building combined with shared physiological arousal events.The results of JERC can be used by researchers to develop advanced techniques, such as AI deep learning, for designing adaptive supports that can foster students' online collaborative knowledge building. [ABSTRACT FROM AUTHOR]

Background: Measuring students' self‐regulation skills is essential to understand how they approach their learning tasks in order to identify areas where they might need additional support. Traditionally, self‐report questionnaires and think aloud protocols have been used to measure self‐regulated learning skills (SRL). However, these methods are based on students' interpretation, so they are prone to potential inaccuracy. Recently, there has been a growing interest in utilizing learning analytics (LA) to capture students' self‐regulated learning (SRL) by extracting indicators from their online trace data. Objectives: This paper aims to identify the indicators and metrics employed by previous studies to measure SRL in higher education. Additionally, the study examined how these measurements were validated. Methods: Following the protocol of Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA), this study conducted an analysis of 25 articles, published between 2015 and 2022, and sourced from major databases. Results and Conclusions: The results showed that previous research used a variety of indicators to capture learners' SRL. Most of these indicators are related to time management skills, such as indicators of engagement, regularity, and anti‐procrastination. Furthermore, the study found that the majority of the reviewed studies did not validate the proposed measurements based on any theoretical models. This highlights the importance of fostering closer collaboration between learning analytics and learning science to ensure the extracted indicators accurately represent students' learning processes. Moreover, this collaboration can enhance the validity and reliability of data‐driven approaches, ultimately leading to more meaningful and impactful educational interventions. Lay Description: What is already known about this topic?: Measuring students' self‐regulation skills is essential for understanding their learning approaches and identifying areas requiring further support.Traditionally, questionnaires and interviews have been used to measure learners' self‐regulation; however, these methods rely on students' own views, which can sometimes be unreliable.Recently, there has been more interest in using learning analytics to measure students' self‐regulation based on data extracted from their online activities. What this paper adds?: This paper systematically analyses how previous studies used learning analytics to measure students' self‐regulation in higher education.It examines how these measurements were validated. Implications for practise and/or policy: More collaboration is needed between researcher in learning science and learning analytics is essential to ensure that the metrics and methods developed are not only theoretically sound but also practically relevant. This collaboration ultimately contributes to the design of enhanced learning experiences and outcomes. [ABSTRACT FROM AUTHOR]

Background: The emergence of ChatGPT in the education literature represents a transformative phase in educational technology research, marked by a surge in publications driven by initial research interest in new topics and media hype. While these publications highlight ChatGPT's potential in education, concerns arise regarding their quality, methodology, and uniqueness. Objective: Our study employs unconventional methods by combining altmetrics and bibliometrics to explore ChatGPT in education comprehensively. Methods: Two scholarly databases, Web of Science and Altmetric, were adopted to retrieve publications with citations and those mentioned on social media, respectively. We used a search query, "ChatGPT," and set the publication date between November 30th, 2022, and August 31st, 2023. Both datasets were within the education‐related domains. Through a filtering process, we identified three publication categories: 49 papers with both altmetrics and citations, 60 with altmetrics only, and 66 with citations only. Descriptive statistical analysis was conducted on all three lists of papers, further dividing the entire collection into three distinct periods. All the selected papers underwent detailed coding regarding open access, paper types, subject domains, and learner levels. Furthermore, we analysed the keywords occurring and visualized clusters of the co‐occurring keywords. Results and Conclusions: An intriguing finding is the significant correlation between media/social media mentions and academic citations in ChatGPT in education papers, underscoring the transformative potential of ChatGPT and the urgency of its incorporation into practice. Our keyword analysis also reveals distinctions between the themes of the papers that received both mentions and citations and those that received only citations but no mentions. Additionally, we noticed a limitation that authors' choice of keywords might be influenced by individual subjective judgements, potentially skewing results in thematic analysis based solely on author‐assigned keywords such as keyword co‐occurrence analysis. Henceforth, we advocate for developing a standardized keyword taxonomy in the educational technology field and integrating Large Language Models to enhance keyword analysis in altmetric and bibliometric tools. This study reveals that ChatGPT in education literature is evolving from rapid publication to rigorous research. Lay Description: What is currently known about this topic?: ChatGPT in education has seen a surge in publications driven by media hype.Early publications tend to lack rigour and reiterate known advantages/disadvantages.Literature reviews on ChatGPT in education have limitations in scope and depth.Some studies have explored altmetrics and bibliometrics in other fields. What does this paper add?: Combines altmetrics and bibliometrics to analyse publications of ChatGPT in education.Addresses challenges in the discourse by offering unconventional analysis methods.Identifies publication trends and investigates the relationship between media attention and citations.Determines key themes in the literature through keyword co‐occurrence analysis. Implications for practice/or policy: Expectations of continued growth in ChatGPT literature but with evolving publication trends.Distinctive characteristics of ChatGPT in education challenge keyword analysis.Proposes the development of a unified keyword taxonomy for clarity in the field.Suggests enhancing altmetrics and bibliometrics tools using Large Language Models. [ABSTRACT FROM AUTHOR]

Background: Mindfulness practices enhance executive function skills and academic achievement, spurring interest in integrating mindfulness interventions into education. Embedding mindfulness practice into a digital math game may provide a low‐cost, scalable way to induce mindfulness and boost game‐based learning, yet this approach remains unexplored. Objectives: We investigated the learning benefits of integrating mindfulness exercises in a digital math learning game and examined how students' trait mindfulness might moderate the outcomes. Methods: Two classroom studies were conducted with 404 5th and 6th grade students from six public schools in the U.S. (nStudy 1 = 227, nStudy 2 = 177). The two randomized controlled experiments assigned students to one of the three conditions: passive control (playing the digital learning game Decimal Point), story‐enriched active control, or mindfulness‐enriched condition. Trait mindfulness, learning gains, and in‐game problem‐solving (including problem‐solving duration, error count and correctness after reminder) were assessed. Study 2 included a manipulation check to better understand the effects of the mindfulness intervention. Results: Findings showed no significant differences in learning gains, problem‐solving duration or error count among the conditions. Students' trait mindfulness did not moderate these outcomes. Mindfulness reminders in the mindfulness‐enriched game led to more correct answers after errors than jokes in the story‐enriched game. Study 2 revealed that we failed to induce higher state mindfulness through the mindfulness inductions. Conclusions: Mindfulness prompts could be especially beneficial for students experiencing frustration during gameplay, warranting more exploration for digital game‐based instruction. We highlight barriers and future directions for fostering mindfulness through computer‐based instruction in classrooms. Lay Description: What is currently known about this topic?: Researchers focus on digital games as productive learning environments for math, with potential for higher learning gains compared with traditional methods. However, results are mixed, and not all games lead to improved math outcomes.Executive function (EF) skills are crucial for math learning, and mindfulness‐based interventions show promise in enhancing EF skills in school‐aged students.Embedding mindfulness practice into a digital math game may provide a low‐cost, scalable way to induce mindfulness and, in turn, boost EF skills and game‐based learning, yet this approach remains unexplored What does this paper add?: This paper presents the results of two randomized control trials investigating the feasibility and benefits of incorporating mindfulness exercises into a digital math game designed for middle school students. Benefits are compared to those of a story‐enriched and regular version of the same digital math learning game.The paper also explores variations in the effects of the mindfulness‐enriched game based on students' initial trait mindfulness levels.We observe that listening to mindfulness inductions at the beginning of game sessions do not induce mindfulness, and therefore does not benefit math learning.We find that mindfulness prompts received after recurrent errors can be beneficial for students' problem solving. Implications of study findings for practitioners: Our study provides important information on how digital learning game designers should attempt to induce mindfulness in a digital game to promote learning.Digital learning game designers should consider incorporating mindfulness exercises into their games strategically. Presenting mindfulness inductions in audio format at the beginning of game sessions may not induce mindfulness or benefit math learning. Instead, designers should focus on integrating mindfulness prompts at moments when students encounter frustration within the learning game.Beyond embedding audio mindfulness exercises in the game, learning designers should also consider alternative technological and game features to induce mindfulness within a learning game. [ABSTRACT FROM AUTHOR]

Background: Behavioural intention (BI) has been predicted using other variables by adopting the technology acceptance model (TAM). However, few studies have examined whether BI can predict learning performance. Objectives: The present study used an extended TAM to investigate whether students' BI is a predictor of their listening learning performance (LLP) through vocabulary learning performance (VLP) in the context of mobile vocabulary‐assisted listening learning by using two mobile learning tools. Methods: A total of 129 college students with a pre‐intermediate level of English were recruited as participants, and a 10‐week mobile vocabulary‐assisted, listening‐learning course was conducted in 2022. In each task of this course, the students had to learn target words from a listening passage on Quizlet and then engage in listening activities on Randall's ESL Cyber Listening Lab. Quantitative responses obtained through an online questionnaire were analysed through partial‐least‐squares structural equation modelling. Results: The analysis results indicated that BI significantly predicted LLP through VLP. Perceived ease of use (PEU) and perceived usefulness (PU) were significant antecedents of BI. However, PEU did not significantly predict PU because of the difficulty of navigating between the two technological tools used in this study. The extended model demonstrated its effectiveness in explaining listening learning performance, as evidenced by an explained variance (R2) of 69%. Conclusion: The extended model validates the influence of BI on learning performance and it can also draw teachers' focus toward the significance of enhancing students' BI to improve their listening learning performance. Pedagogical implications based on the results are provided in this paper. Lay Description: What is already known about this topic?: TAM was used to study learners' acceptance of mobile‐assisted language learning.TAM incorporates latent variables to explore mobile‐assisted language learning.Investigating factors influencing BI is a primary research focus in extended TAM literature.Mobile tools could improve listening learning and vocabulary retention. What this paper adds to that: Learning performance was considered as a dependent variable in an extended TAM.BI might predict students' learning performance in vocabulary and listening in an extended TAM.Teachers used two mobile tools to design mobile vocabulary‐assisted listening tasks.Pre‐learning the target words facilitate students' listening learning performance. Implications for practice and/or policy: We show the importance of BI on predicting listening learning performance.The impact of BI on other factors became another focus of TAM research.Results highlight pre‐learning target words' importance for better listening performance.Existing mobile tools improve listening performance, avoiding new system development. [ABSTRACT FROM AUTHOR]

Background: Learner profiles detected from digital trace data are typically triangulated with survey data to explain those profiles based on learners' internal conditions (e.g., motivation). However, survey data are often analysed with limited consideration of the interconnected nature of learners' internal conditions. Objectives: Aiming to enable a thorough understanding of trace‐based learner profiles, this paper presents and evaluates a comprehensive approach to analysis of learners' self‐reports, which extends conventional statistical methods with psychological networks analysis. Methods: The study context is a massive open online course (MOOC) aimed at promoting physical activity (PA) for health. Learners' (N = 497) perceptions related to PA, as well as their self‐efficacy and intentions to increase the level of PA were collected before and after the MOOC, while their interactions with the course were logged as digital traces. Learner profiles derived from trace data were further examined and interpreted through a combined use of conventional statistical methods and psychological networks analysis. Results and Conclusions: The inclusion of psychological networks in the analysis of learners' self‐reports collected before the start of the MOOC offers better understanding of trace‐based learner profiles, compared to the conventional statistical analysis only. Likewise, the combined use of conventional statistical methods and psychological networks in the analysis of learners' self‐reports before and after the MOOC provided more comprehensive insights about changes in the constructs measured in each learner profile. Major Takeaways: The combined use of conventional statistical methods and psychological networks presented in this paper sets a path for a comprehensive analysis of survey data. The insights it offers complement the information about learner profiles derived from trace data, thus allowing for a more thorough understanding of learners' course engagement than any individual method or data source would allow. Lay Description: What is already known about this topic: Researchers have made extensive use of data from online learning platforms—often referred to as learning trace data—to understand how learners engage in online learning activities.Surveys are often used to gather information about learners' motivation, perceptions, and other internal factors, to complement the insight gleaned from learning traces and thus create a more complete picture of the learning behaviour.When analysing survey data, the focus is usually on individual factors without considering how different factors are connected and affect one another.Psychological networks analysis is a novel analytic approach to studying complex phenomena both in psychology and education. What this paper adds: The paper uses psychological networks as a method for examining mutual relations among learners' internal factors (e.g., motivation, perceptions) measured through self‐reports before and after a course.By combining conventional statistical analysis of self‐reports with psychological networks analysis, the paper develops a comprehensive picture of learners' internal factors measured through self‐reports, one that accounts for both individual and interconnected nature of those factors.This comprehensive approach to information extraction from surveys allows for better understanding of trace‐based learner profiles, that is, profiles mined from data about learners' interaction with online learning activities. Implications for practice and/or policy: The presented method paves a way for a comprehensive analysis of the data collected from learners through surveys.It helps us gain a better understanding of learners' engagement with online learning activities.It can advance the evaluation of digital educational programs that aim to encourage changes in health‐related behaviour. [ABSTRACT FROM AUTHOR]

Background: Painting is the foundational expression across all art forms and is one of the key creative practices for fostering students' aesthetic ability and creativity within fine arts courses. Collaborative painting in the form of socially shared regulation of learning (SSRL) can be recognized as an effective strategy for enhancing creativity in both individual and group work. However, the absence of contextual experiences and collaborative spaces poses challenges for students in cultivating their creativity in painting. Objectives: The present study explores students' creativity, socially shared regulation (SSR) and positive painting behaviours using an SSRL‐based collaborative painting approach in the metaverse (Meta‐CP). Methods: Via a quasi‐experimental design, a total of 40 Chinese students in fifth grade were recruited and were randomly divided into an experimental group and a control group, with 20 students utilizing the Meta‐CP approach, while the remaining 20 students followed the conventional SSRL‐based paper‐and‐brush collaborative painting (C‐CP) approach. The Meta‐CP approach not only offers an authentic painting context and a collaborative space but also facilitates the collaborative process through the SSRL framework. The data collection included students' creative tendency, painting works and painting process. Results and Conclusions: The Meta‐CP approach effectively enhances students' creativity concerning adventure, curiosity and imagination, as well as results in the creation of more distinctive and logical artistic works. Furthermore, the approach significantly improved the quality of students' SSR. Additionally, students utilizing the Meta‐CP approach displayed more positive painting behaviours compared with those employing the C‐CP approach. Lay Description: What is already known about this topic:Collaborative painting is an effective strategy for enhancing creativity.Socially shared regulation of learning (SSRL) fosters collaborative learning.Students in collaborative painting may lack a contextual and synchronized painting space.The metaverse benefits in terms of contextual experiences and collaborative spaces. What this paper adds:Using an SSRL‐based collaborative painting approach in the metaverse (Meta‐CP) is effective in improving students' creativity.The Meta‐CP approach has the potential to improve students' quality of socially shared regulation (SSR), and positive painting behaviours. Implications for practice and/or policy:The metaverse provides an immersive synchronized painting space for art education to stimulate students' creative potential.The metaverse with proper learning strategies (e.g., SSRL) provides an effective collaborative learning environment for creation. [ABSTRACT FROM AUTHOR]

Background: Social annotation has emerged as a promising educational technology that fosters collaborative reading and discussion of digital resources among learners. While the positive impact of social annotation on students' learning process and performance is widely acknowledged, students' behavioural patterns in social annotation are underexplored. Objectives: This study investigated patterns in students' use of annotation and response behaviours in social annotation activities. We also explored how students' performance in the behavioural, cognitive, emotional, and social dimensions varied based on their behavioural patterns. Methods: We recruited 93 undergraduates who were enrolled in an elective course at a large North American University. Students were tasked with collaboratively annotating the class readings uploaded to Perusall, a social annotation platform, over 7 weeks. We used metaclustering to determine the optimal number of clusters pertaining to student behaviours. We compared the differences among clusters across multiple performance dimensions. Results and Conclusions: Two distinct clusters were identified and defined as initiators and responders. We found that responders had significantly longer active reading time and exhibited greater social annotation effort compared to initiators. However, initiators received more peer acknowledgement, as evidenced by higher upvotes. No significant difference was found in cognitive insight between initiators and responders, but responders demonstrated significantly higher cognitive discrepancy. Additionally, there were no significant differences in positive and negative tones between initiators and responders; however, responders displayed higher levels of prosocial behaviours than initiators. This study has significant practical implications regarding promoting students' collaborative learning experience in social annotation. Lay Description: What is already known about this topic: Annotation and response behaviours are two primary actions in social annotation.Understanding how students navigate through annotations and respond to their peers' contributions is essential for optimizing their learning experience.Social annotation outcomes can be assessed in the behavioural, cognitive, emotional, and social dimensions. What this paper adds: This paper revealed students' behavioural patterns in social annotation activities.This study offered a comprehensive understanding of the various dimensions of performance among students with different behavioural tendencies. Implications for practice and/or policy: The two student clusters, initiators and responders, revealed distinct engagement patterns in social annotation and informed the design of targeted scaffoldings.Responders were not passive learners since they demonstrated significantly longer active reading time, greater social annotation effort, and higher level of prosocial behaviours.Educators might not need to place significant emphasis on monitoring participants' emotional expressions in social annotation.Social annotation platforms should incorporate features that encourage and reward both initiation and response behaviours. [ABSTRACT FROM AUTHOR]

With close to 20.4 billion devices connected to the Internet to be deployed by 2020, Internet of things (IoT) is already being leveraged in diverse sectors. Now, because of the ubiquitous nature of IoT devices, schools and academic institutions are looking to incorporate IoT in educational activities. With the increased use of IoT in the education domain, it is of utmost importance to study how this technology with its distinguished system functions such as sensing and decision making can support and challenge the pedagogical processes for all interrelated actors (faculty, students, and staff) as well as all involved assets (e.g., libraries, classrooms, and labs). Although there have been several contributions on the inclusion of IoT into the education domain, there is still a lack of consolidated and coherent views on this subject. Hence, we are motivated to close the gap of knowledge and embarked on mapping out the published studies available. This study presents the results of a systematic literature review focusing on the benefits and the challenges faced in education in integrating IoT into the curriculum and educational environments. Different mapping views of the extracted studies are provided as long as a summary of the already implemented tools and a list of gap research questions yet to be investigated. Lay Description: What is currently known about the subject matter? Despite the several studies available on the inclusion of IoT into the education domain, there is still a lack of consolidated and coherent views on this subject. What this paper adds? In this paper, we provide an overview result on the basis of a systematic literature review conducted to explore and categorize existing scenarios for deploying IoT in the education domain.On the basis of our findings from the systematic literature review, we provide the following: A comprehensive discussion on the benefits of incorporating IoT technologies in education. We structured our discussion around three dimensions related to education perception, learning principle, and learning mode.A comprehensive discussion on three relevant qualities that will challenge the deployment of IoT in education, namely, security/privacy, scalability, and humanization. What is the implication of this work? This work structures the scenarios available on IoT in education and provides a framework that can be used for further analysis/discussions by researchers and practitioners.This work provides necessary statistics on the IoT in education topic that can be used by researchers to construct a pragmatic research direction on this topic. [ABSTRACT FROM AUTHOR]

Background: Virtual reality (VR) offers much potential for learning, but it challenges learners' orientation. Objectives: This paper investigates whether it is possible to use light or movement cues to facilitate orientation in a search task in a desktop‐VR environment so that participants can better attend to the learning content presented simultaneously. Methods: In two pre‐registered online experiments, we investigated the effects of cueing (light and movement) on search time, learning, and several evaluation variables. Participants were asked to find tools in a virtual workshop, while information about the respective tool was narrated. Experiment 1 (N = 60) used a within‐subject design, that is, the objects were alternately highlighted by light, movement or not. For Experiment 2 (N = 159) the narration was substantially shortened, and a between‐subject design was used. Cognitive load and presence were measured additionally. Results and conclusions: In Experiment 1, only the movement cue decreased search time, indicating automatic guidance of learners' attention. There was no effect of cueing on learning, which may be due to the average search time being substantially shorter than the narration, leaving sufficient time to attend to the narration exclusively. In Experiment 2 search times were significantly faster for both cueing methods, but only the light cue resulted in better learning outcomes, which could be explained by the slightly lower presence in the movement cue condition. Implications: Results imply that it is important to develop cues that automatically guide attention without reducing presence. Lay Description: What is already known about this topic: Virtual reality (VR) offers a lot of opportunities for the integration of educational scenarios.VR is challenging for learners with regard to orientation in a 360° environment.Regarding learning outcomes, research on the effects of cues to highlight important content in a 360° environment is still rare.Presence, defined as the feeling of being there in a VR environment, is an important prerequisite for learning in VR. What this paper adds: The influence of light and movement cues on search times and learning outcomes in a desktop‐VR environment was tested.Movement cues can reliably reduce search times (indicating successful orientation), whereas light cues only reduced search times in predictable scenarios.In a predictable scenario, light cues enhanced learning outcomes compared with movement cues.Movement cues reduced presence, which is one potential reason why movement cues did not improve learning. Implications for practice and/or policy: Using light cues might assist orientation and enhance overall performance in predictable scenarios (i.e., when learners know what kind of cue to expect).In an unpredictable setting with variable cues, light cues did not facilitate orientation, whereas movement cues did.However, movement cues reduced presence, which may have negatively affected learning outcomes. It is important to develop cueing methods that also work in more unpredictable settings, but that do not reduce presence. [ABSTRACT FROM AUTHOR]

Background Study: Virtual reality (VR) is becoming a popular technology for safety training in construction. Several VR training prototypes have been designed and tested, which show they can perform better than traditional training tools. However, most of these existing tools are not underpinned by clear pedagogical theory, and studies assessing the impact of pedagogical theories on the effectiveness of VR prototypes are still rare in the literature. Objectives: This study aims to investigate if and how the productive failure theory and the directive instruction theory have an impact on the effectiveness of VR safety training for confined space workers. Methods: The study used a randomized controlled method involving 74 participants. The effectiveness of these two training methods was assessed in terms of knowledge acquisition and retention. Results and Conclusions: The results illustrate that the productive failure training design performed better in terms of knowledge acquisition and retention. This paper introduces the Productive Failure Theory and shows the great potential of this approach for self‐service VR safety training in the field of construction. Lay Description: What is already known about this topic: PF has been proven effective in classroom‐based teaching practice.PF has been proven effective in non‐immersive virtual training.DI is a commonly used pedagogical method for VR training. What this paper adds: The present paper investigates the feasibility of applying PF theory in VR safety training.The present paper examines the pedagogical impacts of the two pedagogical approaches within VR serious games. Implications for practice and/or policy: PF can be applied to self‐help VR safety training, reducing the demand for resources such as teaching staff and venues.PF training design performed better in terms of knowledge acquisition and retention.PF has great potential for self‐help VR safety training in various fields. [ABSTRACT FROM AUTHOR]

Background: Given students' lack of self‐directed learning skills and the growing concern about implementing massive online open courses (MOOCs) in K12 education, learning strategies are needed to facilitate MOOC learning. Many studies have provided different strategies for effective learning in MOOCs. However, there is still limited research to confirm whether these strategies effectively support MOOC learning when deployed by secondary schools, which are not MOOC developers. Objectives: This mixed‐method study examines the provision of different learning strategies, including a learning guide, an academic mentoring programme, a training workshop, and a reimbursement scheme, and investigates the impact of these strategies on student learning in MOOCs. Methods: The study uses two data sources: (1) surveys with 40 participants and (2) semi‐structured interviews with 12 participants. The quantitative data were analysed with descriptive statistics and Fisher's exact test, and the qualitative data were analysed with thematic analysis. Results and Conclusion: The findings indicate that MOOC learners had positive attitudes towards the overall school support, with mentoring enjoying great popularity amongst the students. In terms of the effectiveness of the school support, the mentoring programme and reimbursement scheme were more effective than the university training and learning guide. The paper discusses the implications for researchers and educators. Lay Description: What is already known about this topic: There are a large number of K12 MOOC implementations, which are (i) STEM‐related and computer science courses, and (ii) from Europe and the USA.Limited studies provided different learning strategies for MOOC learning from the perspective of K12 schools, which are not MOOC developers.There is a need to explore MOOC initiatives encompassing a wide variety of subjects, including computer science MOOCs and non‐computer science MOOCs, in regions beyond Europe and the USA.There is also a need for further scrutiny of the effectiveness of learning strategies provided by the K12 school. What this paper adds: Our study launched the first MOOC implementation in K12, encompassing several subject areas beyond computer science in the region of Asia.Our study provided different learning strategies adopted by the K12 school, and the analysis revealed that MOOC learners took positive attitudes towards overall school support with mentoring enjoying great popularity with these students.Our study examined the effectiveness of school support and identified that mentoring and reimbursement are more effective than university training and the learning guide. Implications for practitioners: The insights gained from the study enable other K12 schools and educators to implement MOOC into existing school infrastructures successfully.These strategies provided in the MOOC implementation program can be helpful in many different online learning contexts. [ABSTRACT FROM AUTHOR]

Background: Computer‐based scaffolding has been intensively used to facilitate students' self‐regulated learning (SRL). However, most previous studies investigated how computer‐based scaffoldings affected the cognitive aspect of SRL, such as knowledge gains and understanding levels. In contrast, more evidence is needed to examine the effects of scaffolding on the metacognitive dimension and efficiency outcome of SRL. Objectives: This study aims to examine the role of computer‐based scaffolding in students' metacognitive monitoring and problem‐solving efficiency. Methods: Seventy‐two medical students completed two clinical reasoning tasks in BioWorld, an intelligent tutoring system (ITS) designed for promoting medical students' diagnostic expertise. During solving the tasks, students were asked to report their confidence judgements about proposed diagnoses. Computer trace data were used to identify task completion time (CT) and students' use of three scaffolding types, that is, conceptual, strategic, and metacognitive. Then we calculated students' metacognitive monitoring accuracy (i.e., calibration) and problem‐solving efficiency. Results and Conclusions: One‐sample t‐test demonstrated that students inaccurately monitored their learning processes and were overconfident in both tasks. Linear mixed‐effects models (LMMs) indicated that the intensive use of metacognitive scaffolding positively predicted students' metacognitive monitoring accuracy. Moreover, strategic scaffolding was negatively related to problem‐solving efficiency, whereas metacognitive scaffolding positively influenced problem‐solving efficiency. Takeaways: This study shows the importance of metacognitive scaffolding in improving the accuracy of metacognitive monitoring and problem‐solving efficiency. Findings from this study provide new insights for instructors and ITS developers to optimise the design of scaffoldings. Lay Description: What is already known about this topic?: Computer‐based scaffolding can facilitate students' knowledge gains and academic performance during self‐regulated learning (SRL).The effects of computer‐based scaffolding on the metacognitive dimension and efficiency outcome of SRL are still in a nascent phase. What this paper adds?: This paper explores how different types of computer‐based scaffolding affect students' metacognitive monitoring and problem‐solving efficiency.Metacognitive scaffolding improved the accuracy of medical students' confidence judgements.Metacognitive scaffolding promoted medical students' diagnostic problem‐solving efficiency.Strategic scaffolding had a negative effect on problem‐solving efficiency. Implications for practice: Instructors could provide more metacognitive scaffoldings to facilitate students' metacognitive monitoring accuracy.The designers of intelligent tutoring systems and instructors should consider the costs associated with using scaffoldings. [ABSTRACT FROM AUTHOR]

Background: Many learners struggle to productively self‐regulate their learning. To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL. To measure these processes, contemporary SRL researchers have largely utilized think aloud or trace data, however, not without challenges. Objectives: In this paper, we present the findings of a study that investigated how concurrent analysis and integration of think aloud and trace data could advance the measurement of SRL and assist in better understanding the mechanisms of SRL processes, especially those details that remain obscured by observing each data channel individually. Methods: We concurrently collected think aloud and trace data generated by 44 university students in a laboratory setting and analysed those data relative to the same timeline. Results: We found that the two data channels could be interchangeably used to measure SRL processes for only 17.18% of all the time segments identified in a learning task. Moreover, SRL processes for around 45% of all the time segments could be detected via either trace data or think aloud data. For another 27.17% of all the time segments, different SRL processes were detected in both data channels. Conclusions: Our results largely suggest that the two data collection methods can be used to complement each other in measuring SRL. In particular, we found that think aloud and trace data could provide different perspectives on SRL. The integration of the two methods further allowed us to reveal a more complex and more comprehensive temporal associations among SRL processes compared to using a single data collection method. In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL. Lay Description: What is already known about this topic: To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL.To measure SRL processes, contemporary researchers have largely utilized think aloud or trace data, however, not without challenges.Think aloud and trace data should complement each other and, when analysed concurrently, can provide a more valid and fuller picture of SRL than when analysed separately, which is typically the case in the SRL research to date. What this paper adds: We proposed a novel alignment approach to triangulate the measurement of self‐regulated learning (SRL) based on trace and think aloud data.We defined integration rules to integrate the measurement results from trace data and think aloud, which helped to provide a fuller picture of SRL.The integrated results revealed a more complex, complete and comprehensive SRL process map compared to using a single method. Implications for practice and/or policy: First, our results suggest that using a single measurement method can often reveal SRL processes only partially.Second, our findings indicated that the integration of the two measurement methods could not address all their methodological shortcomings and more research is needed towards new integrative approaches that can further reduce the number of misaligned results.In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL.More specifically, the integrated measurement of SRL can be used in the future to better (1) test the effects of instructional SRL interventions, for example, scaffolding; and (2) evaluate how learners use specific learning tools. [ABSTRACT FROM AUTHOR]

Background: This research is inspired by the challenges encountered in interpreter training, changes in learning needs in the technological era, the educational paradigm shift caused by the COVID‐19 pandemic, the lack of studies on combining virtual reality (VR)_and mobile technologies, and literature gaps in the field of the incorporation of technology in interpreter education. Objectives: This research aims to develop a mobile‐based VR application for bi‐directional English‐Chinese and Chinese‐English interpreting learning named 'Virtual Interpreting Practice' (VIP) based on an interpreting competence model and to investigate its impact on students' self‐rated language and interpreting proficiency levels as well as their declarative knowledge and operative skills as reflected in different interpreting modes (sight and consecutive) and language directions (English‐Chinese and Chinese‐English). The VIP app contains learning resources, including 13 learning modules covering both interpreting modes, practical topics and contexts, video lectures and demonstrations, fully immersive VR and non‐VR practice, glossary lists, source texts, translated texts and an online feedback platform. Methods: Thirty‐one native Chinese‐speaking English as a second/foreign (ESL/EFL) undergraduate students used the app for self‐directed learning. The data were collected by the pre‐study and post‐study questionnaires as well as the pre‐test and post‐test. Results and Conclusions: The results indicate that the use of VIP significantly raised the students' self‐rated language and interpreting proficiency levels as well as their interpreting performance in both modes and language directions. While the students performed better in sight interpreting and Chinese‐English interpreting, they achieved a significantly higher improvement rate in consecutive interpreting and English‐Chinese interpreting. Lay Description: What is already known about this topic: A number of studies have demonstrated the use of virtual reality (VR) provides users with senses of multiple presence, enhances learner engagement and motivation, and facilitates collaborative, situated, immersive and experiential learning that is not often available in traditional learning environments.The increasing availability of VR has created new opportunities in the area of mobile‐assisted language learning (MALL), paving the way for a new research area called VR‐assisted language learning (VRALL).Using VRALL, numerous benefits in various language skills have been identified, such as listening, speaking, writing and vocabulary acquisition. What this paper adds: While blending VR and mobile technologies may play a more significant role in education settings and create more advantages, the impact of this combination for interpreting learning has remained an unexplored area in higher education. This paper has addressed the research gaps in which there is a lack of VR language learning apps that are bilingual, mobile‐based and specifically designed for interpreting practice in highly immersive learning environments.The results indicate that the use of VIP significantly raised the students' self‐rated language and interpreting proficiency levels as well as their interpreting performance in both sight and consecutive interpreting and language directions (English‐Chinese and Chinese‐English).While the students performed better in sight interpreting and Chinese‐English interpreting, they achieved a significantly higher improvement rate in consecutive interpreting and English‐Chinese interpreting. Implications for practice and/or policy: The results have implications for the roles of students and teachers. The app developed in this study shifts the teacher‐led approach to student‐centred learning. While it allows more learning autonomy, its effectiveness may largely depend on students' ability to self‐regulate and engage.It appears that the effectiveness of VRALL depends on a number of individual and contextual factors, e.g. the design and functionality of the apps, availability of the internet connection and smartphones as well as learning needs and motivation. [ABSTRACT FROM AUTHOR]

Background: A strong knowledge of mathematics, beginning at the elementary level, is critical for participation in today's complex world. The home may be one way to facilitate individualized mathematics instruction, given that children spend more time at home than in an academic institution. Therefore, researchers are interested to see whether the home numeracy environment (HNE) can provide a solid foundation for children's mathematics understanding. Further, children's digital mathematics exploration at home is increasingly common (e.g., using math apps). Objectives: The present study evaluates the digital home numeracy practice (DHNP) model and explores its effect on children's mathematics knowledge across five domains (numeration, number operation, pattern recognition, spatial sense, and applied problem‐solving). Methods: To conduct this study, 117 Canadian parents and their children from Grade 1 through 5 completed a DHNP survey and a range of in‐person mathematics measures. Results and Conclusions: The results identified significant relations between parents and children's implicit mathematics factors (e.g., math anxiety, motivation). Children's mathematics anxiety and parents' academic estimations and expectations for their children positively predicted children's mathematics knowledge. In terms of DHNP components, parental involvement in DHNP predicted children's numeration and applied problem‐solving knowledge. Implications: Taken together, the results detail the contribution of parental and child factors to children's mathematics knowledge and suggest that parents adjust their role in DHNP according to their children's mathematics ability. Lay Description: What is (not) known about the subject matter?: Research is less developed on the impact of home technology in the mathematics learning processExisting research did not use a multi‐measure approach to assess the relationships between a variety of home numeracy factors and fundamental mathematics concepts and processes What is the contribution of this paper?: The paper highlights the importance of considering different home related factors to understand the role of home numeracy practices in children's mathematics developmentIt provides a holistic view of digital home numeracy practice (DHNP) by examining several implicit and explicit components of home numeracy environmentChildren's mathematics anxiety predicts their mathematics knowledgeParental estimation and expectation about their children's mathematics performance predicts their mathematics knowledge across several domains whereas parental role on DHNP impacts children's numeration only What are the implications of the findings?: The findings provide an understanding of the significant value of including digital mathematics practices in the study of the home mathematics environmentThe outcome of the study provides guidance for educators and researchers to better understand and leverage DHNP, and its impact on children's mathematics educationFuture research should investigate to what extent digital features should be included in the DHNP model. This will provide insights into the impact of using well‐designed apps on children's mathematics learning [ABSTRACT FROM AUTHOR]

Background Studies: Captioning and repetition are widely used multimedia instructional devices for non‐native students. Generally, studies in this area have tended to focus on second language literacy skills rather than on learning new content knowledge. Additionally, posttests were administered immediately after the treatments, while the delayed influences of captioning and repetition have never been investigated. Objectives: This paper addressed these research gaps in two separate studies. More specifically, this study attempted to examine the influences of captioning and repetition on non‐native students' immediate and relayed retention. Methods: In Study One, three captioning conditions; word‐by‐word captions, closed captions, and no‐captions; were compared to examine their efficacies in immediate and delayed content knowledge retention on 82 Chinese university students. To address the limitations in Study One as the multimedia lesson was short and played only once, Study Two incorporated captioning and two repetition types in its design. One hundred and eleven Chinese university students watch a video lesson in one of four captioning and repetition conditions. Results: The statistical analyses of Study One indicated that there were no significant differences in both immediate and delayed retention test scores across the three captioning condition. Similarly, in Study Two, there were no significant differences in retention tests scores across the four captioning and repetition conditions. Findings: Neither the availability of captions nor the repetition types had any impact on the Chinese students' immediate or delayed content knowledge retention, which lent support to existing studies. Based on the research results, the limitations and future study possibilities are discussed. Lay Description: What Is Already Known About This TopicEmpirical studies on captioning have focused on immediate learning right after the treatment, so have studies on repetition.Empirical studies on multimedia lessons for non‐native students have focused on English language learning. What This Paper AddsThree types of captioning were compared to examine their efficacies in both immediate and delayed content retention of Chinese students.Two types of repetition were compared to examine their efficacies in both immediate and delayed content retention of Chinese students. Implications for Practice and/or Policy:Neither the availability of captions nor the repetition types had any impact on the Chinese students' immediate or delayed content knowledge retention.The availability of textual keywords adjacent to their corresponding graphics might have compromised the efficacy of captioning. [ABSTRACT FROM AUTHOR]

Background: Augmented reality (AR) is receiving increasing interest as a tool to create an interactive and motivating learning environment. Yet, it is unclear how instructional support affects performance in AR. Objectives: This study sought to explore how varying the instructional support in AR can affect performance‐related behaviours of students with low cognitive abilities during assembly work. Methods: A total of 90 Belgian secondary school students repeatedly executed four different realistic assembly tasks. Three levels of instructional support (low, medium, and high) in AR as well as a control condition with paper instructions with a high level of detail were systematically varied across tasks and participants. Results and Conclusions: Multilevel regression analyses showed that AR instructions yielded lower assembly times and a lower perceived physical effort than paper instructions. Additionally, participants perceived tasks as less complex when given AR instructions with a high or a medium level of detail than when given a low level of detail. No effects of instructional support were established for other performance‐related behaviours, namely necessary assistance, error‐making, cognitive load, competence frustration, and stress. Effect sizes were small, at least among the instructional support conditions studied, yielding a limited base for adaptivity. Presumably, tailoring the instructional support in AR is only beneficial for highly complex tasks. The results might be useful for the design and implementation of AR in educational settings. Lay Description: What is currently known about the subject matter: Augmented reality is knowing increased use in education.Little is known about how to design effective instructional support in augmented reality. What this paper adds: This study represents an initial insight into how to personalize instructional support.The impact of instructional support on augmented reality performance of students with low cognitive abilities was investigated.The study suggests that varying instructional support may lead to differences in performance outcomes. Implications for practitioners: How instructional support is constructed may affect augmented reality learning.The results may inform the design of effective augmented reality learning environments for students with special needs.How individual, contextual, and task‐specific characteristics moderate the effectiveness of instructional support should be further investigated. [ABSTRACT FROM AUTHOR]

Background: The potential of learning analytics dashboards in virtual reality simulation‐based training environments to influence occupational self‐efficacy via self‐reflection phase processes in the Chemical industry is still not fully understood. Learning analytics dashboards provide feedback on learner performance and offer points of comparison (i.e., comparison with one's own past performance or comparison with peer performance) to help learners make sense of their feedback. Objectives: We present a theoretical framework for describing learning analytics reference frames and investigate the impact of feedback delivered through dashboards with different reference frames on occupational self‐efficacy, while controlling for workplace self‐reflection. Methods: This experimental study engaged 42 chemical operator employees, aged between 18 and 55 years, each with at least one year of experience. We utilised a two‐group design to ask two research question each with three competing hypotheses related to changes in occupational self‐efficacy, employing Bayesian informative hypothesis evaluation. Results and Conclusions: Results for the primary research question suggest that dashboards with progress reference frames do not elicit greater change to self‐efficacy than those with social reference frames, however, they may elicit equal change. Furthermore, dashboards with social reference frames may elicit greater change to self‐efficacy than those with progress reference frames. Exploratory results found that dashboards with progress reference frames may elicit greater positive directional change than those with social reference frames and that they may elicit equal directional change. These findings contribute to the understanding of self‐efficacy beliefs within the Chemical industry, with potential impacts on skill development. The research may inform the design of targeted interventions and training programs to influence self‐efficacy. From a practical perspective, this research suggests that careful consideration is needed when choosing reference frames in learning analytics dashboards due to their potential consequences on the formation of learner self‐efficacy. Lay Description: What is already known about this topic?: Learning analytics dashboards often aim to stimulate self‐regulated learning by providing feedback.Feedback plays a crucial role in simulation‐based learning and learning analytics dashboards can be a valuable tool to deliver feedback and facilitate the learning process by providing learners with insights into their performance and progress.Previous research has highlighted the importance of reference frames as critical design features of learning analytics dashboards, as they assist learners in making sense of learning analytics feedback.Self‐efficacy is a powerful determine factor of workplace performance and is influenced by mastery experiences and social modelling information. What the paper adds?: A theoretical framework describes the mediating role self‐reflection phase processes of the self‐regulated learning cycle plays in the formation of occupational self‐efficacy.This paper introduces the concept of three learning analytics reference frame components which include the performance outcome component, point of comparison component and score delta component.The paper indicates that learning analytics dashboards designed with a progress reference frame does not elicit greater change to occupational self‐efficacy than the social reference frame.Exploratory results suggest dashboards with progress reference frames might produce greater positive directional change compared to social reference frames or elicit equal change. Implications for practice?: Learning analytics system designers who use reference frames to help learners make sense of their feedback should carefully consider which reference frames they use as these decisions likely have consequences on the formation of learner self‐efficacy beliefs.For LAD designers and stakeholders, recognising the absolute change and directional shift in self‐efficacy is crucial, as LAD designs significantly influence these dynamics and guide the tailoring of effective tools.In industries like the chemical sector, where overconfidence can result in severe consequences, understanding the nuance of self‐efficacy changes is especially pertinent. [ABSTRACT FROM AUTHOR]

Background: Driven by the ongoing need to provide high‐quality learning and teaching, universities recently have shown an increased interest in using learning analytics (LA) for improving learning design (LD). However, the evidence of such improvements is scarce, and the maturity of such research is unclear. Objectives: This study is aimed to evaluate the maturity of research discussing LA‐driven LD improvements in higher education. Methods: The systematic review analyses 49 empirical papers, assesses their quality and suggests further research directions. The review elaborates on methodological (research questions, strategy and methods, LA‐LD integration theoretical backgrounds) and substantial (LA‐driven LD improvements, types of data used, LA software development) features of the papers. Results and Conclusions: The findings demonstrated the lack of theoretical alignment between LA and LD, with research tending towards user experience studies. The most frequently used research strategy was a case study; experiments were very rare. Researchers predominantly used parsing for collecting data and AI methods for analysing it; mostly used data types related to registering learners' engagement with learning activities as well as resources and tools provided in digital learning environments. Takeaways: The research area discussing LA‐driven LD improvements still has a way to go before attaining the level of full maturity. Only a third of the papers reported actual LA‐driven LD improvements; moreover, only three papers measured their effectiveness. The presented LA software was mostly at the beta or implementation stages and did not assess the impact of using this software. Lay Description: What is already known about this topic: Universities show an increased interest in using LA for improving LD.The evidence of such improvements being efficient is scarce.Learning analytics is weakly grounded in learning and teaching. What this paper adds: LA‐LD research presented in the reviewed papers cannot yet be considered fully mature.Almost half of the research was carried out using a case study approach, intrinsically challenging in terms of replication and validity. As few as three out of the reviewed studies applied an experimental approach, capable of stating the cause–effect relationship between LA and LD.All the studied papers mentioned improvements in LD, but only around a third of them reported actual improvements, another one‐third suggested potential improvements, and the rest did not come down to describing any.The LA software presented in the papers was mostly at the testing or implementation stages, and the impact of implemented software on LD has yet to be evaluated. Implications for practice and/or policy: Future LA‐LD research to become more mature may well elaborate on theoretical footing, contribute to the cause–effect relationship between LA and LD utilising experimental research design, ensure sufficient sample size.Practitioners' efforts should be directed to operationalising LD for efficient measurements, addressing pedagogical challenges when applying LA, and assessing LA‐driven improvements introduced into LD. [ABSTRACT FROM AUTHOR]

Background: Previous studies have shown that dynamic illustrations, as compared to their static counterparts, lead to higher achievement levels, especially for hand‐based procedures. Other researchers have investigated how the presence of seductive details (i.e., appealing but irrelevant adjunct displays) influences students' interest positively but their learning negatively. Objectives: The purpose of the two present studies was to investigate the effects of animated versus static presentations, combined with the presence of seductive details, on student performance on a paper‐folding task (i.e., origami) in a naturalistic school environment. Methods: Fifty‐five children (5–6 years old) participated in the first study and were randomly assigned to one of four groups. The second study was conducted with older children (72 s or third graders) and a more complex origami task. Results and Conclusions: In the first study, results demonstrated negative effects of seductive details on children's performance and time on task, but no effects of presentation format. In the second study, no negative effects of seductive details on student achievement were found, but animated illustrations significantly improved children's performance and reduced time on task. However, seductive details tended to impair learning more greatly given the presence of static, as compared to animated, presentations. Task difficulties and pupils' ability to inhibit irrelevant information may explain these results. Lay Description: What is already known about this topic: Seductive details negatively influence young children's performance.Animated illustrations have been shown to improve students' learning for dynamic procedure. What this paper adds: This is the first study investigating the influence of animated vs. static illustrations combined with seductive details on children's learning performance.Animated illustrations improve children's performance for a challenging dynamic procedure.Seductive details tended to impair more learning from static than from animated presentations.Results are discussed in relation to the task's difficulty as well as students' ability to inhibit irrelevant information. Implications for practitioners: Animated illustrations should be used when presenting dynamic procedures.Instructors should use seductive details cautiously in pedagogical documents particularly when the task is difficult. [ABSTRACT FROM AUTHOR]

Background Study: The research discusses the need for a paradigm shift in engineering education current practices to accommodate the digital native students. The paper emphasizes the importance of integrating disruptive technologies, namely Virtual Reality (VR) through Head Mounted Displays VR (HMD VR) and Desktop Based VR (DB VR) and comparing it with the traditional teaching methods. The research focuses on second‐year undergraduate students enrolled in a concrete structures course. Objectives: The objective of the study is to analyse the impact of DB VR and HMD VR on students' motivation, performance and workload in comparison with traditional 2D drawings. The study also aims to investigate how simulation sickness and system usability could impact students' motivation and performance when interpreting concrete structures. Methods: The study divided second‐year civil engineering students into three groups, 2D, DB VR and HMD VR. The performance and motivation levels of students were assessed based on the number of mistakes identified and an intrinsic motivation survey. Furthermore, data on system usability and simulation sickness were collected. Spearman rank correlation was conducted to analyse the relationships between the variables tested. Results: The results have shown that students' motivation and performance were much higher when using VR in general and HMD VR specifically, students' efficiency and accuracy were also observed. On the other hand, usability was found to be moderately correlated with motivation, with students rating HMD VR as the most usable approach. A moderate inverse correlation was observed between simulation sickness and motivation, indicating that higher simulation sickness led to lower motivation levels. Conclusion: The study concludes that integrating VR in general, DB VR, or HMD VR into a concrete structures course for undergraduate students can significantly improve students' performance and motivation. Furthermore, enhancing usability of any of the methods used can also improve the performance and motivation. On the other hand, simulation sickness inversely affects motivation and performance, therefore, VR developers and educators should not neglect it. Lay Description: What is already known about the topic: Traditional teaching methods in engineering education require improvement.Integrating digital technologies into engineering education enhances performance.Digital technologies can potentially enhance motivation. What this paper adds: Compares traditional teaching methods for concrete structures interpretation with virtual reality.Establishes correlations between motivation, performance and usabilityIntroduces how desktop‐based VR and head‐mounted display VR can produce varying results. Implications for practice and/or policy: Decision‐makers can use the information to integrate updated pedagogy into engineering curricula.Allows for further exploration of different digital technologies that can be used for concrete structure interpretation.Allows instructors to introduce virtual reality in their courses. [ABSTRACT FROM AUTHOR]

Background: Teachers often rely on the use of open‐ended questions to assess students' conceptual understanding of assigned content. Particularly in the context of mathematics; teachers use these types of questions to gain insight into the processes and strategies adopted by students in solving mathematical problems beyond what is possible through more close‐ended problem types. While these types of problems are valuable to teachers, the variation in student responses to these questions makes it difficult, and time‐consuming, to evaluate and provide directed feedback. It is a well‐studied concept that feedback, both in terms of a numeric score but more importantly in the form of teacher‐authored comments, can help guide students as to how to improve, leading to increased learning. It is for this reason that teachers need better support not only for assessing students' work but also in providing meaningful and directed feedback to students. Objectives: In this paper, we seek to develop, evaluate, and examine machine learning models that support automated open response assessment and feedback. Methods: We build upon the prior research in the automatic assessment of student responses to open‐ended problems and introduce a novel approach that leverages student log data combined with machine learning and natural language processing methods. Utilizing sentence‐level semantic representations of student responses to open‐ended questions, we propose a collaborative filtering‐based approach to both predict student scores as well as recommend appropriate feedback messages for teachers to send to their students. Results and Conclusion: We find that our method outperforms previously published benchmarks across three different metrics for the task of predicting student performance. Through an error analysis, we identify several areas where future works may be able to improve upon our approach. Lay Description: What is already known about this topic: Open‐ended questions are used by teachers in the domain of mathematics to assess their students understanding but automated support for these types of questions are limited in online learning platforms. Recent advancements in areas of machine learning and natural language processing have led to promising results in a range of domains and applications. What this paper adds: Emulating how teachers identify similar student answers can be used to build tools that support teachers in assessing and providing feedback to student open‐ended work. Implications for practice: Developing better automated supports can increase the amount of direct feedback students receive to guide their learning. [ABSTRACT FROM AUTHOR]

Background: In 2018, it was found that only a quarter of Grade 3 children in India were reading at grade level. A growing demand for English education has further limited children's literacy achievement. Despite a strong evidence base in favour of using systematic phonics for building English literacy skills, many teachers in India continue to use rote‐methods of literacy instruction. Objectives: We aimed to examine the efficacy of GraphoLearn (GL) English Rime, a computer‐assisted reading intervention, in improving the foundational literacy skills of 1st and 2nd grade students who were attending an English medium school in India. Methods: A total of 136 students across 6 classrooms were randomly allocated to play either GL or a control math game over a 5‐week intervention period. Students were pre‐ and post‐tested on various English literacy skills using tasks built into the GL software as well as through oral and paper‐based tasks. Results and Conclusions: Students who played GL showed significantly greater and faster development on in‐game measures of letter‐sound knowledge, rime unit recognition, and word recognition as compared to students who did not play GL. In addition, GL resulted in greater effects on these measures for students with stronger English literacy skills prior to the start of the intervention. No differences were found between groups on the oral and paper‐based tasks. Implications: GL was able to quickly and effectively teach critical sub‐skills for reading. However, a lack of effects on the out‐of‐game measures opens the door for further discussion on the successful implementation of such interventions. Lay Description: What is already known about this topic:India has an ongoing literacy crisis with many children failing to acquire functional literacy skills.Under‐resourced schools,outdated pedagogical methods, and a demand for English‐medium education are partially to blame.Globally, technology is being increasingly looked at to help improve student learning levels across all subject areas.There are a lack of studies examining the efficacy of various ed‐tech tools to improve literacy in the context of India.What this paper adds:The study aimed to test GraphoLearn English (GL), a mobile game designed to teach and practice early reading skills through phonics with first and second graders.Results showed that children who played GL outperformed those who did not play on critical literacy skills such as letter‐sound knowledge and word recognition.In addition, GL was more effective for those who had higher pre‐existing English literacy skills.However, improvements were only seen on measures assessed in the game and not on measures assessed orally or on paper.Implications for practice and/or policy:GL and other educational technologies can be extremely effective tools which allow for an individualized learning experience.However, it is important that for any educational game, learning moves beyond the game itself.Teachers are critical players in this process and must ensure that tech‐based instruction is integrated with teacher‐led instruction.Policy makers and school administration must ensure that teachers are adequately trained on when, with whom, and how to use such technologies before they are introduced. [ABSTRACT FROM AUTHOR]

Background: The existing literature has predominantly focused on instructor social presence in videos in an asynchronous learning environment and little is known about student social presence on webcam in online learning in the context of COVID‐19. Objectives: This paper therefore contrasts students' and teachers' perspectives on student social presence on webcam in synchronous online teaching through co‐orientation analysis. Methods: Data were collected through an online questionnaire with 14 statements that measured participants' perceptions of webcam use in three constructs in social presence (i.e., emotional expression, open communication, and cohesion). 154 students and 36 teachers from two higher education institutions in Hong Kong responded to the questionnaire, and their responses were analysed using the co‐orientation model. Results and conclusion: Results reveal the perceptual gaps between teachers and students on the use of webcam to promote student social presence by showing how teachers were comparatively more positive about its impacts for learning and consistently overestimated students' preference for it. Through analysing individual constructs/items, this paper argues that using webcams in synchronous online learning could enhance student social presence only to a limited extent in that it may help improve emotional expression and open communication but not cohesion. Implications: The paper advises against the adoption of a clear‐cut policy that webcams should be either recommended or not recommended for online learning. Instead, teachers should take into account students' perspective to find out the types of activities that are apt for using webcams in online learning, and reflective tasks and oral assessments were amongst the ones considered appropriate by students in the study. Lay Description: What is currently known about the subject matter: Teacher presence through videoconferencing is important to the construction of social presence.Student presence on webcam is relatively understudied in online learning during COVID‐19.Teachers struggled to use webcams for online learning during the pandemic.Teachers and students have different concerns about using webcams for online learning that either party may not be aware of. What this paper adds: The current study contrasted teachers' and students' perceptions of student presence on webcam in online learning under COVID‐19.This is the first study using co‐orientation model as the analytical method for this area.There were perceptual differences between students and teachers on the use of webcams in which teachers were comparatively more positive about its impacts for learning and consistently overestimated students' preference for it.Using webcams in synchronous online learning could enhance social presence only to a limited extent in that it may help improve emotional expression and open communication but not cohesion. Implications of study findings for practitioners: The paper advises against the adoption of a clear‐cut policy that webcams should be either recommended or not recommended for online learning.Teachers should take into account students' perspective to find out the types of activities that are apt for using webcams in online learning, and reflective tasks and oral assessments were amongst the ones considered appropriate by students in the study.It reveals how co‐orientation model can be a useful tool for perception studies in higher education. [ABSTRACT FROM AUTHOR]

Background: While the use of digital technologies in collaborative design tasks have gained acceptance amongst educational researchers and instructors, few studies have analysed the application of video‐supported collaborative learning‐by‐design (VSC‐LBD) in the authentic setting of professional education and training. Objectives: This study on VSC‐LBD investigated the learning processes and outcomes of nursing students who collaboratively used a hypervideo authoring tool to learn the procedure about urinary catheter insertion. We hypothesized that the students who collaboratively used a hypervideo authoring tool to learn about a professional procedure would outperform those exposed to a traditional lesson on the same procedure. Further, we assumed that the students who created an instructional video from scratch would obtain higher learning scores than those who worked on existing footage. Methods: Participants (N = 60) worked in groups and were assigned to three conditions: in the first each group recorded a video while simulating the procedure and then turned the footage into a hypervideo (VSC‐LBD1); in the second condition each group already received the raw video to turn it into a hypervideo (VSC‐LBD1); in the third participants attended a traditional lesson (control). Pre‐ and post‐tests measured procedural knowledge acquisition. The co‐regulation episodes within the groups that produced the best and worst videos were assessed and measured. Results and Conclusions: The students in the two VSC‐LBD conditions significantly outperformed those in the control condition. No differences were found between making an original video and using existing footage. More co‐regulatory processing episodes were found in the best video group compared to the other groups. Takeaways: This study supports theoretical assumptions on the value of VSC‐LBD in authentic learning environments and provide useful information to instructors willing to adopt collaborative use of interactive video tools. Lay Description: What is already known about this topic: Video‐based technologies, and more in particular hypervideo with its additional affordances, results an effective tool to support procedural learning.Hypervideo designing is a fruitful Learning‐By‐Design (LBD) activity that allows learners to transform and restructure knowledge.From a pedagogical point of view, giving students collaborative design tasks on video materials showed to be quite effective. What this paper adds: Few studies have investigated the application of video‐supported collaborative learning‐by‐design (VSC‐LBD) in the authentic setting of professional education and training. The same is true when it comes to procedural knowledge acquisition applied to clinical procedures, with most studies focussing on conceptual knowledge acquisition.When working with a learning‐by‐design approach, a clear distinction between the benefit of designing a video from scratch and of designing the hyper‐ components was lacking.Adopting a VSC‐LBD pedagogical approach to support learning of professional procedures in the nursing sector showed to be very effective both looking at the learning processes and the learning outcomes. Implications for practice and/or policy: This study proposes a collaborative design activity to learn professional procedures and demonstrates its affordances in terms of learning gains compared to a traditional lesson.Giving students a collaborative design task to build a hypervideo seems more important than just giving them a design task on the starting video depicting the procedureThe paper provides instructors with the necessary information to develop pedagogically sound design VSC‐LBD activities in time‐sensitive yet effective ways. [ABSTRACT FROM AUTHOR]

Background: As one of the mainstream forms of programming education, educational robotics (ER) have been a crucial way to develop K‐12 students' programming ability. Objectives: The purpose of this study is to clarify the content of programming ability, to verify the effectiveness of ER as a teaching method to improve students' programming abilities and the conditions for more effective instructional design. Methods: The method of meta‐analysis was adopted to conduct this study. 4180 K‐12 students from 36 studies with a total of 85 effect sizes were captured. Based on the contents of included literature, an ER programming ability model was put forward, which was composed of essential ability and generative ability. The meta‐analysis of essential ability (N = 22) and generative ability (N = 64) was carried out respectively. Results and conclusion: The results showed that ER activity has a positive effect on the essential ability (Hedges' g = 0.539 CI [0.327, 0.752], p < 0.001) and generative ability (Hedges' g = 0.535 CI [0.426, 0.643], p < 0.001). Additionally, the results of moderator analysis showed that utilizing ER to solve mathematics problems is able to more effectively develop students' essential ability, while the STEM interdisciplinary ER instruction had the largest effect on generative ability. Simultaneously, the individual programming form is conducive to students' essential ability, while the generative ability is significantly affected by the cooperative programming form. No matter for the evaluation of essential ability or generative ability, ER had the greatest effect on kindergarten children' programming ability. Moreover, the intervention duration ranging from 1 to 5 weeks, the samples size less than 50 and the choice of measurement scale can effectively improve students' programming ability. Implications: This research enriched the theoretical basis of programming ability, and provided reference and guidance for K‐12 programming teaching practitioners and researchers in ER teaching design and practise. Lay Description: What is (not) known about the subject matter?: Educational robotics (ER) is one of the mainstream form of K‐12 programming education.K‐12 students develop various abilities by coding ER.Different instruction conditions in ER education may affect the teaching effect. What is the contribution of this paper?: This study sorted out the specific content of programming ability in ER activities, and classified programming ability into essential ability and generative ability.This study respectively validated the effectiveness of ER activity on improving essential ability and generative ability of K‐12 students.This study considered discipline integration, cooperation degree, grade level, intervention duration, sample size and assessment tools as moderator variables, and analyzed their effects sizes on ER developing programming ability. What are the implications for practitioners?: This paper clarified the specific content of programming ability in K‐12 ER education, and enriched the theoretical basis of programming ability.It provided evidence for the effectiveness of K‐12 ER education.This study provided an reference and guidance for ER instructional design for K‐12 programming teachers and researchers. [ABSTRACT FROM AUTHOR]

Background: Massive Open Online Courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business models. In addition, the promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful. And finally, studies demonstrated that many learners exploit the anonymity and feedback to earn certificates unethically. Thus, establishing MOOC pedagogical models that balance open access, meaningful learning, and trustworthy assessment remains a challenge that is crucial for the field to achieve its goals. Objectives: This study analysed the influence of an MOOC assessment model, denoted the Competency Exam (CE), on learner engagement, the level of cheating, and certification rates. At its core, this model separates learning from for‐credit assessment, and it was introduced by the MITx Biology course team in 2016. Methods: We applied a learning analytics methodology to the clickstream data of the verified learners (N = 559) from four consecutive runs of an Introductory Biology MOOC offered through edX. The analysis used novel algorithms for measuring the level of cheating and learner engagement, which were developed in the previous studies. Results and Conclusions: On the positive side, the CE model reduced cheating and did not reduce learner engagement with the main learning materials – videos and formative assessment items. On the negative side, it led to procrastination, and certification rates were lower. Implications: First, the results shed light on the fundamental connection between incentive design and learner behaviour. Second, the CE provides MOOC designers with an 'analytically verified' model to reduce cheating without compromising on open access. Third, our methodology provides a novel means for measuring cheating and learner engagement in MOOCs. Lay Description: What is already known about this topic?: Massive open online courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business modelsThe promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful.Studies demonstrated that many learners exploit the anonymity and feedback to earn certificates unethically.Thus, establishing MOOC pedagogical models that balance open access, meaningful learning, and trustworthy assessment remains a challenge that is crucial for the field to achieve its goals. What this paper adds?: Underlines ways in which incentive‐based design shapes learners' behavior in MOOCs.Presents an 'analytically‐verified' assessment model that is resistant to cheating while still preserving open access and design for learning.Provides a robust learning analytics methodology to evaluate the effect of assessment models on cheating and learning, which can be generalized to evaluate the effect of such interventions. The implications of study findings for practitioners: The results shed light on the fundamental connection between assessment design and learner behavior.The competency exam model provides MOOC designers with an 'analytically‐verified' model to reduce cheating without compromising on open access.The paper provides a novel methodology for measuring cheating and learner engagement in MOOCs. [ABSTRACT FROM AUTHOR]

Background: During the COVID‐19 period, academics and higher education institutions have shown deep concern about academic integrity related to measurement and evaluation issues that have arisen in online education. Objectives: To address this concern, this paper examined the prevalence of cheating behaviour among university students before and during the pandemic by comparing self‐reported cheating behaviours of students and academics' perceived levels of cheating behaviours of their students. Methods: A correlational design was employed aligned with study objectives. Results and Conclusions: The results indicate that although both groups reported a significant increase in cheating incidents in online education, instructors' perceived frequency of student cheating is remarkably greater than students' self‐report cheating incidents. Contrary to the perceptions of instructors and stakeholders in education, students did not report a very drastic cheating increase in online education during the pandemic. The strongest predictive power for online cheating behaviours was the cheating behaviours in face‐to‐face education. Whereas the sensitivity of institutions and course instructors toward cheating behaviour was negatively associated with cheating behaviours in face‐to‐face education, this situational factor did not show a significant effect in distance education. Regarding individual factors, we found a significant relationship between cheating behaviours and gender, discipline, whereas no significant relationship was found in terms of student GPA. Consequently, in order to minimize the threats to the validity of scores associated with cheating, faculty should be supported through faculty development programs and resources so that they can develop authentic assessment strategies for measuring higher‐order thinking skills. Lay Description: What is already known about this topic: The COVID‐19 period created an abrupt shift in learning conditions and measurement processes.Educational administrators and teachers have also shown deep concern about academic integrity related to measurement and evaluation issues that have arisen in distance education during the pandemic period.Previous studies investigating the factors affecting students' academic dishonesty in traditional cheating behaviours have primarily focused on individual and situational factors. What this paper adds: The online education process caused an increase in cheating behaviour scores.There is a substantial range between students and instructors' responses about online cheating during the pandemic.Cheating behaviour in face‐to‐face education significantly explains cheating behaviour in online education. Cheaters in face‐to‐face education are also cheaters in online education.The sensitivity shown by university and course instructors toward cheating yielded a mixed result in online and face‐to‐face education.In online and face‐to‐face education settings, cheating behaviour scores of female students are lower than male students.Students with lower GPA scores generally have higher cheating behaviours. Implications for practice and/or policy: Individual and contextual factors are major determinants of cheating behaviours.In order to minimize the threats on validity of scores associated with cheating, faculty should be supported through faculty development programs and resources so that they can develop authentic assessment strategies for measuring higher‐order thinking skills.This study fills an important gap in the available literature on cheating before and during COVID‐19.The study has a potential to guide higher education institutions for planning and initiating strategies to address cheating in short and long term. [ABSTRACT FROM AUTHOR]

Background: Inquiry‐based learning is a salient instructional approach to cultivate students' higher order thinking skills (HOTS). With the presence and advancement of new technologies, their usage for inquiry learning in university context is increasingly ubiquitous. However, in most circumstances, college students cannot integrate technologies to their inquiry learning in efficient ways or their abilities to use technologies are not good enough. Previous studies found that intrinsic motivation (IM), peer interaction (PI) and classroom connectedness (CC) were key factors to influence students' approaches to using technologies from the personal, behavioural and environmental perspectives. Objectives: This study investigated the influence of these three essential learning factors (IM, PI and CC) on students' HOTS and the mediate influence of deep approach to using technologies (DAUT) between these learning factors and HOTS in the technology‐enhanced open inquiry‐based learning context. Methods: A questionnaire was administered to 80 university students who had studied with the technology‐enhanced open inquiry‐based learning approach. The partial least squares method was employed to investigate the relationships among learning factors, DAUT and HOTS. Results and Conclusions: Results showed that CC and PI were positively directly related to HOTS. DAUT was a significant mediator between two (i.e., IM and PI) of the three learning factors and HOTS. The findings of the study have practical implications for instructors, indicating that they should pay attention to students' IM and PI in deepening their approach to using technologies as well as to improve students' HOTS in technology‐enhanced open inquiry‐based learning. Lay Description: What Is Already Known About This Topic: Inquiry‐based learning is considered to be a salient instructional approach to cultivate students' higher order thinking skills (HOTS).Technologies usage in inquiry learning is ubiquitous in university context.In most cases, college students are not able to integrate technologies in their inquiry learning in effective ways. What This Paper Adds: This paper proposed a research model that explains and predicts the mediating influence of deep approach to using technologies on the association between learning factors and HOTS in the technology‐enhanced open inquiry‐based learning context.The mediating effect of approaches to using technologies between learning factors and HOTS was identified.Two of the three learning factors (peer interaction and classroom connectedness) had direct effect on HOTS.Deep approaches to using technologies variable significantly mediates two of the three learning factors (peer interaction and intrinsic motivation) and HOTS. Implications for Practice or Policy: Instructors should pay attention to students' intrinsic motivation (IM) and peer interaction in order to deepen their approach to using technologies.Instructors should pay particular attention to peer interaction and classroom connectedness when conducting technology‐enhanced open inquiry‐based learning activities to improve college students' HOTS.Students' interest improvement and IM in using technologies, the integration of technologies and open inquiry‐based learning activities could be discussed and decided by both the instructor and students. [ABSTRACT FROM AUTHOR]

Background: Digital game‐based learning is gaining increased attention from both researchers and educators for improving mathematics instruction. However, the evidence for game‐based learning is mixed and research with rigorous research design and analyses are limited. Objective: Here, in a pre‐registered randomized controlled study, we investigated whether a fraction game designed collaboratively by educational experts and professional game developers may serve as a useful tool to enhance students' fraction knowledge. Methods: We assigned French fifth graders to either an experimental group who used the game (n = 110) or a control group (n = 78) who received traditional instruction on fractions. Fraction knowledge was assessed pre‐ and post‐intervention. Results: Results show that students in the active control group had superior overall fraction performance than students in the experimental group at the end of intervention. However, the game had a positive effect on decimal learning. We also found a positive relation between game performance and overall fraction knowledge scores at post‐test. Contribution: The study highlights the importance of game metrics as indicators of personalized assessment tools. Given the increased usage of games in learning mathematics and the equivocal results on the effectiveness of these games, our study also highlights the importance of pre‐registration and randomized controlled studies. Lay Description: What is already known about this topic: Digital game‐based learning (DGBL) is gaining popularity in mathematics teaching.DGBL shows potential for teaching difficult abstract concepts such as fractions.However, research evaluating DGBL for fractions is limited. What this paper adds: The study examines a fraction game designed by education experts and game designers.Students fraction knowledge is assessed using paper‐based test.Challenges associated with DGBL in the classroom are discussed in the paper. Implications for practice: The results will guide educators in designing effective fraction instruction in classroom.The study highlights the critical role of instructional support in DGBL for fractions.Game based metrics can be used to individualize instruction in the classroom. [ABSTRACT FROM AUTHOR]

Background: Maintaining cohesion is critical for teams to achieve shared goals and performance outcomes within a work‐integrated learning (WIL) environment. Cohesion is an emergent state that develops over time, representing the synchrony of different behavioural interactions. Cohesive teams will exhibit such phenomena by their temporal coordination of micro‐level relations. Objectives: The primary aim of this study is to examine the cohesion of teams in learning environments using a learning analytics approach. Method: This study examines teams from higher education who participate in a WIL environment platform working in teams to develop their collaborative problem‐solving skills. Here we show that temporal network motifs can be used as a proxy to measure cohesion. Results and Conclusions: We illustrate three clusters represented by team learning behaviours and found that each cluster has distinctive interactions with learning resources, performance outcomes, temporal network motif group characteristics and emergence over time using learning analytics. Implications: Applying temporal motifs as an analytics‐based measure of cohesion is a starting point for understanding how cohesion develops over time without relying on surveys. We anticipate that the same approaches can be applied in most learning management systems containing trace data of teams and their interactions with learning resources to understand cohesion. Lay Description: What is already known about this topic?: The development of team cohesion has been widely studied for decades in face‐to‐face educational contexts but remains underexplored in online environmentsObtrusive tools, such as questionnaire instruments are still the primary method used to examine team cohesionTeam cohesion is an emergent state that changes over time, representing the synchrony of different behavioural interactionsResearch that explores and examines the temporality of cohesion as it unfolds in team learning is limited What this paper adds?: Underlines how emerging team behaviours are characterised by their engagement, performance and cohesion development using temporal network motifsPresents an analytics‐based measure to examine cohesion using temporal network motifs as a proxyProvides a learning analytics approach for researchers and instructors to evaluate cohesion in online learning environments through online learner trace data The implications of study findings for practitioners: The paper provides insights into distinct teams with emerging learning behaviours, performance associations and cohesion in an online learning platform.The paper provides instructors with a way to monitor and support a team's cohesion over time by examining the way temporal motifs occur.The paper offers a new avenue to understanding learner engagement beyond summarisations [ABSTRACT FROM AUTHOR]

Background: As the concept of flipped classrooms continues to gain interest across disciplines, more research is needed to strengthen the instructional design by integrating active learning strategies and emerging technologies. Among various possibilities, little is known about how game‐based learning combined with Augmented Reality (AR) can be effectively infused into language education to establish supportive flipped learning contexts. Objectives: This study thus proposed an AR‐enhanced game‐based learning (ARGBL) approach, featuring the use of an augmented board game to engage students actively in classroom activities. It further compared the effects of the proposed approach with traditional game‐based learning on the students' vocabulary acquisition and creative thinking as they were instructed to learn English as a foreign language (EFL) in flipped classrooms. Methods: A quasi‐experimental design was adopted to examine the effectiveness of the proposed approach to promote the students' participation in flipped in‐class activities, thereby improving their learning outcomes. Participants were recruited from two classes of the same undergraduate course, one of which was designated as the experimental group to take part in game‐based learning activities in class by playing an AR‐enhanced board game, and the other as the comparison group to learn by playing a paper‐and‐pencil game with identical puzzle content. The desired student learning outcomes were measured by pre‐ and post‐intervention vocabulary tests and creative thinking tests, supplemented by individual interviews. Results: Results indicated that the students in the experimental group significantly outperformed their counterparts in vocabulary acquisition and creative thinking. They also expressed positive perceptions of the augmented game‐based learning experience in the flipped EFL classroom. Take Away: ARGBL can be a promising approach to improving student learning, and it is particularly beneficial to the design of classroom activities in flipped learning contexts due to its affordances for enriched content visualization and active learner engagement through gameplay. Lay Description: What is already known about this topic: Flipping the classroom is becoming prevalent in education, and researchers have stressed the need to move beyond comparing the outcomes of flipped and non‐flipped settings in order to advance innovation and examine the effectiveness of instructional design.Recent research has shown positive effects of using AR technology for content delivery, with location‐based context‐aware applications being more commonly applied in language education, while the potential of image‐based AR also warrants research attention.Learning by playing games has been considered an engaging strategy that provides benefits for learner engagement, but not all game genres have been fully studied. What this paper adds: This study proposed an ARGBL approach, applying image‐based AR to augment board gaming activities in class when the classroom was flipped.The ARGBL approach was found to significantly improve the students' English vocabulary acquisition.The ARGBL approach was found to significantly enhance the students' creative thinking development. Implications for practice: The innovative merger of image‐based AR and physical board gaming pieces into a hybrid form of mediation, namely the AR‐enhanced board game, likely encouraged face‐to‐face interaction of meaningful language use in flipped in‐class activities, thereby leading to the vocabulary growth and creative thinking development of EFL learners.The effectiveness of the ARGBL approach should be considered as an integrated whole with a holistic understanding of the interplay between the AR technology and the active learning strategy through gameplay in the broader pedagogical context of flipped classrooms. [ABSTRACT FROM AUTHOR]

Background: Academic dishonesty (AD) and trustworthy assessment (TA) are fundamental issues in the context of an online assessment. However, little systematic work currently exists on how researchers have explored AD and TA issues in online assessment practice. Objectives: Hence, this research aimed at investigating the latest findings regarding AD forms, factors affecting AD and TA, and solutions to reduce AD and increase TA to maintain the quality of online assessment. Methods: We reviewed 52 articles in Scopus and Web of Science databases from January 2017 to April 2021 using the Preferred Reporting Items for Systematic Reviews and Meta‐Analyses model as a guideline to perform a systematic literature review that included three stages, namely planning, conducting, and reporting. Results and conclusions: Our review found that there were different forms of AD among students in online learning namely plagiarism, cheating, collusion, and using jockeys. Individual factors such as being lazy to learn, lack of ability, and poor awareness as well as situational factors including the influence of friends, the pressure of the courses, and ease of access to information were strongly associated with AD. A technology‐based approach such as using plagiarism‐checking software, multi‐artificial intelligence (AI) in a learning management system, computer adaptive tests, and online proctoring as well as pedagogical‐based approaches, such as implementing a research ethics course programme, and a re‐design assessment form such as oral‐based and dynamic assessment to reduce cheating behaviour and also sociocultural and sociotechnical adjustment related to the online assessment are reported to reduce AD and increase TA. Implications: Educators should adjust the design of online learning and assessment methods as soon as possible. The identified gaps point towards unexplored study on AI, machine learning, learning analytics tools, and related issues of AD and TA in K12 education could motivated future work in the field. Lay Description: What is already known about this topic: Online assessment has become a global trend in the last 10 years, especially since PISA (2015) and TIMSS (2019) were adopted, then, the increasing adoption of MOOCs and online learning due to the COVID‐19 pandemic.Academic dishonesty (AD) and trustworthy assessment (TA) are hot issues in online assessment practices that are interesting to study.Research findings on the associated factors of AD and efforts to increase TA in online assessments are still inconclusive.Contemporary research on AD and TA in online assessment lacks of comprehensive systematic review. What this paper adds: This paper systematically reviewed 5 years of empirical research (2017–2021) on AD and TA in online assessment in both K‐12 and higher education.This paper revealed the most recent trends developing in the literature regarding the factors contributing to the appearance of AD in online assessment.This paper revealed a recent report on efforts to improve TA in online assessment.This paper recommended several new pedagogical and technological approaches to reduce AD and increase TA in online assessment. Implications for practice: Education managers, professional associations, teachers, and lecturers need to reeducate the academic community about the risks of AD in online assessments.Teachers need to redesign the form of online assessment to achieve HOTs and reduce multiple‐choice questions. On the other hand, oral‐based, project‐based assessments, and student work portfolios are encouraged to be adopted.Online assessment using an adaptive and intelligent online assessment approach, randomization of delivery question systems, smart proctoring, AI for online assessment, and learning analytic technology is recommended to be studied massively.Research on AD and TA at the K‐12 and higher education levels needs to be intensified considering online learning programs in the era of the COVID‐19 pandemic. [ABSTRACT FROM AUTHOR]

Background: In scientific inquiry learning, students often have difficulties conducting hypothetical reasoning with multiple intertwined variables. Concept maps have a potential to facilitate complex thinking and reasoning. However, there is little investigation into the content of student‐constructed concept maps and its association with inquiry task performance. Objectives: This study explored students' concept mapping style and its association with task performance in computer‐based inquiry learning. Methods: An exploratory study was conducted with 80 Grade 11 students, who collaboratively constructed concept maps in a free style to support inquiry learning with a virtual ecosystem. Student‐constructed concept maps was analysed by firstly identifying different types of propositions formed in the maps and then determining the style of each concept map based on the dominant type of propositions in the map. Finally, the association between the concept map style and inquiry task performance was explored. Results and Conclusions: Two major concept map styles were identified: (1) knowledge‐oriented concept maps (KCMs) mainly representing problem‐related subject knowledge as a set of concepts and their relationships, and (2) problem‐oriented concept maps (PCMs) mainly representing problem situation as a sequence of changes and their causal relationships. Compared with those constructing KCMs, the students constructing PCMs formed higher‐quality propositions in their maps and performed better in hypothesising, reasoning, and drawing conclusions in the inquiry task. Implications: Besides KCMs, students in inquiry learning can be encouraged to construct PCMs to foster effective thinking and reasoning; that is, constructing a concept map to represent the problem situation as a sequence of changes and the causal relationships between the changes. Lay Description: What is currently known about the subject matter: Concept maps (CMs) can facilitate complex thinking and reasoning in inquiry learning.There is little investigation into the content of student‐constructed CMs.It is unknown how CM content might associate with inquiry task performance. What this paper adds: Students constructed two major styles of CMs in computer‐based inquiry learning.The two styles of CMs are problem‐oriented and knowledge‐oriented CMs.Students constructing problem‐oriented CMs performed better in the inquiry task. Implications for practitioners: Analysing student‐constructed CMs helps understand student thinking in inquiry.Students are encouraged to build problem‐oriented CMs in inquiry learning. [ABSTRACT FROM AUTHOR]

Background: Effective learning in computer programming courses has been a constant challenge for university teachers and has become a relevant competence for current professionals. The literature on gamification in learning presents mixed results, mainly due to problems in instructional design and inconsistency in gamification. Studies with positive empirical results on computer programming formative activities and showing under what conditions gamification is effective still need to be included. Objectives: This study aimed to quantify the effects of gamification techniques in software tools that support computer programming learning applied to data‐structures university students. The study focused on determining whether there are differences in learning when using gamification techniques in online exercising formative activities. The effects of gamification on learning objectives with diverse complexity are studied. Methods: The study was conducted on computer engineering university students following a pretest‐intervention‐posttest design. They were divided into control and experimental groups, where both used a bank of exercises in Moodle to support learning. The experimental group considered gamification techniques, including points, leaderboards, and badges. Results and Conclusions: Gamification techniques significantly outperformed in learning gains in exercising activities without gamification. Regarding learning complexity, increasing taxonomic complexity did not negatively affect gamification learning effects. Lay Description: What is currently known about the subject matter?: Gamification has been explored as a strategy to enhance learning motivation in various educational contexts, including computer programmingLiterature shows mixed quantitative results on learning improvements under gamification.Few studies cover formative exercises, deal with computer programming tasks, or use a LMS like Moodle.Lack of literature exploring the conditions for effective gamification use, and involving learning objective complexity. What does this paper add to the existing body of research?: Quantifies the impact of gamification techniques on learning outcomes, specifically focusing on computer‐programming in university.Provides empirical evidence on gamification significantly improving learning gains compared to non‐gamified data‐structures exercisesGamification is effective in tasks of diverse levels of taxonomic complexity, with consistent effectiveness regardless of learning difficulty. Implications of study findings for practitioners: Gamification techniques, can be used in higher education to enhance student engagement and learning outcomes in computer programmingThe gamification information (e.g. points and ranking) do not require an automatic update, can be processed manually and published daily.It is effective to use gamification for learning tasks of medium‐high difficulty in Moodle on computer programming topics.It is key a thoughtful instructional design when applying gamification, ensuring alignment with learning objectives and task complexity. [ABSTRACT FROM AUTHOR]

Background: Many instructors transitioned their courses from face‐to‐face environments to computer‐mediated learning environments (CMLEs) following the onset of the coronavirus disease 2019 (COVID‐19) pandemic. However, little was known about how teleconferencing platforms and their corresponding functions affect student learning when the COVID‐19 pandemic began. Objectives: The aim of this study was to provide more clarity on the conditions through which online teleconferencing platforms influence student achievement. More specifically, this study investigated how displaying lecture‐relevant and lecture‐irrelevant messages in a chat box during a video lecture delivered via the Zoom teleconferencing platform affected student learning and note taking. Methods: Participants viewed the video lecture either with (relevant or irrelevant) or without messages appearing in the chat box of the Zoom window. Participants completed a learning test immediately following the lecture. Results and Conclusions: No difference regarding student achievement was observed between the three groups. However, results revealed that students in the relevant‐lecture messages group reported a higher extraneous cognitive load than the other groups even if they reported positive attitudes about the messages appearing on the chat box. Students in the lecture‐relevant group also recorded more notes during the lecture compared to the two other groups, but this result did not reach significance. This study extends previous research that investigated how messaging influences learning in classroom settings. Findings suggest that allowing relevant discussions is not the best strategy to promote learning in CMLEs as this information seems to compete with the other relevant information being presented during the ongoing lecture. Lay Description: What is already known about this topic: In video lectures, the chat box has been identified as the function most often used to support students' learning.Responding to lecture‐relevant messages can enhance students' learning.However, it remains unknown how simply reading, but not responding to, lecture‐relevant and lecture‐irrelevant messages can affect learning and note taking. What this paper adds: In previous studies, researchers examined how messaging affects learning in a classroom setting, but not within a computer‐mediated lecture environment.The present study extends previous research that investigated how messaging influences learning in classroom settings.This study provides more clarity on the conditions through which online teleconferencing platforms affect student learning and note taking.Findings suggest that allowing relevant discussions is not the best strategy to promote learning in CMLEs as this information seems to compete with the other relevant information being presented during the ongoing lecture. Implications for practitioners: The features of video lectures are critical factors, as they influence students' learning and should therefore be taken into account when designing educational materials.Instructors should not allow students to engage in lecture‐relevant and irrelevant messaging and discussion during video lectures as it competes with the other relevant information being presented. [ABSTRACT FROM AUTHOR]

Background: Delivering effective feedback to large groups of students represents a challenge for the academic staff at universities. Research suggests that undergraduate students often ignore the Elaborated Feedback (EF) received via digital learning environments. This may be because instructors provide feedback in written format instead of using more engaging channels (e.g., audiovisual). Objectives: This quasi‐experimental study examines the extent to which feedback format (video vs. written) influences students' perceptions of feedback, their decision to access EF messages related to high‐stakes assignments in digital environments, and its impact on academic performance, while considering the effect of their academic engagement. Methods: A total of 171 undergraduate students received generic EF messages through a learning platform the day after submitting each course assignment. 78 students received EF in written format and 93 in video format. Results and Conclusions: Our results showed that feedback format influenced students' decision to access EF and their academic performance, but not their feedback perceptions. Students in the written‐feedback group accessed EF messages more often, but students who received video‐feedback performed better than their counterparts in the written‐feedback group. Moderation analysis showed that the relationship between the feedback format and students' academic performance was moderated by their academic engagement, suggesting that students with lower levels of academic engagement may benefit from video‐feedback. Takeaways: The results reveal that using video feedback in digital environments may influence students' decisions to process EF and their academic achievement, especially when it comes to students with lower levels of academic engagement. Lay Description: What is currently known about the subject matter: Delivering Elaborated Feedback (EF) to large groups of students represents a challenge for instructors.Undergraduate students often ignore the EF received via digital learning environments.Students usually prefer audiovisual formats to receive feedback compared to the written format.Results in regard to whether video‐feedback is best for learning are inconclusive. What this paper adds: A quasi‐experimental study to compare two feedback formats (video and written) in an ecologically valid setup.Data of students' voluntary decisions to process EF related to high‐stakes assignments.The moderating effect of students' academic engagement on the relationship between feedback format and academic performance. The implications of study findings for practitioners: Students positively value the EF received in both video and written formats.Students may not engage with EF as expected even when provided in audiovisual formats.Students may access written‐EF more frequently than video‐EF.Video‐EF may positively influence academic performance when students have low levels of academic engagement. [ABSTRACT FROM AUTHOR]