Search

Background Study: Several meta‐analysis studies have investigated the effects of mobile learning on learning performance. However, limited attention has been paid to pedagogy in mobile learning, making quantitative evidence of the effects of pedagogical approaches on learning performance in mobile learning scarce. Filling this gap can therefore help stakeholders understand which mobile pedagogical approaches might work or not under which learning conditions, hence achieving better learning experience and performance. Objectives: To address this gap, this study conducted a meta‐analysis and research synthesis of the effects of integrated pedagogical approaches on students' learning performance in mobile learning. Additionally, this study analysed the field of education, level of education, learning setting, sample size, and mobile device as moderating variables of the effect of pedagogical approaches. Methods: The software Comprehensive Meta‐Analysis V.3 was used for this meta‐analysis, where Hedges' g was calculated for the effect sizes. Specifically, 70 quantitative studies (N = 5575 participants) were coded and analysed. Results: The results indicate that pedagogical approaches in mobile learning have a large effect on students' learning performance (g = 0.93, p < 0.001). The most effective pedagogical approach was project‐based learning (huge effect), while collaborative learning, situated learning and game‐based learning had large effects. Finally, cognitive theory of multimedia learning and inquiry‐based learning had medium effects. The results also indicate that the effect is moderated by the field of education, the level of education, the learning setting, the sample size, and the mobile device. Finally, it is found that study quality might influence the overall effect size. Conclusions: The findings of this study can be beneficial to both researchers and practitioners as they highlight and discuss which pedagogical approaches could be more effective in mobile learning under specific conditions. Further research, on the other hand, should focus on covering additional moderators of learning performance like mobile device type and screen size which is one of the limitations of this study. Lay Description: What is already known about this topic: Mobile learning is widely adopted in education.Mobile learning can enhance learning outcomes. What this paper adds: Pedagogical approaches in mobile learning have different effects on students' learning performance.The most effective pedagogical approach in mobile learning is project‐based learning (huge effect).Which pedagogical approaches could be more effective in mobile learning under specific conditions. Implications for practice and/or policy: This study enriches the ongoing debate on how to design effective mobile learning interventions.This study provides substantial evidence about which pedagogical approaches in mobile learning would be more effective under which circumstances. [ABSTRACT FROM AUTHOR]

Background: Learning to use software using screencast videos with worked examples in the corresponding practice files presents a classic split‐attention problem that requires learners to mentally integrate information from the video with a target application. While there is evidence that splitting attention either temporally or spatially adversely impacts learning, it is unclear if there is a meaningful difference in the load imposed by splitting attention in different ways. Furthermore, while much is known about effective screencast design, little is known about how learning environment features, such as the monitor configuration, influence learning from this form of instruction. Objective: An experiment was conducted with 42 novice learners to compare the effects of two common monitor configurations that divided attention differently on three physiological measures of cognitive load. Methods: Effects due to the monitor setup were assessed using a 2 × 2 study design that controlled for task order and working memory capacity. In one condition, subjects split attention temporally by toggling back and forth between the video and target application on one monitor. In contrast, the other condition required subjects to split attention spatially by shifting their gaze between the video and target application displayed on two side‐by‐side monitors. Results and Conclusions: Results indicated that cognitive load as measured through task‐evoked pupil response was significantly higher, p < 0.05, for groups with two monitors during both instruction and testing, even after controlling for working memory capacity. Lay Description: What is currently known about the subject matter: Splitting attention between information sources negatively impacts learningInstructional media that splits attention temporally or spatially increases cognitive loadEnvironmental factors such as monitor configuration also contribute to cognitive loadPrior research suggests integrating the mutually referring information sources What the paper adds: Compares cognitive load in two monitor configurations designed to split attention differently – temporally and spatiallyCognitive load increased when attention was split spatially across two monitors during an encoding phaseCognitive load also increased when attention was split spatially across two monitors during a retrieval phaseWorking memory capacity did not explain variances in cognitive load Implications for practice: To reduce cognitive load, learners should consider working on one monitor while engaging with screencast software tutorials and the related practice filesFocus on studying worked examples in the video before attempting to replicate them in the practice filesWhen designing instructional videos, structure opportunities to practice closest to the point where they are taught in the video to avoid added cognitive load [ABSTRACT FROM AUTHOR]

Background: Formative online multiple‐choice tests are ubiquitous in higher education and potentially powerful learning tools. However, commonly used feedback approaches in online multiple‐choice tests can discourage meaningful engagement and enable strategies, such as trial‐and‐error, that circumvent intended learning outcomes. These strategies will not prepare graduates as self‐regulated learners, nor for the complexities of contemporary work settings. Objectives: To investigate whether providing only a score after formative online multiple‐choice test attempts (score‐only feedback) increases the likelihood of students to engage in self‐regulated learning compared with more directive feedback. Measurable outcomes included deeper learning, collaboration, information seeking, and satisfaction. Methods: Data in this mixed methods study were collected from nursing students through surveys, test results, focus groups, and student discussion board contributions. A quasi‐experimental design was used for quantitative data, and qualitative data were analysed thematically against domains of self‐regulated learning. Results and Conclusions: Students receiving score‐only feedback were more cognitively engaged with the content, collaborated constructively, and sought out richer sources of information. However, it was also associated with lower satisfaction. In this study, minimal feedback created states of uncertainty, which resulted in the activation of self‐regulatory actions. Implications for Practice: Providing overly directive feedback for formative online multiple‐choice tests is conducive to surface‐level learning strategies. By minimising feedback and allowing for extended states of uncertainty, students are more likely to regulate their learning through self‐assessment and problem‐solving strategies, all of which are required by graduates to meet the challenges of real‐world work settings. Lay Description: What is already known about this topic: Formative online multiple‐choice tests are widely used in higher education.Feedback is a critical element in the design of effective online multiple‐choice tests.Formative feedback should promote self‐regulated learning.Feedback types used in multiple‐choice tests facilitate strategies not conducive to self‐regulation. What this paper adds: Online multiple‐choice test feedback can influence how students self‐regulate their learning.Less feedback can result in greater self‐evaluation and performance in summative assessment.Less feedback can encourage richer help‐seeking strategies (collaboration and information seeking).However, less feedback can result in student dissatisfaction. Implications for practice and/or policy: Judicious use of feedback is required in the design of online multiple‐choice tests.Educators should consider providing less feedback to promote learner self‐regulation.Satisfaction with online multiple‐choice tests does not necessarily equate to greater learning. [ABSTRACT FROM AUTHOR]

Background: Providing feedback in massive open online courses (MOOCs) is challenging due to the massiveness and heterogeneity of learners' population. Learning analytics (LA) solutions aim at scaling up feedback interventions and supporting instructors in this endeavour. Paper Objectives: This paper focuses on instructor‐led feedback mediated by LA tools in MOOCs. Our goal is to answer how, to what extent data‐driven feedback is provided to learners, and what its impact is. Methods: We conducted a systematic literature review on the state‐of‐the‐art LA‐informed instructor‐led feedback in MOOCs. From a pool of 227 publications, we selected 38 articles that address the topic of LA‐informed feedback in MOOCs mediated by instructors. We applied etic content analysis to the collected data. Results and Conclusions: The results revealed a lack of empirical studies exploring LA to deliver feedback, and limited attention on pedagogy to inform feedback practices. Our findings suggest the need for systematization and evaluation of feedback. Additionally, there is a need for conceptual tools to guide instructors' in the design of LA‐based feedback. Takeaways: We point out the need for systematization and evaluation of feedback. We envision that this research can support the design of LA‐based feedback, thus contributing to bridge the gap between pedagogy and data‐driven practice in MOOCs. Lay Description: What is known about this topic: Learners' scale and diversity hinder timely feedback in massive open online courses (MOOCs).Learning analytics (LA) can optimise learners' support by scaling the feedback interventions. What this paper adds: We present a literature review on LA‐based feedback in MOOCs in the last 12 years.We focused on LA approaches that support instructors in providing feedback.Results show a scarcity of empirical studies related to these LA‐based tools.Results show that limited attention is paid to pedagogical and contextual aspects. Implications of the study findings for practitioners: We address knowledge gaps related to LA‐based tools for feedback in MOOCs.There is a need of LA‐based interventions to consider the course context.There is a need to evaluate the impact of LA‐based feedback in MOOCs empirically. [ABSTRACT FROM AUTHOR]

Background: Massive Open Online Courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business models. In addition, the promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful. And finally, studies demonstrated that many learners exploit the anonymity and feedback to earn certificates unethically. Thus, establishing MOOC pedagogical models that balance open access, meaningful learning, and trustworthy assessment remains a challenge that is crucial for the field to achieve its goals. Objectives: This study analysed the influence of an MOOC assessment model, denoted the Competency Exam (CE), on learner engagement, the level of cheating, and certification rates. At its core, this model separates learning from for‐credit assessment, and it was introduced by the MITx Biology course team in 2016. Methods: We applied a learning analytics methodology to the clickstream data of the verified learners (N = 559) from four consecutive runs of an Introductory Biology MOOC offered through edX. The analysis used novel algorithms for measuring the level of cheating and learner engagement, which were developed in the previous studies. Results and Conclusions: On the positive side, the CE model reduced cheating and did not reduce learner engagement with the main learning materials – videos and formative assessment items. On the negative side, it led to procrastination, and certification rates were lower. Implications: First, the results shed light on the fundamental connection between incentive design and learner behaviour. Second, the CE provides MOOC designers with an 'analytically verified' model to reduce cheating without compromising on open access. Third, our methodology provides a novel means for measuring cheating and learner engagement in MOOCs. Lay Description: What is already known about this topic?: Massive open online courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business modelsThe promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful.Studies demonstrated that many learners exploit the anonymity and feedback to earn certificates unethically.Thus, establishing MOOC pedagogical models that balance open access, meaningful learning, and trustworthy assessment remains a challenge that is crucial for the field to achieve its goals. What this paper adds?: Underlines ways in which incentive‐based design shapes learners' behavior in MOOCs.Presents an 'analytically‐verified' assessment model that is resistant to cheating while still preserving open access and design for learning.Provides a robust learning analytics methodology to evaluate the effect of assessment models on cheating and learning, which can be generalized to evaluate the effect of such interventions. The implications of study findings for practitioners: The results shed light on the fundamental connection between assessment design and learner behavior.The competency exam model provides MOOC designers with an 'analytically‐verified' model to reduce cheating without compromising on open access.The paper provides a novel methodology for measuring cheating and learner engagement in MOOCs. [ABSTRACT FROM AUTHOR]

Background: Hyper‐video technology allows reflection on learning materials by writing personal notes and by interactions with lecturers and peers through shared posts and replies. While research shows that integrating hyper‐videos in educational systems can promote the learning processes and outcomes, an open question remains regarding its actual utilization patterns by students and teachers. Objectives: The study aimed to reveal the extent to which students utilize different functions of hyper‐videos in real‐life learning contexts, and to examine the role of instructional design on hyper‐video utilization. Method: In a mixed‐method design, the study characterized active and passive interactions in hyper‐videos in higher education courses, and amongst active interactions, compared shared versus private annotations. Additionally, the study compared voluntary and mandatory instructional design for promoting hyper‐video interactions. In particular, we used learning analytics to explore hyper‐video patterns in 25 undergraduate and graduate courses. Results and Discussion: A log analysis revealed that students wrote most of the posts, while lecturers mainly provided replies to students' posts. Private annotations were more prevalent than shared writing, pointing to the unfulfilled potential of hyper‐video annotations to benefit from collaborative learning. A qualitative analysis on instructional design was consistent with quantitative findings, revealing important differences between the courses with mandatory versus voluntary hyper‐video integration in pedagogical design, and in cognitive presence and teaching presence, based on the community of inquiry framework. Major takeaways: Findings point to an unfulfilled potential of hyper‐video technology to promote active and collaborative learning. This highlights the role of design and instructive guidance when integrating technology into educational systems. Lay Description: What is already known about this topic: Hyper‐video functions increase motivation and promote self‐regulation of learningIntegrating hyper‐videos in education can benefit leaning outcomesHowever, there is an imbalance between the availability ICT and its actual useThere is a gap in the literature regarding actual utilisation patterns of hyper‐video What this paper adds: A mixed method design exposes hyper‐video utilisation patterns in higher educationFindings show underutilisation of active and collaborative hyper‐video functionsMixed analysis reveals advantage for mandatory (graded) compared to voluntary designGender and degree do not moderate utilisation patterns of hyper‐videos Implications for practise and/or policy: Instructional design is required to guide students of effective use of hyper‐videosInstructors should use hyper‐videos to promote collaboration and peer dialogueDirect instruction does not engage students in active learning via hyper‐videosMandatory design can increase hyper‐videos' potential to contribute to learning [ABSTRACT FROM AUTHOR]

Despite the proliferation of multimedia devices in elementary classrooms, there is limited research examining teacher‐created video instruction, particularly regarding its effect on academic growth and engagement. This study investigated the effect of teacher‐created computer‐based video instruction (CBVI) using iPads on students' academic, behavioural and affective learning in elementary classrooms. The study used a repeated‐measures design with counterbalancing to measure the effects of CBVI during mathematics lessons on student achievement scores, time on‐task and attitudes towards learning. Three year three classes (n = 49) completed three lessons, each using a different mode of instruction: CBVI created by the class teacher, CBVI created by a stranger, and a traditional live lesson delivered by the class teacher. Results were analysed using a Linear Mixed Model. No significant growth in performance was detected during video instruction, however a significant growth result was achieved for the traditional live teaching mode (p < 0.001), possibly attributable to the longer duration of experimental session. Behavioural engagement was considerably higher during CBVI lessons than live lessons and students preferred their teacher's voice during CBVI. Three teachers were interviewed to examine how CBVI affected teaching and learning, with two main themes emerging: (1) positive impacts of CBVI upon students; and (2) positive impacts on teacher wellbeing. This research indicates benefits for students and teachers when using teacher‐created CBVI. Further research is needed to better understand the factors that influence cognitive development of students using CBVI and to also further explore the effect of CBVI on teacher wellbeing. Lay Description: What is already known about this topic: Video as an instructional method has been used to deliver content to learners for over 40 years.Current mobile technologies have the inbuilt capability to film, edit, upload and access custom‐made instructional videos.Learning through video instruction is enjoying renewed popularity due to Internet capability, increased connectivity and device affordances.Video can promote self‐paced, controlled, personalized learning experiences for students. What this paper adds: Teacher‐created video instruction has been an overlooked pedagogical approach in mainstream elementary classrooms.Students are highly engaged behaviourally when completing teacher‐created video lessons.Students prefer to hear their teacher's voice on the video, rather than a stranger's.Using teacher‐created video instruction in the classroom positively impacts on teacher wellbeing. Implications for practice and/or policy: Using teacher‐created video instruction in the classroom provides a way to deliver differentiated content to groups or individuals.Students have the autonomy to self‐pace and control their learning within the close proximity of the teacher.Teachers are able to provide individual support and attention to students during the video instruction without affecting general learning.High student engagement can positively impact the classroom dynamics and environment. [ABSTRACT FROM AUTHOR]