Search

Background: The potential of learning analytics dashboards in virtual reality simulation‐based training environments to influence occupational self‐efficacy via self‐reflection phase processes in the Chemical industry is still not fully understood. Learning analytics dashboards provide feedback on learner performance and offer points of comparison (i.e., comparison with one's own past performance or comparison with peer performance) to help learners make sense of their feedback. Objectives: We present a theoretical framework for describing learning analytics reference frames and investigate the impact of feedback delivered through dashboards with different reference frames on occupational self‐efficacy, while controlling for workplace self‐reflection. Methods: This experimental study engaged 42 chemical operator employees, aged between 18 and 55 years, each with at least one year of experience. We utilised a two‐group design to ask two research question each with three competing hypotheses related to changes in occupational self‐efficacy, employing Bayesian informative hypothesis evaluation. Results and Conclusions: Results for the primary research question suggest that dashboards with progress reference frames do not elicit greater change to self‐efficacy than those with social reference frames, however, they may elicit equal change. Furthermore, dashboards with social reference frames may elicit greater change to self‐efficacy than those with progress reference frames. Exploratory results found that dashboards with progress reference frames may elicit greater positive directional change than those with social reference frames and that they may elicit equal directional change. These findings contribute to the understanding of self‐efficacy beliefs within the Chemical industry, with potential impacts on skill development. The research may inform the design of targeted interventions and training programs to influence self‐efficacy. From a practical perspective, this research suggests that careful consideration is needed when choosing reference frames in learning analytics dashboards due to their potential consequences on the formation of learner self‐efficacy. Lay Description: What is already known about this topic?: Learning analytics dashboards often aim to stimulate self‐regulated learning by providing feedback.Feedback plays a crucial role in simulation‐based learning and learning analytics dashboards can be a valuable tool to deliver feedback and facilitate the learning process by providing learners with insights into their performance and progress.Previous research has highlighted the importance of reference frames as critical design features of learning analytics dashboards, as they assist learners in making sense of learning analytics feedback.Self‐efficacy is a powerful determine factor of workplace performance and is influenced by mastery experiences and social modelling information. What the paper adds?: A theoretical framework describes the mediating role self‐reflection phase processes of the self‐regulated learning cycle plays in the formation of occupational self‐efficacy.This paper introduces the concept of three learning analytics reference frame components which include the performance outcome component, point of comparison component and score delta component.The paper indicates that learning analytics dashboards designed with a progress reference frame does not elicit greater change to occupational self‐efficacy than the social reference frame.Exploratory results suggest dashboards with progress reference frames might produce greater positive directional change compared to social reference frames or elicit equal change. Implications for practice?: Learning analytics system designers who use reference frames to help learners make sense of their feedback should carefully consider which reference frames they use as these decisions likely have consequences on the formation of learner self‐efficacy beliefs.For LAD designers and stakeholders, recognising the absolute change and directional shift in self‐efficacy is crucial, as LAD designs significantly influence these dynamics and guide the tailoring of effective tools.In industries like the chemical sector, where overconfidence can result in severe consequences, understanding the nuance of self‐efficacy changes is especially pertinent. [ABSTRACT FROM AUTHOR]

Background Study: The research discusses the need for a paradigm shift in engineering education current practices to accommodate the digital native students. The paper emphasizes the importance of integrating disruptive technologies, namely Virtual Reality (VR) through Head Mounted Displays VR (HMD VR) and Desktop Based VR (DB VR) and comparing it with the traditional teaching methods. The research focuses on second‐year undergraduate students enrolled in a concrete structures course. Objectives: The objective of the study is to analyse the impact of DB VR and HMD VR on students' motivation, performance and workload in comparison with traditional 2D drawings. The study also aims to investigate how simulation sickness and system usability could impact students' motivation and performance when interpreting concrete structures. Methods: The study divided second‐year civil engineering students into three groups, 2D, DB VR and HMD VR. The performance and motivation levels of students were assessed based on the number of mistakes identified and an intrinsic motivation survey. Furthermore, data on system usability and simulation sickness were collected. Spearman rank correlation was conducted to analyse the relationships between the variables tested. Results: The results have shown that students' motivation and performance were much higher when using VR in general and HMD VR specifically, students' efficiency and accuracy were also observed. On the other hand, usability was found to be moderately correlated with motivation, with students rating HMD VR as the most usable approach. A moderate inverse correlation was observed between simulation sickness and motivation, indicating that higher simulation sickness led to lower motivation levels. Conclusion: The study concludes that integrating VR in general, DB VR, or HMD VR into a concrete structures course for undergraduate students can significantly improve students' performance and motivation. Furthermore, enhancing usability of any of the methods used can also improve the performance and motivation. On the other hand, simulation sickness inversely affects motivation and performance, therefore, VR developers and educators should not neglect it. Lay Description: What is already known about the topic: Traditional teaching methods in engineering education require improvement.Integrating digital technologies into engineering education enhances performance.Digital technologies can potentially enhance motivation. What this paper adds: Compares traditional teaching methods for concrete structures interpretation with virtual reality.Establishes correlations between motivation, performance and usabilityIntroduces how desktop‐based VR and head‐mounted display VR can produce varying results. Implications for practice and/or policy: Decision‐makers can use the information to integrate updated pedagogy into engineering curricula.Allows for further exploration of different digital technologies that can be used for concrete structure interpretation.Allows instructors to introduce virtual reality in their courses. [ABSTRACT FROM AUTHOR]

Background: Virtual reality (VR) offers significant potential for hands‐on learning environments by providing immersive and visually stimulating experiences. Interacting with such environments can bring numerous benefits to learning, including enhanced engagement, knowledge construction, and higher‐order thinking. However, many current VR studies in hands‐on learning tend to utilise one‐way learning materials, limiting participants' ability to interact with and reflect on their actions and learning experiences. Moreover, these studies often neglect to assess learners' capacity to transfer their skills from VR learning to real‐world scenarios. Therefore, this study aims to investigate participants' engagement, learning outcomes, higher‐order thinking, and their ability to apply acquired skills in real‐world contexts. Method and Objective: Participants were immersed in a hands‐on learning environment in VR, where they received feedback and engaged in reflection during the learning process. This study recruited 68 university students to participate in the experiment, employing a quasi‐experimental design. Participants experienced learning units both with and without reflection on the feedback. The theme of these learning units was related to embedded systems, encompassing topics such as the assembly of embedded components and Python programming. The investigation aimed to assess whether reflection in VR could enhance cognitive levels, engagement, real‐world hands‐on tasks abilities, and higher‐order thinking. Results: The research results indicate that in the VR hands‐on learning environment, participants engage in reflection through the provided feedback, effectively enhancing their engagement, cognitive levels, and hands‐on task abilities. Simultaneously, it also successfully assists participants in developing problem‐solving skills and critical thinking in higher‐order thinking. Conclusions: Participants actively engaged in reflection on their own learning tasks and actions within the hands‐on learning environment, enabling them to develop a deeper understanding of the learning material and enhance their real‐world hands‐on tasks abilities, we encourage the integration of reflection strategies in VR learning environments for hands‐on learning, as they can yield positive benefits for learners. Lay Description: What is already known about this topic: Virtual reality learning environments can enhance students' cognitive levels.Higher‐order thinking has a significant impact on hands‐on learning.Reflection has an important influence on the cognitive process. What this paper adds: Providing reflection through feedback in a virtual reality environment increases learning engagement and promotes higher‐order thinking.Reflection in virtual reality enhances cognitive levels and practical abilities. Implications for practice and/or policy: We demonstrated the effectiveness of providing reflection through feedback in a VR hands‐on learning environment.Learners, through reflection in VR, enhance higher‐order thinking, engagement, cognitive levels, and practical abilities. What are the 1 or 2 major takeaways from the study: Providing reflection in VR learning environments used for training or hands‐on learning can effectively promote cognitive levels, engagement, higher‐order thinking abilities, and practical skills.Through VR reflection, we reveal the potential of cultivating higher‐order thinking through VR. [ABSTRACT FROM AUTHOR]