Search

Introduction: Variations in skin tone can significantly alter the appearance of symptoms such as rashes or bruises. Unfortunately, previous works utilizing Augmented Reality (AR) in simulating visual symptoms have often failed to consider this critical aspect, potentially leading to inadequate training and education. This study seeks to address this gap by integrating generative artificial intelligence (AI) into the AR filter design process. Methods: We conducted a 2 × 5 within-subjects study with second-year nursing students (N = 117) from the University of Florida. The study manipulated two factors: symptom generation style and skin tone. Symptom generation style was manipulated using a filter based on a real symptom image or a filter based on a computer-generated symptom image. Skin tone variations were created by applying AR filters to computer-generated images of faces with five skin tones ranging from light to dark. To control for factors like lighting or 3D tracking, 101 pre-generated images were created for each condition, representing a range of filter transparency levels (0-100). Participants used visual analog scales on a computer screen to adjust the symptom transparency in the images until they observed image changes and distinct symptom patterns. Participants also rated the realism of each condition and provided feedback on how the symptom style and skin tone impacted their perceptions. Results: Students rated the symptoms displayed by the computer-generated AR filters as marginally more realistic than those displayed by the real image AR filters. However, students identified symptoms earlier with the real-image filters. Additionally, SET-M and Theory of Planned Behavior questions indicate that the activity increased students' feelings of confidence and self-efficacy. Finally, we found that similar to the real world, where symptoms on dark skin tones are identified at later stages of development, students identified symptoms at later stages as skin tone darkened regardless of cue type. Conclusion: This work implemented a novel approach to develop AR filters that display time-based visual cues on diverse skin tones. Additionally, this work provides evidence-based recommendations on how and when generative AIbased AR filters can be effectively used in healthcare education. [ABSTRACT FROM AUTHOR]

Real-world understanding serves as a medium that bridges the information world and the physical world, enabling the realization of virtual–real mapping and interaction. However, scene understanding based solely on 2D images faces problems such as a lack of geometric information and limited robustness against occlusion. The depth sensor brings new opportunities, but there are still challenges in fusing depth with geometric and semantic priors. To address these concerns, our method considers the repeatability of video stream data and the sparsity of newly generated data. We introduce a sparsely correlated network architecture (SCN) designed explicitly for online RGBD instance segmentation. Additionally, we leverage the power of object-level RGB-D SLAM systems, thereby transcending the limitations of conventional approaches that solely emphasize geometry or semantics. We establish correlation over time and leverage this correlation to develop rules and generate sparse data. We thoroughly evaluate the system's performance on the NYU Depth V2 and ScanNet V2 datasets, demonstrating that incorporating frame-to-frame correlation leads to significantly improved accuracy and consistency in instance segmentation compared to existing state-of-the-art alternatives. Moreover, using sparse data reduces data complexity while ensuring the real-time requirement of 18 fps. Furthermore, by utilizing prior knowledge of object layout understanding, we showcase a promising application of augmented reality, showcasing its potential and practicality. [ABSTRACT FROM AUTHOR]

Periacetabular osteotomy (PAO) is an effective approach for the surgical treatment of developmental dysplasia of the hip (DDH). However, due to the complex anatomical structure around the hip joint and the limited field of view (FoV) during the surgery, it is challenging for surgeons to perform a PAO surgery. To solve this challenge, we propose a robot-assisted, augmented reality (AR)-guided surgical navigation system for PAO. The system mainly consists of a robot arm, an optical tracker, and a Microsoft HoloLens 2 headset, which is a state-of-the-art (SOTA) optical see-through (OST) head-mounted display (HMD). For AR guidance, we propose an optical marker-based AR registration method to estimate a transformation from the optical tracker coordinate system (COS) to the virtual space COS such that the virtual models can be superimposed on the corresponding physical counterparts. Furthermore, to guide the osteotomy, the developed system automatically aligns a bone saw with osteotomy planes planned in preoperative images. Then, it provides surgeons with not only virtual constraints to restrict movement of the bone saw but also AR guidance for visual feedback without sight diversion, leading to higher surgical accuracy and improved surgical safety. Comprehensive experiments were conducted to evaluate both the AR registration accuracy and osteotomy accuracy of the developed navigation system. The proposed AR registration method achieved an average mean absolute distance error (mADE) of 1.96 ± 0.43 mm. The robotic system achieved an average center translation error of 0.96 ± 0.23 mm, an average maximum distance of 1.31 ± 0.20 mm, and an average angular deviation of 3.77 ± 0.85°. Experimental results demonstrated both the AR registration accuracy and the osteotomy accuracy of the developed system. [ABSTRACT FROM AUTHOR]

Recent advancements in communication technology have catalyzed the widespread adoption of realistic content, with augmented reality (AR) emerging as a pivotal tool for seamlessly integrating virtual elements into real-world environments. In construction, architecture, and urban design, the integration of mixed reality (MR) technology enables rapid interior spatial mapping, providing clients with immersive experiences to envision their desires. The rapid advancement of MR devices, or devices that integrate MR capabilities, offers users numerous opportunities for enhanced entertainment experiences. However, to support designers at a high level of expertise, it is crucial to ensure the accuracy and reliability of the data provided by these devices. This study explored the potential of utilizing spatial mapping within various methodologies for surveying architectural interiors. The objective was to identify optimized spatial mapping procedures and determine the most effective applications for their use. Experiments were conducted to evaluate the interior survey performance, using HoloLens 2, an iPhone 13 Pro for spatial mapping, and photogrammetry. The findings indicate that HoloLens 2 is most suited for the tasks examined in the scope of these experiments. Nonetheless, based on the acquired parameters, the author also proposes approaches to apply the other technologies in specific real-world scenarios. [ABSTRACT FROM AUTHOR]

This paper presents a support tool designed for instructors in technical education within engineering programs, focusing specifically on power electronics and laboratory procedures related to the three-phase half-wave rectifier. The Augmented Reality (AR) application was developed for Android devices using Unity+Vuforia, employing a gamification-based approach. The application allows students to evaluate their knowledge and skills in real-time and offers an interactive learning environment. It provides learning diagnostics and sends each student's evaluation to a database stored on Google-Forms that is accessible by the instructor or assessor in question. It's important to note that this APP is freely accessible through the Android APP store. The learning strategy is around a game that tests players on their knowledge of measuring devices and theoretical concepts. Additionally, there is a puzzle task that encourages learners to correctly arrange the waveforms in a rectifier. Students can also connect the half-wave rectifier's essential connections and the transformer's delta-star connections through touch interaction. A comparison study between traditional teaching methods and the innovative AR-based approach has been conducted. This educational proposal itself is an innovative solution that will be especially helpful for laboratories lacking useful equipment in Mexican colleges. To test the effect of AR application on student success, an experimental study was conducted on two groups of students (a control group [non-using AR] and a test group [using AR]). To determine significant difference in acquired learning, an ANOVA statistical analysis was conducted using independent sample tests. According to tests result, there is a significant difference in the acquired knowledge for those who used the designed tool. The probability value (p = 1e-5 <0.05) for the use of AR is found. They increase their initial average grade from 27.08% to 72.3%, in contrast to the control group with no significant increasing learning, reporting an initial average grade of 28.75–43.33%. These results show that the use of AR in electronic practice makes a significant difference in student success. [ABSTRACT FROM AUTHOR]

With the rapid development of science and technology, the integration and complexity of aerospace vehicles, weaponry, and large-scale chemical equipment are becoming higher and higher. PHM plays an important role in realizing reductions in equipment loss due to failures in many fields. In order to systematically sort through the research history of PHM and deeply analyze the development status of AR and DT technologies in the field of PHM, to clarify the current technical challenges and future development directions and to provide valuable references and insights for researchers, engineers, and decision-makers in the related fields, this paper summarizes the development of PHM in the engineering field. This paper summarizes the development of PHM in the field of engineering, from the initial PHM used in aerospace to the current PHM systems supported by various advanced technologies; analyzes the advantages and shortcomings of the digital twin and augmented reality technologies used for PHM; and organizes and summarizes the future directions and future research focuses of PHM research based on the existing technologies (mainly digital twins and augmented reality). After systematic research and study, we found that the integration of augmented reality and digital twin technologies will provide superb simulation capabilities and immersive operation and bring new challenges and opportunities. Therefore, it is also imperative to address the challenges and limitations that hinder the seamless integration of the new technologies. [ABSTRACT FROM AUTHOR]

A robust AR-DSNet (Augmented Reality method based on DSST and SiamFC networks) tracking registration method in complex scenarios is proposed to improve the ability of AR (Augmented Reality) tracking registration to distinguish target foreground and semantic interference background, and to address the issue of registration failure caused by similar target drift when obtaining scale information based on predicted target positions. Firstly, the pre-trained network in SiamFC (Siamese Fully-Convolutional) is utilized to obtain the response map of a larger search area and set a threshold to filter out the initial possible positions of the target; Then, combining the advantage of the DSST (Discriminative Scale Space Tracking) filter tracker to update the template online, a new scale filter is trained after collecting multi-scale images at the initial possible position of target to reason the target scale change. And linear interpolation is used to update the correlation coefficient to determine the final position of target tracking based on the difference between two frames. Finally, ORB (Oriented FAST and Rotated BRIEF) feature detection and matching are performed on the accurate target position image, and the registration matrix is calculated through matching relationships to overlay the virtual model onto the real scene, achieving enhancement of the real world. Simulation experiments show that in complex scenarios such as similar interference, target occlusion, and local deformation, the proposed AR-DSNet method can complete the registration of the target in AR 3D tracking, ensuring real-time performance while improving the robustness of the AR tracking registration algorithm. [ABSTRACT FROM AUTHOR]

We propose a compact wearable glove capable of estimating both the finger bone lengths and the joint angles of the wearer with a simple stretch-based sensing mechanism. The soft sensing glove is designed to easily stretch and to be one-size-fits-all, both measuring the size of the hand and estimating the finger joint motions of the thumb, index, and middle fingers. The system was calibrated and evaluated using comprehensive hand motion data that reflect the extensive range of natural human hand motions and various anatomical structures. The data were collected with a custom motion-capture setup and transformed into the joint angles through our post-processing method. The glove system is capable of reconstructing arbitrary and even unconventional hand poses with accuracy and robustness, confirmed by evaluations on the estimation of bone lengths (mean error: 2.1 mm), joint angles (mean error: 4.16°), and fingertip positions (mean 3D error: 4.02 mm), and on overall hand pose reconstructions in various applications. The proposed glove allows us to take advantage of the dexterity of the human hand with potential applications, including but not limited to teleoperation of anthropomorphic robot hands or surgical robots, virtual and augmented reality, and collection of human motion data. Hand's complexity and individual variation poses a challenge to achieve accurate tracking hand motion. Here, authors introduce a glove that estimates finger bone lengths and joint angles, achieving accurate and robust motion estimation for virtual reality and robotic control applications. [ABSTRACT FROM AUTHOR]

Background: Virtual reality (VR) and augmented reality (AR) are emerging technologies that can be used for cardiopulmonary resuscitation (CPR) training. Compared to traditional face-to-face training, VR/AR-based training has the potential to reach a wider audience, but there is debate regarding its effectiveness in improving CPR quality. Therefore, we conducted a meta-analysis to assess the effectiveness of VR/AR training compared with face-to-face training. Methods: We searched PubMed, Embase, Cochrane Library, Web of Science, CINAHL, China National Knowledge Infrastructure, and Wanfang databases from the inception of these databases up until December 1, 2023, for randomized controlled trials (RCTs) comparing VR- and AR-based CPR training to traditional face-to-face training. Cochrane's tool for assessing bias in RCTs was used to assess the methodological quality of the included studies. We pooled the data using a random-effects model with Review Manager 5.4, and assessed publication bias with Stata 11.0. Results: Nine RCTs (involving 855 participants) were included, of which three were of low risk of bias. Meta-analyses showed no significant differences between VR/AR-based CPR training and face-to-face CPR training in terms of chest compression depth (mean difference [MD], -0.66 mm; 95% confidence interval [CI], -6.34 to 5.02 mm; P = 0.82), chest compression rate (MD, 3.60 compressions per minute; 95% CI, -1.21 to 8.41 compressions per minute; P = 0.14), overall CPR performance score (standardized mean difference, -0.05; 95% CI, -0.93 to 0.83; P = 0.91), as well as the proportion of participants meeting CPR depth criteria (risk ratio [RR], 0.79; 95% CI, 0.53 to 1.18; P = 0.26) and rate criteria (RR, 0.99; 95% CI, 0.72 to 1.35; P = 0.93). The Egger regression test showed no evidence of publication bias. Conclusions: Our study showed evidence that VR/AR-based training was as effective as traditional face-to-face CPR training. Nevertheless, there was substantial heterogeneity among the included studies, which reduced confidence in the findings. Future studies need to establish standardized VR/AR-based CPR training protocols, evaluate the cost-effectiveness of this approach, and assess its impact on actual CPR performance in real-life scenarios and patient outcomes. Trial registration: CRD42023482286. [ABSTRACT FROM AUTHOR]

Introduction: The integration of augmented reality (AR) in spine surgery marks a significant advancement, enhancing surgical precision and patient outcomes. AR provides immersive, three-dimensional visualizations of anatomical structures, facilitating meticulous planning and execution of spine surgeries. This technology not only improves spatial understanding and real-time navigation during procedures but also aims to reduce surgical invasiveness and operative times. Despite its potential, challenges such as model accuracy, user interface design, and the learning curve for new technology must be addressed. AR's application extends beyond the operating room, offering valuable tools for medical education and improving patient communication and satisfaction. Material and methods: A literature review was conducted by searching PubMed and Scopus databases using keywords related to augmented reality in spine surgery, covering publications from January 2020 to January 2024. Results: In total, 319 articles were identified through the initial search of the databases. After screening titles and abstracts, 11 articles in total were included in the qualitative synthesis. Conclusion: Augmented reality (AR) is becoming a transformative force in spine surgery, enhancing precision, education, and outcomes despite hurdles like technical limitations and integration challenges. AR's immersive visualizations and educational innovations, coupled with its potential synergy with AI and machine learning, indicate a bright future for surgical care. Despite the existing obstacles, AR's impact on improving surgical accuracy and safety marks a significant leap forward in patient treatment and care. [ABSTRACT FROM AUTHOR]

Background: Technological advancements have been rapidly integrated within the neurosurgical education track since it is a high-risk specialty with little margin for error. Indeed, simulation and virtual reality during training can improve surgical performance and technical skills. Our study aims to investigate the impact of neurosurgical technology-based simulation activities on medical students. Methods and Materials: The "Suturing Mission–The Symposium" was a three-day event held at Humanitas University. Participants had access to live-streamed conferences held by worldwide experts in several fields of neurosurgery and practical simulations of dura mater sutures, microvascular anastomosis, and augmented reality neurosurgical approaches. An anonymous survey was conducted at the beginning and end of the event. Results: 141 medical students with a mean age of 21 participated. After the course, 110 participants (77.5%) showed interest in pursuing a surgical path, with a great prevalence in those who had planned to have a surgical career before the event (88.7% vs. 41.4%, p < 0.001). Participants were also asked about their comfort levels while handling surgical instruments, and a good outcome was reached in 72.7% of participants, with a significant difference between those who had previously attended a suture course (87.8% vs. 66.3%, p = 0.012). Conclusion: Training sessions on surgical simulators were effective in increasing participants' interest in pursuing a surgical path, improving their understanding of postgraduate orientation, and boosting their confidence with surgical instruments. [ABSTRACT FROM AUTHOR]

Estimating the pose of a large set of fixed indoor cameras is a requirement for certain applications in augmented reality, autonomous navigation, video surveillance, and logistics. However, accurately mapping the positions of these cameras remains an unsolved problem. While providing partial solutions, existing alternatives are limited by their dependence on distinct environmental features, the requirement for large overlapping camera views, and specific conditions. This paper introduces a novel approach to estimating the pose of a large set of cameras using a small subset of fiducial markers printed on regular pieces of paper. By placing the markers in areas visible to multiple cameras, we can obtain an initial estimation of the pair-wise spatial relationship between them. The markers can be moved throughout the environment to obtain the relationship between all cameras, thus creating a graph connecting all cameras. In the final step, our method performs a full optimization, minimizing the reprojection errors of the observed markers and enforcing physical constraints, such as camera and marker coplanarity and control points. We validated our approach using novel artificial and real datasets with varying levels of complexity. Our experiments demonstrated superior performance over existing state-of-the-art techniques and increased effectiveness in real-world applications. Accompanying this paper, we provide the research community with access to our code, tutorials, and an application framework to support the deployment of our methodology. [ABSTRACT FROM AUTHOR]

A point cloud is a representation of objects or scenes utilising unordered points comprising 3D positions and attributes. The ability of point clouds to mimic natural forms has gained significant attention from diverse applied fields, such as virtual reality and augmented reality. However, the point cloud, especially those representing dynamic scenes or objects in motion, must be compressed efficiently due to its huge data volume. The latest video-based point cloud compression (V-PCC) standard for dynamic point clouds divides the 3D point cloud into many patches using computationally expensive normal estimation, segmentation, and refinement. The patches are projected onto a 2D plane to apply existing video coding techniques. This process often results in losing proximity information and some original points. This loss induces artefacts that adversely affect user perception. The proposed method segments dynamic point clouds based on shape similarity and occlusion before patch generation. This segmentation strategy helps maintain the points' proximity and retain more original points by exploiting the density and occlusion of the points. The experimental results establish that the proposed method significantly outperforms the V-PCC standard and other relevant methods regarding rate–distortion performance and subjective quality testing for both geometric and texture data of several benchmark video sequences. [ABSTRACT FROM AUTHOR]

Implementing digital technologies, such as augmented reality and 3D modeling, to various cultural sectors is an ongoing procedure, especially favorable after the COVID-19 pandemic. Even though such technologies are common to museums, galleries and archaeological places all over the world, little research or practical cases have been developed when it comes to theaters and theatrical costumes. The proposed research article describes the methodology of both reference material collection and application development, while an analysis of functions and aesthetic results are described, especially when it comes to 3D modeling. This paper's aim is to reveal that theatrical operations (as part of the cultural sector) as well as structured parts (such as acts, performances and costumes) can be preserved and served to larger audiences via technological means, such as an augmented reality application. [ABSTRACT FROM AUTHOR]

With the rapid development of modern science and technology, navigation technology provides great convenience for people's life, but the problem of inaccurate localization in complex environments has always been a challenge that navigation technology needs to be solved urgently. To address this challenge, this paper proposes an augmented reality navigation method that combines image segmentation and multi-sensor fusion tracking registration. The method optimizes the image processing process through the GA-OTSU-Canny algorithm and combines high-precision multi-sensor information in order to achieve accurate tracking of positioning and guidance in complex environments. Experimental results show that the GA-OTSU-Canny algorithm has a faster image edge segmentation rate, and the fastest start speed is only 1.8 s, and the fastest intersection selection time is 1.2 s. The navigation system combining the image segmentation and sensor tracking and registration techniques has a highly efficient performance in real-world navigation, and its building recognition rates are all above 99%. The augmented reality navigation system not only improves the navigation accuracy in high-rise and urban canyon environments, but also significantly outperforms traditional navigation solutions in terms of navigation startup time and target building recognition accuracy. In summary, this research not only provides a new framework for the theoretical integration of image processing and multi-sensor data, but also brings innovative technical solutions for the development and application of practical navigation systems. [ABSTRACT FROM AUTHOR]

Simultaneous Localization and Mapping (SLAM) is a crucial function for most autonomous systems, allowing them to both navigate through and create maps of unfamiliar surroundings. Traditional Visual SLAM, also commonly known as VSLAM, relies on frame-based cameras and structured processing pipelines, which face challenges in dynamic or low-light environments. However, recent advancements in event camera technology and neuromorphic processing offer promising opportunities to overcome these limitations. Event cameras inspired by biological vision systems capture the scenes asynchronously, consuming minimal power but with higher temporal resolution. Neuromorphic processors, which are designed to mimic the parallel processing capabilities of the human brain, offer efficient computation for real-time data processing of event-based data streams. This paper provides a comprehensive overview of recent research efforts in integrating event cameras and neuromorphic processors into VSLAM systems. It discusses the principles behind event cameras and neuromorphic processors, highlighting their advantages over traditional sensing and processing methods. Furthermore, an in-depth survey was conducted on state-of-the-art approaches in event-based SLAM, including feature extraction, motion estimation, and map reconstruction techniques. Additionally, the integration of event cameras with neuromorphic processors, focusing on their synergistic benefits in terms of energy efficiency, robustness, and real-time performance, was explored. The paper also discusses the challenges and open research questions in this emerging field, such as sensor calibration, data fusion, and algorithmic development. Finally, the potential applications and future directions for event-based SLAM systems are outlined, ranging from robotics and autonomous vehicles to augmented reality. [ABSTRACT FROM AUTHOR]

This study explores how combining virtual reality (VR) and augmented reality (AR) with geographic information systems (GIS) revolutionizes data visualization. It traces the historical development of these technologies and highlights key milestones that paved the way for this study's objectives. While existing platforms like Esri's software and Google Earth VR show promise, they lack complete integration for immersive GIS visualization. This gap has led to the need for a dedicated workflow to integrate selected GIS data into a game engine for visualization purposes. This study primarily utilizes QGIS for data preparation and Unreal Engine for immersive visualization. QGIS handles data management, while Unreal Engine offers advanced rendering and interactivity for immersive experiences. To tackle the challenge of handling extensive GIS datasets, this study proposes a workflow involving tiling, digital elevation model generation, and transforming GeoTIFF data into 3D objects. Leveraging QGIS and Three.js streamlines the conversion process for integration into Unreal Engine. The resultant virtual reality application features distinct stations, enabling users to navigate, visualize, compare, and animate GIS data effectively. Each station caters to specific functionalities, ensuring a seamless and informative experience within the VR environment. This study also delves into augmented reality applications, adapting methodologies to address hardware limitations for smoother user experiences. By optimizing textures and implementing augmented reality functionalities through modules Swift, RealityKit, and ARKit, this study extends the immersive GIS experience to iOS devices. In conclusion, this research demonstrates the potential of integrating virtual reality, augmented reality, and GIS, pushing data visualization into new realms. The innovative workflows and applications developed serve as a testament to the evolving landscape of spatial data interpretation and engagement. [ABSTRACT FROM AUTHOR]

This research presents a novel algorithmic implementation to improve the analysis of visually controlled interception and accompanying motor action through the computational application of harmonic ratios and stimulation invariants. Unlike traditional models that focus mainly on psychological aspects, our approach integrates the relevant constructs into a practical mathematical framework. This allows for dynamic prediction of interception points with improved accuracy and real-time perception–action capabilities, essential for applications in neurorehabilitation and virtual reality. Our methodology uses stimulation invariants as key parameters within a mathematical model to quantitatively predict and improve interception outcomes. The results demonstrate the superior performance of our algorithms over conventional methods, confirming their potential for advancing robotic vision systems and adaptive virtual environments. By translating complex theories of visual perception into algorithmic solutions, this study provides innovative ways to improve motion perception and interactive systems. This study aims to articulate the complex interplay of geometry, perception, and technology in understanding and utilizing cross ratios at infinity, emphasizing their practical applications in virtual and augmented reality settings. [ABSTRACT FROM AUTHOR]

This study delves into the transformative potential of integrating augmented reality (AR) within imaging technologies, shedding light on this evolving landscape. Through a comprehensive narrative review, this research uncovers a wealth of literature exploring the intersection between AR and medical imaging, highlighting its growing prominence in healthcare. AR's integration offers a host of potential opportunities to enhance surgical precision, bolster patient engagement, and customize medical interventions. Moreover, when combined with technologies like virtual reality (VR), artificial intelligence (AI), and robotics, AR opens up new avenues for innovation in clinical practice, education, and training. However, amidst these promising prospects lie numerous unanswered questions and areas ripe for exploration. This study emphasizes the need for rigorous research to elucidate the clinical efficacy of AR-integrated interventions, optimize surgical workflows, and address technological challenges. As the healthcare landscape continues to evolve, sustained research efforts are crucial to fully realizing AR's transformative impact in medical imaging. Systematic reviews on AR in healthcare also overlook regulatory and developmental factors, particularly in regard to medical devices. These include compliance with standards, safety regulations, risk management, clinical validation, and developmental processes. Addressing these aspects will provide a comprehensive understanding of the challenges and opportunities in integrating AR into clinical settings, informing stakeholders about crucial regulatory and developmental considerations for successful implementation. Moreover, navigating the regulatory approval process requires substantial financial resources and expertise, presenting barriers to entry for smaller innovators. Collaboration across disciplines and concerted efforts to overcome barriers will be essential in navigating this frontier and harnessing the potential of AR to revolutionize healthcare delivery. [ABSTRACT FROM AUTHOR]

The new advancement in percutaneous intervention procedures, which provides more accurate needle placement compared to other modalities, is Augmented Reality (AR). It provides the operator with 3-dimensional (3D) or 2-dimensional (2D) structures of the anatomy along with the target during surgery to get a precise needle placement into the target. The review highlights that using AR systems for needle navigation and placement can become productivity in various interventional procedures. The AR navigation system reduces radiation exposure, procedural time, risk to the patient, and ensures higher accuracy of needle placement than conventional Computed Tomography (CT)-guided percutaneous procedure systems. The AR system can provide precisely guided needle insertion and reduce the risk of complications. As technology and research are increasing, new techniques, such as automatic image-hologram registration, can be brought into the picture. This review compares conventional image-guided procedure systems with the AR system in the interventional radiology field. This review also provides detailed information about AR as a promising tool for optimising needle placement in interventional procedures, paving the way for safer and more effective clinical practices. [ABSTRACT FROM AUTHOR]

In this research, a blind area information perception and guidance approach for dynamic context is proposed as a solution to the issue of difficult and time-consuming assembly in blind areas. The proposed approach involves the utilization of real-time RGBD data to perceive both blind area context and operator hand information. The resulting data is then used to visualize the blind area scene and provide assembly guidance through the application of augmented reality technology. Unlike conventional methods, the proposed solutions are based on dynamic RGBD data rather than static predefined CAD models, making it simpler to configure and adapt to more scenarios. A user study was designed and conducted to confirm the feasibility of the suggested approach. The results indicate that the suggested approach can decrease assembly time by 49.5%, greatly lower the percentage of assembly errors, reduce the mental load on the workers, and significantly enhance their operational experience. [ABSTRACT FROM AUTHOR]

Occlusion handling is a key technical issue in augmented reality research. This paper proposes a new occlusion algorithm based on object contour detection to address issues such as poor real-time occlusion processing, high computational complexity in comparing the depth values of virtual and real objects, and the presence of jagged, blurry, and hollow edges in occluded areas. First, based on the depth and color information, we obtained aligned images of real scenes. Second, we extracted the maximum closed contour of the real object in the scene and overlaid it with the aligned image. Subsequently, we generated a virtual object and obtained a depth map of the virtual object. Finally, by comparing the depth values of the stacked images with the virtual objects, masks are generated in real time and optimized to present the occlusion processing results. Experimental comparisons demonstrated that the algorithm presented in this study not only improves real-time performance but also enhances accuracy at the intersection edges of virtual and real images. Simultaneously, it is no longer limited by the size of real scene images and can achieve real-time virtual and real occlusion effects. [ABSTRACT FROM AUTHOR]

This study aimed to develop an interactive mobile application based on augmented reality (IMoART), which could contribute to reshaping the learning paradigm in computer hardware courses. The IMoART application employs a marker-based tracking method. Accessible on smartphones, it integrates into the learning process, is attractive to students, and fosters engagement as users can visualize hardware through 3D objects. The application serves as an alternative and supplementary learning tool to make the educational experience more enjoyable while potentially reducing school expenditures. The results of the development process, which involved using the 4D model (define, design, develop, and disseminate), showed that the IMoART application is effective, with notable feasibility scores of 3.68 for the media aspect and 3.81 for the material aspect, as evaluated by media and subject matter experts. User responses from teachers and students further support the positive outcomes of the IMoART application, achieving a robust practicality score of 84.68%. Noteworthy aspects such as ease of navigation, clarity, aesthetic features, and instructional quality demonstrate high practicality. This study contributes significantly to the literature by presenting an evaluated model that offers an enjoyable and efficient learning experience using 3D objects, videos, images, simulations, and interactive animations in the context of computer hardware learning. [ABSTRACT FROM AUTHOR]

Peripheral facial paralysis (PFP) causes deficits in muscle and sensory functions of the face due to damage to the facial nerve. In this study, we evaluated the effectiveness of the "Fisiobem" app in rehabilitating patients with PFP through facial mimicry exercises. The app uses the device's camera to identify the user and measure the range of motion during the exercises, applying the ARKit framework to quantify the intensity of the movements. We conducted a usability study with 34 participants unaffected by PFP, performing mimics with different amplitudes. Results show that glasses did not affect recognition accuracy in exercises such as raising eyebrows, frowning, and closing the eyes tightly. As for wrinkling the nose exercise, glasses impacted higher intensities. As for the beard or mustache, lower lip protrusion, compressing the lips, smiling, showing teeth and blowing out filling cheeks were not affected. However, when smiling with lips together, beard and mustache influenced intensities above 75%. It is important to highlight that this study has limitations, such as the sample size and lack of consideration for ethnic diversity among participants. Future research with larger and more diverse samples is needed to validate and generalize these findings and explore the nuances of interactions between facial features and facial recognition algorithms. Despite these limitations, the approach facilitated by the "Fisiobem" application offers significant benefits, especially for patients with PFP who face challenges in accessing specialized therapists. It allows patients to complement their treatment by performing guided facial mimicry exercises at home. The application helps individuals accurately perform the exercises and effectively track the progress of their rehabilitation. [ABSTRACT FROM AUTHOR]

As globalization accelerates and technology advances, the education and transmission of architectural heritage face new challenges and opportunities. Mobile augmented reality (MAR) technology offers innovative means for presenting and educating about architectural heritage, enhancing user experiences and interactivity through the overlay of virtual information. This study explores the application of MAR in architectural heritage education, examining its potential to enhance educational outcomes, increase user engagement, and foster awareness of heritage conservation. While the technology has been widely explored in other educational fields, its application in architectural heritage remains insufficient, particularly in the design of collaborative tasks, assessment of user satisfaction, and implementation of incentive mechanisms. This paper encompasses three research components: a detailed description of collaborative tasks in architectural heritage education using MAR, the development of a satisfaction model to evaluate the effectiveness of these tasks, and the construction of an educational collaboration incentive mechanism. Through this study, the paper not only enriches the application of MAR in cultural heritage conservation but also provides theoretical and empirical support for future related studies. [ABSTRACT FROM AUTHOR]

Copyright of Edmetic: Revista de Educación Mediática y TIC is the property of EDMETIC Revista de Educacion Mediatica and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Extended reality, which encompasses virtual, augmented, and mixed reality, emerges as an important didactic resource, offering great potential to bring heritage closer to the educational environment. Heritage education is a challenge for today's society, contributing to cultural and social development. Therefore, the aim of this systematic review is to analyze documents related to heritage in education through extended reality. The search was conducted using Scopus and Web of Sciences databases, allowing for an international search. We excluded any document that was not a scientific article published in a journal. A total of 52 documents were analyzed, all of which were open-access articles. Preliminary results indicate that virtual reality and augmented reality are utilized in education to work with architectural, historical, archaeological, and musical heritage. Extended reality has been applied in all the stages of the education system, and in formal and non-formal settings, thereby demonstrating its versatility. These experiences increase motivation and academic performance in comparison to less innovative methodologies, which is in line with other studies on this topic. In conclusion, extended reality has the potential to make a significant impact on education, particularly when combined with heritage. The creation of multidisciplinary groups will enhance research in the near future. [ABSTRACT FROM AUTHOR]

Extended reality (XR) is one of the most important technologies in developing a new generation of human–machine interfaces (HMIs). In this study, the design and implementation of a standalone interactive XR-supported industrial robot programming system using the Unity game engine is presented. The presented research aims to achieve a cross-platform solution that enables novel tools for robot programming, trajectory validation, and robot programming debugging within an extended reality environment. From a robotics perspective, key design tasks include modeling in the Unity environment based on robot CAD models and control design, which include inverse kinematics solution, trajectory planner development, and motion controller set-up. Furthermore, the integration of real-time vision, touchscreen interaction, and AR/VR headset interaction are involved within the overall system development. A comprehensive approach to integrating Unity with established industrial robot modeling conventions and control strategies is presented. The proposed modeling, control, and programming concepts, procedures, and algorithms are verified using a 6DoF robot with revolute joints. The benefits and challenges of using a standalone XR-supported interactive industrial robot programming system compared to integrated Unity–robotics development frameworks are discussed. [ABSTRACT FROM AUTHOR]

One of the most challenging scenarios for drivers of open-pit mines is driving in dense fog. As a result, drivers cannot see the road, which causes significant vehicle colloidal accidents. To overcome the problem, an intelligent vision enhancement system has been developed by real-time processing and integrating data from the vehicle-to-everything (V2X) module, global navigation satellite system (GNSS), radar, and infrared cameras to enhance the visibility range of the operative road to the driver and mitigate the chances of accidents. Final images after image processing and object detection are displayed using a dashboard screen in front of the driver for adaptive control and safe operation. Performance analysis of the visual computing algorithm has been carried out in a mine based on image quality parameters. Field-tested images' average contrast value, peak signal-to-noise ratio, structural similarity index, visual information fidelity, and universal quality index were 0.87, 19.36, 0.39, 0.82, and 0.56, respectively, and the calculated accurateness of the convolution neural network (CNN)-based object detection model was 90%. These values indicate the output of the image processing algorithm provided better-enhanced images in the foggy condition. With the help of image processing algorithms, the camera view is able to provide a clear vision of more than 30 m in dense fog. Further, using V2X technology, the augmented visibility range has been increased up to 200 m. The 3D augmented reality (AR) view and 2D navigation view provide other surrounding vehicle locations. Untagged objects like rocks or bunds are also detected and displayed using radar. HIGHLIGHTS: The system fuses IR cameras, V2X, GNSS, radar, & visual computing for safe driving Image processing algorithm fuses CLAHE and DCP methods for clear image output CNN-based object detection algorithm integrated with image processing software Provides multi-stage safety using camera, 2D navigation, & 3D virtual reality views Intelligent system inbuilt with software and advanced analytics for fleet management [ABSTRACT FROM AUTHOR]

The state-of-the-art cleaner smart manufacturing process in the metal industry is the direct energy deposition-arc (DED-arc) process, which has emerged as an energy-efficient method for producing complex geometry metallic constructions. Process flexibility, material-consumption efficiency and high performance have drawn attention amongst both academics and industry, as DED-arc presents an ecologically viable alternative to traditional manufacturing techniques. Concurrently, the parallel emergence of extended reality (XR) technology has unveiled multiple novel possibilities for enhancing the sustainable development of DED-arc processing toward cleaner manufacturing. However, an evident knowledge gap exists concerning the integration of XR into the DED-arc process chain. This research aims to solve this problem by systematically exploring the potential of implementing XR technology within the DED-arc framework. Therefore, this study identifies through a literature review the technological difficulties and prospects associated with merging XR and DED-arc. Subsequently, a series of practical experiments are executed, presenting various applications of XR within the DED-arc process chain. The current research makes several noteworthy contributions to the practical understanding of how XR can be integrated into the DED-arc manufacturing process. Technological challenges are discussed, while the potential benefits of XR adoption in the DED-arc process chain are illuminated in practical applications. [ABSTRACT FROM AUTHOR]

Copyright of FME Transactions is the property of University of Belgrade, Faculty of Mechanical Engineering and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Background: For total hip arthroplasty (THA), a new technology in the evolution of computer-assisted surgery has emerged in the form of augmented reality (AR). We sought to determine the impact of AR on resident and fellow education after implementation at an academic teaching center. Materials and Methods: The senior author's intraoperative technique allows for the orthopedic trainee to use AR to correct the acetabular component's position after an attempt is made with standard instrumentation. One year after the implementation of this AR method, both resident and fellow trainees were issued an anonymous survey regarding their experience and descriptive statistics were calculated for the results. Results: Sixteen trainees responded to the survey. One hundred percent felt the use of AR improved their understanding of acetabular component placement and improved their intraoperative experience. Sixty-nine percent reported feeling there was a small increase in operative time but 25% reported no increase in operative time when using AR. Seventy-five percent of trainees felt that patients benefited from the technology and would be in favor of AR if they were having a THA. The majority of those surveyed reported a desire to use AR in their practice if it is available. Conclusion: Computer-assisted surgery has demonstrated variable impacts on orthopedic education. After the implementation of AR at an academic teaching center, all trainees reported it improved their intraoperative experience and their understanding of acetabular component placement. Further studies are needed to determine if AR is able to improve a trainee's component placement. [Orthopedics. 2024;47(4):e157–e160.] [ABSTRACT FROM AUTHOR]

This paper presents the development of a 3D digital model of end-of-service-life buildings to facilitate a step change in preparation of pre-demolition protocols that can eliminate problems of inadequate documentation and extensive time spent in preparing pre-demolition audits. The 3D digital model consists of the following four main components: (i) digitization of paper-based drawings and their conversion to CAD; (ii) automated generation of a 3D digital model from CAD; (iii) corrections to the 3D digital model to account for changes in the lifetime of a building; (iv) a sub-model for performing pre-demolition audit. This paper proposes the innovative approaches of incorporating a minimal amount of human intervention to overcome numerous difficulties in automated drawing analysis, application of augmented reality (AR) in corrections to the 3D digital model, and data compatibility for pre-demolition audit. These processes are demonstrated using one building as case study. Using the digital model, a pre-demolition audit can be prepared in minutes rather than the many days required in current practice without a digital model. The accurate quantification of the quantities and locations of different demolition waste materials and products in buildings to be demolished will enable a systematic and quantitative evaluation of potentials of material and product reuse and eliminate contamination of different demolition waste streams (which may contain hazardous waste), which is the main cause of environmental degradation and downcycling of demolition waste materials. [ABSTRACT FROM AUTHOR]

Compact and high efficiency microdisplays are essential for lightweight augmented reality (AR) glasses to ensure longtime wearing comfort. Liquid-crystal-on-silicon (LCoS) is a promising candidate because of its high-resolution density, high brightness, and low cost. However, its bulky illumination system with a polarizing beam splitter (PBS) cube remains an urgent issue to be overcome. To reduce the volume of the LCoS illumination system, here, we propose a compact structure with four thin PBS cuboids. Through simulations, the optical efficiency of 36.7% for an unpolarized input light can be achieved while maintaining reasonably good spatial uniformity. Such a novel design is expected to have a significant impact on future compact and lightweight AR glasses. [ABSTRACT FROM AUTHOR]

This paper presents a novel method for path selection by non-expert users in robot trajectory planning using augmented reality (AR). While AR has been used in robot control tasks, current approaches often require manual waypoint specification, limiting their effectiveness for non-expert users. In contrast, our study introduces an innovative AR-based method via a head-mounted display, designed to enhance human-robot interaction by making the process of selecting robotic paths more accessible to users without specialized expertise. The proposed method utilizes the RRT-Connect algorithm to automatically generate pathways from the initial to the goal position, offering choices of 1, 3, or 5 pathways, as well as 3 and 5 pathways with AR text guidance. This guidance provides contextual instructions within the AR environment, displaying the order of pathways from the fewest to the highest number of waypoints. Our findings demonstrate that optimizing the number of AR pathways can reduce user stress and improve operational skills. Path1 exhibited the fastest performance time but had the highest number of obstacle collisions. Methods with AR text guidance showed increased performance time compared to Path1. However, Path3 and Path5 achieved the best balance between performance time and collision avoidance. Qualitative analysis indicated that AR text displays demanded more effort from users. Path3 without AR text guidance was identified as the easiest method for operating the robot. Consequently, Path3 was deemed the most beneficial among the five methods. These results highlight the novelty of our method in enhancing the design of future human-robot interaction systems, focusing on improving efficiency, safety, and user experience for non-expert users using AR interfaces. [ABSTRACT FROM AUTHOR]

Augmented reality (AR) improves science education by facilitating teaching and experiments in schools and universities. Studies show positive effects, like increased motivation and improved concept connections, but there is a lack of consistency in the implementation and investigation of AR in science experiments. This review examines AR usage, criteria, design parameters for the development of AR applications and the validation methods, taking into account the PRISMA guidelines. A Web of Science database search using "Publish or Perish" software (version 23.4.0) identified 247 potentially relevant articles from 2000 to March 2024 in international, peer-reviewed journals. After removing duplicates, inaccessible abstracts, and applying inclusion and exclusion criteria, 40 studies were selected for in-depth analysis. Physics had the most AR applications, primarily for visualizing invisible properties. Most studies used quantitative or qualitative methods, only a few used both or did not conduct empirical research. Research questions varied, but common drawbacks included small sample sizes and low use of AR design parameters such as interactivity, adaptivity, realistic representation and use of game elements. This review identifies opportunities for improvement in the implementation and investigation of AR in science education experiments and emphasizes consistent and rigorous approaches to fully exploit the benefits of AR in science education. [ABSTRACT FROM AUTHOR]

In this study, we report on a case study of two Swedish preschool teachers' first experiences of teaching sustainable development goals through the innovative use of augmented reality. Their statements about thematic work, children's agency, teachers' perspective, and augmented reality were analysed qualitatively through a theoretical framework based on transduction and place. The innovative use of augmented reality related to the importance of children's agency in their exploration of local places associated with sustainable development goals is elaborated on, especially with the value of treating augmented reality as a 'what', or content, in teaching before it can be used as a 'how', or tool, for teaching sustainable development. It is seen in this exploratory study that transducing meaning between different representations such as physical places and the sustainable development goals in augmented reality applications opens up fruitful discussions regarding, for example, democracy aspects and source criticism between children and preschool teachers. Results indicate that the introduction of augmented reality technology is also worth pursuing in early-year teaching. [ABSTRACT FROM AUTHOR]

The construction industry is undergoing a digital transformation, with the digital twin serving as a core system for project information. This digital twin provides an opportunity to utilize AR technology for real-time verification of on-site project information. Although many AR developments for construction sites have been attempted, they have been limited to accessing information on stationary components via Building Information Models. There have been no attempts to access information on dynamically changing resources, such as personnel and equipment. This paper addresses this gap by presenting an AR framework that enables site managers to verify real-time information on specific personnel or equipment. It introduces a matching algorithm for retrieving the necessary information from the digital twin. This algorithm is pivotal in identifying and retrieving the specific information needed from the vast dataset within the digital twin. The matching process integrates object detection and tracking algorithms applied to video frames from AR devices, along with GPS and IMU sensor data. Experimental results demonstrate the potential of this matching algorithm to streamline on-site management and reduce the effort required to interact with digital twin information. This paper highlights the transformative potential of AR and digital twin technologies in revolutionizing construction site operations. [ABSTRACT FROM AUTHOR]

Featured Application: Shopee, SmartPLS 3. With the rapid growth of Augmented Reality (AR) in e-commerce, it is necessary to conduct in-depth studies related to the integration of AR with Artificial Intelligence (AI) technology to improve personalization in product recommendations. AI and AR are expected to work together, where AI systems analyze consumer data to provide more suitable product recommendations, while AR helps consumers visualize these recommendations in the real world. This research explores the influence of AI and AR technology integration in personalized recommendations on customer usage intention, with a focus on the cosmetics industry on the e-commerce platform Shopee. Adopting the Technology Acceptance Model (TAM) and the Theory of Planned Behavior (TPB), this research uses quantitative methods with the try-on feature of cosmetic products as the main focus. With a total number of 387 respondents, the results of the PLS-SEM analysis revealed factors impacting the intention to use, such as perceived ease of use, perceived usefulness, and users' perceived trust, on the intention to use personalized recommendations. This research contributes to the understanding of AI–AR technology acceptance in the context of online shopping, particularly in the cosmetics sector. [ABSTRACT FROM AUTHOR]

This article reveals the theoretical and practical issues of using virtual reality technologies in the field of providing tourist services. The position is argued that innovative technologies, which are currently involved in all aspects of our lives, whether it is a commercial sphere or a service sphere, have not bypassed the tourism industry. Such technological development has become very effective in the national economy of any country in the world, as new technologies can overcome obstacles related to space and time barriers, pandemic outbreaks, etc. In the scientific literature, virtual tourism has become a rather promising phenomenon for the research of lawyers, marketers, sociologists and psychologists. The peculiarities of the application of virtual reality technologies in the tourism field have been the subject of research by many foreign scientists for several years. The largest number of publications on this issue is in Asian countries, in particular China and Indonesia, where the tourism sector has been most affected due to the outbreak of the COVID-19 pandemic and travel restrictions. Their experimental studies reveal the main positive and negative aspects of the use of virtual reality technologies in the tourism sector. Within the framework of our research, attention is paid to the specifics of the application of certain types of virtual and augmented reality technologies in the field of providing tourist services. In particular, we characterized tourism using the system of immersive virtual reality technologies, photorealistic 360-degree virtual tours, travel blogs, live broadcasts. Although this is not an exclusive list, virtual tourism can be supplemented with technologies of augmented reality, panoramic online tour, 3D photos, videos, etc. It was found that the application of virtual reality technologies in tourism is indispensable for the creation of a new travel industry. It can enable users to visualize a virtual world by responding to visual, moving and audio cues, creating a sense of presence without having to leave their home or comfort zone. [ABSTRACT FROM AUTHOR]

In response to the evolving landscape of maritime operations, new technologies are on the horizon as mixed reality (MR), which shall enhance navigation safety and efficiency during remote assistance as, e.g., in the remote pilotage use case. However, up to now, it is uncertain if this technology can provide benefits in terms of usability and situational awareness (SA) compared with screen-based visualizations, which are established in maritime navigation. Thus, this paper initially tests and assesses novel approaches to pilotage in the congested maritime environment, which integrates augmented reality (AR) for ship captains and virtual reality (VR) and desktop applications for pilots. The tested prototype employs AR glasses, notably the Hololens 2, to superimpose the Automatic Identification System (AIS) data directly into the captain's field of view, while pilots on land receive identical information alongside live 360-degree video feeds from cameras installed on the ship. Additional minimum functionalities include waypoint setting, bearing indicators, and voice communication. The efficiency and usability of these technologies are evaluated through in situ tests conducted with experienced pilots on a real ship using the System Usability Scale, the Situational Awareness Rating Technique, as well as Simulator Sickness Questionnaires during the assessment. This includes a first indicative comparison of VR and desktop applications for the given use case. [ABSTRACT FROM AUTHOR]

The Metaverse presents itself as the next evolutionary paradigm of the Internet, based on the integration of the physical world with a plurality of virtual worlds so as to enable immersive, continuous and consistent life experiences for subjects across environments. Underlying this, there is a massive datafication of habitats and people that are reproduced and supplemented by digital content based on augmentation and virtualization of reality to allow users fluid social, economic and (soon) legal presence and operability. A decisive part of optimizing the control of environments and the avatars themselves is the datafication of personal, physical and behavioral aspects suitable to serve a plurality of functions: authentication, identification, but also management of the specific physicality required by the immersiveness of experiences. Massive biometric datafication is thus placed at the center of the entire project, raising doubts as to its compatibility with the fundamental principle of personal dignity. [ABSTRACT FROM AUTHOR]

Emotion recognition is an immense challenge for immersive technology. In order to detect the emotions of the user, we use machine learning methods and techniques to use the potential of the Virtual Environment and to improve the userExperience. Emotion recognition plays an important role in developing realistic and emotionally immersive experiences in augmented reality (AR) and virtual reality (VR) settings by instantly adjusting interactions, content, and visuals based on the accurate detection and interpretation of users' emotions. Immersive systems can enhance user experience through various machine learning algorithms and methods used for emotion recognition, which are examined in this article. Upon novel idea, challenges and potential applications of incorporating emotion recognition in immersive virtual environments with Machine Learning (ML) Techniques and thebenefits of tailoring powerful immersive experiences with ML methods were highlighted, and also the study discusses potential advancements in identifying the user's emotion recognition in the future by modeling an Architecture, as well as how the ML techniques were enhanced for virtual environment is discussed. [ABSTRACT FROM AUTHOR]

Estimating depth from 2D images is vital in various applications, such as object recognition, scene reconstruction, and navigation. It offers significant advantages in augmented reality, image refocusing, and segmentation. In this paper, we propose an optimized U-net network based on a transfer learning encoder and advanced decoder structures to estimate depth on a single 2D image. The encoder--decoder architecture is built from ResNet152v2 as the encoder and an improved U-Net-based decoder to achieve accurate depth predictions. The introduced ResNet152v2 network had been pretrained on the extensive ImageNet dataset, which possesses weights to extract rich and generalizable features for large-scale image classification. This proposed encoder can have prior knowledge to reduce training time and improve object position recognition. The proposed composite up-sampling block (CUB) designed in the decoder applied the 2x and 4x bilinear interpolation combined with the one-stride transpose convolution to expand the low-resolution feature maps obtained from the encoder, enabling the network to recover finer details. The skip connections are used to enhance the representation power of the decoder. The output of each up-sampling block is concatenated with the corresponding pooling layer. This fusion of features from different scales helps capture local and global context information, contributing to more accurate depth predictions. This method utilizes RGB images and depth maps as training inputs from the NYU Depth Dataset V2. The experimental results demonstrate that the transfer learning-based encoder, coupled with our proposed decoder and data augmentation techniques, enables the transformation of complex RGB images into accurate depth maps. The system accurately classifies different depth ranges based on depth data ranging from 0.4 to 10 m. By mapping different depths to corresponding colors using gradational color scales, precise depth classification can be performed on the 2D images. [ABSTRACT FROM AUTHOR]

Recently, advancements in digital twin and extended reality (XR) technologies, along with industrial control systems (ICSs), have driven the transition to Industry 5.0. Digital twins mimic and simulate real-world systems and play a crucial role in various industries. XR provides innovative user experiences through virtual reality (VR), augmented reality (AR), and mixed reality (MR). By integrating digital twin simulations into XR devices, these technologies are utilized in various industrial fields. However, the prevalence of XR devices has increased the exposure to cybersecurity threats in ICS and digital twin environments. Because XR devices are connected to networks, the control and production data they process are at risk of being exposed to cyberattackers. Attackers can infiltrate XR devices through malicious code or hacking attacks to take control of the ICS or digital twin or paralyze the system. Therefore, this study emphasizes the cybersecurity threats in the ecosystem of XR devices used in ICSs and conducts research based on digital forensics. It identifies potentially sensitive data and artifacts in XR devices and proposes secure and reliable security response measures in the Industry 5.0 environment. [ABSTRACT FROM AUTHOR]

This paper presents an innovative use case of virtual reality (VR) for career development and exploration, within the context of the CareProfSys recommendation system for professions. The recommender users receive recommendations not only in textual format but as WebVR gamified scenarios as well, having thus the possibility to try activities specific to the suggested professions and decide whether they are suitable for them or not. This paper describes, from a functional and technical point of view, scenarios for six different jobs: computer network specialists, civil engineers, web and multimedia developers, chemical engineers, project managers, and university professors. Extended experiments were performed, using an internal protocol, with 47 students enrolled in engineering studies. The results of the experiments were measured with the aid of four instruments: two questionnaires, one unstructured interview, and the VR simulation performance recording module. Positive results were obtained: the users admitted that such a tool was useful when choosing one's career and that it was entertaining. Most of the students considered the VR scenarios as learning or testing experiences, too. Thus, we claim that a VR form of providing job recommendations is more appealing to young people and brings value to career development initiatives. [ABSTRACT FROM AUTHOR]

The portrayal of emotions by virtual characters is crucial in virtual reality (VR) communication. Effective communication in VR relies on a shared understanding, which is significantly enhanced when virtual characters authentically express emotions that align with their spoken words. While human emotions are often conveyed through facial expressions, existing facial animation techniques have mainly focused on lip-syncing and head movements to improve naturalness. This study investigates the influence of various factors in facial animation on the emotional representation of virtual characters. We conduct a comparative and analytical study using an audio-visual database, examining the impact of different animation factors. To this end, we utilize a total of 24 voice samples, representing 12 different speakers, with each emotional voice segment lasting approximately 4–5 s. Using these samples, we design six perceptual experiments to investigate the impact of facial cues—including facial expression, lip movement, head motion, and overall appearance—on the expression of emotions by virtual characters. Additionally, we engaged 20 participants to evaluate and select appropriate combinations of facial expressions, lip movements, head motions, and appearances that align with the given emotion and its intensity. Our findings indicate that emotional representation in virtual characters is closely linked to facial expressions, head movements, and overall appearance. Conversely, lip-syncing, which has been a primary focus in prior studies, seems less critical for conveying emotions, as its accuracy is difficult to perceive with the naked eye. The results of our study can significantly benefit the VR community by aiding in the development of virtual characters capable of expressing a diverse range of emotions. [ABSTRACT FROM AUTHOR]

In a rapidly evolving digital landscape, the Metaverse emerges as a transformative force, integrating augmented reality, virtual reality, and the internet, to redefine online interactions. This collective virtual shared space promises to revolutionise global collaboration, communication, and information engagement. Our study consisted of the application, through an online form builder, of a questionnaire to Portuguese adult gamers, analysing the results with descriptive statistics. Our research question was the following: how is the Metaverse perceived and represented by gamers? In this context, we trace four objectives: (1) verify the representations of the Metaverse; (2) verify the representations of immersion; (3) verify the representations of the multiverse; and (4) verify the importance of these concepts in daily reality. Our findings explored the Metaverse, immersion, and multiverse concepts, uncovering gamers' perceptions with emphasis on animation, gaming, and virtual worlds as foundational elements. The Metaverse arises as an evolving force that bridges emotional experiences, offering limitless possibilities for experimentation and exploration. [ABSTRACT FROM AUTHOR]

The integration of material attribute estimation (MAE) within augmented reality, virtual reality, and mixed reality telecommunication systems stands as a pivotal domain, evolving rapidly with the advent of the Tactile Internet. This unifying implementation process has the potential for improvements in the realism and interactivity of immersive environments. The interaction between MAE and the haptic Internet could lead to significant advances in haptic feedback systems, enabling more accurate and responsive user experiences. This systematic review is focused on the intersection of MAE and the Tactile Internet, aiming to find an implementation path between these technologies. Motivated by the potential of the haptic Internet to advance telecommunications, we explore its potential to advance the analysis of material attributes within AR, VR, and MR applications. Through an extensive analysis of current research approaches, including machine learning methods, we explore the possibilities of integrating the TI into MAE. By exploiting haptic and visual properties stored in the materials of 3D objects and using them directly during rendering in remote access scenarios, we propose a conceptual framework that combines data capture, visual representation, processing, and communication in virtual environments. [ABSTRACT FROM AUTHOR]