Search

Some of the barriers preventing virtual reality (VR) from being widely adopted are the cost and unfamiliarity of VR systems. Here, we propose that in many cases, the specialized controllers shipped with most VR head-mounted displays can be replaced by a regular smartphone, cutting the cost of the system, and allowing users to interact in VR using a device they are already familiar with. To achieve this, we developed SmartVR Pointer, an approach that uses smartphones to replace the specialized controllers for two essential operations in VR: selection and navigation by teleporting. In SmartVR Pointer, a camera mounted on the head-mounted display (HMD) is tilted downwards so that it points to where the user will naturally be holding their phone in front of them. SmartVR Pointer supports three selection modalities: tracker based, gaze based, and combined/hybrid. In the tracker-based SmartVR Pointer selection, we use image-based tracking to track a QR code displayed on the phone screen and then map the phone's position to a pointer shown within the field of view of the camera in the virtual environment. In the gaze-based selection modality, the user controls the pointer using their gaze and taps on the phone for selection. The combined technique is a hybrid between gaze-based interaction in VR and tracker-based Augmented Reality. It allows the user to control a VR pointer that looks and behaves like a mouse pointer by moving their smartphone to select objects within the virtual environment, and to interact with the selected objects using the smartphone's touch screen. The touchscreen is used for selection and dragging. The SmartVR Pointer is simple and requires no calibration and no complex hardware assembly or disassembly. We demonstrate successful interactive applications of SmartVR Pointer in a VR environment with a demo where the user navigates in the virtual environment using teleportation points on the floor and then solves a Tetris-style key-and-lock challenge. [ABSTRACT FROM AUTHOR]

The popularity of mixed reality (MR) technologies, including virtual (VR) and augmented (AR) reality, have advanced many training and skill development applications. If successful, these technologies could be valuable for high-impact professional training, like medical operations or sports, where the physical resources could be limited or inaccessible. Despite MR's potential, it is still unclear whether repeatedly performing a task in MR would affect performance in the same or related tasks in the physical environment. To investigate this issue, participants executed a series of visually-guided manual pointing movements in the physical world before and after spending one hour in VR or AR performing similar movements. Results showed that, due to the MR headsets' intrinsic perceptual geometry, movements executed in VR were shorter and movements executed in AR were longer than the veridical Euclidean distance. Crucially, the sensorimotor bias in MR conditions also manifested in the subsequent post-test pointing task; participants transferring from VR initially undershoot whereas those from AR overshoot the target in the physical environment. These findings call for careful consideration of MR-based training because the exposure to MR may perturb the sensorimotor processes in the physical environment and negatively impact performance accuracy and transfer of training from MR to UR. [ABSTRACT FROM AUTHOR]

Simple Summary: As breast cancer rates rise, more patients choose breast reconstruction. Autologous breast reconstruction (ABR) may be more cost-effective and offer superior patient quality of life compared to prosthetic implant-based reconstruction but it involves heightened surgical complexity and extended operative time. Imaging facilitates surgical planning, patient selection, and reduces the time spent in the operating room, thereby enhancing the likelihood of surgical success and decreasing complication rates. Advanced imaging has also spurred innovative surgical techniques aimed at improving aesthetic outcomes and minimizing donor-site morbidity, including robotic-assisted deep inferior epigastric flap perforator (DIEP) flap harvest and stacked microsurgical flaps. The evolution of imaging actively shapes clinical management in the field. Ultrasonography (US), computed tomography angiography (CTA), and magnetic resonance angiography (MRA) stand out as the most extensively researched imaging modalities for ABR. Ongoing advancements include "real-time" angiography and three-dimensional (3D) surface imaging, and future prospects incorporate augmented or virtual reality (AR/VR) and artificial intelligence (AI). These technologies may further enhance perioperative efficiency, reduce donor-site morbidity, and improve surgical outcomes in ABR. [ABSTRACT FROM AUTHOR]

Assembly simulation and evaluation have become an effective means to analyze product assembly design and assembly plan. Compared with the widely used digital assembly simulation method, the AR-based human-in-the-loop assembly simulation and evaluation method can discover and solve the problems related to the human factors, which is very important for manual assembly. This paper proposes an AR-based human-in-the-loop manual assembly evaluation with high-fidelity assembly simulation method. By proposing the natural human assembly gesture intention recognition method and the virtual assembling parts motion simulation method based on the dual geometric and physical constraints, the AR-based human-in-the-loop manual assembly simulation is realized to provided natural assembly simulation experience and generate realistic assembly simulation process data. In addition, the assembly evaluation methods are integrated to objectively evaluate the performance and operation difficulty of manual assembly process, which comprehensively capture and utilize the human-in-the-loop assembly simulation data including the assembly hand actions, assembly visibility, and assembly time. Finally, the prototype system was developed based on the proposed method and verified in an assembly case by a set of experiments. The results illustrate that the assembly simulation is high fidelity and the assembly evaluation more comprehensively by using the proposed method, realizing a high consistence between virtual and real assembly process validation. This study provides a practical methodology for the manual assembly simulation and evaluation through human-in-the-loop in the AR environment. [ABSTRACT FROM AUTHOR]

Geometry is considered a fundamental component to be mastered in the elementary school mathematics curriculum. Lower primary school pupils frequently experience obstacles because of the abstract nature of geometric concepts and the requirement for spatial visualization skills, which are necessary for strengthening their conceptual understanding. Augmented reality (AR) technology offers a promising solution by providing visual representations of geometric shapes. Thus, this study aimed to investigate the effects of AR technology in primary school education on pupils’ spatial visualization abilities in geometry. Employing a quasiexperimental pre- and post-test research design, this study involved 61 second-grade pupils from two Northern Malaysian primary schools. The selection of schools followed cluster sampling techniques, while intact groups were utilized to select samples. Data were collected from two groups: an experimental group that utilized the LearnGeoAR applications and a control group that employed conventional teaching methods to learn geometric shapes. This study used the spatial visualization ability test (SVAT) instrument, grounded in Van Hiele’s theory of geometric thinking. The findings revealed that the experimental group, which utilized AR applications, exhibited a higher mean score in pupils’ spatial visualization ability in geometry compared to the control group. Additionally, the experiment demonstrated a moderate effect on both groups. This finding highlights the potential of AR technology in enhancing pupils’ spatial visualization skills in geometry instruction, providing valuable insights for instructional methodologies. [ABSTRACT FROM AUTHOR]

Achieving optimal patient safety (PS) remains a challenge in healthcare. Effective educational methods are critical for improving PS. Innovative teaching tools, like case-based learning, augmented reality, and active learning, can help students better understand and apply PS and healthcare quality improvement (HQI) principles. This study aimed to assess activities and tools implemented to improve PS and HQI education, as well as student engagement, in medical schools. We designed a two-week course for fourth-year medical students at the Autonomous University of Guadalajara, incorporating Fink's taxonomy of significant learning to create engaging activities. The course featured daily synchronous and asynchronous learning, with reinforcement activities using tools, like augmented reality and artificial intelligence. A total of 394 students participated, with their performance in activities and final exam outcomes analyzed using non-parametric tests. Students who passed the final exam scored higher in activities focused on application and reasoning (p = 0.02 and p = 0.018, respectively). Activity 7B, involving problem-solving and decision-making, was perceived as the most impactful. Activity 8A, a case-based learning exercise on incident reporting, received the highest score for perception of exam preparation. This study demonstrates innovative teaching methods and technology to enhance student understanding of PS and HQI, contributing to improved care quality and patient safety. Further research on the long-term impact is needed. [ABSTRACT FROM AUTHOR]

Tourism is an excellent pathway with which to promote and provide access to cultural heritage. Sustainable cultural tourism offers a new perspective, as it places cultural heritage and local communities at the centre of decision-making processes. In this context, traditional tourism must be updated accordingly to the new times. This research aims to classify a cultural heritage piece found in the ruins of what used to be the Castle of Montilla, and produce a 3D virtual model using innovative technologies, to be appreciated in the metaverse, as a virtual museum. The idea of tourism as a real movement of people should be shifted little by little to an idea of connection without the need of being there exactly. This research succeeded with this idea. A 'perfume burner', catalogued as a lamp, and currently located in the medieval section of the Local Historical Museum of Montilla (Cordoba, Spain), was virtually reconstructed. In the attainment of these physical subjects transferred to the metaverse, photogrammetry played a crucial role. Obtaining a 3D digital model of a heritage asset enables the public in general, present and non-present visitors, to appreciate such cultural pieces. In this context, tourist agents and resources might be changed and updated to bring tourist services and clients. The metaverse is paramount in creating virtual museums, providing the possibility of establishing connections with people without the need to be physically in a certain place. The virtual museum leverages digital technology to promote sustainability by reducing travels and minimising the environmental impact. To date, this research enhances the experiences of the users at the local museum. [ABSTRACT FROM AUTHOR]

Gesture recognition is crucial in computer vision-based applications, such as drone control, gaming, virtual and augmented reality (VR/AR), and security, especially in human–computer interaction (HCI)-based systems. There are two types of gesture recognition systems, i.e., static and dynamic. However, our focus in this paper is on dynamic gesture recognition. In dynamic hand gesture recognition systems, the sequences of frames, i.e., temporal data, pose significant processing challenges and reduce efficiency compared to static gestures. These data become multi-dimensional compared to static images because spatial and temporal data are being processed, which demands complex deep learning (DL) models with increased computational costs. This article presents a novel triple-layer algorithm that efficiently reduces the 3D feature map into 1D row vectors and enhances the overall performance. First, we process the individual images in a given sequence using the MediaPipe framework and extract the regions of interest (ROI). The processed cropped image is then passed to the Inception-v3 for the 2D feature extractor. Finally, a long short-term memory (LSTM) network is used as a temporal feature extractor and classifier. Our proposed method achieves an average accuracy of more than 89.7%. The experimental results also show that the proposed framework outperforms existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Introduction: Augmented reality (AR) has been increasingly studied in transportation, particularly for drivers and pedestrians interacting with automated vehicles (AVs). Previous research evaluated AR interfaces using online video-based questionnaires but lacked human-subject research in immersive environments. This study examined if prior online evaluations of nine AR interfaces could be replicated in an immersive virtual environment and if AR interface effectiveness depends on pedestrian attention allocation. Methods: Thirty participants completed 120 trials in a CAVE-based simulator with yielding and non-yielding AVs, rating the interface's intuitiveness and crossing the road when they felt safe. To emulate visual distraction, participants had to look into an attention-attractor circle that disappeared 1 s after the interface appeared. Results: The results showed that intuitiveness ratings from the current CAVEbased study and the previous online study correlated strongly (r = 0.90). Headlocked interfaces and familiar designs (augmented traffic lights, zebra crossing) yielded higher intuitiveness ratings and quicker crossing initiations than vehiclelocked interfaces. Vehicle-locked interfaces were less effective when the attention-attractor was on the environment's opposite side, while headlocked interfaces were relatively unaffected by attention-attractor position. Discussion: In conclusion, this 'AR in VR' study shows strong congruence between intuitiveness ratings in a CAVE-based study and online research, and demonstrates the importance of interface placement in relation to user gaze direction. [ABSTRACT FROM AUTHOR]

This paper addresses the problem of 6D pose tracking of plane segments from point clouds acquired from a mobile camera. This is motivated by manual packing operations, where an opportunity exists to enhance performance, aiding operators with instructions based on augmented reality. The approach uses as input point clouds, by its advantages for extracting geometric information relevant to estimating the 6D pose of rigid objects. The proposed algorithm begins with a RANSAC fitting stage on the raw point cloud. It then implements strategies to compute the 2D size and 6D pose of plane segments from geometric analysis of the fitted point cloud. Redundant detections are combined using a new quality factor that predicts point cloud mapping density and allows the selection of the most accurate detection. The algorithm is designed for dynamic scenes, employing a novel particle concept in the point cloud space to track detections' validity over time. A variant of the algorithm uses box size priors (available in most packing operations) to filter out irrelevant detections. The impact of this prior knowledge is evaluated through an experimental design that compares the performance of a plane segment tracking system, considering variations in the tracking algorithm and camera speed (onboard the packing operator). The tracking algorithm varies at two levels: algorithm ( A wpk ), which integrates prior knowledge of box sizes, and algorithm ( A woutpk ), which assumes ignorance of box properties. Camera speed is evaluated at low and high speeds. Results indicate increments in the precision and F1-score associated with using the A wpk algorithm and consistent performance across both velocities. These results confirm the enhancement of the performance of a tracking system in a real-life and complex scenario by including previous knowledge of the elements in the scene. The proposed algorithm is limited to tracking plane segments of boxes fully supported on surfaces parallel to the ground plane and not stacked. Future works are proposed to include strategies to resolve this limitation. [ABSTRACT FROM AUTHOR]

Chemistry as a whole is divided into three levels. The macroscopic level describes real, observable phenomena of the material world. The submicroscopic level focuses on particles. The representative level includes pictorial and symbolic representations to visualize substance in its nature. Students often have problems separating these levels and conceptually transfer each of the three levels to the other. Therefore, teachers need to use chemical terminology correctly when teaching the substance-particle concept. Augmented Reality (AR) connects real and virtual world. The observer physically moves in a real environment that integrates virtual elements. The AR technology has great potential for learning in the subject chemistry, especially when it comes to making the "invisible" visible and illustrating scientific phenomena at particle level. The simultaneous presentation should avoid split-attention and offers new possibilities to interactively deal with (M)ER. The question arises whether AR has a positive effect on the use of technical language and the associated understanding of the concept of dealing with (M)ER at the substance and particle levels. With an AR app on the tablet and the AR glasses, the chemical processes of a real experiment are represented by AR visualizations. Therefore, the AR app was piloted. This study captured the chemistry handling with (M)ER of chemistry teachers (N = 30) using a pre-post survey. The participating preservice teachers are described below. Each test includes five tasks elaborated by thinking aloud. The thinking-aloud protocols to acquire the use of the chemical terminology are evaluated in MAXQDA. [ABSTRACT FROM AUTHOR]

In the global context, advancements in technology and science have rendered virtual, augmented, and mixed-reality technologies capable of transforming clinical care and medical environments by offering enhanced features and improved healthcare services. This paper aims to present a mixed reality-based system to control a robotic wheelchair for people with limited mobility. The test group comprised 11 healthy subjects (six male, five female, mean age 35.2 ± 11.7 years). A novel platform that integrates a smart wheelchair and an eye-tracking-enabled head-mounted display was proposed to reduce the cognitive requirements needed for wheelchair movement and control. The approach's effectiveness was demonstrated by evaluating our system in realistic scenarios. The demonstration of the proposed AR head-mounted display user interface for controlling a smart wheelchair and the results provided in this paper could highlight the potential of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as remote control, cognitive rehabilitation, the implementation of patient autonomy with severe disabilities, and telemedicine. [ABSTRACT FROM AUTHOR]

This review explores the transformative applications of augmented reality (AR) and mixed reality (MR) technologies in interventional cardiology. The integration of these cutting-edge systems offers unprecedented potential to enhance visualization, guidance, and outcomes during complex cardiac interventional procedures. This review examines four key domains: (1) medical AR/MR systems and technological foundations; (2) clinical applications across procedures like TAVI, PCI, and electrophysiology mapping; (3) ongoing technology development and validation efforts; and (4) educational and training applications for fostering essential skills. By providing an in-depth analysis of the benefits, challenges, and future directions, this work elucidates the paradigm shift catalyzed by AR and MR in advancing interventional cardiology practices. Through meticulous exploration of technological, clinical, and educational implications, this review underscores the pivotal role of these innovative technologies in optimizing procedural guidance, improving patient outcomes, and driving innovation in cardiovascular care. [ABSTRACT FROM AUTHOR]

The advent and progression of AR (augmented reality) technology, coupled with the emergence of AR hearing aid glasses, offer a novel opportunity for people with hearing impairments (PHI). This study aims to explore the intention of this population to employ AR hearing aid glasses as their choice of hearing aid device and the specific factors influencing their preference. This study utilized the partial least squares SEM (PLS-SEM) analytical method to create structural equation model for intentions of PHI to use AR glasses as hearing aids. Data were gathered from on-site experiences across multiple locations; a total of 189 valid questionnaires from individuals with varying degrees of hearing disabilities were used for statistical analysis. According to the data analysis results, we discovered that functionality quality, perceived interaction speed, and perceived usability significantly influence communication effectiveness. Further, communication effectiveness positively influences confidence and societal perception, and the latter has a positive impact on information. Both of these factors positively influence behavioral intention. Based on these findings, this study offers design recommendations for AR hearing aid glasses to cater to the specific needs of PHI, aiming to enhance their quality of life. Furthermore, this study provides pivotal insights for the prospective growth of this emerging industry. [ABSTRACT FROM AUTHOR]

This study introduces an innovative surgical approach for total knee arthroplasty (TKA) that combines kinematic alignment (KA) principles with real-time elongation of the knee ligaments through the range of motion, using augmented reality (AR). The novelty of the surgical technique lies in the possibility of enhancing the decision-making process to perform the cut on the tibia as for the KA caliper technique developed by Dr. Stephen Howell. The NextAR is a CT-based AR system that offers the possibility of performing three-dimensional surgical preoperative planning and an accurate execution in the surgical room through single-use infrared sensors, smart glasses, and a control unit. During the preoperative planning, the soft tissue is not considered and only the alignment based on bony reference is ensured. Thanks to the possibility of measuring in real time the elongation of the knee collateral lateral ligaments, the system assists the surgeon in optimizing the cut on the tibia after an accurate resurfacing of the femur as described in the KA surgical technique. The implant used in this novel approach is a medial pivot design (Medacta GMK Sphere) that allows the restoration of the physiological behavior of the software tissue and natural knee kinematics. In conclusion, this novel technique offers a promising approach to TKA, allowing personalized treatment tailored to each patient's unique anatomy and soft tissue characteristics. The integration of KA and real-time soft tissue analysis provided by NextAR enhances surgical precision and outcomes, potentially improving patient satisfaction and functional results. [ABSTRACT FROM AUTHOR]

Surgical education demands extensive knowledge and skill acquisition within limited time frames, often limited by reduced training opportunities and high-pressure environments. This review evaluates the effectiveness of extended reality-based head-mounted display (ExR-HMD) technology in surgical education, examining its impact on educational outcomes and exploring its strengths and limitations. Data from PubMed, Cochrane Library, Web of Science, ScienceDirect, Scopus, ACM Digital Library, IEEE Xplore, WorldCat, and Google Scholar (Year: 2014–2024) were synthesized. After screening, 32 studies comparing ExR-HMD and traditional surgical training methods for medical students or residents were identified. Quality and bias were assessed using the Medical Education Research Study Quality Instrument, Newcastle–Ottawa Scale-Education, and Cochrane Risk of Bias Tools. Results indicate that ExR-HMD offers benefits such as increased immersion, spatial awareness, and interaction and supports motor skill acquisition theory and constructivist educational theories. However, challenges such as system fidelity, operational inconvenience, and physical discomfort were noted. Nearly half the studies reported outcomes comparable or superior to traditional methods, emphasizing the importance of social interaction. Limitations include study heterogeneity and English-only publications. ExR-HMD shows promise but needs educational theory integration and social interaction. Future research should address technical and economic barriers to global accessibility. [ABSTRACT FROM AUTHOR]

Objective: This experiment examined performance costs when processing two sources of information positioned at increasing distances using a flat panel display and an augmented reality head-mounted display (AR-HMD). Background: The AR-HMD enables positioning virtual information at various distances in space. However, the proximity compatibility principle suggests that closer separation when two sources of information require mental integration assists performance, whereas increased separation between two sources hurts integration performance more than when a single source requires focused attention. Previous studies have provided inconsistent findings regarding costs associated with increased separation. Few of these experiments have examined separation for both focused and integration tasks, compared vertical and lateral separation, or measured head movements. Method: Three experiments collectively examined these issues using a flat panel display and a virtual display presented with an HMD, where the separation of information varied laterally or vertically during a focused attention (digit reading) task and an information integration (mental subtraction) task. Results: There was no performance cost for either display when information was increasingly separated. However, head movements mitigated performance costs by preserving accuracy at larger separations without increasing response time. Conclusion: Head movements appear to mitigate performance costs associated with presenting information increasingly far apart on flat panel displays and HMDs. Both eye scanning and head movements appear to be less effortful than expected. Application: These findings have important implications for design guidelines regarding the placement of information presented on flat panel displays and, more specifically, HMDs, which can present information 360° around the user. [ABSTRACT FROM AUTHOR]

Augmented reality (AR) can benefit manual assembly operations by superimposing intuitive visual guidance on the workbench directly, alleviating the mental load to determine the next operation while improving assembly performance. Where the bare-hand gesture interface is considered a promising manner to manipulate the virtual assembly model, nevertheless, it usually suffers from unreliable recognition results and poor adaptability due to the unfamiliarity with gesture libraries in actual AR assembly tasks. In this paper, we try to establish a robust and easy-to-use natural bare-hand interactive AR assembly system, enabling the operator to interact against the ongoing virtual assembly models intuitively and resulting in a human-centric AR assembly performance. Firstly, a normalized feature information extraction for real-time bare-hand gestures is presented, which can establish a robust gesture model expression when encountering different sensing distances and varying operators. Followed by the definition of some typical bare-hand interaction functions related to manual assembly operations, and thus reliable interactions between hand gestures and virtual components are available. Then, a bare-hand-enabled interactive AR assembly system is established, where operators can explore and manipulate a large amount of assembly-related information with the help of real-time bare-hand interaction. Finally, extensive experiments are carried out to evaluate the proposed bare-hand interactive AR assembly system, and results demonstrate that it can alleviate the cognitive load for the operators while providing a human-centric assembly performance. [ABSTRACT FROM AUTHOR]

People with disorders of consciousness, either as a consequence of an acquired brain injury or a traumatic brain injury, may pose serious challenges to medical and/or rehabilitative centers with an increased burden on caregivers and families. The objectives of this study were as follows: to explore the use of extended reality as a critical means of rehabilitative support in people with disorders of consciousness and brain injuries; to evaluate its impact on recovery processes; to assess the improvements in the participants' quality of life, and to reduce the burden on families and caregivers by using extended reality and artificial-intelligence-based programs. A selective review of the newest empirical studies on the use of extended reality and artificial-intelligence-based interventions in patients with brain injuries and disorders of consciousness was conducted over the last decade. The potential for bias in this selective review is acknowledged. A conceptual framework was detailed. The data showed that extended reality and artificial-intelligence-based programs successfully enhanced the adaptive responding of the participants involved, and improved their quality of life. The burden on caregivers and families was reduced accordingly. Extended reality and artificial intelligence may be viewed as crucial means of recovery in people with disorders of consciousness and brain injuries. [ABSTRACT FROM AUTHOR]

This article explores the implementation of Augmented Reality (AR) in retail, focusing on the furniture sector. It outlines the process undertaken to gain Retail business managers' approval for a proof of concept utilizing AR, supported by a Storyboard demonstrating potential business benefits. The proof of concept aimed to illustrate how AR could increase sales and decrease return rates of furniture by allowing customers to visualize products in their own space before purchasing. Metrics for evaluating 3D model suppliers used in the AR platform are also discussed. The company's team developed the platform internally using Google's ARCore technology. This study highlights the practical applications of AR in retail and its impact on enhancing consumer interaction and operational efficiency. [ABSTRACT FROM AUTHOR]

Estimating lighting from standard images can effectively circumvent the need for resource-intensive high-dynamic-range (HDR) lighting acquisition. However, this task is often ill-posed and challenging, particularly for indoor scenes, due to the intricacy and ambiguity inherent in various indoor illumination sources. We propose an innovative transformer-based method called SGformer for lighting estimation through modeling spherical Gaussian (SG) distributions—a compact yet expressive lighting representation. Diverging from previous approaches, we explore underlying local and global dependencies in lighting features, which are crucial for reliable lighting estimation. Additionally, we investigate the structural relationships spanning various resolutions of SG distributions, ranging from sparse to dense, aiming to enhance structural consistency and curtail potential stochastic noise stemming from independent SG component regressions. By harnessing the synergy of local-global lighting representation learning and incorporating consistency constraints from various SG resolutions, the proposed method yields more accurate lighting estimates, allowing for more realistic lighting effects in object relighting and composition. Our code and model implementing our work can be found at https://github.com/junhong-jennifer-zhao/SGformer. [ABSTRACT FROM AUTHOR]

The urgency of environmental sustainability has catalyzed a thorough reconsideration of traditional workspaces and their environmental impact, particularly concerning carbon footprint stemming from business-related travel and daily commutes. In response to these concerns, the innovative notion of the "Phygital Workspace" has arisen. Moreover, the advent of the COVID-19 pandemic has accelerated the proliferation of this technology. In a Phygital Workspace, physical and digital elements coexist and interact to enhance productivity, collaboration, and overall work experience. This integration is often facilitated using advanced digital technologies, such as Augmented Reality (AR), Virtual Reality (VR), Mixed Reality (MR), and other immersive or interactive tools. This conceptual framework sets the stage for the seamless integration of both physical and digital dimensions, empowered by the potential of Extended Reality (XR) technology. An integral part of this review involves the analysis of various workspace scenarios, and further examines the role of a Phygital Workspace plays in reducing carbon footprint within each context. The scenarios under examination include flexible workspace scenarios, field work scenarios, and hybrid work scenarios. XR technology's contributions to reducing carbon footprint are evaluated by minimizing the need for physical travel, enabling remote collaboration, and enhancing workspace efficiency within these scenarios. Employing a systematic review methodology, this review considers the status of XR technology adoption in diverse business environments, pinpointing its strengths and limitations. The aim is to provide a solid foundation for the framework of a new typological work environment that leverages XR technology to effectively reduce the carbon footprint associated with travel. The framework comprises four key dimensions: XR Infrastructure, Collaborative Work Environment, Social Interaction Enhancement, and Environmental Impact Assessment. These dimensions collectively guide the development and implementation of sustainable Phygital Workspaces, catering to technological, social, and ecological considerations. It is an impassioned call for collaborative efforts among researchers, policymakers, and organizations to converge their expertise for a more environmentally conscious future of work. [ABSTRACT FROM AUTHOR]

For nearly three decades, researchers have explored the use of augmented reality for facilitating collaboration between humans and robots. In this survey paper, we review the prominent, relevant literature published since 2008, the last date that a similar review article was published. We begin with a look at the various forms of the augmented reality (AR) technology itself, as utilized for human–robot collaboration (HRC). We then highlight specific application areas of AR for HRC, as well as the main technological contributions of the literature. Next, we present commonly used methods of evaluation with suggestions for implementation. We end with a look towards future research directions for this burgeoning field. This review serves as a primer and comprehensive reference for those whose work involves the combination of augmented reality with any kind of human–robot collaboration. [ABSTRACT FROM AUTHOR]

Meta-lenses composed of artificial meta-atoms have stimulated substantial interest due to their compact and flexible wavefront shaping capabilities, outperforming bulk optical devices. The operating bandwidth is a critical factor determining the meta-lens' performance across various wavelengths. Meta-lenses that operate in a narrowband manner relying on nonlocal effects can effectively reduce disturbance and crosstalk from non-resonant wavelengths, making them well-suitable for specialized applications such as nonlinear generation and augmented reality/virtual reality display. However, nonlocal meta-lenses require striking a balance between local phase manipulation and nonlocal resonance excitation, which involves trade-offs among factors like quality-factor, efficiency, manipulation dimensions, and footprint. In this work, we experimentally demonstrate the nonlocal meta-lens featuring Huygens' bound states in the continuum (BICs) and its near-infrared imaging application. All-dielectric integrated-resonant unit is particularly optimized to efficiently induce both the quasi-BIC and generalized Kerker effect, while ensuring the rotation-angle robustness for generating geometric phase. The experimental results show that the single-layer nonlocal Huygens' meta-lens possesses a high quality-factor of 104 and achieves a transmission polarization conversion efficiency of 55%, exceeding the theoretical limit of 25%. The wavelength-selective two-dimensional focusing and imaging are demonstrated as well. This work will pave the way for efficient nonlocal wavefront shaping and meta-devices. Here, the authors demonstrate a nonlocal meta-lens featuring Huygen's bound states in the continuum and experimentally realise this system for nearinfrared imaging. They show wavelength-selective two-dimensional focusing and imaging, paving the way for efficient nonlocal wavefront shaping. [ABSTRACT FROM AUTHOR]

Copyright of Environmental & Social Management Journal / Revista de Gestão Social e Ambiental is the property of Environmental & Social Management Journal and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The introduction of new technologies in current digestive surgical practice is progressively reshaping the operating room, defining the fourth surgical revolution. The implementation of black boxes and control towers aims at streamlining workflow and reducing surgical error by early identification and analysis, while augmented reality and artificial intelligence augment surgeons' perceptual and technical skills by superimposing three-dimensional models to real-time surgical images. Moreover, the operating room architecture is transitioning toward an integrated digital environment to improve efficiency and, ultimately, patients' outcomes. This narrative review describes the most recent evidence regarding the role of these technologies in transforming the current digestive surgical practice, underlining their potential benefits and drawbacks in terms of efficiency and patients' outcomes, as an attempt to foresee the digestive surgical practice of tomorrow. [ABSTRACT FROM AUTHOR]

Micro-light-emitting diodes (µLEDs) are gathering significant interest as a technology for emerging micro-displays. However, µLEDs encounter numerous obstacles, including size-dependent efficiency loss, poor efficiency of red µLEDs, and challenges associated with the mass transfer and integration of full-color µLEDs. These issues become more acute in ultra-small µLEDs (<5 µm), which were required by the augmented reality (AR) displays. Here, we discuss the principal challenges faced by µLEDs and explore the possible solutions. We highlight recent advances in InGaN-based RGB µLEDs tailored for AR displays. In particular, we discuss the advancements in ultra-small InGaN µLEDs scaled down to 1 µm, the developments in InGaN red µLEDs, and the implementation of tunnel junction-based cascaded InGaN µLEDs for monolithic integration. [ABSTRACT FROM AUTHOR]

The sustainable development of tourism in cultural heritage sites benefits from the active participation of tourists in the co-creation process. Location-based AR games show great potential in tourists' participation in creation and positive experiences. This study explores the relationship between the stage factors of the co-creation experience and the overall co-creation. Combining the service-dominant logic and process perspective of value co-creation theory, this research proposes a conceptual framework for co-creating experiences in cultural heritage tourism using augmented reality technology through two studies. In the first phase of the study, quantitative research was conducted on 256 visitors to measure the impact of factors in the three processes of pre-co-creation experience, on-site experience, and post-co-creation experience on the overall co-creation experience. In the study's second phase, follow-up qualitative interviews were conducted based on multiple linear regression analysis results to expand the interpretation of the relationship and importance of factors affecting the co-creation experience process. The results show that psychological engagement, awareness, knowledge, and social relations during pre-visitation help enhance the overall co-creation experience. In contrast, the overall co-creation experience is enriched by real-time storytelling, interaction, and emotional resonance in both on-site and post-experience processes. The proposal of this framework model advances the discussion of augmented reality technology and co-creation experience to the empirical level. It provides a basis for further tourism co-creation experience design practice. [ABSTRACT FROM AUTHOR]

Display technologies influence user experience, not only through the perception of product features but also due to their own usage properties. In this work, 12 functional, usable, pleasuring, and media usage properties were analysed for five display technologies: image rendering, 360° rotation, and augmented, immersive, and non-immersive virtual reality. The perception of their importance and their assessment for the chosen technologies were studied by taking two different household products. Two variables for studying decision and expectations were also considered. The results showed that 360° rotation was well-valued in various properties, mainly related to functionality and usability, while the immersive virtual technology stood out in media properties and also in the most important feature: realism. It was also seen that the results could depend on the displayed product. These results provide a deeper insight for user experience optimisation because they complement the information to choose the most appropriate display technology based on the properties to be prioritised. [ABSTRACT FROM AUTHOR]

Strawberry production has been continually increasing worldwide, but this growth has often resulted in a lack of taste, favoring yield and plant adaptability instead. However, in recent decades, consumer focus has shifted towards more flavorful fruits. Consequently, the application of new sensory methodologies for consumers in strawberry breeding programs is becoming essential. This review provides an overview of new rapid consumer-based sensory methodologies and a brief summary of their potential applications when combined with Augmented Reality technology. These advancements aim to better understand and meet consumer needs, offering breeders valuable tools for their future work. [ABSTRACT FROM AUTHOR]

Location-based games are a highly technology-dependent game genre that has witnessed an exponential increase in popularity with the democratisation of smartphones as well as ubiquitous mobile data and access to satellite navigation. Moving forward into the future, location-based games can be expected to evolve as the technologies underlying the genre improve. In this conceptual work, we review the current state of the art in location-based games, and identify key trajectories and trends. We discovered 12 trends, based on which we jump ten years into the future and evaluate how current technology trends may end up influencing location-based gaming. For example, we propose that in the year 2035 through improvements in map data services and sensor data coverage, we will see locative games that are increasingly connected to elements in the physical world. We also expect to see gameplay that moves away from solely taking place on a smartphone screen to the adoption of multiple forms of interactions with location-based game worlds, especially as head-mounted displays and other wearables become more commonplace. [ABSTRACT FROM AUTHOR]

This work introduces Augmented Total Theatre (ATT), a new theatrical form that combines Total Theatre with Augmented Reality (AR) to transform theatrical experiences. We first explore ATT features, highlighting its capabilities in creating theatrical representations that surpass traditional theatre. We also examine current technological limitations that hinder the deployment of ATT potential. We venture then into a journey into the future, particularly focusing on the next decade. We try to envisage the evolution of AR and assess whether future advancements will yield a form of AR capable of creating digital worlds that can deceive human senses. Additionally, we explore the role of Generative AI systems in addressing the problems that hold back the current ATT. Specifically, we probe the feasibility of a cost-effective, autonomous, and highly efficient generative AI system to reshape and empower ATT, making it capable of real-time production of (theatrical and non-theatrical) representations of many events in the world. Finally, we try to imagine the ATT of the future: a sophisticated device that integrates cutting-edge AR technology with a super-performing generative AI system. This ATT, transcending its theatrical origins, emerges as a powerful tool for augmenting our sensory experiences and enriching our perception of reality. [ABSTRACT FROM AUTHOR]

Information Radiators (IRs) provide context-specific pieces of information in a semi-public place where a group of people can see it while working or passing-by. They can simplify information sharing "out-of-the-box", foster awareness and socialization, create serendipity and enhance collaboration. Recent sociotechnical developments such as the establishment of permanent hybrid work settings as well as advances in the area of Human Computer Interaction (HCI) such as the emergence of Augmented Reality (AR) and Virtual Reality (VR) are likely to impact how IRs are being used – or even challenge their usefulness. In this article we discuss those developments and their possible implications for the design and use of IRs in the context of knowledge work in the next decades. We argue that IRs will probably remain an important part of future office environments providing awareness, supporting serendipity and building a situated social place for matchmaking as well as informal communication. Using new display and interaction technologies (such as AR) they might even grow in importance by enabling fluid work scenarios. [ABSTRACT FROM AUTHOR]

This article aims to assist readers in understanding the current status of studies on the subject by providing a descriptive bibliometric analysis of publications on virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies in cultural heritage. A bibliometric analysis of 1214 publications in this discipline in the Scopus database between 2014 and the beginning of June 2024 was performed. We used VOSviewer and Bibliometrix as the analysis tools in this investigation. The outcome of this study provides a detailed overview of the descriptive bibliometric analysis based on seven categories, including the annual count of articles and citations, the most productive author, the primary affiliation, the publication source, and the subject areas. The contribution of this research lies in offering valuable insights for practitioners and researchers, helping them make informed decisions on the use of immersive technologies, for example, VR, AR, and MR, in the context of cultural heritage. [ABSTRACT FROM AUTHOR]

This study investigates the pedagogy and evaluation of fractions throughout the educational progression, ranging from early childhood education to the K-10. The article is presented from fundamental fraction notions, with concrete illustrations, through more complex numerical operations. The introduction addresses mathematical and ordinary contexts, while the primary emphasis is on the efficacy of using visual aids and real-world illustrations to enhance comprehension. The research furthermore examines a range of evaluation techniques, including formative assessments and technology-enhanced evaluations, to obtain a comprehensive understanding of students' skills. The highlighted instructional routes include a range of approaches, focusing on personalized learning and prompt feedback. The use of sophisticated digital technologies, such as virtual and augmented reality, presents a potentially fruitful path for enhancing the effectiveness of fraction instruction. Although conventional approaches have established a solid foundation, integrating additional digital tools can improve students' learning experience. [ABSTRACT FROM AUTHOR]

Digital technologies are opening up new ways to involve students in environmental education (EE). Augmented reality (AR) is one of these technologies and can potentially engage students and improve their learning outcomes. In this article, we systematically analyze the use of AR in EE. We searched the ERIC, Scopus, and Web of Science databases for articles related to AR and found 20 articles that met the inclusion and exclusion criteria of the research question. The results showed that most articles examined were published after 2017, and the researchers used experimental research methods. The results also showed that the research participants were mostly primary school students, and the most common sample size was between 50 and 100. In addition, the results revealed four categories: (1) contribution to student learning, (2) affective outcomes, (3) interaction, and (4) other benefits and advantages. We also found that only two articles reported the challenges of using AR in EE. In light of the findings, we recommend suggestions for future studies. [ABSTRACT FROM AUTHOR]

Introduction: Augmented reality (AR) and virtual reality (VR) are emerging tools in interventional radiology (IR), enhancing IR education, preprocedural planning, and intraprocedural guidance. Areas covered: This review identifies current applications of AR/VR in IR, with a focus on studies that assess the clinical impact of AR/VR. We outline the relevant technology and assess current limitations and future directions in this space. We found that the use of AR in IR lags other surgical fields, and the majority of the data exists in case series or small-scale studies. Educational use of AR/VR improves learning anatomy, procedure steps, and procedural learning curves. Preprocedural use of AR/VR decreases procedure times, especially in complex procedures. Intraprocedural AR for live tracking is accurate within 5 mm live patients and has up to 0.75 mm in phantoms, offering decreased procedure time and radiation exposure. Challenges include cost, ergonomics, rapid segmentation, and organ motion. Expert opinion: The use of AR/VR in interventional radiology may lead to safer and more efficient procedures. However, more data from larger studies is needed to better understand where AR/VR is confers the most benefit in interventional radiology clinical practice. [ABSTRACT FROM AUTHOR]

This literature review presents a comprehensive and systematic account of research on the experiences of children with extended reality (XR), including VR, AR, and other types of immersive technologies that enhance and augment children's activities. The search on Scopus and Web of Science produced 531 outputs. Content analysis with inter-rater reliability (Krippendorff's α) and Leximancer, a software for text mining, were used for analyzing the material. Four research strands were identified: (1) interventions, treatments, and medical procedures in clinical contexts; (2) teaching and learning enhanced by XR; (3) children's adoption and user experiences; (4) design and prototyping of XR hardware and software for children. The results showed the following findings: (a) studies on children's clinical interventions and treatments using HMD-supported immersive virtual reality comprise the most substantial strand of studies; (b) research in this area, and in teaching and learning studies, has grown dramatically since 2017, while the other areas have been stagnant over the years; (c) AR research is still limited and is mainly applied in educational contexts for design and prototyping; (d) few studies have considered children's perspectives on XR safety issues; (e) research on the use of XR for enhancing social and emotional skills development is underrepresented. Future research should focus on the potential of XR technologies for interventions to enhance children's psychosocial wellbeing and health more broadly. The further implications and study limitations for the fast-developing nature of this transdisciplinary research field are also discussed. [ABSTRACT FROM AUTHOR]

The growing demand for Location-based Augmented Reality (LAR) experiences has driven the integration of Visual Simultaneous Localization And Mapping (VSLAM) with Google Street View (GSV) to enhance the accuracy. However, the impact of the ambient light intensity on the accuracy and reliability is underexplored, posing significant challenges in outdoor LAR implementations. This paper investigates the impact of light conditions on the accuracy and reliability of the VSLAM/GSV integration approach in outdoor LAR implementations. This study fills a gap in the current literature and offers valuable insights into vision-based approach implementation under different light conditions. Extensive experiments were conducted at five Point of Interest (POI) locations under various light conditions with a total of 100 datasets. Descriptive statistic methods were employed to analyze the data and assess the performance variation. Additionally, the Analysis of Variance (ANOVA) analysis was utilized to assess the impact of different light conditions on the accuracy metric and horizontal tracking time, determining whether there are significant differences in performance across varying levels of light intensity. The experimental results revealed that a significant correlation (p < 0.05 ) exists between the ambient light intensity and the accuracy of the VSLAM/GSV integration approach. Through the confidence interval estimation, the minimum illuminance 434   lx is needed to provide a feasible and consistent accuracy. Variations in visual references, such as wet surfaces in the rainy season, also impact the horizontal tracking time and accuracy. [ABSTRACT FROM AUTHOR]

As students' affective states can differ between learning that occurs in traditional classrooms when compared with learning that takes place in extended reality and immersive learning environments, it is important to examine the role of affective computing. Therefore, this study aims to provide an overview regarding the use of affective computing in the context of augmented reality, virtual reality, and immersive learning environments and the metaverse. Hence, it examines and presents the state of the art through a review and bibliometric analysis of 188 documents of the existing literature from Scopus and Web of Science (WoS) from 2005 to 2023. The study follows the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement to identify and select relevant to the topic documents. In addition to the analysis of the existing literature, emerging topics and themes are identified and future research directions are presented. The significant role of affective computing within augmented reality and virtual reality environments arose. Their ability to offer engaging and interactive learning experiences while also being able to recognize, monitor, and respond to students' affective states and to consider their emotions, personalities, characteristics, knowledge, and preferences to provide adaptive and personalized learning was evident. Additionally, their potential to enrich educational activities, increase learning outcomes, and support special education emerged. When augmented reality, virtual reality, and immersive learning environments capitalize on affective computing, meaningful learning can occur and self-regulated learning can be promoted. [ABSTRACT FROM AUTHOR]

Recent advances in virtual reality technologies accelerate the immersive interaction between human and augmented 3D virtual worlds. Here, the authors discuss olfactory feedback technologies that facilitate interaction with real and virtual objects and the evolution of wearable devices for immersive VR/AR applications. [ABSTRACT FROM AUTHOR]

The present article explores the potential and usefulness of virtual reality (VR) and augmented reality (AR) technologies in space engineering. VR is a realistic, interactive 3D computer-created world that you can explore as if you really are there. In this work, we explored VR technology usage in space borne systems and engineering. Usually, designers use native mechanical design software like CATIA and CREO to design and analyse various systems and subsystems. System designers must also analyse system interfaces, intricacies, and alignments from all angles in an interactive and immersive fashion to foresee and avoid potential issues. Therefore, an in-house virtual reality solution is developed to understand a complex engineering sub-system/system; its assembly, dis-assembly; sectional views and perform 360-degree analysis of system/sub-systems by direct interaction in a virtual environment. This technical paper also explores the use of AR technology for various users to understand intricate engineering models and assist the crew members remotely, even in case of unavailability of proper communication. The AR application is equipped with interactive simulations and demonstrations, enabling engineers to manipulate and investigate 3D models in a mixed-reality environment. Application is designed in a generalized way to take any complex engineering model as an input. The contribution of this work to the field of space technology lies in its innovative approach and in-house developments to visualize and interact with complex models through VR and AR-based solutions. [ABSTRACT FROM AUTHOR]

HOBIT, which stands for "Hybrid Optical Bench for Innovative Teaching and learning" is an educational platform that leverages the combination of numerical simulation and physical manipulation to facilitate learning of complex phenomena and motivate users about wave optics in practical work. HOBIT operates in real time and is self-adaptive, providing realistic displays of optical phenomena with virtual augmentations designed to facilitate their understanding. HOBIT makes it quick and easy to build any reconfigurable optical experiment. Students can manipulate optical components and observe the changes induced on detectors and displays. We detail the technology, the simulation model and the initial teaching aids. Current and future enhancements should meet the needs of students at different levels, from high school to higher education degrees. [ABSTRACT FROM AUTHOR]

Introduction: Orthognathic surgery (OGS) is a highly sophisticated surgical technique that aims to repair a variety of skeletal and dental abnormalities, including misaligned jaws and teeth. It requires precise preoperative preparation and advanced surgical skills, which are typically learned through years of practical experience in operating rooms or laboratory-based surgical training facilities utilizing cadavers or models. The traditional physical hands-on method of surgical training is still used at OGS. However, this method requires a longer time of preparation. Currently, mixed reality (MR)—a combination of virtual reality and augmented reality technology—is an innovation of OGS. The present study aimed to present a comprehensive review of studies that assessed the advantages of utilizing mixed reality technology in OGS. Methods: A modified Population, Intervention, Comparison, Outcome strategy was performed using a combination of electronic (PubMed, Cochrane, Embase) and manual searches between 2013 and 2023 exploring mixed reality (MR) technology in OGS in the last 10 years. The inclusion criteria were limited to the patient and study model focusing on the clinical application of MR and the associated field of OGS. Result: The initial search indicated 1731 studies, of which 17 studies were included for analysis. The main results indicated that the use of MR technology in OGS led to high accuracy and time reduction as primary outcomes and cost-effectiveness and skill improvement as secondary outcomes. The review firmly concluded that MR technology exhibited a positive impact on students, trainees, and oromaxillofacial surgeons. However, due to the heterogeneity of the included studies, meta-analyses could not be performed. Collectively, these findings provide strong evidence for the advantages of MR technology in orthognathic surgery. Conclusion: MR technology significantly improves OGS planning efficiency by providing pre-surgical information and serving as an intraoperative navigation tool, reducing surgical time without compromising outcomes. Virtual training using MR technology exerts a positive impact on knowledge and skill improvement for OGS. This innovative technology will revolutionize the healthcare system and enhance patient care. [ABSTRACT FROM AUTHOR]

This paper presents the development of an innovative augmented reality application for evaluating clamping concepts through visualizing the finite element analysis. The focus is on transforming the traditional simulation results into immersive, holographic displays, enabling users to experience and assess finite element analysis in three dimensions. The application development process involves data processing by MATLAB, visualization in the software Unity, and displaying holograms through Microsoft's Hololens2. The most significant advancement introduces a new algorithm for rendering different finite elements in Unity. The application targets not only university engineering students but also vocational students with limited background in finite element analysis and machining, aiming to make the learning process more interactive and engaging. It was tested in a real machining environment, demonstrating its technical feasibility and potential in engineering education. [ABSTRACT FROM AUTHOR]

Feature description is a critical task in Augmented Reality Tracking. This article introduces a Convex Based Feature Descriptor (CBFD) system designed to withstand rotation, lighting, and blur variations while remaining computationally efficient. We have developed two filters capable of computing pixel intensity variations, followed by the covariance matrix of the polynomial to describe the features. The superiority of CBFD is validated through precision, recall, computation time, and feature location distance. Additionally, we provide a solution to determine the optimal block size for describing nonlinear regions, thereby enhancing resolution. The results demonstrate that CBFD achieves a average precision of 0.97 for the test image, outperforming Superpoint, Directional Intensified Tertiary Filtering (DITF), Binary Robust Independent Elementary Features (BRIEF), Binary Robust Invariant Scalable Keypoints (BRISK), Speeded Up Robust Features (SURF), and Scale Invariant Feature Transform (SIFT), which achieve scores of 0.95, 0.92, 0.72, 0.66, 0.63 and 0.50 respectively. Noteworthy is CBFD's recall value of 0.87 representing at the maximum of a 13.6% improvement over Superpoint, DITF, BRIEF, BRISK, SURF, and SIFT. Furthermore, the matching score for the test image is 0.975. The computation time for CBFD is 2.8 ms, which is at least 6.7% lower than that of other algorithms. Finally, the plot of location feature distance illustrates that CBFD exhibits minimal distance compared to DITF and Histogram of Oriented Gradients (HOG). These results highlight the speed and robustness of CBFD across various transformations. [ABSTRACT FROM AUTHOR]

Introduction: Variations in skin tone can significantly alter the appearance of symptoms such as rashes or bruises. Unfortunately, previous works utilizing Augmented Reality (AR) in simulating visual symptoms have often failed to consider this critical aspect, potentially leading to inadequate training and education. This study seeks to address this gap by integrating generative artificial intelligence (AI) into the AR filter design process. Methods: We conducted a 2 × 5 within-subjects study with second-year nursing students (N = 117) from the University of Florida. The study manipulated two factors: symptom generation style and skin tone. Symptom generation style was manipulated using a filter based on a real symptom image or a filter based on a computer-generated symptom image. Skin tone variations were created by applying AR filters to computer-generated images of faces with five skin tones ranging from light to dark. To control for factors like lighting or 3D tracking, 101 pre-generated images were created for each condition, representing a range of filter transparency levels (0-100). Participants used visual analog scales on a computer screen to adjust the symptom transparency in the images until they observed image changes and distinct symptom patterns. Participants also rated the realism of each condition and provided feedback on how the symptom style and skin tone impacted their perceptions. Results: Students rated the symptoms displayed by the computer-generated AR filters as marginally more realistic than those displayed by the real image AR filters. However, students identified symptoms earlier with the real-image filters. Additionally, SET-M and Theory of Planned Behavior questions indicate that the activity increased students' feelings of confidence and self-efficacy. Finally, we found that similar to the real world, where symptoms on dark skin tones are identified at later stages of development, students identified symptoms at later stages as skin tone darkened regardless of cue type. Conclusion: This work implemented a novel approach to develop AR filters that display time-based visual cues on diverse skin tones. Additionally, this work provides evidence-based recommendations on how and when generative AIbased AR filters can be effectively used in healthcare education. [ABSTRACT FROM AUTHOR]

Real-world understanding serves as a medium that bridges the information world and the physical world, enabling the realization of virtual–real mapping and interaction. However, scene understanding based solely on 2D images faces problems such as a lack of geometric information and limited robustness against occlusion. The depth sensor brings new opportunities, but there are still challenges in fusing depth with geometric and semantic priors. To address these concerns, our method considers the repeatability of video stream data and the sparsity of newly generated data. We introduce a sparsely correlated network architecture (SCN) designed explicitly for online RGBD instance segmentation. Additionally, we leverage the power of object-level RGB-D SLAM systems, thereby transcending the limitations of conventional approaches that solely emphasize geometry or semantics. We establish correlation over time and leverage this correlation to develop rules and generate sparse data. We thoroughly evaluate the system's performance on the NYU Depth V2 and ScanNet V2 datasets, demonstrating that incorporating frame-to-frame correlation leads to significantly improved accuracy and consistency in instance segmentation compared to existing state-of-the-art alternatives. Moreover, using sparse data reduces data complexity while ensuring the real-time requirement of 18 fps. Furthermore, by utilizing prior knowledge of object layout understanding, we showcase a promising application of augmented reality, showcasing its potential and practicality. [ABSTRACT FROM AUTHOR]

Periacetabular osteotomy (PAO) is an effective approach for the surgical treatment of developmental dysplasia of the hip (DDH). However, due to the complex anatomical structure around the hip joint and the limited field of view (FoV) during the surgery, it is challenging for surgeons to perform a PAO surgery. To solve this challenge, we propose a robot-assisted, augmented reality (AR)-guided surgical navigation system for PAO. The system mainly consists of a robot arm, an optical tracker, and a Microsoft HoloLens 2 headset, which is a state-of-the-art (SOTA) optical see-through (OST) head-mounted display (HMD). For AR guidance, we propose an optical marker-based AR registration method to estimate a transformation from the optical tracker coordinate system (COS) to the virtual space COS such that the virtual models can be superimposed on the corresponding physical counterparts. Furthermore, to guide the osteotomy, the developed system automatically aligns a bone saw with osteotomy planes planned in preoperative images. Then, it provides surgeons with not only virtual constraints to restrict movement of the bone saw but also AR guidance for visual feedback without sight diversion, leading to higher surgical accuracy and improved surgical safety. Comprehensive experiments were conducted to evaluate both the AR registration accuracy and osteotomy accuracy of the developed navigation system. The proposed AR registration method achieved an average mean absolute distance error (mADE) of 1.96 ± 0.43 mm. The robotic system achieved an average center translation error of 0.96 ± 0.23 mm, an average maximum distance of 1.31 ± 0.20 mm, and an average angular deviation of 3.77 ± 0.85°. Experimental results demonstrated both the AR registration accuracy and the osteotomy accuracy of the developed system. [ABSTRACT FROM AUTHOR]

Recent advancements in communication technology have catalyzed the widespread adoption of realistic content, with augmented reality (AR) emerging as a pivotal tool for seamlessly integrating virtual elements into real-world environments. In construction, architecture, and urban design, the integration of mixed reality (MR) technology enables rapid interior spatial mapping, providing clients with immersive experiences to envision their desires. The rapid advancement of MR devices, or devices that integrate MR capabilities, offers users numerous opportunities for enhanced entertainment experiences. However, to support designers at a high level of expertise, it is crucial to ensure the accuracy and reliability of the data provided by these devices. This study explored the potential of utilizing spatial mapping within various methodologies for surveying architectural interiors. The objective was to identify optimized spatial mapping procedures and determine the most effective applications for their use. Experiments were conducted to evaluate the interior survey performance, using HoloLens 2, an iPhone 13 Pro for spatial mapping, and photogrammetry. The findings indicate that HoloLens 2 is most suited for the tasks examined in the scope of these experiments. Nonetheless, based on the acquired parameters, the author also proposes approaches to apply the other technologies in specific real-world scenarios. [ABSTRACT FROM AUTHOR]