Search

Introduction: Thermal imaging can be used for the non-invasive detection of blood vessels of the skin. However, mapping the results to the patient currently lacks user-friendliness. Augmented reality may provide a useful tool to superimpose thermal information on the patient., Methods: A system to support planning in reconstructive surgery using a thermal camera was designed. The obtained information was superimposed on the physical object using a Microsoft HoloLens. An RGB, depth, and thermal camera were combined to capture a scene of different modalities and reconstruct a virtual scene in real time. To register the different cameras and the AR device, an active calibration target was developed and evaluated. A Vuforia marker was used to register the hologram in the virtual space. The accuracy of the projected hologram was evaluated in a laboratory setting with participants by measuring the error between the physical object and the hologram., Results: The AR-based system was evaluated by 21 participants in a laboratory setting. The mean projection error is 10.3 ± 9.4 mm. The system is able to stream a three-dimensional scene with augmented thermal information in real time at 5 frames per second. The active calibration target can be used independently of the environment., Conclusion: The calibration target provides an easy-to-use method for the registration of cameras capturing the visible to long-infrared spectral range. The inside-out tracking of the HoloLens in combination with a Vuforia marker is not accurate enough for the intended clinical use., (© 2024. CARS.)

Purpose: Calibration of an optical see-through head-mounted display is critical for augmented reality-based surgical navigation. While conventional methods have advanced, calibration errors remain significant. Moreover, prior research has focused primarily on calibration accuracy and procedure, neglecting the impact on the overall surgical navigation system. Consequently, these enhancements do not necessarily translate to accurate augmented reality in the optical see-through head mount due to systemic errors, including those in calibration., Method: This study introduces a simulated augmented reality-based calibration to address these issues. By replicating the augmented reality that appeared in the optical see-through head mount, the method achieves calibration that compensates for augmented reality errors, thereby reducing them. The process involves two distinct calibration approaches, followed by adjusting the transformation matrix to minimize displacement in the simulated augmented reality., Results: The efficacy of this method was assessed through two accuracy evaluations: registration accuracy and augmented reality accuracy. Experimental results showed an average translational error of 2.14 mm and rotational error of 1.06° across axes in both approaches. Additionally, augmented reality accuracy, measured by the overlay regions' ratio, increased to approximately 95%. These findings confirm the enhancement in both calibration and augmented reality accuracy with the proposed method., Conclusion: The study presents a calibration method using simulated augmented reality, which minimizes augmented reality errors. This approach, requiring minimal manual intervention, offers a more robust and precise calibration technique for augmented reality applications in surgical navigation., (© 2024. CARS.)

Background: In the wake of challenges brought by the COVID-19 pandemic to conventional medical education, the demand for innovative teaching methods has surged. Nurse training, with its focus on hands-on practice and self-directed learning, encountered significant hurdles with conventional approaches. Augmented reality (AR) offers a potential solution to addressing this issue., Objective: The aim of this study was to develop, introduce, and evaluate an AR-based educational program designed for nurses, focusing on its potential to facilitate hands-on practice and self-directed learning., Methods: An AR-based educational program for nursing was developed anchored by the Kern six-step framework. First, we identified challenges in conventional teaching methods through interviews and literature reviews. Interviews highlighted the need for hands-on practice and on-site self-directed learning with feedback from a remote site. The training goals of the platform were established by expert trainers and researchers, focusing on the utilization of a ventilator and extracorporeal membrane oxygenation system. Intensive care nurses were enrolled to evaluate AR education. We then assessed usability and acceptability of the AR training using the System Usability Scale and Technology Acceptance Model with intensive care nurses who agreed to test the new platform. Additionally, selected participants provided deeper insights through semistructured interviews., Results: This study highlights feasibility and key considerations for implementing an AR-based educational program for intensive care unit nurses, focusing on training objectives of the platform. Implemented over 2 months using Microsoft Dynamics 365 Guides and HoloLens 2, 28 participants were trained. Feedback gathered through interviews with the trainers and trainees indicated a positive reception. In particular, the trainees mentioned finding AR particularly useful for hands-on learning, appreciating its realism and the ability for repetitive practice. However, some challenges such as difficulty in adapting to the new technology were expressed. Overall, AR exhibits potential as a supplementary tool in nurse education., Conclusions: To our knowledge, this is the first study to substitute conventional methods with AR in this specific area of critical care nursing. These results indicate the multiple principal factors to take into consideration when adopting AR education in hospitals. AR is effective in promoting self-directed learning and hands-on practice, with participants displaying active engagement and enhanced skill acquisition., Trial Registration: ClinicalTrials.gov NCT05629663; https://clinicaltrials.gov/study/NCT05629663., (©Suyoung Yoo, Sejin Heo, Soojin Song, Aeyoung Park, Hyunchung Cho, Yuna Kim, Won Chul Cha, Kyeongsug Kim, Meong Hi Son. Originally published in JMIR Serious Games (https://games.jmir.org), 23.05.2024.)

Cybersickness remains a pivotal factor that impacts user experience in Augmented Reality (AR). Research probing into the relationship between AR reading tasks and cybersickness, particularly focusing on text display patterns and user characteristics, has been scant. Moreover, the influence of cybersickness on searching ability and the broader spectrum of user experience has not been rigorously tested. Recent investigations have aimed to pinpoint the variables that contribute to cybersickness during AR reading sessions. In one such study, 40 participants underwent a series of controlled experiments with randomized text display patterns, including variations in text speed and text movement modes. Post-experiment, participants completed a questionnaire that helped quantify their experiences and the degree of cybersickness encountered. The data highlighted that satiety, text speed, and text movement mode are significant contributors to cybersickness. When participants experienced higher levels of cybersickness, font color stood out as a particularly influential factor, whereas gender differences seemed to affect the onset of cybersickness more noticeably at lower levels. This study also drew attention to the impact of cybersickness on search ability within AR environments. It was noted that as cybersickness intensity increased, search ability was markedly compromised. In sum, the research underscores the importance of text display patterns and user characteristics, such as past AR experience, in understanding cybersickness and its detrimental effects on user experience and search ability, particularly under conditions of intense cybersickness., (© 2024. The Author(s).)

Purpose: We present a novel method for augmented reality in endoscopic endonasal surgery. Our method does not require the use of external tracking devices and can show hidden anatomical structures relevant to the surgical intervention., Methods: Our method registers a preoperative 3D model of the nasal cavity to an intraoperative 3D model by estimating a scaled-rigid transformation. Registration is based on a two-stage ICP approach on the reconstructed nasal cavity. The hidden structures are then transferred from the preoperative 3D model to the intraoperative one using the estimated transformation, projected and overlaid into the endoscopic images to obtain the augmented reality., Results: We performed qualitative and quantitative validation of our method on 12 clinical cases. Qualitative results were obtained from an ENT surgeon from visual inspection of the hidden structures in the augmented images. Quantitative results were obtained by measuring a target registration error using a novel transillumination-based approach. The results show that the hidden structures of interest are augmented at the expected locations in most cases., Conclusion: Our method was able to augment the endoscopic images in a sufficiently precise manner when the intraoperative nasal cavity did not deform considerably with respect to its preoperative state. This is a promising step towards trackerless augmented reality in endonasal surgery., (© 2024. CARS.)

Purpose: This systematic review aims to provide an overview of the current knowledge on the role of the metaverse, augmented reality, and virtual reality in reverse shoulder arthroplasty., Methods: A systematic review was performed using the PRISMA guidelines. A comprehensive review of the applications of the metaverse, augmented reality, and virtual reality in in-vivo intraoperative navigation, in the training of orthopedic residents, and in the latest innovations proposed in ex-vivo studies was conducted., Results: A total of 22 articles were included in the review. Data on navigated shoulder arthroplasty was extracted from 14 articles: seven hundred ninety-three patients treated with intraoperative navigated rTSA or aTSA were included. Also, three randomized control trials (RCTs) reported outcomes on a total of fifty-three orthopedics surgical residents and doctors receiving VR-based training for rTSA, which were also included in the review. Three studies reporting the latest VR and AR-based rTSA applications and two proof of concept studies were also included in the review., Conclusions: The metaverse, augmented reality, and virtual reality present immense potential for the future of orthopedic surgery. As these technologies advance, it is crucial to conduct additional research, foster development, and seamlessly integrate them into surgical education to fully harness their capabilities and transform the field. This evolution promises enhanced accuracy, expanded training opportunities, and improved surgical planning capabilities., (© 2024. The Author(s).)

Purpose: To compare two cohorts of patients submitted to robot-assisted partial nephrectomy (RAPN) for highly-complex renal masses (PADUA ⩾ 10) with versus without the use of 3DVMs., Materials and Methods: We screened a prospective consecutive cohort of 152 patients submitted to RAPN with 3DVM and 1264 patients submitted to RAPN without 3DVM between 2019 and 2022. Only PADUA ⩾ 10 cases were considered eligible for analysis. Propensity score matching (PSM) analysis was applied. Primary endpoint was to evaluate whereas RAPNs with 3DVM were superior in terms of functional outcomes at 12-month. Secondary outcomes were to compare perioperative and oncological outcomes. Multivariable logistic regression analyses (MVA) tested the associations of clinically significant eGFR drop and 3DVMs. Subgroups analysis was performed for PAUDA-risk categories., Results: Thirty seven patients for each group were analyzed after PSM. RAPN with 3DVM presented a higher rate of selective/no clamping procedure (32.5% vs 16.2%, p  = 0.03) and a higher enucleation rate (43.2% vs 29.8%, p  = 0.04). Twelve-month functional preservation performed better within 3DVM group in terms of creatinine serum level (median 1.2 [IQR 1.1-1.4] vs 1.6 [IQR 1.1-1.8], p  = 0.03) and eGFR (median 64.6 [IQR 56.2-74.1] vs 52.3 [IQR 49.2-74.1], p  = 0.03). MVA confirmed 3DVM as a protective factor for clinically significant eGFR drop in this subgroup of patients., Conclusions: RAPN performed with the use of 3DVM assistance for PADUA ⩾ 10 cases resulted in lower incidence of global ischemia and higher rate of enucleations. The positive impact of such technology was found at 12-month follow-up., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Purpose: Virtual interactive 3-dimensional models (VI3DM) and immersive virtual reality are implemented in medical education and surgical training. VI3DM allow learners to view and interact with a virtual 3D object and help in conceptualising learning objectives that demand high cognitive and visuo-spatial skills. However, the effects of VI3DM in medical education are unknown. We aimed to determine whether VI3DM are helpful in conceptualising complex anatomical structures. Materials and methods: We included 5 specimens, which were assessed by 200 first-year medical students categorised into experimental (n = 100) and control (n = 100) groups using a systemic randomisation method after matching for age and sex. The experimental group was given VI3DM as interventional learning resources while the control group was given 2-dimensional photographs as conventional learning resources for self-directed learning for 30 minutes. Participants completed a questionnaire before and after the learning session to assess their knowledge related to external features, attachments, and relations of anatomical specimens. Results : The scores of the experimental group improved significantly in the post-test compared to those of the control group for all 5 specimens included in the study (p < 0.05, confidence interval = 95%, unpaired student's t-test). Conclusions : VI3DM can help conceptualise external features, attachments, and relations of anatomical structures.

Study Design: Feasibility study., Purpose: A phantom model was used to evaluate the accuracy of a novel augmented reality (AR) system for cervical screw placement., Overview of Literature: The use of navigation systems is becoming increasingly common in spine procedures. However, numerous factors limit the feasibility of regular and widespread use of navigation tools during spine surgery. AR is a new technology that has already demonstrated utility as a navigation tool during spine surgery. However, advancements in AR technology are needed to increase its adoption by the medical community., Methods: AR technology that uses a fiducial-less registration system was tested in a preclinical cervical spine phantom model study for accuracy during spinal screw placement. A three-dimensional reconstruction of the spine along with trajectory lines was superimposed onto the phantom model using an AR headset. Participants used the AR system to guide screw placement, and post-instrumentation scans were compared for accuracy assessment., Results: Twelve cervical screws were placed under AR guidance. All screws were placed in an acceptable anatomic position. The average distance error for the insertion point was 2.73±0.55 mm, whereas that for the endpoint was 2.71±0.69 mm. The average trajectory angle error for all insertions was 2.69°±0.59°., Conclusions: This feasibility study describes a novel registration approach that superimposes spinal anatomy and trajectories onto the surgeon's real-world view of the spine. These results demonstrate reasonable accuracy in the preclinical model. The results of this study demonstrate that this technology can assist with accurate screw placement. Further investigation using cadaveric and clinical models is warranted.

Purpose: To compare two cohorts of patients submitted to robot-assisted partial nephrectomy (RAPN) with vs without the use of three-dimensional virtual models (3DVMs)., Methods: We screened a prospective consecutive cohort of 152 patients submitted to RAPN with 3DVM and 1264 patients submitted to RAPN without 3DVM between 2019 and 2022. Propensity score matching analysis (PSMA) was applied. Primary endpoint was to evaluate whereas RAPNs with 3DVM were superior in terms of functional outcomes at 12-month. Secondary endopoints were to compare perioperative and oncological outcomes. Multivariable logistic regression analyses (MVA) tested the associations of clinically significant eGFR drop and 3DVMs. Subgroups analysis was performed for PAUDA-risk categories., Results: 100 patients for each group were analyzed after PSMA. RAPN with 3DVM presented a higher rate of selective/no clamping procedure (32% vs 16%, p = 0.03) and a higher enucleation rate (40% vs 29%, p = 0.04). As concern to primary endopoint, 12-month functional preservation performed better within 3DVM group in terms of creatinine serum level (median 1.2 [IQR 1.1-1.4] vs 1.6 [IQR 1.1-1.8], p = 0.03) and eGFR (median 64.6 [IQR 56.2-74.1] vs 52.3 [IQR 49.2-74.1], p = 0.03). However, this result was confirmed only in the PADUA ≥ 10 renal masses. Regarding secondary endpoints, no significative difference emerged between the two cohorts. MVA confirmed 3DVM as a protective factor for clinically significant eGFR drop only in high-risk (PADUA ≥ 10) masses., Conclusions: RAPN performed with the use of 3DVM assistance resulted in lower incidence of global ischemia and higher rate of enucleations. The positive impact of such technology was found at 12-month only in high-risk renal masses., (© 2024. The Author(s).)

Exact biopsy planning and careful execution of needle injection is crucial to ensure successful procedure completion as initially intended while minimizing the risk of complications. This study introduces a solution aimed at helping the operator navigate to precisely position the needle in a previously planned trajectory utilizing a mixed reality headset. A markerless needle tracking method was developed by integrating deep learning and deterministic computer vision techniques. The system is based on superimposing imaging data onto the patient's body in order to directly perceive the anatomy and determine a path from the selected injection site to the target location. Four types of tests were conducted to assess the system's performance: measuring the accuracy of needle pose estimation, determining the distance between injection sites and designated targets, evaluating the efficiency of material collection, and comparing procedure time and number of punctures required with and without the system. These tests, involving both phantoms and physician participation in the latter two, demonstrated the accuracy and usability of the proposed solution. The results showcased a significant improvement, with a reduction in number of punctures needed to reach the target location. The test was successfully completed on the first attempt in 70% of cases, as opposed to only 20% without the system. Additionally, there was a 53% reduction in procedure time, validating the effectiveness of the system.

Industry 4.0 technology is promoted as improving manufacturing flexibility, and competitiveness; though Australia has been slow to adopt. The Australian Navy shipbuilding program provides opportunities for accelerating technology adoption, revitalising manufacturing productivity and competitiveness. Adopting a sociotechnical systems lens, our research sought to identify usability, workload, and user experience of an augmented reality head-mounted display (AR-HMD) deployed to complete multiple work tasks in a workflow (electrical assembly, collaborative robot (cobot) mediated inspection, and remote troubleshooting using video call). Usability was rated 'average' (System Usability Scale mean = 69.8) and workload 'acceptable' (NASA Task Load Index mean = 25.8) for the AR-HMD alone, with usability of the integrated work system (IWS) rated 'good' (SUS mean = 79.2). Results suggest software interfaces, tracking, and gesturing methods for the AR-HMD require improvement. This trial shows the AR-HMD provides a versatile platform for integrating multiple digital technologies without hindering effectiveness of end-user performance, potentially benefiting productivity and quality.

The study of consciousness has developed well-controlled, rigorous methods for manipulating and measuring consciousness. Yet, in the process, experimental paradigms grew farther away from everyday conscious and unconscious processes, which raises the concern of ecological validity. In this review, we suggest that the field can benefit from adopting a more ecological approach, akin to other fields of cognitive science. There, this approach challenged some existing hypotheses, yielded stronger effects, and enabled new research questions. We argue that such a move is critical for studying consciousness, where experimental paradigms tend to be artificial and small effect sizes are relatively prevalent. We identify three paths for doing so-changing the stimuli and experimental settings, changing the measures, and changing the research questions themselves-and review works that have already started implementing such approaches. While acknowledging the inherent challenges, we call for increasing ecological validity in consciousness studies., Competing Interests: Declaration of interests The authors declare no competing interests., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Purpose: This single-center, randomized, prospective, exploratory clinical trial was conducted to assess the clinical efficacy of an augmented reality (AR)-based breast cancer localization imaging solution for patients with breast cancer., Methods: This clinical trial enrolled 20 women who were diagnosed with invasive breast cancer between the ages of 19 and 80, had a single lesion with a diameter ≥ 5 mm but ≤ 30 mm, had no metastases to other organs, and had not received prior chemotherapy. All patients underwent mammography, ultrasound, computed tomography, and magnetic resonance imaging for preoperative assessment. Patients were randomly assigned to ultrasound-guided skin marking localization (USL) and AR-based localization (ARL) groups (n = 10 in each group). Statistical comparisons between USL and ARL groups were made based on demographics, radiologic features, pathological outcomes, and surgical outcomes using chi-square and Student t-tests., Results: Two surgeons performed breast-conserving surgery on 20 patients. Histopathologic evaluation of all patients confirmed negative margins. Two independent pathologists evaluated the marginal distances, and there were no intergroup differences in the readers' estimates (R1, 6.20 ± 4.37 vs. 5.04 ± 3.47, P = 0.519; R2, 5.10 ± 4.31 vs. 4.10 ± 2.38, P = 0.970) or the readers' average values (5.65 ± 4.19 vs. 4.57 ± 2.84, P = 0.509). In comparing the tumor plane area ratio, there was no statistically significant difference between the two groups in terms of either reader's mean values (R1, 15.90 ± 9.52 vs. 19.38 ± 14.05, P = 0.525; R2, 15.32 ± 9.48 vs. 20.83 ± 12.85, P = 0.290) or the overall mean values of two readers combined (15.56 ± 9.11 vs. 20.09 ± 13.38, P = 0.388). Convenience, safety, satisfaction, and reusability were all superior in the AR localization group (P < 0.001) based on the two surgeons' responses., Conclusion: AR localization is an acceptable alternative to ultrasound-guided skin marking with no significant differences in surgical outcomes., (© 2024. The Author(s).)

Background: Attention-deficit/hyperactivity disorder (ADHD) is one of the most common neurodevelopmental disorders among children. Pharmacotherapy has been the primary treatment for ADHD, supplemented by behavioral interventions. Digital and exercise interventions are promising nonpharmacologic approaches for enhancing the physical and psychological health of children with ADHD. However, the combined impact of digital and exercise therapies remains unclear., Objective: The aim of this study was to determine whether BrainFit, a novel digital intervention combining gamified cognitive and exercise training, is efficacious in reducing ADHD symptoms and executive function (EF) among school-aged children with ADHD., Methods: This 4-week prospective randomized controlled trial included 90 children (6-12 years old) who visited the ADHD outpatient clinic and met the diagnostic criteria for ADHD. The participants were randomized (1:1) to the BrainFit intervention (n=44) or a waitlist control (n=46) between March and August 2022. The intervention consisted of 12 30-minute sessions delivered on an iPad over 4 weeks with 3 sessions per week (Monday, Wednesday, and Friday after school) under the supervision of trained staff. The primary outcomes were parent-rated symptoms of attention and hyperactivity assessed according to the Swanson, Nolan, and Pelham questionnaire (SNAP-IV) rating scale and EF skills assessed by the Behavior Rating Inventory of Executive Function (BRIEF) scale, evaluated pre and post intervention. Intention-to-treat analysis was performed on 80 children after attrition. A nonparametric resampling-based permutation test was used for hypothesis testing of intervention effects., Results: Among the 145 children who met the inclusion criteria, 90 consented and were randomized; ultimately, 80 (88.9%) children completed the study and were included in the analysis. The participants' average age was 8.4 (SD 1.3) years, including 63 (78.8%) male participants. The most common ADHD subtype was hyperactive/impulsive (54/80, 68%) and 23 (29%) children had severe symptoms. At the endpoint of the study, the BrainFit intervention group had a significantly larger improvement in total ADHD symptoms (SNAP-IV total score) as compared to those in the control group (β=-12.203, 95% CI -17.882 to -6.523; P<.001), owing to lower scores on the subscales Inattention (β=-3.966, 95% CI -6.285 to -1.647; P<.001), Hyperactivity/Impulsivity (β=-5.735, 95% CI -8.334 to -3.137; P<.001), and Oppositional Defiant Disorder (β=-2.995, 95% CI -4.857 to -1.132; P=.002). The intervention was associated with significant reduction in the Metacognition Index (β=-6.312, 95% CI -10.973 to -1.650; P=.006) and Global Executive Composite (β=-5.952, 95% CI -10.214 to -1.690; P=.003) on the BRIEF. No severe intervention-related adverse events were reported., Conclusions: This novel digital cognitive-physical intervention was efficacious in school-age children with ADHD. A larger multicenter effectiveness trial with longer follow-up is warranted to confirm these findings and to assess the durability of treatment effects., Trial Registration: Chinese Clinical Trial Register ChiCTR2300070521; https://www.chictr.org.cn/showproj.html?proj=177806., (©Licong Zhao, Heather Agazzi, Yasong Du, Hongdao Meng, Renya Maku, Ke Li, Peter Aspinall, Cynthia Wilson Garvan, Shuanfeng Fang. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 10.05.2024.)

Background: We compared computed tomography (CT) images and holograms (HG) to assess the number of arteries of the lung lobes undergoing lobectomy and assessed easiness in interpretation by radiologists and thoracic surgeons with both techniques., Methods: Patients scheduled for lobectomy for lung cancer were prospectively included and underwent CT for staging. A patient-specific three-dimensional model was generated and visualized in an augmented reality setting. One radiologist and one thoracic surgeon evaluated CT images and holograms to count lobar arteries, having as reference standard the number of arteries recorded at surgery. The easiness of vessel identification was graded according to a Likert scale. Wilcoxon signed-rank test and κ statistics were used., Results: Fifty-two patients were prospectively included. The two doctors detected the same number of arteries in 44/52 images (85%) and in 51/52 holograms (98%). The mean difference between the number of artery branches detected by surgery and CT images was 0.31 ± 0.98, whereas it was 0.09 ± 0.37 between surgery and HGs (p = 0.433). In particular, the mean difference in the number of arteries detected in the upper lobes was 0.67 ± 1.08 between surgery and CT images and 0.17 ± 0.46 between surgery and holograms (p = 0.029). Both radiologist and surgeon showed a higher agreement for holograms (κ = 0.99) than for CT (κ = 0.81) and found holograms easier to evaluate than CTs (p < 0.001)., Conclusions: Augmented reality by holograms is an effective tool for preoperative vascular anatomy assessment of lungs, especially when evaluating the upper lobes, more prone to anatomical variations., Trial Registration: ClinicalTrials.gov, NCT04227444 RELEVANCE STATEMENT: Preoperative evaluation of the lung lobe arteries through augmented reality may help the thoracic surgeons to carefully plan a lobectomy, thus contributing to optimize patients' outcomes., Key Points: • Preoperative assessment of the lung arteries may help surgical planning. • Lung artery detection by augmented reality was more accurate than that by CT images, particularly for the upper lobes. • The assessment of the lung arterial vessels was easier by using holograms than CT images., (© 2024. The Author(s).)

Purpose: Numerous navigation devices for percutaneous, CT-guided interventions exist and are, due to their advantages, increasingly integrated into the clinical workflow. However, effective training methods to ensure safe usage are still lacking. This study compares the potential of an augmented reality (AR) training application with conventional instructions for the Cube Navigation System (CNS), hypothesizing enhanced training with AR, leading to safer clinical usage., Methods: An AR-tablet app was developed to train users puncturing with CNS. In a study, 34 medical students were divided into two groups: One trained with the AR-app, while the other used conventional instructions. After training, each participant executed 6 punctures on a phantom (204 in total) following a standardized protocol to identify and measure two potential CNS procedural user errors: (1) missing the coordinates specified and (2) altering the needle trajectory during puncture. Training performance based on train time and occurrence of procedural errors, as well as scores of User Experience Questionnaire (UEQ) for both groups, was compared., Results: Training duration was similar between the groups. However, the AR-trained participants showed a 55.1% reduced frequency of the first procedural error (p > 0.05) and a 35.1% reduced extent of the second procedural error (p < 0.01) compared to the conventionally trained participants. UEQ scores favored the AR-training in five of six categories (p < 0.05)., Conclusion: The AR-app enhanced training performance and user experience over traditional methods. This suggests the potential of AR-training for navigation devices like the CNS, potentially increasing their safety, ultimately improving outcomes in percutaneous needle placements., (© 2024. The Author(s).)

Objectives: This review aimed to map taxonomy frameworks, descriptions, and applications of immersive technologies in the dental literature., Data: The Preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) guidelines was followed, and the protocol was registered at open science framework platform (https://doi.org/10.17605/OSF.IO/H6N8M)., Sources: Systematic search was conducted in MEDLINE (via PubMed), Scopus, and Cochrane Library databases, and complemented by manual search., Study Selection: A total of 84 articles were included, with 81% between 2019 and 2023. Most studies were experimental (62%), including education (25%), protocol feasibility (20%), in vitro (11%), and cadaver (6%). Other study types included clinical report/technique article (24%), clinical study (9%), technical note/tip to reader (4%), and randomized controlled trial (1%). Three-quarters of the included studies were published in oral and maxillofacial surgery (38%), dental education (26%), and implant (12%) disciplines. Methods of display included head mounted display device (HMD) (55%), see through screen (32%), 2D screen display (11%), and projector display (2%). Descriptions of immersive realities were fragmented and inconsistent with lack of clear taxonomy framework for the umbrella and the subset terms including virtual reality (VR), augmented reality (AR), mixed reality (MR), augmented virtuality (AV), extended reality, and X reality., Conclusions: Immersive reality applications in dentistry are gaining popularity with a notable surge in the number of publications in the last 5 years. Ambiguities are apparent in the descriptions of immersive realities. A taxonomy framework based on method of display (full or partial) and reality class (VR, AR, or MR) is proposed., Clinical Significance: Understanding different reality classes can be perplexing due to their blurred boundaries and conceptual overlapping. Immersive technologies offer novel educational and clinical applications. This domain is fast developing. With the current fragmented and inconsistent terminologies, a comprehensive taxonomy framework is necessary., Competing Interests: Declaration of competing interest non, (Copyright © 2024. Published by Elsevier Ltd.)

A popular and widely suggested measure for assessing unilateral hand motor skills in stroke patients is the box and block test (BBT). Our study aimed to create an augmented reality enhanced version of the BBT (AR-BBT) and evaluate its correlation to the original BBT for stroke patients. Following G-power analysis, clinical examination, and inclusion-exclusion criteria, 31 stroke patients were included in this study. AR-BBT was developed using the Open Source Computer Vision Library (OpenCV). The MediaPipe's hand tracking library uses a palm and a hand landmark machine learning model to detect and track hands. A computer and a depth camera were employed in the clinical evaluation of AR-BBT following the principles of traditional BBT. A strong correlation was achieved between the number of blocks moved in the BBT and the AR-BBT on the hemiplegic side (Pearson correlation = 0.918) and a positive statistically significant correlation (p = 0.000008). The conventional BBT is currently the preferred assessment method. However, our approach offers an advantage, as it suggests that an AR-BBT solution could remotely monitor the assessment of a home-based rehabilitation program and provide additional hand kinematic information for hand dexterities in AR environment conditions. Furthermore, it employs minimal hardware equipment., (© 2024. The Author(s).)

Background: Dynamic infrared thermography (DIRT) is a quick and non-invasive technique for perforator mapping in free flaps that provides real-time information. After a cold challenge, areas best supplied with blood become visible hotspots on color-coded maps, indicating perforators. This study presents a proof of principle for a new and innovative feature of DIRT, where projected augmented reality is used to directly display thermal images on the patient's abdomen prior to the deep inferior epigastric artery perforator (DIEP) flap breast reconstruction., Methods: A self-aligning projection device prototype (Anatomy Projector) equipped with an integrated thermal camera was used to obtain thermal information and project the color-coded map directly on the patient's abdomen before DIEP flap breast reconstruction. Projected DIRT hotspots were verified using a hand-held Doppler, and compared to the vascularity on computed tomography angiography (CTA), and intraoperative perforator measurements following a Cartesian grid., Results: A total of 514 DIRT hotspots were projected in 50 patients, among them 97.3% could be verified using Doppler. The positive predictive value for CTA was 74.5%. Intraoperative measurements yielded 132 perforators in 71 flaps, among them 75 perforators (56.8%) correlated with projected DIRT hotspots, and half of them (54.7%) appeared within the first 5 emerging hotspots., Conclusion: This study showed that real-time display of thermal data in DIEP flap breast reconstruction is feasible via projected augmented reality. Projection facilitates convenient marking of hotspots, and a high resemblance to Doppler and CTA data was observed. Further research should assess the added value of projecting thermal images intraoperatively and in other fields of plastic surgery., (Copyright © 2024 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved.)

Introduction: Medical resuscitations in rugged prehospital settings require emergency personnel to perform high-risk procedures in low-resource conditions. Just-in-Time Guidance (JITG) utilizing augmented reality (AR) guidance may be a solution. There is little literature on the utility of AR-mediated JITG tools for facilitating the performance of emergent field care., Study Objective: The objective of this study was to investigate the feasibility and efficacy of a novel AR-mediated JITG tool for emergency field procedures., Methods: Emergency medical technician-basic (EMT-B) and paramedic cohorts were randomized to either video training (control) or JITG-AR guidance (intervention) groups for performing bag-valve-mask (BVM) ventilation, intraosseous (IO) line placement, and needle-decompression (Needle-d) in a medium-fidelity simulation environment. For the interventional condition, subjects used an AR technology platform to perform the tasks. The primary outcome was participant task performance; the secondary outcomes were participant-reported acceptability. Participant task score, task time, and acceptability ratings were reported descriptively and compared between the control and intervention groups using chi-square analysis for binary variables and unpaired t-testing for continuous variables., Results: Sixty participants were enrolled (mean age 34.8 years; 72% male). In the EMT-B cohort, there was no difference in average task performance score between the control and JITG groups for the BVM and IO tasks; however, the control group had higher performance scores for the Needle-d task (mean score difference 22%; P = .01). In the paramedic cohort, there was no difference in performance scores between the control and JITG group for the BVM and Needle-d tasks, but the control group had higher task scores for the IO task (mean score difference 23%; P = .01). For all task and participant types, the control group performed tasks more quickly than in the JITG group. There was no difference in participant usability or usefulness ratings between the JITG or control conditions for any of the tasks, although paramedics reported they were less likely to use the JITG equipment again (mean difference 1.96 rating points; P = .02)., Conclusions: This study demonstrated preliminary evidence that AR-mediated guidance for emergency medical procedures is feasible and acceptable. These observations, coupled with AR's promise for real-time interaction and on-going technological advancements, suggest the potential for this modality in training and practice that justifies future investigation.

Purpose: Augmented reality (AR) is an innovative approach that could assist percutaneous procedures; by directly seeing "through" a phantom, targeting a lesion might be more intuitive than using ultrasound (US). The objective of this study was to compare the performance of experienced interventional radiologists and operators untrained in soft tissue lesion puncture using AR guidance and standard US guidance., Material and Methods: Three trained interventional radiologists with 5-10 years of experience and three untrained operators performed punctures of five targets in an abdominal phantom, with US guidance and AR guidance. Correct targeting, accuracy (defined as the Euclidean distance between the tip and the center of the target), planning time, and puncture time were documented., Results: Accuracy was higher for the trained group than the untrained group using US guidance (1 mm versus 4 mm, p = 0.001), but not when using AR guidance (4 mm vs. 4 mm, p = 0.76). All operators combined, no significant difference was found concerning accuracy between US and AR guidance (2 mm vs. 4 mm, p = 0.09), but planning time and puncture time were significantly shorter using AR (respectively, 15.1 s vs. 74 s, p < 0.001; 16.1 s vs. 59 s; p < 0.001)., Conclusion: Untrained and trained operators obtained comparable accuracy in percutaneous punctures when using AR guidance whereas US performance was better in the experienced group. All operators together, accuracy was similar between US and AR guidance, but shorter planning time, puncture time were found for AR guidance., (© 2024. Springer Science+Business Media, LLC, part of Springer Nature and the Cardiovascular and Interventional Radiological Society of Europe (CIRSE).)

Background: Mixed reality offers potential educational advantages in the delivery of clinical teaching. Holographic artefacts can be rendered within a shared learning environment using devices such as the Microsoft HoloLens 2. In addition to facilitating remote access to clinical events, mixed reality may provide a means of sharing mental models, including the vertical and horizontal integration of curricular elements at the bedside. This study aimed to evaluate the feasibility of delivering clinical tutorials using the Microsoft HoloLens 2 and the learning efficacy achieved., Methods: Following receipt of institutional ethical approval, tutorials on preoperative anaesthetic history taking and upper airway examination were facilitated by a tutor who wore the HoloLens device. The tutor interacted face to face with a patient and two-way audio-visual interaction was facilitated using the HoloLens 2 and Microsoft Teams with groups of students who were located in a separate tutorial room. Holographic functions were employed by the tutor. The tutor completed the System Usability Scale, the tutor, technical facilitator, patients, and students provided quantitative and qualitative feedback, and three students participated in semi-structured feedback interviews. Students completed pre- and post-tutorial, and end-of-year examinations on the tutorial topics., Results: Twelve patients and 78 students participated across 12 separate tutorials. Five students did not complete the examinations and were excluded from efficacy calculations. Student feedback contained 90 positive comments, including the technology's ability to broadcast the tutor's point-of-vision, and 62 negative comments, where students noted issues with the audio-visual quality, and concerns that the tutorial was not as beneficial as traditional in-person clinical tutorials. The technology and tutorial structure were viewed favourably by the tutor, facilitator and patients. Significant improvement was observed between students' pre- and post-tutorial MCQ scores (mean 59.2% Vs 84.7%, p < 0.001)., Conclusions: This study demonstrates the feasibility of using the HoloLens 2 to facilitate remote bedside tutorials which incorporate holographic learning artefacts. Students' examination performance supports substantial learning of the tutorial topics. The tutorial structure was agreeable to students, patients and tutor. Our results support the feasibility of offering effective clinical teaching and learning opportunities using the HoloLens 2. However, the technical limitations and costs of the device are significant, and further research is required to assess the effectiveness of this tutorial format against in-person tutorials before wider roll out of this technology can be recommended as a result of this study., (© 2024. The Author(s).)

Background: The prevalence of physical inactivity among children and adolescents is alarmingly high despite the well-documented and comprehensive benefits of regular physical activity (PA). Therefore, PA promotion should start early in childhood and adolescence. Although reducing recreational screen time in children and adolescents is an urgent concern, digital approaches have the potential to make activity promotion attractive and age appropriate for the target group. KIJANI is a mobile app approach to promote PA in children and adolescents via gamification and augmented reality., Objective: This study protocol aims to describe the KIJANI intervention in detail, as well as the evaluation approach., Methods: KIJANI is based on the concept that virtual coins can be earned through PA, for example, in the form of a collected step count. With these coins, in turn, blocks can be bought, which can be used to create virtual buildings and integrate them into the player's real-world environment via augmented reality. PA of users is detected via accelerometers integrated into the smartphones. KIJANI can be played at predefined play locations that were comprehensively identified as safe, child-friendly, and attractive for PA by the target group in a partner project. The evaluation process will be divided into 2 different stages. The phase-I evaluation will be a mixed methods approach with one-on-one semistructured interviews and questionnaires to evaluate the user experience and receive feedback from the target group. After the implementation of results and feedback from the target group, the phase-II evaluation will proceed in the form of a 2-arm randomized controlled trial, in which the effectiveness of KIJANI will be assessed via objectively measured PA as well as questionnaires., Results: The study received ethical approval from the ethical board of the Technical University of Munich. Participants for the phase-I evaluation are currently being recruited., Conclusions: The study will help to determine the efficacy, applicability, and user experience of a gamified activity promotion application in children and adolescents. Overall, digital health approaches provide easy and wide reachability at low cost and are age appropriate and attractive for the target group of adolescents. Strategies have to be developed to apply digital health approaches in the best possible way for activity promotion., International Registered Report Identifier (irrid): DERR1-10.2196/55156., (©Laura Willinger, Birgit Böhm, Florian Schweizer, Lara Marie Reimer, Stephan Jonas, Daniel A Scheller, Renate Oberhoffer-Fritz, Jan Müller. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 03.05.2024.)

Technology have helped surgeons to increase MILS feasibility, so that currently liver surgery evolution is strongly based on technological advances and the same trend is expected even further soon. Aim of the present technical report is to provide insights regarding the possible interplay between 3D reconstructions based on augmented reality and intraoperative navigation by indocyanine green fluorescence. Augmented reality methods based on reconstructions created through artificial intelligence interact synergistically. The better the understanding of the anatomy and characteristics of the lesion, the more accurate the preoperative planning may be scheduled. On the other hand, the better the intraoperative navigation, the more reproducible the preoperative planning becomes., (© 2024. Italian Society of Surgery (SIC).)

The role of the crime scene investigator is complex, and investigators need to be able to conduct multiple frequently performed tasks. Appropriate training and education are critical to impart the crime scene investigator with the necessary capabilities. For a range of reasons, including the COVID-19 pandemic and the need for multi-disciplinary capabilities, training and education requirements have evolved in recent times to be more flexible and accessible. The skills of a crime scene investigator can be broadly categorised into two types of fundamental skills: decision-making and psychomotor skills. Both these skills need to be taught and assessed within training and education programs. The most common approach to impart these skills is by incorporating a crime scene simulation facility; however, not everyone has access to these facilities. Furthermore, crime scene staff often undertake refresher courses and are required to complete proficiency assessments. Conducting these activities in a dedicated crime scene simulation facility is time consuming and costly. Virtual tools have been developed in recent years to address this, but these tools only assess decision-making skills and not psychomotor skills. This paper argues that the implementation of augmented reality (AR) technology should be considered in crime scene investigator training and university education, because it can provide significant advantages when paired with conventional methods of training and education. When appropriately managed, AR can provide an avenue of training where both decision-making and psychomotor skills can be addressed simultaneously, while providing a more flexible and accessible approach. The implementation of AR has the potential to significantly improve the standards of teaching, resulting in better equipped crime scene investigators. The paper will explore how AR has the potential to improve accessibility of training, increase safety, enhance the student experience, enhance collaboration and feedback through connectivity and potentially reduce cost. This paper will also provide an insight into what would need to be considered before implementing AR technology into crime scene investigation training and education alongside current approaches. It is argued that the inclusion of AR into the current training and education arsenal provides significant benefits that are worthy of exploration., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.)

Background: The existing face matching method requires a point cloud to be drawn on the real face for registration, which results in low registration accuracy due to the irregular deformation of the patient's skin that makes the point cloud have many outlier points., Methods: This work proposes a non-contact pose estimation method based on similarity aspect graph hierarchical optimization. The proposed method constructs a distance-weighted and triangular-constrained similarity measure to describe the similarity between views by automatically identifying the 2D and 3D feature points of the face. A mutual similarity clustering method is proposed to construct a hierarchical aspect graph with 3D pose as nodes. A Monte Carlo tree search strategy is used to search the hierarchical aspect graph for determining the optimal pose of the facial 3D model, so as to realize the accurate registration of the facial 3D model and the real face., Results: The proposed method was used to conduct accuracy verification experiments on the phantoms and volunteers, which were compared with four advanced pose calibration methods. The proposed method obtained average fusion errors of 1.13 ± 0.20 mm and 0.92 ± 0.08 mm in head phantom and volunteer experiments, respectively, which exhibits the best fusion performance among all comparison methods., Conclusions: Our experiments proved the effectiveness of the proposed pose estimation method in facial augmented reality., Competing Interests: Declaration of competing interest The authors declare that there are no conflicts of interest related to this article., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Purpose: Biopsies play a crucial role in determining the classification and staging of tumors. Ultrasound is frequently used in this procedure to provide real-time anatomical information. Using augmented reality (AR), surgeons can visualize ultrasound data and spatial navigation information seamlessly integrated with real tissues. This innovation facilitates faster and more precise biopsy operations., Methods: We have developed an augmented reality biopsy navigation system characterized by low display latency and high accuracy. Ultrasound data is initially read by an image capture card and streamed to Unity via net communication. In Unity, navigation information is rendered and transmitted to the HoloLens 2 device using holographic remoting. Concurrently, a retro-reflective tool tracking method is implemented on the HoloLens 2, enabling the simultaneous tracking of the ultrasound probe and biopsy needle. Distinct navigation information is provided during in-plane and out-of-plane punctuation. To evaluate the effectiveness of our system, we conducted a study involving ten participants, assessing puncture accuracy and biopsy time in comparison to traditional methods., Results: Ultrasound image was streamed from the ultrasound device to augmented reality headset with 122.49±11.61ms latency, while only 16.22±11.25ms was taken after data acquisition from image capture card. Navigation accuracy reached 1.23±0.68mm in the image plane and 0.95±0.70mm outside the image plane, within a depth range of 200 millimeters. Remarkably, the utilization of our system led to 98% and 95% success rate in out-of-plane and in-plane biopsy, among ten participants with little ultrasound experience., Conclusion: To sum up, this paper introduces an AR-based ultrasound biopsy navigation system characterized by high navigation accuracy and minimal latency. The system provides distinct visualization contents during in-plane and out-of-plane operations according to their different characteristics. Use case study in this paper proved that our system can help young surgeons perform biopsy faster and more accurately., Competing Interests: Declaration of competing interest The authors declare that they have no conflict of interest, (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Competing Interests: Conflicts of Interest: See Disclosures at the end of the article.

A prerequisite to improving the presence of a user in mixed reality (MR) is the ability to measure and quantify presence. Traditionally, subjective questionnaires have been used to assess the level of presence. However, recent studies have shown that presence is correlated with objective and systemic human performance measures such as reaction time. These studies analyze the correlation between presence and reaction time when technical factors such as object realism and plausibility of the object's behavior change. However, additional psychological and physiological human factors can also impact presence. It is unclear if presence can be mapped to and correlated with reaction time when human factors such as conditioning are involved. To answer this question, we conducted an exploratory study ($N=60$) where the relationship between presence and reaction time was assessed under three different conditioning scenarios: control, positive, and negative. We demonstrated that human factors impact presence. We found that presence scores and reaction times are significantly correlated (correlation coefficient of -0.64), suggesting that the impact of human factors on reaction time correlates with its effect on presence. In demonstrating that, our study takes another important step toward using objective and systemic measures like reaction time as a presence measure.

Augmented Reality (AR) from preoperative data is a promising approach to improve intraoperative tumour localisation in Laparoscopic Liver Resection (LLR). Existing systems register the preoperative tumour model with the laparoscopic images and render it by direct camera projection, as if the organ were transparent. However, a simple geometric reasoning shows that this may induce serious surgeon misguidance. This is because the tools enter in a different keyhole than the laparoscope. As AR is particularly important for deep tumours, this problem potentially hinders the whole interest of AR guidance. A remedy to this issue is to project the tumour from its internal position to the liver surface towards the tool keyhole, and only then to the camera. This raises the problem of estimating the tool keyhole position in laparoscope coordinates. We propose a keyhole-aware pipeline which resolves the problem by using the observed tool to probe the keyhole position and by showing a keyhole-aware visualisation of the tumour. We assess the benefits of our pipeline quantitatively on a geometric in silico model and on a liver phantom model, as well as qualitatively on three patient data., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Microscopes with fluorescence modality for videoangiography (VAG) using indocyanine green or sodium fluorescein (FL) have been used in cerebrovascular surgeries as tools for brain blood flow assessment in vascular diseases, especially in brain aneurysms, extracranial-intracranial bypass, and arteriovenous malformations (AVMs). Indocyanine green-VAG is a well-documented tool frequently employed as an adjunct to microsurgery for AVM treatment. Nevertheless, it's worth noting that the use of FL-VAG has been significantly underrepresented in medical literature, with only a few studies addressing its application in this context. 1 , 2 We report a case of a 33-year-old woman with a grade 1 frontal unruptured AVM, admitted because of recurrent headache. The AVM was exposed with a centered craniotomy (Video 1). Three FL injections were administered at different timing: 1) at the procedure's outset (before any dissection), 2) when the surgeon estimated most feeders had been disconnected, and 3) after the removal of the nidus. FL-VAG allowed visualization of the superficial AVM vessels and its draining veins. After identification and disconnection of feeding arteries, diminished blood flow was visualized and the AVM was completely removed, confirming no residual lesion by absence of FL on the surgical bed. Postoperative digital angiography showed complete removal of the AVM. FL-VAG represents a valuable adjunct in the AVM resection by facilitating the assessment of blood flow within cerebral vessels. This can be helpful to modify surgical strategies in some circumstances (e.g., selection of the main feeders vs. arteries in passage) and to save time making decisions about draining vein division and nidus removal., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Background: Mixed reality may offer an alternative for computer-assisted navigation in shoulder arthroplasty. The purpose of this study was to determine the accuracy and precision of mixed-reality guidance for the placement of the glenoid axis pin in cadaver specimens. This step is essential for accurate glenoid placement in total shoulder arthroplasty., Methods: Fourteen cadaveric shoulders underwent simulated shoulder replacement surgery by 7 experienced shoulder surgeons. The surgeons exposed the cadavers through a deltopectoral approach and then used mixed-reality surgical navigation to insert a guide pin in a preplanned position and trajectory in the glenoid. The mixed-reality system used the Microsoft Hololens 2 headset, navigation software, dedicated instruments with fiducial marker cubes, and a securing pin. Computed tomography scans obtained before and after the procedure were used to plan the surgeries and determine the difference between the planned and executed values for the entry point, version, and inclination. One specimen had to be discarded from the analysis because the guide pin was removed accidentally before obtaining the postprocedure computed tomography scan., Results: Regarding the navigated entry point on the glenoid, the mean difference between planned and executed values was 1.7 ± 0.8 mm; this difference was 1.2 ± 0.6 mm in the superior-inferior direction and 0.9 ± 0.8 mm in the anterior-posterior direction. The maximum deviation from the entry point for all 13 specimens analyzed was 3.1 mm. Regarding version, the mean difference between planned and executed version values was 1.6° ± 1.2°, with a maximum deviation in version for all 13 specimens of 4.1°. Regarding inclination, the mean angular difference was 1.7° ± 1.5°, with a maximum deviation in inclination of 5°., Conclusions: The mixed-reality navigation system used in this study allowed surgeons to insert the glenoid guide pin on average within 2 mm from the planned entry point and within 2° of version and inclination. The navigated values did not exceed 3 mm or 5°, respectively, for any of the specimens analyzed. This approach may help surgeons more accurately place the definitive glenoid component., (Copyright © 2023 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.)

Background: Ophthalmic microscopes have been crucial in visualizing surgical fields, but their limitations in enhancing the surgical view through digital image processing have prompted the development of digital surgical microscopes. The Beyeonics One microscope, a novel digital microscope, offers ophthalmic surgeons a 3D visualization platform and an augmented reality (AR) surgical headset, potentially improving surgical decision-making and outcomes. While its initial use has been described in cataract and corneal surgeries, its application in vitreoretinal surgery remains relatively unexplored., Methods: In this interventional case series, we collected data from the medical records of patients who underwent vitreoretinal surgery using the Beyeonics One 3D visualization platform at the Tel Aviv Medical Center. A total of 36 eyes from 36 subjects were included. Surgical techniques included retinal detachment surgeries and macular surgeries, performed by experienced surgeons. The surgical visualization was facilitated by the Beyeonics One 3D head-mounted display (HMD) platform., Results: The procedures were uneventful, and none intra- or postoperative complications were reported, and surgeons did not experience any signal delay in the real-time video., Discussion: The Beyeonics One microscope offers several potential advantages in vitreoretinal surgery, including digital image processing, enhanced depth perception through the 3D HMD platform, and hands-free image control using head gestures. While this study demonstrates the feasibility and safety of the Beyeonics One microscope, addressing limitations related to hazy views and optimizing image quality are crucial for consistent visualization., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Purpose of Review: Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development., Recent Findings: To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Objective: This study used a virtual environment to examine how older and younger pedestrians responded to simulated augmented reality (AR) overlays that indicated the crossability of gaps in a continuous stream of traffic., Background: Older adults represent a vulnerable group of pedestrians. AR has the potential to make the task of street-crossing safer and easier for older adults., Method: We used an immersive virtual environment to conduct a study with age group and condition as between-subjects factors. In the control condition, older and younger participants crossed a continuous stream of traffic without simulated AR overlays. In the AR condition, older and younger participants crossed with simulated AR overlays signaling whether gaps between vehicles were safe or unsafe to cross. Participants were subsequently interviewed about their experience., Results: We found that participants were more selective in their crossing decisions and took safer gaps in the AR condition as compared to the control condition. Older adult participants also reported reduced mental and physical demand in the AR condition compared to the control condition., Conclusion: AR overlays that display the crossability of gaps between vehicles have the potential to make street-crossing safer and easier for older adults. Additional research is needed in more complex real-world scenarios to further examine how AR overlays impact pedestrian behavior., Application: With rapid advances in autonomous vehicle and vehicle-to-pedestrian communication technologies, it is critical to study how pedestrians can be better supported. Our research provides key insights for ways to improve pedestrian safety applications using emerging technologies like AR.

Purpose: To demonstrate that the augmented reality-assisted puncture technique improves the efficacy of ultrasound-guided puncture to get central venous access (CVA), allows the image to be obtained without limitations, freeing the hands and keeping the gaze continuously on the working field, which contributes to improving the safety of the procedure., Material and Methods: A gelatin mould with a latex surface and a chicken breast with silicone tubes inside were used to simulate vascular punctures. Images were obtained by an ultrasound scanner and post-processed with a specific software. A hologram was obtained and projected onto the previously delimited surface to be punctured. The variables related to image acquisition, the characteristics of the structure to be cannulated and the percentage of successes in the first attempt were analysed. Six operators were involved, using different ultrasound scanners. Efficiency was examined after the application of technical improvements in the process., Results: Seventy-six punctures were performed, guided by two different ultrasound scanners, divided into two groups: 37 with 33 successes (sigma = 3.52 with a process efficiency of 97.98%) and after technical improvements, 39 with 38 successes (sigma = 4.07 with a process efficiency of 99.4%). There are no significant differences among the operators (X2 p  = 0.47) and between the ultrasound scanners (X2 p  = 0.56)., Conclusions: The augmented reality ultrasound-assisted CVA technique may be the next step in standardising the process of cannulation of vascular structures. This technique provides greater accuracy, greater comfort by freeing the hands and keeping the gaze on the working field, better ultrasound image quality, and eliminates variability between operators and sonographers., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

As the field of three-dimensional (3D) visualization rapidly advances, how healthcare professionals perceive and interact with real and virtual objects becomes increasingly complex. Lack of clear vocabulary to navigate the changing landscape of 3D visualization hinders clinical and scientific advancement, particularly within the field of radiology. In this article, we provide foundational definitions and illustrative examples for 3D visualization in clinical care, with a focus on the pediatric patient population. We also describe how understanding 3D visualization tools enables better alignment of hardware and software products with intended use-cases, thereby maximizing impact for patients, families, and healthcare professionals., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Purpose: Patients with incurable corneal diseases experience visual impairment (VI) despite having a healthy retina and optic pathway. Low-vision aids (LVAs) can optimize the use of remaining vision through magnification and contrast enhancement, but do not harness the full visual capacity because they rely on the optic media. Therefore, we investigated a novel laser eyewear (LEW) technology that bypasses the anterior segment of the eye. Images captured by an integrated camera are projected directly onto the retina using a low-energy laser. The patient is able to view a full-color video, realized as augmented reality. We aimed to evaluate the efficacy of the LEW to enhance the vision of individuals with corneal diseases., Design: Prospective, randomized, crossover clinical trial., Participants: We examined the retinal projection glasses in 21 patients (25-69 years) with VI (0.7 logarithm of the minimum angle of resolution [logMAR] or worse) resulting from corneal diseases. Patients with comorbidities that impact vision, such as retinal disorders, were excluded., Methods: Standardized measurements of visual acuity (VA) for near vision (NV) and distance vision (DV) were conducted using ETDRS charts with the respective best correction (BC) and then with LEW. In addition reading speed, vision-related quality of life (QoL) and capacity to carry out daily tasks were assessed at an initial visit and at 2 subsequent visits after a home phase with and without the device. Six weeks after last use of the LEW, an ophthalmologic examination including spectral-domain-OCT or full-field-electroretinography was conducted and compared with baseline findings to evaluate the safety of the device. Four patients participated and completed a subsequent 12-month follow-up phase., Main Outcome Measures: Improvement of VA using the LEW. Secondary objectives included safety, reading speed, QoL, and usability in daily activities., Results: The mean VA in patients with VI was improved by 0.43 logMAR in DV using the LEW compared with BC (P < 0.0001). Using the ×2 magnification mode of the LEW resulted in an average improvement of 0.66 logMAR compared with BC (P < 0.0001). In NV, an increase of 0.47 logMAR was achieved compared with BC (P < 0.0001). Although only 4 of 21 participants were able to read with BC, 17 of 21 participants were able to read with the LEW. Quality of life significantly improved in the 17 participants who completed all visits., Conclusions: We demonstrated that the retinal projection glasses resulted in enhanced VA for all participants by directly projecting images onto the intact retina. In future, the LEW could represent a new option as an LVA for patients with corneal diseases. No pathological alterations were observed in the safety assessments., Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article., (Copyright © 2024. Published by Elsevier Inc.)

Objective: Precise planning and execution is key for neuroendoscopic interventions, which can be based on different available aiding technologies. The aim of this retrospective study is to report a case-based use of guided neuroendoscopy and to develop a stratification algorithm for the available technologies., Methods: We reviewed consecutive neuroendoscopic cases performed at our center from 2016 to 2018. We distinguished between patients receiving a new burr hole (group A) and those with a preexisting burr hole (group B). Case-specific technical requirements for procedure planning and execution, complication rate, surgical outcome, and possible subsequent surgery were evaluated. From this experience, a stratification system was developed to tailor the available guiding technologies., Results: A total of 309 neuroendoscopic interventions in 243 patients were included in the present study. The cases included hydrocephalic (81.6%) and nonhydrocephalic (18.4%) conditions. The interventions were supported by coordinate-based (group A, n = 49; group B, n = 67), guide-based (group A, n = 42; group B, n = 0), ultrasound-guided (group A, n = 50; group B, n = 7), or navigated augmented reality-guided (group A, n = 85; group B, n = 9) techniques. The overall complication rate was 4.5%. Stratified by the surgical indication, fontanel status, entry point localization, presence of a preexisting burr hole, ventricular size, and number of targets, an approach toward image-guided neuroendoscopy is suggested., Conclusions: Planning and technical guidance is essential in neuroendoscopic procedures. The stratified decision-making algorithm for different available technologies aims to achieve lower cost and time consumption, which was found to be safe and efficient. Further investigations are warranted to deliver solid data on procedure efficiency., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

In Mixed Reality (MR), users' heads are largely (if not completely) occluded by the MR Head-Mounted Display (HMD) they are wearing. As a consequence, one cannot see their facial expressions and other communication cues when interacting locally. In this paper, we investigate how displaying virtual avatars' heads on-top of the (HMD-occluded) heads of participants in a Video See-Through (VST) Mixed Reality local collaborative task could improve their collaboration as well as social presence. We hypothesized that virtual heads would convey more communicative cues (such as eye direction or facial expressions) hidden by the MR HMDs and lead to better collaboration and social presence. To do so, we conducted a between-subject study ($\mathrm{n}=88$) with two independent variables: the type of avatar (CartoonAvatar/RealisticAvatar/NoAvatar) and the level of facial expressions provided (HighExpr/LowExpr). The experiment involved two dyadic communication tasks: (i) the "20-question" game where one participant asks questions to guess a hidden word known by the other participant and (ii) a urban planning problem where participants have to solve a puzzle by collaborating. Each pair of participants performed both tasks using a specific type of avatar and facial animation. Our results indicate that while adding an avatar's head does not necessarily improve social presence, the amount of facial expressions provided through the social interaction does have an impact. Moreover, participants rated their performance higher when observing a realistic avatar but rated the cartoon avatars as less uncanny. Taken together, our results contribute to a better understanding of the role of partial avatars in local MR collaboration and pave the way for further research exploring collaboration in different scenarios, with different avatar types or MR setups.

In this manuscript, we have reported an augmented reality (AR) application named, 'Eye MG AR' innovated by us, to show different anatomical/pathological parts of the eyeball pertaining to glaucoma, from multiple customized angles of the user's choice to simplify glaucoma learning and clinical counseling. It is available free of cost from the Google Play Store for Android users. Procedures ranging from a simple outpatient department procedure (yttrium aluminium garnet peripheral iridotomy) to a complex surgical technique (trabeculectomy/tube surgery) can be explained and counseled with this Android application. Also, complex structures such as the angle of the anterior chamber and optic nerve head, are constructed in advanced real-time three-dimensional (3D) high-resolution confocal images. These 3D models are useful for glaucoma neophytes' immersive learning and 3D patient counseling experiences. This AR tool aims to reinvent the approach to glaucoma counseling with 'Unreal Engine' software and is created in a patient-friendly approach. Incepting 3D pedagogy and counseling with AR in glaucoma with real-time and high-resolution TrueColor confocal images has never been reported in the literature according to our knowledge., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

The inferior alveolar nerve block (IANB) is a dental anesthetic injection that is critical to the performance of many dental procedures. Dental students typically learn to administer an IANB through videos and practice on silicone molds and, in many dental schools, on other students. This causes significant stress for both the students and their early patients. To reduce discomfort and improve clinical outcomes, we created an anatomically informed virtual reality headset-based educational system for the IANB. It combines a layered 3D anatomical model, dynamic visual guidance for syringe position and orientation, and active force feedback to emulate syringe interaction with tissue. A companion mobile augmented reality application allows students to step through a visualization of the procedure on a phone or tablet. We conducted a user study to determine the advantages of preclinical training with our IANB simulator. We found that in comparison to dental students who were exposed only to traditional supplementary study materials, dental students who used our IANB simulator were more confident administering their first clinical injections, had less need for syringe readjustments, and had greater success in numbing patients.

Asynchronous digital communication is a widely applied and well-known form of information exchange. Most pieces of technology make use of some variation of asynchronous communication systems, be it messaging or email applications. This allows recipients to process digital messages immediately (synchronous) or whenever they have time (asynchronous), meaning that purely digital interruptions can be mitigated easily. Mixed Reality systems have the potential to not only handle digital interruptions but also interruptions in physical space, e.g., caused by co-workers in workspaces or learning environments. However, the benefits of such systems previously remained untested in the context of Mixed Reality. We conducted a user study ($\mathrm{N}=26$) to investigate the impact that the timing of task delivery has on the participants' performance, workflow, and emotional state. Participants had to perform several cognitively demanding tasks in a Mixed Reality workspace. Inside the virtual workspace, we simulated in-person task delivery either during tasks (i.e., interrupting the participant) or between tasks (i.e., delaying the interruption). Our results show that delaying interruptions has a significant impact on subjective metrics like the perceived performance and workload.

Introduction: This study aimed to investigate the accuracy of cup position and assess the changes in pelvic tilt during primary total hip arthroplasty (THA) in the lateral decubitus position using a new computed tomography (CT)-based navigation system with augmented reality (AR) technology., Materials and Methods: There were 37 cementless THAs performed using a CT-based navigation system with AR technology in the lateral decubitus position and 63 cementless THAs performed using manual implant techniques in the lateral decubitus position in this retrospective study. Postoperative cup radiographic inclination and anteversion were measured using postoperative CT, and the proportion of hips within Lewinnek's safe zone was analyzed and compared between the two groups. The mean absolute values of navigation error were assessed. Intraoperative pelvic tilt angles were also recorded using navigation system., Results: The percentage of cups inside Lewinnek's safe zone was 100% in the navigation group and 35% in the control group (p < 0.001). The mean absolute values of navigation error in inclination and anteversion were 2.9° ± 2.1° and 3.3° ± 2.4°, respectively. The mean abduction angle of the pelvis was 5.1° ± 4.8° after placing the patients in the lateral decubitus position and 4.1° ± 6.0° after cup placement. The mean posterior tilt angle was 6.8° ± 5.1° after placing the patients in the lateral decubitus position and 9.3° ± 5.9° after cup placement. The mean internal rotation angle was 14.8° ± 7.4° after cup placement. There were no correlations between the navigation error in inclination or anteversion and the absolute values of changes of the pelvic tilt angle at any phase., Conclusions: Although progressive pelvic motion occurred in THA in the lateral decubitus position, especially during cup placement, the CT-based navigation system with AR technology improved cup placement accuracy., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Children diagnosed with Autism Spectrum Disorder (ASD) often exhibit motor disorders. Dance Movement Therapy (DMT) has shown great potential for improving the motor control ability of children with ASD. However, traditional DMT methods often lack vividness and are difficult to implement effectively. To address this issue, we propose a Mixed Reality DMT approach, utilizing interactive virtual agents. This approach offers immersive training content and multi-sensory feedback. To improve the training performance of children with ASD, we introduce a novel training paradigm featuring a self-guided mode. This paradigm enables the rapid creation of a virtual twin agent of the child with ASD using a single photo to embody oneself, which can then guide oneself during training. We conducted an experiment with the participation of 24 children diagnosed with ASD (or ASD propensity), recording their training performance under various experimental conditions. Through expert rating, behavior coding of training sessions, and statistical analysis, our findings revealed that the use of the twin agent for self-guidance resulted in noticeable improvements in the training performance of children with ASD. These improvements were particularly evident in terms of enhancing movement quality and refining overall target-related responses. Our study holds clinical potential in the field of medical treatment and rehabilitation for children with ASD.

Currently, we face an exponentially increasing interest in immersion, especially sensory-driven immersion, mainly due to the rapid development of ideas and business models centered around a digital virtual universe as well as the increasing availability of affordable immersive technologies for education, communication, and entertainment. However, a clear definition of 'immersion', in terms of established neurocognitive concepts and measurable properties, remains elusive, slowing research on the human side of immersive interfaces. To address this problem, we propose a conceptual, taxonomic model of attention in immersion. We argue (a) modeling immersion theoretically as well as studying immersion experimentally requires a detailed characterization of the role of attention in immersion, even though (b) attention, while necessary, cannot be a sufficient condition for defining immersion. Our broader goal is to characterize immersion in terms that will be compatible with established psychophysiolgical measures that could then in principle be used for the assessment and eventually the optimization of an immersive experience. We start from the perspective that immersion requires the projection of attention to an induced reality, and build on accepted taxonomies of different modes of attention for the development of our two-competitor model. The two-competitor model allows for a quantitative implementation and has an easy graphical interpretation. It helps to highlight the important link between different modes of attention and affect in studying immersion., Competing Interests: Declaration of Competing Interest The authors have declared no competing interest., (Copyright © 2024. Published by Elsevier Inc.)