Search

Aim: Characterize use and efficacy/effectiveness of virtual, augmented, or mixed reality (VR/AR/MR) technology as non-pharmacological therapy for chronic pain. Methods: Systematic search of 12 databases to identify empirical studies, of individuals who experience chronic pain or illness involving chronic pain, published between 1990 and 2021. JBI Critical Appraisal Checklists assessed study bias and a narrative synthesis was provided. Results: 46 studies, investigating a total of 1456 participants and including 19 randomized controlled trials (RCT), were reviewed. VR/AR/MR was associated with improved pain-related outcomes in 78% of the RCTs. Conclusion: While most studies showed effects immediately or up to one month post treatment, RCTs are needed to further evaluate VR/AR/MR, establish long-term benefits, and assess accessibility, especially among individuals who experience pain management disparities.

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on the idea that the Metaverse represents an applied convergence of Artificial Intelligence of Things (AIoT) and Extended Reality (XR) that intersects with urbanism in terms of the distinctive features of platform-mediated everyday life experiences in cities. However, social interaction and its resulting social organization in the Metaverse are mediated and governed by algorithms and thus submitted to—a dream of—complete logical ordering. This raises a plethora of concerns related to the systemic collection and algorithmic processing of users’ personal, brain, and biometric data, i.e., profound societal—and the hardest to predict ethical—implications. Therefore, this study analyzes and synthesizes a large body of scientific literature on the unfolding convergence of AIoT and XR technologies, neurotechnology, and nanobiotechnology in the realm of the Metaverse in order to derive a novel conceptual framework for the Metaverse as an envisioned virtual model of platform urbanism. Further, it examines the key challenges and risks of these converging technologies in relation to the Metaverse and beyond. This study employs thematic analysis and synthesis to cope with multidisciplinary literature. The analysis identifies seven themes: (1) Platformization, (2) platform urbanism, (3) virtual urbanism, (4) XR technologies, (5) AIoT technologies, (6) neurotechnology, and (7) nanobiotechnology. The synthesized evidence reveals that, while neurotechnology and nanobiotechnology have numerous benefits and promising prospects, they raise contentions and controversies stemming from their potential use to inflict harm to human users—if left unchecked—through the black box of the algorithmic mediation underpinning the Metaverse. The findings serve to steer the Metaverse to contribute to human flourishing and wellbeing by adhering to and upholding ethical principles as well as leveraging its underlying disruptive technologies in meaningful ways. They also aid scholars, practitioners, and policymakers in assessing the pros and cons of these technologies, especially their inevitable ramifications.

Kecakapan literasi perlu ditanamkan sejak dini. Literasi pada anak mampu menstimulasi dalam tahapan ganda anak usia dini yaitu secara kognitif dan bonding. Literasi ini diintegrasikan dengan teknologi berbasis Augmented Reality sebagai salah satu Media Literasi Pendukung untuk anak usia untuk menghadirkan pengalaman visual yang baru agar pengalaman membaca pada anak lebih menyenangkan Penelitian ini bertujuan untuk mengetahui pengaruh model pembelajaran sentra berbasis Augmented Reality untuk meningkatkan perkembangan literasi anak TK B dengan menggunakan pendekatan kuantitatif Quasy Experimental. Sampel yang digunakan adalah anak usia 5-6 tahun atau kelompok B. Pada uji hipotesis diperoleh nilai Sig. (2-tailed) sebesar 0,001 untuk hasil di kelompok eksperimen. Dimana hasil menunjukkan 0,05 berdasarkan pedoman untuk melakukan uji hipotesis bahwa H0 ditolak dan Ha diterima. Sehingga dapat diketahui bahwa terdapat pengaruh yang signifikan dalam model pembelajaran menggunakan AR terhadap kemampuan literasi anak. Sehingga dapat diketahui bahwa ada pengaruh yang signifikan dalam model pembelajaran menggunakan AR terhadap kemampuan literasi anak.

Augmented reality (AR) can bring a new interactive experience to the collaboration between users. When users are in the same place, there are two modes of joint operation for the same object: parallel-work (PW) and cross-work (CW). PW means two users perform their tasks, while CW means assisting each other. To investigate the difference that collaboration using PW and CW in an AR environment brings to users, we developed a two-person local collaboration system, LoCol. We designed and conducted user experiments by selecting the tasks of adjusting the virtual model of the assembly and adding missing boundaries in the model. The results showed that CW led to a higher sense of social coexistence while reducing workload. In terms of task completion time and accuracy, CW and PW each had advantages. We found that users generally want to reduce unnecessary repetitive operations and frequent movement by working with others. This is likely an important criterion for determining who is better suited for a particular job in either approach. Refereed/Peer-reviewed

Augmented reality (AR) technology offers many benefits for language teaching and learning. Using the AR technique in pedagogy attracts and engages children to learn and memorize easily, even in a short time. Visual representation learning method like a pictorial dictionary is one of the beginnings of learning for children. It helps children to visualize the object and memorize it in effective ways. Based on the survey conducted in one of the primary schools at Merlimau, Melaka, it was found that the children have difficulties in learning English. The development of pictorial dictionaries with the combination of AR technology in 3D that are presented in the form of mobile applications can be used to improve existing learning methods in English. The method used during the development of this application is the ADDIE model, which comes with five phases: analysis, design, development, implementation, and evaluation. The development of the ‘smart pictorial dictionary via mobile AR application has been done successfully and has received positive results. Based on the evaluation using the attention relevance confidence satisfaction (ARCS) model, the output has an overall mean of 4.58, which shows that using AR technology in early childhood learning makes children learn more.

The architecture, engineering, and construction (AEC) industry is undergoing a substantial change, and the technological advancements are shaping the future of this industry. Over years, numerous tools have been developed based on building information modeling (BIM) and the Internet of Things (IoT) to manage a variety of tasks and activities within different construction and operational phases in the AEC industry. Recently, with the advent of novel internet-enabled technologies in providing the ability of real-time connectivity, researchers have started to develop virtual design and construction (VDC) and digital twin approaches to remotely monitor, control, and optimize different work progresses and activities in real-time at any work level in the AEC industry. This paper presents a reference model to illustrates the main advantages and applications of VDC and digital twin, and to demonstrate their trends and anticipated cost savings in the AEC industry at a global level. These technological advancements along with augmented reality (AR) and virtual reality (VR) can offer the unique benefit of real-time monitoring of the current status as well as predicting the future of any physical structure at any level of work. The global demand and usage of these technological advancements will lead to great cost savings in the AEC industry which would be US$950 million in design and construction and US$400 million in operation and maintenance phases in the non-residential AEC industry in 2025. This paper also discusses the future challenges of VDC and digital twin in the industry. As a main line of future research, these technologies can simultaneously be utilized with artificial intelligence to enable human-centered decision making to automate and optimize work progresses. Such integrations of VDC, digital twin, artificial intelligence, and human-centered approaches will shape the future of the AEC industry and provide numerous research opportunities in this domain.

Eye-tracking technologies have matured significantly in recent years and have become more affordable and easier to use. We investigated how eye-tracking technology can be applied to evaluate the usability of mobile augmented reality applications with historical images for urban cultural heritage. The experiment involved a series of complex user evaluation sessions, combining semi-structured interviews, observations, think-aloud protocol, SUS questionnaire, and product reaction cards, complemented by eye tracking, to gather insights on the Spotlight Timisoara AR mobile application, part of a digital storytelling multiplatform for the city of Timisoara (Romania), soon to be European Capital of Culture in 2023. The results indicate strong and weak aspects of the application, both as expressed by the participants and as derived from analyzing the eye-tracking data. The paper also lists the main challenges we identified in using eye-tracking equipment to evaluate the usability of such mobile augmented reality applications for urban outdoor heritage.

After the isolation caused by the pandemic, the entertainment sector has been forced to change the way it markets its products and services, and users have been adapting to the change. Companies dedicated to the film industry have had to bet on digital marketing to attract customers through the promotion and advertising of movies, thus attracting a larger audience to their theaters. The objective of this research article is to provide added value and innovation to the advertising promotions of movies in the premiere, through the development of a mobile application based on augmented reality to improve customers’ shopping experience. For which the Agile Mobile-D Methodology was used for the development of the application and the results were studied using 5 indicators: Time to choose a movie, where an improvement of 38.26% was obtained compared to the Pre-Test; regarding the indicator time to acquire information about the movie, an improvement of 81.33% was obtained. 33%; concerning the third indicator, time to initiate the purchase, an improvement of 88% was obtained; concerning the fourth indicator, time to obtain a reminder, an improvement of 83.33% was obtained, making the time with the use of the application shorter; finally, concerning the customer satisfaction indicator, 73% of the users who used the application rated their experience as between satisfied and very satisfied.

Nowadays the technology of augmented reality has become available for a wide audience of users because of a big number of software and hardware enhancements and optimizations done in the last years. The fact that the smartphone is a suitable and relatively cheap device having all the hardware required makes the technology even more accessible and thus widespread. Furthermore, the interaction with three-dimensional objects in space may have positive impact on user’s perception of information. These both facts make the technology of augmented reality a good choice for displaying complex data.The analysis of software plays a significant role in development as it is vital to keep the code clean and sustained all the time. Poor quality code may be unsustainable to the extent it must be fully replaced which results in big losses of resources. In terms of quality checks the analysis must be informative and consume as few resources as possible to be executed so that it is appropriate to perform it regularly. That is the reason for this process to be automated and made convenient to execute and percept.The new system for automatic software analysis is described in this article. ADAR (Architecture Displayer in Augmented Reality) software is best suitable for code coupling and cohesion analysis as it uses three-dimensional graph to display connectivity between parts of software module. High coupling and low cohesion might inform the developers of severe architectural mistakes that may lead to high code fragility. With the use of AR technology the result of high coupling detection analysis in the form of graph is presented in augmented reality to provide user the information in a highly intuitive way.This article also covers different approaches to graph visualization in three-dimensional space. The criteria that allow to achieve high level of aesthetics relative to this problem are stated in paper. The problem of using the force-directed algorithms in terms of high-aesthetic graph visualization is described in details and some arguments pro their usage are given., У статті описано створений програмний комплекс ADAR для статичного аналізу програмного коду з подальшим створенням тривимірної моделі для візуалізації засобами доповненої реальності. Комплекс має природне для людини подання, що дає змогу на інтуїтивному рівні ефективно аналізувати складність зв’язків між різними частинами програмного коду, які виступають критерієм визначення зв’язності, зв’язаності або крихкості компонента.

The post-pandemic period brought with it new challenges for both businesses and private health centers, many of which were affected by the loss of customers. In the case of dental centers, many were affected by the distrust of customers, since activities performed in the oral cavity exposed them to the contagion of Covid-19. This research work proposes the implementation of a mobile application with Augmented Reality (AR) as a strategy for digital marketing immersion, with the aim of achieving a dynamic approach to the services provided in the dental center to customers, this is through the use of this technology in conjunction with social networks, contributing to the improvement of the business and building trust with customers. The application was developed under the Mobile-D methodology with a layered system development architecture, having as indicators the time of elaboration of the advertisement, the cost of information material, the time to inform the services, and the level of customer satisfaction. Finally, the results revealed that the time of elaboration of the advertisement decreased from 25 hours to 14 hours, the cost of informative material was considered "low" since the implementation of the application turns out to be economic, and the time to inform the services in its marketing process went from 30 min to 19 min with the use of the application, finally, the customer satisfaction increased being considered in 87% between "Good" and "Excellent".

Student success in Dynamics, a core subject in Mechanical Engineering courses, requires conceptual understanding of complex systems. Dynamics covers motion of particles and objects, and usually relies on 2 dimensional images and/or written descriptions to explain models and problems. This paper explores the value of visual representation of Dynamics problems with an assumption that it would facilitate student understanding of the content. Two approaches were applied for representation of Dynamics problems with the premise of Bring Your Own Device (BYOD): used with augmented reality and web animation activities. Responses from students and reflection from lecturers were collected and reviewed in relation to the applicability and the ease of use. Students and lecturers both appreciated the benefits of visual representation of complex models, and the possibility of manipulating with virtual objects. Lecturers also appreciated the easy access and use of tools during the class.

Viele medienpädagogische Studien zu Augmented Reality (AR) und Virtual Reality (VR) beziehen sich auf den Einsatz von entsprechenden Anwendungen und Hilfsmitteln im Unterricht. Über die Gestaltung eigener Inhalte für AR und VR, insbesondere im Lehramtsstudium, ist in diesem Zusammenhang wenig veröffentlicht worden. In diesem Beitrag werden im Sinne einer explorativen Pilotierung Hinweise dafür gesucht, dass der gestalterische Umgang mit AR und VR digitale pädagogische Inhaltskompetenzen in Bezug auf diese Technologien fördern kann. Hierfür wurden 13 Lehramtsstudierende des Studiengangs Kindergarten und Primar der Pädagogischen Hochschule St. Gallen befragt. Sie nahmen an einem Modul in der Schnittstelle von Gestaltung und Informatik Teil, in dem neben AR und VR weitere digitale Gestaltungsformen erprobt wurden. Die Onlinebefragung basierte auf dem DPACK-Modell von Döbeli-Honegger (2021), einer Weiterentwicklung des TPACK-Modells (Koehler und Mishra 2009) um die drei Perspektiven der Dagstuhl-Erklärung (Gesellschaft für Informatik – GI 2016): die anwendungsbezogene, die gesellschaftlich-kulturelle und die technologische Perspektive. Neben diversen methodischen Verbesserungspotenzialen für Folgestudien konnten Hinweise dafür gefunden werden, dass die gestalterische Auseinandersetzung mit AR und VR ein interesseweckender Zugang sein kann, der eine bewusste Haltung zu diesen Technologien fördert. Dies müsste jedoch in weiteren Studien mit angepasstem Design untersucht werden.

Today, augmented reality (AR) applications are being used in many fields, such as advertising, entertainment, tourism, and education. Location-based augmented reality (AR) is a technology where interactive digital content is associated with real-world locations and their geo-based markers. The merging of the real-world environment with the digital content occurs when the user reaches these locations. Location-based AR applications are typically experienced using mobile devices with the ability to report the user’s location via GPS. These applications are increasingly used in education, since it has been shown that they positively affect student satisfaction and engagement. Furthermore, it is known in the literature that learner satisfaction and engagement increase when gamification and storytelling techniques are incorporated into the educational process. The aim of the study is to present two location-based, educational augmented-reality applications that utilize gamification and storytelling to provide cultural heritage knowledge about a prehistoric lake settlement. The study also aims to provide ideas and guidance to educators who wish to create applications that transform educational visits to archeological sites and museums into engaging augmented-reality experiences. Both applications underwent a preliminary evaluation using a sample of 71 higher-education students and a sample of 58 school students. The findings showed that the applications scored well in aspects such as ease of use, student satisfaction, and perceived educational usefulness.

One of the difficulties in physics learning is the low motivation to learn because physics materials are considered complex, boring, and abstract for students. Therefore, this research developed an Augmented Reality (AR)-integrated game application "Adventuring Physics" based on android that can create more fun physics learning and provide concept visualization on abstract materials so that they become easier for students to understand. This study aims to develop a valid and practical application of Adventuring Physics games on physics learning. This research uses Research and Development (R&D) design to develop the application. This application has two main features: 'play games' and 'augmented reality'. Furthermore, the game's concept in this application is adapted to the physics materials. Meanwhile, the AR feature in this application can create visualizations in the form of 3D image projections of the material. The results of the validity assessment show that this application is declared valid, feasible, and reliable. In addition, the results of the practicality assessment show that this application is very practical. Thus, the app is worth applying in physics learning. This research has implications as an application of Adventuring Physics that can motivate students to learn physics, apply digital technology in education, and apply it to physics learning.

New teaching techniques have been adopted as a result of the emergence of innovative technological tools in the field of Augmented Reality (AR), as investigated in several articles to date (Hsu 2017; Forsythe & Raine 2019). The availability of AR applications, both vision, and location-based, allows students today to learn foreign languages in a more contextualized and immersive manner, thanks to the use of smartphones and other electronic devices. Thus, this study seeks to analyze and review the recent trends in AR implementation in education and to present the main projects aimed at teaching with AR-based projects that have been published in the latest years in WOS and Scopus.

The performance of smart vehicle (SV) applications like autonomous driving and in-vehicle augmented reality based traffic information system depends on the Field of View (FoV) and the timely processing of the SVs sensor data. Vehicular networking (VN) technology can enhance the performance of these applications by enabling a SV to access the sensing and processing capabilities of other neighbouring SVs. The processing and storage capacity of a SV is limited compared to cloud servers and the communication link between two SVs is unreliable due to their mobility and the nature of wireless channels. Hence, developing efficient processing and sensing schemes for SVs and VNs can help in optimizing the performance of SV applications. In this paper, we propose Contextual Bandits (CB), Markov decision process (MDP) and deep Q-network (DQN) based sensing and processing schemes for VNs. Simulation results show that the proposed schemes outperform the baseline schemes in a variety of scenarios.

El Digital Storytelling (DST) es una estrategia digital que tiene un carácter de multiformato, que permite potenciar habilidades narrativas en los estudiantes de diferentes niveles educativos. Se realizó una investigación con el objetivo central de comprobar la mejora de la competencia narrativa después de una experiencia educativa con el uso de un software Sumac Willaquy (Cuento bonito), que permite aplicar la estrategia de DST. El estudio es de enfoque cuantitativo y de tipo preexperimental. Participaron 70 niños de 5 y 6 años de un centro infantil de Perú distribuidos en tres grupos experimentales bajo dos modalidades de intervención en 2D y 3D. Se adaptó un instrumento sobre competencia narrativa infantil para adecuarlo a las características de los niños de cinco años del contexto peruano. Los resultados indicaron que en la medición del postest, los niños obtuvieron mejores puntuaciones en la competencia narrativa con el uso de la versión 3D más que en la versión 2D. En tal sentido se concluye que el DST es más efectivo en su versión de realidad aumentada. Digital Storytelling (DST) is a digital strategy that has a multiformat character, which allows enhancing narrative skills in students of different educational levels. A research was conducted with the main objective of verifying the improvement of narrative competence after an educational experience with the use of Sumac Willaquy software (Cuento bonito), which allows the application of the DST strategy. The study is quantitative and pre-experimental. Seventy 5-and 6-year-old children from a Peruvian children's center participated, distributed in three experimental groups under two intervention modalities in 2D and 3D. An instrument on children's narrative competence was adapted to suit the characteristics of five-year-old children in the Peruvian context. The results indicated that in the posttest measurement, the children obtained better scores in narrative competence with the use of the 3D version than with the 2D version. In this sense, it is concluded that the DST is more effective in its augmented reality version. Universidad Nacional de San Agustín de Arequipa, UNSA N°IBA-CS-08-2020-UNSA

Industry 4.0 is a revolutionizing concept which has a more significant implication to numerous industries of various sectors worldwide. Industry 4.0 acts as a technical catalyst in accelerated growth through systematic adaptation and new-generation cutting-edge engineering tools. IoT, Blockchain, Artificial Intelligence, Augmented Reality, 3D printing, Big-data analytics, cloud-computing are some of the primary technologies which work in join hand to make the vision of Industry 4.0 successful. In addition, it promotes autonomous industry, which in turn considerably reduces human intervention, thus resulting in efficient working and safeguard companies' interests. Due to the faster adaption of Industry 4.0, authors have attempted to define each and every concept related to it and to explore a futuristic roadmap, special focusing on its implication in the contemporary market. In the 21st century Industry, 4.0 is the need of the hour, so it has become essential to understand the state-of-the-art technologies involved.

Augmented Reality (AR) has shown great potential for improving human performance in Maintenance, Repair, and Overhaul (MRO) operations. Whilst most studies are currently being carried out at an academic level, the research is still in its infancy due to limitations in three main aspects: limited hardware capabilities, the robustness of object recognition, and content-related issues. This article focuses on the last point, by proposing a new geometry-based method for creating a step-by-step AR procedure for maintenance activities. The Fast Augmented Reality Authoring (FARA) method assumes that AR can recognise and track all the objects in a maintenance environment when CAD models are available, to knowledge transfer to a non-expert maintainer. The novelty here lies in the fact that FARA is a human-centric method for authoring animation-based procedures with minimal programming skills and the manual effort required. FARA has been demonstrated, as a software unit, in an AR system composed of commercially available solutions and tested with over 30 participants. The results show an average time saving of 34.7% (min 24.7%; max 55.3%) and an error reduction of 68.6% when compared to the utilisation of traditional hard-copy manuals. Comparisons are also drawn from performances of similar AR applications to illustrate the benefits of procedures created utilising FARA.

This paper reports at Augmented Reality (AR) as a field, where a real time integration of a 3 dimensional real environment and the virtual 3D objects. This paper explains the applications related to medical, engineering, simulation, route planning, entertainment, and military that have been discussed. Two of the greatest challenges in constructing efficient augmented reality or AR systems are registration errors and sensing errors. In this paper, authors summarize current practices to overcome these issues. A discussion of future strategies and the areas requiring more study is done. Moreover, this survey can serve as an initial point for anyone those who are interested in researching and/or using augmented reality. This is because peoples are at a stage wherein adoption of technologies based on augmented reality for enhancement of our perception and to help ourselves sense our environment in a new and an enriched way is the need of the hour.

En esta contribución presentamos el Proyecto Europeo Erasmus+ Fostering Inclusive Learning for children with Dyslexia in Europe by providing easy-touse Virtual and/or Augmented Reality tools and guidelines, cuyo acrónimo es FORDYSVAR. Este proyecto proporciona un enfoque innovador y tecnológico para el tratamiento de la Dislexia en escolares, utilizando la RA y la RV. Entre los objetivos planteados en el proyecto FORDYSVAR destaca el diseño y desarrollo de un software de RV y RA para fomentar el aprendizaje de estudiantes con dislexia con edades comprendidas entre los 10 y los 16 años. Para dar respuesta al problema de investigación se ha seguido el Diseño Centrado en el Usuario (DCU) como metodología en tres fases ya que es imprescindible involucrar a las personas en su diseño y desarrollo, para lograr un mayor compromiso y garantías en su utilización. Consideramos que el trabajo realizado dentro del proyecto europeo Erasmus+ FORDYSVAR puede contribuir al avance en la inclusión, tratamiento y rehabilitación de las personas con dislexia a través de la tecnología y concretamente mediante la Realidad Virtual y Realidad Aumentada, posibilitando un entorno inmersivo y atractivo para desarrollar las habilidades visoespaciales de los estudiantes con dislexia. No obstante, desde el equipo de trabajo, creemos necesario seguir avanzando en este campo con objeto de dar un soporte científico al uso de estas tecnologías emergentes en el diagnóstico y tratamiento de la dislexia In this contribution we present the European Erasmus+ Project Fostering Inclusive Learning for children with Dyslexia in Europe by providing easy-touse Virtual and/or Augmented Reality tools and guidelines, whose acronym is FORDYSVAR. This project provides an innovative and technological approach to the treatment of Dyslexia in schoolchildren, using AR and VR. Among the objectives of the FORDYSVAR project is the design and development of a VR and AR software to promote learning in students with dyslexia between the ages of 10 and 16 years old. In order to answer the research problem, User-Centered Design (UCD) has been used as a methodology in three phases, since it is essential to involve people in its design and development, in order to achieve greater commitment and guarantees in its use. We believe that the work carried out within the European Erasmus+ FORDYSVAR project can contribute to progress in the inclusion, treatment and rehabilitation of people with dyslexia through technology and specifically through Virtual Reality and Augmented Reality, enabling an immersive and attractive environment to develop the visuospatial skills of students with dyslexia. However, from the work team, we believe it is necessary to continue advancing in this field in order to give scientific support to the use of these emerging technologies in the diagnosis and treatment of dyslexia. info:eu-repo/semantics/publishedVersion

Esta investigación tiene como objetivo principal reflexionar sobre la efectividad de las aplicaciones de arqueología virtual en públicos escolares para la comprensión y el aprendizaje del patrimonio arqueológico con el fin de aprehender de qué manera las tecnologías, como la Realidad Aumentada y la Realidad Virtual, pueden aportar un valor añadido a las propuestas educativas realizadas por museos y sitios arqueológicos que no cuentan con esta inclusión. El análisis exploratorio del caso se realiza en el Museo del Mar de Santa Pola (España) que ha desarrollado este tipo de aplicaciones en el yacimiento arqueológico romano que gestiona, el Portus Ilicitanus. The main objective of this research is to reflect on the effectiveness of virtual archaeology applications in school audiences for the understanding and learning of archaeological heritage. This is intended to appreciate how technologies such as Augmented Reality and Virtual Reality can add value to the educational proposals made by museums and archaeological sites that do not have this inclusion. The exploratory analysis of the case is carried out at the Santa Pola Sea Museum (Spain), which has developed this type of applications in the Roman archaeological site it manages, the Portus Ilicitanus.

© 2022 Copyright held by the owner/author(s). Despite the growing applications of smart glass Augmented Reality (AR) in heritage, there is not a framework that can serve as a base for designing meaningful and educational immersive heritage experiences. This article proposes such a prototype design framework for AR experiences in heritage sites, drawing on literature that connects affective experiences with learning, and practically exploring AR as a non-didactic storytelling medium. Smart glass AR is considered here an important technology milestone for creating affective interactions, one that offers visitors/viewers new ways to experience, embody, and have a physical and social interaction with a localized past, and learn about it. Arts and Humanities Research Council Leadership Fellow grant (Grant Ref: AH/S005692/1).

Estimating the depth of virtual content has proven to be a challenging task in Augmented Reality (AR) applications. Existing studies have shown that the visual system makes use of multiple depth cues to infer the distance of objects, occlusion being one of the most important ones. The ability to generate appropriate occlusions becomes particularly important for AR applications that require the visualization of augmented objects placed below a real surface. Examples of these applications are medical scenarios in which the visualization of anatomical information needs to be observed within the patient's body. In this regard, existing works have proposed several focus and context (F+C) approaches to aid users in visualizing this content using Video See-Through (VST) Head-Mounted Displays (HMDs). However, the implementation of these approaches in Optical See-Through (OST) HMDs remains an open question due to the additive characteristics of the display technology. In this article, we, for the first time, design and conduct a user study that compares depth estimation between VST and OST HMDs using existing in-situ visualization methods. Our results show that these visualizations cannot be directly transferred to OST displays without increasing error in depth perception tasks. To tackle this gap, we perform a structured decomposition of the visual properties of AR F+C methods to find best-performing combinations. We propose the use of chromatic shadows and hatching approaches transferred from computer graphics. In a second study, we perform a factorized analysis of these combinations, showing that varying the shading type and using colored shadows can lead to better depth estimation when using OST HMDs.

The state-of-the-art optical see-through head-mounted displays (OST-HMD) for augmented reality applications lack the ability to render correct light interaction behavior between digital and physical objects, known as mutual occlusion capability. This paper presents a novel optical architecture for enabling a compact, high performance, occlusion-capable optical see-through head-mounted display (OCOST-HMD) with correct, pupil-matched viewing perspective. The proposed design utilizes a single-layer, double-pass architecture, offering a compact OCOST-HMD solution that is capable of rendering per-pixel mutual occlusion, a correctly pupil-matched viewing between virtual and real views, and a very wide see-through field of view (FOV). Based on this architecture, we demonstrate a design embodiment and a compact prototype implementation. The prototype offers a virtual display with an FOV of 34 by 22, an angular resolution of 1.06 arc minutes per pixel, and an average image contrast greater than 40% at the Nyquist frequency of 53 cycles/mm. Further, the prototype system affords a wide see-though FOV of 90 by 50, within which about 40 diagonally is occlusion-enabled, along with an angular resolution of 1.0 arc minutes, comparable to a 20/20 vision and a dynamic range greater than 100:1. Lastly, we composed a quantitative color study that compares the effects of occlusion between a conventional HMD system and our OCOST-HMD system and the resulting response exhibited in different studies.

Literature surrounding artificial intelligence (AI)-related applications for hip and knee arthroplasty has proliferated. However, meaningful advances that fundamentally transform the practice and delivery of joint arthroplasty are yet to be realized, despite the broad range of applications as we continue to search for meaningful and appropriate use of AI. AI literature in hip and knee arthroplasty between 2018 and 2021 regarding image-based analyses, value-based care, remote patient monitoring, and augmented reality was reviewed. Concerns surrounding meaningful use and appropriate methodological approaches of AI in joint arthroplasty research are summarized. Of the 233 AI-related orthopaedics articles published, 178 (76%) constituted original research, while the rest consisted of editorials or reviews. A total of 52% of original AI-related research concerns hip and knee arthroplasty (n = 92), and a narrative review is described. Three studies were externally validated. Pitfalls surrounding present-day research include conflating vernacular (“AI/machine learning”), repackaging limited registry data, prematurely releasing internally validated prediction models, appraising model architecture instead of inputted data, withholding code, and evaluating studies using antiquated regression-based guidelines. While AI has been applied to a variety of hip and knee arthroplasty applications with limited clinical impact, the future remains promising if the question is meaningful, the methodology is rigorous and transparent, the data are rich, and the model is externally validated. Simple checkpoints for meaningful AI adoption include ensuring applications focus on: administrative support over clinical evaluation and management; necessity of the advanced model; and the novelty of the question being answered. Cite this article: Bone Joint J 2022;104-B(12):1292–1303.

In spatial augmented reality, a widely dynamic projection mapping system has been developed as a novel approach to graphics presentation for widely moving objects in dynamic situations. However, this method necessitates a novel tracking marker design that is resistant to random and complex occlusion and out-of-focus blurring, which conventional markers have not achieved. This article presents a uniform circumferential marker that becomes an ellipse in perspective projection and expresses geometric information. It can track the relative posture of a dynamically moving sphere with high speed, high accuracy, and robustness owing to continuous contour lines, thereby supporting both wide-range movement in the depth direction and human interaction. Moreover, a biased circumferential marker is proposed to embed unique coding, where the absolute posture is decoded with a novel recognition algorithm. Moreover, rough initialization using the geometry of multiple ellipses is proposed for both markers to start the automatic and precise tracking. Real-time rotation visualization onto the surface of a moving sphere is made possible with the high-speed, widely dynamic projection mapping system. The tracking performance is demonstrated to exhibit sufficient basic tracking performance as well as robustness against blurring and occlusion compared to conventional dot-based markers.

Military technologies are typically the product of long-term development efforts. These technologies are often adapted late in the development process for use by other users, including other members of the defense enterprise, foreign militaries, or the commercial sector. The need to adapt a technology can arise from cost over-runs or changing operational requirements. This article describes a value-based methodology for developing a transition plan early in the development process, when the system is still in the conceptual phase. Performing this analysis early in the design phase allows for design choices that will support adapting the system for other users. Moreover, it provides a risk mitigation strategy against cost over-run and changes in operational requirements. The process begins by capturing the functional architecture of the technology and analyzing them against a set of tasks associated with different military positions. From there, the adapted technology is evaluated for its projected adequacy based on the value added and the effort required for adaptation. The end-state of this analysis is a value-based model that identifies a portfolio of possible alternative markets and/or uses, which can be comparatively analyzed. A case study is presented for adapting a military augmented reality system for a different market.

Augmented reality applications use object tracking to estimate the pose of a camera and to superimpose virtual content onto the observed object. Today, a number of tracking systems are available, ready to be used in industrial applications. However, such systems are hard to handle for a service maintenance engineer, due to obscure configuration procedures. In this article, we investigate options towards replacing the manual configuration process with a machine learning approach based on automatically synthesized data. We present an automated process of creating object tracker facilities exclusively from synthetic data. The data is highly enhanced to train a convolutional neural network, while still being able to receive reliable and robust results during real world applications only from simple RGB cameras. Comparison against related work using the LINEMOD dataset showed that we are able to outperform similar approaches. For our intended industrial applications with high accuracy demands, its performance is still lower than common object tracking methods with manual configuration. Yet, it can greatly support those as an add-on during initialization, due to its higher reliability.

Tujuan penelitian adalah mengembangkan kartu bangun ruang berbasis augmented reality (AR). Metode penelitian yang digunakan adalah penelitian dan pengembangan model ADDIE yang terdiri dari analisis, desain, pengembangan, penerapan, dan evaluasi. Produk divalidasi oleh empat orang ahli yang terdiri dari dua orang ahli materi dan dua orang ahli media. Uji coba produk dilakukan pada 28 siswa kelas VIII SMP Negeri 5 Pontianak. Alat pengumpulan data yang digunakan adalah angket yang terdiri dari angket kelayakan, kepraktisan, dan keefektifan media. Hasil penelitian menunjukkan bahwa kartu bangun ruang berbasis AR layak digunakan berdasarkan hasil uji kelayakan dari ahli media dan materi serta praktis dan efektif berdasarkan hasil uji coba. Berdasarkan hasil uji kelayakan, kepraktisan, dan keefektifan, disimpulkan bahwa kartu bangun ruang berbasis AR layak, praktis, dan efektif untuk disebarluaskan. Kata Kunci: augmented reality; kartu bangun ruang; konsep bangun ruang. Abstract The research aimed to develop an augmented reality (AR)-based spatial card. The research method used the ADDIE research and development model which consists of analysis, design, development, implementation, and evaluation. The product was validated by four experts consisting of two material experts and two media experts. Product trials were conducted on 28 grade VIII students of SMP Negeri 5 Pontianak. The data collection tool used a questionnaire consisting of a feasibility, practicality, and media effectiveness questionnaire. The results of the research showed that AR-based spatial cards were feasible to use based on the results of due diligence from media and material experts and practical and effective based on the results of the trials. Based on the results of the feasibility, practicality, and effectiveness tests, it was concluded that AR-based spatial cards were feasible, practical, and effective for dissemination. Keywords: augmented reality;constructing space card;constructing space concept.

Here, we examine the extension of smart retailing from the indoor confines of stores, outward to high streets. We explore how several technologies at the union of retail intelligence and smart city monitoring could coalesce into retail high streets that are both smart and sentient. We examine the new vantages that smart and sentient retail high streets provide on the customer journey, and how they could transform retailers’ sway over customer experience with new reach to the public spaces around shops. In doing so, we pursue a three-way consideration of these issues, examining the technology that underpins smart retailing, new advances in artificial intelligence and machine learning that beget a level of street-side sentience, and opportunities for retailers to map the knowledge that those technologies provide to individual customer journeys in outdoor settings. Our exploration of these issues takes form as a review of the literature and the introduction of our own research to prototype smart and sentient retail systems for high streets. The topic of enhancing retailers’ acuity on high streets has significant currency, as many high street stores have recently been struggling to sustain custom. However, the production and application of smart and sentient technologies at hyper-local resolution of the streetscape conjures some sobering considerations about shoppers’ and pedestrians’ rights to privacy in public.

The current study aimed to propose a Deep Learning (DL) based framework to retrieve in real-time the position and the rotation of an object in need of maintenance from live video frames only. For testing the positioning performances, we focused on intervention on a generic Fused Deposition Modeling (FDM) 3D printer maintenance. Lastly, to demonstrate a possible Augmented Reality (AR) application that can be built on top of this, we discussed a specific case study using a Prusa i3 MKS FDM printer. This method was developed using a You Only Look Once (YOLOv3) network for object detection to locate the position of the FDM 3D printer and a subsequent Rotation Convolutional Neural Network (RotationCNN), trained on a dataset of artificial images, to predict the rotations’ parameters for attaching the 3D model. To train YOLOv3 we used an augmented dataset of 1653 real images, while to train the RotationCNN we utilized a dataset of 99.220 synthetic images, showing the FDM 3D Printer with different orientations, and fine-tuned it using 235 real images tagged manually. The YOLOv3 network obtained an AP (Average Precision) of 100% with Intersection Over Unit parameter of 0.5, while the RotationCNN showed a mean Geodesic Distance of 0.250 (σ = 0.210) and a mean accuracy to detect the correct rotation r of 0.619 (σ = 0.130), considering as acceptable the range [r − 10, r + 10]. We then evaluate the CAD system performances with 10 non-expert users: the average speed improved from 9.61 (σ = 1.53) to 5.30 (σ = 1.30) and the average number of actions to complete the task from 12.60 (σ = 2.15) to 11.00 (σ = 0.89). This work is a further step through the adoption of DL and AR in the assistance domain. In future works, we will overcome the limitations of this approach and develop a complete mobile CAD system that could be extended to any object that presents a 3D counterpart model.

Augmented reality is a ground-breaking technology that allows users to communicate with an enticing real-world experience to receive messages or knowledge. Today, mask inspection is essential to relay information to society through an augmented reality where extensive information about masks is required and identifying them is challenging. Furthermore, with augmented reality, society may have access to the fascinating way of getting information on the masks, assisting in spreading knowledge, particularly during this pandemic. The augmented reality on a visual inspection mask (ARVIM) was created utilizing 3D images on an Android smartphone platform. The models were created using Blender Animation and Unity 3D software. Vuforia Engine and Android Studio applications were used to build a personalized mobile Augmented Reality application. Google Cloud was used to store data that are accessible to users. ARVIM has facilitated teaching and interaction with 3D AR effects enjoyable for users. The analysis results on the use of ARVIM revealed that ARVIM obtained a high easiness rating of 80%. While 83% of respondents say ARVIM can help distinguish between different types of masks, 88% of respondents agreed that ARVIM's design is acceptable and approachable. This initiative enhances society's education in interactive and mixed-reality innovation settings through a long-distance and innovative teaching method that gives a comprehensive Google Platform experience.

Augmented reality (AR) is a rapidly developing technology that has substantial potential as a novel approach for addiction treatment, including tobacco use. AR can facilitate the delivery of cue exposure therapy (CET) such that individuals can experience the treatment in their natural environments as viewed via a smartphone screen, addressing the limited generalizbility of extinction learning. Previously, our team developed a basic AR app for smoking cessation and demonstrated the necessary mechanisms for CET. Specifically, we showed that the AR smoking cues, compared to neutral cues, elicited substantial cue reactivity (i.e. increased urge) and that repeated exposure to the AR smoking cues reduced urge (i.e. extinction) in a laboratory setting. Here we report the next step in the systematic development of the AR app, in which we assessed the usability and acceptability of the app among daily smokers in their natural environments.Daily smokers (Results indicated high usability and acceptability. Most of the participants (73.9%) used the AR app on at least 5 days. Participants found the AR cues realistic and well-integrated in their natural environments. The AR app was perceived as easy to use (Mean = 4.1/5) and learn (mean of 2 days to learn). Overall satisfaction with the app was also high. Secondary analyses found that 56.5% reported reduced smoking, with an average 26% reduction in cigarettes per day at follow-up.These findings set the stage for a randomized controlled trial testing the AR app as an adjuvant therapy for treating tobacco dependence, with potential applicability to other substances. KEY MESSAGEThis study found that the augmented reality (AR) smartphone application that utlized cue exposure treatment for smoking cessation was perceived as easy to use and learn in the natural, day-to-day environment of daily smokers. Findings set the stage for a larger clinical trial testing the AR app as an adjuvant therapy for treating tobacco dependence, with potential applicability to other addictive behaviors.

International audience; Establishing an effective collaboration between augmented-reality (AR) and remote desktop users is a challenge because collaborators do not share a common physical space and equipment. Yet, such asymmetrical collaboration configurations are common today for many design tasks, due to the geographical distance of people or unusual circumstances such as a lockdown. We conducted a first study to investigate trade-offs of three remote representations of an AR workspace: a fully virtual representation, a first-person view, and an external view. Building on our findings, we designed ARgus, a multi-view video-mediated communication system that combines these representations through interactive tools for navigation, previewing, pointing, and annotation. We report on a second user study that observed how 12 participants used ARgus to provide remote instructions for an AR furniture arrangement task. Participants extensively used its view transition tools, while the system reduced their reliance on verbal instructions.

S2 alar-iliac (S2AI) screws provide spinopelvic fixation with the advantages of minimized dissection, easier rod contouring, and decreased symptomatic screw-head prominence. However, placement of S2AI screws may be challenging because of the anatomy of the lumbosacral junction. Augmented reality is a nascent technology that may enhance placement of S2AI screws.To report the first in-human placement of augmented reality (AR)-assisted S2 alar-iliac screws and evaluate the accuracy of screw placement.A retrospective review was performed of patients who underwent AR-assisted S2AI screw placement. All surgeries were performed by 2 neurosurgeons using an AR head-mounted display (Xvision, Augmedics). Screw accuracy was analyzed in a blinded fashion by an independent neuroradiologist using the cortical breach grading scale.Twelve patients underwent AR-assisted S2AI screw placement for a total of 23 screws. Indications for surgery included deformity, degenerative disease, and tumor. Twenty-two screws (95.6%) were accurate-defined as grade 0 or grade 1. Twenty-one screws (91.3%) were classified as grade 0, 1 screw (4.3%) was grade 1, and 1 screw (4.3%) was grade 3. All breaches were asymptomatic.AR-assisted S2AI screw placement had an overall accuracy rate of 95.6% (grade 0 and grade 1 screws) in a cohort of 12 patients and 23 screws. This compares favorably with freehand and robotic placement. 1,2 AR enables spine surgeons to both better visualize anatomy and accurately place spinal instrumentation. Future studies are warranted to research the learning curve and cost analysis of AR-assisted spine surgery.

Most telemedicine modalities have limited ability to enhance procedural and operative care. We developed a novel system to provide synchronous bidirectional expert mixed reality-enabled virtual procedural mentoring. In this feasibility study, we evaluated mixed reality mentoring of combat casualty care related procedures in a re-perfused cadaver model.Novices received real-time holographic mentoring from experts using augmented reality via Hololens (Microsoft Inc, Redmond, WA). The experts maintained real-time awareness of the novice's operative environment using virtual reality via HTC-Vive (HTC Corp, Xindian District, Taiwan). Additional cameras (both environments) and novel software created the immersive, shared, 3-dimensional mixed reality environment in which the novice and expert collaborated. The novices were prospectively randomized to either mixed reality or audio-only mentoring. Blinded experts independently evaluated novice procedural videos using a 5-point Likert scale-based questionnaire. Nonparametric variables were evaluated using the Wilcoxon rank-sum test and comparisons using the χSurgeon and nonsurgeon novices (14) performed 69 combat casualty care-related procedures (38 mixed reality, 31 audio), including various vascular exposures, 4-compartment lower leg fasciotomy, and emergency neurosurgical procedures; 85% were performed correctly with no difference in either group. Upon video review, mixed reality-mentored novices showed no difference in procedural flow and forward planning (3.67 vs 3.28, P = .21) or the likelihood of performing individual procedural steps correctly (4.12 vs 3.59, P = .06).In this initial feasibility study, our novel mixed reality-based mentoring system successfully facilitated the performance of a wide variety of combat casualty care relevant procedures using a high fidelity re-perfused cadaver model. The small sample size and limited variety of novice types likely impacted the ability of holographically mentored novices to demonstrate improvement over the audio-only control group. Despite this, using virtual, augmented, and mixed reality technologies for procedural mentoring demonstrated promise, and further study is needed.

Over the past years, computationally-intensive mobile applications, such as interactive games and augmented reality, have gained enormous popularity. This phenomenon has placed a serious burden on mobile devices with limited computation resources and constrained battery capacity. Multi-access Edge Computing (MEC) is proposed to solve the problem by offloading part of the computation tasks from mobile devices to edge servers. The fundamental challenge in MEC is how to effectively select a subset of computation tasks to be offloaded so that the application requirements are satisfied and the total energy consumption is minimized. The existing Deep Reinforcement Learning (DRL) based offloading schemes focus on either non-real-time tasks or real-time tasks with soft deadlines. In addition, the existing schemes do not work well when the information of the system environment is not complete. In this paper, we propose an innovative DRL-based task offloading method, PDMO, which guarantees that the deadlines of real-time tasks are met even when the system environment is only partially observable. Our experimental results indicate that PDMO works well in partially observable environments. In addition, it outperforms the existing offloading schemes in terms of energy consumption, deadline miss number and completion rate of non-real-time tasks.

Passengers spend considerable periods of time in shared transit spaces, relying on smartphones and laptops for work. However, these displays are limited in size and ergonomics compared to typical multi-monitor setups used in the office, impairing productivity. Augmented Reality (AR) headsets could provide large, flexible virtual workspaces during travel, enabling passengers to work more efficiently. This paper investigates the factors affecting how passengers choose to layout virtual displays in car, train, subway and plane environments, studying the affordances of each mode of transport and the presence of others. Results from our experiment showed: significant usage of the physical environment to align displays; strong social effects meant avoiding placing displays over other passengers or their belongings; and use of displays for shielding oneself from others. Our findings show the unique challenges posed by the mode of transport and presence of others on the use of AR for mobile productivity in the future.

Zygomaticomaxillary complex fractures involve four fracture ends. It is difficult to fully expose the operative area through a main coronal incision, an intraoral incision, and an eyelid incision. To address the partial visual field loss in craniofacial fracture reduction, we attempted to use an augmented reality (AR) navigation system.Patients with zygomaticomaxillary complex fractures underwent three-dimensional (3D) computed tomography (CT) modeling before surgery, and preoperative plans were designed. The control team used traditional optical navigation to perform the surgery. The experimental team used an AR navigation system. From May 2019 to December 2019, 10 patients with zygomaticomaxillary complex fractures were included in this study. Data were collected after surgery and analyzed.There was a significant difference between the two groups in the fracture point error (1.35 vs. 1.61, P = 0.02) and fracture reduction time (15.40 vs. 20.40, P = 0.03). However, there was no difference in the operative duration (6.60 vs. 6.65, P = 0.92), blood loss volume (620.00 vs. 580.00, P = 0.83), or incidence of complications.The AR navigation system used by the research team has good auxiliary effects for reducing zygomaticomaxillary complex fractures. The new surgical method has better accuracy and a shorter reduction time than the traditional surgical method.

The use of learning media on respiratory system material is needed so that the material presented can be understood thoroughly. One of the media that can be used to visualize the respiratory system material is Augmented Reality (AR). The purpose of this study was to determine the effect of using AR media on improving students' higher order thinking skills on the respiratory system material for class VIII at SMP Negeri 12 Bandar Lampung. The method used in this study is a quasi-experimental method with a non-equivalent pretest-posttest design. The sampling technique in this study used a purposive sampling technique. The research sample used was students of class VIII A as the experimental class and VIII C as the control class, with a total sample of 62 students. The data on the average value of pretest, posttest, and N-Gain as a result of the increase in students were analyzed by using the Independent Sample t-test. The results showed that the HOTS ability of students was in the medium category with N-gain in the experimental class of 0.58 ± 0.21 and the HOTS ability of students in the low category with N-gain in the control class was 0.29 ± 0.14. Statistical analysis with T-test showed that the use of AR media had a significant effect on increasing students' HOTS., Penggunaan media pembelajaran pada materi sistem pernapasan sangat dibutuhkan agar materi yang disampaikan dapat dipahami secara menyeluruh. Salah satu media yang dapat digunakan untuk dapat memvisualisasikan materi sistem pernapasan yaitu Augmented Reality (AR). Tujuan dari penelitian ini adalah untuk mengetahui pengaruh penggunaan media AR terhadap peningkatan higher order thinking skills peserta didik pada materi sistem pernapasan kelas VIII di SMP Negeri 12 Bandar Lampung. Metode yang digunakan dalam penelitian ini adalah metode quasi eksperiment dengan desain Pretest-Posttest Non-equivalent. Teknik pengambilan sampel pada penelitian ini menggunakan teknik purposive sampling. Sampel penelitian yang digunakan adalah peserta didik kelas VIII A sebagai kelas eksperimen dan VIII C sebagai kelas control, dengan jumlah sampel sebanyak 62 siswa. Data rata-rata nilai pretest, posttest, dan N-Gain sebagai hasil peningkatan peserta didik dianalisis dengan uji Independen Sample t-test. Hasil penelitian menunjukkan kemampuan HOTS peserta didik berkategori sedang dengan N-gain pada kelas eksperimen sebesar 0,58 ± 0,21 dan kemampuan HOTS peserta didik berkategori rendah dengan N-gain pada kelas kontrol sebesar 0,29 ± 0,14. Analisis statistik dengan uji T-test menunjukkan bahwa penggunaan media AR berpengaruh signifikan terhadap peningkatan HOTS peserta didik.

Currently, we are witnessing the active introduction of modern digital technologies in the field of education. One of the main reasons for this was the transition to distance learning due to the global COVID-19 pandemic. More and more virtual labs, virtual textbooks, as well as educational platforms that allow students to acquire the necessary skills and abilities remotely using the Internet, are being used in the educational process. The most promising educational platform is an interactive mobile learning platform. It has several advantages, among which one can especially single out the convenience of learning due to its interactivity and organization of the studied material. The application of augmented and virtual reality allows for increasing the effectiveness of classes. These technologies provide another level of interaction and material perception by students. However, VR and its high level of immersion require special equipment and more actions from the user while AR is cheaper and more affordable, but still interactive and has great visual aids. The aim of the paper is to demonstrate how augmented reality can be used for radio engineering disciplines on the example of an interactive mobile platform. This article discusses the process of developing a mobile platform that allows studying the material of radio engineering courses using augmented reality technology. The work also contains the results of a survey conducted among the students who used it as a part of their class activities. In addition, sections of the article contain a description of the project development process, its structure, international experience, and the conclusions.

The attractiveness of traditional exhibition halls to young people is gradually decreasing. Combining modern digital technology to improve the display effect of the exhibition hall can effectively enhance the effect of cultural publicity. This article introduces the technology of image interaction and mixed reality (MR) to improve the historical and cultural propaganda level of the Shaanxi exhibition hall. The advantages of MR technology in applying digital exhibition halls are theoretically expounded. A theoretical plan for Shaanxi history and culture-related display areas is designed using artificial intelligence combined with MR technology. In addition, the survey respondent’s evaluation of the effect of the new exhibition hall is obtained using a questionnaire survey. The survey results show that 97% of people like the history and culture of Shaanxi but only 13% of the people say they know or know very well about the history and culture of Shaanxi. In addition, 60% of the tourists say they are satisfied with the cultural experience of Shaanxi, and only 27% of the tourists are very satisfied. Also, 96% of tourists are willing to experience Shaanxi’s history and culture through digital exhibition halls, and 93% are willing to participate in cultural experience activities based on MR technology. The survey results prove that tourists are satisfied with the effect of the new exhibition hall. Tourists want to add a distinctive form of cultural experience to the exhibition hall. They are willing to accept digital exhibition halls incorporating MR technology and are very happy to participate in the exhibition method of image interaction. This shows that the use of image interactive display based on MR technology in the layout of the exhibition hall is recognized by people and has strong feasibility. This article has reference significance for the digital upgrade of the exhibition hall and the development of the cultural tourism industry.

Current robotic endoluminal interventions require surgeons to hold a proximal joystick to control the distal flexible robot under 2-D X-ray guidance. However, the 2-D X-ray image is not intuitive, which not only increases the risk of surgical misoperation but also the workload of surgeons. Moreover, contact teleoperation exposes surgeons to the potentially infectious environment. To address it, this article proposes an augmented-reality-assisted touchless teleoperated robot for endoluminal intervention, called ARei. It aims to provide immersive experiences with augmented information. The robot integrates perceptual information obtained from an electromagnetic (EM) sensor, a shape sensor, and the virtual anatomy into a head-mounted display (HMD). The touchless teleoperation is used to control the robot, with the assistance of gesture recognition technology. Results show that the mean error of the calibration between the HMD and the EM tracking system is 4.67 mm, and the mean distance error between the points measured by the EM sensor and the points obtained by shape reconstruction with calibration is 5.19 mm (3.05%).

The development of digital intelligent diagnostic and treatment technology has opened countless new opportunities for liver surgery from the era of digital anatomy to a new era of digital diagnostics, virtual surgery simulation and using the created scenarios in real-time surgery using mixed reality. In this article, we described our experience on developing a dedicated 3 dimensional visualization and reconstruction software for surgeons to be used in advanced liver surgery and living donor liver transplantation. Furthermore, we shared the recent developments in the field by explaining the outreach of the software from virtual reality to augmented reality and mixed reality.

Humans are embarking on a new era of space exploration with the plan of sending crewed spacecraft to the Moon, Mars, and beyond. Extravehicular activities (EVAs) will be an essential part of the scientific activities to be carried out in these missions, and they will involve extensive geological fieldwork. These EVAs entail many challenges as real-time support from ground control cannot be provided to astronauts. Hence, new human–machine interfaces are urgently needed to enhance mission autonomy for astronauts and reduce ground communication dependability for real-time operations. This study introduces an Augmented Reality (AR) Internet of Things tool for astronauts to carry out geological activities. It proposes a theoretically-informed user-centred design method supported by expert feedback and an evaluation method. The tool was assessed via questionnaires and semi-structured interviews with European Space Agency (ESA) astronauts and geological field activities experts. Content analysis of the interviews revealed that user satisfaction was the first most mentioned (32% of 139 quotes) usability aspect. Key design factors identified were: displaying solely important information in the field of view while adjusting it to the user's visual acuity, easy usage, extensibility, and simplicity. User interaction was the second most mentioned (24% of 139 quotes) usability aspect, with voice seen as the most intuitive input. Finally, this research highlights important factors determining the usability and operational feasibility of an AR tool for analogue training missions and provides a foundation for future design iterations and an eventual integration of AR into the spacesuit's visor.

This study aimed to investigate the feasibility of a mixed reality (MR)-based hologram for intraoperative navigation in colorectal surgery. Virtual reality (VR) and MR technologies can visualize overlapping three-dimensional (3D) hologram images and real space using the wearable HoloLens2 glasses.This study comprised 13 patients with colorectal cancer. Twelve participants had hologram images created from computed tomography (CT) between August and September 2021. One patient who underwent lateral lymph node dissection (LLND) after this period was included. A 3D hologram of the arteries, veins, and tumor was downloaded to HoloLens2 with the Holoeyes MD system and used during surgery. Hologram visibility, surgical outcome, and the NASA Task Load Index (TLX) were examined.A total of 2 ileocecal resections, 6 right hemicolectomies, 1 partial colectomy, 4 LLNDs, and 1 para-aortic lymph node dissection were performed safely while viewing the holograms. The mean operative duration was 421 [290-555] min, blood loss was 5 [5-15] ml, and the postoperative hospital stay was 10 [9-14] days. Regarding the TLX, the mental demand score was 30 [20-40], the physical demand score was 60 [50-67.5], the temporal demand score was 50 [40-62.5], the performance score was 15 [2.5-35], the effort score was 45 [35-62.5], the frustration score was 60 [50-65], and the weighted workload score was 34 [30.17-45.835].Viewing a hologram in VR/MR can improve the understanding of the anatomy, which cannot be ascertained on a conventional two-dimensional monitor. Holographic guidance is a highly novel surgical concept that can potentially reduce the mental demand on surgeons.