Search

Introduction Endoscopic skull base approaches are broadly used in modern neurosurgery. The support of neuronavigation can help to effectively target the lesion avoiding complications. In children, endoscopic-assisted skull base surgery in combination with navigation systems becomes even more important because of the morphological variability and rare diseases affecting the sellar and parasellar regions. This paper aims to analyze our first experience on augmented reality navigation in endoscopic skull base surgery in a pediatric case series. Patients and methods A retrospective review identified seventeen endoscopic-assisted endonasal or transoral procedures performed in an interdisciplinary setting in a period between October 2011 and May 2020. In all the cases, the surgical target was a lesion in the sellar or parasellar region. Clinical conditions, MRI appearance, intraoperative conditions, postoperative MRI, possible complications, and outcomes were analyzed. Results The mean age of our patients was 14.5 ± 2.4 years. The diagnosis varied, but craniopharyngiomas (31.2%) were mostly represented. AR navigation was experienced to be very helpful for effectively targeting the lesion and defining the intraoperative extension of the pathology. In 65% of the oncologic cases, a radical removal was proven in postoperative MRI. The mean follow-up was 89 ± 79 months. There were no deaths in our series. No long-term complications were registered; two cerebrospinal fluid (CSF) fistulas and a secondary abscess required further surgery. Conclusion The implementation of augmented reality to endoscopic-assisted neuronavigated procedures within the skull base was feasible and did provide relevant information directly in the endoscopic field of view and was experienced to be useful in the pediatric cases, where anatomical variability and rarity of the pathologies make surgery more challenging.

Background Accurate glenoid positioning in reverse total shoulder arthroplasty (RSA) is important to achieve satisfying functional outcome and prosthesis longevity. Optimal component placement can be challenging, especially in severe glenoid deformities. The use of patient-specific instruments (PSI) and 3D computer-assisted optical tracking navigation (NAV) are already established methods to improve surgical precision. Augmented reality technology (AR) promises similar results at low cost and ease of use. With AR, the planned component placement can be superimposed to the surgical situs and shown directly in the operating field using a head mounted display. We introduce a new navigation technique using AR via head mounted display for surgical navigation in this feasibility study, aiming to improve and enhance the surgical planning. Methods 3D surface models of ten human scapulae were printed from computed tomography (CT) data of cadaver scapulae. Guidewire positioning of the central back of the glenoid baseplate was planned with a dedicated computer software. A hologram of the planned guidewire with dynamic navigation was then projected onto the 3D-created models of the cadaver shoulders. The registration of the plan to the anatomy was realized by digitizing the glenoid surface and the base of the coracoid with optical tracking using a fiducial marker. After navigated placement of the central guidewires, another CT imaging was recorded, and the 3D model was superimposed with the preoperative planning to analyze the deviation from the planned and executed central guides trajectory and entry point. Results The mean deviation of the ten placed guidewires from the planned trajectory was 2.7° ± 1.3° (95% CI 1.9°; 3.6°). The mean deviation to the planned entry point of the ten placed guidewires measured 2.3 mm ± 1.1 mm (95% CI 1.5 mm; 3.1 mm). Conclusion AR may be a promising new technology for highly precise surgical execution of 3D preoperative planning in RSA.

The COVID-19 pandemic has disrupted traditional global point-of-care ultrasound (POCUS) education and training, as a result of travel restrictions. It has also provided an opportunity for innovation using a virtual platform. Tele-ultrasound and video-conferencing are alternative and supportive tools to augment global POCUS education and training. There is a need to support learners and experts to ensure that maximum benefit is gained from the use of these innovative modalities.

Environment textures are used for the illumination of virtual objects within a virtual scene. Using these textures is crucial for high-quality lighting and reflection. In the case of an augmented reality context, the lighting is very important to seamlessly embed a virtual object within the real world scene. To ensure this, the lighting of the environment has to be captured according to the current light information. In this paper, we present a novel approach by stitching the current camera information onto a cube map. This cube map is enhanced in every single frame and is fed into a neural network to estimate missing parts. Finally, the output of the neural network and the currently stitched information is fused to make even mirror-like reflections possible on mobile devices. We provide an image stream stitching approach combined with a neural network to create plausible and high-quality environment textures that may be used for image-based lighting within mixed reality environments.

Learning anywhere, anytime is becoming ever more a daily routine, due to the increasing and recent growth of information and communication technologies. In the last 5 years, their key characteristic and specifically in the use of mobile equipment and software have been their portability, mobility, and network access. The technological development, including software applications available for the implementation of three-dimensional contents, has been following this trend. Hence, it is important to know whether and how these three-dimensional contents are being integrated in educational situations, namely, regarding augmented reality and mobile learning. Thus, a synthesis of Portuguese and international research works and case studies on the use of three-dimensional augmented reality is chronologically presented along with the evolution of information and communication technologies. The main goal of this knowledge mapping is to contribute to the state of the art in three-dimensional augmented reality technologies in education. In addition, it is aimed at framing the creation and implementation of three-dimensional content in higher education, specifically in the field of mathematics.

Purpose Laparoscopic liver resection has significant advantages over open surgery due to less patient trauma and faster recovery times, yet it can be difficult due to the restricted field of view and lack of haptic feedback. Image guidance provides a potential solution but one current challenge is in accurate “hand–eye” calibration, which determines the position and orientation of the laparoscope camera relative to the tracking markers. Methods In this paper, we propose a simple and clinically feasible calibration method based on a single invariant point. The method requires no additional hardware, can be constructed by theatre staff during surgical setup, requires minimal image processing and can be visualised in real time. Real-time visualisation allows the surgical team to assess the calibration accuracy before use in surgery. In addition, in the laboratory, we have developed a laparoscope with an electromagnetic tracking sensor attached to the camera end and an optical tracking marker attached to the distal end. This enables a comparison of tracking performance. Results We have evaluated our method in the laboratory and compared it to two widely used methods, “Tsai’s method” and “direct” calibration. The new method is of comparable accuracy to existing methods, and we show RMS projected error due to calibration of 1.95 mm for optical tracking and 0.85 mm for EM tracking, versus 4.13 and 1.00 mm respectively, using existing methods. The new method has also been shown to be workable under sterile conditions in the operating room. Conclusion We have proposed a new method of hand–eye calibration, based on a single invariant point. Initial experience has shown that the method provides visual feedback, satisfactory accuracy and can be performed during surgery. We also show that an EM sensor placed near the camera would provide significantly improved image overlay accuracy.

Production lines are nowadays transforming into flexible modular and interconnected cells to react to rapidly changing product demands. The arrangement of the workspace inside the modular cells will vary according to the actual product being developed. Tasks like motion planning will not be possible to precompute. Instead, it has to be solved on demand. Planning the trajectories for the industrial robots with respect to changing obstacles and other varying environment parameters is hard to solve with classical path planning approaches. A possible solution is to employ sampling-based planning techniques. In this paper we present a distributed sampling-based path planner and an augmented reality visualization approach for verification of trajectories. Combining the technologies ensures a confirmed continuation of the production process under new conditions. Using parallel and distributed path planning speeds up the planning phase significantly and comparing different mobile devices for augmented reality representation of planned trajectories reveals a clear advantage for hands-free HoloLens. The results are demonstrated in several experiments in laboratory scale.

Augmented reality as a technology for programming a collaborative robot is in comparison to existing practice a more intuitive, safe and quick approach. This paper shows a novel concept for connecting a physical robot with its virtual twin, using augmented reality as a visual output and a device for interacting with the simulation model. The core of the system is a station control that contains all interfaces, sequencing logics and databases. For programming the robot, the coordinates are created by the operator by interaction and voice input in the augmented reality environment. All information is stored in a shared database which contains assembly plans and instructions for both workers and robots. A demonstration platform is presented, that allows to implement the concept of the system design for an experimental assembly station for human-robot collaboration. The work station includes a Universal Robot 5® that assists the worker in handling of objects and is operated by coordinates from the station control. A Microsoft Hololens® is used for programming the robot in an augmented reality environment which is based on the output of the physical robot and the work system simulation.

There are varieties of methods for realizing augmented reality. A projection type augmented reality proposes augmented information in the real world. Every person can share the experience within the environment. However, the method needs many preparation works and enormous energy for freely projecting images. It can work on only limited conditions, such as indoors or outdoors at night. Our research solves these problems. We propose a method that works in a head-worn type equipment using the method of projection type augmented reality. It recognizes an object from camera images. It projects a mark that carries a little information onto a recognized object. There is an error on the position where the mark projected when the equipment moves. We decrease this error using precise measurements of angular velocity. We propose the method, the implementation and the experiments for evaluating the performance in vitro and in vivo.

Services are one of the main supporting facilities of modern societies. They support users in their everyday life. They provide additional features to their users. They must be useful, usable in the user environment and must correspond to the utilisation pattern of potential users. In modern applications, the user must be able to understand the service on the fly and to appreciate the utility a service provides. The user thus needs a comprehensive service. Models are a mainstay of every scientific and engineering discipline. Models are typically more accessible to study than the systems. Models are instruments that are effectively functioning within a scenario. The effectiveness is based on an associated set of methods and satisfies requirements of utilisation of the model. A typical utilisation of a model is explanation, informed selection, and appropriation of an opportunity. The mental model that a user might have on a service can be supported by a specific general model of the service: the informative model. It generalises such conceptions as the instruction leaflet, the package or product insert, the information and direction for use, and the enclosed label.

Real-time 3D computer graphics technology has advanced to the point of allowing game designers to visualize entire imagined worlds. At the same time there has been a huge growth in data gathered from and representing the real world. Urban design and planning practitioners have used GIS and urban form modeling tools to help structure and mine this and other data to enable better decision-making and more meaningful public involvement in planning processes.

The interactive mode and scene effect of games are facing more and more challenges with increasing attention given by game players. Augmented Reality produces a real-time 3D display effect by overlaying virtual information with the real world. Augmented reality technology is applied in this article to develop an AR basketball smart phone game. Users can control the interaction of their counterparts in the virtual world through image characteristics identification card, which is interactive and playable. The game not only combines entertainment with education, but also offers an immersive experience. More importantly, it is designed to promote the concept that teenagers are expected to change the world through their intelligence and wisdom as well as to have sports and exercise.

This paper presents a method to extract the position and size of objects in movie or drama scenes by creating natural image marker from user images that were fed into and recognizing the created natural image marker. First, the range of natural image marker candidate that the user will utilize in the image is defined. Then, the defined natural image marker candidate is created and analyzed to recommend final natural image marker. If the user image and natural image marker were different, the initial value was set from the user, allowing the user to edit the position or size of object. The position and size information of character are extracted by recognizing the natural image marker. The character image is matched with the image by using the extracted information. Therefore, the position of object can be estimated by frame, on which basis services applying various augmented reality techniques can be developed.

The early application of augmented reality AR was introduced. And the principle and application of mobile AR technology were discussed. Then the present application of mobile AR in e-learning was also discussed. Finally the existing problem and application prospect of mobile AR technology in e-learning were discussed. Our results indicated that the application of mobile AR technology in e-learning improves the students' autonomous learning ability and learning interest, which is very important to personnel training.

Although digital media, social media and new media were found for a while, an overview of integrated multidisciplinary research of new, social and digital media with information technology, such as augmented reality, virtual reality and interactive applications has not been yet presented. This paper discusses the current development of the socially digital media work applying augmented reality for advertising, marketing and display research. These are a very important issue for developing some new social networks, i.e. to connect people through various senses of human (i.e., vision, hearing, somatosensation, olfactory and gustatory). In other words, a literature review of the recent new media and augmented reality works is discussed also. Rather than only augmented reality, this paper also provides a brief concept for future new media research when utilizing and using some other innovative technologies into every human sense. By tackling these complex problems, we can find advanced solutions breeding novel trends in socially digital media and information technology in an integrated and multidisciplinary manner.

This paper describes our efforts in developing real-time projection mapping system, effective technique available in the performance by combining costume and digital technology. Our system can project and align images on the surface of moving actor’s costume by applying augmented reality based on projection mapping, and the images can change frequently during the performance. Therefore, this result can not only describe a particular character effectively, but also offer visual experience to audiences. We explain our result obtained by rehearsing the scenes applying our techniques in the real stage set installed in a wide theater.

In recent decades, advances in research and hardware have significantly improved the quality of augmented reality applications. However, efforts of combining real illumination and virtual illumination have made little progress thus far [1, 2, 3]. In this paper, we propose the position estimation of multiple light sources using a specular reflective sphere placed in front of a camera for relighting in augmented reality applications. For position estimation, we take images to estimate light directions, and then, we estimate the positions of light sources in real time using a sequence of images taken by moving the camera. Our method improves illuminant integration, as more accurate shadows of virtual objects are obtained in comparison with the traditional methods of light source estimation [4, 5, 6, 7]. Further, we obtain not only the direction but also the position of light sources.

Augmented reality is a technology which superimposes virtual objects on real world to provide users with useful information and user interface. AR coloring book is interesting application. In this paper, we propose a texture extraction method from video and image warping method for augmented reality coloring book with vuforia SDK. To realize this idea, we made algorithm to extract specific rectangular area on a paper from video in real-time, and then transforms the image of area into rectangular shape for texture mapping. We expect that our approach will be useful when developers implement new function to AR coloring book with vuforia SDK.

This paper explores options to the built-in authentication mechanism of the Google Glass which is vulnerable to shoulder surfing attacks. Two simple PIN-based authentication techniques are presented, both of which provide protection against shoulder surfing. The techniques employ two interfaces for entering the PIN, namely, voice (Voice-based PIN) and touchpad (Touch-based PIN). To enter the same PIN, user has the freedom to choose either technique and thereby interface, as per the environment in which authentication is being performed. A user study was conducted with 30 participants to compare the performance of the proposed methods with the built-in technique. The results show that the proposed mechanisms have a significantly better login success rate than the built-in technique. Interestingly, although the average authentication times of the proposed methods are higher than that of the built-in one, the users perceived them as being faster. The results also indicate that the proposed methods have better perceived security and usability than the built-in method. The study reveals that when it comes to authentication on augmented reality devices, there is a need for authentication mechanisms that complement each other as users tend to prefer a different interface in different contexts.

Providing a feature-matching strategy to accurately recover tracked features after a fast and large endoscopic-camera motion or a strong organ deformation, is key in many endoscopic-imaging applications, such as augmented reality or soft-tissue shape recovery. Despite recent advances, existing feature-matching algorithms are characterized by limiting assumptions, and have not yet met the necessary levels of accuracy, especially when used to recover features in distorted or poorly-textured tissue areas. In this paper, we present a novel feature-matching algorithm that accurately recovers the position of image features over the entire organ’s surface. Our method is fully automatic, it does not require any explicit assumption about the organ’s 3-D surface, and leverages Gaussian Process Regression to incorporate noisy matches in a probabilistically sound way. We have conducted extensive tests with a large database of more than 100 endoscopic-image pairs, which show the improved accuracy and robustness of our approach when compared to current state-of-the-art methods.

There is a tremendous interest among researchers for the development of virtual, augmented reality and games technologies due to their widespread applications in medicine and healthcare. To date the major applications of these technologies include medical simulation, telemedicine, medical and healthcare training, pain control, visualisation aid for surgery, rehabilitation in cases such as stroke, phobia and trauma therapies. Many recent studies have identified the benefits of using Virtual Reality, Augmented Reality or serious games in a variety of medical applications. This research volume on Virtual, Augmented Reality and Serious Games for Healthcare 1 offers an insightful introduction to the theories, development and applications of virtual, augmented reality and digital games technologies in medical and clinical settings and healthcare in general. It is divided into six sections: section one presents a selection of applications in medical education and healthcare management; Section two relates to the nursing training, health literacy and healthy behaviour; Section three presents the applications of Virtual Reality in neuropsychology; Section four includes a number of applications in motor rehabilitation; Section five aimed at therapeutic games for various diseases; and the final section presents the applications of Virtual Reality in healing and restoration. This book is directed to the healthcare professionals, scientists, researchers, professors and the students who wish to explore the applications of virtual, augmented reality and serious games in healthcare further.

Serious game is now a multi-billion dollar industry and is still growing steadily in many sectors. As a major subset of serious games, designing and developing Virtual Reality (VR), Augmented Reality (AR), and serious games or adopting off-the-shelf games to support medical education, rehabilitation, or promote health has become a promising frontier in the healthcare sector since 2004, because games technology is inexpensive, widely available, fun and entertaining for people of all ages, with various health conditions and different sensory, motor, and cognitive capabilities. In this chapter, we provide the reader an overview of the book with a perspective of future trends of VR, AR simulation and serious games for healthcare.

This paper presents a new approach to modelling the time course of user-experience UX. Flexibility in modelling is essential: to select or develop UX models based on the outcome variables that are of interest in terms of explanation or prediction. At the same time, there is potential for partial re-using UX models across products and generalisation of models. As a case study, an experience model is developed for a particular consumer product, based on a time-sequential framework of subjective well-beingi¾?[ 13 ] and a theoretical framework of flow for human-computer interactioni¾?[ 23 ]. The model is represented as a dynamic Bayesian network and the feasibility and limitations of using DBN are assessed. Future work will empirically evaluate the model with users of consumer products.

In this paper we develop a new approach for reconstructing 3-D scenes from RGB-D data. We use a Markov random field to model appearance relations and geometric cues between different regions of a scene, as a means to provide robustness to noisy and incomplete data often generated by RGB-D devices. A parametric reconstruction of 3-D scenes that enable coherent physical interaction are computed, in near real time, with a standard computer that does not use specialized hardware.

In this paper, marker-less mobile augmented reality based 3D model visualization of efficient design was implemented by applying augmented reality that is recently getting the most brilliant spotlight in the shipbuilding industry. This system helps even an amateur understand relevant individual object with ease by visualizing ship design being progressed based on existing 2D individual object as realistic 3D ship individual object model. This 3D visualization would be helpful for activating negotiation for new shipbuilding order as it is easy to understand virtual ship design.

The advance of technology has brought a revolutionary impact on the development of contemporary exhibition. Using novel technology to plan an exhibition has gradually become the mainstream of exhibition display technology. In this research, we integrate the immersive experience concept and the interactive technology into an immersive interactive exhibition. Besides the static content, the exhibition allows visitors to interact actively with digital contents in an immersive interactive environment through a designed scenario. However, planning an interactive exhibition needs to be customized case by case, which is time-consuming and inefficient. This paper presents an architecture of ImUX Platform (Immersive UX Platform) which integrates the reusable template of interaction in order to save the time costs of the communication between designers and technicians. Through the ImUX Platform, not only can exhibition designers convey their ideas more precisely, but they also can build the immersive interactive environment more quickly and efficiently.

Interactive systems have been used successfully in sports to assist people in achieving their performance goals, however, we believe that some aspects are often overlooked. In this paper we focus on rock climbing and we examine existing work on climbing from varying fields, including sports science, psychology, and climbing literary works, in order to identify recurring motivational themes. In total we identify and describe five key themes from these works: “risk as a measure of progress”, “maintaining challenge”, “social engagement”, “experiencing beauty and nature”, and “documenting and reliving the experience”. We then examine how existing digital climbing experiences address these themes and suggest ways in which these interactive climbing designs could embrace the themes they do not yet address. We believe this work will be important not only when designing digital climbing experiences, but also digital experiences for other extreme sports.

The chapter provides a view of alternative visualisation technologies to support sustainable healthcare. It presents the developments in healthcare to explain the need for disruptive innovation. The chapter then presents the elements of disruptive innovation (DI) in healthcare to explain the need to co-design solutions with all stakeholders. This is followed by a discussion of the implications and opportunities for visualisation technologies to enable co-designing of disruptive healthcare processes and products.

This paper looks through several educational cases applying STEAM using SMART GRID. Then it is followed by the presentation of an educational application for making up the deficiency of examined cases. The educational application is able to calculate and analyze wattage by using the QR codes, which leads to easy solution and self-initiative work for elementary school students regarding their developing stage and interests. The application will be verified its effectiveness and implented augmented reality in the next stage. It is also expected to have beneficial effect on the educational field.

Panoramic image-based representation of real world environments has received much attention in virtual/augmented reality applications due to advantages such as shorter generation times, faster rendering speeds, higher photorealism, and less storage needed when compared to the 3D modeling approaches. In this paper, a novel approach is proposed for generating animated stereo panoramic images based on a single video sequence captured by a panning camera. The techniques involved include generating seamless stereo video textures, inpainting the unsatisfactory regions, and embedding video textures into stereo panoramic images. A player is also developed to provide user stereo visualization and real-time navigation of the image-based virtual environment that are featured with seamlessly-looping animated scenes. The quality of the generated animated stereo panoramic image is satisfactory for virtual reality applications and the computation time is acceptable for practical use.

Pedestrian Navigation System (PNS) is useful for emergency responders, security personnel, and wide range augmented reality applications. Since the majority of these pedestrian navigation applications require walking from outdoor to an indoor destination point, the Inertial navigation System (INS) which is self-contained and immune to jamming/interference are preferred to be used. Due to the sensor properties, a navigation solution of a stand-alone inertial system will drift rapidly, so it relies on external corrections to maintain the system stability and reliability, such as Global Positioning System (GPS). In addition to seeking for external compensation, taking use of constraints deduced from the particular properties of pedestrian application is also well presented. Compared with using external augmentation, these constraints are advantaged of keeping the system independence. In this paper, the walking status detection based on inertial sensor’s properties is investigated. Two constraints are considered to reduce the divergence of the navigation solution caused by the signal errors of accelerometer and gyroscope. One is position update by step detection and the other is the heading angle constraint based on walking status detection. Experiments results show that different walking status: static, walking forward, or turning, can be well distinguished by the signal properties during walking.

The paper describes a novel, declarative language that enables modelling ubiquitous, contextual and interactive augmented reality environments. The language, called CARL – Contextual Augmented Reality Language, is highly componentised with regards to both the structure of AR scenes as well as the presented AR content. This enables dynamic composition of CARL presentations based on various data sources and depending on the context. CARL separates specification of three categories of entities constituting an AR environment – trackable markers, content objects and interfaces, which makes the language more flexible and particularly well suited to building collective awareness systems based on ubiquitous AR-based information visualisation.

We developed a multi-view video camera system that works inside the abdominal cavity to obtain a wider range of information during laparoscopic and robotic surgery. This video camera system is able to enter the abdominal cavity and surround an organ in a fixed degree. We conducted in vitro and in vivo experiments to clarify the functions of the system. The advantage of the system is that it can alter the viewpoint without physically moving the camera and can obtain diversified intraperitoneal information. Moreover, by taking advantage of its video image array with geometrical regularity, we build a novel augmented reality function compared with the images for conventional navigation surgery.

Augmented-Reality (AR) displays increase surgeon’s visual awareness of high-risk surgical targets (e.g., the location of a tumor) by accurately overlaying pre-operative radiological 3-D model onto the intra-operative laparoscopic video. Existing AR systems are not robust to sudden camera motion or prolonged occlusions, which can cause the loss of those anchor points tracked along the video sequence, and thus the loss of the AR display. In this paper, we present a novel AR system, integrated with a novel feature-matching method, to automatically recover the lost augmentation by predicting the image locations of the AR anchor image-points after sudden image changes. Extensive experiments on challenging surgical video data are presented that show the accuracy, speed, and robustness of our designs.

In recent years, more and more researchers try to make Microsoft Kinect and Augmented Reality (AR) into real lives. In this paper, we try to utilize both Kinect and AR to build a dynamic fitting room. We can automatically measure the clothes size of a user in popular brands or different country standards. A user can utilize gesture to select cloths for fitting. Our proposed system will project the video dynamically of dressing selected clothes in accordance with the captured video from Kinect. This system can be utilized in clothing store, e-commerce of clothes shopping, and at your home when you are confusing choosing a clothes to wear. This can greatly reduce the time you fitting clothes.

In a previous work, we confirmed the existing effects of “Out of the Body” tactile illusion for virtual and augmented objects through funneling and saltation. However, it required a virtual imagery to be attached to the user for directly extending one’s body. This paper aims at investigating similar phantom tactile sensations exist when the virtual object is visually detached from the user’s body. Two usability experiments were conducted to verify the hypothesized phantom tactile effects: one for funneling and the other, saltation. Our results have shown that in addition to the perception of the phantom sensations with the “detached” visual feedback, the interaction experience was significantly enriched (vs. when without explicit visual feedback). We also discovered for the first time that for funneling, phantom sensations can be elicited without any visual feedback at all. The findings can be applied to the tactile interaction design using minimal number of actuators on a variety of media platforms including the mobile, holography and augmented reality.

This article examines applications of Spatial Augmented Reality SAR in architectural and engineering collaboration. These applications can be split into four SAR configurations supported by an innovative software program SketSha which enables remote sharing of graphic documents and annotations in real time; remote expert consultation, collaborative design, project review and group evaluation are all implemented in collaborative design training. Analysis of how SAR affects instrumented training activities is qualitatively conducted on four axes: 1 the status of the object being collaboratively designed; 2 the status of the document as an intermediary object for collaboration; 3 the status of the participants in aiding collective intelligence to emerge and 4 the status of workspace as we question the "co-presence / remote" dichotomy in synchronous relations.

In this paper, we propose a Trans-Space convergence system that exploits realistic 3D remote collaboration with spatial co-presence by using augmented reality technology. To experience it, we define two major enabling technologies: 1 Context-of-Interest CoI based Trans-Space registration and selective augmentation and 2 augmented object interaction for realistic collaboration. Through these technologies, a user wearing augmented reality AR glasses can naturally experience remote collaboration with spatial co-presence while moving in space. We implemented a prototype of the Trans-Space for a preliminary test experiencing spatial co-presence in an indoor environment. With an assumption that a common physical CoI is in each space, a distant mirror space can be conveniently linked with real user's mirror space and they are merged together as a Trans-Space. Through the proposed convergence system, a human's co-presence experience can be enlarged by selectively context sharing and effectively spatial interaction between remote mirror spaces. We expect this is applicable to AR-based time/space transcended smart applications, such as the next generation of experimental education, training, medical surgery, and entertainment.

This article examines from a theoretical academic research, concepts, definitions and elements that consist the universe of virtual reality (VR) and Augmented Reality (AR), with the goal of applying them to spaces constructed both by professionals specialized in developing environments, as many by its users.

3D stereoscopic vision is used in many applications, but the level of benefit to the user differs depending on the particular application. We studied its benefits for command and control applications such as battlefield visualization or disaster response. We conducted experiments where the subjects completed some simple military planning exercises both with and without 3D vision. 3D users had lower error when judging line of sight between two points. Furthermore, survey results show that subjects preferred 3D. We also compared two ways of rendering symbols in the environment. Billboard symbols were more efficient than draping the symbol on the terrain.

This paper presents the development and testing of a Virtual Camera (VC) system to improve astronaut and mission operations situation awareness while exploring other planetary bodies. In this embodiment, the VC is implemented using a tablet-based computer system to navigate through interactive database application. It is claimed that the advanced interaction media capability of the VC can improve situation awareness as the distribution of human space exploration roles change in deep space exploration. The VC is being developed and tested for usability and capability to improve situation awareness. Work completed thus far as well as what is needed to complete the project will be described. Planned testing will also be described.

This paper presents a review of recent developments and future perspectives, addressing the problem of creating a virtual dressing room. First, we review the current state-of-the-art of exiting solutions and discuss their applicability and limitations. We categorize the exiting solutions into three kinds: (1) virtual real-time 2D image/video techniques, where the consumer gets to superimpose the clothes on their real-time video to visualize themselves wearing the clothes. (2) 2D and 3D mannequins, where a web-application uses the body measurements provided by the customer, to superimpose the standard sizes to fit a customized 2D or 3D mannequin before buying. (3) 3D camera and laser technologies which acquire 3D information of the costumer, enabling estimation of the body shape and measurements. Additionally, we conduct user studies to investigate the user behavior when buying clothes and their demands to a virtual dressing room.

Augmented reality applications are beginning to reach the general public due to the widespread use of smartphones and tablet devices. Most AR systems require the use of image processing techniques to superimpose the virtual information over the image of the real world. However, this may quickly consume the battery of the user’s device. In this paper, we design and implement an AR system for indoor environments that relies on an external ultrasound localization system and on the inertial sensors embedded in the device to estimate the position and orientation of the user. The system was implemented on a tablet device, offers several functionalities, such as visualization of virtual objects and interaction with the virtual view, and aims at providing appropriate accuracy for a satisfactory user experience without the need of using costly vision-based techniques.

We introduce a natural feature tracking approach that facilitates the tracking of rigid objects for an on-site assembly assistance system. The tracking system must track multiple circuit boards without added fiducial markers, and they are manipulated by the user. We use a common SIFT feature matching detector enhanced with a probability search. This search estimates how likely a set of query descriptors belongs to a particular object. The method was realized and tested. The results show that the probability search enhanced the identification of different circuit boards.

We propose a new depth correction method for the Kinect through the analysis of the technology behind this sensor. The depth values obtained from the Kinect are sometimes inaccurate because the manufacturer's calibration between IR projector and IR camera becomes invalid by the tolerances in manufacturing, temperature variation and vibration during transportation. To improve the results from the previous methods, an analytic approach is presented in this paper considering that the depth measurement principle of the Kinect is triangulation. Experiments show that the induced depth correction model is reasonable and the results from the proposed approach are better than those of the previous approaches.

The development of mobile and location-based technologies intensifies media use in public space. Media theorist Eric Kluitenberg emphasizes this emerging trend, as he notes that the city becomes an intensified mediatized space where the modus operandi is carried out almost without thinking. The aim of this article is to show, with the use of location-based audio walks as case studies, how this intensive hybridization of space on the contrary is able to provide new possibilities to engage with space. The power of location-based audio walks is its aesthetic and poetic potential of layering new information over a physical space, while revealing the stories, memories and history of specific physical locations. In doing so, these audio walks can be seen as a poetic act: they draw together human involvement and invite engagement with reality to such an extent that it enters consciousness and it re-imagines space poetically.

Realistic motion of virtual characters is a crucial factor for the reality and immersiveness of an AR application. Motion graph-based approach allows for generating infinitely many types of motions and may create remarkably realistic human motion from a limited set of motion data. In this paper, we present a method to efficiently search the motion graph using A* search algorithm in an AR environment. Specifically, we introduce three types of heuristic functions: the distance, previewed distance, and directional heuristic functions. The proposed heuristic functions reduce compute time significantly while not sacrificing the quality of motion. We demonstrate the effectiveness of our method by implementing an interactive AR application.

With the rapid development of such disciplines and areas as computer vision, computer graphics, Internet, communication network and the software and hardware of computers, researches on the theory of AR technology and on the commercial application have been undertaken with great achievements in recent years, hence successful application of AR technology to such domains as military affairs, education and entertainment. This thesis shall begin with the model of animation characters, research the feasibility of application of AR technology to instructional system of design of animation model, design the model of digital instructional system of model design based upon AR technology. Through experimental tests and researches, it also analyzes the advantages of that system in teaching practices of model designing, argument relevant key technology in the system and provides experimental results of the working system.

Video-based Augmented Reality (VAR) aims to add 3D virtual objects (3D VOs) to a real world video sequence, in order to provide additional and useful information to facilitate some tasks, like computer aided surgery, simulation in a real environment, satellite positioning, interior design, among others. To achieve a consistent and convincing augmented scene, it is necessary that the VOs are properly occluded by real objects (Occlusion Problem in VAR); in this paper, we present a strategy based on the use of the Kinect sensor to solve this problem. In the occlusion stage we evaluate distances between real and VOs. Then, the parts of the VO occluded by a real object are calculated and removed. We found that the Kinect sensor is appropriate to be used for handling occlusions in indoor environments, dynamic scenarios and real-time applications. Experiments showed comparable results with the state of the art in both issues: occlusion handling and processing time.

Robust real time object pose tracking is an essential component for robotic applications as well as for the growing field of augmented reality. Currently available systems are typically either optimized for textured objects or for uniformly colored objects. The proposed approach combines complementary interest points in a common tracking framework which allows to handle a broad variety of objects regardless of their appearance and shape. A thorough evaluation of state of the art interest points shows that a multi scale FAST detector in combination with our own image descriptor outperforms all other combinations. Additionally, we show that a combination of complementary features improves the tracking performance slightly further.