Search

• We propose an approach to compensate the visual defects caused by metamorphopsia • Our approach enables interactive measurement of distortion in user's visual field • We compensate the warped visual field through a real-time processing of video streams • We conducted an experiment on 17 patients affected by metamorphopsia • The results show the proposed system is able to reduce visual field distortion Advances in Augmented Reality technologies and, particularly, the availability of video see-through enabled head mounted displays (HMD), are allowing to devise new strategies to help individuals with visual impairments in daily life. In this work, an approach is proposed to compensate a serious visual impairment, known as metamorphopsia, a vision disorder characterized by deformed images. The goal is to provide patients with a digitally restored visual field, through real-time processing of video see-through streams captured from the HMD. To this regard, we present two contributions, respectively, an interactive discrete modeling of patient's eye-specific vision distortion and a compensation of the latter by means of corresponding real-time counter-distortion of incoming frames. Our approach, indeed, maps each of the video streams acquired by the stereoscopic video see-through cameras aboard the headset on a 2D polygonal mesh which is then counter-warped by moving its vertices based on the previously built distortion model and then displayed, restored, on the HMD's screen. First user evaluations report promising results along with usability issues related to HMD technology. [ABSTRACT FROM AUTHOR]

Abstract: One of the most interesting research lines about avatars is the design and the implementation of a synthetic behaviour able to drive avatar''s actions according to an adaptive interaction paradigm. This aspect, indeed, is of fundamental importance to many advanced applications involving avatars and humans. This study presents a novel framework exploiting augmented reality to visualize a synthetic 3D virtual guide inside an exhibit or a public gallery, to assist visitors wearing a Head Mounted Display during their visit and providing them with both visual and informative enhancements not available in a standard tour. The Human–avatar interaction is approached through a model based on timed automata to address the conversational issues and to improve the quality of interaction by means of an effective synchronization. A usability study conducted on an application of this research to the “avatar assisted tour” of a roman villa, confirms the efficacy of the approach. [Copyright &y& Elsevier]