1. An Improved Augmented-Reality Framework for Differential Rendering Beyond the Lambertian-World Assumption
- Author
-
Yan Zhao, Shigang Wang, and Aijia Zhang
- Subjects
business.industry ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer Graphics and Computer-Aided Design ,Rendering (computer graphics) ,Visualization ,medicine.anatomical_structure ,Signal Processing ,medicine ,Computer vision ,Augmented reality ,Human eye ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Caustic (optics) ,Specular reflection ,business ,Software ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
In augmented reality, it is important to achieve visual consistency between inserted virtual objects and the real scene. As specular and transparent objects can produce caustics, which affect the appearance of inserted virtual objects, we herein propose a framework for differential rendering beyond the Lambertian-world assumption. Our key idea is to jointly optimize illumination and parameters of specular and transparent objects. To estimate the parameters of transparent objects efficiently, the psychophysical scaling method is introduced while considering visual characteristics of the human eye to obtain the step size for estimating the refractive index. We verify our technique on multiple real scenes, and the experimental results show that the fusion effects are visually consistent.
- Published
- 2021