1. Shape Basis Interpretation for Monocular Deformable 3-D Reconstruction
- Author
-
Francesc Moreno-Noguer, Antonio Agudo, Agencia Estatal de Investigación (España), Google, Ministerio de Economía y Competitividad (España), Ministerio de Ciencia, Innovación y Universidades (España), Institut de Robòtica i Informàtica Industrial, and Universitat Politècnica de Catalunya. ROBiri - Grup de Robòtica de l'IRI
- Subjects
Optimization ,Optimisation [Classificació INSPEC] ,Informàtica::Automàtica i control [Àrees temàtiques de la UPC] ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Bundle adjustment ,02 engineering and technology ,Solid modeling ,Low-rank representation ,Robustness (computer science) ,0202 electrical engineering, electronic engineering, information engineering ,Media Technology ,Structure from motion ,Computer vision ,Electrical and Electronic Engineering ,Monocular ,Basis (linear algebra) ,business.industry ,Deformable shape analysis ,Computer Science Applications ,Distance matrix ,Signal Processing ,020201 artificial intelligence & image processing ,Artificial intelligence ,business ,Dynamic modeling - Abstract
In this paper, we propose a novel interpretable shape model to encode object nonrigidity. We first use the initial frames of a monocular video to recover a rest shape, used later to compute a dissimilarity measure based on a distance matrix measurement. Spectral analysis is then applied to this matrix to obtain a reduced shape basis, that in contrast to existing approaches, can be physically interpreted. In turn, these precomputed shape bases are used to linearly span the deformation of a wide variety of objects. We introduce the low-rank basis into a sequential approach to recover both camera motion and nonrigid shape from the monocular video, by simply optimizing the weights of the linear combination using bundle adjustment. Since the number of parameters to optimize per frame is relatively small, specially when physical priors are considered, our approach is fast and can potentially run in real time. Validation is done in a wide variety of real-world objects, undergoing both inextensible and extensible deformations. Our approach achieves remarkable robustness to artifacts such as noisy and missing measurements and shows an improved performance to competing methods., This work is supported in part by a Google Faculty Research Award, by the MINECO projects HuMoUR TIN2017-90086-R and Mar´ıa de Maeztu Seal of Excellence MDM-2016-0656.
- Published
- 2019