Search

Multiview video (MVV) can provide viewers a complete 3D perception by its multiple-viewpoint feature. In order to support smooth viewpoint switching, virtual view synthesis is required. However the ultra high computational complexity and the system memory bandwidth requirement make the real-time multiview applications difficult. For the quad full-HD (QFHD) specification, 31.5GByte/Sec is needed for every virtual view. Furthermore, the conventional line buffer based or block based data scheduling cannot support the various geometries required in the virtual view synthesis. In the paper, a six-dimensional free-viewpoint view synthesis flow is proposed. By the proposed texture reorder and inverse reorder data interface, the on-chip data scheduling can be done under the conventional block pipelining even with different geometries. After integrating the proposed bandwidth reduction schemes, including the dynamic warping reference frame selection and on-chip texture buffer optimization, 95.7% system memory bandwidth is saved. Comparing with the previous 1D-horizontal-shifting-based 3DTV chips, the proposed scheduling provides full geometries including translations and rotations in the 3D space.

Multiview video (MVV) can provide viewers a complete 3D perception by its multiple-viewpoint feature. In order to support smooth viewpoint switching, virtual view synthesis is required. However, color and illumination information varies between views according to the light field conditions. This mismatch leads to ghost effects and wrong reflection phenomena. In this paper, a hybrid color compensation method is proposed. With the proposed inter-view color correspondence estimation, a smoothly changing color/illumination field is established between reference views. Furthermore, the reflection on mirrorlike materials can also be detected and optimized by the proposed hybrid reflection model. As a result, virtual view frames with better perceptual quality are generated. In the objective test, the proposed algorithm also provides 0.26–0.42 dB PSNR gains.

As the history of television industry goes, multiview video (MW) and its applications draw more and more attentions by the realistic 3D scene it can bring. In these applications, virtual view synthesis is required for providing free view point sequences so as to fulfill a real-time display system. In this paper, a low-area architecture is proposed. By employing the linear-interpolated approximation algorithm, the large area requirement due to the synthesis parameters is resolved. In addition, redundant information for fraction bits of parameters is further reduced by precision fitting analysis. As a result, 95.9% of area for matrix parameter rendering stage and 69.5% for vector transform stage are reduced with only 0.0059 dB overhead of PSNR performance.