Search

Multiview video (MVV) can provide viewers a complete 3D perception by its multiple-viewpoint feature. In order to support smooth viewpoint switching, virtual view synthesis is required. However the ultra high computational complexity and the system memory bandwidth requirement make the real-time multiview applications difficult. For the quad full-HD (QFHD) specification, 31.5GByte/Sec is needed for every virtual view. Furthermore, the conventional line buffer based or block based data scheduling cannot support the various geometries required in the virtual view synthesis. In the paper, a six-dimensional free-viewpoint view synthesis flow is proposed. By the proposed texture reorder and inverse reorder data interface, the on-chip data scheduling can be done under the conventional block pipelining even with different geometries. After integrating the proposed bandwidth reduction schemes, including the dynamic warping reference frame selection and on-chip texture buffer optimization, 95.7% system memory bandwidth is saved. Comparing with the previous 1D-horizontal-shifting-based 3DTV chips, the proposed scheduling provides full geometries including translations and rotations in the 3D space.

As the history of television industry goes, multiview video (MW) and its applications draw more and more attentions by the realistic 3D scene it can bring. In these applications, virtual view synthesis is required for providing free view point sequences so as to fulfill a real-time display system. In this paper, a low-area architecture is proposed. By employing the linear-interpolated approximation algorithm, the large area requirement due to the synthesis parameters is resolved. In addition, redundant information for fraction bits of parameters is further reduced by precision fitting analysis. As a result, 95.9% of area for matrix parameter rendering stage and 69.5% for vector transform stage are reduced with only 0.0059 dB overhead of PSNR performance.

Multiview video can bring the 3D and virtual reality perceptual experience to users by its multiple view point characteristic. To support the smooth and free view point switching, both matrix-based depth image based rendering and the complex virtual view interpolation schemes are required. In order to reduce the high computation complexity and avoid the iterative processing scheduling in conventional view interpolation flows, a single iteration view interpolation algorithm is proposed. By use of the proposed algorithm, the redundant warping operations are reduced by 86%. In addition, based on the proposed artifact detecting and removing algorithm, artifacts due to imperfect depth maps can be detected and eliminated at the same time. Therefore, no additional post-processing or iteration is required and the single iteration processing is achieved.