1. Video Vectorization via Bipartite Diffusion Curves Propagation and Optimization
- Author
-
Yanwen Guo, Jing Hong, Jie Zhu, Jie Guo, Chuan Wang, Jue Wang, Yuanqi Li, and Wenping Wang
- Subjects
Computer science ,Frame (networking) ,Feature extraction ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,computer.file_format ,Iterative reconstruction ,Computer Graphics and Computer-Aided Design ,Feature (computer vision) ,Signal Processing ,Image tracing ,Computer Vision and Pattern Recognition ,Raster graphics ,Representation (mathematics) ,Diffusion curve ,computer ,Algorithm ,Software - Abstract
We propose a new video vectorization approach for converting videos in the raster format to vector representation with the benefits of resolution independence and compact storage. Through classifying extracted curves in each video frame into salient ones and non-salient ones, we introduce a novel bipartite diffusion curves (BDCs) representation in order to preserve both important image features such as sharp boundaries and regions with smooth color variation. This bipartite representation allows us to propagate non-salient curves across frames such that the propagation, in conjunction with geometry optimization and color optimization of salient curves, ensures the preservation of fine details within each frame and across different frames, and meanwhile, achieves good spatial-temporal coherence. Thorough experiments on a variety of videos show that our method is capable of converting videos to the vector representation with low reconstruction errors, low computational cost, and fine details, demonstrating our superior performance over the state of the art. We also show that, when used for video upsampling, our method produces results comparable to video super-resolution.
- Published
- 2022
- Full Text
- View/download PDF