1. Video Generation and Synthesis Network for Long-term Video Interpolation
- Author
-
Nayoung Kim, Je-Won Kang, Jung Kyung Lee, Chae Hwa Yoo, and Seung-Hyun Cho
- Subjects
Two generation ,Computer science ,business.industry ,Deep learning ,05 social sciences ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Video sequence ,Function (mathematics) ,010501 environmental sciences ,01 natural sciences ,Term (time) ,0502 economics and business ,Computer vision ,Artificial intelligence ,050207 economics ,business ,0105 earth and related environmental sciences ,Interpolation - Abstract
In this paper, we propose a bidirectional synthesis video interpolation technique based on deep learning, using a forward and a backward video generation network and a synthesis network. The forward generation network first extrapolates a video sequence, given the past video frames, and then the backward generation network generates the same video sequence, given the future video frames. Next, a synthesis network fuses the results of the two generation networks to create an intermediate video sequence. To jointly train the video generation and synthesis networks, we define a cost function to approximate the visual quality and the motion of the interpolated video as close as possible to those of the original video. Experimental results show that the proposed technique outperforms the state-of-the art long-term video interpolation model based on deep learning.
- Published
- 2018
- Full Text
- View/download PDF