结合时空特征和视觉感知的全参考视频质量评价.

Video distortion mainly comes from the degradation of video quality caused by spatial and temporal distortion. Aiming at these two kinds of video quality degradation, this paper proposed a full-reference video quality assessment method STPFVQA combining spatio-temporal features and visual perception. Firstly, the method extracted spatial perceptual features from reference video and distorted video using ResNet50 convolutional network. Secondly, the method feeded the extracted spatial perceptual features into transformer’s encoder and decoder to construct the serialization relationship of the video, and at the same time to explore the effect of distortion on the video serialization relationship by comparing the reference video and distorted video Then, the method sent the output of the transformer to the prediction header to form a frame-level score Finally, in order to simulate the hysteresis of human visual system perception, this paper obtained the video quality score from the short-term, long-term and global memory effects. To verify the feasibility of the method, this paper conducted experiments on four datasets, respectively LIVE,IVC-IC,CSIQ,and IVPL. The experimental results show that the proposed method is more consistent with the perception of the human visual system. Compared with the state-of-the-art serial dependence model（SDM） on the IVC-IC and CSIQ datasets, the SROCC is 2.6% and 3.1% higher, the KROCC is 6.1% and 7.9% higher, and the PLCC is 2.3% and 5.5% higher. [ABSTRACT FROM AUTHOR]