Back to Search Start Over

An End-to-End No-Reference Video Quality Assessment Method With Hierarchical Spatiotemporal Feature Representation.

Authors :
Shen, Wenhao
Zhou, Mingliang
Liao, Xingran
Jia, Weijia
Xiang, Tao
Fang, Bin
Shang, Zhaowei
Source :
IEEE Transactions on Broadcasting; Sep2022, Vol. 68 Issue 3, p651-660, 10p
Publication Year :
2022

Abstract

In this paper, we propose a deep neural network-based no-reference (NR) video quality assessment (VQA) method with spatiotemporal feature fusion and hierarchical information integration to evaluate the perceptual quality of videos. First, a feature extraction model is proposed by using 2D and 3D convolutional layers to gradually extract spatiotemporal features from raw video clips. Second, we design a hierarchical branching network to fuse multiframe features, and the feature vectors at each hierarchical level are comprehensively considered during the process of network optimization. Finally, these two modules and quality regression are synthesized into an end-to-end architecture. Experimental results obtained on benchmark VQA databases demonstrate the superiority of our method over other state-of-the-art algorithms. The source code is available online. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00189316
Volume :
68
Issue :
3
Database :
Complementary Index
Journal :
IEEE Transactions on Broadcasting
Publication Type :
Academic Journal
Accession number :
158914480
Full Text :
https://doi.org/10.1109/TBC.2022.3164332