Back to Search Start Over

A Psychovisual Quality Metric in Free-Energy Principle.

Authors :
Zhai, Guangtao
Wu, Xiaolin
Yang, Xiaokang
Lin, Weisi
Zhang, Wenjun
Source :
IEEE Transactions on Image Processing; Jan2012, Vol. 21 Issue 1, p41-52, 12p
Publication Year :
2012

Abstract

In this paper, we propose a new psychovisual quality metric of images based on recent developments in brain theory and neuroscience, particularly the free-energy principle. The perception and understanding of an image is modeled as an active inference process, in which the brain tries to explain the scene using an internal generative model. The psychovisual quality is thus closely related to how accurately visual sensory data can be explained by the generative model, and the upper bound of the discrepancy between the image signal and its best internal description is given by the free energy of the cognition process. Therefore, the perceptual quality of an image can be quantified using the free energy. Constructively, we develop a reduced-reference free-energy-based distortion metric (FEDM) and a no-reference free-energy-based quality metric (NFEQM). The FEDM and the NFEQM are nearly invariant to many global systematic deviations in geometry and illumination that hardly affect visual quality, for which existing image quality metrics wrongly predict severe quality degradation. Although with very limited or even without information on the reference image, the FEDM and the NFEQM are highly competitive compared with the full-reference SSIM image quality metric on images in the popular LIVE database. Moreover, FEDM and NFEQM can measure correctly the visual quality of some model-based image processing algorithms, for which the competing metrics often contradict with viewers' opinions. [ABSTRACT FROM PUBLISHER]

Details

Language :
English
ISSN :
10577149
Volume :
21
Issue :
1
Database :
Complementary Index
Journal :
IEEE Transactions on Image Processing
Publication Type :
Academic Journal
Accession number :
70577344
Full Text :
https://doi.org/10.1109/TIP.2011.2161092