Search

Numerous single image super-resolution (SISR) algorithms have been proposed during the past years to reconstruct a high-resolution (HR) image from its low-resolution (LR) observation. However, how to fairly compare the performance of different SISR algorithms/results remains a challenging problem. So far, the lack of comprehensive human subjective study on large-scale real-world SISR datasets and accurate objective SISR quality assessment metrics makes it unreliable to truly understand the performance of different SISR algorithms. We in this paper make efforts to tackle these two issues. Firstly, we construct a real-world SISR quality dataset (i.e., RealSRQ) and conduct human subjective studies to compare the performance of the representative SISR algorithms. Secondly, we propose a new objective metric, i.e., KLTSRQA, based on the Karhunen-Loéve Transform (KLT) to evaluate the quality of SISR images in a no-reference (NR) manner. Experiments on our constructed RealSRQ and the latest synthetic SISR quality dataset (i.e., QADS) have demonstrated the superiority of our proposed KLTSRQA metric, achieving higher consistency with human subjective scores than relevant existing NR image quality assessment (NR-IQA) metrics. The dataset and the code will be made available at https://github.com/Zhentao-Liu/RealSRQ-KLTSRQA. [ABSTRACT FROM AUTHOR]

The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network’s (CNN’s) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human–robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using ${k}$ -fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on. [ABSTRACT FROM AUTHOR]

Two-layer fuzzy support vector regression-Takagi–Sugeno (TLFSVR-TS) model is proposed for emotion understanding in human–robot interaction (HRI), where the real-time dynamic emotion is recognized according to facial expression, and emotional intention understanding is obtained mainly based on human emotions and identification information. It aims to make robots capable of recognizing and understanding human emotions, in such a way that make HRI run smoothly. TLFSVR-TS considers about the priori knowledge inferred from human personal preference to reduce the uncertainty of various people, and multiple support vector regression (SVR) corresponding to different genders/provinces/ages of human to guarantee the local learning ability. Preliminary application experiments are performed in the developing emotional social robot system, where 30 volunteers experience the scenario of “drinking in the bar.” Results show that the proposal receives higher understanding accuracy than that of TLFSVR, kernel fuzzy ${c}$ -means clustering is fused with SVR, and SVR. [ABSTRACT FROM AUTHOR]

A three-layer weighted fuzzy support vector regression (TLWFSVR) model is proposed for understanding human intention, and it is based on the emotion-identification information in human–robot interaction. The TLWFSVR model consists of three layers, including adjusted weighted kernel fuzzy c-means for data clustering, fuzzy support vector regressions (FSVR) for information understanding, and weighted fusion for intention understanding. It aims to guarantee the quick convergence and satisfactory performance of the local FSVR via adjusting the weights of each feature in each cluster, in such a way that importance of different emotion-identification information is represented. Moreover, smooth human-oriented interaction can be obtained by endowing robot with human intention understanding capability. Experimental results show that the proposed TLWFSVR model obtains higher intention understanding accuracy and less computational time than that of two-layer fuzzy support vector regression, support vector regression, and back propagation neural network (BPNN), respectively. Additionally, the preliminary application experiments are performed in the developing human–robot interaction system, called emotional social robot system, where 12 volunteers and 2 mobile robots experience a scenario of “drinking at a bar.” Application results indicate that the bartender robot is able to understand customers’ order intentions. [ABSTRACT FROM AUTHOR]