Search

The level of face recognition technology continues to improve, and has achieved an ideal recognition rate in identity authentication, human-computer interaction and other industrial applications, and the market scale keeps growing. However, the occlusion problem in real scenes has not been completely solved. How to restrain or eliminate the negative impact of occlusion on key facial feature, is one of the hot spots in the field of face recognition. Aiming at the problem of lack of face structure information caused by occlusion, this paper reviews the occluded face recognition datasets and the occluded face recognition methods. Firstly, this paper introduces and analyzes some important new occluded face recognition datasets; Secondly, this paper summarizes the traditional learning methods and deep learning based methods to solve occlusion problems, and emphasizes the deep learning based robustness feature extraction and occluded facial information recovery. Finally, this paper summarizes and analyzes the advantages and disadvantages of relevant methods, points out the problems and challenges of occluded face recognition, and prospects the future research directions. [ABSTRACT FROM AUTHOR]

Local feature information plays an important role in image segmentation, however, the referring image segmentation task is dependent on the text expression, so it is impossible to extract local feature information directly from the original reference image. In order to solve this problem, this paper proposes a specific noun-guided local feature extraction deep neural network model（NgLFNet). The NgLFNet model can automatically mine the local feature information of the object to be segmented according to the key nouns in the input text expression. Specifically, the model first obtains key nouns in text through sentence analysis; secondly, extracting corresponding features through text and image encoders, and using the key nouns to obtain local features of high-interest regions through the multihead attention mechanism; then the multi-modal features are gradually fused to learn; Finally, the decoding and correction module uses the obtained local features to perform more detailed corrections on the prediction mask to obtain the final result. The method in this paper is compared with a variety of mainstream referring segmentation methods and the experimental results show that the proposed method improves the accuracy of text-based instance segmentation task. [ABSTRACT FROM AUTHOR]

There is a huge demand for weather cloud images in the observatory' s weather monitoring system. In order to solve the problems of model instability and loss of image features when the conventional generative adversarial network expands the dataset of the weather cloud images, this paper proposed a double-layer embedded adversarial image generation method based on SAU-Net DCGAN. This method consisted of two layers of networks which were nested within each other. Firstly,by the first layer of embedded network, it added the U-shaped network to the generator of the generative adversarial network. This network acted as the basic architecture and enhanced the feature recovery capability of the image by using the jump connection between the encoder and the decoder. Secondly,by the second layer of embedded network, it added SA to the U-shaped network. This attention mechanism reduced the complexity of the model by simplifying the parameters, improved effectively the feature loss in the dark part of the image. Finally, it developed a new weight calculation method to strengthen the connection between each features and improved the extraction of detail texture features from the images. The experimental results show that the quality of the images generated by this method is better than that of the conventional generative adversarial network in terms of sharpness and saturation. The evaluation indicators PSNR and SSIM have increased by 27. 06 dB and 0. 606 5 respectively. [ABSTRACT FROM AUTHOR]

Single-view 3D reconstruction based on deep learning is a research hot spot at present. In order to discover more high-frequency details, SDF-SRN algorithm introduces positional encoding, but neural network is easy to overfit without accurate supervision, and reconstructs uneven surface. To solve the problem, this paper proposed the network model based on sparse feature. The model enabled the network that preferred to overfitting to predict high-frequency residual by residual learning. The feature extraction network extracted sparse features and the global features. Then one hypernetwork took the sparse features as input and generated prediction shallow head. This shallow head predicted low-frequency part of signed distance function. Another hypernetwork took global features as input and generated another shallow head. This shallow head predicted high-frequency residual. It fused two predictions of shallow heads into final signed distance function. Spectrum analysis shows that the design purpose of network is achieved. Compared with other smooth surface reconstruction schemes, the network can achieve smoother surface reconstruction with enough details. It overcomes the overfitting of SDF-SRN. The qualitative and quantitative comparison with other advanced single-view reconstruction approaches show the superiority of the proposed approach. [ABSTRACT FROM AUTHOR]

Existing deep learning based single image super-resolution (SISR) models usually improve the fitting ability of the model by increasing the number of network layers, but fail to fully extract and reuse features, leading low quality of reconstructed images. To solve this problem, this paper proposed an image super-resolution model based on feature fusion and attention mechanism. This model used residual in residual (RIR) structure in feature extraction module. The feature extraction module of the network consisted of several residual groups. Each residual group consisted of several residual blocks. This module implemented local feature fusion in each residual group and global feature fusion between each group. In addition, this model introduced coordinate attention module into each residual block and spatial attention module into each residual group. It verifies that the model is able to fully extract features and reuse features. The final experimental results show that the model is superior to the existing models in objective evaluation indexes and subjective visual effect. [ABSTRACT FROM AUTHOR]

The single-frame image super-resolution（SISR） method based on deep networks is currently a hotspot in SR research. However, most of these methods mainly focus on exploring the network depth structure during feature extraction, ignoring the similarity between the feature layers in the intermediate space, and neglect the feature differences between the feature layers during reconstruction. This paper proposed a progressive network based on spatial feature transformation and back-projection reconstruction to solve this problem. The main feature of this method was to perform feature affine transformation on the feature space when extracting image features to increase the different similarities between feature layers, so as to obtain progressive features and spatial transformation features. In the image reconstruction stage, the reconstruction module adopted the strategy of multi-scale back projection to integrate the multi-source features of the image, which made the module pay more attention to the difference between features. Finally, the experimental results show that compared with most super-resolution methods, the proposed method has greatly improved the evaluation indexes such as PSNR/SSIM during image super-resolution reconstruction, and the texture information of the reconstructed image is more abundant. [ABSTRACT FROM AUTHOR]

Capsule network emphasizes the encoding of image features' spatial relationship, while its feature extraction module has difficulty in handling complex scenarios. In order to improve the performance of CapsNet, this paper proposed a capsule network with a self-attention feature extraction module ( SA-CapsNet) to solve the above problem. At first, it improved CapsNet by reducing the dimension of the capsule and adding an intermediate layer. Then mapped the SA module to the feature extraction layer of the capsule network to increase feature extraction capability. The results worked on the MNIST, Fashion MNIST, and CIFARlO datasets show that the classification accuracy rates are 99. 67%, 92. 21 %, and 82. 51 %, respectively. Additionally, results demonstrate the effectiveness of this proposed network, and the overall performance has been dramatically improved compared with CapsNet [ABSTRACT FROM AUTHOR]