Search

Introduction: Convolutional neural networks (CNNs) have maintained their dominance in deep learning methods for human action recognition (HAR) and other computer vision tasks. However, the need for a large amount of training data always restricts the performance of CNNs. Method: This paper is inspired by the two-stream network, where a CNN is deployed to train the network by using the spatial and temporal aspects of an activity, thus exploiting the strengths of both networks to achieve better accuracy. Contributions: Our contribution is twofold: first, we deploy an enhanced spatial stream, and it is demonstrated that models pre-trained on a larger dataset, when used in the spatial stream, yield good performance instead of training the entire model from scratch. Second, a dataset augmentation technique is presented to minimize overfitting of CNNs, where we increase the dataset size by performing various transformations on the images such as rotation and flipping, etc. Results: UCF101 is a standard benchmark dataset for action videos, and our architecture has been trained and validated on it. Compared with the other two-stream networks, our results outperformed them in terms of accuracy. [ABSTRACT FROM AUTHOR]

Human Action Recognition (HAR) is a current research topic in the field of computer vision that is based on an important application known as video surveillance. Researchers in computer vision have introduced various intelligent methods based on deep learning and machine learning, but they still face many challenges such as similarity in various actions and redundant features. We proposed a framework for accurate human action recognition (HAR) based on deep learning and an improved features optimization algorithm in this paper. From deep learning feature extraction to feature classification, the proposed framework includes several critical steps. Before training fine-tuned deep learning models - MobileNet-V2 and Darknet53 - the original video frames are normalized. For feature extraction, pre-trained deep models are used, which are fused using the canonical correlation approach. Following that, an improved particle swarm optimization (IPSO)-based algorithm is used to select the best features. Following that, the selected features were used to classify actions using various classifiers. The experimental process was performed on six publicly available datasets such as KTH, UT-Interaction, UCF Sports, Hollywood, IXMAS, and UCF YouTube, which attained an accuracy of 98.3%, 98.9%, 99.8%, 99.6%, 98.6%, and 100%, respectively. In comparison with existing techniques, it is observed that the proposed framework achieved improved accuracy. [ABSTRACT FROM AUTHOR]

The design of computer-assisted decision (CAD) systems for different biomedical imaging scenarios is a challenging task in computer vision. Sometimes, this challenge can be attributed to the image acquisition mechanisms since the lack of control on the cameras can create different visualizations of the same imaging site under different rotation, scaling, and illumination parameters, with a requirement to get a consistent diagnosis by the CAD systems. Moreover, the images acquired from different sites have specific colors, making the use of standard color spaces highly redundant. In this paper, we propose to tackle these issues by introducing novel region-based texture, and color descriptors. The proposed texture features are based on the usage of analytic Gabor filters (for compensation of illumination variations) followed by the calculation of first- and second-order statistics of the filter responses and making them invariant using some trivial mathematical operators. The proposed color features are obtained by compensating for the illumination variations in the images using homomorphic filtering followed by a bag-of-words approach to obtain the most typical colors in the images. The proposed features are used for the identification of cancer in images from two distinct imaging modalities, i.e., gastroenterology and dermoscopy . Experiments demonstrate that the proposed descriptors compares favorably to several other state-of-the-art methods, elucidating on the effectiveness of adapted features for image characterization. [ABSTRACT FROM AUTHOR]

Gastroenterology imaging is an essential tool to detect gastrointestinal cancer in patients. Computer-assisted diagnosis is desirable to help us improve the reliability of this detection. However, traditional computer vision methodologies, mainly segmentation, do not translate well to the specific visual characteristics of a gastroenterology imaging scenario. In this paper, we propose a novel method for the segmentation of gastroenterology images from two distinct imaging modalities and organs: chromoendoscopy (CH) and narrow-band imaging (NBI) from stomach and esophagus, respectively. We have used various visual features individually and their combinations (edgemaps, creaseness, and color) in normalized cuts image segmentation framework to segment ground truth datasets of 142 CH and 224 NBI images. Experiments show that an integration of edgemaps and creaseness in normalized cuts gives the best segmentation performance resulting in high-quality segmentations of the gastroenterology images. [ABSTRACT FROM PUBLISHER]