Search

Background: In recent years, the healthcare field has experienced significant advancements. New diagnostic techniques, treatments, and insights into the causes of various diseases have emerged. Despite these progressions, cancer remains a major concern. It is a widespread illness affecting individuals of all ages and leads to one out of every six deaths. Lung and colon cancer alone account for nearly two million fatalities. Though it is rare for lung and colon cancers to co-occur, the spread of cancer cells between these two areas—known as metastasis—is notably high. Early detection of cancer greatly increases survival rates. Currently, histopathological image (HI) diagnosis and appropriate treatment are key methods for reducing cancer mortality and enhancing survival rates. Digital image processing (DIP) and deep learning (DL) algorithms can be employed to analyze the HIs of five different types of lung and colon tissues. Methods: Therefore, this paper proposes a refined DL model that integrates feature fusion for the multi-classification of lung and colon cancers. The proposed model incorporates three DL architectures: ResNet-101V2, NASNetMobile, and EfficientNet-B0. Each model has limitations concerning variations in the shape and texture of input images. To address this, the proposed model utilizes a concatenate layer to merge the pre-trained individual feature vectors from ResNet-101V2, NASNetMobile, and EfficientNet-B0 into a single feature vector, which is then fine-tuned. As a result, the proposed DL model achieves high success in multi-classification by leveraging the strengths of all three models to enhance overall accuracy. This model aims to assist pathologists in the early detection of lung and colon cancer with reduced effort, time, and cost. The proposed DL model was evaluated using the LC25000 dataset, which contains colon and lung HIs. The dataset was pre-processed using resizing and normalization techniques. Results: The model was tested and compared with recent DL models, achieving impressive results: 99.8% for precision, 99.8% for recall, 99.8% for F1-score, 99.96% for specificity, and 99.94% for accuracy. Conclusions: Thus, the proposed DL model demonstrates exceptional performance across all classification categories. [ABSTRACT FROM AUTHOR]

In the production of the sucker rod well, the dynamic liquid level is important for the production efficiency and safety in the lifting process. It is influenced by multi-source data which need to be combined for the dynamic liquid level real-time calculation. In this paper, the multi-source data are regarded as the different views including the load of the sucker rod and liquid in the wellbore, the image of the dynamometer card and production dynamics parameters. These views can be fused by the multi-branch neural network with special fusion layer. With this method, the features of different views can be extracted by considering the difference of the modality and physical meaning between them. Then, the extraction results which are selected by multinomial sampling can be the input of the fusion layer. During the fusion process, the availability under different views determines whether the views are fused in the fusion layer or not. In this way, not only the correlation between the views can be considered, but also the missing data can be processed automatically. The results have shown that the load and production features fusion (the method proposed in this paper) performs best with the lowest mean absolute error (MAE) 39.63 m, followed by the features concatenation with MAE 42.47 m. They both performed better than only a single view and the lower MAE of the features fusion indicates that its generalization ability is stronger. In contrast, the image feature as a single view contributes little to the accuracy improvement after fused with other views with the highest MAE. When there is data missing in some view, compared with the features concatenation, the multi-view features fusion will not result in the unavailability of a large number of samples. When the missing rate is 10%, 30%, 50% and 80%, the method proposed in this paper can reduce MAE by 5.8, 7, 9.3 and 20.3 m respectively. In general, the multi-view features fusion method proposed in this paper can improve the accuracy obviously and process the missing data effectively, which helps provide technical support for real-time monitoring of the dynamic liquid level in oil fields. [ABSTRACT FROM AUTHOR]

Real-time semantic segmentation is a challenging task in computer vision, especially in complex scenes. In this study, a novel three-branch semantic segmentation model is designed, aiming to effectively use boundary information to improve the accuracy of semantic segmentation. The proposed model introduces the concept of containment control in a pioneering way, which treats image interior elements as well as image boundary elements as followers and leaders in containment control, respectively. Based on this, we utilize two learnable feature fusion matrices in the high-level semantic information stage of the model to quantify the fusion process of internal and boundary features. Further, we design a dedicated loss function to update the parameters of the feature fusion matrices based on the criterion of containment control, which enables fine-grained communication between target features. In addition, our model incorporates a Feature Enhancement Unit (FEU) to tackle the challenge of maximizing the utility of multi-scale features essential for semantic segmentation tasks through the meticulous reconstruction of these features. The proposed model proves effective on the publicly available Cityscapes and CamVid datasets, achieving a trade-off between effectiveness and speed. [ABSTRACT FROM AUTHOR]

Predicting the remaining useful life (RUL) of an engine is one of the key tasks of Prognostics and health management (PHM). Modern mechanical equipment typically operates in complex operating conditions and fault modes, leading to dispersed distribution of sensor data and challenges for feature extraction. To improve the accuracy of predicting the RUL under the complex scenarios, this paper proposes a multi‐scale convolutional network (CNN) and bidirectional gated recurrent unit (MSC‐BiGRU) mode under a dual path framework with temporal attention. Specifically, the multi‐scale CNN in the first path is to learn complex features, and Swish Activation function is used to improve the prediction ability of the network; the bidirectional gated recurrent unit (BiGRU) in the second path can handle both forward and backward time series, and adaptively capture the importance of outputs at different times using temporal attention, enhancing the model's feature extraction ability in the temporal dimension. A feature fusion mechanism is developed to connect two paths in parallel, overcoming the overfitting and high computational complexity in deep complex models. We verify the effectiveness of the proposed method using a simulated turbofan engine dataset, especially on datasets FD002 and FD004 under complex operating conditions and fault modes, the RMSE values were reduced by 17.37% and 9.97%, respectively, compared to the BiGRU‐TSAM. [ABSTRACT FROM AUTHOR]

Advancements in computer vision have resulted in significant breakthroughs across various applications, and one notable area of progress is in the recognition of food ingredient types and states. The identification of food items, distinguishing between types like oranges or apples, and assessing their states, whether whole, peeled, sliced, or juiced, is a pivotal task with far-reaching implications for fields such as food safety, recipe analysis, and restaurant quality control. This paper introduces an innovative approach to food type and state recognition that capitalizes on attention mechanisms and incorporates mask fusion to improve the accuracy and robustness of the recognition process. We evaluate the proposed approach through quantitative and qualitative analyses and comparisons to previous methods. The results consistently demonstrate that our proposed approach, integrating attention mechanisms, outperforms baseline and state-of-the-art methods, achieving an accuracy of 87.11%. This achievement signifies a step forward in refining food image segmentation models and reinforces the applicability of advanced techniques in real-world scenarios. [ABSTRACT FROM AUTHOR]

• Design and train 55-layer CNN model on the CIFAR-100 dataset. • Build two-stream network to extract spatial and temporal features from the images. • Feature optimization is performed using a Genetic algorithm. Human Gait Recognition (HGR) is referred to as a biometric tactic that is broadly used for the recognition of an individual by using the pattern of walking. There are some key factors such as angle variation, clothing variation, foot shadows, and carrying conditions that affect the human gait. In this work, a new approach is proposed for the HGR that contains five major steps. In the first step, the video data is converted into image frames. In the second step, RGB to GRAY conversion is carried out. After that, a two-stream network is designed by using a 55-layer CNN model called CNN-55 trained on CIFAR-100. The CNN-55 is designed from scratch and trained on the CIFAR-100 dataset by selecting hyperparameters. This pre-trained CNN-55 is used to build a two-stream network. In Stream-1 the optical flow frames are obtained by Horn and Schunk algorithm. These frames are fed into a CNN-55 to extract temporal features. In Stream-2 the GRAY frames are fed to the CNN-55 model for extraction of spatial features. After that, both vectors are serially fused. In the fourth step, the fused feature vector is fed into the Genetic Algorithm for optimization. Finally, the feature vector is fed into the One-Versus-All SVM classifier for recognition. The system is tested on all CASIA-B angles such as 000, 180, 360, 540, 720, 900, 1080, 1260, 1440, 1620, and 1800 which provides accuracy of 97.10%, 96.80%, 94.60%, 98.0%, 98.30%, 96.80%, 97.60, 96.90%, 99.60%, 96.80%, and 97.60%, respectively. The proposed method produces better outcomes compared to recent techniques. [ABSTRACT FROM AUTHOR]

The drastic increase of forest fire occurrence, which in recent years has posed severe threat and damage worldwide to the natural environment and human society, necessitates smoke detection of the early forest fire. First, a semantic segmentation method based on multiple color spaces feature fusion is put forward for forest fire smoke detection. Considering that smoke images in different color spaces may contain varied and distinctive smoke features which are beneficial for improving the detection ability of a model, the proposed model integrates the function of multi-scale and multi-type self-adaptive weighted feature fusion with attention augmentation to extract the enriched and complementary fused features of smoke, utilizing smoke images from multi-color spaces as inputs. Second, the model is trained and evaluated on part of the FIgLib dataset containing high-quality smoke images from watchtowers in the forests, incorporating various smoke types and complex background conditions, with a satisfactory smoke segmentation result for forest fire detection. Finally, the optimal color space combination and the fusion strategy for the model is determined through elaborate and extensive experiments with a superior segmentation result of 86.14 IoU of smoke obtained. [ABSTRACT FROM AUTHOR]

Abstract RNA-protein interaction (RPI) is crucial to the life processes of diverse organisms. Various researchers have identified RPI through long-term and high-cost biological experiments. Although numerous machine learning and deep learning-based methods for predicting RPI currently exist, their robustness and generalizability have significant room for improvement. This study proposes LPI-MFF, an RPI prediction model based on multi-source information fusion, to address these issues. The LPI-MFF employed protein–protein interactions features, sequence features, secondary structure features, and physical and chemical properties as the information sources with the corresponding coding scheme, followed by the random forest algorithm for feature screening. Finally, all information was combined and a classification method based on convolutional neural networks is used. The experimental results of fivefold cross-validation demonstrated that the accuracy of LPI-MFF on RPI1807 and NPInter was 97.60% and 97.67%, respectively. In addition, the accuracy rate on the independent test set RPI1168 was 84.9%, and the accuracy rate on the Mus musculus dataset was 90.91%. Accordingly, LPI-MFF demonstrated greater robustness and generalization than other prevalent RPI prediction methods.

Alopecia Areata is an autoimmune disorder where the body’s immune system attacks normal cells instead of intruders, leading to hair loss. If not detected early, it can progress to complete scalp baldness (Alopecia Totalis) or total body hair loss (Alopecia Universalis). Therefore, early detection of Alopecia Areata is crucial. Computer vision and deep learning techniques have been used for the last few years in the field of dermatology to detect different relevant diseases. We proposed a robust feature fusion technique, named AlopeciaDet for the timely detection of Alopecia Areata using camera images instead of dermoscopic images that require specialized equipment. AlopeciaDet combines Corner Rhombus Shape HOG (CRSHOG) features with those extracted from the ResNet-50 pre-trained model to detect Alopecia Areata with high accuracy by using the Dermenet dataset. The geometric properties of rhombus shapes make them useful for recognizing patterns in an image. HOG captures local object appearance and shape by computing the distribution of intensity gradients in localized portions of the image. We combined these characteristics into CRSHOG. Alopecia Areata, on the other hand, is characterized by distinctive patterns and shapes of hair loss, with the most common feature being round or oval-shaped patches. These patches can vary in size and usually have well-defined, sharp edges. Consequently, our proposed CRSHOG significantly improves the extraction of local information from images of affected areas. It achieves this by integrating sign and magnitude data, thereby enhancing discrimination capabilities for texture classification tasks. Finally, the magnitudes and directions of these pixel values are calculated. We achieved an accuracy of 99.45% with an error rate of 0.55% using Artificial Neural Network. These results surpass the accuracy of current state-of-the-art techniques in this field.

Land-use and land-cover (LULC) classification is an active research challenge in the area of remotely sensed satellite images due to critical applications, such as resource management and agriculture. Deep learning has recently shown a significant improvement in LULC classification using satellite images; however, complex and similar patterns of the images make the classification process more challenging. This article proposes a new information-fused framework for LULC classification from the remotely sensed imaging data. The proposed framework consists of two phases: training and testing. An augmentation process was conducted in the training phase to resolve the imbalance issue. In the next step, two novel convolutional neural network architectures are proposed based on six residual blocks named ResSAN6 and six inverted blocks named RS-IRSAN. The designed models are trained from scratch, whereas the hyperparameters are initialized using the Bayesian optimization algorithm. In the next phase, testing has been performed on the trained models. Testing set images were employed, and deep features from the self-attention layer were extracted. A novel mutual information-based serial fusion approach is proposed that combines both models' features. Also, the variation in the features is removed using median normalization. Furthermore, the feature fusion's computational time and precision rates are improved, which is further optimized using an arithmetic optimization (AO) algorithm. The best information features are selected and finally classified using a shallow wide neural network by employing AOrk. The experimental process of the proposed framework has been performed on three datasets, such as RSI-CB128, WHU-RS19, and NWPU_RESISC45, and achieved an accuracy of 95.7, 97.5, and 92.0%, respectively. Comparing the results with recent related works, the proposed framework shows improved accuracy and precision rates.

Human Gait Recognition (HGR) is a biometric approach, widely used for security purposes from the past few decades. In HGR, the change in an individual walk along with wearing clothes and carrying bag are major covariant controls which impact the performance of a system. Moreover, recognition under various view angles is another key challenge in HGR. In this work, a novel fully automated method is proposed for HGR under various view angles using deep learning. Four primary steps are involved such as: preprocessing of original video frames, exploiting pre-trained Densenet-201 CNN model for features extraction, reduction of additional features from extracted vector based on a hybrid selection method, and finally recognition using supervised learning methods. The extraction of CNN features is a key step in which our target is to extract the most active features. To achieve this goal, we fuse the features of both second last and third last layers in a parallel process. At a later stage, best features are selected by the Firefly algorithm and Skewness based approach. These selected features are serially combined and fed to One against All Multi Support Vector Machine (OAMSVM) for final recognition. Three different angles 180, 360 and 540 of the CASIA B dataset are selected for the evaluation process and accuracy of 94.3%, 93.8% and 94.7% is achieved respectively. Results show significant improvement in accuracy and recall rate as compared to the existing state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

In the area of digital biometric systems, the handwritten signature plays a key role in the authentication of a person based on their original samples. In offline signature verification (OSV), several problems exist that are challenging for verification of authentic or forgery signature by the digital system. Correct signature verification improves the security of people, systems, and services. It is applied to uniquely identify an individual based on the motion of pen as up and down, signature speed, and shape of a loop. In this work, the multi-level features fusion and optimal features selection based automatic technique is proposed for OSV. For this purpose, twenty-two Gray Level Co-occurrences Matrix (GLCM) and eight geometric features are calculated from pre-processing signature samples. These features are fused by a new parallel approach which is based on a high-priority index feature (HPFI). A skewness-kurtosis based features selection approach is also proposed name skewness-kurtosis controlled PCA (SKcPCA) and selects the optimal features for final classification into forged and genuine signatures. MCYT, GPDS synthetic, and CEDAR datasets are utilized for validation of the proposed system and show enhancement in terms of Far and FRR as compared to existing methods. [ABSTRACT FROM AUTHOR]

Human Action Recognition (HAR) has become one of the most active research area in the domain of artificial intelligence, due to various applications such as video surveillance. The wide range of variations among human actions in daily life makes the recognition process more difficult. In this article, a new fully automated scheme is proposed for Human action recognition by fusion of deep neural network (DNN) and multiview features. The DNN features are initially extracted by employing a pre-trained CNN model name VGG19. Subsequently, multiview features are computed from horizontal and vertical gradients, along with vertical directional features. Afterwards, all features are combined in order to select the best features. The best features are selected by employing three parameters i.e. relative entropy, mutual information, and strong correlation coefficient (SCC). Furthermore, these parameters are used for selection of best subset of features through a higher probability based threshold function. The final selected features are provided to Naive Bayes classifier for final recognition. The proposed scheme is tested on five datasets name HMDB51, UCF Sports, YouTube, IXMAS, and KTH and the achieved accuracy were 93.7%, 98%, 99.4%, 95.2%, and 97%, respectively. Lastly, the proposed method in this article is compared with existing techniques. The resuls shows that the proposed scheme outperforms the state of the art methods. [ABSTRACT FROM AUTHOR]

Gesture recognition has been widely used in many human–computer interaction applications, which is one of the most intuitive and natural ways for humans to communicate with computers. However, it remains a challenging problem due to the interference such as variety of backgrounds, hand similar object, and lighting changes. In this article, a lightweight static gesture recognition network, named as PEA-YOLO, was put forward. The network adopts the idea of adaptive spatial feature pyramid and combines the attention mechanism and multi-path feature fusion method to improve the localization and recognition performance of gesture features. First, Efficient Channel Attention module was added after the backbone network to focus the model's attention on the gesture. Second, Feature Pyramid Network was replaced by Path Aggregation Network to localize the gesture better. Finally, Adaptive Spatial Feature Fusion module was added before the Yolo head to further reduce false detections rate in gesture recognition. The experiments conducted on the OUHANDS and NUSII datasets show that PEA-YOLO could achieve favorable performance with only 8.57 M parameters in static gesture recognition. Compared with other state of the arts, the proposed lightweight network has obtained a highest accuracy with a much high speed and few parameters. [ABSTRACT FROM AUTHOR]

With the rapid development of information technology, the conception of smart healthcare has progressively come to the fore. Smart healthcare utilizes next-generation technologies, such as artificial intelligence, the Internet of Things (IoT), big data and cloud computing to transform intelligently the existing medical system-making it more efficient, more reliable, and personalized. In this work, skin data are collected using dedicated hardware from mobile health units-working as nodes. The collected samples are uploaded to the cloud for further processing using a novel multi-modal information fusion framework, which performs skin lesion segmentation, followed by classification. The proposed framework has two main functional blocks: Segmentation and classification. In each block, we have a performance booster, which works on the principle of information fusion. For lesion segmentation, a hybrid framework is proposed, which utilizes the complementary strengths of two convolutional neural network (CNN) architectures to generate the segmented images. The resultant binary images are later fused using joint probability distribution and marginal distribution function. For lesion classification, a 30-layered CNN architecture is designed, which is trained on the HAM10000 dataset. A novel summation discriminant correlation analysis technique is used to fuse the extracted features from two fully connected layers. To avoid feature redundancy, a feature selection method "Regular Falsi" is developed, which down samples the extracted features into the lower dimensions. The selected features are finally classified using an extreme learning machine classifier. Five skin benchmark datasets (ISBI2016, ISIC2017, ISBI2018, ISIC2019, and HAM10000) are used to evaluate both segmentation and classification frameworks using average accuracy, false-negative rate, sensitivity, and computational time, whose results are impressive compared to state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Object detection plays an important role in the field of computer vision. The purpose of object detection is to identify the objects of interest in the image and determine their categories and positions. Object detection has many important applications in various fields. This article addresses the problems of unclear foreground contour in moving object detection and excessive noise points in the global vision, proposing an improved Gaussian mixture model for feature fusion. First, the RGB image was converted into the HSV space, and a mixed Gaussian background model was established. Next, the object area was obtained through background subtraction, residual interference in the foreground was removed using the median filtering method, and morphological processing was performed. Then, an improved Canny algorithm using an automatic threshold from the Otsu method was used to extract the overall object contour. Finally, feature fusion of edge contours and the foreground area was performed to obtain the final object contour. The experimental results show that this method improves the accuracy of the object contour and reduces noise in the object. [ABSTRACT FROM AUTHOR]

Cross-resolution person re-identification is a challenging problem in the field of person re-identification. In order to solve the problem of resolution mismatch, many studies introduce super-resolution into person re-identification tasks. In this work, we propose a cross-resolution person re-identification method based on double transformer residual super-resolution network (DTRSR), which mainly includes super-resolution module and person re-identification module. In the super-resolution module, we propose the double transformer network as our attention module. First of all, we divide the features extracted by the residual network. Then calculate the similarity between each local feature and the global feature after average pooling and maximum pooling respectively, which makes our module quickly capture the hidden weight information in the spatial domain. In the person re-identification module, we propose an effective fusion method based on key point features (KPFF). The key point extraction model can not only solve the problem that local features can not be accurately aligned, but also remove the interference of background noise. In order to fully mine the relationship between the features of each key point, we calculate the two-way correlation between each key point feature and other features, and then superimpose the two-way correlation with the feature itself to get the superposition feature which contains global and local information. The effectiveness of this method is proved by extensive experiments. Compared with the most advanced methods, the test results in the three datasets show that our method improves rank-1 by 1.1%, 3.5% and 1.7%; and rank-5 by 1.3%, 1.7% and 0.3%; and rank-10 by 0.1%, 0.4% and 0.1%, respectively.

Real-time semantic segmentation is a challenging task in computer vision, especially in complex scenes. In this study, a novel three-branch semantic segmentation model is designed, aiming to effectively use boundary information to improve the accuracy of semantic segmentation. The proposed model introduces the concept of containment control in a pioneering way, which treats image interior elements as well as image boundary elements as followers and leaders in containment control, respectively. Based on this, we utilize two learnable feature fusion matrices in the high-level semantic information stage of the model to quantify the fusion process of internal and boundary features. Further, we design a dedicated loss function to update the parameters of the feature fusion matrices based on the criterion of containment control, which enables fine-grained communication between target features. In addition, our model incorporates a Feature Enhancement Unit (FEU) to tackle the challenge of maximizing the utility of multi-scale features essential for semantic segmentation tasks through the meticulous reconstruction of these features. The proposed model proves effective on the publicly available Cityscapes and CamVid datasets, achieving a trade-off between effectiveness and speed.

Cross-resolution person re-identification is a challenging problem in the field of person re-identification. In order to solve the problem of resolution mismatch, many studies introduce super-resolution into person re-identification tasks. In this work, we propose a cross-resolution person re-identification method based on double transformer residual super-resolution network (DTRSR), which mainly includes super-resolution module and person re-identification module. In the super-resolution module, we propose the double transformer network as our attention module. First of all, we divide the features extracted by the residual network. Then calculate the similarity between each local feature and the global feature after average pooling and maximum pooling respectively, which makes our module quickly capture the hidden weight information in the spatial domain. In the person re-identification module, we propose an effective fusion method based on key point features (KPFF). The key point extraction model can not only solve the problem that local features can not be accurately aligned, but also remove the interference of background noise. In order to fully mine the relationship between the features of each key point, we calculate the two-way correlation between each key point feature and other features, and then superimpose the two-way correlation with the feature itself to get the superposition feature which contains global and local information. The effectiveness of this method is proved by extensive experiments. Compared with the most advanced methods, the test results in the three datasets show that our method improves rank-1 by 1.1%, 3.5% and 1.7%; and rank-5 by 1.3%, 1.7% and 0.3%; and rank-10 by 0.1%, 0.4% and 0.1%, respectively. [ABSTRACT FROM AUTHOR]

The convolutional neural network showed considerable success in medical imaging with explainable AI for cancer detection and recognition. However, the irrelevant and large number of features increases the computational time and decreases the accuracy. This work proposes a deep learning and fuzzy entropy slime mould algorithm-based architecture for multiclass skin lesion classification. In the first step, we employed the data augmentation technique to increase the training data and further utilized it for training two fine-tuned deep learning models such as Inception-ResNetV2 and NasNet Mobile. Then, we used transfer learning on augmented datasets to train both models and obtained two feature vectors from newly fine-tuned models. Later, we applied a fuzzy entropy slime mould algorithm on both vectors to get optimal features that are finally fused using the Serial-Threshold fusion technique and classified using several machine learning classifiers. Eventually, the explainable AI technique named Gradcam opted for the visualization of the lesion region. The experimental process was conducted on two datasets, such as HAM10000 and ISIC 2018, and achieved 97.1 and 90.2% accuracy, better than the other techniques. [ABSTRACT FROM AUTHOR]

Deep-learning methods have made significant progress for salient object detection in optical remote sensing images (ORSI-SOD). However, it is difficult for existing methods to effectively exploit both the multi-scale global context and local detail features due to the cluttered background and different scales that characterize ORSIs. To solve the problem, we propose a transformer and convolution mixed network (TCM-Net), with a U-shaped codec architecture for ORSI-SOD. By using a dual-path complementary network, we obtain both the global context and local detail information from the ORSIs of different resolution. A local and global features fusion module was developed to integrate the information at corresponding decoder layers. Furthermore, an attention gate module was designed to refine features while suppressing noise at each decoder layer. Finally, we tailored a hybrid loss function to our network structure, which incorporates three supervision strategies: global, local and output. Extensive experiments were conducted on three common datasets, and TCM-Net outperforms 17 state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Background: Using artificial intelligence (AI) with the concept of a deep learning-based automated computer-aided diagnosis (CAD) system has shown improved performance for skin lesion classification. Although deep convolutional neural networks (DCNNs) have significantly improved many image classification tasks, it is still difficult to accurately classify skin lesions because of a lack of training data, inter-class similarity, intra-class variation, and the inability to concentrate on semantically significant lesion parts. Innovations: To address these issues, we proposed an automated deep learning and best feature selection framework for multiclass skin lesion classification in dermoscopy images. The proposed framework performs a preprocessing step at the initial step for contrast enhancement using a new technique that is based on dark channel haze and top–bottom filtering. Three pre-trained deep learning models are fine-tuned in the next step and trained using the transfer learning concept. In the fine-tuning process, we added and removed a few additional layers to lessen the parameters and later selected the hyperparameters using a genetic algorithm (GA) instead of manual assignment. The purpose of hyperparameter selection using GA is to improve the learning performance. After that, the deeper layer is selected for each network and deep features are extracted. The extracted deep features are fused using a novel serial correlation-based approach. This technique reduces the feature vector length to the serial-based approach, but there is little redundant information. We proposed an improved anti-Lion optimization algorithm for the best feature selection to address this issue. The selected features are finally classified using machine learning algorithms. Main Results: The experimental process was conducted using two publicly available datasets, ISIC2018 and ISIC2019. Employing these datasets, we obtained an accuracy of 96.1 and 99.9%, respectively. Comparison was also conducted with state-of-the-art techniques and shows the proposed framework improved accuracy. Conclusions: The proposed framework successfully enhances the contrast of the cancer region. Moreover, the selection of hyperparameters using the automated techniques improved the learning process of the proposed framework. The proposed fusion and improved version of the selection process maintains the best accuracy and shorten the computational time. [ABSTRACT FROM AUTHOR]

Foreign bodies often cause belt scratching and tearing, coal stacking, and plugging during the transportation of coal via belt conveyors. To overcome the problems of large parameters, heavy computational complexity, low classification accuracy, and poor processing speed in current classification networks, a novel network based on ESCBAM and multichannel feature fusion is proposed in this paper. Firstly, to improve the utilization rate of features and the network's ability to learn detailed information, a multi-channel feature fusion strategy was designed to fully integrate the independent feature information between each channel. Then, to reduce the computational amount while maintaining excellent feature extraction capability, an information fusion network was constructed, which adopted the depthwise separable convolution and improved residual network structure as the basic feature extraction unit. Finally, to enhance the understanding ability of image context and improve the feature performance of the network, a novel ESCBAM attention mechanism with strong generalization and portability was constructed by integrating space and channel features. The experimental results demonstrate that the proposed method has the advantages of fewer parameters, low computational complexity, high accuracy, and fast processing speed, which can effectively classify foreign bodies on the belt conveyor. [ABSTRACT FROM AUTHOR]

The classification of environmental sound is an important research area in artificial intelligence and its classification accuracy is greatly affected by feature extraction. However, most existing methods for feature set generation use simple feature fusion methods, which are ineffective for multi-classification purposes. To solve this problem and improve the neural network classification performance of existing training environmental sound classification (ESC) tasks, we first add the Gaussian error linear unit (GELU) activation function and gated linear units (GLU) to the residual network, which improves the network's stability. Subsequently, this paper proposes a feature fusion method based on the attention mechanism and employs squeeze-and-excitation networks (SENet) to make network learning features fusion and training more successfully, which offers obvious advantages over existing classification methods. Experimental results show that our model has reached an obvious increase in classification accuracy for the two datasets i.e. ESC-10 (98.27%) and ESC-50 (98.32%). [ABSTRACT FROM AUTHOR]

When approximately seventy percent of dopamine-producing nerve cells cease to function normally, the symptoms of Parkinson’s disease (PD) manifest, marking an irreversible decline in nerve cell health. In clinical settings, neurologists assess individuals by observing their performance in carrying out certain tasks, including writing, drawing, walking, speaking, and assessing facial expressions for any difficulties. This paper focuses on the problem of early PD identification through handwriting and drawing tasks, and by using three well-known PD data-sets. Given the scarcity of handwriting samples and the wide spectrum of Parkinson’s disease symptoms, the challenge is known to be particularly difficult. To achieve reliable PD detection, we employ diverse data augmentation techniques to expand the dataset size. Then, we deploy and train the different architectures of deep Convolutional Neural Network (CNN) each of which extract different salient features and aspect of input data due to its unique layout and structure (i.e., number of layers, kernels, normalization, number of connected layers, etc.). After experimental analysis of the performance of individual CNNs, we selected the promising feature vectors and employed different early fusion strategies before final classification. This is a very useful technique that allows a classification model to learn and detect from various representations of data provided by multiple CNNs and improve the overall system performance. Experimental results show that the fusion of freeze features of multiple deep CNN models significantly achieves better exactness of 99.35% in comparison to uni model CNN and other state-of-the-art work.

Esophagitis, cancerous growths, bleeding, and ulcers are typical symptoms of gastrointestinal disorders, which account for a significant portion of human mortality. For both patients and doctors, traditional diagnostic methods can be exhausting. The major aim of this research is to propose a hybrid method that can accurately diagnose the gastrointestinal tract abnormalities and promote early treatment that will be helpful in reducing the death cases. The major phases of the proposed method are: Dataset Augmentation, Preprocessing, Features Engineering (Features Extraction, Fusion, Optimization), and Classification. Image enhancement is performed using hybrid contrast stretching algorithms. Deep Learning features are extracted through transfer learning from the ResNet18 model and the proposed XcepNet23 model. The obtained deep features are ensembled with the texture features. The ensemble feature vector is optimized using the Binary Dragonfly algorithm (BDA), Moth–Flame Optimization (MFO) algorithm, and Particle Swarm Optimization (PSO) algorithm. In this research, two datasets (Hybrid dataset and Kvasir-V1 dataset) consisting of five and eight classes, respectively, are utilized. Compared to the most recent methods, the accuracy achieved by the proposed method on both datasets was superior. The Q_SVM's accuracies on the Hybrid dataset, which was 100%, and the Kvasir-V1 dataset, which was 99.24%, were both promising. [ABSTRACT FROM AUTHOR]

A brain tumor refers to an abnormal growth of cells in the brain that can be either benign or malignant. Oncologists typically use various methods such as blood or visual tests to detect brain tumors, but these approaches can be time-consuming, require additional human effort, and may not be effective in detecting small tumors. This work proposes an effective approach to brain tumor detection that combines segmentation and feature fusion. Segmentation is performed using the mayfly optimization algorithm with multilevel Kapur's threshold technique to locate brain tumors in MRI scans. Key features are achieved from tumors employing Histogram of Oriented Gradients (HOG) and ResNet-V2, and a bidirectional long short-term memory (BiLSTM) network is used to classify tumors into three categories: pituitary, glioma, and meningioma. The suggested methodology is trained and tested on two datasets, Figshare and Harvard, achieving high accuracy, precision, recall, F1 score, and area under the curve (AUC). The results of a comparative analysis with existing DL and ML methods demonstrate that the proposed approach offers superior outcomes. This approach has the potential to improve brain tumor detection, particularly for small tumors, but further validation and testing are needed before clinical use. [ABSTRACT FROM AUTHOR]

Human gait recognition (HGR) is the process of identifying a subject (human) based on their walking pattern. Each subject is a unique walking pattern and cannot be simulated by other subjects. But, gait recognition is not easy and makes the system difficult if any object is carried by a subject, such as a bag or coat. This article proposes an automated architecture based on deep features optimization for HGR. To our knowledge, it is the first architecture in which features are fused using multiset canonical correlation analysis (MCCA). In the proposed method, original video frames are processed for all 11 selected angles of the CASIA B dataset and utilized to train two fine-tuned deep learning models such as Squeezenet and Efficientnet. Deep transfer learning was used to train both fine-tuned models on selected angles, yielding two new targeted models that were later used for feature engineering. Features are extracted from the deep layer of both fine-tuned models and fused into one vector using MCCA. An improved manta ray foraging optimization algorithm is also proposed to select the best features from the fused feature matrix and classified using a narrow neural network classifier. The experimental process was conducted on all 11 angles of the large multi-view gait dataset (CASIA B) dataset and obtained improved accuracy than the state-of-the-art techniques. Moreover, a detailed confidence interval based analysis also shows the effectiveness of the proposed architecture for HGR. [ABSTRACT FROM AUTHOR]

Moyamoya disease (MMD) is a serious intracranial cerebrovascular disease. Cerebral hemorrhage caused by MMD will bring life risk to patients. Therefore, MMD detection is of great significance in the prevention of cerebral hemorrhage. In order to improve the accuracy of digital subtraction angiography (DSA) in the diagnosis of ischemic MMD, in this paper, a deep network architecture combined with 3D convolutional neural network (3D CNN) and bidirectional convolutional gated recurrent unit (BiConvGRU) is proposed to learn the spatiotemporal features for ischemic MMD detection. Firstly, 2D convolutional neural network (2D CNN) is utilized to extract spatial features for each frame of DSA. Secondly, the long-term spatiotemporal features of DSA sequence are extracted by BiConvGRU. Thirdly, the short-term spatiotemporal features of DSA are further extracted by 3D convolutional neural network (3D CNN). In addition, different features are extracted when gray images and optical flow images pass through the network, and multiple features are extracted by features fusion. Finally, the fused features are utilized to classify. The proposed method was quantitatively evaluated on a data sets of 630 cases. The experimental results showed a detection accuracy of 0.9788, sensitivity and specificity were 0.9780 and 0.9796, respectively, and area under curve (AUC) was 0.9856. Compared with other methods, we can get the highest accuracy and AUC. The experimental results show that the proposed method is stable and reliable for ischemic MMD detection, which provides an option for doctors to accurately diagnose ischemic MMD. [ABSTRACT FROM AUTHOR]

The early detection of breast cancer using mammogram images is critical for lowering women's mortality rates and allowing for proper treatment. Deep learning techniques are commonly used for feature extraction and have demonstrated significant performance in the literature. However, these features do not perform well in several cases due to redundant and irrelevant information. We created a new framework for diagnosing breast cancer using entropy-controlled deep learning and flower pollination optimization from the mammogram images. In the proposed framework, a filter fusion-based method for contrast enhancement is developed. The pre-trained ResNet-50 model is then improved and trained using transfer learning on both the original and enhanced datasets. Deep features are extracted and combined into a single vector in the following phase using a serial technique known as serial mid-value features. The top features are then classified using neural networks and machine learning classifiers in the following stage. To accomplish this, a technique for flower pollination optimization with entropy control has been developed. The exercise used three publicly available datasets: CBIS-DDSM, INbreast, and MIAS. On these selected datasets, the proposed framework achieved 93.8, 99.5, and 99.8% accuracy, respectively. Compared to the current methods, the increase in accuracy and decrease in computational time are explained. [ABSTRACT FROM AUTHOR]

The Speech Emotion Recognition (SER) algorithm, which aims to analyze the expressed emotion from a speech, has always been an important topic in speech acoustic tasks. In recent years, the application of deep-learning methods has made great progress in SER. However, the small scale of the emotional speech dataset and the lack of effective emotional feature representation still limit the development of research. In this paper, a novel SER method, combining data augmentation, feature selection and feature fusion, is proposed. First, aiming at the problem that there are inadequate samples in the speech emotion dataset and the number of samples in each category is unbalanced, a speech data augmentation method, Mix-wav, is proposed which is applied to the audio of the same emotion category. Then, on the one hand, a Multi-Head Attention mechanism-based Convolutional Recurrent Neural Network (MHA-CRNN) model is proposed to further extract the spectrum vector from the Log-Mel spectrum. On the other hand, Light Gradient Boosting Machine (LightGBM) is used for feature set selection and feature dimensionality reduction in four emotion global feature sets, and more effective emotion statistical features are extracted for feature fusion with the previously extracted spectrum vector. Experiments are carried out on the public dataset Interactive Emotional Dyadic Motion Capture (IEMOCAP) and Chinese Hierarchical Speech Emotion Dataset of Broadcasting (CHSE-DB). The experiments show that the proposed method achieves 66.44% and 93.47% of the unweighted average test accuracy, respectively. Our research shows that the global feature set after feature selection can supplement the features extracted by a single deep-learning model through feature fusion to achieve better classification accuracy. [ABSTRACT FROM AUTHOR]

Human parsing has great application prospects in the field of computer vision, but there are still many problems. In the existing algorithms, the problems of small-scale target location and the problem of background occlusion have not been fully resolved, which will lead to wrong segmentation or incomplete segmentation. Compared with the existing practice of feature concatenation, using the correlation between two factors can make full use of edge information for refined parsing. This paper proposes the mechanism of correlation edge and parsing network (MCEP), which uses the spatial aware and two max-pooling (SMP) module to capture the correlation. The structure mainly includes two steps, namely (1) collection operation, where, through the mutual promotion of edge features and parsing features, more attention is paid to the region of interest around the edge of the human body, and the spatial clues of the human body are collected adaptively, and (2) filtering operation, where parallel max-pooling is adopted to solve the background occlusion problem. Meanwhile, semantic context feature extraction capability is endowed to enhance feature extraction capability and prevent small target detail loss. Through a large number of experiments on multiple single-person and multi-person datasets, this method has greater advantages. [ABSTRACT FROM AUTHOR]

In medical imaging, automated detection of stomach and gastrointestinal diseases using WCE (wireless capsule endoscopy) images is an emerging research domain. It includes numerous limitations and challenges such as variation in the contrast, texture variation, color and complexity in the background etc. To overcome these challenges, several computer-aided methods are proposed by the researchers. But there exist different limitations in these methods. In this work, a new method is proposed for computer-aided diagnosis of stomach disease classification. This hybrid approach is based on the amassed texture and deep CNN features. Initially, the contrast of image is improved by using power-law transformation. Texture features are extracted from the enhanced dataset by using LBP and SFTA features. Extracted texture features are then fused to obtain strong feature vectors. At the same time, two pre-trained deep learning models are utilized for CNN feature extraction namely VGG16 and InceptionV3. Extracted deep features are fused serially along with the obtained handcrafted feature vector to obtain an ensemble deep feature vector. A unique feature vector is obtained by serial fusion of both fused vectors to get an advantage of accumulated texture and CNN features. This feature vector is supplied to various classifiers and evaluated with existing methods. The promising recognition proficiency portrays the strength of proposed approach. [ABSTRACT FROM AUTHOR]

This paper proposes an efficient deep convolutional neural network with features fusion for recognizing radar signal, which mainly includes data pre-processing, features extraction, multi-features fusion, and classification. Radar signals are first transformed into time-frequency images by using choi-williams distribution and smooth pseudo-wigner-ville distribution, and the image pre-processing methods are used to resize and normalize the time-frequency images. Then, two constructed deep convolutional neural network models are aimed to extract more effective features. Furthermore, a multi-features fusion model is proposed to integrate features extracted from two deep convolutional neural network models, which makes full use of the relationship among different features and further improves the recognition performance. Experimental results shown that the average recognition accuracy of the proposed method is up to 84.38% when the signal to noise ratio is at −12 dB, and even reach to 94.31% at −10 dB, which achieved the superior recognition performance than others, especially at the lower signal to noise ratio. Moreover, the recognition performance of various radar signals can be largely improved, especially for 2FSK, 4FSK and SFM. This work provides a sound experimental foundation for further improving radar signal recognition in modern electronic warfare systems. [ABSTRACT FROM AUTHOR]

Breast cancer is diagnosed using mammography imaging. Mammography is an effective screening tool for diagnosing and managing breast cancer. This task is highly time-consuming due to the high similarity between benign and malignant cells. However, for medical intervention, it is important to diagnose breast cancer at an early stage. Recently, deep learning has shown remarkable success in the area of medical imaging for the diagnosis of several cancer types. The DL-based computerized techniques assist in detecting and classifying breast cancer correctly. This article proposes a new computerized architecture based on two novel CNN architectures with Bayesian Optimization and feature selection techniques. Initially, two convolutional neural network (CNN) architectures were designed, named 2-Residual Blocks CNN and 3-Residual Blocks CNN. Both designed architectures have been trained using Mammography images, where hyperparameters have been initialized using Bayesian Optimization (BO). After the training from scratch, deep features are extracted from the average pool layer. Extracted deep features are optimized using an improved optimization algorithm named Simulated Annealing controlled Position Shuffling (SAcPS). The fitness of each iteration is computed using an extreme learning machine (ELM) classifier instead of a fine k-nearest neighbor. The selected features of both CNN architectures are finally fused using a novel serial-controlled Reyni Entropy technique. The fused feature vector is passed to neural networks for final classification. The experimental process was conducted on two publicly available datasets and obtained improved accuracy of 97.7% and 97.3%, respectively. In addition, a detailed comparison is conducted with several recent techniques and shows improved performance. [ABSTRACT FROM AUTHOR]

Deep-learning methods have made significant progress for salient object detection in optical remote sensing images (ORSI-SOD). However, it is difficult for existing methods to effectively exploit both the multi-scale global context and local detail features due to the cluttered background and different scales that characterize ORSIs. To solve the problem, we propose a transformer and convolution mixed network (TCM-Net), with a U-shaped codec architecture for ORSI-SOD. By using a dual-path complementary network, we obtain both the global context and local detail information from the ORSIs of different resolution. A local and global features fusion module was developed to integrate the information at corresponding decoder layers. Furthermore, an attention gate module was designed to refine features while suppressing noise at each decoder layer. Finally, we tailored a hybrid loss function to our network structure, which incorporates three supervision strategies: global, local and output. Extensive experiments were conducted on three common datasets, and TCM-Net outperforms 17 state-of-the-art methods.

Automated food detection and recognition methods have been studied to enhance end-user life. However, most existing research focused on food ingredient type recognition, with little work has been done for food ingredient state recognition. Successful recognition of food ingredient state plays a significant role in handling the food ingredient by an intelligent system. In this work, we propose a new novel cascaded multi-head approach based on deep learning to simultaneously recognize the state and type of food ingredients. We trained and evaluated the proposed approach on a benchmark dataset of food ingredient images with nine different food states and 18 food types. We compared the proposed approach with a non-cascaded deep learning approach. The cascaded approach shows improvement in food ingredient state recognition with 87% accuracy compared to 81% using a non-cascaded deep learning method. Our proposed method broadly applies to various tasks where food ingredient state recognition is essential, such as feeding elderly and disabled people and automating food recognition and preparation.

The fusion of spectral–spatial features based on deep learning has become the focus of research in hyperspectral image (HSI) classification. However, previous deep frameworks based on spectral–spatial fusion usually performed feature aggregation only at the branch ends. Furthermore, only first-order statistical features are considered in the fusion process, which is not conducive to improving the discrimination of spectral–spatial features. This article proposes a global–local hierarchical weighted fusion end-to-end classification architecture. The architecture includes two subnetworks for spectral classification and spatial classification. For the spectral subnetwork, two band-grouping strategies are designed, and bidirectional long short-term memory is used to capture spectral context information from global to local perspectives. For the spatial subnetwork, a pooling strategy based on local attention is combined to construct a global–local pooling fusion module to enhance the discriminability of spatial features learned by a convolutional neural network. For the fusion stage, a hierarchical weighting fusion mechanism is developed to obtain the nonlinear relationship between both spectral and spatial features. The experimental results on four real HSI datasets and a GF-5 satellite dataset demonstrate that the method proposed is more competitive in terms of accuracy and generalization.

Recent methods for visual tracking exploit a multitude of information obtained from combinations of handcrafted and/or deep features. However, the response maps derived from these feature combinations are often fused using simple strategies such as winner-takes-all or weighted sum approaches. Although some efficient fusion methods have also been proposed, these methods still do not leverage the individual strengths of the different features being fused. In the current work, we propose a novel information fusion strategy comprising a common low-rank subspace for the fusion of different types of features and tracker responses. Firstly, we interpret the response maps as smoothly varying functions which can be efficiently represented using individual low-rank matrices, thus removing high frequency noise and sparse artifacts. Secondly, we estimate a common low-rank subspace which is constrained to remain close to each individual low-rank subspace resulting in an efficient fusion strategy. The proposed algorithm achieves good performance by integrating the information contained in heterogeneous feature types. We demonstrate the efficiency of our algorithm using several combinations of features as well as correlation filter and end-to-end deep trackers. The proposed common subspace fusion algorithm is generic and can be used to efficiently fuse the response maps of varying types of feature representations as well as trackers. Extensive experiments on several tracking benchmarks including OTB100, TC128, VOT-ST 2018, VOT-LT 2018, UAV123, GOT-10K and LaSoT have demonstrated significant performance improvements compared to many SOTA tracking methods.

In this paper, in order to accurately detect Domain Name System (DNS) covert channels based on DNS over HTTPS (DoH) encryption and to solve the problems of weak single-feature differentiation and poor performance in the existing detection methods, we have designed a DoH-encrypted DNS covert channel detection method based on features fusion, called FF-MR. FF-MR is based on a Multi-Head Attention and Residual Neural Network. It fuses session statistical features with multi-channel session byte sequence features. Some important features that play a key role in the detection task are screened out of the fused features through the calculation of the Multi-Head Attention mechanism. Finally, a Multi-Layer Perceptron (MLP) is used to detect encrypted DNS covert channels. By considering both global and focused features, the main idea of FF-MR is that the degree of correlation between each feature and all other features is expressed as an attention weight. Thus, features are re-represented as the result of the weighted fusion of all features using the Multi-Head Attention mechanism. Focusing on certain important features according to the distribution of attention weights improves the detection performance. While detecting the traffic in encrypted DNS covert channels, FF-MR can also accurately identify encrypted traffic generated by the three DNS covert channel tools. Experiments on the CIRA-CIC-DoHBrw-2020 dataset show that the macro-averaging recall and precision of the FF-MR method reach 99.73% and 99.72%, respectively, and the macro-averaging F1-Score reached 0.9978, which is up to 4.56% higher than the existing methods compared in the paper. FF-MR achieves at most an 11.32% improvement in macro-averaging F1-Score in identifying three encrypted DNS covert channels, indicating that FF-MR has a strong ability to detect and identify DoH-encrypted DNS covert channels. [ABSTRACT FROM AUTHOR]

The main task of noninvasive load monitoring is to disaggregate the power consumption of a single household appliance from an electricity meter that detects the power consumption of all household appliances. The deep neural network method has achieved leading results in this field. In this article, a multichannel spatio-temporal feature fusion method is proposed, where the spatial features extracted by convolution neural network and the temporal features extracted by the recurrent neural network are fused. And the attention module is introduced to further improve the performance of the model. Finally, the effectiveness and superiority of the proposed method are verified on three public datasets. [ABSTRACT FROM AUTHOR]

Medical imaging systems installed in different hospitals and labs generate images in bulk, which could support medics to analyze infections or injuries. Manual inspection becomes difficult when there exist more images, therefore, intelligent systems are usually required for real‐time diagnosis. Melanoma is one of the most common and severe forms of skin cancer that begins from the cells beneath the skin. Through dermoscopic images, it is possible to diagnose the infection at the early stages. In this regard, different approaches have been exploited for improved results. In this study, we propose a two‐stream deep neural network information fusion framework for multiclass skin cancer classification. The proposed technique follows two streams: initially, a fusion‐based contrast enhancement technique is proposed, which feeds enhanced images to the pretrained DenseNet201 architecture. The extracted features are later optimized using a skewness‐controlled moth–flame optimization algorithm. In the second stream, deep features from the fine‐tuned MobileNetV2 pretrained network are extracted and down‐sampled using the proposed feature selection framework. Finally, most discriminant features from both networks are fused using a new parallel multimax coefficient correlation method. A multiclass extreme learning machine classifier is used to classify lesion images. The testing process is initiated on three imbalanced skin data sets—HAM10000, ISBI2018, and ISIC2019. The simulations are performed without performing any data augmentation step in achieving an accuracy of 96.5%, 98%, and 89%, respectively. A fair comparison with the existing techniques reveals the improved performance of our proposed algorithm. [ABSTRACT FROM AUTHOR]

Human Action Recognition (HAR) is a current research topic in the field of computer vision that is based on an important application known as video surveillance. Researchers in computer vision have introduced various intelligent methods based on deep learning and machine learning, but they still face many challenges such as similarity in various actions and redundant features. We proposed a framework for accurate human action recognition (HAR) based on deep learning and an improved features optimization algorithm in this paper. From deep learning feature extraction to feature classification, the proposed framework includes several critical steps. Before training fine-tuned deep learning models - MobileNet-V2 and Darknet53 - the original video frames are normalized. For feature extraction, pre-trained deep models are used, which are fused using the canonical correlation approach. Following that, an improved particle swarm optimization (IPSO)-based algorithm is used to select the best features. Following that, the selected features were used to classify actions using various classifiers. The experimental process was performed on six publicly available datasets such as KTH, UT-Interaction, UCF Sports, Hollywood, IXMAS, and UCF YouTube, which attained an accuracy of 98.3%, 98.9%, 99.8%, 99.6%, 98.6%, and 100%, respectively. In comparison with existing techniques, it is observed that the proposed framework achieved improved accuracy. [ABSTRACT FROM AUTHOR]

Background: Using artificial intelligence (AI) with the concept of a deep learning-based automated computer-aided diagnosis (CAD) system has shown improved performance for skin lesion classification. Although deep convolutional neural networks (DCNNs) have significantly improved many image classification tasks, it is still difficult to accurately classify skin lesions because of a lack of training data, inter-class similarity, intra-class variation, and the inability to concentrate on semantically significant lesion parts. Innovations: To address these issues, we proposed an automated deep learning and best feature selection framework for multiclass skin lesion classification in dermoscopy images. The proposed framework performs a preprocessing step at the initial step for contrast enhancement using a new technique that is based on dark channel haze and top–bottom filtering. Three pre-trained deep learning models are fine-tuned in the next step and trained using the transfer learning concept. In the fine-tuning process, we added and removed a few additional layers to lessen the parameters and later selected the hyperparameters using a genetic algorithm (GA) instead of manual assignment. The purpose of hyperparameter selection using GA is to improve the learning performance. After that, the deeper layer is selected for each network and deep features are extracted. The extracted deep features are fused using a novel serial correlation-based approach. This technique reduces the feature vector length to the serial-based approach, but there is little redundant information. We proposed an improved anti-Lion optimization algorithm for the best feature selection to address this issue. The selected features are finally classified using machine learning algorithms. Main Results: The experimental process was conducted using two publicly available datasets, ISIC2018 and ISIC2019. Employing these datasets, we obtained an accuracy of 96.1 and 99.9%, respectively. Comparison was also conducted with state-of-the-art techniques and shows the proposed framework improved accuracy. Conclusions: The proposed framework successfully enhances the contrast of the cancer region. Moreover, the selection of hyperparameters using the automated techniques improved the learning process of the proposed framework. The proposed fusion and improved version of the selection process maintains the best accuracy and shorten the computational time.

Foreign bodies often cause belt scratching and tearing, coal stacking, and plugging during the transportation of coal via belt conveyors. To overcome the problems of large parameters, heavy computational complexity, low classification accuracy, and poor processing speed in current classification networks, a novel network based on ESCBAM and multichannel feature fusion is proposed in this paper. Firstly, to improve the utilization rate of features and the network’s ability to learn detailed information, a multi-channel feature fusion strategy was designed to fully integrate the independent feature information between each channel. Then, to reduce the computational amount while maintaining excellent feature extraction capability, an information fusion network was constructed, which adopted the depthwise separable convolution and improved residual network structure as the basic feature extraction unit. Finally, to enhance the understanding ability of image context and improve the feature performance of the network, a novel ESCBAM attention mechanism with strong generalization and portability was constructed by integrating space and channel features. The experimental results demonstrate that the proposed method has the advantages of fewer parameters, low computational complexity, high accuracy, and fast processing speed, which can effectively classify foreign bodies on the belt conveyor.

Knee osteoarthritis (KOA) is one of the deadliest forms of arthritis. If not treated at an early stage, it may lead to knee replacement. That is why early diagnosis of KOA is necessary for better treatment. Manually KOA detection is a time-consuming and error-prone task. Computerized methods play a vital role in accurate and speedy detection. Therefore, the classification and localization of the KOA method are proposed in this work using radiographic images. The two-dimensional radiograph images are converted into three-dimensional and LBP features are extracted having the dimension of N × 59 out of which the best features of N × 55 are selected using PCA. The deep features are also extracted using Alex-Net and Dark-net-53 with the dimensions of N × 1024 and N × 4096, respectively, where N represents the number of images. Then, N × 1000 features are selected individually from both models using PCA. Finally, the extracted features are fused serially with the dimension of N × 2055 and passed to the classifiers on a 10-fold cross-validation that provides an accuracy of 90.6% for the classification of KOA grades. The localization model is proposed with the combination of an open exchange neural network (ONNX) and YOLOv2 that is trained on the selected hyper-parameters. The proposed model provides 0.98 mAP for the localization of classified images. The experimental analysis proves that the presented framework provides better results as compared to existing works. [ABSTRACT FROM AUTHOR]