Search

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

The automatic semantic structuring of scientific text allows for more efficient reading of research articles and is an important indexing step for academic search engines. Sequential sentence classification is an essential structuring task and targets the categorisation of sentences based on their content and context. However, the potential of transfer learning for sentence classification across different scientific domains and text types, such as full papers and abstracts, has not yet been explored in prior work. In this paper, we present a systematic analysis of transfer learning for scientific sequential sentence classification. For this purpose, we derive seven research questions and present several contributions to address them: (1) We suggest a novel uniform deep learning architecture and multi-task learning for cross-domain sequential sentence classification in scientific text. (2) We tailor two transfer learning methods to deal with the given task, namely sequential transfer learning and multi-task learning. (3) We compare the results of the two best models using qualitative examples in a case study. (4) We provide an approach for the semi-automatic identification of semantically related classes across annotation schemes and analyse the results for four annotation schemes. The clusters and underlying semantic vectors are validated using k-means clustering. (5) Our comprehensive experimental results indicate that when using the proposed multi-task learning architecture, models trained on datasets from different scientific domains benefit from one another. Our approach significantly outperforms state of the art on full paper datasets while being on par for datasets consisting of abstracts. [ABSTRACT FROM AUTHOR]

AbstractAmidst the dramatic expansion of online shopping, wasted cardboard packaging has become a significant challenge in modern-day society. In this paper, we propose an innovative approach to address the issue of box packaging waste by efficiently selecting an optimal cardboard box for a set of items. Employing depth vision and deep learning classification techniques, the proposed system analyzes depth images to compute an optimal cuboid for unpackaged items while accounting for fragility characteristics. The system, facilitated by two Intel RealSense RGB-D cameras, first captures the overhead and sideview images to determine the dimensions of an unknown object. Then, the developed vision system utilizes averaging and morphological opening filters to denoise the acquired images, calculates the difference between the background image and object image, and employs thresholding by Otsu’s algorithm to find the minimum cuboid of the irregular object. After, a two-step deep learning model is used to determine the general category and characteristics of an object, considering factors, such as fragility, that may necessitate wrapping or separate packaging. Finally, a modified largest area first fit algorithm uses the outputted dimensions for irregular-shaped objects and packaged objects to determine the optimal fitting box from the standard Amazon box catalog. The computer simulation shows that the proposed method can be implemented in a cardboard packaging warehouse for optimal box selection, effectively minimizing cardboard waste. [ABSTRACT FROM AUTHOR]

Micro-expression is a special kind of human emotion. Due to its characteristics of short time, low intensity, and local region, micro-expression recognition is a difficult task. At the same time, it is a natural, spontaneous, and unconcealable emotion that can well convey a person's actual psychological state and, therefore, has certain research value and practical significance. This paper focuses on micro-expression recognition in the field of deep learning through the survey and understanding of existing micro-expression recognition research, as well as grasping the research trend, for the previous literature on micro-expression review ignored the handcrafted features as an important part of the micro-expression recognition framework, and at the same time lacked the analysis of the various enhancement processing, a new micro-expression recognition framework based on deep learning is proposed. The model is designed from the perspective of modularity and streaming data. On the other hand, unlike the previous process of feeding the data directly into the network for training and recognition, the handcrafted features are used as the initial encoding of the micro-expression recognition data, followed by the training and learning of the deep model and at the same time the modular embedding approach is used to incorporate the feature enhancement module, and finally the classification and recognition. The article provides a detailed summary and analysis of each part of the whole framework and a comprehensive introduction to the current problems, experimental protocols, evaluation metrics, and application areas. Finally, it summarizes and gives possible future research directions. Therefore, this paper provides a comprehensive summary and analysis of micro-expression recognition in deep learning so that the related personnel can have a new understanding of the development of this field. On the other hand, it proposes a new recognition framework that also provides a reference for the researchers' later research. [ABSTRACT FROM AUTHOR]

Lung screening is really crucial in the early detection and management of masses, with particular regard to cancer. Studies have shown that lung cancer screening, can reduce lung cancer mortality by 20–30% in high-risk populations. In recent times, the advent of deep learning, with particular regard to computer vision, demonstrated the ability to effectively detect and locate objects from video streams and also (medical) images. Considering these aspects, in this paper, we propose a method aimed to perform instance segmentation, i.e., by providing a mask for each lung mass instance detected, allowing for the identification of individual masses even if they overlap or are close to each other by classifying the detected masses into (generic) nodules, cancer or adenocarcinoma. In this paper, we considered the you-only-look-once model for lung nodule segmentation. An experimental analysis, performed on a set of real-world lung computed tomography images, demonstrated the effectiveness of the proposed method not only in the detection of lung masses but also in lung mass segmentation, thus providing a helpful way not only for radiologist to conduct automatic lung screening but also for discovering very small masses not easily recognizable to the naked eye and that may deserve attention. As a matter of fact, in the evaluation of a dataset composed of 3654 lung scans, the proposed method obtains an average precision of 0.757 and an average recall of 0.738 in the classification task. Additionally, it reaches an average mask precision of 0.75 and an average mask recall of 0.733. These results indicate that the proposed method is capable of not only classifying masses as nodules, cancer, and adenocarcinoma, but also effectively segmenting the areas, thereby performing instance segmentation. [ABSTRACT FROM AUTHOR]

To communicate with one another hand, gesture is very important. The task of using the hand gesture in technology is influenced by a very common way humans communicate with the natural environment. The recognizing and finding pose estimation of hand comes under the area of hand gesture analysis. To find out the gesturing hand is very difficult than finding the another part of the human body because the hand is smaller in size. The hand has greater complexity and more challenges due to differences between the cultural or individual factors of users and gestures invented from ad hoc. The complication and divergences of finding hand gestures will deeply affect the recognition rate and accuracy. This paper emphasizes on summary of hand gestures technique, recognition methods, merits and demerits, various applications, available data sets, and achieved accuracy rate, classifiers, algorithm, and gesture types. This paper also scrutinizes the performance of traditional and deep learning methods on dynamic hand gesture recognition. [ABSTRACT FROM AUTHOR]

Brain stroke, or a cerebrovascular accident, is a devastating medical condition that disrupts the blood supply to the brain, depriving it of oxygen and nutrients. Each year, according to the World Health Organization, 15 million people worldwide experience a stroke. This results in approximately 5 million deaths and another 5 million individuals suffering permanent disabilities. The complex interplay of various risk factors highlights the urgent need for sophisticated analytical methods to more accurately predict stroke risks and manage their outcomes. Machine learning and deep learning technologies offer promising solutions by analyzing extensive datasets including patient demographics, health records, and lifestyle choices to uncover patterns and predictors not easily discernible by humans. These technologies enable advanced data processing, analysis, and fusion techniques for a comprehensive health assessment. We conducted a comprehensive review of 25 review papers published between 2020 and 2024 on machine learning and deep learning applications in brain stroke diagnosis, focusing on classification, segmentation, and object detection. Furthermore, all these reviews explore the performance evaluation and validation of advanced sensor systems in these areas, enhancing predictive health monitoring and personalized care recommendations. Moreover, we also provide a collection of the most relevant datasets used in brain stroke analysis. The selection of the papers was conducted according to PRISMA guidelines. Furthermore, this review critically examines each domain, identifies current challenges, and proposes future research directions, emphasizing the potential of AI methods in transforming health monitoring and patient care. [ABSTRACT FROM AUTHOR]

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

Segmentation of whole slide histological images through the classification of tissue types of small fragments is an extremely relevant task in digital pathology, necessary for the development of methods for automatic analysis of whole slide histological images. The extremely large resolution of such images also makes the task of increasing image resolution relevant, which allows storing images at a reduced resolution and increasing it if necessary. Annotating whole slide images by histologists is complex and time-consuming, so it is important to make the most efficient use of the available data, both labeled and unlabeled. In this paper we propose a novel neural network method to simultaneously solve the problems of super-resolution of histological images from ×20 optical magnification to ×40 and classifying image fragments into tissue types at ×20 magnification. The use of a single encoder as well as the proposed neural network training scheme allows to achieve better results on both tasks compared to existing approaches. The PATH-DT-MSU WSS2v2 dataset presented for the first time in this paper was used for training and testing the method. On the test sample, an accuracy value of 0.971 and a balanced accuracy value of 0.916 were achieved in the classification task on 5 tissue types, for the super-resolution task, values of PSNR = 32.26 and SSIM = 0.89 were achieved. The source code of the proposed method is available at: https://github.com/Kukty/WSI_SR_CL. [ABSTRACT FROM AUTHOR]

The widespread adoption of Electronic Healthcare Records has resulted in an abundance of healthcare data. This data holds significant potential for improving healthcare services by providing valuable clinical insights and enhancing clinical decision-making. This paper presents a patient classification methodology that utilizes a multiclass and multilabel diagnostic approach to predict the patient's clinical class. The proposed model effectively handles comorbidities while maintaining a high level of accuracy. The implementation leverages the MIMIC III database as a data source to create a phenotyping dataset and train the models. Various machine learning models are employed in this study. Notably, the natural language processing-based One-Vs-Rest classifier achieves the best classification results, maintaining accuracy and F1 scores even with a large number of classes. The patient diagnostic class prediction model, based on the International Classification of Diseases 9, showcased in this paper, has broad applications in diagnostic support, treatment prediction, clinical assistance, recommender systems, clinical decision support systems, and clinical knowledge discovery engines. [ABSTRACT FROM AUTHOR]

Confronted with the fast social development, the speed of garbage generation has increased. Therefore, from every aspect, especially staying green and healthy, it is urgent and vital to ensure accurate and stable garbage classification. In the field of garbage classification, household garbage has a large volume and the classification process still requires manual intervention. Besides, most of the current studies focus on industrial waste and medical waste, while the existing studies on household garbage are not effective enough. Furthermore, these studies are mostly trained and validated in self-built datasets, making the experimental results insufficiently representative and severely limiting the development of research. Aiming to facilitate the study of household garbage classification, this paper proposes a simple yet effective network model (FConvNet) to improve classification performance. In this paper, an effective convolution block with fused convolution is designed to enhance the potential correlation of the features in the spatial dimension, and then a lightweight symmetric structure is constructed to infer more information about the feature representation. The experiments on public datasets have justified the effectiveness of FConvNet with accuracy rates of 95%, 95% and 97%, achieving better performance on public datasets compared to baselines. Additionally, an online system based on the WeChat mini program framework is designed to provide convenient household garbage classification services and enable the collection of uploaded images to perform model optimizations. [ABSTRACT FROM AUTHOR]

Many complex engineering systems can be represented in a topological form, such as graphs. This paper utilizes a machine learning technique called Geometric Deep Learning (GDL) to aid designers with challenging, graph-centric design problems. The strategy presented here is to take the graph data and apply GDL to seek the best realizable performing solution effectively and efficiently with lower computational costs. This case study used here is the synthesis of analog electrical circuits that attempt to match a specific frequency response within a particular frequency range. Previous studies utilized an enumeration technique to generate 43,249 unique undirected graphs presenting valid potential circuits. Unfortunately, determining the sizing and performance of many circuits can be too expensive. To reduce computational costs with a quantified trade-off in accuracy, the fraction of the circuit graphs and their performance are used as input data to a classification-focused GDL model. Then, the GDL model can be used to predict the remainder cheaply, thus, aiding decision-makers in the search for the best graph solutions. The results discussed in this paper show that additional graph-based features are useful, favorable total set classification accuracy of 80% in using only 10% of the graphs, and iteratively built GDL models can further subdivide the graphs into targeted groups with medians significantly closer to the best and containing 88.2 of the top 100 best-performing graphs on average using 25% of the graphs. [ABSTRACT FROM AUTHOR]

Legal Charge Prediction (LCP) is a task of predicting charge labels for which a criminal should be charged based on the factual case descriptions. In recent years, the advancement of deep learning networks has led to the emergence of effective approaches for LCP through the Fine-tuning of pre-trained language models. While existing methods primarily treat it as multiple binary classifications, excelling in the single charge label given factual case descriptions, they still exhibit substantial room for improvement in multi-label LCP. This is because single-label classification methods do not effecitively deal with the relationship between multiple labels, mainly determining the likelihood of a factual description’s association to each individual charge label. Recognizing the need to enhance the relationship among multi-label charges in Fine-tuning-based discriminative charge prediction, this paper introduces a multi-label LCP method based on summarization generation. This method reconstructs the multi-label classification problem as a summarization generation task, capturing the relationship among multiple labels within the summarization content. Empirical findings from the Chinese legal domain’s CAIL2018 dataset demonstrate the method’s capacity to discern the relationship between multiple legal charge labels with Micro-F1 and Macro-F1 enhancements, compared to the fine-tuning-based approaches. [ABSTRACT FROM AUTHOR]

The integration of multi-modal data allows for a more accurate representation of the ground characteristics. For a comprehensive interpretation of remote sensing data, existing multi-modal data fusion research mainly focuses on the joint utilization of 3D Light Detection and Ranging (LiDAR) and 2D Hyperspectral Image (HSI) data. However, existing algorithms do not pay much attention to the interaction of high-level semantic information between different modal data before fusion. This paper proposes a novel multi-modal data fusion deep learning network with the Cross-Modal Self-Attentive Feature Fusion Transformer (SAFFT). The framework employs a multi-head self-attention layer to fuse various attention information from multiple heads, effectively enhancing advanced feature information from different modalities for comprehensive integration. Experimental results on the Houston 2013 dataset demonstrate the effectiveness of the proposed method, which achieves an overall accuracy (OA) of 94.3757% in classifying 15 semantic classes. [ABSTRACT FROM AUTHOR]

Brain tumors pose a serious threat to public health, impacting thousands of individuals directly or indirectly worldwide. Timely and accurate detection of these tumors is crucial for effective treatment and enhancing the quality of patients’ lives. The widely used brain imaging technique is magnetic resonance imaging, the precise identification of brain tumors in MRI images is challenging due to the diverse anatomical structures. This paper introduces an innovative approach known as the ensemble attention mechanism to address this challenge. Initially, the approach uses two networks to extract intermediate- and final-level feature maps from MobileNetV3 and EfficientNetB7. This assists in gathering the relevant feature maps from the different models at different levels. Then, the technique incorporates a co-attention mechanism into the intermediate and final feature map levels on both networks and ensembles them. This directs attention to certain regions to extract global-level features at different levels. Ensemble of attentive feature maps enabling the precise detection of various feature patterns within brain tumor images at both model, local, and global levels. This leads to an improvement in the classification process. The proposed system was evaluated on the Figshare dataset and achieved an accuracy of 98.94%, and 98.48% for the BraTS 2019 dataset which is superior to other methods. Thus, it is robust and suitable for brain tumor detection in healthcare systems. [ABSTRACT FROM AUTHOR]

Nowadays, liver cancers are well-known cancers attacking the human body. The larger segment of liver carcinomas is highly affected by alcohol-associated hepatitis as well as cirrhosis circumstances. In order to increase the survival rate of humans, premature and early diagnosis of liver cancer is very vital. Currently, discriminating the tumor and liver segments from medical imaging with the help of entirely automated computer-aided software is a highly difficult task, because the liver tumor may differ from one human being to another human being. Thus, this paper endeavors to present a new liver tumor segmentation and classification approach by incorporating an optimization-enabled deep learning model. Here, the adopted model comprises four stages, pre-processing, liver segmentation, liver tumor detection, and classification. To begin with, the collected images are given to the pre-processing stage using the African vulture's optimization-based adaptive histogram equalization (AVOAHE). The integration of the African vulture's optimization (AVO) concept in adaptive histogram equalization is named AVOAHE. After the image pre-processing phase, the liver region is segmented by utilizing kernel-based fuzzy C-means clustering. Then, the detection of liver tumor is performed using the Swin-Unet. Finally, tumor detection is done by utilizing the deep convolutional neural network (Deep CNN). Moreover, a hybrid optimization approach, called double exponential smoothing (DES)-marine predator algorithm (MPA), is developed by combining DES and MPA, which is used to train Deep CNN and serves as an enhancement. Finally, the experimental analysis has shown that the adopted technique has achieved better results in terms of accuracy, specificity, sensitivity, and precision with values of 0.957, 0.969, 0.941 and 0.915, respectively. [ABSTRACT FROM AUTHOR]

Lung cancer is a leading cause of cancer-related deaths worldwide, emphasizing the significance of early detection. Computer-aided diagnostic systems have emerged as valuable tools for aiding radiologists in the analysis of medical images, particularly in the context of lung cancer screening. A typical pipeline for lung cancer diagnosis involves pulmonary nodule detection, segmentation, and classification. Although traditional machine learning methods have been deployed in the previous years with great success, this literature review focuses on state-of-the-art deep learning methods. The objective is to extract key insights and methodologies from deep learning studies that exhibit high experimental results in this domain. This paper delves into the databases utilized, preprocessing steps applied, data augmentation techniques employed, and proposed methods deployed in studies with exceptional outcomes. The reviewed studies predominantly harness cutting-edge deep learning methodologies, encompassing traditional convolutional neural networks (CNNs) and advanced variants such as 3D CNNs, alongside other innovative approaches such as Capsule networks and transformers. The methods examined in these studies reflect the continuous evolution of deep learning techniques for pulmonary nodule detection, segmentation, and classification. The methodologies, datasets, and techniques discussed here collectively contribute to the development of more efficient computer-aided diagnostic systems, empowering radiologists and dfhealthcare professionals in the fight against this deadly disease. [ABSTRACT FROM AUTHOR]

In this paper, I present a comprehensive pipeline integrating a Fine-Tuned Convolutional Neural Network (FT-CNN) and a Residual-UNet (RUNet) architecture for the automated analysis of MRI brain scans. The proposed system addresses the dual challenges of brain tumor classification and segmentation, which are crucial tasks in medical image analysis for precise diagnosis and treatment planning. Initially, the pipeline preprocesses the FigShare brain MRI image dataset, comprising 3064 images, by normalizing and resizing them to achieve uniformity and compatibility with the model. The FT-CNN model then classifies the preprocessed images into distinct tumor types: glioma, meningioma, and pituitary tumor. Following classification, the RUNet model performs pixel-level segmentation to delineate tumor regions within the MRI scans. The FT-CNN leverages the VGG19 architecture, pre-trained on large datasets and fine-tuned for specific tumor classification tasks. Features extracted from MRI images are used to train the FT-CNN, demonstrating robust performance in discriminating between tumor types. Subsequently, the RUNet model, inspired by the U-Net design and enhanced with residual blocks, effectively segments tumors by combining high-resolution spatial information from the encoding path with context-rich features from the bottleneck. My experimental results indicate that the integrated pipeline achieves high accuracy in both classification (96%) and segmentation tasks (98%), showcasing its potential for clinical applications in brain tumor diagnosis. For the classification task, the metrics involved are loss, accuracy, confusion matrix, and classification report, while for the segmentation task, the metrics used are loss, accuracy, Dice coefficient, intersection over union, and Jaccard distance. To further validate the generalizability and robustness of the integrated pipeline, I evaluated the model on two additional datasets. The first dataset consists of 7023 images for classification tasks, expanding to a four-class dataset. The second dataset contains approximately 3929 images for both classification and segmentation tasks, including a binary classification scenario. The model demonstrated robust performance, achieving 95% accuracy on the four-class task and high accuracy (96%) in the binary classification and segmentation tasks, with a Dice coefficient of 95%. [ABSTRACT FROM AUTHOR]

Binary classification with an imbalanced dataset is challenging. Models tend to consider all samples as belonging to the majority class. Although existing solutions such as sampling methods, cost-sensitive methods, and ensemble learning methods improve the poor accuracy of the minority class, these methods are limited by overfitting or cost parameters that are difficult to decide. This paper proposes a hybrid approach with dimension reduction that consists of data block construction, dimensionality reduction, and ensemble learning with deep neural network classifiers. The performance is evaluated on eight imbalanced public datasets in terms of recall, G-mean, AUC, F-measure, and balanced accuracy. The results show that the proposed model outperforms state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The increasing complexity of deep learning models can make it difficult to interpret and fit models beyond a purely accuracy-focused evaluation. This is where interpretable and eXplainable Artificial Intelligence (XAI) come into play to facilitate an understanding of the inner workings of models. Consequently, alternatives have emerged, such as class activation mapping (CAM) techniques aimed at identifying regions of importance for an image classification model. However, the behavior of such models can be highly dependent on the type of architecture and the different variants of convolutional neural networks. Accordingly, this paper evaluates three Convolutional Neural Network (CNN) architectures (VGG16, ResNet50, ConvNext-T) against seven CAM models (GradCAM, XGradCAM, HiResCAM, LayerCAM, GradCAM++, GradCAMElementWise, and EigenCAM), indicating that the CAM maps obtained with ConvNext models show less variability among them, i.e., they are less dependent on the selected CAM approach. This study was performed on an image dataset for the classification of coffee leaf rust and evaluated using the RemOve And Debias (ROAD) metric. [ABSTRACT FROM AUTHOR]

Earth observation missions such as Sentinel and Landsat support the large-scale identification of agricultural crops by providing free radar and multispectral satellite images. The extraction of representative image information as well as the combination of different image sources for improved feature selection still represent a major challenge in the field of remote sensing. In this paper, we propose a novel three-dimensional (3D) deep learning U-Net model to fuse multi-level image features from multispectral and synthetic aperture radar (SAR) time series data for seasonal crop-type mapping at a regional scale. For this purpose, we used a dual-stream U-Net with a 3D squeeze-and-excitation fusion module applied at multiple stages in the network to progressively extract and combine multispectral and SAR image features. Additionally, we introduced a distinctive method for generating patch-based multitemporal multispectral composites by selective image sampling within a 14-day window, prioritizing those with minimal cloud cover. The classification results showed that the proposed network provided the best overall accuracy (94.5%) compared to conventional two-dimensional (2D) and three-dimensional U-Net models (2D: 92.6% and 3D: 94.2%). Our network successfully learned multi-modal dependencies between the multispectral and SAR satellite images, leading to improved field mapping of spectrally similar and heterogeneous classes while mitigating the limitations imposed by persistent cloud coverage. Additionally, the feature representations extracted by the proposed network demonstrated their transferability to a new cropping season, providing a reliable mapping of spatio-temporal crop type patterns. [ABSTRACT FROM AUTHOR]

In mathematics, closed-domain systems for Question Answering (QA) have shown a distinct advantage over open-domain systems, primarily due to their focused use of supporting knowledge bases. This advantage is particularly salient in the era of online and hybrid tutoring, where automatic QA systems have become vital in addressing complex mathematical problems. This paper focuses on the challenge of geometric shape recognition in math word problems (MWPs) accompanied by figures that aid in the solution process. Existing systems rely on manually inputted shape information, which is less efficient. In this work, a novel customized two-layer deep learning model ‘2DGeoShapeNet’ for 2D geometric shape recognition has been developed. At the first level, it recognizes images in broad categories such as circles, quadrilaterals, or triangles. At the second level, the subtypes of quadrilaterals and triangles are detected. The proposed 2D shape detection model is trained and tested on a newly created integrated dataset, ‘GeoCQT’ (Circle, Quadrilateral, and Triangle), consisting of 6K+ images. The proposed deep learning technique achieved 93.98% accuracy on the ‘GeoCQT’ dataset. The performance of the proposed techniques is also evaluated on other geometry math word problem solver datasets such as GeoS, Geometry3K, GeoQA, PGDP5K, and PGPS9K. The proposed technique is compared with the already-published work that employed traditional image processing techniques for 2D shape detection. Findings highlight the superiority of two-level deep learning classifiers in detecting geometric shapes, marking a significant advancement in automated geometry problem-solving. [ABSTRACT FROM AUTHOR]

In many modern machine learning (ML) models, attention mechanisms (AMs) play a crucial role in processing data and identifying significant parts of the inputs, whether these are text or images. This selective focus enables subsequent stages of the model to achieve improved classification performance. Traditionally, AMs are applied as a preprocessing substructure before a neural network, such as in encoder/decoder architectures. In this paper, we extend the application of AMs to intermediate stages of data propagation within ML models. Specifically, we propose a generalized attention mechanism (GAM), which can be integrated before each layer of a neural network for classification tasks. The proposed GAM allows for at each layer/step of the ML architecture identification of the most relevant sections of the intermediate results. Our experimental results demonstrate that incorporating the proposed GAM into various ML models consistently enhances the accuracy of these models. This improvement is achieved with only a marginal increase in the number of parameters, which does not significantly affect the training time. [ABSTRACT FROM AUTHOR]

Coronary artery disease (CAD) remains the leading cause of death globally and invasive coronary angiography (ICA) is considered the gold standard of anatomical imaging evaluation when CAD is suspected. However, risk evaluation based on ICA has several limitations, such as visual assessment of stenosis severity, which has significant interobserver variability. This motivates to development of a lesion classification system that can support specialists in their clinical procedures. Although deep learning classification methods are well‐developed in other areas of medical imaging, ICA image classification is still at an early stage. One of the most important reasons is the lack of available and high‐quality open‐access datasets. In this paper, we reported a new annotated ICA images dataset, CADICA, to provide the research community with a comprehensive and rigorous dataset of coronary angiography consisting of a set of acquired patient videos and associated disease‐related metadata. This dataset can be used by clinicians to train their skills in angiographic assessment of CAD severity, by computer scientists to create computer‐aided diagnostic systems to help in such assessment, and to validate existing methods for CAD detection. In addition, baseline classification methods are proposed and analysed, validating the functionality of CADICA with deep learning‐based methods and giving the scientific community a starting point to improve CAD detection. [ABSTRACT FROM AUTHOR]

Understanding the data and reaching accurate conclusions are of paramount importance in the present era of big data. Machine learning and probability theory methods have been widely used for this purpose in various fields. One critically important yet less explored aspect is capturing and analyzing uncertainties in the data and model. Proper quantification of uncertainty helps to provide valuable information to obtain accurate diagnosis. This paper reviewed related studies conducted in the last 30 years (from 1991 to 2020) in handling uncertainties in medical data using probability theory and machine learning techniques. Medical data is more prone to uncertainty due to the presence of noise in the data. So, it is very important to have clean medical data without any noise to get accurate diagnosis. The sources of noise in the medical data need to be known to address this issue. Based on the medical data obtained by the physician, diagnosis of disease, and treatment plan are prescribed. Hence, the uncertainty is growing in healthcare and there is limited knowledge to address these problems. Our findings indicate that there are few challenges to be addressed in handling the uncertainty in medical raw data and new models. In this work, we have summarized various methods employed to overcome this problem. Nowadays, various novel deep learning techniques have been proposed to deal with such uncertainties and improve the performance in decision making. [ABSTRACT FROM AUTHOR]

Invasive ductal carcinoma (IDC) is a common form of breast cancer that affects women. In traditional medical practice, physicians have to manually test and classify areas which are suspected to be cancerous. However, the literature strongly indicates that the manual segmentation process performed by medical practitioners is neither time efficient nor accurate, as it relies on their subjective judgment. This paper introduces a model called residual attention neural network breast cancer classification (RANN-BCC) to help medical practitioners in the cancer diagnostic process. RANN-BCC utilizes residual neural network (ResNet) as an expert-supportive method to aid medical practitioners in cancer diagnosis. The implementation of RANN-BCC can support the classification of whole slide imaging (WSI) into non-IDC and IDC without prior information about the presence of a cancerous lesion. The classification results demonstrate that the RANN-BCC model has achieved 92.45% accuracy, 0.98 recall, 0.91 precision, and 0.94 F-score which has outperformed other models such as CNN, AlexNet, Residual Neural Network 34 (ResNet34), and Feed-Forward Neural Network. The developed RANN-BCC model aims to help medical experts to classify IDC and non-IDC of breast cancer by learning the feature content of medical images. [ABSTRACT FROM AUTHOR]

Graph clustering is an essential task in data analysis. Recently, there has been a notable trend in the application of deep learning in graph clustering. However, it is worth noting that existing deep graph clustering methods primarily focus on the topological information of nodes while overlooking the use of attribute information in the learned feature representations. In addition, they do not address the consistency of the space distribution in attribute and structure clustering results. To tackle these critical issues, a novel structured deep graph clustering network with consistency constraint (CC-DGC) is proposed. The network first constructs an autoencoder to learn and transmit hierarchical attribute information to the graph autoencoder (GAE). Subsequently, the GAE integrates the received hierarchical attribute information with extracted topological information to generate enhanced clustering representations. Moreover, this paper designs a consistency constraint module to promote consistency between the autoencoder and the GAE by optimizing the cluster space distributions they produce. Finally, the feature extraction and clustering classification processes are synchronized and optimized in a self-supervised manner within a unified framework. Extensive experiments illustrate that the proposed CC-DGC demonstrates superiority over the state-of-the-art deep graph clustering methods on five benchmark datasets. [ABSTRACT FROM AUTHOR]

Although modulation classification with deep learning has been widely explored, this is challenging when the training data is limited. In this paper, we meet this challenge by data augmentation based on a semi-supervised generative model, named semi-supervised variational auto-encoder GAN (SS-VAEGAN). The proposed model has two novel aspects: first, the ensemble prediction technique is presented to establish a semi-supervised framework, and thus few labeled data and abundant unlabeled data can be used simultaneously to train the generative model; second, a modified feature matching strategy is utilized to ensure the diversity of the generated samples and contribute to the final classification under limited labeled data. With the aim of the constellation diagram with density and the ResNet-18 network, we have worked out a complete solution of modulation classification with data augmentation using SS-VAEGAN. In the experiments, we investigate the classification accuracy and robustness of the proposed data augmentation method and then compare the proposed SS-VAEGAN with other deep generative models. It is shown that our method can achieve the classification accuracy of 0.968 in the extreme absence of training data. [ABSTRACT FROM AUTHOR]

In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters. [ABSTRACT FROM AUTHOR]

In this paper, we discuss the implementation of artificial self-awareness mechanisms and self-reflection abilities in deep neural networks. While the current limitations of research prevent achieving cognitive capabilities on par with natural biological entities, the incorporation of basic self-awareness and self-reflection mechanisms in deep learning architectures offers substantial advantages in tackling specific problems across various scientific fields, including geosciences. In the first section, we outline the foundational architecture of our deep learning approach termed Self-Aware Learning (SAL). The subsequent part of the paper highlights the practical benefits of this machine learning methodology through synthetic tests and applications addressed to automatic classification and image analysis of real petrological data sets. We show how Self-Aware Learning allows enhanced accuracy, reduced overfitting problems, and improved performances compared to other existing methods. [ABSTRACT FROM AUTHOR]

Deep neural networks are extensively used in text mining and Natural Language Processing is to enable computers to understand, analyze, and generate natural language data, such as text or speech, but semantic resources, such as taxonomies and ontologies, are not fully included in deep learning. In this paper, we use Deep Convolutional Neural Network (Deep CNN) to classify research papers using the Computer Science Ontology, an ontology of research areas in the field of computer science. It takes as input the abstract and keywords of a particular research paper and returns the relevant research topic. To evaluate our ontology, we used a gold standard dataset that includes research articles. To further improve text classification results, we propose to design a Deep CNN model. We then used ontology matching to reduce the classes and get better results. Experimental results show that the proposed approach outperforms the one with the highest precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

Mobile LiDAR technology is a powerful tool that accurately captures spatial information about typical static objects in road scenes. However, the precise extraction and classification of these objects pose persistent technical challenges. In this paper, we employ a deep learning approach to tackle the point cloud classification problem. Despite the popularity of the PointNet++ network for direct point cloud processing, it encounters issues related to insufficient feature learning and low accuracy. To address these limitations, we introduce a novel layer-wise optimization network, LO-Net. Initially, LO-Net utilizes the set abstraction module from PointNet++ to extract initial local features. It further enhances these features through the edge convolution capabilities of GraphConv and optimizes them using the "Unite_module" for semantic enhancement. Finally, it employs a point cloud spatial pyramid joint pooling module, developed by the authors, for the multiscale pooling of final low-level local features. Combining three layers of local features, LO-Net sends them to the fully connected layer for accurate point cloud classification. Considering real-world scenarios, road scene data often consist of incomplete point cloud data due to factors such as occlusion. In contrast, models in public datasets are typically more complete but may not accurately reflect real-world conditions. To bridge this gap, we transformed road point cloud data collected by mobile LiDAR into a dataset suitable for network training. This dataset encompasses nine common road scene features; hence, we named it the Road9 dataset and conducted classification research based on this dataset. The experimental analysis demonstrates that the proposed algorithm model yielded favorable results on the public datasets ModelNet40, ModelNet10, and the Sydney Urban Objects Dataset, achieving accuracies of 91.2%, 94.2%, and 79.5%, respectively. On the custom road scene dataset, Road9, the algorithm model proposed in this paper demonstrated outstanding classification performance, achieving a classification accuracy of 98.5%. [ABSTRACT FROM AUTHOR]

Simple Summary: Diagnosing glioblastoma multiforme (GBM), solitary brain metastases (SBM), and primary central nervous system lymphoma (PCNSL) in malignant tumors of the central nervous system using multi-modal magnetic resonance imaging (MRI) is significantly important in helping physicians develop treatment plans and enhance patient prognosis. In this paper, MFFC-Net is developed and validated using deep learning methods to predict these three tumor categories from multi-modal MRI without the manual region of interest (ROI). MFFC-Net first uses a multi-encoder with DenseBlocks to extract deep features from multi-modal MRI. Then, the feature fusion layer fuses the deep information between different modalities and tissues. Finally, the spatial-channel attention module suppresses redundant new information and activates tumor classification-related features. Compared with radiomics models, MFFC-Net demonstrated higher accuracy. In addition, the results in the different sequences provide important references for future clinical work on MRI image acquisition. We believe that MFFC-Net has the potential to assist in the diagnosis and treatment of brain tumors in the future. (1) Background: Diagnosis of glioblastoma (GBM), solitary brain metastases (SBM), and primary central nervous system lymphoma (PCNSL) plays a decisive role in the development of personalized treatment plans. Constructing a deep learning classification network to diagnose GBM, SBM, and PCNSL with multi-modal MRI is important and necessary. (2) Subjects: GBM, SBM, and PCNSL were confirmed by histopathology with the multi-modal MRI examination (study from 1225 subjects, average age 53 years, 671 males), 3.0 T T2 fluid-attenuated inversion recovery (T2-Flair), and Contrast-enhanced T1-weighted imaging (CE-T1WI). (3) Methods: This paper introduces MFFC-Net, a classification model based on the fusion of multi-modal MRIs, for the classification of GBM, SBM, and PCNSL. The network architecture consists of parallel encoders using DenseBlocks to extract features from different modalities of MRI images. Subsequently, an L 1 − n o r m feature fusion module is applied to enhance the interrelationships among tumor tissues. Then, a spatial-channel self-attention weighting operation is performed after the feature fusion. Finally, the classification results are obtained using the full convolutional layer (FC) and Soft-max. (4) Results: The ACC of MFFC-Net based on feature fusion was 0.920, better than the radiomics model (ACC of 0.829). There was no significant difference in the ACC compared to the expert radiologist (0.920 vs. 0.924, p = 0.774). (5) Conclusions: Our MFFC-Net model could distinguish GBM, SBM, and PCNSL preoperatively based on multi-modal MRI, with a higher performance than the radiomics model and was comparable to radiologists. [ABSTRACT FROM AUTHOR]

Automated and accurate detection of power quality (PQ) events is important from the point of view of safety as well as maintaining the reliability of the power transmission and distribution network. However, detection of multiple PQ events in a noisy environment is challenging task. Another important issue is the choice of meaningful features that can directly influence the accuracy of PQ detection. Considering these two aforesaid facts, this paper presents a novel framework for automated classification of PQ signals in a noisy environment employing cross Stockwell Transform (XST). The XST proposed in this paper has better noise suppression capability compared to conventional Stockwell Transform. Here, XST was used to convert 1D PQ signals to 2D time–frequency (T–F) images. To improve the accuracy of PQ detection, an automated feature extraction method employing deep learning is implemented in this work. The noise free T–F images obtained using XST were fed as inputs to several pre-trained convolutional neural networks (CNNs) for deep feature extraction. Transfer learning technique was implemented to reduce the computational cost. The extracted deep features were further undergone selection using one-way analysis of variance test followed by false discovery rate correction. The statistically significant deep features were subsequently fed to three benchmark machine learning classifiers for classification of PQ signals. In addition, tests were also carried out on real-life PQ signals to verify the practicability of the proposed framework. Investigations revealed that the proposed method returned mean accuracy of 99.72% and 96.45% for classification of simulated and real-life PQ signals, respectively. [ABSTRACT FROM AUTHOR]

Strip steel plays a crucial role in modern industrial production, where enhancing the accuracy and real-time capabilities of surface defect classification is essential. However, acquiring and annotating defect samples for training deep learning models are challenging, further complicated by the presence of redundant information in these samples. These issues hinder the classification of strip steel surface defects. To address these challenges, this paper introduces a high real-time network, ODNet (Orthogonal Decomposition Network), designed for few-shot strip steel surface defect classification. ODNet utilizes ResNet as its backbone and incorporates orthogonal decomposition technology to reduce the feature redundancies. Furthermore, it integrates skip connection to preserve essential correlation information in the samples, preventing excessive elimination. The model optimizes the parameter efficiency by employing Euclidean distance as the classifier. The orthogonal decomposition not only helps reduce redundant image information but also ensures compatibility with the Euclidean distance requirement for orthogonal input. Extensive experiments conducted on the FSC-20 benchmark demonstrate that ODNet achieves superior real-time performance, accuracy, and generalization compared to alternative methods, effectively addressing the challenges of few-shot strip steel surface defect classification. [ABSTRACT FROM AUTHOR]

Intracranial aneurysm (IA) is now a common term closely associated with subarachnoid hemorrhage. IA is the bulging of a blood vessel caused by a weakening of its wall. This bulge can rupture and, in most cases, cause internal bleeding. In most cases, internal bleeding leads to death or other fatal consequences. Therefore, the development of an automated system for detecting IA is needed to help physicians make more accurate diagnoses. For this reason, we have focused on this problem. In this paper, we propose a 2D Convolutional Neural Network (CNN) based on a network commonly used for data classification in medicine. In addition to our proposed network, we also tested ResNet 50, ResNet 101 and ResNet 152 on a publicly available dataset. In this case, ResNet 152 achieved better results than our proposed network, but our network was significantly smaller and the classifications took significantly less time. Our proposed network achieved an overall accuracy of 98%. This result was achieved on a dataset consisting of 611 images. In addition to the mentioned networks, we also experimented with the VGG network, but it was not suitable for this type of data and achieved only 20%. We compare the results in this work with neural networks that have been verified by the scientific community, and we believe that the results obtained by us can help in the creation of an automated system for the detection of IA. [ABSTRACT FROM AUTHOR]

Kolkata, renowned as the City of Joy, boasts a rich tapestry of cultural heritage spanning centuries. Despite the significance of its architectural marvels, accessing comprehensive visual documentation of Kolkata's heritage sites remains a challenge. In online searches, limited imagery often fails to provide a detailed understanding of these historical landmarks. To address this gap, this paper introduces MonuNet, a high-performance deep-learning network specifically designed for the classification of heritage images from Kolkata. The development of MonuNet addresses the critical need for efficient and accurate identification of Kolkata's architectural marvels, which are significant tangible cultural heritages. The dataset used to train MonuNet is organized by heritage sites, each category within the dataset represents distinct sites. It includes images from 13 prominent heritage sites in Kolkata. For each of these sites, there are 50 images, making it a structured collection where each category (heritage site) is equally represented. The proposed network utilizes a unique architecture incorporating a Dense channel attention module and a Parallel-spatial channel attention module to capture intricate architectural details and spatial relationships within the images. Experimental evaluations demonstrate the superior performance of MonuNet in classifying Kolkata heritage images with an accuracy of 89%, Precision of 87.77%, and Recall of 86.61%. The successful deployment of MonuNet holds significant implications for cultural preservation, tourism enhancement, and urban planning in Kolkata, aligning with the United Nations Sustainable Development Goals (SDGs) for sustainable city development. By providing a robust tool for the automatic identification and classification of heritage images, MonuNet promises to enrich online repositories with detailed visual documentation, thereby enhancing accessibility to Kolkata's cultural heritage for researchers, tourists, and urban planners alike. [ABSTRACT FROM AUTHOR]

The intelligent appearance quality classification method for Auricularia auricula is of great significance to promote this industry. This paper proposes an appearance quality classification method for Auricularia auricula based on the improved Faster Region-based Convolutional Neural Networks (improved Faster RCNN) framework. The original Faster RCNN is improved by establishing a multiscale feature fusion detection model to improve the accuracy and real-time performance of the model. The multiscale feature fusion detection model makes full use of shallow feature information to complete target detection. It fuses shallow features with rich detailed information with deep features rich in strong semantic information. Since the fusion algorithm directly uses the existing information of the feature extraction network, there is no additional calculation. The fused features contain more original detailed feature information. Therefore, the improved Faster RCNN can improve the final detection rate without sacrificing speed. By comparing with the original Faster RCNN model, the mean average precision (mAP) of the improved Faster RCNN is increased by 2.13%. The average precision (AP) of the first-level Auricularia auricula is almost unchanged at a high level. The AP of the second-level Auricularia auricula is increased by nearly 5%. And the third-level Auricularia auricula AP is increased by 1%. The improved Faster RCNN improves the frames per second from 6.81 of the original Faster RCNN to 13.5. Meanwhile, the influence of complex environment and image resolution on the Auricularia auricula detection is explored. [ABSTRACT FROM AUTHOR]

The information contained in a map is always represented by text, symbols, and map-type. Among them, map-type is a critical element that denotes the category and theme of map content, which can support map content extraction, map retrieval, and other map data mining tasks. However, the representations of map-type are always so complex and diverse that relies on multiple descriptive labels. Traditional deep learning methods regarding map-type classification are developed by single label, which only supports single-task classification. This means these approaches might overlook the common features among multiple map-type. In this paper, we propose a framework of multi-task deep learning strategy for employing the state-of-the-art deep convolutional neural network models, including ResNet50, MobileNetV2, and Inception-v3, to conduct efficient multi-label map-type classification. Specifically, we develop the dedicated classification module and label selection layer, and integrate them into the backbone of the deep convolutional network model. The experiments revealed that our proposed multi-task classification strategy can achieve greater accuracy in map-type classification, with less processing time required compared to state-of-the-art deep learning regarding map-type classification. This proves that multi-task classification strategy could be competitive to recognize and discover the complex map-type information. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD), the predominant form of dementia, is a growing global challenge, emphasizing the urgent need for accurate and early diagnosis. Current clinical diagnoses rely on radiologist expert interpretation, which is prone to human error. Deep learning has thus far shown promise for early AD diagnosis. However, existing methods often overlook focal structural atrophy critical for enhanced understanding of the cerebral cortex neurodegeneration. This paper proposes a deep learning framework that includes a novel structure-focused neurodegeneration CNN architecture named SNeurodCNN and an image brightness enhancement preprocessor using gamma correction. The SNeurodCNN architecture takes as input the focal structural atrophy features resulting from segmentation of brain structures captured through magnetic resonance imaging (MRI). As a result, the architecture considers only necessary CNN components, which comprises of two downsampling convolutional blocks and two fully connected layers, for achieving the desired classification task, and utilises regularisation techniques to regularise learnable parameters. Leveraging mid-sagittal and para-sagittal brain image viewpoints from the Alzheimer's disease neuroimaging initiative (ADNI) dataset, our framework demonstrated exceptional performance. The para-sagittal viewpoint achieved 97.8% accuracy, 97.0% specificity, and 98.5% sensitivity, while the mid-sagittal viewpoint offered deeper insights with 98.1% accuracy, 97.2% specificity, and 99.0% sensitivity. Model analysis revealed the ability of SNeurodCNN to capture the structural dynamics of mild cognitive impairment (MCI) and AD in the frontal lobe, occipital lobe, cerebellum, temporal, and parietal lobe, suggesting its potential as a brain structural change digi-biomarker for early AD diagnosis. This work can be reproduced using code we made available on GitHub. [ABSTRACT FROM AUTHOR]

Ever since Computer Vision was introduced, humanity has seen various ways to detect or classify objects of various types. Depending upon the context in consideration, the performances of models vary with respect to their evolution or even upon the nature of the data in hand. The classification of front or rear views in vehicles forms an integral part when we go ahead with deciding whether a given vehicle is moving in the correct lane. In the context of Indian streets, we have various challenges like rural unmarked roads, faded markings, shaded situations from poles or trees, etc. Hence instead of detecting lanes, an alternative way is to detect whether the vehicle(s) ahead is facing toward or away from our vehicle. Various deep learning architectures have been proposed in this aspect to detect or classify objects like the networks from Visual Geometry Group, You Only Look Once, Inception Networks, Residual Networks, etc. In this paper, we have performed a comparative analysis of performance on various versions of You Only Look Once for its evolution over time. [ABSTRACT FROM AUTHOR]

In this paper, we leverage multimodal data to classify minerals using a multi-stream neural network. In a previous study on the Tinto dataset, which consisted of a 3D hyperspectral point cloud from the open-pit mine Corta Atalaya in Spain, we successfully identified mineral classes by employing various deep learning models. However, this prior work solely relied on hyperspectral data as input for the deep learning models. In this study, we aim to enhance accuracy by incorporating multimodal data, which includes hyperspectral images, RGB images, and a 3D point cloud. To achieve this, we have adopted a graph-based neural network, known for its efficiency in aggregating local information, based on our past observations where it consistently performed well across different hyperspectral sensors. Subsequently, we constructed a multi-stream neural network tailored to handle multimodality. Additionally, we employed a channel attention module on the hyperspectral stream to fully exploit the spectral information within the hyperspectral data. Through the integration of multimodal data and a multi-stream neural network, we achieved a notable improvement in mineral classification accuracy: 19.2%, 4.4%, and 5.6% on the LWIR, SWIR, and VNIR datasets, respectively. [ABSTRACT FROM AUTHOR]

Artificial intelligence (AI)-based approaches are crucial in computer-aided diagnosis (CAD) for various medical applications. Their ability to quickly and accurately learn from complex data is remarkable. Deep learning (DL) models have shown promising results in accurately classifying Alzheimer's disease (AD) and its related cognitive states, Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI), along with the healthy conditions known as Cognitively Normal (CN). This offers valuable insights into disease progression and diagnosis. However, certain traditional machine learning (ML) classifiers perform equally well or even better than DL models, requiring less training data. This is particularly valuable in CAD in situations with limited labeled datasets. In this paper, we propose an ensemble classifier based on ML models for magnetic resonance imaging (MRI) data, which achieved an impressive accuracy of 96.52%. This represents a 3–5% improvement over the best individual classifier. We evaluated popular ML classifiers for AD classification under both data-scarce and data-rich conditions using the Alzheimer's Disease Neuroimaging Initiative and Open Access Series of Imaging Studies datasets. By comparing the results to state-of-the-art CNN-centric DL algorithms, we gain insights into the strengths and weaknesses of each approach. This work will help users to select the most suitable algorithm for AD classification based on data availability. [ABSTRACT FROM AUTHOR]

Deep learning has enabled significant advancements in the classification of remote sensing images; however, the task of classifying images in remote sensing remains a formidable challenge because of the high item diversity and complexity that result from spatial and temporal combination and connection. The problem of insufficient differentiation of feature representations generated by deep learning remains, which is mostly due to the similarity and variety of inter-class and intra-class images, respectively. This paper introduces a novel hexagonal network architecture called DenseNet-169, which is based on end-to-end convolutional methods (Bi-LSTM and RNN model) known as CRLSTM-Hexnet. The proposed model comprises three distinct components: (1) a module for extracting features, (2) a feature selection module utilizing the Harris Hawk optimization (HHO) algorithm, and (3) a sub-network based on LSTM and RNN, incorporating a class attention module learning layer. Positive quantitative and qualitative findings from experiments on the RSI-CB256 multi-label dataset confirm the efficacy of our model. [ABSTRACT FROM AUTHOR]

Solar cells are playing a significant role in aerospace equipment. In view of the surface defect characteristics in the manufacturing process of solar cells, the common surface defects are divided into three categories, which include difficult-detecting defects (mismatch), general defects (bubble, glass-crack and cell-crack) and easy-detecting defects (glass-upside-down). Corresponding to different types of defects, the deep learning model with different optimization methods and a classification detection method based on multi-models fusion are proposed in the paper. In the proposed model, in order to solve the mismatch problem between the default anchor boxes size of YOLOv5s model and the extreme scale of the battery mismatch defect label boxes, the K-means algorithm was adopted to re-cluster the dedicated anchor boxes for the mismatch defect label boxes. In order to improve the comprehensive detection accuracy of YOLOv5s model for the general defects, the YOLOv5s model was also improved by the methods of image preprocessing, anchor box improving and detection head replacing. In order to ensure the recognition accuracy and improve the detection speed for easy-detecting defects, the lightweight classification network MobileNetV2 was also used to classify the cells with glass-upside-down defects. The experimental results show that the proposed optimization model and classification detection method can significantly improve the defect detection precision. Respectively, the detection precision for mismatch, bubble, glass-crack and cell-crack defects are up to 95.64%, 91.8%, 93.1% and 98.0%. By using lightweight model to train the glass-upside-down defect dataset, the average classification accuracy reaches 100% and the detection speed reaches 13.29 frames per second. The comparison experiments show that the proposed model has a great improvement in detection accuracy compared with the original model, and the defect detection speed of lightweight classification network is improved more obviously, which confirms the effectiveness of the proposed optimization model and the multi-defect classification detection method for solar cells defect detection. [ABSTRACT FROM AUTHOR]

The recent adoption of deep learning-based models for the processing and coding of multimedia signals has brought noticeable gains in performance, which have established deep learning-based solutions as the uncontested state-of-the-art both for computer vision tasks, targeting machine consumption, as well as, more recently, coding applications, targeting human visualization. Traditionally, applications requiring both coding and computer vision processing require first decoding the bitstream and then applying the computer vision methods to the decompressed multimedia signals. However, the adoption of deep learning-based solutions enables the use of compressed domain computer vision processing, with gains in performance and computational complexity over the decompressed domain approach. For point clouds (PCs), these gains have been demonstrated in the single available compressed domain computer vision processing solution, named Compressed Domain PC Classifier, which processes JPEG Pleno PC coding (PCC) compressed streams using a PC classifier largely compatible with the state-of-the-art spatial domain PointGrid classifier. However, the available Compressed Domain PC Classifier presents strong limitations by imposing a single, specific input size which is associated to specific JPEG Pleno PCC configurations; this limits the compression performance as these configurations are not ideal for all PCs due to their different characteristics, notably density. To overcome these limitations, this paper proposes the first Adaptive Compressed Domain PC Classifier solution which includes a novel adaptive bridge model that allows to process the JPEG Pleno PCC encoded bit streams using different coding configurations, now maximizing the compression efficiency. Experimental results show that the novel Adaptive Compressed Domain PC Classifier allows JPEG PCC to achieve better compression performance by not imposing a single, specific coding configuration for all PCs, regardless of its different characteristics. Moreover, the added adaptability power can achieve slightly better PC classification performance than the previous Compressed Domain PC Classifier and largely better PC classification performance (and lower number of weights) than the PointGrid PC classifier working in the decompressed domain. [ABSTRACT FROM AUTHOR]

It is vital for the development of attention deficit hyperactivity disorders (ADHDs) diagnostic tools that help healthcare practitioners to have automated recognition of ADHDs. Recently, the detection of ADHD using EEG data has attracted a lot of interest due to its apparent rapidity in diagnosis and treatment. This is because the disease seems to be caused by hyperactivity and inattention. This paper presents the method for diagnosing ADHDs based on EEG data, with the nonlinear characteristics being retrieved via the Synchrosqueezing Transform (ST). The ST filter banks are used to break down the 16 channels of EEG signal information into the ideal number of time-frequency subbands. At each stage of the decomposition process, the distinctive feature vectors are assessed using CNN as well as the proposed nonlinear fractal dimensions approach. Using ResNet34, it was discovered that a modified CNN classifier that used a 10-fold cross-validation approach was an efficient classifier for differentiating between normal people and those with ADHD. The suggested method was able to successfully categorize ADHD and normal participants with the best accuracy, as shown by several performance indicators. The statistical study demonstrated that the CNN and the proposed nonlinear feature estimation techniques produce possible characteristics that are acceptable for the automated identification of ADHD. These features may be categorized with good accuracy, sensitivity and specificity. The technique that has been presented is capable of correctly differentiating between participants who have ADHD and those who do not have ADHD with an ultimate precision of 99.5%. [ABSTRACT FROM AUTHOR]