Search

The use of Artificial Intelligence (AI) to preserve and promote cultural heritage has experienced significant growth in recent years. Among the various areas of cultural heritage, numismatics have emerged as a particularly promising field where we can develop AI solutions. Numismatics refers to the study of coins, tokens, paper money, and medals, which play a critical role in understanding human history and culture. However, there are still limited resources available to help researchers and collectors in the identification of coins. This is due to the vast number of coins in circulation, which presents a significant challenge in developing smart tools for classification tasks. This paper aims to provide a contribution to this setting. In particular, we start by creating a new dataset called EURO-Coin, which consists of images showing the side of coins with reliefs and is designed to facilitate the training and testing of AI models for euro coin classification. Then, we propose two approaches that leverage Convolutional Neural Networks and self-attention layers to classify the country and value of the coins. In our experiments, we obtain an accuracy of 86.9% for country classification and an accuracy of 96.4% for value classification. Finally, we conduct an ablation study to evaluate the impact of the preprocessing activities and attention layers in our approaches. [ABSTRACT FROM AUTHOR]

This paper presents a convolutional neural network (CNN) to classify between the conventionally and organically cultivated Memecik varieties of green olives. The image forming method called the rising paper chromatography is utilized in preparing the images of Memecik varieties of green olives for CNN. In the rising chromatography method, 20, 30, and 40% sample concentrations were determined as the suitable concentrations for both organic and conventional olives. The concentrations of AgNO3 and FeSO4 were determined as 0.25, 0.5, 0.75 and 1% for both conventional and organic samples. The visual differences used for differentiation of different types of Memecik green olives are usually determined according to the regional color differences, the vivid color occurrence, the width and the frequency of bowl occurrence, the thin line, and the picks at drop zone by the expert assessors. The testing results in this study verified the effectiveness of the CNN methodology in differentiating between the organically and conventionally cultivated Memecik green olives. The newly designed neural network achieved 100% accuracy. Furthermore, this high accuracy achieved by CNN might suggest that it can be effectively used in place of the expert assessors. [ABSTRACT FROM AUTHOR]

Brain–computer interfacing (BCI) research, fueled by deep learning, integrates insights from diverse domains. A notable focus is on steady-state visual evoked potential (SSVEP) in BCI applications, requiring in-depth assessment through deep learning. EEG research frequently employs SSVEPs, which are regarded as normal brain responses to visual stimuli, particularly in investigations of visual perception and attention. This paper tries to give an in-depth analysis of the implications of deep learning for SSVEP-adapted BCI. A systematic search across four stable databases (Web of Science, PubMed, ScienceDirect, and IEEE) was developed to assemble a vast reservoir of relevant theoretical and scientific knowledge. A comprehensive search yielded 177 papers that appeared between 2010 and 2023. Thence a strict screening method from predetermined inclusion criteria finally generated 39 records. These selected works were the basis of the study, presenting alternate views, obstacles, limitations and interesting ideas. By providing a systematic presentation of the material, it has made a key scholarly contribution. It focuses on the technical aspects of SSVEP-based BCI, EEG technologies and complex applications of deep learning technology in these areas. The study delivers more penetrating reporting on the latest deep learning pattern recognition techniques than its predecessors, together with progress in data acquisition and recording means suitable for SSVEP-based BCI devices. Especially in the realms of deep learning technology orchestration, pattern recognition techniques, and EEG data collection, it has effectively closed four important research gaps. To increase the accessibility of this critical material, the results of the study take the form of easy-to-read tables just generated. Applying deep learning techniques in SSVEP-based BCI applications, as the research shows, also has its downsides. The study concludes that a radical framework will be presented which, includes intelligent decision-making tools for evaluation and benchmarking. Rather than just finding a comparable or similar analogy, this framework is intended to help guide future research and pragmatic applications, and to determine which SSVEP-based BCI applications have succeeded at responsibility for what they set out with. [ABSTRACT FROM AUTHOR]

Research on the visual system and its development is not only crucial for understanding how we see and interpret the environment from basic visual processing to complex perception but also aids in the development of technologies like virtual reality, augmented reality, and computer vision. In our previous paper, we have proposed a novel biological motion direction detection mechanism. Based on this mechanism, the authors of this paper proposed a learning artificial visual system (AVS) and use it to achieve motion direction detection. The learning AVS consists of two layers: the local visual feature detective neuron layer and the global feature detective neuron layer. For local motion direction detection, we use dendritic neurons to implement local motion direction-detective neurons and use them to extract local motion direction information. Global feature detective neurons are simply implemented by summing the local motion direction-detective neurons in each direction of possible motion. We trained the learning AVS by eliminating unnecessary branches or synapses and keeping only those that are strongly connected to the function of motion direction detection. Computer simulations demonstrate that AVS can learn the correct motion direction of objects with different shapes, size and positions. We compare the performance of AVS with support vector machine (SVM) and traditional convolutional neural networks (CNNs)—LeNet-5 and EfficientNet-B0 (EfN)—in motion direction detection and find that our learning AVS has better recognition accuracy, noise immunity and less demands on size of dataset and learning costs. [ABSTRACT FROM AUTHOR]

Visual question answering is a challenging task that necessitates for sophisticated reasoning over the visual elements to provide an accurate answer to a question. Majority of the state-of-the-art VQA models are only applicable to English questions. However, applications such as visual assistance and tourism necessitate the incorporation of multilingual VQA systems. This paper presents an effective deep learning framework for Malayalam visual question answering (MVQA), which can answer a specific natural language question about an image in Malayalam. As there is no available dataset in English–Malayalam VQA, a MVQA dataset was created by translating English question–answer pairs from the visual genome dataset. The paper proposes an attention-driven MVQA model on the developed dataset. The proposed MVQA model uses a deep learning-based co-attention mechanism to jointly learn the attention for images and Malayalam questions. A second-order multimodal factorized high-order pooling is used for multi modal feature fusion. Different VQA models using combinations of classical CNNs and RNNs were experimented on the developed MVQA dataset, and the performance was compared against the proposed attention-driven model. Experimental results show that the proposed attention-driven MVQA model achieves state-of-the-art results as compared to other models for MVQA on the custom Malayalam VQA dataset. [ABSTRACT FROM AUTHOR]

The inspection and diagnosis of building engineering involve rail surface defect detection, which plays a crucial role in assessing the quality of railway tracks. However, achieving accurate detection remains a significant challenge for infrastructure construction due to the challenging factors, such as complex background, poor texture, the irregular shapes and sizes of rail surface defects, etc. To address these challenges, combined with vision sensor, this paper proposes an automatic vision-based rail surface defect detection network, which leverages a combination of convolutional neural network (CNN) and transformer. Specifically, an effective encoding path based on an improved Res2N-et is presented to obtain stronger contextual information. Meanwhile, to address the limitation of feature representation on global context information, the transformer block is introduced into the bottleneck layer to capture essential global context information. Moreover, an attention-based edge enhancement block is proposed to mitigate the loss of local edge details and strengthen the focus on key feature information, to acquire more discriminant features. To further enrich the feature representation capability, this paper introduces an efficient feature aggregation block, which combines the global features extracted by the transformer and the local features extracted by CNN, to achieve effective feature complementarity and enhances overall detection performance. Combined with public NRSD-MN dataset, proposed model obtains 87.3 % and 77.9 % on PA metric, 85.9 % and 83.4 % in mIoU metric among artificial dataset with natural dataset. Meanwhile, it also obtains 84.0 % PA metric and 87.0 % mIoU metric in SEPR dataset. Experiments have proven the superiority of proposed model though the performance comparison with latest models, which presents an effective and promising rail surface defect detection solution for railway track quality assessment, and can be instrumental in ensuring safe and efficient railway operations. [ABSTRACT FROM AUTHOR]

Mental stress is a common problem that affects individuals all over the world. Stress reduces human functionality during routine work and may lead to severe health defects. Early detection of stress is important for preventing diseases and other negative health-related consequences of stress. Several neuroimaging techniques have been utilized to assess mental stress, however, due to its ease of use, robustness, and non-invasiveness, electroencephalography (EEG) is commonly used. This paper aims to fill a knowledge gap by reviewing the different EEG-related deep learning algorithms with a focus on Convolutional Neural Networks (CNNs) and Long Short-Term Memory networks (LSTMs) for the evaluation of mental stress. The review focuses on data representation, individual deep neural network model architectures, hybrid models, and results amongst others. The contributions of the paper address important issues such as data representation and model architectures. Out of all reviewed papers, 67% used CNN, 9% LSTM, and 24% hybrid models. Based on the reviewed literature, we found that dataset size and different representations contributed to the performance of the proposed networks. Raw EEG data produced classification accuracy around 62% while using spectral and topographical representation produced up to 88%. Nevertheless, the roles of generalizability across different deep learning models and individual differences remain key areas of inquiry. The review encourages the exploration of innovative avenues, such as EEG data image representations concurrently with graph convolutional neural networks (GCN), to mitigate the impact of inter-subject variability. This novel approach not only allows us to harmonize structural nuances within the data but also facilitates the integration of temporal dynamics, thereby enabling a more comprehensive assessment of mental stress levels. [ABSTRACT FROM AUTHOR]

An efficient plant disease identification is prime important for Agricultural productivity. This paper proposes a method of automatic leaf extraction and classification with improved accuracy compared with existing techniques. Images acquired from natural fields are complex, with background information that needs to be accurately segmented to identify areas of interest. Grab cut is a semi-automatic approach to extract foreground objects, which might occasionally degrade an object's properties. This paper suggests a better Grab cut for automatically extracting leaves from real-field images. The enhanced dataset of 23,617 images with eleven tomato leaf classes are created using the plant village dataset and actual field images. This paper addresses a wide range of issues related to convolutional neural network optimization, including how the number of layers affects the results of leaf disease detection and the creation of tiny models for portable devices. Five models, VGG 16, MobileNet, and custom architecture with input sizes of 98 × 98, 160 × 160, and 256 × 256, have been optimized and evaluated through several trials. Training and testing involve varying the input size, the number of layers, the optimizer, the dropout, the batch normalization, and the transfer learning. This paper presents and analyzes the findings of thirty experiments on various architecture. The proposed modified sequential eleven-layer architecture achieves accuracy compared with MobileNet and a reduced model size of 3.9 MB for input size 160 and 4.5 MB for input size 98. [ABSTRACT FROM AUTHOR]

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

IoT devices convert billions of objects into data-generating entities, enabling them to report status and interact with their surroundings. This data comes in various formats, like structured, semi-structured, or unstructured. In addition, it can be collected in batches or in real time. The problem now is how to benefit from all of this data gathered by sensing and monitoring changes like temperature, light, and position. In this paper, we propose a predictive analytics framework constructed on top of open-source technologies such as Apache Spark and Kafka. The framework focuses on forecasting temperature time series data using traditional and deep learning predictive analytics methods. The analysis and prediction tasks were performed using Autoregressive Integrated Moving Average (ARIMA), Seasonal Autoregressive Integrated Moving Average (SARIMA), Long Short-Term Memory (LSTM), and a novel hybrid model based on Convolution Neural Network (CNN) and LSTM. The purpose of this paper is to determine whether and how recently developed deep learning-based models outperform traditional algorithms in the prediction of time series data. The empirical studies conducted and reported in this paper demonstrate that deep learning-based models, specifically LSTM and CNN-LSTM, exhibit superior performance compared to traditional-based algorithms, ARIMA and SARIMA. More specifically, the average reduction in error rates obtained by LSTM and CNN-LSTM models were substantial when compared to other models indicating the superiority of deep learning. Moreover, the CNN-LSTM-based deep learning model exhibits a higher degree of closeness to the actual values when compared to the LSTM-based model. [ABSTRACT FROM AUTHOR]

Autism Spectrum Disorder (ASD) is a developmental condition resulting from abnormalities in brain structure and function, which can manifest as communication and social interaction difficulties. Conventional methods for diagnosing ASD may not be effective in the early stages of the disorder. Hence, early diagnosis is crucial to improving the patient's overall health and well-being. One alternative and effective method for early autism diagnosis is facial expression recognition since autistic children typically exhibit distinct facial expressions that can aid in distinguishing them from other children. This paper provides a deep convolutional neural network (DCNN)-based real-time emotion recognition system for autistic kids. The proposed system is designed to identify six facial emotions, including surprise, delight, sadness, fear, joy, and natural, and to assist medical professionals and families in recognizing facial expressions in autistic children for early diagnosis and intervention. In this study, an attention-based YOLOv8 (AutYOLO-ATT) algorithm for facial expression recognition is proposed, which enhances the YOLOv8 model's performance by integrating an attention mechanism. The proposed method (AutYOLO-ATT) outperforms all other classifiers in all metrics, achieving a precision of 93.97%, recall of 97.5%, F1-score of 92.99%, and accuracy of 97.2%. These results highlight the potential of the proposed method for real-world applications, particularly in fields where high accuracy is essential. [ABSTRACT FROM AUTHOR]

Sustainable Development Goal 7 is dedicated to ensuring access to clean and affordable energy that can be utilized in various applications. Solar panels (SP) are utilized to convert sunlight into electricity, acting as a renewable energy source. It is important to keep SP clean to obtain the required performance, as the accumulation of snow and dust on SP greatly affects the amount of electricity generated. On the other hand, excessive cleaning has some detrimental effects on the SP, therefore cleaning should only be done when necessary and not on a regular basis. Consequently, it is critical to determine whether the cleaning procedure is necessary by automatically detecting the presence of dust or snow on the panels while avoiding inaccurate predictions. Research efforts have been made to detect the presence of dust and snow on SP, but most of the proposed methods do not guarantee accurate detection results. This paper proposes an accurate, reliable, and interpretable approach called Solar-OBNet. The proposed Solar-OBNet can detect dusty SP and snow-covered SP very efficiently and be used in conjunction with the methods used to clean SP. The proposed Solar-OBNet is based on a Bayesian convolutional neural network, which enables it to express the amount of confidence in its predictions. Two measurements are used to estimate the uncertainty in the outcomes of the proposed Solar-OBNet, namely predictive entropy and standard deviation. The proposed Solar-OBNet can express confidence in the correct predictions by showing low values for predictive entropy and standard deviation. The proposed Solar-OBNet can also give an uncertainty warning in the case of erroneous predictions by showing high values of predictive entropy and standard deviation. The proposed Solar-OBNet's efficacy was verified by interpreting its results using a method called Weighted Gradient-Directed Class Activation Mapping (Grad-CAM). The proposed Solar-OBNet has achieved a balanced accuracy of 94.07% and an average specificity 95.83%, outperforming other comparable methods. [ABSTRACT FROM AUTHOR]

Retinal fundus image classification is pivotal for the early detection of various eye disorders. Leveraging advancements in deep learning, this research introduces a robust framework for retinal fundus image classification. In this research paper, we introduce a novel methodology that integrates the Active Gradient Deep Convolutional Neural Network (AG-DCNN) architecture with the Red Spider Optimization (RSO) algorithm. Extensive evaluations conducted on well-established retinal image datasets such as DRIVE, STARE, CHASE DB1, HRF, DRISHTI-GS, and RFMiD illustrate substantial enhancements in classification accuracy, sensitivity, and specificity when compared to conventional approaches. The AG-DCNN with RSO exhibits superior performance and remarkable generalization abilities across diverse datasets. This novel approach not only enhances the latest advances in retinal image classification but also holds promise for early disease diagnosis and improved patient care. Through extensive examinations, our proposed method consistently outperforms established techniques, establishing itself as the benchmark in retinal fundus image classification. The integration of AG-DCNN and RSO showcases its efficacy and potential impact in advancing the field of medical image analysis. [ABSTRACT FROM AUTHOR]

Protein structure prediction is one of the main research areas in the field of Bio-informatics. The importance of proteins in drug design attracts researchers for finding the accurate tertiary structure of the protein which is dependent on its secondary structure. In this paper, we focus on improving the accuracy of protein secondary structure prediction. To do so, a Multi-scale convolutional neural network with a Gated recurrent neural network (MCNN-GRNN) is proposed. The novel amino acid encoding method along with layered convolutional neural network and Gated recurrent neural network blocks helps to retrieve local and global relationships between features, which in turn effectively classify the input protein sequence into 3 and 8 states. We have evaluated our algorithm on CullPDB, CB513, PDB25, CASP10, CASP11, CASP12, CASP13, and CASP14 datasets. We have compared our algorithm with different state-of-the-art algorithms like DCNN-SS, DCRNN, MUFOLD-SS, DLBLS_SS, and CGAN-PSSP. The Q3 accuracy of the proposed algorithm is 82–87% and Q8 accuracy is 69–77% on different datasets. [ABSTRACT FROM AUTHOR]

With the wide application of deep learning in anomaly detection (AD), industrial vision AD has achieved remarkable success. However, current AD usually focuses on anomaly localization and rarely investigates anomaly classification. Furthermore, anomaly classification is currently requested for quality management and anomaly reason analysis. Therefore, it is essential to classify anomalies while improving the accuracy of AD. This paper designs a novel multi-classification AD (MCAD) framework to achieve high-accuracy AD with an anomaly classification function. In detail, the proposal model based on relational knowledge distillation consists of two components. The first one employs a teacher–student AD model, utilizing a relational knowledge distillation approach to transfer the interrelationships of images. The teacher–student critical layer feature activation values are used in the knowledge transfer process to achieve anomaly detection. The second component realizes anomaly multi-classification using the lightweight convolutional neural network. Our proposal has achieved 98.95, 96.04, and 92.94% AUROC AD results on MNIST, FashionMNIST, and CIFAR10 datasets. Meanwhile, we earn 97.58 and 98.10% AUROC for AD and localization in the MVTecAD dataset. The average classification accuracy of anomaly classification has reached 76.37% in fifteen categories of the MVTec-AD dataset. In particular, the classification accuracy of the leather category has gained 95.24%. The results on the MVTec-AD dataset show that MCAD achieves excellent detection, localization, and classification results. [ABSTRACT FROM AUTHOR]

Scene recognition has been the foundation of research in computer vision fields. Because scene images typically are composed of specific regions distributed in some layout, so modeling layouts of various scenes is a key clue for scene recognition. Existing methods usually require an additional stream to detect regions for subsequent modeling, which accumulate errors and may miss important information. Meanwhile, they use manual features to model relations between regions, which weakens the representation ability of layouts. In this paper, we propose a single-stream adaptive scene layout modeling approach based on a layout modeling module (LMM), which constructs layouts without additional detection streams and adaptively captures the relations to take advantage of graph attention network. LMM is directly concatenated to a convolutional neural network, where each pixel of the activation maps of the last convolutional layer is defined as a region that is the initial input node of the LMM. LMM first models the layout of each region, and then uses all regions with layout information to model the entire scene. Layout relations are encoded as edges, which are automatically analyzed according to region co-occurrence and relative position. Our work can be understood as optimizing features of the activation maps from a scene layout modeling perspective for scene recognition. Experimental results on MIT67, SUN397, and Places365 show that our single-stream model achieves competitive performance. [ABSTRACT FROM AUTHOR]

Automatic handwritten character recognition plays a significant role in various applications across multiple fields. With the growing interest in automatic handwriting recognition and the advancement of deep learning methods, researchers have achieved significant improvements in the development of English handwriting recognition methods. However, the recognition of Arabic handwriting has received insufficient attention. In this paper, a novel "DeepAHR" model is presented to accurately and efficiently recognize Arabic handwritten characters using deep learning techniques. The "DeepAHR" model is based on a convolutional neural network (CNN) and is trained using two recent public datasets: Hijaa and Arabic handwritten characters dataset (AHCD). The overall accuracies of the proposed model were 98.66% and 88.24% on the AHCD and Hijaa datasets, respectively.The experimental results showed that DeepAHR outperformed state-of-the-art methods in the literature. These promising results provide evidence of the successful use of the DeepAHR model for recognizing handwritten Arabic characters [ABSTRACT FROM AUTHOR]

In recent years, transformers, initially developed for language, have been successfully applied to visual tasks. Vision transformers have been shown to push the state of the art in a wide range of tasks, including image classification, object detection, and semantic segmentation. While ample research has shown promising results in art attribution and art authentication tasks using convolutional neural networks, this paper examines whether the superiority of vision transformers extends to art authentication, improving, thus, the reliability of computer-based authentication of artworks. Using a carefully compiled dataset of authentic paintings by Vincent van Gogh and two contrast datasets, we compare the art authentication performances of Swin transformers with those of EfficientNet. Using a standard contrast set containing imitations and proxies (works by painters with styles closely related to van Gogh), we find that EfficientNet achieves the best performance overall. With a contrast set that only consists of imitations, we find the Swin transformer to be superior to EfficientNet by achieving an authentication accuracy of over 85%. These results lead us to conclude that vision transformers represent a strong and promising contender in art authentication, particularly in enhancing the computer-based ability to detect artistic imitations. [ABSTRACT FROM AUTHOR]

The significant increase in online activities in the wake of recent global events has underlined the importance of biometric person authentication on digital platforms. Although many biometric devices may be used for precise biometric authentication, acquiring the necessary technology, such as 3D sensors or fingerprint scanners, can be prohibitively expensive and logistically challenging. Addressing the demands of online environments, where access to specialized hardware is limited, this paper introduces an innovative approach. In this work, by fusing static and dynamic signature data with facial data captured through regular computer cameras, a dataset of 1750 samples from 25 individuals is constructed. Deep learning models, including convolutional neural networks (CNN), long short-term memory (LSTM), gated recurrent unit (GRU), and temporal convolutional networks (TCN), are employed to craft a robust multi-classification model. This integration of various deep learning algorithms has demonstrated remarkable performance enhancements in biometric authentication. This research also underscores the potential of merging dynamic and static biometric features, derived from readily available sources, to yield a high-performance recognition framework. As online interactions continue to expand, the combination of various biometric modalities holds potential for enhancing the security and usability of virtual environments. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

Scene classification in panchromatic (PAN) remote sensing images is a challenging task due to arbitrary spatial arrangement of a variety of objects with complex background in the absence of RGB-channel information. In this paper, we propose an elevation-guided attention network (EGANet) for multimodal scene classification in panchromatic images by leveraging elevation information from digital elevation model (DEM). The proposed network helps to identify the potential regions containing prominent class-specific features in the panchromatic image scene with the attention of elevation features extracted from a convolution neural network (CNN). Then, elevation-guided features in panchromatic image scene are obtained by the correlation of these two modalities for effective scene classification. The efficacy of the proposed method is demonstrated on Cartosat-1 panchromatic remote sensing image datasets with a lot of variations in view-angle, occlusion, background, and illumination conditions. The experimental results show that our proposed EGANet achieves scene classification accuracy with an improvement of 5% in comparison with the state-of-the-art approaches. [ABSTRACT FROM AUTHOR]

This paper presents a lightweight and accurate convolution neural network (CNN) based on encoder in vision transformer structure, which uses multigroup convolution rather than multilayer perceptron and multiheaded self-attention. We propose a group convolution block called multigroup convolution attention (MGCA) and squeeze and excitation (SE). The MGCA includes two parts: three 1 × 1 convolutions concatenated along the channel dimension and depth-wise separable convolution. SE is used as a skip connection to provide long-range dependencies. MGCA-SE is introduced to reduce the number of parameters in state-of-the-art network in order to use fewer datasets for training CNN. Furthermore, we provide a lightweight network based on MGCA-SE in Resnet architecture called Resnet-multigroup convolution attention-squeeze and excitation (Res-MGCA-SE) in order to have early detection and treatment of medical images. Finally, Res-MGCA-SE is evaluated on lung cancer and Covid-19 chest X-ray and CT and images. According to our research findings, MGCA-SE can change convolutional layers in state-of-the-art networks and switch them to lightweight networks with properties comparable to heavy-weight networks. [ABSTRACT FROM AUTHOR]

This paper proposes a new method to improve the training efficiency of deep convolutional neural networks. During training, the method evaluates scores to measure how much each layer's parameters change and whether the layer will continue learning or not. Based on these scores, the network is scaled down such that the number of parameters to be learned is reduced, yielding a speed-up in training. Unlike state-of-the-art methods that try to compress the network to be used in the inference phase or to limit the number of operations performed in the back-propagation phase, the proposed method is novel in that it focuses on reducing the number of operations performed by the network in the forward propagation during training. The proposed training strategy has been validated on two widely used architecture families: VGG and ResNet. Experiments on MNIST, CIFAR-10 and Imagenette show that, with the proposed method, the training time of the models is more than halved without significantly impacting accuracy. The FLOPs reduction in the forward propagation during training ranges from 17.83% for VGG-11 to 83.74% for ResNet-152. As for the accuracy, the impact depends on the depth of the model and the decrease is between 0.26% and 2.38% for VGGs and between 0.4 and 3.2% for ResNets. These results demonstrate the effectiveness of the proposed technique in speeding up learning of CNNs. The technique will be especially useful in applications where fine-tuning or online training of convolutional models is required, for instance because data arrive sequentially. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a condition that degenerates over time and impairs speech and pronunciation because brain cells have died. This research work aims to predict parkinson disease using the voice features extracted from speech signals recorded from PD individuals with dysphonic speech disorders by employing deep learning algorithms. PD is challenging to diagnose early on in the clinical presentation. To address the issue in machine learning methods, this paper proposes a neural network model by processing speech signals to classify PD using the University of California Irvine (UCI) machine learning repository dataset. Initially, a pre-loss reduction module is created by using pre-sampling to make the dataset balanced by reducing the dimensionality and maintaining the size of the space without influencing the learning process for data preparation. The relevant features are derived using a novel multi-agent salp swarm (MASS) algorithm, and a novel Parkinson classification neural network (PCNN) is proposed to classify Parkinson's patients with high accuracy employing these derived features. The result shows that the models that use MASS-PCNN produce higher classification accuracy of 99.1%, precision of 97.8%, recall of 94.7% and F1-score of 0.995 when paralleled to the existing models. As an outcome, the suggested model will perform superior to common convolutional neural networks. [ABSTRACT FROM AUTHOR]

Personalized learning has gained significant attention in education as a means to cater to the diverse needs of learners and optimize educational outcomes. However, ensuring the efficiency of personalized learning remains a challenge. It requires the ability to accurately analyze and interpret vast amounts of data collected from learners. Traditional analytical approaches often struggle to handle the complexity and heterogeneity of this data, limiting the potential for personalized learning interventions. To address these challenges, this paper proposes a personalized learning efficiency data analysis network (PLEDANet) based on machine learning. First, PLEDANet redesigns a convolutional neural network based on the ResNet structure. The network performs convolutions using multiple convolution kernels of different scales to extract diverse feature information from personalized learning efficiency data. To enhance the extraction and representation of fine-grained differentiated features, PLEDANet introduces a hybrid attention module to combine channel and spatial information among feature maps. Second, PLEDANet designs a hybrid loss function for model training, which consists of the AM-softmax loss and the Center loss. The former increases the inter-class distance of features by imposing a fixed angular margin, while the latter reduces the intra-class distance by constraining the samples and feature centers. Finally, extensive experiments are conducted on PLEDANet. The experimental results validate the superiority of PLEDANet for personalized learning efficiency analysis. [ABSTRACT FROM AUTHOR]

Forecasting solar power production accurately is critical for effectively planning and managing renewable energy systems. This paper introduces and investigates novel hybrid deep learning models for solar power forecasting using time series data. The research analyzes the efficacy of various models for capturing the complex patterns present in solar power data. In this study, all of the possible combinations of convolutional neural network (CNN), long short-term memory (LSTM), and transformer (TF) models are experimented. These hybrid models also compared with the single CNN, LSTM and TF models with respect to different kinds of optimizers. Three different evaluation metrics are also employed for performance analysis. Results show that the CNN–LSTM–TF hybrid model outperforms the other models, with a mean absolute error (MAE) of 0.551% when using the Nadam optimizer. However, the TF–LSTM model has relatively low performance, with an MAE of 16.17%, highlighting the difficulties in making reliable predictions of solar power. This result provides valuable insights for optimizing and planning renewable energy systems, highlighting the significance of selecting appropriate models and optimizers for accurate solar power forecasting. This is the first time such a comprehensive work presented that also involves transformer networks in hybrid models for solar power forecasting. [ABSTRACT FROM AUTHOR]

Breast cancer, a widespread global disease, represents a significant threat to women's health and lives. Many researchers have proposed computer-aided diagnosis systems for classifying breast cancer. The majority of the approaches primarily utilize deep learning methods, which overlook the crucial necessity of incorporating both local information for precise tumor detection. In addition, available breast cancer datasets are imbalanced in nature. Therefore, this paper presents the hybrid breast network (HBNet) for detection of breast cancer, designed to address two critical challenges: class imbalance and incorporation of both global and local information in achieving precise tumor classification. To overcome the problem of class imbalance, HBNet incorporates the borderline synthetic minority oversampling technique. Simultaneously, it employs a feature fusion approach to combine deep and handcrafted features extracted by utilizing ResNet50 and HOG which incorporates global and local information. Moreover, the proposed method integrates the block-matching and 3D denoising filter to effectively eliminate multiplicative noise that has enhanced the performance of the system. The proposed HBNet is evaluated with BUSI and UDIAT datasets and achieved an average accuracy of 95.824% and 90.37%, respectively. [ABSTRACT FROM AUTHOR]

Successful deployment of convolutional neural networks on resource-constrained hardware platforms is challenging for ubiquitous AI applications. For latency-sensitive scenarios, real-time inference requires model compression techniques such as network pruning to achieve the purpose of inference acceleration. However, many researches focus on hardware-independent filter pruning methods, which cannot balance the contribution of pruned structure to latency and the accuracy drop. Although some pruning methods have introduced latency constraints into the pruning process, most of them are based on look-up tables, which omits the key step of hardware optimization, resulting in significant deviation in latency estimation. In this paper, we propose a novel latency-constrained pruning method, named hardware-in-loop pruning (HILP). It is based on the fast optimal pruning rate search within the layer and layer-wise hybrid pruning, which can prioritize removing the less important layers with considerable latency contributions. The proposed hardware-in-loop pipeline enables the hardware optimization module to be integrated into the entire framework. During pruning, an intermediate network architecture is automatically transformed to a deployable model for accurate latency measurement. The latency-optimized intermediate architecture is then selected by traversing all layers for next progressive step. HILP is generally applicable to any platform that provides a hardware optimization toolchain, such as NVIDIA GPU and Cambricon NPU. We evaluate HILP on both image classification task using ResNet50 with ImageNet and object detection task using YOLOv3 with COCO, HILP can reduce the inference latency of these two networks to 60% and 75%, respectively, within the range of accuracy variation not exceeding 0.6%. Extensive experiment results have proven that HILP is able to achieve a significant advantage in latency-accuracy performance compared to state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Tailoring a deep convolutional neural network (DCNN) is a tedious and time-consuming task in the field of medical image analysis. In this research paper, Deep-generative adversial neural network (Deep-GAN) based model is proposed using grid search optimization (GSO) technique for identification and classification of thyroid nodule. The main objective of this work is to propose a deep learning (DL) model for the identification and classification of thyroid nodules without user or specialist intervention. The proposed model has gone through four phases namely (i) data acquisition, (ii) pre-processing (iii) data augmentation using GAN technique and (iv) optimization and classification using Deep-GAN model. Two pre-trained architectures namely Alex-Net and Visual Geometry Group (VGG-16) are considered for the identification and classification of thyroid nodule in ultrasonography (USG) images. From the experiment, it is found that Alex-GAN model has shown an improvement of 2 to 4 percentage points in comparison with VGG-GAN model and reported literature on Thyroid digital image database (TDID) public and collected dataset. [ABSTRACT FROM AUTHOR]

Assessing the strength of complex networks is crucial for evaluating their functionality and monitoring system security. Two primary perspectives for measuring network robustness are connectivity and controllability, which quantify how well a network maintains connectivity and controllability after experiencing complete attacks. However, conventional robustness calculation methods that use simulation attacks can be impractical for large-scale networks. Recent research has explored the use of deep learning methods for network robustness prediction, including PCR (short for predictor of controllability robustness), which uses a VGG (short for visual geometry group)-based convolutional neural network (CNN) and a linear filter. However, PCR has limitations, including inaccurate edge importance differentiation and fluctuating output curves. This paper presents ATTRP, an attention-based robustness predictor, which addresses these limitations. ATTRP uses a novel convolutional neural network with channel and spatial attention mechanisms to improve prediction accuracy and a robustness filter based on Savitzky–Golay smoothing to rectify the robustness curve. Experimental studies demonstrate that ATTRP outperforms other predictors, with much lower errors, while its computational speed is far superior to that of traditional attacking simulation. Overall, our research provides a more effective and efficient means of predicting network robustness, with potential applications in monitoring system security. [ABSTRACT FROM AUTHOR]

Deep convolutional neural networks (DCNNs) have emerged as powerful tools in diverse remote sensing domains, but their optimization remains challenging due to their complex nature and the large number of parameters involved. Researchers have been exploring more sophisticated methodologies to improve image classification accuracy. In this paper, we introduce a multi-granularity feature encoding ensemble network (MGFEEN) that is designed to fine-tune features at different levels of granularity. The network is trained in a two-step process: First, the output of granularity level i is used as the input for the next level; then, a fully connected layer is added to the pre-trained network to advance to the next level. The effectiveness of the MGFEEN's feature extraction is evaluated by feeding the globally extracted features to a softmax classifier for classification. By applying ensemble learning principles, our proposed MGFEEN achieves more accurate final predictions. We evaluate our model on three widely recognized benchmark datasets: UC-Merced, SIRIWHU, and EAC-Dataset. Notably, on the EAC-Dataset, our results show a significant 0.54% improvement in accuracy over a single-training-network setup, resulting in an impressive 98.70% accuracy level. [ABSTRACT FROM AUTHOR]

In areas with high tuberculosis (TB) prevalence, high mortality rate has significantly increased over the past few decades. Even though tuberculosis can be treated, areas with high disease burden continue to have insufficient screening tools, leading to diagnostic delays and incorrect diagnoses. As a result of these challenges, a computer-aided diagnostics (CAD) system has been developed that can automatically detect tuberculosis. There are few different methods that can be used to screen for tuberculosis; however, chest X-ray (CXR) is most commonly used and strongly suggested because it is so effective in identifying lung irregularities. Over past ten years, we have seen a meteoric rise in amount of research conducted into application of machine learning strategies to examination of chest X-ray images for screening regarding pulmonary abnormalities. Particularly, we have also noticed significant interest in testing for TB. This attentiveness has increased in tandem with phenomenal progress that has been made in deep learning (DL), which is predominately founded on convolutional neural networks (CNNs). Because of these advancements, significant research contributions have been made in field of DL techniques for TB screening by utilizing CXR images. The main focus of this paper is to emphasize favorable methods and data collection, as well as methodological contributions, identify data collections, and identify challenges. [ABSTRACT FROM AUTHOR]

Approximation approaches have been developed for very large-scale integration architecture to limit power consumption and increase effective throughput. The full adder (FA) and block-based designs are the approximate adder designs widely used in the existing techniques to accelerate the additions by partitioning a long carry propagation chain. However, these techniques require more power and area than the standard FA-based techniques. To overcome this issue, this paper presents an error-reduced carry prediction approximate full adder (ERCPAA) technique to achieve faster additions and performance by adding a constant truncation mechanism with an error reduction strategy. Deep learning and neural network technology had made great progress in recent years for field programmable gate array implementation and real-time object detection. It is essential to maintain high accuracy rates in image processing applications, as any errors introduced during the processing can significantly impact the quality of the output image and impact the hardware implementation. Therefore, we propose an ERCPAA that utilizes a lightweight convolutional neural network (ERCPAA–lightweight CNN) to fit well in a fixed-point CNN accelerator architecture. A lightweight CNN that is both thin (with fewer feature maps per layer) and deep (four layers) with just one fully connected hidden layer can enable faster training while achieving higher accuracy. In addition, in a few positions of the higher-order bits of the incorrect part, a full adder (FA) cell is used to simplify the traditional one-bit FA cell, creating an approximate summation and carry. The proposed method is verified by randomly selecting specific images from the Fruit 360, ImageNet, and the Caltech 256 Image Dataset. The proposed model offers an normalized mean error distance, error rate, and mean relative error distance values of 0.154, 6.55%, and 4.6E-4. The recognition accuracy of the proposed model in the ImageNet database is 96% with an execution time of 1420 µs. [ABSTRACT FROM AUTHOR]

Deep learning integration in cancer diagnosis enhances accuracy and diagnosis speed which helps clinical decision-making and improves health outcomes. Despite all these benefits in cancer diagnosis, the present AI models in urology cancer diagnosis have not been sufficiently reviewed systematically. This paper reviews the artificial intelligence approaches used in cancer diagnosis, prediction, and treatment of urology cancer. AI models and their applications in urology subspecialties are evaluated and discussed. The Scopus, Microsoft Academic and PubMed/MEDLINE databases were searched in November 2022 using the terms "artificial intelligence", "neural network", "machine learning," or "deep learning" combined with the phrase "urology cancers". The search was limited to publications published within the previous 20 years to identify cutting-edge deep-learning applications published in English. Irrelevant review articles and publications were eliminated. The included research involves two kinds of research analysis: quantitative and qualitative. 48 articles were included in this survey. 25 studies proposed several approaches for prostate cancers, while 15 were for bladder cancers. 8 studies discussed renal cell carcinoma and kidney cancer. The models presented to detect urology cancers have achieved high detection accuracy (77–95%). Deep learning approaches that use convolutional neural networks have achieved the highest accuracy among other techniques. Although it is still progressing, the development of AI models for urology cancer detection, prediction, and therapy has shown significant promise. Additional research is required to employ more extensive, higher-quality, and more recent datasets to the clinical performance of the proposed AI models in urology cancer applications. [ABSTRACT FROM AUTHOR]

Nowadays, machine learning (ML) has attained a high level of achievement in many contexts. Considering the significance of ML in medical and bioinformatics owing to its accuracy, many investigators discussed multiple solutions for developing the function of medical and bioinformatics challenges using deep learning (DL) techniques. The importance of DL in Internet of Things (IoT)-based bio- and medical informatics lies in its ability to analyze and interpret large amounts of complex and diverse data in real time, providing insights that can improve healthcare outcomes and increase efficiency in the healthcare industry. Several applications of DL in IoT-based bio- and medical informatics include diagnosis, treatment recommendation, clinical decision support, image analysis, wearable monitoring, and drug discovery. The review aims to comprehensively evaluate and synthesize the existing body of the literature on applying deep learning in the intersection of the IoT with bio- and medical informatics. In this paper, we categorized the most cutting-edge DL solutions for medical and bioinformatics issues into five categories based on the DL technique utilized: convolutional neural network, recurrent neural network, generative adversarial network, multilayer perception, and hybrid methods. A systematic literature review was applied to study each one in terms of effective properties, like the main idea, benefits, drawbacks, methods, simulation environment, and datasets. After that, cutting-edge research on DL approaches and applications for bioinformatics concerns was emphasized. In addition, several challenges that contributed to DL implementation for medical and bioinformatics have been addressed, which are predicted to motivate more studies to develop medical and bioinformatics research progressively. According to the findings, most articles are evaluated using features like accuracy, sensitivity, specificity, F-score, latency, adaptability, and scalability. [ABSTRACT FROM AUTHOR]

A fabric inspection system is a sophisticated computer vision system that detects fabric defects, automatically. In recent years, human visual inspection has traditionally been used to detect fabric defects. However, this trend is inaccurate and may be expensive due to the need for highly-trained personnel. This paper describes a deep-learning-based fabric inspection system for detecting fabric defects instead of the dependence on personnel. To find the Region of Interest (RoI) in fabric images, the system depends on a saliency-based region detection technique to localize the defected areas in fabric images. The fabric images are then classified into defect-free and defective images using a Convolutional Neural Network (CNN). Four convolutional layers and four max-pooling layers are arranged in the suggested model. A fully-connected layer and a Softmax activation function are also used in the classification task. The results of the experiments indicate that the proposed system exceeds some other state-of-the-art systems in terms of both quality and robustness. The proposed system achieves an average accuracy of 95.8%. Hence, it can be used in applications related to fabric industry. [ABSTRACT FROM AUTHOR]

Several state-of-the-art convolutional neural networks (CNNs)-based methods are available for image denoising tasks. CNNs are typically trained using the backpropagation algorithm, which requires all operations in the network to be differentiable. Most CNN operations satisfy this requirement and can be applied to backpropagation-based training algorithms. However, some transforms, including wavelet transform, which is useful for speeding up CNN computations as well as performing multi-resolution analysis, are not strictly differentiable. This paper addresses this challenge by proposing a wavelet-like transform that is differentiable. This new design is, in fact, a new CNN architecture named semi-wavelet, specific edge convolutional neural network (SW/SE-CNN), consisting of three newly designed layers. The first layer is a Semi-Wavelet (SW)-based layer which is a differential down-sampling operator for wavelet approximation. That is, the SW layer converts the input image into four channels. Three of these channels are estimations of the vertical, horizontal, and diagonal edges of the original image; and the fourth channel is a down-sampled version of it. The second proposed layer, called Semi-Wavelet Inverse (SWI), is to restore the original image by using the four SW output channels. Additionally, a specific edge extractor (SE), as another new layer, is designed on the basis of the well-known Sobel operator to extract specific edges of the image. The reason behind proposing the SE layer is to provide more edge information for the network; and the motive for including the SW layer is to speed the network up as well as multi-resolution analysis. Then, the new SW/SE-CNN architecture is implemented for Gaussian image denoising. The experimental results show that the new SW/SE-CNN outperformed the state-of-the-art methods for Gaussian image denoising based on the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) measurements for grayscale as well as color images. [ABSTRACT FROM AUTHOR]

Traditional sentiment analysis focuses on text-level sentiment mining, transforming sentiment mining into classification or regression problems, resulting in a sentiment analysis low accuracy rate. Sentiment analysis refers to the use of natural language processing, text analysis, and computational linguistics to systematically identify, extract, quantify, and study sentimental states. Therefore, more scholars have begun to focus on speech recognition and facial expression recognition research, and extracting and analysing people's sentiment tendencies can improve sentiment recognition accuracy. Traditional single-modal sentiment analysis can no longer meet people's needs. Therefore, this paper proposes a multimodal sentiment analysis method based on the multimodal sentiment analysis method that can obtain more sentimental information sources and help people make better decisions. The experimental results in this paper show that the highest recognition rates of CNN-SVM, RNN-SVM, and CRNN-SVM were 76.8%, 71.2%, and 93.5%, respectively. It can be seen that CRNN-SVM has the highest sentiment tendency recognition rate in deep learning, so it is suitable to apply CRNN-SVM to sentiment tendency analysis system design in this paper. The average accuracy rate of the system designed in this paper was 91%, and the stability was also very strong, which shows that the system designed in this paper is meaningful. The main contribution of this paper is based on the limitations of single-mode emotion analysis. It proposes a multimode emotion analysis method and introduces a convolutional neural network to help people obtain more emotional information sources to meet their needs. [ABSTRACT FROM AUTHOR]

Nowadays, the volume of online information is growing and it is difficult to find the required information. Effective strategies such as recommender systems are required to overcome information overload. Collaborative filtering is a widely used type of recommender system in e-commerce environments and can simply provide suggestions for users. Recently, deep learning approaches were applied in collaborative filtering to tackle some drawbacks. This systematic review aims to provide a comprehensive review of recent research efforts on deep learning-based collaborative filtering recommender systems. We explain the research methodology and paper selection process and the search query. 102 papers are selected out of 719 papers that were published between 2019 and May 2023. Furthermore, the approaches in the selected papers are classified into two main categories: memory-based and model-based techniques. The main ideas, advantages, disadvantages, used tools, type of neural network, applications, and evaluation parameters of each selected paper are also discussed in detail. It was found that CNN (Convolutional Neural Network), AE (Autoencoder), DNN (Deep neural network), and Hybrid networks are the four mostly used neural networks in recommender systems. Also, Python, MATLAB, and Java are the most frequently used tools in the reviewed papers. Regarding the applications of the recommender systems in the reviewed papers, movies, products, and music recommendation are three most frequent applications. We point out the open issues and future research directions. Some key challenges such as cold start, data sparsity, scalability, and accuracy are still open to be addressed. [ABSTRACT FROM AUTHOR]

In this paper, we have proposed a hybrid bio-inspired algorithm which takes the merits of whale optimization algorithm (WOA) and adaptive particle swarm optimization (APSO). The proposed algorithm is referred as the hybrid WOA_APSO algorithm. We utilize a convolutional neural network (CNN) for classification purposes. Extensive experiments are performed to evaluate the performance of the proposed model. Here, pre-processing and segmentation are performed on 120 lung CT images for obtaining the segmented tumored and non-tumored region nodule. The statistical, texture, geometrical and structural features are extracted from the processed image using different techniques. The optimized feature selection plays a crucial role in determining the accuracy of the classification algorithm. The novel variant of whale optimization algorithm and adaptive particle swarm optimization, hybrid bio-inspired WOA_APSO, is proposed for selecting optimized features. The feature selection grouping is applied by embedding linear discriminant analysis which helps in determining the reduced dimensions of subsets. Twofold performance comparisons are done. First, we compare the performance against the different classification techniques such as support vector machine, artificial neural network (ANN) and CNN. Second, the computational cost of the hybrid WOA_APSO is compared with the standard WOA and APSO algorithms. The experimental result reveals that the proposed algorithm is capable of automatic lung tumor detection and it outperforms the other state-of-the-art methods on standard quality measures such as accuracy (97.18%), sensitivity (97%) and specificity (98.66%). The results reported in this paper are encouraging; hence, these results will motivate other researchers to explore more in this direction. [ABSTRACT FROM AUTHOR]

This paper aims to propose a new technique for identifying and categorizing malevolent Internet traffic within the context of security for smart devices. Given the rising usage of smart devices, including mobile phones, wearables, smart transportation-based devices, and the Internet of Things, concerns regarding their security are increasing. The need to develop effective security measures arises from the potential for attackers to compromise user data. In this study, we introduce an innovative approach that combines deep learning techniques, specifically convolutional neural networks (CNN), with long short-term memory (LSTM) for the purpose of detecting and categorizing malevolent Internet traffic. The objective of the proposed technique is to address the challenges related to time estimation by focusing on level prediction, resulting in a substantial reduction in prediction time for the identification of malevolent traffic. We utilize bidirectional long short-term memory–CNN (BI-LSTM–CNN) to identify malevolent communication and provide support for voice input. Experimental outcomes illustrate the effectiveness of our proposed technique in terms of precision, accuracy, F1 factor, false acceptance rate (FAR), false positive rate (FPR), and detection rate. In comparison with existing methods for detecting malevolent traffic, our approach achieves a 99.62% traffic detection rate, 99.98% accuracy, and 0.01% FAR, whereas the accuracy, detection rate of malevolent traffic, and FAR of existing methods are 99.88%, 97.32%, and 4.31%, respectively. These outcomes emphasize the superior performance and analysis of our technique, rendering it a valuable contribution to the realm of smart device security. In summary, this paper proposes a novel BI-LSTM–CNN technique for detecting malevolent traffic in smart devices. The proposed methodology tackles time estimation challenges and exhibits superior performance when compared to existing techniques. [ABSTRACT FROM AUTHOR]

The usage of intelligent IoT devices is exponentially rising, and so the possibility of attacks in the IoT surfaces. The deep leaning algorithms are competent for directing the sanctuary investigation of IoT systems but have not upgraded the analysis of potential attacks in IoT. This paper aims to advance deep learning methods to create upgraded security strategies for IoT frameworks quickly. The study of the IoT security threats identified with inalienable or recently presented risks is done. Also, this paper does a quick examination of different possible attack surfaces for the IoT framework, and the potential risks identified with each character. The systematic survey of deep learning methods for IoT security and the existence of the chances, focal points, and weaknesses of every strategy opens the door significant for future research. [ABSTRACT FROM AUTHOR]

Acute lymphocytic leukemia (ALL) is a common serious cancer in white blood cells (WBC) that advances quickly and produces abnormal cells in the bone marrow. Cancerous cells associated with ALL lead to impairment of body systems. Microscopic examination of ALL in a blood sample is applied manually by hematologists with many defects. Computer-aided leukemia image detection is used to avoid human visual recognition and to provide a more accurate diagnosis. This paper employs the ensemble strategy to detect ALL cells versus normal WBCs using three stages automatically. Firstly, image pre-processing is applied to handle the unbalanced database through the oversampling process. Secondly, deep spatial features are generated using a convolution neural network (CNN). At the same time, the gated recurrent unit (GRU)-bidirectional long short-term memory (BiLSTM) architecture is utilized to extract long-distance dependent information features or temporal features to obtain active feature learning. Thirdly, a softmax function and the multiclass support vector machine (MSVM) classifier are used for the classification mission. The proposed strategy has the resilience to classify the C-NMC 2019 database into two categories by using splitting the entire dataset into 90% as training and 10% as testing datasets. The main motivation of this paper is the novelty of the proposed framework for the purposeful and accurate diagnosis of ALL images. The proposed CNN-GRU-BiLSTM-MSVM is simply stacked by existing tools. However, the empirical results on C-NMC 2019 database show that the proposed framework is useful to the ALL image recognition problem compared to previous works. The DenseNet-201 model yielded an F1-score of 96.23% and an accuracy of 96.29% using the MSVM classifier in the test dataset. The findings exhibited that the proposed strategy can be employed as a complementary diagnostic tool for ALL cells. Further, this proposed strategy will encourage researchers to augment the rare database, such as blood microscopic images by creating powerful applications in terms of combining machine learning with deep learning algorithms. [ABSTRACT FROM AUTHOR]

Image white-balancing is an integral part of every camera's processing pipeline. White-balancing is used to remove illumination chromaticity from an image. Most research in this field has been limited to images with a single uniform illuminant. In this paper, we introduce a novel method for illumination estimation for situations where the scene is illuminated by a variable number of different illuminants and where the illumination in the scene can be non-uniform. The proposed method uses a lightweight convolutional neural network that achieves state-of-the-art results. The method performs illumination estimation on a patch-by-patch basis. We use the assumption that only one illuminant affects each patch since they are so small. Unlike other such methods, our method uses features extracted from the entire image to perform patch illumination estimation. The paper also shows how the image features improve method accuracy with a minimal increase in complexity. The proposed method has around 42 k parameters, and it was tested on three different cameras from the Large-Scale Multi-Illuminant dataset. [ABSTRACT FROM AUTHOR]

Knee ligament tear injury is frequent in many volleyball, football, basketball, and cricket players. In the past, various deep learning-based ACL tear detection schemes using knee magnetic resonance imaging (MRI) have been presented. It has shown challenges in ACL tear detection performance due to class imbalance issue arising due to uneven training samples and poor feature representation. This paper presents a simple and effective ACL knee ligament tear detection method with a convolutional neural network (ATD-CNN) to lessen the intricacy of the network. Further, the self-attention mechanism is used to improve the feature representation of MRI image information, neglect the irrelevant information in deep features, and enhance the classification accuracy. To diminish the class imbalance issue, generative adversarial network (GAN) is used to construct the synthetic database. The performance of the ATD-CNN with self-attention is assessed on the MRNet database using precision, accuracy, F1-score, and recall. ATD-CNN provides an accuracy of 90.10% for the original and 93.93% and augmented datasets. However, the ATD-CNN without attention mechanism resulted in 89.60% and 92.30% accuracy for original and augmented dataset. The proposed ATD-CNN model indicates that it can be utilized to detect ACL tears automatically and outperforms the existing schemes for tear detection. [ABSTRACT FROM AUTHOR]

Document classification is becoming increasingly essential for the vast number of documents available in digital libraries, emails, the Internet, etc. Textual records frequently contain non-discriminative (noisy and irrelevant) terms that are also high-dimensional, resulting in higher computing costs and poorer learning performance in Text Classification (TC). Feature selection (FS), which tries to discover discriminate terms or features from the textual data, is one of the most effective tasks for this issue. This paper introduces a novel multi-stage term-weighting scheme-based FS model designed for the single-label TC system to obtain the optimal set of features. We have also developed a hybrid deep learning fine-tuning network based on Bidirectional Long Short-Term Memory (BiLSTM) and Convolutional Neural Network (CNN) for the classification stage. The FS approach is worked on two-stage criteria. The filter model is used in the first stage, and the multi-objective wrapper model, an upgraded version of the Whale Optimization Algorithm (WOA) with Particle Swarm Optimization (PSO), is used in the second stage. The objective function in the above wrapper model is based on a tri-objective principle. It uses the Pareto front technique to discover the optimal set of features. Here in the wrapper model, a novel selection strategy has been introduced to select the whale instead of the random whale. The proposed work is evaluated on four popular benchmark text corpora, of which two are binary class, and two are multi-class. The suggested FS technique is compared against classic Machine Learning (ML) and deep learning classifiers. The results of the experiments reveal that the recommended FS technique is more effective in obtaining better results than the other results. [ABSTRACT FROM AUTHOR]

One of the significant aspects of our digital world is that data are literally everywhere, and it is increasing. On the other hand, the number of cyberattacks aiming to seize this data and use it illegally is increasing at an exponential rate, and this is the challenge. Therefore, intrusion detection systems (IDS) have attracted considerable interest from researchers and industries. In this regard, machine learning (ML) techniques are playing a pivotal role as they put the responsibility of analyzing enormous amounts of data, finding patterns, classifying intrusions, and solving issues on computers instead of humans. This paper implements two separate classification layers of ML-based algorithms with the recently published NF-UQ-NIDS-v2 dataset, preprocessing two volumes of sample records (100 k and 10 million), utilizing MinMaxScaler, LabelEncoder, selecting superlative features by recursive feature elimination, normalizing the data, and optimizing hyper-parameters for classical algorithms and neural networks. With a small dataset volume, the results of the classical algorithms layer show high detection accuracy rates for support vector (98.26%), decision tree (98.78%), random forest (99.07%), K-nearest neighbors (98.16%), CatBoost (99.04%), and gradient boosting (98.80%). In addition, the layer of neural network algorithms has proven to be a very powerful technology when using deep learning, particularly due to its unique ability to effectively handle enormous amounts of data and detect hidden correlations and patterns; it showed high detection results, which were (98.87%) for long short-term memory and (98.56%) for convolutional neural networks. [ABSTRACT FROM AUTHOR]

Knowledge about the subtypes of a disease critically affects clinical decisions ranging from the choice of therapeutic options to patient management. If the understanding of a disease is partial and the subtypes of the disease are not yet known, a traditional supervised approach becomes untenable for disease subtype classification. In these contexts, unsupervised methods for subtype discovery are essential. There has been very little prior work on the discovery of phenotypic subtypes based on imaging. Moreover, within that limited body of work, the discovered phenotypes often lack interpretability. In this paper, we present a data-driven approach to discovering interpretable imaging phenotypes in 3D image volumes. In particular, the phenotypes are discovered in a latent space learned through a 3D autoencoder. To interpret the discovered phenotypes, we learn a convolutional neural network to classify the phenotype label and present VolPAM (Volumetric Phenotype-Activation-Map) to interpret the latent phenotypes in terms of their imaging footprints. We present results and visualizations on datasets of Computed Tomography images as an example 3D imaging modality. The proposed methods can become a useful aid to further the understanding of the condition in question through phenotype discovery and interpretability in terms of distinct aspects of the discovered phenotypes. [ABSTRACT FROM AUTHOR]

This paper presents an efficient deep neural network model for diagnosing Parkinson's disease from gait. More specifically, we introduce a hybrid ConvNet-Transformer architecture to accurately diagnose the disease by detecting the severity stage. The proposed architecture exploits the strengths of both convolutional neural networks and Transformers in a single end-to-end model, where the former is able to extract relevant local features from Vertical Ground Reaction Force (VGRF) signal, while the latter allows to capture long-term spatio-temporal dependencies in data. In this manner, our hybrid architecture achieves an improved performance compared to using either models individually. Our experimental results show that our approach is effective for detecting the different stages of Parkinson's disease from gait data, with a final accuracy of 88%, outperforming other state-of-the-art AI methods on the Physionet gait dataset. Moreover, our method can be generalized and adapted for other classification problems to jointly address the feature relevance and spatio-temporal dependency problems in 1D signals. Our source code and pre-trained models are publicly available at https://github.com/SafwenNaimi. [ABSTRACT FROM AUTHOR]

Today, investigating gait recognition as a biometric technology has become necessary, especially after the COVID-19 pandemic broke out in the world. This paper proposes a deep structure procedure for precise human identification from the walking manner quickly, as each human has a unique way of walking. The proposed generative adversarial network (GAN) generates gait images from pedestrians of the CASIA and OU-ISIR gait datasets for normalizing the number of frames in each class in both datasets. Then, we extract the gait features from the normalized datasets by the pretrained convolutional neural network (CNN) models; AlexNet, Inception, VGG16, VGG19, ResNet, and Xception, and balance them using the synthetic minority oversampling technique (SMOTE) to enhance the recognition results. Several feature selectors are selecting the best features, including particle swarm optimization (PSO), grey wolf optimization (GWO), Chi-square, and genetic models. Finally, the proposed deep neural network recognizes the gait images precisely. Several performance assessment measures were generated to assess the model's quality, including accuracy, precision, sensitivity, specificity, false negative rate (FNR), intersection of union (IoU), and time. Experimental results showed that the inception model with genetic feature selector performed better in all used datasets than the current studies and was more robust against any change, achieving 99.3%, 99.1%, and 99.09% accuracy in identifying CASIA-B, CASIA-A, and OU-ISIR datasets, respectively in low time. [ABSTRACT FROM AUTHOR]