Search

Designing implants for large and complex cranial defects is a challenging task, even for professional designers. Current efforts on automating the design process focused mainly on convolutional neural networks (CNN), which have produced state-of-the-art results on reconstructing synthetic defects. However, existing CNN-based methods have been difficult to translate to clinical practice in cranioplasty, as their performance on large and complex cranial defects remains unsatisfactory. In this paper, we present a statistical shape model (SSM) built directly on the segmentation masks of the skulls represented as binary voxel occupancy grids and evaluate it on several cranial implant design datasets. Results show that, while CNN-based approaches outperform the SSM on synthetic defects, they are inferior to SSM when it comes to large, complex and real-world defects. Experienced neurosurgeons evaluate the implants generated by the SSM to be feasible for clinical use after minor manual corrections. Datasets and the SSM model are publicly available at https://github.com/Jianningli/ssm. [ABSTRACT FROM AUTHOR]

A neural network model needs to be manually designed for ancient mural dynasty recognition, and this paper proposes an ancient mural dynasty recognition algorithm that is based on a neural architecture search (NAS). First, the structural edge information of mural images is extracted for use by the neural network model in recognizing mural missions. Second, an NAS algorithm that is based on contrast selection (CS) simplifies the architecture search to an incremental CS and then searches for the optimal network architecture on the mural dataset. Finally, the identified optimal network architecture is used for training and testing to complete the mural dynasty recognition task. The results show that the top accuracy of the proposed method on the mural dataset is 88.10%, the recall rate is 87.52%, and the precision rate is 87.69%. Each evaluation index used by the neural network model is superior to that of classical network models such as AlexNet and ResNet-50. Compared with NAS methods such as ASNG and MIGO, the accuracy of mural dynasty recognition is higher by an average of 4.27% when using the proposed method. The proposed method is verified on CIFAR-10, CIFAR-100, ImageNet16-120 and other datasets and achieves a good recognition accuracy in the NAS-bench-201 search space, which averages 93.26%, 70.73% and 45.34%, respectively, on the abovementioned datasets. [ABSTRACT FROM AUTHOR]

Featured Application: The Deep Neural Network model employed in this work will help build a system for the pre-diagnosis of retinopathies that can lead to blindness. The main intention of this type of system is to support the work performed by ophthalmology specialists. Computer-based pre-diagnosis of diseases through medical imaging is a task worked on for many years. The so-called fundus images stand out since they do not have uniform illumination and are highly sensitive to noise. One of the diseases that can be pre-diagnosed through fundus images is age-related macular degeneration, which initially manifests as the appearance of lesions called drusen. Several ways of pre-diagnosing macular degeneration have been proposed, methods based entirely on the segmentation of drusen with prior image processing have been designed and applied, and methods based on image pre-processing and subsequent conversion to feature vectors, or patterns, to be classified by a Machine-Learning model have also been developed. Finally, in recent years, the use of Deep-Learning models, particularly Convolutional Networks, has been proposed and used in classification problems where the data are only images. The latter has allowed the so-called transfer learning, which consists of using the learning achieved in the solution of one problem to solve another. In this paper, we propose the use of transfer learning through the Xception Deep Convolutional Neural Network to detect age-related macular degeneration in fundus images. The performance of the Xception model was compared against six other state-of-the-art models with a dataset created from images available in public and private datasets, which were divided into training/validation and test; with the training/validation set, the training was made using 10-fold cross-validation. The results show that the Xception neural network obtained a validation accuracy that surpasses other models, such as the VGG-16 or VGG-19 networks, and had an accuracy higher than 80% in the test set. We consider that the contributions of this work include the use of a Convolutional Neural Network model for the detection of age-related macular degeneration through the classification of fundus images in those affected by AMD (drusen) and the images of healthy patients. The performance of this model is compared against other methods featured in the state-of-the-art approaches, and the best model is tested on a test set outside the training and validation set. [ABSTRACT FROM AUTHOR]

Deep neural network has made surprising achievements in natural language processing, image pattern classification recognition, and other domains in the last few years. It is still tough to apply to hardware-constrained or mobile equipment because of the huge number of parameters, high storage as well as computing costs. In this paper, a new sparse iteration neural network architecture is proposed. First, the pruning method is used to compress the model size and make the network sparse. Then the architecture is iterated on the sparse network model, and the network performance is improved without adding additional parameters. Finally, the hybrid deep learning model was carried out on CV tasks and NLP tasks on ANN, CNN, and Transformer. Compared with the sparse network architecture, we finally found that the accuracy of the MINST, CIFAR10, PASCAL VOC 2012, and SQuAD datasets is improved by 0.47%, 0.64%, 3.75%, and 15.06%, respectively. [ABSTRACT FROM AUTHOR]

In this paper, we study the post-hoc calibration of modern neural networks, a problem that has drawn a lot of attention in recent years. Despite the plethora of calibration methods proposed, there is no consensus yet on the inherent complexity of the task and, while some authors claim that simple functions solve the problem, others suggest that more expressive models are needed to capture misscalibration. As a first approach, we focus on the task of confidence scaling, specifically on post-hoc methods that generalize Temperature Scaling, which we refer to as the Adaptive Temperature Scaling family. We begin by demonstrating that while complex models like neural networks provide an advantage when there is ample data, they fail in scenarios where it is limited, notably common in fields like medical diagnosis. We then show how under this ideal data conditions the more expressive methods learn a relationship between the entropy of a prediction and its level of overconfidence, and based on this observation, we propose Entropy-based Temperature Scaling, a simple method that scales the confidence of a prediction according to this relationship. Results show that our method obtains state-of-the-art performance and is robust against data scarcity. Moreover, our proposed model enables a deeper understanding of the calibration process by the interpretation of the entropy as a measure of uncertainty in the network outputs. [ABSTRACT FROM AUTHOR]

Recent studies show that neural networks are vulnerable to backdoor attacks, in which compromised networks behave normally for clean inputs but make mistakes when a pre-defined trigger appears. Although prior studies have designed various invisible triggers to avoid causing visual anomalies, they cannot evade some trigger detectors. In this paper, we consider the stealthiness of backdoor attacks from input space and feature representation space. We propose a novel backdoor attack named sparse backdoor attack, and investigate the minimum required trigger to induce the well-trained networks to make incorrect results. A U-net-based generator is employed to create triggers for each clean image. Considering the stealthiness of the trigger, we restrict the elements of the trigger between −1 and 1. In the aspect of the feature representation domain, we adopt an entanglement cost function to minimize the gap between feature representations of benign and malicious inputs. The inseparability of benign and malicious feature representations contributes to the stealthiness of our attack against various model diagnosis-based defences. We validate the effectiveness and generalization of our method by conducting extensive experiments on multiple datasets and networks. [ABSTRACT FROM AUTHOR]

Existing research in metasurface design was based on trial-and-error high-intensity iterations and requires deep acoustic expertise from the researcher, which severely hampered the development of the metasurface field. Using deep learning enabled the fast and accurate design of hypersurfaces. Based on this, in this paper, an integrated learning approach was first utilized to construct a model of the forward mapping relationship between the hypersurface physical structure parameters and the acoustic field, which was intended to be used for data enhancement. Then a dual-feature fusion model (DFCNN) based on a convolutional neural network was proposed, in which the first feature was the high-dimensional nonlinear features extracted using a data-driven approach, and the second feature was the physical feature information of the acoustic field mined using the model. A convolutional neural network was used for feature fusion. A genetic algorithm was used for network parameter optimization. Finally, generalization ability verification was performed to prove the validity of the network model. The results showed that 90% of the integrated learning models had an error of less than 3 dB between the real and predicted sound field data, and 93% of the DFCNN models could achieve an error of less than 5 dB in the local sound field intensity. [ABSTRACT FROM AUTHOR]

Gradient-based aerodynamic optimization methods involve complex gradient calculations with high computational costs. To address these problems, this paper proposes a rapid deep learning-based method for predicting the aerodynamic force gradients and establishes an aerodynamic optimization framework. A deep neural network is used to determine the latent mapping relationship between the near-wall flow field information and the aerodynamic force gradients, and the resulting gradient prediction model is integrated into an aerodynamic optimization platform. Combining grid deformation techniques with gradient-based optimization enables the aerodynamic optimization of airfoils. The deep neural network model can rapidly predict gradients that are basically consistent with those from the traditional discrete adjoint method, and decouples the gradient computation from the flow field solution process. The proposed method is validated through the aerodynamic optimization of the airfoil. Under various optimization objectives and initial conditions, the deep neural network model significantly improves the aerodynamic performance of the airfoil and substantially enhances the efficiency of optimization compared with traditional methods. [ABSTRACT FROM AUTHOR]

Learning in neural networks with locally-tuned neuron models such as radial Basis Function (RBF) networks is often seen as instable, in particular when multi-layered architectures are used. Furthermore, universal approximation theorems for single-layered RBF networks are very well established; therefore, deeper architectures are theoretically not required. Consequently, RBFs are mostly used in a single-layered manner. However, deep neural networks have proven their effectiveness on many different tasks. In this paper, we show that deeper RBF architectures with multiple radial basis function layers can be designed together with efficient learning schemes. We introduce an initialization scheme for deep RBF networks based on k-means clustering and covariance estimation. We further show how to make use of convolutions to speed up the calculation of the Mahalanobis distance in a partially connected way, which is similar to the convolutional neural networks (CNNs). Finally, we evaluate our approach on image classification as well as speech emotion recognition tasks. Our results show that deep RBF networks perform very well, with comparable results to other deep neural network types, such as CNNs. [ABSTRACT FROM AUTHOR]

Purpose: The macular ganglion cell layer (mGCL) is a strong potential biomarker of axonal degeneration in multiple sclerosis (MS). For this reason, this study aims to develop a computer‐aided method to facilitate diagnosis and prognosis in MS. Methods: This paper combines a cross‐sectional study of 72 MS patients and 30 healthy control subjects for diagnosis and a 10‐year longitudinal study of the same MS patients for the prediction of disability progression, during which the mGCL was measured using optical coherence tomography (OCT). Deep neural networks were used as an automatic classifier. Results: For MS diagnosis, greatest accuracy (90.3%) was achieved using 17 features as inputs. The neural network architecture comprised the input layer, two hidden layers and the output layer with softmax activation. For the prediction of disability progression 8 years later, accuracy of 81.9% was achieved with a neural network comprising two hidden layers and 400 epochs. Conclusion: We present evidence that by applying deep learning techniques to clinical and mGCL thickness data it is possible to identify MS and predict the course of the disease. This approach potentially constitutes a non‐invasive, low‐cost, easy‐to‐implement and effective method. [ABSTRACT FROM AUTHOR]

While deep neural networks have shown impressive results in automatic speaker recognition and related tasks, it is dissatisfactory how little is understood about what exactly is responsible for these results. Part of the success has been attributed in prior work to their capability to model supra-segmental temporal information (SST), i.e., learn rhythmic-prosodic characteristics of speech in addition to spectral features. In this paper, we (i) present and apply a novel test to quantify to what extent the performance of state-of-the-art neural networks for speaker recognition can be explained by modeling SST; and (ii) present several means to force respective nets to focus more on SST and evaluate their merits. We find that a variety of CNN- and RNN-based neural network architectures for speaker recognition do not model SST to any sufficient degree, even when forced. The results provide a highly relevant basis for impactful future research into better exploitation of the full speech signal and give insights into the inner workings of such networks, enhancing explainability of deep learning for speech technologies. • Literature explains speaker recognition in neural nets by modeling of voice dynmaics. • Diagnostic: We quantify how well deep learning models actually capture dynamics. • Observation: State-of-the-art deep nets do not model speaker prosody but ignore it. • Interpretation as "cheating": Achieving high without putting in due effort. • Outlook: Increasing task difficulty biases models towards prosody, but not enough. [ABSTRACT FROM AUTHOR]

Deep-learning-based automatic modulation recognition techniques have been extensively explored for wireless communication systems, because of their strong feature extraction and classification abilities of deep neural networks. Although the high recognition accuracy and low alarms, they also raise concerns about complexity and interpretability, which can affect the practical deployments. In this paper, we propose a randomly perturbation convolutional kernel activation mapping (RPCKAM) strategy to explain modulation recognition networks, and the RPCKAM-based filter pruning method to compress modulation recognition networks, combining the reasoning and interpretation of decisions made by modulation recognition networks with the compression of network models. The RPCKAM is used to evaluate the importance of convolutional kernels, and then the importance ranking is used to provide a basis for network pruning. Moreover, the effect of pruning is verified with VGG16 and ResNet34 as the baseline networks. The experimental results reflect that the RPCKAM-based convolutional kernel pruning can compress the model on a large scale while maintaining high accuracy, and can even improve the modulation recognition accuracy within a certain compression range. Specifically, the accuracy improvement is close to 1% at most in the VGG16, and it is also close to 0.5% at most in the ResNet34. Furthermore, by analyzing the performance changes before and after model compression, it is found that the compression effect of ResNet34 is better than that of VGG16, and the performance of the RPCKAM-based pruning method outperforms that of the Grad-CAM-based pruning method. [ABSTRACT FROM AUTHOR]

Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction. [ABSTRACT FROM AUTHOR]

Flettner rotors are wind propulsion systems using the Magnus effect to generate thrust, thereby reduce fuel consumption and carbon emissions in the ships. However, rotor unbalance can cause excessive vibrations and energy loss, affecting the performance and stability of the system. There is a need to have a system onboard, which can predict the vibrations. The paper proposes a deep learning approach to predict the vibrations and unbalanced forces of a Flettner rotor based on the data of ECO Flettner rotor onboard the vessel MV Fehn pollux. The paper develops two methods to estimate the direction and magnitude of the unbalanced forces using the reading values of the strain gauges. The work also compares two recurrent neural network models, namely Long-short term memory and Gated Recurrent Unit, for vibration prediction and evaluates their performance using Mean Absolute Error and Root Mean Squared Error metrics. The results show that Longshort term memory model outperforms Gated Recurrent Unit model in prediction accuracy and can be implemented on the system onboard to monitor and prevent rotor unbalance. The paper also suggests some possible solutions for automatic self-balancing of the rotor and identifies some areas for future work. [ABSTRACT FROM AUTHOR]

This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a SAGAN optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time.The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. The accuracy acquired for the brain tumor identification from the proposed method is 99.29%. The proposed BTC-SAGAN-CHA-MRI technique achieves 18.29%, 14.09% and 7.34% higher accuracy and 67.92%,54.04%, and 59.08% less Computation Time when analyzed to the existing models, like Brain tumor diagnosis utilizing deep learning convolutional neural network with transfer learning approach (BTC-KNN-SVM-MRI); M3BTCNet: multi model brain tumor categorization under metaheuristic deep neural network features optimization (BTC-CNN-DEMFOA-MRI), and efficient method depending upon hierarchical deep learning neural network classifier for brain tumour categorization (BTC-Hie DNN-MRI) respectively. This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a Self-Attention based Generative Adversarial Network (SAGAN) optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time. The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. [ABSTRACT FROM AUTHOR]

The accurate quantification of concentration fluctuations is crucial when evaluating the exposure to toxic, infectious, reactive, flammable, or explosive substances, as well as for the estimation of odor nuisance. However, in the field of Computational Fluid Dynamics (CFD), the industry currently relies predominantly on steady-state RANS turbulence models for simulating near-field pollutant dispersion, which are only capable of producing the time-averaged concentration field. This paper presents a regression relationship for calculating the standard deviation of the local concentration based on the mean concentration and the downstream distance from a point source, over a city-like surface, in the case of the wind direction perpendicular to the streets. The desired peak values and other statistical characteristics can be predicted by assuming a gamma distribution which is fitted based on the average and standard deviation. To obtain the regression function, a deep neural network model was used. The model was trained using timeresolved concentration data obtained from wind tunnel experiments. The validation results show that the concentration fluctuations predicted by the DNN-based model are in satisfactory agreement with the measurement data in terms of the skewness, the kurtosis, the median, and the peak concentrations. Furthermore, the present paper suggests a workflow for estimating the concentration fluctuations based on RANS CFD results, as well as recommendations for generating further training data for specific applications. [ABSTRACT FROM AUTHOR]

Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled samples without forgetting the previously learned ones. This setup can easily leads to catastrophic forgetting and overfitting problems, severely affecting model performance. Studying FSCIL helps overcome deep learning model limitations on data volume and acquisition time, while improving practicality and adaptability of machine learning models. This paper provides a comprehensive survey on FSCIL. Unlike previous surveys, we aim to synthesize few-shot learning and incremental learning, focusing on introducing FSCIL from two perspectives, while reviewing over 30 theoretical research studies and more than 20 applied research studies. From the theoretical perspective, we provide a novel categorization approach that divides the field into five subcategories, including traditional machine learning methods, meta learning-based methods, feature and feature space-based methods, replay-based methods, and dynamic network structure-based methods. We also evaluate the performance of recent theoretical research on benchmark datasets of FSCIL. From the application perspective, FSCIL has achieved impressive achievements in various fields of computer vision such as image classification, object detection, and image segmentation, as well as in natural language processing and graph. We summarize the important applications. Finally, we point out potential future research directions, including applications, problem setups, and theory development. Overall, this paper offers a comprehensive analysis of the latest advances in FSCIL from a methodological, performance, and application perspective. • In-depth survey on FSCIL methods, applications, performance. • Categorizing FSCIL into five subcategories for clear analysis. • Evaluating FSCIL research on benchmarks for strengths, weaknesses. • FSCIL applications in computer vision, NLP, and graph. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved outstanding performance in computer vision tasks. Convolutional Neural Networks (CNNs) typically operate in the spatial domain with raw images, but in practice, images are usually stored and transmitted in their compressed representation where JPEG is one of the most widely used encoder. Also, these networks are computationally intensive and slow. This paper proposes performing the learning and inference processes in the compressed domain in order to reduce the computational complexity and improve the speed of popular CNNs. For this purpose, a novel graph-based frequency channel selection method is proposed to identify and select the most important frequency channels. The computational complexity is reduced by retaining the important frequency components and discarding the insignificant ones as well as eliminating the unnecessary layers of the network. Experimental results show that the modified ResNet-50 operating in the compressed domain is up to 70% faster than the spatial-based traditional ResNet-50 while resulting in similar classification accuracy. Moreover, this paper proposes a preprocessing step with partial encoding to improve the resilience to distortions caused by low-quality encoded images. Finally, we show that training a network with highly compressed data can achieve a good classification accuracy with up to 93% reduction in the storage requirements of the training data. [ABSTRACT FROM AUTHOR]

This paper presents an in-depth study and analysis of oil painting classification and simulation using an improved embedded learning fusion vision perception algorithm. This paper analyzes and models the image quality evaluation problem by simulating the human visual system and extracting quality perception features as the main entry point to improve the prediction accuracy of the overall algorithm. This paper proposes a multi-classification method of CCNN, which uses the similarity measure based on information first to achieve multi-classification of artwork styles and artists, and this part is the main part of this paper. This paper uses the wiki art repository to construct a dataset of oil paintings, including over 2000 works by 20 artists in 13 styles. CNN achieves an accuracy of 85.75% on the artist classification task, which is far more effective than traditional deep learning networks such as Resnet. Finally, we use the network model of this paper and other network models to train the classification of 3, 4, and 6 categories of art images. The accuracy of art image classification by this paper's algorithm is higher than that of the current mainstream convolutional neural network models, and the extracted features are more comprehensive and more accurate than traditional art image feature extraction methods, which do not rely on researchers to extract image features. Experiments show that the proposed method can achieve excellent prediction accuracy for both synthetic distorted images and distorted images. [ABSTRACT FROM AUTHOR]

Background: The discovery of anticancer drug combinations is a crucial work of anticancer treatment. In recent years, pre-screening drug combinations with synergistic effects in a large-scale search space adopting computational methods, especially deep learning methods, is increasingly popular with researchers. Although achievements have been made to predict anticancer synergistic drug combinations based on deep learning, the application of multi-task learning in this field is relatively rare. The successful practice of multi-task learning in various fields shows that it can effectively learn multiple tasks jointly and improve the performance of all the tasks. Methods: In this paper, we propose MTLSynergy which is based on multi-task learning and deep neural networks to predict synergistic anticancer drug combinations. It simultaneously learns two crucial prediction tasks in anticancer treatment, which are synergy prediction of drug combinations and sensitivity prediction of monotherapy. And MTLSynergy integrates the classification and regression of prediction tasks into the same model. Moreover, autoencoders are employed to reduce the dimensions of input features. Results: Compared with the previous methods listed in this paper, MTLSynergy achieves the lowest mean square error of 216.47 and the highest Pearson correlation coefficient of 0.76 on the drug synergy prediction task. On the corresponding classification task, the area under the receiver operator characteristics curve and the area under the precision–recall curve are 0.90 and 0.62, respectively, which are equivalent to the comparison methods. Through the ablation study, we verify that multi-task learning and autoencoder both have a positive effect on prediction performance. In addition, the prediction results of MTLSynergy in many cases are also consistent with previous studies. Conclusion: Our study suggests that multi-task learning is significantly beneficial for both drug synergy prediction and monotherapy sensitivity prediction when combining these two tasks into one model. The ability of MTLSynergy to discover new anticancer synergistic drug combinations noteworthily outperforms other state-of-the-art methods. MTLSynergy promises to be a powerful tool to pre-screen anticancer synergistic drug combinations. [ABSTRACT FROM AUTHOR]

Electromagnetic wave logging while drilling (LWD) technology is an important tool for evaluation of formation oil and gas content. It generally adopts multi-transmitter–receiver coil system structure and the symmetrical coil system arrangement with equal transmitter–receiver spacing can obtain the measurement results with borehole compensation. Here, we develop a method to realize wellbore compensation by deep learning for logging data inversion. This paper focuses on reasonable inversion of logging data through deep learning technology, which is combined with Levenberg–Marquardt (LM) algorithm, modular and fast construction of deep neural network (DNN) model. Under the condition of reducing the outermost transmitting coil, the logging data are inversed, and the inversion effect is evaluated. Our research shows that the combination of neural network and logging data can realize the measurement results with borehole compensation under the condition of reducing one transmitting coil, thereby shortening the instrument length to reduce drilling tool sticking risk and effectively reducing the LWD instrument structure complexity, high power and other problems. At the same time, the accuracy of logging data inversion is tested. The test results show that the DNN method can achieve high-precision inversion, and the average error is reduced by about 50% compared with the traditional algorithm such as linear regression. [ABSTRACT FROM AUTHOR]

An artificial neural network (ANN) in information technology is a system of hardware or software modeled after the operation of neurons in the human brain. ANNs, often known as "neural networks," are a form of deep learning technology that falls under the umbrella of Artificial Intelligence (AI). Commercial applications of these technologies typically focus on optimization and solving complex signal processing and pattern recognition problems. Multiple types of optimization techniques are utilized to determine the optimal neural network for a model. These procedures help determine and define the model's accuracy, dependability, functionality, and capacity. The convergence of the neural network helps determine the number of training iterations required to generate the fewest errors. In this paper, we investigate an activation function to help reduce the training time of the analog-to-digital converter (ADC). A new Hopfield ADC model is proposed by using the proteretic activation function property. We supported our research by simulating the new ADC converter and comparing the traditional Hopfield ADC, the hysteretic ADC, and the proteretic ADC. Experiment and simulation demonstrate that the proteretic function provides a faster rate of convergence than other functions, thereby enhancing the performance of the ADC application. [ABSTRACT FROM AUTHOR]

In this paper, a lightweight deep neural network (DNN) for direction of arrival (DOA) estimation is proposed, of which the input vector is designed to remove data redundancy as well as remaining DOA information. By exploring the Vandermonde property of the steering vector of a uniform linear array (ULA), the size of the newly designed input vector is greatly reduced. Furthermore, the DOA estimation is designed as a regression problem instead of a classification problem; that is, the lightweight DNN designs the output vector as the estimated DOAs of sources, of which the size is much shorter than that of the spatial spectrum used as the output vector in the conventional DNN. The reductions in the sizes of input and output vectors lead to a reduction in the sizes of hidden layers, achieving lightweightness of the neural network. The analysis illustrates that when the number of sensors is 22, the number of parameters in the lightweight DNN is three orders of magnitude less than that in the conventional DNN. The simulation results demonstrate the lightweight DNN can provide high DOA estimation accuracy with the shortest testing time. It performs better than the conventional DNN. Furthermore, it is superior to traditional solutions such as the multiple signal classification (MUSIC) method and conventional beamforming (CBF) method in harsh conditions like low signal-to-noise ratios (SNRs), closely spaced sources, and few snapshots. [ABSTRACT FROM AUTHOR]

In this paper we present a method that allows leveraging 3D electron density information to train a deep neural network pipeline to segment regions of high, medium and low electronegativity and classify substances as health hazardous or non-hazardous. We show that this can be used for use-cases such as cosmetics and food products. For this purpose, we first generate 3D electron density cubes using semiempirical molecular calculations for a custom European Chemicals Agency (ECHA) subset consisting of substances labelled as hazardous and non-hazardous for cosmetic usage. Together with their 3-class electronegativity maps we train a modified 3D-UNet with electron density cubes to segment reactive sites in molecules and classify substances with an accuracy of 78.1%. We perform the same process on a custom food dataset (CompFood) consisting of hazardous and non-hazardous substances compiled from European Food Safety Authority (EFSA) OpenFoodTox, Food and Drug Administration (FDA) Generally Recognized as Safe (GRAS) and FooDB datasets to achieve a classification accuracy of 64.1%. Our results show that 3D electron densities and particularly masked electron densities, calculated by taking a product of original electron densities and regions of high and low electronegativity can be used to classify molecules for different use-cases and thus serve not only to guide safe-by-design product development but also aid in regulatory decisions. Scientific contribution: We aim to contribute to the diverse 3D molecular representations used for training machine learning algorithms by showing that a deep learning network can be trained on 3D electron density representation of molecules. This approach has previously not been used to train machine learning models and it allows utilization of the true spatial domain of the molecule for prediction of properties such as their suitability for usage in cosmetics and food products and in future, to other molecular properties. The data and code used for training is accessible at https://github.com/s-singh-ivv/eDen-Substances. [ABSTRACT FROM AUTHOR]

This document provides summaries of various research papers published in the journal Sensors. The summaries cover a wide range of topics, including personalized medicine, laser ranging, memristive interfaces, face and person detection, IoT data visualization, monitoring elderly activities, auditory illusions, brain connectivity, corona discharges, thermal data analysis, vital signal detection, and eye-blink artifact removal. The document showcases the contributions and findings of each study, offering valuable insights for researchers and library patrons interested in these areas of study. [Extracted from the article]

This study aims to enhance diagnostic capabilities for optimising the performance of the anaerobic sewage treatment lagoon at Melbourne Water's Western Treatment Plant (WTP) through a novel machine learning (ML)-based monitoring strategy. This strategy employs ML to make accurate probabilistic predictions of biogas performance by leveraging diverse real-life operational and inspection sensor and other measurement data for asset management, decision making, and structural health monitoring (SHM). The paper commences with data analysis and preprocessing of complex irregular datasets to facilitate efficient learning in an artificial neural network. Subsequently, a Bayesian mixture density neural network model incorporating an attention-based mechanism in bidirectional long short-term memory (BiLSTM) was developed. This probabilistic approach uses a distribution output layer based on the Gaussian mixture model and Monte Carlo (MC) dropout technique in estimating data and model uncertainties, respectively. Furthermore, systematic hyperparameter optimisation revealed that the optimised model achieved a negative log-likelihood (NLL) of 0.074, significantly outperforming other configurations. It achieved an accuracy approximately 9 times greater than the average model performance (NLL = 0.753) and 22 times greater than the worst performing model (NLL = 1.677). Key factors influencing the model's accuracy, such as the input window size and the number of hidden units in the BiLSTM layer, were identified, while the number of neurons in the fully connected layer was found to have no significant impact on accuracy. Moreover, model calibration using the expected calibration error was performed to correct the model's predictive uncertainty. The findings suggest that the inherent data significantly contribute to the overall uncertainty of the model, highlighting the need for more high-quality data to enhance learning. This study lays the groundwork for applying ML in transforming high-value assets into intelligent structures and has broader implications for ML in asset management, SHM applications, and renewable energy sectors. [ABSTRACT FROM AUTHOR]

The rapid development of deep neural networks has attracted significant attention in the infrared and visible image fusion field. However, most existing fusion models have many parameters and consume high computational and spatial resources. This paper proposes a fast and efficient recursive fusion neural network model to solve this complex problem that few people have touched. Specifically, we designed an attention module combining a traditional fusion knowledge prior with channel attention to extract modal-specific features efficiently. We used a shared attention layer to perform the early fusion of modal-shared features. Adopting parallel dilated convolution layers further reduces the network's parameter count. Our network is trained recursively, featuring minimal model parameters, and requires only a few training batches to achieve excellent fusion results. This significantly reduces the consumption of time, space, and computational resources during model training. We compared our method with nine SOTA methods on three public datasets, demonstrating our method's efficient training feature and good fusion results. [ABSTRACT FROM AUTHOR]

The maturity of fruits and vegetables such as tomatoes significantly impacts indicators of their quality, such as taste, nutritional value, and shelf life, making maturity determination vital in agricultural production and the food processing industry. Tomatoes mature from the inside out, leading to an uneven ripening process inside and outside, and these situations make it very challenging to judge their maturity with the help of a single modality. In this paper, we propose a deep learning-assisted multimodal data fusion technique combining color imaging, spectroscopy, and haptic sensing for the maturity assessment of tomatoes. The method uses feature fusion to integrate feature information from images, near-infrared spectra, and haptic modalities into a unified feature set and then classifies the maturity of tomatoes through deep learning. Each modality independently extracts features, capturing the tomatoes' exterior color from color images, internal and surface spectral features linked to chemical compositions in the visible and near-infrared spectra (350 nm to 1100 nm), and physical firmness using haptic sensing. By combining preprocessed and extracted features from multiple modalities, data fusion creates a comprehensive representation of information from all three modalities using an eigenvector in an eigenspace suitable for tomato maturity assessment. Then, a fully connected neural network is constructed to process these fused data. This neural network model achieves 99.4% accuracy in tomato maturity classification, surpassing single-modal methods (color imaging: 94.2%; spectroscopy: 87.8%; haptics: 87.2%). For internal and external maturity unevenness, the classification accuracy reaches 94.4%, demonstrating effective results. A comparative analysis of performance between multimodal fusion and single-modal methods validates the stability and applicability of the multimodal fusion technique. These findings demonstrate the key benefits of multimodal fusion in terms of improving the accuracy of tomato ripening classification and provide a strong theoretical and practical basis for applying multimodal fusion technology to classify the quality and maturity of other fruits and vegetables. Utilizing deep learning (a fully connected neural network) for processing multimodal data provides a new and efficient non-destructive approach for the massive classification of agricultural and food products. [ABSTRACT FROM AUTHOR]

This paper delves into the specialized domain of human action recognition, focusing on the Identification of Indian classical dance poses, specifically Bharatanatyam. Within the dance context, a "Karana" embodies a synchronized and harmonious movement encompassing body, hands, and feet, as defined by the Natyashastra. The essence of Karana lies in the amalgamation of nritta hasta (hand movements), sthaana (body postures), and chaari (leg movements). Although numerous, Natyashastra codifies 108 karanas, showcased in the intricate stone carvings adorning the Nataraj temples of Chidambaram, where Lord Shiva's association with these movements is depicted. Automating pose identification in Bharatanatyam poses challenges due to the vast array of variations, encompassing hand and body postures, mudras (hand gestures), facial expressions, and head gestures. To simplify this intricate task, this research employs image processing and automation techniques. The proposed methodology comprises four stages: acquisition and pre-processing of images involving skeletonization and Data Augmentation techniques, feature extraction from images, classification of dance poses using a deep learning network-based convolution neural network model (InceptionResNetV2), and visualization of 3D models through mesh creation from point clouds. The use of advanced technologies, such as the MediaPipe library for body key point detection and deep learning networks, streamlines the identification process. Data augmentation, a pivotal step, expands small datasets, enhancing the model's accuracy. The convolution neural network model showcased its effectiveness in accurately recognizing intricate dance movements, paving the way for streamlined analysis and interpretation. This innovative approach not only simplifies the identification of Bharatanatyam poses but also sets a precedent for enhancing accessibility and efficiency for practitioners and researchers in the Indian classical dance. [ABSTRACT FROM AUTHOR]

To achieve successful prevention of fire incidents originating from human activities, it is imperative to possess a thorough understanding. This paper introduces a machine learning approach, specifically utilizing deep neural networks (DNN), to develop predictive models for fire occurrence in Keelung City, Taiwan. It investigates ten factors across demographic, architectural, and economic domains through spatial analysis and thematic maps generated from geographic information system data. These factors are then integrated as inputs for the DNN model. Through 50 iterations, performance indices including the coefficient of determination (R2), root mean square error (RMSE), variance accounted for (VAF), prediction interval (PI), mean absolute error (MAE), weighted index (WI), weighted mean absolute percentage error (WMAPE), Nash–Sutcliffe efficiency (NS), and the ratio of performance to deviation (RPD) are computed, with average values of 0.89, 7.30 × 10−2, 89.21, 1.63, 4.90 × 10−2, 0.97, 2.92 × 10−1, 0.88, and 4.84, respectively. The model's predictions, compared with historical data, demonstrate its efficacy. Additionally, this study explores the impact of various urban renewal strategies using the DNN model, highlighting the significant influence of economic factors on fire incidence. This underscores the importance of economic factors in mitigating fire incidents and emphasizes their consideration in urban renewal planning. [ABSTRACT FROM AUTHOR]

The rapid development of deep learning has significant implications for the advancement of computational fluid dynamics. Currently, most pixel-grid-based deep learning methods for flow field prediction exhibit significantly reduced accuracy in predicting boundary layer flows and poor adaptability to geometric shapes. Although graph neural network models for unstructured grid-based unsteady flow prediction have better geometric adaptability, these models suffer from error accumulation in long-term predictions of unsteady flows. More importantly, fully data-driven models often require extensive training time, greatly limiting the rapid update and iteration speed of deep learning models when facing more complex unsteady flows. Therefore, this paper aims to balance the demands for training overhead and prediction accuracy by integrating physical constraints based on the finite volume method into the loss function of the graph neural network. Additionally, it incorporates a twice-message aggregation mechanism inspired by the extended stencil method to enhance the unsteady flow prediction accuracy and geometric shape generalization ability of the graph neural network model on unstructured grids. We focus particularly on the model's predictive accuracy within the boundary layer. Compared to fully data-driven methods, our model achieves better predictive accuracy and geometric shape generalization ability in a shorter training time. [ABSTRACT FROM AUTHOR]

Airwakes are shed behind a ship's superstructure, and they represent a highly turbulent and rapidly distorting flow field. Because of this complexity, they require a baseline: A database of flow velocity points, preferably through experiments and also through high-fidelity computational fluid dynamics simulations. However the database is prohibitively costly, and in situ measurements, at a constant wind angle, are often affected by the weather. A previously developed perturbation scheme helps to generate the autospectrum in closed form from a given wind database, specifically, from the numerically extracted autospectrum for this database. The primary objective of this paper is to demonstrate how deep neural networks can be fruitfully exploited to reduce the dependence on a database of flow velocity points in generating the autospectra, by reducing the amount of in situ data required to achieve the same accuracy as established methods. Two machine learning approaches are developed to predict the autospectrum for a data set when provided with a subset of the wind data set at the input and are assessed using cross-validation. In the first, a neural network is applied to predict the perturbation scheme. Though this method did not predict the autospectrum better than the previously developed perturbation scheme, it laid the foundation for the second method. In the second, a neural network is applied to the autospectra which can be numerically extracted from a database. An improvement is found in the average error computed over all data sets for the model-predicted autospectrum compared to the average error in the autospectrum predicted using the conventional method. The model provided better results for 51.4% of the data sets compared to the conventional method, with many data sets showing marked improvement. The database measured from the Naval Academy YP676 training vessel is used for training and testing the neural network. [ABSTRACT FROM AUTHOR]

One of the predominant health issues affecting Saudi Arabia and leading to many complications is Type 2 diabetes (T2D). Early detection and significant preventative measures lead to curbing and controlling the health issue. There are fewer datasets in the literature for the detection of T2D in the Saudi population. Past studies using Saudi data have favoured machine learning algorithms to classify T2D. Although the application of this data in machine learning is evident, no studies exist in the literature that compare this data, especially those related to deep learning algorithms. This study's objective is to use specific Saudi data to develop multiple deep learning models that could be used to detect T2D. The research uses a Deep Neural Network (DNN), an Autoencoder (AE), and a Convolutional Neural Network (CNN) to create predictive models and compare their performance with a traditional machine learning classifier used on the same dataset that outperformed other machine learning algorithms such as a Decision Forest (DF). Various metrics were used to evaluate the effectiveness of the models, such as accuracy, precision, recall, F1 score and area under the ROC curve (AUC) where the ROC acts as a receiver operating characteristic curve. There are two cases in this paper: (i) uses all features of the dataset and (ii) uses six of the ten features, such as DF. In case (i), the results were shown that AE outperformed other models with the highest accuracy for imbalanced and balanced data 81.12% and 79.16%, respectively. The results for case (ii) showed that AE scored the highest 81.01% accuracy with imbalanced data compared to DF and DF achieved the highest accuracy of 82.1% with balanced data. As a result, both cases explored in this study revealed that AE has a constant superior performance if imbalanced data is used. In contrast, DF demonstrated the highest accuracy when a balanced dataset was used with a feature set reduction. They help to identify the undiagnosed T2D, and they are essential for professionals in Saudi Arabia in the health sector to promote health connections, identify risks and contain or improve their diabetes management. [ABSTRACT FROM AUTHOR]

Neuroimaging technology is considered a non-invasive method research the structure and function of the brain which have been widely used in neuroscience, psychiatry, psychology, and other fields. The development of Deep Learning Neural Network (DLNN), based on the deep learning algorithms of neural imaging techniques in brain disease diagnosis plays a more and more important role. In this paper, a deep neural network imaging technology based on Stack Auto-Encoder (SAE) feature extraction is constructed, and then Support Vector Machine (SVM) was used to solve binary classification problems (Alzheimer's disease [AD] and Mild Cognitive Impairment [MCI]). Four sets of experimental data were employed to perform the training and testing stages of DLNN. The number of neurons in each of the DLNNs was determined using the grid search technique. Overall, the results of DLNNs performance indicated that the SAE feature extraction was superior over (Accuracy Rate [AR] = 74.9% with structure of 93-171-49-22-93) shallow layer features extraction (AR = 70.8% with structure of 93-22-93) and primary features extraction (AR = 69.2%). [ABSTRACT FROM AUTHOR]

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper, we establish some analysis for linear feature extraction by a deep multi-channel convolutional neural networks (CNNs), which demonstrates the power of deep learning over traditional linear transformations, like Fourier, wavelets, redundant dictionary coding methods. Moreover, we give an exact construction presenting how linear features extraction can be conducted efficiently with multi-channel CNNs. It can be applied to lower the essential dimension for approximating a high-dimensional function. Rates of function approximation by such deep networks implemented with channels and followed by fully connected layers are investigated as well. Harmonic analysis for factorizing linear features into multi-resolution convolutions plays an essential role in our work. Nevertheless, a dedicate vectorization of matrices is constructed, which bridges 1D CNN and 2D CNN and allows us to have corresponding 2D analysis. [ABSTRACT FROM AUTHOR]

The advanced development of communication technologies has made covert communications quite challenging to be recognized. By altering an entity's timing behavior during overt network communication, a covert timing channel (CTC) provides a way to leak sensitive data. This is becoming a serious threat due to the ability to transmit hidden messages without being detected by traditional security systems such as proxies and firewalls. In this paper, we explore the automatic classification and identification of covert timing channels using deep neural networks, namely, Long Short-Term Memory (LSTM), 1D-Convolutional Neural networks (1D-CNN), and a hybrid of LSTM and 1D-CNN. These classifiers have been trained and tested using sequence real inter-arrival times datasets labeled with covert or legitimate. The stream length differs for each dataset; (32, 64, 128, 256, and 512 bytes). Traditional machine-learning models have also been developed for comparisons and evaluation. The evaluation results showed that the hybrid of LSTM and CNN model outperforms other models either developed by deep neural networks or traditional machine learning with an accuracy of %97.5. [ABSTRACT FROM AUTHOR]

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a wide range of NLP tasks. Deep learning models for NLP typically use large amounts of data to train deep neural networks, allowing them to learn the patterns and relationships in language data. This is in contrast to traditional NLP approaches, which rely on hand-engineered features and rules to perform NLP tasks. The ability of deep neural networks to learn hierarchical representations of language data, handle variable-length input sequences, and perform well on large datasets makes them well-suited for NLP applications. Driven by the exponential growth of textual data and the increasing demand for condensed, coherent, and informative summaries, text summarization has been a critical research area in the field of NLP. Applying deep learning to text summarization refers to the use of deep neural networks to perform text summarization tasks. In this survey, we begin with a review of fashionable text summarization tasks in recent years, including extractive, abstractive, multi-document, and so on. Next, we discuss most deep learning-based models and their experimental results on these tasks. The paper also covers datasets and data representation for summarization tasks. Finally, we delve into the opportunities and challenges associated with summarization tasks and their corresponding methodologies, aiming to inspire future research efforts to advance the field further. A goal of our survey is to explain how these methods differ in their requirements as understanding them is essential for choosing a technique suited for a specific setting. This survey aims to provide a comprehensive review of existing techniques, evaluation methodologies, and practical applications of automatic text summarization. [ABSTRACT FROM AUTHOR]

This paper introduces a deep learning approach for accurately predicting the position and size of cracks in steam turbine blades using frequency response function data obtained from finite element analysis. Training deep neural networks for crack prediction necessitates an extensive dataset comprising various crack conditions, along with corresponding position and size information. However, obtaining sufficient high-quality and well-balanced experimental data for diverse crack conditions poses challenges. To address this issue, we leverage finite element analysis techniques to effectively amass a large volume of training data. Our methodology involves frequency response analysis, incorporating a crack modeling approach based on node sharing elimination and model order reduction (MOR). Automating this process enables us to efficiently generate a diverse dataset of crack blade frequency response data in a short timeframe, focusing on cracks in a single blade. The collected data is then transformed into two-dimensional image data, including magnitude similarity maps and magnitude frequency response maps, which serve as training data for our convolutional neural network (CNN) model. Evaluation of the CNN model's performance and accuracy for crack position and size prediction highlights its remarkable precision in determining the initiation position and size of blade cracks. Utilizing the proposed prediction model, there was a 95 % probability of accurately predicting the crack position within 3.1 % of the entire airfoil area. Furthermore, successful crack size predictions were achieved for approximately 96.4 % of the entire test dataset within an error range of ±1 mm. This underscores the potential capability of neural network training and crack prediction by leveraging training data derived from the finite element analysis and MOR. Our approach demonstrates promising implications for enhancing steam turbine blade maintenance and structural integrity assessment, as it streamlines data acquisition and provides an efficient solution for predicting critical crack characteristics. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) have gained prominence in various applications, but remain vulnerable to adversarial attacks that manipulate data to mislead a DNN. This paper aims to challenge the efficacy and transferability of two contemporary defense mechanisms against adversarial attacks: (a) robust training and (b) adversarial training. The former suggests that training a DNN on a data set consisting solely of robust features should produce a model resistant to adversarial attacks. The latter creates an adversarially trained model that learns to minimise an expected training loss over a distribution of bounded adversarial perturbations. We reveal a significant lack in the transferability of these defense mechanisms and provide insight into the potential dangers posed by L ∞ -norm attacks previously underestimated by the research community. Such conclusions are based on extensive experiments involving (1) different model architectures, (2) the use of canonical correlation analysis, (3) visual and quantitative analysis of the neural network's latent representations, (4) an analysis of networks' decision boundaries and (5) the use of equivalence of L 2 and L ∞ perturbation norm theories. [ABSTRACT FROM AUTHOR]

Despite the wide variety of methods developed for synthetic image attribution, most of them can only attribute images generated by models or architectures included in the training set and do not work with unknown architectures, hindering their applicability in real-world scenarios. In this paper, we propose a verification framework that relies on a Siamese Network to address the problem of open-set attribution of synthetic images to the architecture that generated them. We consider two different settings. In the first setting, the system determines whether two images have been produced by the same generative architecture or not. In the second setting, the system verifies a claim about the architecture used to generate a synthetic image, utilizing one or multiple reference images generated by the claimed architecture. The main strength of the proposed system is its ability to operate in both closed and open-set scenarios so that the input images, either the query and reference images, can belong to the architectures considered during training or not. Experimental evaluations encompassing various generative architectures such as GANs, diffusion models, and transformers, focusing on synthetic face image generation, confirm the excellent performance of our method in both closed and open-set settings, as well as its strong generalization capabilities. • New verification framework for open-set architecture attribution of synthetic images. • Tested with several types of generative architectures in closed and open set scenarios. • Generalization tests prove that the system can verify unknown models of the architecture. • Outperforms state-of-the-art methods for open-set architecture attribution with rejection. [ABSTRACT FROM AUTHOR]

Artificial Intelligence has found wide application, but also poses risks due to unintentional or malicious tampering during deployment. Regular checks are therefore necessary to detect and prevent such risks. Fragile watermarking is a technique used to identify tampering in AI models. However, previous methods have faced challenges including risks of omission, additional information transmission, and inability to locate tampering precisely. In this paper, we propose a method for detecting tampered parameters and bits, which can be used to detect, locate, and restore parameters that have been tampered with. We also propose an adaptive embedding method that maximizes information capacity while maintaining model accuracy. Our approach was tested on multiple neural networks subjected to attacks that modified weight parameters, and our results demonstrate that our method achieved great recovery performance when the modification rate was below 20%. Furthermore, for models where watermarking significantly affected accuracy, we utilized an adaptive bit technique to recover more than 15% of the accuracy loss of the model. • Fragile watermarking for rigorous neural network integrity detection. • Watermarking ensures 100% tampering detection, precise location, and recovery. • Watermarking fragility by combining Mutual- and Self-neural net parameters. • Incorporates watermarking with neural net feature, maintaining watermarked models' performance via gradient descent. • Bit-level training controls step size with carefully set hyperparameters. [ABSTRACT FROM AUTHOR]

At present, human translation is characterized by low efficiency, high cost, high consumption of resources and time, so it is urgent to study automatic translation technology to meet the needs of information interaction and language communication in various countries under the background of economic globalization. In order to improve the performance of Chinese-English translation system, this study aims to use optical network transmission technology to optimize the translation process. This research is based on deep learning model and uses optical network transmission technology to implement Chinese-English translation system. The neural network model is used to train the Chinese-English translation, and then the data is transmitted to the cloud for translation using optical network transmission technology. Finally, the translation result is returned to the user. The system can learn by itself on the basis of analyzing source documents, and predict target translation output by extracting features. The system is equipped with a translation engine based on the data source, which can realize interactive translation, and the final output can be achieved by processing the predicted translation output and based on the translator's understanding. Through the design of simulation experiments for system detection, the results show that the Chinese English translation model system has a high translation quality. By comparing it with the baseline system, it can be seen that both of them can translate sentences normally in 8 PR cycles (PR * 8, about 18% KSMR), and the data set improvement rate is about + 35 BLEU, that is, 76 BLEU is finally achieved. This proves that users can maintain the translation accuracy while reducing the number of effective interactions by using the optimized translation model to translate the target text, showing the effectiveness. In this paper, an interactive Chinese English translation system is designed by combining deep learning with cloud computing. [ABSTRACT FROM AUTHOR]

This paper introduces the Hybrid Quantum Deep Neural Network (HQDNN), a pioneering model that amalgamates classical Convolutional Neural Network (CNN) architecture with Parameterized Quantum Circuits (PmQC) for image classification tasks. The background elucidates the intricacies of CNN and PmQC operations, emphasizing their respective components and functions. HQDNN comprises quantum convolutional and pooling layers alongside a classical fully connected layer, demonstrating its effectiveness through simulations on the MNIST dataset. Results reveal HQDNN's superior learning ability and classification performance compared to traditional CNN, particularly with the inclusion of a pooling layer. This work contributes to the evolution of quantum machine learning, opening avenues for the practical integration of quantum computing in image classification workflows. Future research may explore scalability and diverse applications of HQDNN, marking a promising convergence of quantum computing and deep learning methodologies. [ABSTRACT FROM AUTHOR]

Background: Classifying breast cancer subtypes is crucial for clinical diagnosis and treatment. However, the early symptoms of breast cancer may not be apparent. Rapid advances in high-throughput sequencing technology have led to generating large number of multi-omics biological data. Leveraging and integrating the available multi-omics data can effectively enhance the accuracy of identifying breast cancer subtypes. However, few efforts focus on identifying the associations of different omics data to predict the breast cancer subtypes. Results: In this paper, we propose a differential sparse canonical correlation analysis network (DSCCN) for classifying the breast cancer subtypes. DSCCN performs differential analysis on multi-omics expression data to identify differentially expressed (DE) genes and adopts sparse canonical correlation analysis (SCCA) to mine highly correlated features between multi-omics DE-genes. Meanwhile, DSCCN uses multi-task deep learning neural network separately to train the correlated DE-genes to predict breast cancer subtypes, which spontaneously tackle the data heterogeneity problem in integrating multi-omics data. Conclusions: The experimental results show that by mining the associations among multi-omics data, DSCCN is more capable of accurately classifying breast cancer subtypes than the existing methods. [ABSTRACT FROM AUTHOR]

Text-independent speaker verification (TI-SV) is a crucial task in speaker recognition, as it involves verifying an individual's claimed identity from speech of arbitrary content without any human intervention. The target for TI-SV is to design a discriminative network to learn deep speaker embedding for speaker idiosyncrasy. In this paper, we propose a deep speaker embedding learning approach of a hybrid deep neural network (DNN) for TI-SV in FM broadcasting. Not only acoustic features are utilized, but also phoneme features are introduced as prior knowledge to collectively learn deep speaker embedding. The hybrid DNN consists of a convolutional neural network architecture for generating acoustic features and a multilayer perceptron architecture for extracting phoneme features sequentially, which represent significant pronunciation attributes. The extracted acoustic and phoneme features are concatenated to form deep embedding descriptors for speaker identity. The hybrid DNN demonstrates not only the complementarity between acoustic and phoneme features but also the temporality of phoneme features in a sequence. Our experiments show that the hybrid DNN outperforms existing methods and delivers a remarkable performance in FM broadcasting TI-SV. [ABSTRACT FROM AUTHOR]

The cost function gradient vanishing or exploding problem and slow convergence speed are key issues when training deep neural networks (DNNs). In this paper, we investigate the forward and backward propagation processes of DNN training and explore the properties of the activation function and derivative function (ADF) employed. The outputs' distribution of ADF with near-zero mean is proposed to reduce gradient problems. Additionally, the constant energy transfer of propagating data in the training process is also proposed to speed up convergence further. Based on wavelet frame theory, we derive a novel ADF, i.e., tight frame wavelet activation function (TFWAF) and tight frame wavelet derivative function (TFWDF) of the Mexican hat wavelet, to stabilize and accelerate DNN training. The nonlinearity of wavelet functions can strengthen the learning capacity of DNN models, while the sparse property of wavelets derived can reduce the overfitting problem and enhance the robustness of models. Experiments demonstrate that the proposed method stabilizes the DNN training process and accelerates convergence. [ABSTRACT FROM AUTHOR]

Visual object tracking is a key technology that is used in unmanned aerial vehicles (UAVs) to achieve autonomous navigation. In recent years, with the rapid development of deep learning, tracking algorithms based on Siamese neural networks have received widespread attention. However, because of complex and diverse tracking scenarios, as well as limited computational resources, most existing tracking algorithms struggle to ensure real-time stable operation while improving tracking performance. Therefore, studying efficient and fast-tracking frameworks, and enhancing the ability of algorithms to respond to complex scenarios has become crucial. Therefore, this paper proposes a cross-parallel attention and efficient match transformer for aerial tracking (SiamEMT). Firstly, we carefully designed the cross-parallel attention mechanism to encode global feature information and to achieve cross-dimensional interaction and feature correlation aggregation via parallel branches, highlighting feature saliency and reducing global redundancy information, as well as improving the tracking algorithm's ability to distinguish between targets and backgrounds. Meanwhile, we implemented an efficient match transformer to achieve feature matching. This network utilizes parallel, lightweight, multi-head attention mechanisms to pass template information to the search region features, better matching the global similarity between the template and search regions, and improving the algorithm's ability to perceive target location and feature information. Experiments on multiple drone public benchmark tests verified the accuracy and robustness of the proposed tracker in drone tracking scenarios. In addition, on the embedded artificial intelligence (AI) platform AGX Xavier, our algorithm achieved real-time tracking speed, indicating that our algorithm can be effectively applied to UAV tracking scenarios. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

In recent years, with the continuous advancement of remote sensing technology, remote sensing images have found widespread application in various fields. However, remote sensing images are often hindered by the presence of clouds, which can significantly reduce their usability. Removing clouds from remote sensing images has thus become an essential preprocessing step in remote sensing image analysis. While numerous models based on deep learning have produced impressive results in the domain of image denoising, there has been limited research on applying deep neural networks to tackle the issue of cloud removal in remote sensing images. This paper proposes a novel model, the Hybrid Attention Generative Adversarial Network (HyA-GAN), that blends the channel attention mechanism and the spatial attention mechanism and integrates it into a generative adversarial network. By incorporating both the channel attention mechanism and the spatial attention mechanism, HyA-GAN permits the network to prioritize regions that are vital for image processing. This feature leads to an improvement in the network's capacity to recover data and generate remote sensing images with superior cloud removal effects. When comparing HyA-GAN with other existing cloud removal models on the RICE dataset, it outperformed them in both peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The experiments demonstrate the high potential of HyA-GAN in addressing the challenge of removing clouds from remote sensing images. [ABSTRACT FROM AUTHOR]

All-optical plasmonic switches (AOPSs) utilizing surface plasmon polaritons are well-suited for integration into photonic integrated circuits (PICs) and play a crucial role in advancing all-optical signal processing. The current AOPS design methods still rely on trial-and-error or empirical approaches. In contrast, recent deep learning (DL) advances have proven highly effective as computational tools, offering an alternative means to accelerate nanophotonics simulations. This paper proposes an innovative approach utilizing DL for spectrum prediction and inverse design of AOPS. The switches employ circular nonlinear plasmonic ring resonators (NPRRs) composed of interconnected metal–insulator–metal waveguides with a ring resonator. The NPRR switching performance is shown using the nonlinear Kerr effect. The forward model presented in this study demonstrates superior computational efficiency when compared to the finite-difference time-domain method. The model analyzes various structural parameters to predict transmission spectra with a distinctive dip. Inverse modeling enables the prediction of design parameters for desired transmission spectra. This model provides a rapid estimation of design parameters, offering a clear advantage over time-intensive conventional optimization approaches. The loss of prediction for both the forward and inverse models, when compared to simulations, is exceedingly low and on the order of 10−4. The results confirm the suitability of employing DL for forward and inverse design of AOPSs in PICs. [ABSTRACT FROM AUTHOR]