413 results on '"denoising autoencoder"'
Search Results
2. Single-cell RNA sequencing data analysis utilizing multi-type graph neural networks
- Author
-
Xu, Li, Li, Zhenpeng, Ren, Jiaxu, Liu, Shuaipeng, and Xu, Yiming
- Published
- 2024
- Full Text
- View/download PDF
3. RunDAE model: Running denoising autoencoder models for denoising ECG signals
- Author
-
Samann, Fars and Schanze, Thomas
- Published
- 2023
- Full Text
- View/download PDF
4. Variational Type Graph Autoencoder for Denoising on Event Recommendation.
- Author
-
Zhang, Shuo, Meng, Xiangwu, and Zhang, Yujie
- Subjects
- *
AUTOENCODER , *ARTIFICIAL intelligence , *LATENT variables , *SIGNAL denoising , *RANDOM graphs - Abstract
The article proposes a variational type graph autoencoder model to address noise and data sparsity issues in event recommendation systems within Event-Based Social Networks (EBSNs). Topics discussed include the use of heterogeneous denoising techniques for reducing noise, the introduction of a heterogeneous normalization module to handle data sparsity, and the incorporation of a learnable mixture prior to model various types of contextual features.
- Published
- 2025
- Full Text
- View/download PDF
5. Derivation of Kinetic Parameters and Lignocellulosic Composition From Thermogram of Biomass Pyrolysis Using Convolutional Neural Network.
- Author
-
Kim, Heeyoon, Jo, Hyunbin, Ryu, Changkook, and Rokhum, Samuel Lalthazuala
- Subjects
- *
CONVOLUTIONAL neural networks , *PYROLYSIS kinetics , *LIGNOCELLULOSE , *AUTOENCODER , *REGRESSION analysis - Abstract
A novel method employing a 1‐dimensional convolutional neural network (1D‐CNN) has been developed to deduce kinetic parameters for the three‐parallel‐reaction model (TPRM) and the lignocellulosic composition from the thermogram of biomass pyrolysis. This model was trained on differential thermogram (DTG) datasets created at various heating rates with rate constants randomly selected from expansive ranges. Furthermore, to enhance prediction accuracy, a denoising autoencoder (DAE) was crafted to eliminate noise from experimental data effectively. The 1D‐CNN regression model forecasted kinetic parameters with mean errors of 1.52% for trained heating rates and 1.39%−3.19% for other heating rates. When tested on four biomass samples, the model precisely mimicked the DTG curves with R2 values ranging from 0.9956 to 0.9994. Relative to conventional numerical methods, this model delivers comparable prediction accuracy but through a significantly streamlined and expedited process. Enhancements are needed to broaden the model's applicability across various kinetic models and materials. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
6. Demsasa: micro-video scene classification based on denoising multi-shots association self-attention.
- Author
-
Gong, Rui, Zhang, Yu, Zhang, Yanhui, Liu, Yue, Guo, Jie, and Nie, Xiushan
- Abstract
Due to segmentation and splicing in micro-videos when user upload videos to platform, the content of different shots in the same scene is discontinuous, which leads to the problem of large content differences between different shots. At the same time, due to the low resolution of the shooting equipment or jitter and other factors, the video has noise information. In view of the above problems, the conventional and serialized scene feature learning in micro-video cannot learn the content difference and correlation between different shots, which will weaken the semantic representation of scene features. Therefore, this paper proposes a micro-video scene classification method based on De-noising Multi-shots Association Self-attention (DeMsASa) model. In this method, the shot boundary detection algorithm segments micro- video firstly, and then the semantic representation of the multi-shots video scene is learned by de-noising, association between video frames in the same shot and the association modeling between different shots. Experiments results show that the classification performance of the proposed method is superior to the existing micro-video scene classification methods. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
7. Application of multi-modal temporal neural network based on enhanced sparrow optimization in lithium battery life prediction
- Author
-
Zeyu Liu, Xiaofang Du, and Yuhai Shi
- Subjects
Battery life degradation ,Health feature extraction ,Temporal neural network ,Denoising autoencoder ,Sparrow optimization algorithm ,Medicine ,Science - Abstract
Abstract This paper introduces the DeNet-Mamba-DC-SCSSA network, an advanced solution for predicting the Remaining Useful Life (RUL) of lithium-ion batteries, crucial for the safety and efficiency management of electric vehicles. Combining the robust Denoising Enhancement Network (DeNet), the Improved Sparrow Optimization Algorithm (SCSSA), the adept Mamba time-series model, and the proficient Dilated Convolution (DC), this model excels in precise noise handling and sophisticated feature extraction. DeNet diligently refines input data, mitigating noise interference, while Mamba skillfully captures sequential intricacies. DC, on the other hand, adeptly extracts features over varying time scales, ensuring meticulous RUL predictions.The model’s efficacy was rigorously tested on NASA and CALCE datasets and was benchmarked against cutting-edge algorithms. Remarkably, it reduced average RE and RMSE by 48.59% and 21.45%, respectively, showcasing its superior performance and accuracy. Further evaluation on the CALCE dataset against the latest methods affirmed its leading predictive precision and stability.The model’s robustness and practical applicability were further validated using real vehicle data from a new energy vehicle platform. In a challenging test, it accurately predicted the charging capacities corresponding to the mileage of four vehicles with minimal errors: 0.52 Ah, 1.03 Ah, 0.84 Ah, and 0.71 Ah. These results significantly surpassed those of other recent methods, highlighting the model’s exceptional generalizability and potential for real-world applications in electric vehicle battery management.
- Published
- 2024
- Full Text
- View/download PDF
8. Deep feature fusion with computer vision driven fall detection approach for enhanced assisted living safety
- Author
-
Wafa Sulaiman Almukadi, Fadwa Alrowais, Muhammad Kashif Saeed, Abdulsamad Ebrahim Yahya, Ahmed Mahmud, and Radwa Marzouk
- Subjects
Fall detection ,Computer vision ,Deep feature fusion ,Pelican optimization algorithm ,Deep learning ,Denoising autoencoder ,Medicine ,Science - Abstract
Abstract Assisted living facilities cater to the demands of the elderly population, providing assistance and support with day-to-day activities. Fall detection is fundamental to ensuring their well-being and safety. Falls are frequent among older persons and might cause severe injuries and complications. Incorporating computer vision techniques into assisted living environments is revolutionary for these issues. By leveraging cameras and complicated approaches, a computer vision (CV) system can monitor residents’ movements continuously and identify any potential fall events in real time. CV, driven by deep learning (DL) techniques, allows continuous surveillance of people through cameras, investigating complicated visual information to detect potential fall risks or any instances of falls quickly. This system can learn from many visual data by leveraging DL, improving its capability to identify falls while minimalizing false alarms precisely. Incorporating CV and DL enhances the efficiency and reliability of fall detection and allows proactive intervention, considerably decreasing response times in emergencies. This study introduces a new Deep Feature Fusion with Computer Vision for Fall Detection and Classification (DFFCV-FDC) technique. The primary purpose of the DFFCV-FDC approach is to employ the CV concept for detecting fall events. Accordingly, the DFFCV-FDC approach uses the Gaussian filtering (GF) approach for noise eradication. Besides, a deep feature fusion process comprising MobileNet, DenseNet, and ResNet models is involved. To improve the performance of the DFFCV-FDC technique, improved pelican optimization algorithm (IPOA) based hyperparameter selection is performed. Finally, the detection of falls is identified using the denoising autoencoder (DAE) model. The performance analysis of the DFFCV-FDC methodology was examined on the benchmark fall database. A widespread comparative study reported the supremacy of the DFFCV-FDC approach with existing techniques.
- Published
- 2024
- Full Text
- View/download PDF
9. Application of multi-modal temporal neural network based on enhanced sparrow optimization in lithium battery life prediction.
- Author
-
Liu, Zeyu, Du, Xiaofang, and Shi, Yuhai
- Subjects
REMAINING useful life ,OPTIMIZATION algorithms ,ELECTRIC vehicles ,FEATURE extraction ,TIME-varying networks ,ELECTRIC vehicle batteries - Abstract
This paper introduces the DeNet-Mamba-DC-SCSSA network, an advanced solution for predicting the Remaining Useful Life (RUL) of lithium-ion batteries, crucial for the safety and efficiency management of electric vehicles. Combining the robust Denoising Enhancement Network (DeNet), the Improved Sparrow Optimization Algorithm (SCSSA), the adept Mamba time-series model, and the proficient Dilated Convolution (DC), this model excels in precise noise handling and sophisticated feature extraction. DeNet diligently refines input data, mitigating noise interference, while Mamba skillfully captures sequential intricacies. DC, on the other hand, adeptly extracts features over varying time scales, ensuring meticulous RUL predictions.The model's efficacy was rigorously tested on NASA and CALCE datasets and was benchmarked against cutting-edge algorithms. Remarkably, it reduced average RE and RMSE by 48.59% and 21.45%, respectively, showcasing its superior performance and accuracy. Further evaluation on the CALCE dataset against the latest methods affirmed its leading predictive precision and stability.The model's robustness and practical applicability were further validated using real vehicle data from a new energy vehicle platform. In a challenging test, it accurately predicted the charging capacities corresponding to the mileage of four vehicles with minimal errors: 0.52 Ah, 1.03 Ah, 0.84 Ah, and 0.71 Ah. These results significantly surpassed those of other recent methods, highlighting the model's exceptional generalizability and potential for real-world applications in electric vehicle battery management. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
10. A deep learning approach to prediction of blood group antigens from genomic data.
- Author
-
Moslemi, Camous, Sækmose, Susanne, Larsen, Rune, Brodersen, Thorsten, Bay, Jakob T., Didriksen, Maria, Nielsen, Kaspar R., Bruun, Mie T., Dowsett, Joseph, Dinh, Khoa M., Mikkelsen, Christina, Hyvärinen, Kati, Ritari, Jarmo, Partanen, Jukka, Ullum, Henrik, Erikstrup, Christian, Ostrowski, Sisse R., Olsson, Martin L., and Pedersen, Ole B.
- Subjects
- *
BLOOD group antigens , *CONVOLUTIONAL neural networks , *BLOOD grouping & crossmatching , *BLOOD groups , *DEEP learning - Abstract
Background: Deep learning methods are revolutionizing natural science. In this study, we aim to apply such techniques to develop blood type prediction models based on cheap to analyze and easily scalable screening array genotyping platforms. Methods: Combining existing blood types from blood banks and imputed screening array genotypes for ~111,000 Danish and 1168 Finnish blood donors, we used deep learning techniques to train and validate blood type prediction models for 36 antigens in 15 blood group systems. To account for missing genotypes a denoising autoencoder initial step was utilized, followed by a convolutional neural network blood type classifier. Results: Two thirds of the trained blood type prediction models demonstrated an F1‐accuracy above 99%. Models for antigens with low or high frequencies like, for example, Cw, low training cohorts like, for example, Cob, or very complicated genetic underpinning like, for example, RhD, proved to be more challenging for high accuracy (>99%) DL modeling. However, in the Danish cohort only 4 out of 36 models (Cob, Cw, D‐weak, Kpa) failed to achieve a prediction F1‐accuracy above 97%. This high predictive performance was replicated in the Finnish cohort. Discussion: High accuracy in a variety of blood groups proves viability of deep learning‐based blood type prediction using array chip genotypes, even in blood groups with nontrivial genetic underpinnings. These techniques are suitable for aiding in identifying blood donors with rare blood types by greatly narrowing down the potential pool of candidate donors before clinical grade confirmation. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. COMPUTER-ASSISTED ONLINE LEARNING OF ENGLISH ORAL PRONUNCIATION BASED ON DAE END-TO-END RECURRENT NEURAL NETWORKS.
- Author
-
KANGSHENG LAI and LIUJUN MO
- Subjects
SECOND language acquisition ,PINK noise ,COMPUTER assisted instruction ,SPEECH ,WHITE noise ,DEEP learning - Abstract
With the development of globalization, learning a second language has received increasing attention from people. To improve English oral proficiency, a computer-aided online learning system for English oral pronunciation is studied. A denoising autoencoder is integrated into the system to create a simplified end-to-end recurrent neural network for pronunciation detection and diagnosis based on deep learning. The study first collected and preprocessed oral pronunciation data of English learners, including enhancing speech signals and reducing noise. Next, an RNN model with Long Short-Term Memory (LSTM) as the core was constructed to capture time series characteristics in pronunciation. And use DAE to extract features and reduce the influence of background noise to enhance the recognition of pronunciation features. At the same time, the study utilized web crawler technology to collect a large amount of oral pronunciation data from non-native English learners, and constructed an English oral corpus containing pronunciation errors. And in order to simulate real situations, white noise and pink noise were artificially added to the corpus in the study, and they were divided into training and testing sets in a ratio of 60% to 40%. The results showed that the classification accuracy of the system in the training and testing sets under white noise environment was 78.97% and 94.01%, respectively, and the classification accuracy in the pink noise environment was 76.19% and 94.03%, respectively. The system's error detection accuracy in vowel and consonant pronunciation detection is 88.91% and 91.68%, respectively, and the error correction accuracy in vowel and consonant pronunciation detection is 90.67% and 91.96%, respectively. In summary, the research on computer-aided online learning of English oral pronunciation based on Denoising Auto Encoders end-to-end recurrent neural networks has effectively improved learning efficiency. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
12. V-DAFT: visual technique for texture image defect recognition with denoising autoencoder and fourier transform.
- Author
-
Si, Jongwook and Kim, Sungyoung
- Abstract
Texture is the surface qualities and visual attributes of an object, determined by the arrangement, size, shape, density, and proportion of its fundamental components. In the manufacturing industry, products typically have uniform textures, allowing for automated visual inspections of the product surface to recognize defects. During this process, texture defect recognition techniques can be employed. In this paper, we propose a method that combines a convolutional autoencoder architecture with Fourier transform analysis. We employ a normal reconstructed template as defined in this study. Despite its simple structure and rapid training and inference capabilities, it offers recognition performance comparable to state-of-the-art methods. Fourier transform is a powerful tool for analyzing the frequency domain of images and signals, which is essential for effective defect recognition as texture defects often exhibit characteristic changes in specific frequency ranges. The experiment evaluates the recognition performance using the AUC metric, with the proposed method showing a score of 93.7%. To compare with existing approaches, we present experimental results from previous research, an ablation study of the proposed method, and results based on the high-pass filter used in the Fourier mask. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
13. A novel denoising autoencoder hybrid network for remaining useful life estimation of lithium‐ion batteries
- Author
-
Wei Xia, Jinli Xu, Baolei Liu, and Huiyun Duan
- Subjects
CNN‐BiGRU ,denoising autoencoder ,lithium‐ion batteries ,reconstruction loss ,remaining useful life ,Technology ,Science - Abstract
Abstract Monitoring the health of lithium batteries is a crucial undertaking in ensuring the safe and dependable functioning of electric vehicles. Data‐driven methods have been proved to be an effective method for identifying the complex degradation process of batteries. To augment the precision of predicting the remaining useful life (RUL), this paper introduces a pioneering architecture for a denoising autoencoder (DAE). This architecture integrates a stacked convolutional neural network with subsequent layers of bidirectional gated recurrent units within an encoder–decoder framework. The utilization of the DAE network is employed as a means to effectively capture and represent the intricate and nonlinear knowledge associated with degradation data acquired from measured sources. Simultaneously, the reconstruction loss is incorporated into the total loss to improve the accuracy and generalization of the prediction model. The efficacy of the proposed approach is substantiated through the utilization of data sets sourced from the NASA Ames Prognostics Data Repository. The comparative findings suggest that the proposed approach demonstrates an exceptional ability to achieve precise and robust estimation in predicting the RUL, surpassing other advanced methodologies.
- Published
- 2024
- Full Text
- View/download PDF
14. A novel denoising autoencoder hybrid network for remaining useful life estimation of lithium‐ion batteries.
- Author
-
Xia, Wei, Xu, Jinli, Liu, Baolei, and Duan, Huiyun
- Subjects
REMAINING useful life ,CONVOLUTIONAL neural networks ,DATA libraries ,LITHIUM cells ,ELECTRIC vehicles - Abstract
Monitoring the health of lithium batteries is a crucial undertaking in ensuring the safe and dependable functioning of electric vehicles. Data‐driven methods have been proved to be an effective method for identifying the complex degradation process of batteries. To augment the precision of predicting the remaining useful life (RUL), this paper introduces a pioneering architecture for a denoising autoencoder (DAE). This architecture integrates a stacked convolutional neural network with subsequent layers of bidirectional gated recurrent units within an encoder–decoder framework. The utilization of the DAE network is employed as a means to effectively capture and represent the intricate and nonlinear knowledge associated with degradation data acquired from measured sources. Simultaneously, the reconstruction loss is incorporated into the total loss to improve the accuracy and generalization of the prediction model. The efficacy of the proposed approach is substantiated through the utilization of data sets sourced from the NASA Ames Prognostics Data Repository. The comparative findings suggest that the proposed approach demonstrates an exceptional ability to achieve precise and robust estimation in predicting the RUL, surpassing other advanced methodologies. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
15. Imputation of Missing Data Using Masked Denoising Autoencoder with L2-Norm Regularization in Software Effort Estimation.
- Author
-
Marco, Robert and Ahmad, Sharifah Sakinah Syed
- Subjects
MISSING data (Statistics) ,MULTIPLE imputation (Statistics) ,K-nearest neighbor classification ,RANDOM forest algorithms ,ERROR rates ,SOFTWARE engineering ,COMPUTER software - Abstract
A frequent problem in building initial software effort estimation (SEE) models is the existence of many missing values in historical software engineering datasets. Due to human intervention, this is caused by frequent damage to software project data. Loss of information and bias in data analysis due to missing data are serious problems. This study proposes a method to estimate missing data using a masked-denoising autoencoder (Masked- DAE) with L2-norm regularization, which can handle various types of data, missing patterns, proportions, and distributions. In this study, Cocomo81 and ISBSG-IFPUG datasets from open-source repositories were used. This experiment involved five missing data techniques, eight missing data rates (from 10% to 80%), and two missingness mechanisms (MCAR: missing completely at random and MNAR: missing not at random). The results show that the proposed Mask-DAE method has the best imputation performance in terms of imputation errors by outperforming DAE, k-nearest neighbor imputation (kNNI), random forest (RF) imputation, multiple imputations by chained equation (MICE), mean imputation and mode imputation. We find that the prediction error rate increases with the rate of missing data. Furthermore, prediction errors generated by MCAR mechanisms are lower than those generated by MNAR. Nevertheless, our method can reduce the model variance, which results in lower generalization error. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
16. A clinical trial termination prediction model based on denoising autoencoder and deep survival regression.
- Author
-
Qi, Huamei, Yang, Wenhui, Zou, Wenqin, and Hu, Yuxuan
- Subjects
- *
SIGNAL denoising , *PREDICTION models , *REGRESSION analysis , *ENCODING , *PREGNANT women - Abstract
Effective clinical trials are necessary for understanding medical advances but early termination of trials can result in unnecessary waste of resources. Survival models can be used to predict survival probabilities in such trials. However, survival data from clinical trials are sparse, and DeepSurv cannot accurately capture their effective features, making the models weak in generalization and decreasing their prediction accuracy. In this paper, we propose a survival prediction model for clinical trial completion based on the combination of denoising autoencoder (DAE) and DeepSurv models. The DAE is used to obtain a robust representation of features by breaking the loop of raw features after autoencoder training, and then the robust features are provided to DeepSurv as input for training. The clinical trial dataset for training the model was obtained from the ClinicalTrials.gov dataset. A study of clinical trial completion in pregnant women was conducted in response to the fact that many current clinical trials exclude pregnant women. The experimental results showed that the denoising autoencoder and deep survival regression (DAE‐DSR) model was able to extract meaningful and robust features for survival analysis; the C‐index of the training and test datasets were 0.74 and 0.75 respectively. Compared with the Cox proportional hazards model and DeepSurv model, the survival analysis curves obtained by using DAE‐DSR model had more prominent features, and the model was more robust and performed better in actual prediction. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
17. Investigation of the effectiveness of a classification method based on improved DAE feature extraction for hepatitis C prediction
- Author
-
Lin Zhang, Jixin Wang, Rui Chang, and Weigang Wang
- Subjects
Hepatitis C ,Autoencoder ,Denoising autoencoder ,Medicine ,Science - Abstract
Abstract Hepatitis C, a particularly dangerous form of viral hepatitis caused by hepatitis C virus (HCV) infection, is a major socio-economic and public health problem. Due to the rapid development of deep learning, it has become a common practice to apply deep learning to the healthcare industry to improve the effectiveness and accuracy of disease identification. In order to improve the effectiveness and accuracy of hepatitis C detection, this study proposes an improved denoising autoencoder (IDAE) and applies it to hepatitis C disease detection. Conventional denoising autoencoder introduces random noise at the input layer of the encoder. However, due to the presence of these features, encoders that directly add random noise may mask certain intrinsic properties of the data, making it challenging to learn deeper features. In this study, the problem of data information loss in traditional denoising autoencoding is addressed by incorporating the concept of residual neural networks into an enhanced denoising autoencoder. In our experimental study, we applied this enhanced denoising autoencoder to the open-source Hepatitis C dataset and the results showed significant results in feature extraction. While existing baseline machine learning methods have less than 90% accuracy and integrated algorithms and traditional autoencoders have only 95% correctness, the improved IDAE achieves 99% accuracy in the downstream hepatitis C classification task, which is a 9% improvement over a single algorithm, and a nearly 4% improvement over integrated algorithms and other autoencoders. The above results demonstrate that IDAE can effectively capture key disease features and improve the accuracy of disease prediction in hepatitis C data. This indicates that IDAE has the potential to be widely used in the detection and management of hepatitis C and similar diseases, especially in the development of early warning systems, progression prediction and personalised treatment strategies.
- Published
- 2024
- Full Text
- View/download PDF
18. A channel estimation method using denoising autoencoder for large-scale asymmetric backscatter systems
- Author
-
Chae Yoon Jung, Jae-Mo Kang, and Dong In Kim
- Subjects
Backscatter communication ,Beamforming ,Channel estimation ,Deep learning ,Denoising autoencoder ,Information technology ,T58.5-58.64 - Abstract
A novel channel estimation method based on deep learning algorithm is proposed for large-scale IoT networks. We consider asymmetric backscatter communication system to maintain low-power at sensor nodes. In order to obtain channel data, we design denoising autoencoder which consists of encoder with Feedforward Neural Network (FNN) and decoder with Convolutional Neural Network (CNN). Finally, the channel estimation error is minimized, while the pilots are optimized. Especially, we adopt beamforming technique that relies only on cascaded channel data to reduce complexity in multi-sensor system. It is shown that the accuracy is slightly degraded while the complexity is greatly reduced.
- Published
- 2024
- Full Text
- View/download PDF
19. Reducing false damage detections in guided ultrasonic wave monitoring systems using a denoising autoencoder.
- Author
-
Kong Chen, Yon, Bakhary, Norhisham, Padil, Khairul Hazman, Li, Jun, and Shamsudin, Mohd Fairuz
- Abstract
Guided ultrasonic wave (GUW) monitoring systems for pipeline structures are gaining much attention in critical sectors such as the petrochemical, nuclear and energy sectors. However, the effects of environmental and operational conditions (EOCs), especially temperature, may generate substantial false damage detections. The temperature effect may interfere with different coherent noise sources and generate unwanted peaks that are falsely identified as damage. In this paper, a denoising autoencoder (DAE) is proposed to reduce the frequency of false damage detections in GUW monitoring systems. A DAE decodes high dimensional data into low-dimensional features and reconstructs the original data from these low-dimensional features. By providing signals at a reference temperature with the fewest false damage detections, this structure forces the DAE to learn the essential features hidden within complex data. A database of GUW signals is formed based on the experimental measurements using a six-metre-long stainless steel Schedule 20 pipe. Variations in temperature and damage severity are applied to develop the database to mimic a simple step change in damage growth under EOCs. The outcomes obtained from this study show that the proposed methodology can reduce false damage detections during GUW monitoring and is valuable for pipeline safety evaluations. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
20. Enhance Deep Reinforcement Learning with Denoising Autoencoder for Self-Driving Mobile Robot.
- Author
-
Pratama, Gilang Nugraha Putu, Hidayatulloh, Indra, Surjono, Herman Dwi, and Sukardiyono, Totok
- Subjects
DEEP reinforcement learning ,REINFORCEMENT learning ,MOBILE robots ,MOBILE learning ,HUMAN error ,TRAFFIC accidents - Abstract
Over the past years, self-driving mobile robots have captured the interest of researchers, prompting exploration into their multifaceted implementation. They have the potential to revolutionize transportation by mitigating human error and reducing traffic accidents. The process of deploying self-driving mobile robots can be divided into several steps, such as algorithm design, simulation, and real-world application. This research paper presents a simulation using DonkeyCar on the Mini Monaco track, employing a Soft Actor-Critic (SAC) alongside a denoising autoencoder. At this point, it is limited to the simulation, serving as a proof of concept for further research with hardware implementation. The simulation verifies that relying solely on SAC for the convergence of policy is not sufficient; it yields a mean episode length of only 28.82 steps and a mean episode reward of 0.7815. The simulation ended after 3557 steps due to the inability of SAC alone to converge, without completing a single lap. Later, by integrating the denoising autoencoder, convergence of policy can be achieved. It enables DonkeyCar to adeptly track the lane of the circuit. The denoising autoencoder plays an important role in accelerating the convergence of transfer learning. Notably, the mean reward per episode reached 2380.4387, with an average episode length of 771.71 and a total of 114357 steps taken. DonkeyCar manages to complete several laps. These results affirm the effectiveness of SAC with a denoising autoencoder in enhancing the performance of self-driving mobile robots. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
21. Enhancing non-intrusive load monitoring with weather and calendar feature integration in DAE.
- Author
-
Pu, Zengxin, Huang, Yu, Weng, Min, Meng, Yang, Zhao, Yunbin, He, Gengsheng, Zhao, Jian, Moduo, Yu, Zhang, Zhong, and Gu, Chenghong
- Subjects
PATTERN recognition systems ,CALENDAR ,WIND speed ,ENERGY management ,ENERGY consumption - Abstract
The construction of modern power system is key to achieving dual carbon goals, where non-intrusive load monitoring (NILM) plays a vital role in enhancing energy utilization efficiency and energy management. For example, to enable prosumers to better understand the extent of their flexible loads for demand response and peer-to-peer trading, it is essential to be aware of the types and states of loads using the method of NILM. To improve the predictive accuracy and implementation effectiveness of NILM technology, this paper proposes a novel NILM method integrating meteorological and calendar features. It delves deeply into the close connection between external factors such as temperature, precipitation, wind speed, and holidays, and the energy consumption of electrical appliances, constructing additional associative mappings in the training of the Denoising Autoencoder (DAE) model. Test results on the UK-DALE public dataset show that the NILM method proposed in this paper has significant advantages over traditional NILM methods that consider only single-dimensional electrical data features, in terms of load pattern recognition and accuracy in load energy consumption monitoring. This confirms the potential of multi-dimensional feature fusion technology in the application of NILM. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
22. Investigation of the effectiveness of a classification method based on improved DAE feature extraction for hepatitis C prediction.
- Author
-
Zhang, Lin, Wang, Jixin, Chang, Rui, and Wang, Weigang
- Subjects
HEPATITIS C ,DEEP learning ,FEATURE extraction ,HEPATITIS C virus ,VIRAL hepatitis ,AUDITORY masking ,MACHINE learning - Abstract
Hepatitis C, a particularly dangerous form of viral hepatitis caused by hepatitis C virus (HCV) infection, is a major socio-economic and public health problem. Due to the rapid development of deep learning, it has become a common practice to apply deep learning to the healthcare industry to improve the effectiveness and accuracy of disease identification. In order to improve the effectiveness and accuracy of hepatitis C detection, this study proposes an improved denoising autoencoder (IDAE) and applies it to hepatitis C disease detection. Conventional denoising autoencoder introduces random noise at the input layer of the encoder. However, due to the presence of these features, encoders that directly add random noise may mask certain intrinsic properties of the data, making it challenging to learn deeper features. In this study, the problem of data information loss in traditional denoising autoencoding is addressed by incorporating the concept of residual neural networks into an enhanced denoising autoencoder. In our experimental study, we applied this enhanced denoising autoencoder to the open-source Hepatitis C dataset and the results showed significant results in feature extraction. While existing baseline machine learning methods have less than 90% accuracy and integrated algorithms and traditional autoencoders have only 95% correctness, the improved IDAE achieves 99% accuracy in the downstream hepatitis C classification task, which is a 9% improvement over a single algorithm, and a nearly 4% improvement over integrated algorithms and other autoencoders. The above results demonstrate that IDAE can effectively capture key disease features and improve the accuracy of disease prediction in hepatitis C data. This indicates that IDAE has the potential to be widely used in the detection and management of hepatitis C and similar diseases, especially in the development of early warning systems, progression prediction and personalised treatment strategies. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
23. Gap imputation in related multivariate time series through recurrent neural network-based denoising autoencoder.
- Author
-
Alonso, Serafín, Morán, Antonio, Pérez, Daniel, Prada, Miguel A., Fuertes, Juan J., and Domínguez, Manuel
- Subjects
- *
RECURRENT neural networks , *TIME series analysis , *MISSING data (Statistics) - Abstract
Technological advances in industry have made it possible to install many connected sensors, generating a great amount of observations at high rate. The advent of Industry 4.0 requires analysis capabilities of heterogeneous data in form of related multivariate time series. However, missing data can degrade processing and lead to bias and misunderstandings or even wrong decision-making. In this paper, a recurrent neural network-based denoising autoencoder is proposed for gap imputation in related multivariate time series, i.e., series that exhibit spatio-temporal correlations. The denoising autoencoder (DAE) is able to reproduce input missing data by learning to remove intentionally added gaps, while the recurrent neural network (RNN) captures temporal patterns and relationships among variables. For that reason, different unidirectional (simple RNN, GRU, LSTM) and bidirectional (BiSRNN, BiGRU, BiLSTM) architectures are compared with each other and to state-of-the-art methods using three different datasets in the experiments. The implementation with BiGRU layers outperforms the others, effectively filling gaps with a low reconstruction error. The use of this approach is appropriate for complex scenarios where several variables contain long gaps. However, extreme scenarios with very short gaps in one variable or no available data should be avoided. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
24. Unsupervised environmental operating condition compensation strategies in a guided ultrasonic wave monitoring system: evaluation and comparison.
- Author
-
Yon, Kong Chen, Bakhary, Norhisham, Padil, Khairul Hazman, and Shamsudin, Mohd Fairuz
- Abstract
Guided ultrasonic wave (GUW) monitoring systems are gaining much attention in pipeline condition monitoring. However, the effects of environmental and operational conditions (EOCs), especially temperature and random noise, degrade damage detection performance. When EOC effects produce greater amplitudes than the reflected waves from small damage cases, the reflected waves remain unidentified. This paper proposes an unsupervised learning-based denoising autoencoder (DAE) to reduce the effect of EOCs in GUW monitoring systems. A DAE decodes high-dimensional data into low-dimensional features and reconstructs the original data from these low-dimensional features. By providing GUW signals at a reference temperature, this structure forces the DAE to learn the essential features hidden within complex data. The proposed DAE undergoes comparative analysis with other popular unsupervised learning algorithms used for EOC compensation in GUW monitoring systems, such as principal component analysis, independent component analysis and deep autoencoder algorithms. EOC compensation performance is evaluated through receiver operating characteristics (ROC). From the numerical model and an experimental model, the GUW database is obtained. All four algorithms showed good damage detection performance using a numerical model; however, in the experimental model, the proposed DAE showed superiority among other methods. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
25. An Efficient Convolutional Denoising Autoencoder-Based BDS NLOS Detection Method in Urban Forest Environments.
- Author
-
Yahang Qin, Zhenni Li, Shengli Xie, Haoli Zhao, and Qianming Wang
- Abstract
The BeiDou Navigation Satellite System (BDS) provides real-time absolute location services to users around the world and plays a key role in the rapidly evolving field of autonomous driving. In complex urban environments, the positioning accuracy of BDS often suffers from large deviations due to non-line-of-sight (NLOS) signals. Deep learning (DL) methods have shown strong capabilities in detecting complex and variable NLOS signals. However, these methods still suffer from the following limitations. On the one hand, supervised learning methods require labeled samples for learning, which inevitably encounters the bottleneck of difficulty in constructing databases with a large number of labels. On the other hand, the collected data tend to have varying degrees of noise, leading to low accuracy and poor generalization performance of the detection model, especially when the environment around the receiver changes. In this article, we propose a novel deep neural architecture named convolutional denoising autoencoder network (CDAENet) to detect NLOS in urban forest environments. Specifically, we first design a denoising autoencoder based on unsupervised DL to reduce the long time series signal dimension and extract the deep features of the data. Meanwhile, denoising autoencoders improve the model’s robustness in identifying noisy data by introducing a certain amount of noise into the input data. Then, an MLP algorithm is used to identify the non-linearity of the BDS signal. Finally, the performance of the proposed CDAENet model is validated on a real urban forest dataset. The experimental results show that the satellite detection accuracy of our proposed algorithm is more than 95%, which is about an 8% improvement over existing machine-learning-based methods and about 3% improvement over deep-learning-based approaches. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
26. Effective multi-modal clustering method via skip aggregation network for parallel scRNA-seq and scATAC-seq data.
- Author
-
Hu, Dayu, Liang, Ke, Dong, Zhibin, Wang, Jun, Zhao, Yawei, and He, Kunlun
- Subjects
- *
TUMOR microenvironment , *CLUSTER analysis (Statistics) , *CHROMATIN , *GLOBAL method of teaching , *RNA sequencing - Abstract
In recent years, there has been a growing trend in the realm of parallel clustering analysis for single-cell RNA-seq (scRNA) and single-cell Assay of Transposase Accessible Chromatin (scATAC) data. However, prevailing methods often treat these two data modalities as equals, neglecting the fact that the scRNA mode holds significantly richer information compared to the scATAC. This disregard hinders the model benefits from the insights derived from multiple modalities, compromising the overall clustering performance. To this end, we propose an effective multi-modal clustering model scEMC for parallel scRNA and Assay of Transposase Accessible Chromatin data. Concretely, we have devised a skip aggregation network to simultaneously learn global structural information among cells and integrate data from diverse modalities. To safeguard the quality of integrated cell representation against the influence stemming from sparse scATAC data, we connect the scRNA data with the aggregated representation via skip connection. Moreover, to effectively fit the real distribution of cells, we introduced a Zero Inflated Negative Binomial-based denoising autoencoder that accommodates corrupted data containing synthetic noise, concurrently integrating a joint optimization module that employs multiple losses. Extensive experiments serve to underscore the effectiveness of our model. This work contributes significantly to the ongoing exploration of cell subpopulations and tumor microenvironments, and the code of our work will be public at https://github.com/DayuHuu/scEMC. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
27. MDGN: Circuit design of memristor‐based denoising autoencoder and gated recurrent unit network for lithium‐ion battery state of charge estimation
- Author
-
Jiayang Wang, Xinghao Zhang, Yifeng Han, Chun Sing Lai, Zhekang Dong, Guojin Ma, and Mingyu Gao
- Subjects
circuit design ,denoising autoencoder ,gated recurrent unit ,memristor ,state of charge estimation ,Renewable energy sources ,TJ807-830 - Abstract
Abstract Due to the highly complex and non‐linear physical dynamics of lithium‐ion batteries, it is unfeasible to measure the state of charge (SOC) directly. Designing systems capable of accurate SOC estimation has become a key technology for battery management systems (BMS). Existing mainstream SOC estimation approaches still suffer from the limitations of low efficiency and high‐power consumption, owing to the great number of samples required for training. To address these gaps, this paper proposes a memristor‐based denoising autoencoder and gated recurrent unit network (MDGN) for fast and accurate SOC estimation of lithium‐ion batteries. Specifically, the DAE circuit module is designed to extract useful feature representation with strong generalization and noise immunity. Then, the gated recurrent unit (GRU) circuit module is designed to learn the long‐term dependencies between high‐dimensional input and output data. The overall performance is evaluated by root mean square error (RMSE) and mean absolute error (MAE) at 0, 25, and 45°C, respectively. Compared with the current state‐of‐the‐art methods, the entire scheme shows its superior performance in accuracy, robustness, and operation cost (referring to time cost).
- Published
- 2024
- Full Text
- View/download PDF
28. Intrusion Detection in IoT Systems Using Denoising Autoencoder
- Author
-
Fatma S. Alrayes, Mohammed Zakariah, Syed Umar Amin, Zafar Iqbal Khan, and Maha Helal
- Subjects
Intrusion detection system ,Internet of Things ,machine learning ,CICIDS2017 dataset ,denoising autoencoder ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Protection against unwanted intrusions is crucial for preserving the integrity and security of connected devices in the context of Internet of Things (IoT) networks. The growing number of IoT devices has made several industries more vulnerable to cyberattacks and security breaches, including smart homes, industrial automation, and healthcare. In response to this pressing dilemma, the goal of this project is to create a novel method for intrusion detection in Internet of Things systems utilizing Denoising Autoencoder (DAE) models. Traditional intrusion detection methods often prove inadequate in Internet of Things scenarios due to resource restrictions, dynamic network topologies, and a diversity of communication protocols. By utilizing DAEs’ unsupervised learning and feature extraction skills, our suggested approach creates a system that can identify and stop intrusion attempts in real-time. The evaluation of the study additionally makes use of the NSL-KDD and CICIDS 2017 datasets. DAE integration yields an unequaled accuracy of 99.991% when the CICIDS 2017 dataset is used, and an accuracy of 99.4% when the NSL-KDD dataset is used. The CICIDS 2017 dataset analysis reveals several notable performance measures, including an accuracy of 1.0, a precision of 0.995, and an F1-score of 0.998. Analyses of the NSL-KDD dataset also produce outstanding results, with an F1-score of 0.989, recall of 0.991, accuracy of 0.994, and precision of 0.984. The results also show how well the suggested DAE-based intrusion detection method works to stop unauthorized users from accessing IoT devices, which lowers the risk of issues with system integrity, privacy, and security. By strengthening resilience against evolving cyber threats in the networked Internet of Things landscape, this research enhances cybersecurity strategies tailored to address the unique challenges encountered by IoT ecosystems.
- Published
- 2024
- Full Text
- View/download PDF
29. Accurate noise-robust classification of Bacillus species from MALDI-TOF MS spectra using a denoising autoencoder
- Author
-
Uvarova Yulia E., Demenkov Pavel S., Kuzmicheva Irina N., Venzel Artur S., Mischenko Elena L., Ivanisenko Timofey V., Efimov Vadim M., Bannikova Svetlana V., Vasilieva Asya R., Ivanisenko Vladimir A., and Peltek Sergey E.
- Subjects
classification of bacillus species ,maldi-tof ,denoising autoencoder ,random forest ,Biotechnology ,TP248.13-248.65 - Abstract
Bacillus strains are ubiquitous in the environment and are widely used in the microbiological industry as valuable enzyme sources, as well as in agriculture to stimulate plant growth. The Bacillus genus comprises several closely related groups of species. The rapid classification of these remains challenging using existing methods. Techniques based on MALDI-TOF MS data analysis hold significant promise for fast and precise microbial strains classification at both the genus and species levels. In previous work, we proposed a geometric approach to Bacillus strain classification based on mass spectra analysis via the centroid method (CM). One limitation of such methods is the noise in MS spectra. In this study, we used a denoising autoencoder (DAE) to improve bacteria classification accuracy under noisy MS spectra conditions. We employed a denoising autoencoder approach to convert noisy MS spectra into latent variables representing molecular patterns in the original MS data, and the Random Forest method to classify bacterial strains by latent variables. Comparison of the DAE-RF with the CM method using the artificially noisy test samples showed that DAE-RF offers higher noise robustness. Hence, the DAE-RF method could be utilized for noise-robust, fast, and neat classification of Bacillus species according to MALDI-TOF MS data.
- Published
- 2023
- Full Text
- View/download PDF
30. Deep Learning-Based Ultrasound Image Despeckling by Noise Model Estimation
- Author
-
O. Mahmoudi Mehr, M. R. Mohammadi, and M. Soryani
- Subjects
denoising autoencoder ,inception convolutional neural network ,speckle noise estimation ,ultrasound image denoising. ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Speckle noise is an inherent artifact appearing in medical images that significantly lowers the quality and accuracy of diagnosis and treatment. Therefore, speckle reduction is considered as an essential step before processing and analyzing the ultrasound images. In this paper, we propose an ultrasound speckle reduction method based on speckle noise model estimation using a deep learning architecture called “speckle noise-based inception convolutional denoising neural network" (SNICDNN). Regarding the complicated nature of speckle noise, an inception module is added to the first layer to boost the power of feature extraction. Reconstruction of the despeckled image is performed by introducing a mathematical method based on solving a quadratic equation and applying an image-based inception convolutional denoising autoencoder (IICDAE). The results of various quantitative and qualitative evaluations on real ultrasound images demonstrate that SNICDNN outperforms the state-of-the-art methods for ultrasound despeckling. SNICDNN achieves 0.4579 dB and 0.0100 additional gains on average for PSNR and SSIM, respectively, compared to other methods. Denoising ultrasound based on its noise model estimation is not only a novel approach in comparison to traditional denoising autoencoder models but also due to the fact that it uses mathematical solutions to recover denoised images, SNICDNN shows a greater power in ultrasound despeckling.
- Published
- 2023
31. Enhancing non-intrusive load monitoring with weather and calendar feature integration in DAE
- Author
-
Zengxin Pu, Yu Huang, Min Weng, Yang Meng, Yunbin Zhao, and Gengsheng He
- Subjects
deep learning ,non-intrusive load monitoring ,denoising autoencoder ,weather feature ,calendar feature ,General Works - Abstract
The construction of modern power system is key to achieving dual carbon goals, where non-intrusive load monitoring (NILM) plays a vital role in enhancing energy utilization efficiency and energy management. For example, to enable prosumers to better understand the extent of their flexible loads for demand response and peer-to-peer trading, it is essential to be aware of the types and states of loads using the method of NILM. To improve the predictive accuracy and implementation effectiveness of NILM technology, this paper proposes a novel NILM method integrating meteorological and calendar features. It delves deeply into the close connection between external factors such as temperature, precipitation, wind speed, and holidays, and the energy consumption of electrical appliances, constructing additional associative mappings in the training of the Denoising Autoencoder (DAE) model. Test results on the UK-DALE public dataset show that the NILM method proposed in this paper has significant advantages over traditional NILM methods that consider only single-dimensional electrical data features, in terms of load pattern recognition and accuracy in load energy consumption monitoring. This confirms the potential of multi-dimensional feature fusion technology in the application of NILM.
- Published
- 2024
- Full Text
- View/download PDF
32. MDGN: Circuit design of memristor‐based denoising autoencoder and gated recurrent unit network for lithium‐ion battery state of charge estimation.
- Author
-
Wang, Jiayang, Zhang, Xinghao, Han, Yifeng, Lai, Chun Sing, Dong, Zhekang, Ma, Guojin, and Gao, Mingyu
- Subjects
IMAGE denoising ,STANDARD deviations ,BATTERY management systems ,LITHIUM-ion batteries - Abstract
Due to the highly complex and non‐linear physical dynamics of lithium‐ion batteries, it is unfeasible to measure the state of charge (SOC) directly. Designing systems capable of accurate SOC estimation has become a key technology for battery management systems (BMS). Existing mainstream SOC estimation approaches still suffer from the limitations of low efficiency and high‐power consumption, owing to the great number of samples required for training. To address these gaps, this paper proposes a memristor‐based denoising autoencoder and gated recurrent unit network (MDGN) for fast and accurate SOC estimation of lithium‐ion batteries. Specifically, the DAE circuit module is designed to extract useful feature representation with strong generalization and noise immunity. Then, the gated recurrent unit (GRU) circuit module is designed to learn the long‐term dependencies between high‐dimensional input and output data. The overall performance is evaluated by root mean square error (RMSE) and mean absolute error (MAE) at 0, 25, and 45°C, respectively. Compared with the current state‐of‐the‐art methods, the entire scheme shows its superior performance in accuracy, robustness, and operation cost (referring to time cost). [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
33. Efficient ensemble to combat flash attacks.
- Author
-
C.U, Om Kumar and Sathia Bhama, Ponsy R. K.
- Subjects
- *
CONVOLUTIONAL neural networks , *DEEP learning , *CONTENT delivery networks , *CLOUD computing , *FEATURE extraction - Abstract
Flash event generates enormous traffic and the cloud service providers use sustaining techniques like scaling and content delivery network to up their services. One of the main bottlenecks that the cloud service providers still find difficult to tackle is flash attacks. Illegitimate users send craftily designed packets to land up inside the server for wreaking havoc. As deep learning autoencoder has the potential to detect malicious traffic it has been used in this research study to develop an ensemble. Convolutional neural network is efficacious in overcoming the issue of overfitting; deep autoencoder is proficient in extracting features through dimensionality reduction. In order to obtain both these advantages it was decided to develop an ensemble keeping denoising autoencoder as the core element. The process of addressing a flash attack requires first detecting the presence of bot in malicious traffic, second studying its nature by observing its behavioral manifestations. Detection of botnet was achieved by three ensembles, namely, DAE_CNN, DAE_MLP, and DAE_XGB. But capturing its external manifested behavior is challenging, because the bot signatures are always in a state of flux. The simulated empirical study yielded an appreciable outcome. Its accuracy rate was 99.9% for all the three models and the false positive rates were 0, 0.006, and 0.001, respectively. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
34. IMDAC: A robust intelligent software defect prediction model via multi‐objective optimization and end‐to‐end hybrid deep learning networks.
- Author
-
Zhu, Kun, Zhang, Nana, Jiang, Changjun, and Zhu, Dandan
- Subjects
DEEP learning ,CONVOLUTIONAL neural networks ,PREDICTION models ,EVOLUTIONARY algorithms ,ARTIFICIAL intelligence ,SOFT computing - Abstract
Software defect prediction (SDP) aims to build an effective prediction model for historical defect data from software repositories by some specialized techniques or algorithms, and predict the defect proneness of new software modules. Nevertheless, the complex internal intrinsic structure hidden behind the defect data makes it challenging for the built prediction model to capture the most expressive defect feature representations, and largely limits the SDP performance. Fortunately, artificial intelligence is interacting closely with humans and provides powerful intelligent technical support for addressing these SDP issues. In this article, we propose a robust intelligent SDP model called IMDAC based on deep learning and soft computing techniques. This model has three main advantages: (1) an effective deep generative network—InfoGAN (information maximizing GANs) is employed to conduct data augmentation, namely generating sufficient defect instances and achieving defect class balance simultaneously. (2) Select the fewest representative feature subset for the minimum error via an advanced multi‐objective optimization approach—MSEA (multi‐stage evolutionary algorithm). (3) Build a powerful end‐to‐end deep defect predictor by hybrid deep learning techniques—DAE (Denoising AutoEncoder) and CNN (convolutional neural network), which can not only reconstruct a clean "repaired" input with strong robustness and generalization capabilities via DAE, but also learn the abstract deep semantic features with strong discriminating capability via CNN. Experimental results verify the superiority and robustness of the IMDAC model across 15 software projects. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
35. Bi-channel hybrid GAN attention based anomaly detection system for multi-domain SDN environment.
- Author
-
Prabu, Saranya and Padmanabhan, Jayashree
- Subjects
- *
ANOMALY detection (Computer security) , *SUPERVISED learning , *DEEP learning , *GENERATIVE adversarial networks , *SOFTWARE-defined networking - Abstract
Software-Defined Networking (SDN) is a strategy that leads the network via software by separating its control plane from the underlying forwarding plane. In support of a global digital network, multi-domain SDN architecture emerges as a viable solution. However, the complex and ever-evolving nature of network threats in a multi-domain environment presents a significant security challenge for controllers in detecting abnormalities. Moreover, multi-domain anomaly detection poses a daunting problem due to the need to process vast amounts of data from diverse domains. Deep learning models have gained popularity for extracting high-level feature representations from massive datasets. In this work, a novel deep neural network architecture, supervised learning based LD-BiHGA (Low Dimensional Bi-channel Hybrid GAN Attention) system is designed to learn class-specific features for accurate anomaly detection. Two asymmetric GANs are employed for learning the normal and abnormal network flows separately. Then, to extract more relevant features, a bi-channel attention mechanism is added. This is the first study to introduce an innovative hybrid architecture that merges bi-channel hybrid GANs with attention models for the purpose of anomaly detection in a multi-domain SDN environment that effectively handles real-time unbalanced data. The suggested architecture demonstrates its effectiveness on three benchmark datasets, achieving an average accuracy improvement of 7.225% on balanced datasets and 3.335% on imbalanced datasets compared to previous intrusion detection system (IDS) architectures in the literature. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
36. Research on a Non-Intrusive Load Recognition Algorithm Based on High-Frequency Signal Decomposition with Improved VI Trajectory and Background Color Coding †.
- Author
-
Shi, Jiachuan, Zhi, Dingrui, and Fu, Rao
- Subjects
- *
CONVOLUTIONAL neural networks , *COLOR codes , *OPTIMIZATION algorithms , *CARBON offsetting , *ALGORITHMS - Abstract
Against the backdrop of the current Chinese national carbon peak and carbon neutrality policies, higher requirements have been put forward for the construction and upgrading of smart grids. Non-intrusive Load Monitoring (NILM) technology is a key technology for advanced measurement systems at the end of the power grid. This technology obtains detailed power information about the load without the need for traditional hardware deployment. The key step to solve this problem is load decomposition and identification. This study first utilized the Long Short-Term Memory Denoising Autoencoder (LSTM-DAE) to decompose the mixed current signal of a household busbar and obtain the current signals of the multiple independent loads that constituted the mixed current. Then, the obtained independent current signals were combined with the voltage signals to generate multicycle colored Voltage–Current (VI) trajectories, which were color-coded according to the background. These color-coded VI trajectories formed a feature library. When the Convolutional Neural Network (CNN) was used for load recognition, in light of the influence of the hyperparameters on the recognition results, the Bayesian Optimization Algorithm (BOA) was used for optimization, and the optimized CNN network was employed for VI trajectory recognition. Finally, the proposed method was validated using the PLAID dataset. The experimental results show that the proposed method exhibited better performance in load decomposition and identification than current methods. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
37. Towards the Analysis of Regularized Denoising Autoencoder for Biosignal Processing: Lasso Versus Ridge Norms.
- Author
-
Dasan, Evangelin and Jeyabalan, Nelson Samuel Jebastin
- Subjects
ARTIFICIAL implants ,INTELLIGENT sensors ,COST functions ,NANOSENSORS ,DATA compression ,DATABASES - Abstract
The use of Internet of Things (IoT) that integrate smart bio sensor devices to the internet and shows individual health in real time. Healthcare organizations gain measurable insights into their most demanding problems like chronic diseases which demands long term monitoring. Various types of nano-sensors like Ingestible embedded in pills, Blood sampling sensor and tissue sensors are used in Healthcare IoT. Such implantable device collects, process and sends the vital signs called biosignals from particular organ of the human body where it has been implanted or fixed throughout the day to remote clinician. Such prolonged monitoring may weaken the battery power of nano-sensors. Since nano-sensors are miniaturized in nature and completely relies on its battery, energy awareness is incorporated in this paradigm that can help to avoid unnecessary energy consumption. This is achieved by data compression scheme. As the nano-sensors are light weight devices the designed algorithm should be low complex as well as efficient. As well, the signal acquired through this wireless sensor device are prone to be contaminated with noises because of the wearer's movements. In this study, regularized denoising autoencoder (DAE) has been employed to compress and recover the signal from its noisy version. Lasso (Least Absolute Shrinkage and Selection Operator) and Ridge regularization concepts are used and contrasted in this article. The cost function now includes these penalty clauses to address the overfitting problem. The experimental findings demonstrate that LASSO Norm has outperformed over RIDGE in 18% for ECG, 57% for EMG & 31% for EEG signal with respect to Quality Score. The datasets used in this investigation were taken from a database that was open to the public for testing. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
38. Denoising Masked Autoencoder-Based Missing Imputation within Constrained Environments for Electric Load Data.
- Author
-
Jeong, Jaeik, Ku, Tai-Yeon, and Park, Wan-Ki
- Subjects
- *
MULTIPLE imputation (Statistics) , *MISSING data (Statistics) , *ENERGY consumption , *MACHINE learning , *ACQUISITION of data , *CLASSROOM environment - Abstract
With recent advancements in data technologies, particularly machine learning, research focusing on the enhancement of energy efficiency in residential, commercial, and industrial settings through the collection of load data, such as heat, electricity, and gas, has gained significant attention. Nevertheless, issues arising from hardware- or network-related problems can result in missing data, necessitating the development of management techniques to mitigate these challenges. Traditional methods for missing imputation face difficulties when operating in constrained environments characterized by short data collection periods and frequent consecutive missing. In this paper, we introduce the denoising masked autoencoder (DMAE) model as a solution to improve the handling of missing data, even in such restrictive settings. The proposed DMAE model capitalizes on the advantages of the denoising autoencoder (DAE), enabling effective learning of the missing imputation process, even with relatively small datasets, and the masked autoencoder (MAE), allowing for learning in environments with a high missing ratio. By integrating these strengths, the DMAE model achieves an enhanced performance in terms of missing imputation. The simulation results demonstrate that the proposed DMAE model outperforms the DAE or MAE significantly in a constrained environment where the duration of the training data is short, less than a year, and missing values occur frequently with durations ranging from 3 h to 12 h. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
39. Robust Spoofed Speech Detection with Denoised I-vectors.
- Author
-
DISKEN, Gokay
- Subjects
- *
SPEECH , *AUTOMATIC speech recognition , *SPEECH enhancement , *SPEECH synthesis , *SIGNAL-to-noise ratio , *DATABASES - Abstract
Spoofed speech detection is recently gaining attention of the researchers as speaker verification is shown to be vulnerable to spoofing attacks such as voice conversion, speech synthesis, replay, and impersonation. Although various different methods have been proposed to detect spoofed speech, their performances decrease dramatically under the mismatched conditions due to the additive or reverberant noises. Conventional speech enhancement methods fail to recover the performance gap, hence more advanced techniques seem to be necessary to solve the noisy spoofed speech detection problem. In this work, Denoising Autoencoder (DAE) is used to obtain clean estimates of i-vectors from their noisy versions. ASVspoof 2015 database is used in the experiments with five different noise types, added to the original utterances at 0, 10, and 20 dB signal-to-noise ratios (SNR). The experimental results verified that the DAE provides a more robust spoof detection, where the conventional methods fail. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
40. Security in IoT Applications Using Markov’s Fusion-based MM Ring Toss Blockchain.
- Author
-
SATHISH, C. and RUBAVATHI, C. YESUBAI
- Subjects
RADIAL basis functions ,BLOCKCHAINS ,INTERNET of things ,DATA security ,MARKOV processes ,DATA transmission systems - Abstract
The Internet of Things (IoT) links different gadgets together and enables data transmission, device tracking, and device monitoring. Blockchainbased solutions are being developed to guarantee security in IoT devices, but they have a number of drawbacks. To increase data security and prevent inaccurate data detection, we propose a novel model named Markov’s Fusion-based MM Ring Toss Blockchain. In this novel model, an innovative Fusion-Based Deep Multimodal with Radial Basis Function Neural Network (FBMR-BFNN) is utilized in which Multilayer Perceptron (MLP) with Global Max Pooling Layer eliminates overfitting of data to increase execution and packing time. In order to prevent false data detection, the corrupted input data is rebuilt by a Denoising Auto Encoder (DAE), which is then supplied to a Radial Basis Function Neural Network (RBNN). The absence of identifying capabilities, the inability to determine whether the same user or a hacker is operating the system for an extended period of time, and insufficient authorization methods made the existing systems vulnerable to inadequate security. In order to prevent any unauthorized data usage and achieve a successful second-stage authorization mechanism without data loss, a unique Markov Ring Toss VGBO technique is developed. This proposed method have superior security, efficient authorization and verification system, reduced packaging and execution times, and greater hash rates. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
41. Enhancing Context-Aware Recommendation Using Trust-Based Contextual Attentive Autoencoder.
- Author
-
Abinaya, S., Alphonse, A. Sherly, Abirami, S., and Kavithadevi, M. K.
- Subjects
RECOMMENDER systems ,DEEP learning ,TRUST ,DYNAMIC models - Abstract
Context-aware recommender systems are intended primarily to consider the circumstances under which a user encounters an item to provide better-personalized recommendations. Users acquire point-of-interest, movies, products, and various online resources as suggestions. Classical collaborative filtering algorithms are shown to be satisfactory in a variety of recommendation activities processes, but cannot often capture complicated interactions between item and user, along with sparsity and cold start constraints. Hence it becomes a surge to apply a deep learning-based recommender model owing to its dynamic modeling potential and sustained success in other fields of application. In this work, a trust-based attentive contextual denoising autoencoder (TACDA) for enhanced Top-N context-aware recommendation is proposed. Specifically, the TCADA model takes the sparse preference of the user that is integrated with trust data as input into the autoencoder to prevail over the cold start and sparsity obstacle and efficiently accumulates the context condition into the model via attention framework. Thereby, the attention technique is used to encode context features into a latent space of the user's trust data that is integrated with their preferences, which interconnects personalized context circumstances with the active user's choice to deliver recommendations suited to that active user. Experiments conducted on Epinions, Caio, and LibraryThing datasets make it obvious the efficiency of the TACDA model persistently outperforms the state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
42. A denoising semi-supervised deep learning model for remaining useful life prediction of turbofan engine degradation.
- Author
-
Wang, Youming and Wang, Yue
- Subjects
REMAINING useful life ,DEEP learning ,CONVOLUTIONAL neural networks ,TURBOFAN engines ,SUPERVISED learning ,STANDARD deviations ,FEATURE extraction - Abstract
Remaining useful life (RUL) prediction is significant for reliability analysis and the reduction of maintenance costs for turbofan engine systems. However, most of the existing methods capture temporal or spatial features to predict RUL, which leads to the neglect of deep spatio-temporal correlation in the prediction data. In addition, there are usually noise interference and few labels in feature extraction, which causes difficulty in designing robust RUL prediction models. To address these problems, a denoised semi-supervised model based on fully convolutional denoising autoencoder, convolutional neural network, and long short-term memory network (FCDAE-CNN-LSTM) is proposed to predict RUL, where FCDAE is constructed to denoise the original data by parameter fine-tuning and CNN-LSTM is established based on parallel connection for RUL prognosis. The denoising and generalization capabilities of the RUL prediction model are enhanced by the combination of unsupervised denoising and supervised feature extraction in the case of few labeled training data. The superior features of the method lie in that FCDAE effectively captures globalized and localized features and CNN-LSTM captures multi-layer fused spatial–temporal correlations. The Root Mean Square Error (RMSE) and Score of the proposed method on C-MAPSS dataset are 12.01, 16.62, 11.84, 18.21, and 209.44, 1466.03, 205.07, 2338.93, respectively, which have demonstrated that our method achieves the state-of-the-art performance and outperforms other models. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
43. Parallel multi-head attention and term-weighted question embedding for medical visual question answering.
- Author
-
Manmadhan, Sruthy and Kovoor, Binsu C
- Subjects
FEATURE extraction ,IMAGE representation ,DIAGNOSTIC imaging ,ATTENTION - Abstract
The goal of medical visual question answering (Med-VQA) is to correctly answer a clinical question posed by a medical image. Medical images are fundamentally different from images in the general domain. As a result, using general domain Visual Question Answering (VQA) models to the medical domain is impossible. Furthermore, the large-scale data required by VQA models is rarely available in the medical arena. Existing approaches of medical visual question answering often rely on transfer learning with external data to generate good image feature representation and use cross-modal fusion of visual and language features to acclimate to the lack of labelled data. This research provides a new parallel multi-head attention framework (MaMVQA) for dealing with Med-VQA without the use of external data. The proposed framework addresses image feature extraction using the unsupervised Denoising Auto-Encoder (DAE) and language feature extraction using term-weighted question embedding. In addition, we present qf-MI, a unique supervised term-weighting (STW) scheme based on the concept of mutual information (MI) between the word and the corresponding class label. Extensive experimental findings on the VQA-RAD public medical VQA benchmark show that the proposed methodology outperforms previous state-of-the-art methods in terms of accuracy while requiring no external data to train the model. Remarkably, the presented MaMVQA model achieved significantly increased accuracy in predicting answers to both close-ended (78.68%) and open-ended (55.31%) questions. Also, an extensive set of ablations are studied to demonstrate the significance of individual components of the system. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
44. Deep Learning-Based Ultrasound Image Despeckling by Noise Model Estimation.
- Author
-
Mehr, O. Mahmoudi, Mohammadi, M. R., and Soryani, M.
- Subjects
DEEP learning ,ULTRASONIC imaging ,SIGNAL denoising ,FEATURE extraction ,QUADRATIC equations - Abstract
Speckle noise is an inherent artifact appearing in medical images that significantly lowers the quality and accuracy of diagnosis and treatment. Therefore, speckle reduction is considered as an essential step before processing and analyzing the ultrasound images. In this paper, we propose an ultrasound speckle reduction method based on speckle noise model estimation using a deep learning architecture called "speckle noise-based inception convolutional denoising neural network" (SNICDNN). Regarding the complicated nature of speckle noise, an inception module is added to the first layer to boost the power of feature extraction. Reconstruction of the despeckled image is performed by introducing a mathematical method based on solving a quadratic equation and applying an image-based inception convolutional denoising autoencoder (IICDAE). The results of various quantitative and qualitative evaluations on real ultrasound images demonstrate that SNICDNN outperforms the state-of-the-art methods for ultrasound despeckling. SNICDNN achieves 0.4579 dB and 0.0100 additional gains on average for PSNR and SSIM, respectively, compared to other methods. Denoising ultrasound based on its noise model estimation is not only a novel approach in comparison to traditional denoising autoencoder models but also due to the fact that it uses mathematical solutions to recover denoised images, SNICDNN shows a greater power in ultrasound despeckling. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
45. Semisupervised fault diagnosis of aeroengine based on denoising autoencoder and deep belief network
- Author
-
Lv, Defeng, Wang, Huawei, and Che, Changchang
- Published
- 2022
- Full Text
- View/download PDF
46. Self-supervised fusion of deep soft assignments for multi-view diagnosis of machine faults
- Author
-
Li, Chuan, Wu, Yifan, Xiong, Manjun, Yang, Shuai, and Bai, Yun
- Published
- 2024
- Full Text
- View/download PDF
47. Microscopic biopsy image reconstruction using inception block with denoising auto-encoder approach
- Author
-
Singh, Shiksha and Kumar, Rajesh
- Published
- 2024
- Full Text
- View/download PDF
48. An End-to-End Deep Learning Framework for Real-Time Denoising of Heart Sounds for Cardiac Disease Detection in Unseen Noise
- Author
-
Shams Nafisa Ali, Samiul Based Shuvo, Muhammad Ishtiaque Sayeed Al-Manzo, Anwarul Hasan, and Taufiq Hasan
- Subjects
Heart sound ,real time denoising ,deep learning ,denoising autoencoder ,cardiovascular diseases ,cardiac disease detection ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
The heart sound signals captured via a digital stethoscope are often distorted by environmental and physiological noise, altering their salient and critical properties. The problem is exacerbated in crowded low-resource hospital settings with high noise levels which degrades the diagnostic performance. In this study, we present a novel deep encoder-decoder-based denoising architecture (LU-Net) to suppress ambient and internal lung sound noises. Training is done using a large benchmark PCG dataset mixed with physiological noise, i.e., breathing sounds. Two different noisy datasets were prepared for experimental evaluation by mixing unseen lung sounds and hospital ambient noises with the clean heart sound recordings. We also used the inherently noisy portion of the PASCAL heart sound dataset for evaluation. The proposed framework showed effective suppression of background noises in both unseen real-world data and synthetically generated noisy heart sound recordings, improving the signal-to-noise ratio (SNR) level by 5.575 dB on an average using only 1.32 M parameters. The proposed model outperforms the current state-of-the-art U-Net model with an average SNR improvement of 5.613 dB and 5.537 dB in the presence of lung sound and unseen hospital noise, respectively. LU-Net also outperformed the state-of-the-art Fully Convolutional Network (FCN) by 1.750 dB and 1.748 dB for lung sound and unseen hospital noise conditions, respectively. In addition, the proposed denoising method model improves classification accuracy by 38.93% in the noisy portion of the PASCAL heart sound dataset. The results presented in the paper indicate that our proposed architecture demonstrated a robust denoising performance on different datasets with diverse levels and characteristics of noise. The proposed deep learning-based PCG denoising approach is a pioneering study that can significantly improve the accuracy of computer-aided auscultation systems for detecting cardiac diseases in noisy, low-resource hospitals and underserved communities.
- Published
- 2023
- Full Text
- View/download PDF
49. Intelligent Identification of Simultaneous Faults of Automotive Software Systems Under Noisy and Imbalanced Data Using Ensemble LSTM and Random Forest
- Author
-
Mohammad Abboush, Christoph Knieke, and Andreas Rausch
- Subjects
Automotive software systems ,fault detection and diagnosis ,deep learning ,denoising autoencoder ,LSTM ,random forest ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
According to ISO 26262 standard, functional validation of the developed Automotive Software Systems (ASSs) is crucial to ensure the safety and reliability aspects. Hardware-in-the-loop (HIL) has been introduced as a reliable, safe and flexible test platform to enable the validation process in real-time. However, the traditional failure analysis process of HIL tests is time-consuming, extremely difficult and requires considerable effort. Therefore, an intelligent solution that can overcome the above challenges is required. Following a data-driven approach, the development of deep learning methods for fault detection and classification has gradually become a hot topic. However, despite the fruitful results, most of the previous studies were conducted for single faults without considering the simultaneous occurrence of multiple faults and ignoring the noisy conditions. In this study, based on multi-label ensemble long short term memory (LSTM) and random forest (RF) techniques, a novel method for simultaneous fault classification under noisy conditions is developed. To improve the robustness of the model against noise, a GRU-based denoising autoencoder (DAE) was implemented. Furthermore, to overcome the challenge of imbalanced data, a random undersampling algorithm was employed. By doing so, the single and simultaneous sensor faults occurring during HIL testing of ASSs can be efficiently and automatically detected and identified. To evaluate the capabilities and robustness of the proposed method, a high-fidelity gasoline engine with a dynamic vehicle system and driving environment was used as a case study. The analysis results demonstrate that the proposed model can achieve a high degree of accuracy under noise with an average detection accuracy of 99.43%. Moreover, compared to the individual methods, the proposed ensemble learning architecture with DAE provides more promising fault identification performance with improved accuracy and robustness. Specifically, the test results show that the proposed model is superior to other state-of-the-art models in identifying simultaneous faults with 91.2% F1-Score.
- Published
- 2023
- Full Text
- View/download PDF
50. Multi-Objective Optimization Method for Signalized Intersections in Intelligent Traffic Network.
- Author
-
Zhang, Xinghui, Fan, Xiumei, Yu, Shunyuan, Shan, Axida, and Men, Rui
- Subjects
- *
SIGNALIZED intersections , *INTELLIGENT networks , *OPTIMIZATION algorithms , *ROAD interchanges & intersections , *TRAFFIC congestion , *TRAFFIC flow - Abstract
Urban intersections are one of the most common sources of traffic congestion. Especially for multiple intersections, an appropriate control method should be able to regulate the traffic flow within the control area. The intersection signal-timing problem is crucial for ensuring efficient traffic operations, with the key issues being the determination of a traffic model and the design of an optimization algorithm. So, an optimization method for signalized intersections integrating a multi-objective model and an NSGAIII-DAE algorithm is established in this paper. Firstly, the multi-objective model is constructed including the usual signal control delay and traffic capacity indices. In addition, the conflict delay caused by right-turning vehicles crossing straight-going non-motor vehicles is considered and combined with the proposed algorithm, enabling the traffic model to better balance the traffic efficiency of intersections without adding infrastructure. Secondly, to address the challenges of diversity and convergence faced by the classic NSGA-III algorithm in solving traffic models with high-dimensional search spaces, a denoising autoencoder (DAE) is adopted to learn the compact representation of the original high-dimensional search space. Some genetic operations are performed in the compressed space and then mapped back to the original search space through the DAE. As a result, an appropriate balance between the local and global searching in an iteration can be achieved. To validate the proposed method, numerical experiments were conducted using actual traffic data from intersections in Jinzhou, China. The numerical results show that the signal control delay and conflict delay are significantly reduced compared with the existing algorithm, and the optimal reduction is 33.7% and 31.3%, respectively. The capacity value obtained by the proposed method in this paper is lower than that of the compared algorithm, but it is also 11.5% higher than that of the current scheme in this case. The comparisons and discussions demonstrate the effectiveness of the proposed method designed for improving the efficiency of signalized intersections. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.