Search

The accidental leakage of gaseous hydrogen from hydrogen refueling station facilities has the potential to result in a large fire and explosion catastrophe. The ability to forecast the spatiotemporal evolution of hydrogen plumes in real-time is crucial for monitoring the distribution of plume concentrations and mitigating the risk of fire and explosion. The utilization of deep learning has been extensively employed in a diverse range of spatiotemporal forecasting tasks. However, these approaches encounter limitations in accurately quantifying uncertainty when predicting spatiotemporal concentrations and plume boundaries. This research paper introduces a novel model called DPSTNN_H 2 Evolution, which is a deep probabilistic spatial-temporal neural network designed for forecasting the spatiotemporal evolution of hydrogen plumes. The benchmark dataset is constructed by the implementation of numerical simulations pertaining to the inadvertent leak of hydrogen within a hydrogen refueling station. The findings of the study indicate that incorporating quantified uncertainty information might enhance the precision of plume boundaries and the resilience of plume concentrations when predicting the spatiotemporal development of hydrogen. By employing Monte Carlo sampling with a sample size of m = 100 and a dropout rate of p = 0.1 , the model demonstrates the ability to provide real-time inference for 10 instances of plumes, while maintaining a high level of accuracy with R2 = 0.9829. In comparison to the current state-of-the-art model, the proposed model demonstrates superior accuracy and robustness in forecasting the spatiotemporal evolution of hydrogen plumes. In general, our proposed model has the potential to serve as a dependable option for the development of a digital twin for emergency management of hydrogen refueling stations. • Probabilistic spatial-temporal neural network model for hydrogen plume evolutions is proposed. • Normalized uncertainty contours and uncertainty intervals to improve accuracy and robustness. • Numerical experiment of hydrogen leakage and dispersion in refueling station are conducted. • Optimal hyper-parameters of the proposed model are determined • Comparison between the proposed model with point-estimation based model is conducted [ABSTRACT FROM AUTHOR]

The rapier loom works in a complex environment and operates at high speeds. It is inevitable that its performance will deteriorate during the production process, which in turn will cause faults. The development of maintenance has undergone the transition from "regular maintenance" and "post-event maintenance" to "predictive maintenance". In order to achieve the synergistic optimization goal of ensuring operational safety and reducing operational costs, a predictive maintenance method driven by the fusion of digital twin and deep learning is proposed based on the idea of "combining the real with the virtual and controlling the real". Firstly, a digital twin system structure model of rapier weaving machine is constructed, and the overall architecture of digital twin is proposed according to the full operation cycle of rapier weaving machine. Then, the digital twin-driven process parameter evaluation and prediction and health state evaluation and prediction are investigated separately. In order to achieve the evaluation and prediction of process parameters to ensure the efficiency of weaving machine operation, the prediction method of IWOA optimized BP neural network driven by twin data is proposed and the model is updated and optimized based on the martingale distance approach. In order to achieve health state assessment and prediction, we use health index as an evaluation index to characterize the health condition of spindles, and use BiLSTM network to achieve prediction of remaining spindle life and then make maintenance decisions. The results show that there are greater advantages to combining deep learning and digital twin technology for intelligent predictive maintenance of rapier loom. [ABSTRACT FROM AUTHOR]

With the development of collaborative edge computing (CEC), the manufacturing market is gradually moving toward large-scale, multi-scenario, and dynamic directions. The existing scheduling strategies based on machine learning or deep learning are only applicable to specific scenarios, which is difficult to meet the requirements of dynamic real-time scheduling in multiple scenarios. The proposed digital twin technology provides a new solution for real-time scheduling of multiple scenarios. In this paper, a digital twin-oriented multi-scene real-time scheduler (GNN-RL) is proposed. This scheduler converts task sequences into node trees and sets up two learning layers. The first layer is an online learning representation layer, which uses GNN to learn node features of embedded structures in real time to boost large instances without additional training. The second layer is the online learning policy layer, which introduces imitation learning mappings into optimal scheduling behavior policies adapted to multiple scenarios. Finally, our approach is validated in several scenarios in 3D digital twin factories, such as computationally intensive, delay-sensitive, and task-urgent scenarios. Since the scheduler proposed in this paper learns general features of the embedding graph rather than instance-specific features, it has good generality and scalability, with good generalization and scalability, outperforming other scheduling rules and schedulers on various benchmarks. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in terms of diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish the digital representation of a patient's respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-rays into five distinct categories of lung diseases, including "normal", "covid", "lung_opacity", "pneumonia", and "tuberculosis". The performance of the system was evaluated employing a chest X-ray dataset available in the literature, demonstrating average accuracy of 96.8%, precision of 92%, recall of 97%, and F1-score of 94%. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient's respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights as to personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation. [ABSTRACT FROM AUTHOR]

Hydrogen release and dispersion from hydrogen refuelling stations have the potential to cause explosion disaster and bring significant causalities and economic losses to the surroundings. Real-time spatial hydrogen plume concentration prediction is essential for the quick emergency response planning to dissipate such flammable vapor cloud and prevent explosion disaster. Deep learning approaches have recently been applied to real-time gas release and dispersion modeling, however, are 'over-confident' for spatial plume concentration and boundary estimation, which could not support the robust decision-makings. This study proposes a hybrid deep probability learning-based spatial hydrogen plume concentration prediction model, namely DPL_H 2 Plume by integrating deep learning and Variational Bayesian Inference. Numerical model of hydrogen release and dispersion from hydrogen refuelling station is built to construct the benchmark dataset. By using such dataset, two pre-defined parameters, namely Monte Carlo sampling number m = 300 and dropout probability p = 0.1 are determined to ensure the model's tradeoff between inference accuracy and efficiency. Comparison between our proposed model and the state-of-the-art model is also conducted. The results demonstrate that our model exhibits a competitive accuracy of R 2 = 0.97 as well as an inference time 3.32 s. In addition, our model gives the comprehensive estimations including not only spatial hydrogen plume concentration but also its uncertainty. Also, our model provides the more accurate estimation at plume boundary compared to the state-of-the-art model. Overall, our proposed model could provide reliable alternative for constructing a digital twin for emergency management of hydrogen refuelling station. • Deep probabilistic learning-based hydrogen plume prediction model is proposed. • Optimal hyperparameters of variational Bayesian inference are determined. • Model accurately predicts real-time spatial hydrogen plume concentration given scenario-related parameters. • Model predicts additional uncertainty information for comprehensive emergency decision-makings. [ABSTRACT FROM AUTHOR]

Health monitoring of structures using ultrasonic guided waves is an evolving technology with potential applications in monitoring pipelines, civil bridges, and aircraft components. However, the sensitivity of guided waves to external parameters affects the reliability of monitoring systems based on them. These influencing factors and experimental related factors cannot be perfectly modeled, which give rise to the discrepancy between numerical simulations and experimental measurements. Therefore, it is important to address this inevitable discrepancy and generate close-to-experiment simulations. In this work, we present a deep learning-based Digital Twin framework containing multi-fidelity modeling to reduce the discrepancy between measurements and simulations and a deep generative model to generate close-to-experiment guided wave responses by harnessing the vital characteristics of the two sources. These realistic simulations (close to experiment) can then be used in assessing the reliability of health monitoring system by generating probability of detection curves. Furthermore, they can also be used for augmenting the training data for a machine learning algorithm. We use a measurement dataset corresponding to crack propagation and simulations to validate the proposed framework. The results show that the discrepancy is indeed reduced to a great extent, furthermore, we also show that this framework enables the computation of probability of detection from close-to-experiment data as a direct consequence of rapid generation of realistic simulations. • Structural health monitoring based on ultrasonic guided waves. • Discrepancy reduction between simulations and experiments. • A novel unifed deep neural network model blending simulations and experiments. • Enhanced ultrasonic guided waves signals generation. • Discrepancy quantification through phase and amplitude based misfit metrics. • Metamodel based computation of probability of detection. [ABSTRACT FROM AUTHOR]

• A digital twin-assisted dual transfer method was proposed with information and model adaptation for bearing fault diagnosis. • DTa-DT aims to simultaneously synthesize information transfer and model transfer for domain transfer error minimization. • DTd-IT method was proposed to information transfer with low distribution difference of twin data adapted. • DAd-MT method, composed of DBTN, was proposed to model transfer with feature distribution difference of domain-model adapted. • Experiments and ablation study verified that the proposed DTa-DT method can be well applied to small sample learning. Rolling bearing fault diagnosis is of great importance to the safety management of mechanical equipment. The scarcity of labelled fault data makes it difficult to adequately perform the training process of intelligent diagnosis models, and this will result in these intelligent models not being effectively and widely used in practice. Although some recent studies have verified that the addition of dynamic model response to the training process will greatly improve the ability of the model with low cost and high efficiency, it is still stuck in poor effect caused by large information distribution difference between dynamic model response and real measured data. Focusing on this issue, a digital twin-assisted dual transfer (DTa-DT) method with information and model adaptation was proposed for rolling bearing fault diagnosis. Different from the traditional digital-analogue driven transfer methods, the proposed DTa-DT aims to simultaneously synthesize data information transfer and feature model transfer together with domain transfer error minimization. In particular, it should be noted that the DTa-DT architecture consists of a dual transfer learning process, including digital twin-driven information transfer (DTd-IT) and digital-analogue-driven model transfer (DAd-MT), where the information is collaborated with the model to improve the integrated transfer diagnosis effect under sampling. On one aspect, with the employment of bearing dynamic model responses, DTd-IT is innovatively designed to establish the transfer of dynamic information and measured information. The information distribution difference between these twin data and real measured data is effetely adjusted with the introduced actual inference components, where the twin data with low information distribution difference can be well fusion generated by the information transfer digital twin (ITDT) model. On the other aspect, considering the truth that there are still small sample cases of real measured data and information distribution differences will affect the quality of the twin data, a digital-analogue driven model transfer (DAd-MT) method is further proposed, where the deep branch transfer network (DBTN) model with improved convolutional neural network (CNN) is used to achieve an accurate fault diagnosis effect with the help of digital twin data. Experiments and wear analysis verified that the proposed DTa-DT can significantly reduce the distribution difference between the dynamic model response and the real measured data, thus achieving low-cost and efficient rolling bearing transfer diagnosis compared to other ten state-of-the-art deep learning models. It can be predicted that the proposed dual transfer architecture provides more opportunities for the practical application of intelligent fault diagnosis under small sample sizes. [ABSTRACT FROM AUTHOR]

Optimizing the combustion process by predicting combustion parameters during prolonged engine operation is crucial for engine maintenance. This study presents a zero-dimensional (0-D) prediction model that integrates the advantages of model-driven and data-driven approaches. Initially, the snake optimization algorithm (SO) is employed to address the challenges related to low parameter fitting accuracy and multiple solutions in calculating Wiebe parameters. Subsequently, a convolutional neural network-bidirectional long short-term memory neural network (CNN–Bi-LSTM) is devised to establish a nonlinear correlation between operating parameters and Wiebe parameters. The structural parameters of CNN–Bi-LSTM are then optimized using the SO algorithm (SO–CNN–Bi-LSTM). Ultimately, a 0-D prediction combustion model is formulated by amalgamating the Wiebe function with the neural network, enabling real-time prediction of combustion results and generalization analysis of prediction performance under non-calibrated conditions. The findings demonstrate that the combustion model exhibits heightened accuracy, thereby establishing a robust technical foundation for the development of a digital twin in the engine combustion process. • The SO algorithm for calculating Wiebe parameters was applied. • A parameter identification model based on SO–CNN–Bi-LSTM was proposed. • A 0-D prediction model was constructed by combining Wiebe function with neural network. • Based on the prediction model, the combustion process was simplified and reconstructed. [ABSTRACT FROM AUTHOR]

Accurate and efficient inspection of rebar dimensions has proven to be a persistent challenge for researchers and practitioners. This paper introduces a semantically enriched 3D model-based system that employs computer vision and deep learning for location-aware identification and tracking of rebar issues. The system comprises four modules: (A) digital twin generation, (B) segmentation, (C) inspection, and (D) issue identification and tracking. The generation module constructs 3D models from rebar structures. The segmentation and inspection modules analyze the 3D models, enriching them with semantic information. The issue identification and tracking module exchanges information between the semantically enriched 3D models and the building information models across time. An experiment on a column rebar cage is conducted. A precision of over 90% and a recall of over 97% are reported in 3D instance segmentation. Diameter inspection achieves an accuracy of 95.5% for large-size rebars. Spacing inspection achieves a mean relative error of 0.98%. The defective spacing is identified and tracked. • Fuses deep learning and computer vision to construct 3D semantic rebar model. • BIM- and digital-twin-based information system fulfills rebar quality control. • Autonomous rebar inspection pipeline directly generates issue reports from images. [ABSTRACT FROM AUTHOR]

Weld penetration control has emerged as a critical area of research in the field of online control for ensuring the quality of robotic welds. Acoustic signals, which are known for their distinct temporal characteristics, play a pivotal role in the online assessment of weld quality. This study proposes a novel filter bank specifically tailored for robotic welding and investigates the working environment of robot welding. Twenty-six time-domain and frequency-domain features were extracted from weld acoustic signals, and statistical analyses and comparative methods were used to identify variations in defective signal features and interpret their physical significance. By leveraging these acoustic signal characteristics, this study established a predictive identification model and an online feedback controller. The predictive identification model effectively identified different penetration levels in the welding process, and the identification results served as a reference input for online regulation of the welding speed by the controller. Additionally, a digital twin system was developed, where the identification model and controller functioned as digital objects on a computer and an edge computer, respectively. Experimental tests demonstrated the superior performance of the system and model in accurately reflecting welding process penetration, regulating and stabilising the welding speed, and significantly enhancing the welding quality. The research presented in this paper offers notable advantages for the online control of welding penetration. [ABSTRACT FROM AUTHOR]

Blow-outs occurred on offshore platform and associated fires have been recurrent during the previous few decades, and poses a potential safety hazard to humans, property and the surrounding environment. Although the real-time forecast based on deep learning have shown promise in the fields of fire modelling and hazardous area evaluations, jet fire spatio-temporal modelling has not yet undergone sufficient investigation in complex ocean engineering cases like offshore platforms. This research therefore proposes a deep learning-based framework for jet fire spatio-temporal probabilistic real-time forecast by developing the Hybrid-VB-ConvSTnn model, which integratesConvGRU and variational Bayesian inference. And the significant hyperparameters were locally optimized through sensitivity analysis and finally identified as Monte Carlo (MC) sampling number m = 100 and dropout probability p = 0.1. By performance comparison with different models, the Hybrid-VB-ConvSTnn model shows competitive spatio-temporal forecasting capabilities in terms of both real-time (Inference time = 0.83s) and accuracy (R 2 = 0.982). Moreover, the Hybrid-VB-ConvSTnn model could provide the additional uncertainty inferences based on the probability density of the Bernoulli distribution, which avoids the inherent shortcomings of "overconfidence" for traditional point-estimate models and lends credibility to flame boundary identification. The proposed framework could support the digital twin-based fire emergency management on offshore platforms by more comprehensive and robust risk evaluation. • Deep learning-based advanced approach framework for natural gas jet fire spatiotemporal probabilistic forecast is developed. • Uncertainty inference in flame boundary forecast can be determined with variational Bayesian inference. • Hyperparameters that determine model performance are locally optimized through sensitivity analysis. • Real-time forecast provides an alternative for digital twin model of jet fire accidents management on offshore platform. [ABSTRACT FROM AUTHOR]

This paper establishes a digital twin (DT) enabled model that aims to achieve real-time monitoring and control to enhance the overall performance of tunnel boring machines (TBM) during excavation. Through the Internet of Things (IoT) sensors that are installed on TBM, the actual operating status is transferred from the physical object to the digital model. Deep learning models that integrated graph convolutional network (GCN) and long short-term memory (LSTM) networks are employed for reliable TBM performance estimation. An online multi-objective optimization (MOO) approach is then proposed to determine the optimal operating parameters for advanced control. Real data from Singapore's Circle Line 6 C885 project is utilized as a case study to examine the applicability of the developed digital twin model. TBM's penetration rate, over-excavation ratio, energy consumption, and tool wear are selected as the objectives (O 1 to O 4) for optimization. The results indicate that (1) The digital twin model can provide a reliable estimation of TBM's performance indicators with a high coefficient of determination (R 2) values. (2) TBM's overall performance can be effectively improved through the proposed online optimization method, with an overall improvement of 21.12%. (3) The proposed online optimization method is more practical and creates better improvement than the conventional MOO approach. This study addresses the existing research gaps of lacking a reliable method to guide TBM operation with enhanced performances for the major objectives. It also contributes to proposing a novel intelligent approach that integrates DT, deep learning, and an online-NSGA-II method for TBM operation optimization during tunnel excavation. • A digital twin enabled approach is proposed for real-time intelligent control for TBM operation. • An MOO approach that integrates deep-learning and online optimization is established. • Data from a realistic tunnel project in Singapore is used to demonstrate as a case study. • TBM's efficiency, safety, energy consumption and tool wear are considered as objectives. • An overall improvement of 21.12% is achieved by implementing the proposed method. [ABSTRACT FROM AUTHOR]

• Numerical simulation modeling is complex and computationally intensive. • Digital twin deployment requires lightweight and responsive systems. • Process sensor data drives deep learning algorithms to implement digital twins. • Generative adversarial networks enable monitoring of heat distribution changes. • Results contribute to weld quality assurance and blade structure optimization. In this paper, a novel method of using deep learning to construct a digital twin of the thermos-compression bonding blade's temperature field is presented. Usually, a heat transfer model based on numerical analysis can calculate the heat distribution in the welding process, but its complex modeling process and heavy computational effort are not appropriate for the deployment of the digital twin concept. The approach proposed in this paper is distinctive because it directly converts the collected process sensor data into the bonding blade's temperature field images and the bonding surface's temperature distribution curves for monitoring the welding process. This is achieved by training the generator and discriminator of the conditional depth convolutional generative adversarial network separately. The network is then capable of predicting the bonding blade's heat distribution within a certain range of welding parameters. Compared to methods based on numerical simulation, this approach is far more effective. Training and testing datasets were created to assess the suggested method's efficacy. Multi-scale structural similarity index, structural similarity index, peak signal-to-noise ratio, difference hash and mean absolute error were used to evaluate the simulations' quality. The results show that the simulation's results and the actual data agree quite well. The temperature changes that occur during the welding process may be quickly and accurately simulated using the proposed technology. [ABSTRACT FROM AUTHOR]

Engineering has many necessary fields, and Structural Health Monitoring (SHM) is one of the most important of them. Sometimes in industrial environments, it is difficult and even impossible to collect data containing different real damages. Therefore, the problem of data acquisition represents a primary challenge in designing damage detection systems. The application of digital twin methods based on simulated models and/or Machine Learning (ML) models is a practical way to solve this problem. In this approach, a digital twin is generated for a compromised structure, utilizing a physics-based model to analyze diverse damage scenarios. Subsequently, an ML model is trained using data extracted from the physics-based model, functioning as the digital twin. This research proposes a method based on a digital twin for detecting damages in structures. The data produced from a Floating Wind Turbine (FWT) model was used to evaluate the performance of the proposed digital twin-based method. For this purpose, the FWT structure was simulated using a numerical model to address the data collection problem in the face of various uncertainties, such as changing loading conditions. In line with the concept of digital twin and to reduce the computational time, a Deep Convolution Long Short-Term Memory Neural Network (DCLSTMNN) model was designed and trained only with the frequency data of various scenarios of the simulated FWT model under constant loads (deterministic loads, including constant wind speed and airy wave model) to learn the damage-sensitive features. Then, to demonstrate the robustness of the proposed model under different uncertainties, the DCLSTMNN model was evaluated using the frequency data of the simulated FWT model under variable loading conditions (including Kaimal wind model and JONSWAP wave theory). Some vibration response components unrelated to the nature of the FWT model were removed using the Complete Ensemble Empirical Mode Decomposition (CEEMD) method. Then, the reconstructed vibration responses were used to create the frequency data using the Frequency Domain Decomposition (FDD) technique. The study results show that the proposed digital twin-based method can detect the location and severity of damage more accurately than other comparable methods despite various uncertainties. • A novel digital twin-based method is proposed for learning damage-sensitive features from data of various scenarios of the simulated simple FWT model to detect damage in the complex FWT model. • A Deep Convolution Long Short-Term Memory Neural Network (DCLSTMNN) model is designed to learn features and damage detection of the complex FWT model. • The proposed DCLSTMNN is trained with extracted data from the simulated simple FWT model and then tested with extracted data from the complex FWT model. [ABSTRACT FROM AUTHOR]