Search

In recent years, the detection performance of SAR-GMTI (synthetic aperture radar-ground moving target indication) algorithm based on deep learning has always been limited by insufficient measured data due to the heavy operation complexity and high cost of real SAR systems. To solve this problem, this paper proposes an overall DT-based implementation framework for SAR ground moving target intelligent detection tasks. In particular, by virtue of a SAR imaging algorithm, a high-fidelity twin replica of SAR moving targets is established in digital space through parameter traversal based on the prior target characteristics of the obtained measured datasets. Then, the constructed SAR twin datasets is fed into the neural network model to train an intelligent detector by fully learning features of the moving targets and preset the SAR scene in the twin space, which can realize the robust detection of ground moving targets in related practical scenarios with no need for multiple and complex field experiments. Moreover, the effectiveness of the proposed framework is verified on the MiniSAR measured system, and a comparison with traditional CFAR detection method is given simultaneously. [ABSTRACT FROM AUTHOR]

This review focuses on the definitions, modalities, applications, and performance of various aspects of digital twins (DTs) in the context of transmission and industrial machinery. In this regard, the context around Industry 4.0 and even aspirations for Industry 5.0 are discussed. The many definitions and interpretations of DTs in this domain are first summarized. Subsequently, their adoption and performance levels for rotating and industrial machineries for manufacturing and lifetime performance are observed, along with the type of validations that are available. A significant focus on integrating fundamental operations of the system and scenarios over the lifetime, with sensors and advanced machine or deep learning, along with other statistical or data-driven methods are highlighted. This review summarizes how individual aspects around DTs are extremely helpful for lifetime design, manufacturing, or decision making even when a DT can remain incomplete or limited. [ABSTRACT FROM AUTHOR]

Gear fault detection and remaining useful life estimation are important tasks for monitoring the health of rotating machinery. In this study, a new benchmark for endurance gear vibration signals is presented and made publicly available. The new dataset was used in the HUMS 2023 conference data challenge to test anomaly detection algorithms. A survey of the suggested techniques is provided, demonstrating that traditional signal processing techniques interestingly outperform deep learning algorithms in this case. Of the 11 participating groups, only those that used traditional approaches achieved good results on most of the channels. Additionally, we introduce a signal processing anomaly detection algorithm and meticulously compare it to a standard deep learning anomaly detection algorithm using data from the HUMS 2023 challenge and simulated signals. The signal processing algorithm surpasses the deep learning algorithm on all tested channels and also on simulated data where there is an abundance of training data. Finally, we present a new digital twin that enables the estimation of the remaining useful life of the tested gear from the HUMS 2023 challenge. [ABSTRACT FROM AUTHOR]

The rapid development of advanced technologies provides futuristic option to enhance product value with digital services, which the concept of Smart Product-Service System (SPSS) was proposed. SPSS focuses on usage data, the whole lifecycle, and the iterative optimisation. A large amount of data and context information can be collected during the usage stage, which can be used to elicit requirements to guide further design. How to realise the requirement elicitation with cognitive intelligence based on usage data is the key step for design optimisation. Therefore, this research proposes a cognitive intelligence-enabled requirements elicitation framework to help designers promote the design optimisation process. First, the digital twin-driven data collection architecture of SPSS is proposed by considering multi-sources and multi-stages. Second, the behaviour of SPSS is modelled based on Auto-Encoder which is constructed using deep learning to cognise SPSS performance. Third, the corresponding behaviour model is interpreted based on Shapley Addictive exPlanations (SHAP) to discover key factors with cognitive intelligence. Finally, the domain knowledge graph is used to generate the optimisation requirements for further design. To demonstrate the feasibility and advantages of the proposed framework, this study adopts the case study of wind turbines for illustration and verification. [ABSTRACT FROM AUTHOR]

The accidental leakage of gaseous hydrogen from hydrogen refueling station facilities has the potential to result in a large fire and explosion catastrophe. The ability to forecast the spatiotemporal evolution of hydrogen plumes in real-time is crucial for monitoring the distribution of plume concentrations and mitigating the risk of fire and explosion. The utilization of deep learning has been extensively employed in a diverse range of spatiotemporal forecasting tasks. However, these approaches encounter limitations in accurately quantifying uncertainty when predicting spatiotemporal concentrations and plume boundaries. This research paper introduces a novel model called DPSTNN_H 2 Evolution, which is a deep probabilistic spatial-temporal neural network designed for forecasting the spatiotemporal evolution of hydrogen plumes. The benchmark dataset is constructed by the implementation of numerical simulations pertaining to the inadvertent leak of hydrogen within a hydrogen refueling station. The findings of the study indicate that incorporating quantified uncertainty information might enhance the precision of plume boundaries and the resilience of plume concentrations when predicting the spatiotemporal development of hydrogen. By employing Monte Carlo sampling with a sample size of m = 100 and a dropout rate of p = 0.1 , the model demonstrates the ability to provide real-time inference for 10 instances of plumes, while maintaining a high level of accuracy with R2 = 0.9829. In comparison to the current state-of-the-art model, the proposed model demonstrates superior accuracy and robustness in forecasting the spatiotemporal evolution of hydrogen plumes. In general, our proposed model has the potential to serve as a dependable option for the development of a digital twin for emergency management of hydrogen refueling stations. • Probabilistic spatial-temporal neural network model for hydrogen plume evolutions is proposed. • Normalized uncertainty contours and uncertainty intervals to improve accuracy and robustness. • Numerical experiment of hydrogen leakage and dispersion in refueling station are conducted. • Optimal hyper-parameters of the proposed model are determined • Comparison between the proposed model with point-estimation based model is conducted [ABSTRACT FROM AUTHOR]

The education sector is a rapidly growing global infrastructure for human resources. It is an essential and sensitive data-containing sector where sensitive private information about the user is included in the data. The incorporation of digital twins (DT) into virtual representations is used in higher education to enhance data analytic performance. However, the DT-enabled industry generates enormous amounts of data, making it challenging to manage security and privacy. The management of personal data by human resources involved in critical and resource-constrained tasks has increased since the globalization of Industry 5.0 and the higher education sector. Managing the security and privacy of users' private data through global data collection methods poses significant challenges. We present a framework for delivering decentralized data processing and learning in blockchain-based industry 5.0, with a use-case for higher education that integrates blockchain and deep learning (DL). The framework begins by introducing a new DT model that makes creating a virtual environment to model and replicate security-critical processes in higher education easier. Second, we propose a higher education data analysis model, so that blockchain-based data are ready for the fully functional higher education DT model. At last, the security and cost analyses of the proposed system are presented. Long short-term memory (LSTM) is used for the deep learning model. A custom Python-based blockchain with a proof-of-authentication consensus algorithm is used to implement the blockchain. Our proposed system is designed in such a way that it includes the higher education sector with the concepts of blockchain technology, digital twin, and Industry 5.0. The efficiency and throughput results of the blockchain show that the proposed system is better than the digital twin-based developed systems. The novelty of our proposed system is that educational blockchain with Industry 5.0 is conceptualized and implemented with deep learning models. [ABSTRACT FROM AUTHOR]

The benefits of having digital twins of urban buildings are numerous. However, a major difficulty encountered in their creation from airborne LiDAR point clouds is the effective means of accurately reconstructing significant occlusions amidst point density variations and noise. To bridge the noise/sparsity/occlusion gap and generate high fidelity 3D building models, we propose APC2Mesh which integrates point completion into a 3D reconstruction pipeline, enabling the learning of dense geometrically accurate representation of buildings. Specifically, we leveraged complete points generated from occluded ones as input to a linearized skip attention-based deformation network for 3D mesh reconstruction. In our experiments, conducted on 3 different scenes, we demonstrate that: (1) Compared to SoTA methods like NDF, Points2Poly, Point2Mesh, and a few others, APC2Mesh ranked second in positional RMSE and first in directional RSME, with error magnitudes of 0.0134 m and 0.1581, respectively. This indicates the efficacy of APC2Mesh in handling the challenges of airborne building points of diverse styles and complexities. (2) The combination of point completion with typical deep learning-based 3D point cloud reconstruction methods offers a direct and effective solution for reconstructing significantly occluded airborne building points. As such, this neural integration holds promise for advancing the creation of digital twins for urban buildings with greater accuracy and fidelity. Our source code is available at https://github.com/geospatial-lab/APC2Mesh. [ABSTRACT FROM AUTHOR]

The rapier loom works in a complex environment and operates at high speeds. It is inevitable that its performance will deteriorate during the production process, which in turn will cause faults. The development of maintenance has undergone the transition from "regular maintenance" and "post-event maintenance" to "predictive maintenance". In order to achieve the synergistic optimization goal of ensuring operational safety and reducing operational costs, a predictive maintenance method driven by the fusion of digital twin and deep learning is proposed based on the idea of "combining the real with the virtual and controlling the real". Firstly, a digital twin system structure model of rapier weaving machine is constructed, and the overall architecture of digital twin is proposed according to the full operation cycle of rapier weaving machine. Then, the digital twin-driven process parameter evaluation and prediction and health state evaluation and prediction are investigated separately. In order to achieve the evaluation and prediction of process parameters to ensure the efficiency of weaving machine operation, the prediction method of IWOA optimized BP neural network driven by twin data is proposed and the model is updated and optimized based on the martingale distance approach. In order to achieve health state assessment and prediction, we use health index as an evaluation index to characterize the health condition of spindles, and use BiLSTM network to achieve prediction of remaining spindle life and then make maintenance decisions. The results show that there are greater advantages to combining deep learning and digital twin technology for intelligent predictive maintenance of rapier loom. [ABSTRACT FROM AUTHOR]

Lake thermal dynamics have been considerably impacted by climate change, with potential adverse effects on aquatic ecosystems. To better understand the potential impacts of future climate change on lake thermal dynamics and related processes, the use of mathematical models is essential. In this study, we provide a comprehensive review of lake water temperature modeling. We begin by discussing the physical concepts that regulate thermal dynamics in lakes, which serve as a primer for the description of process‐based models. We then provide an overview of different sources of observational water temperature data, including in situ monitoring and satellite Earth observations, used in the field of lake water temperature modeling. We classify and review the various lake water temperature models available, and then discuss model performance, including commonly used performance metrics and optimization methods. Finally, we analyze emerging modeling approaches, including forecasting, digital twins, combining process‐based modeling with deep learning, evaluating structural model differences through ensemble modeling, adapted water management, and coupling of climate and lake models. This review is aimed at a diverse group of professionals working in the fields of limnology and hydrology, including ecologists, biologists, physicists, engineers, and remote sensing researchers from the private and public sectors who are interested in understanding lake water temperature modeling and its potential applications. Plain Language Summary: Lake thermal dynamics are fundamental in controlling mixing processes and have significant implications for biological and geochemical processes. Consequently, the impacts of climate change on these dynamics can have severe consequences for the health of lakes and their aquatic ecosystems. In this context, mathematical models are essential for understanding the potential effects of future climate change on lake thermal dynamics and related processes. This manuscript offers a comprehensive review of lake water temperature modeling. It covers the fundamental physical concepts that govern thermal dynamics in lakes and provides an overview of various sources of observational water temperature data, including in situ monitoring and satellite data used in these models. The study evaluates different types of lake water temperature models, including statistical, process‐based, and hybrid models. It explores emerging modeling approaches such as forecasting, digital twins, combining process‐based modeling with deep learning, ensemble modeling, and climate‐lake models coupling. Model performance is also discussed, highlighting suggested evaluation metrics and providing a comprehensive analysis of the state‐of‐the‐art optimization methods to assess model accuracy. This review targets researchers in limnology, hydrology, ecology, biology, physics, engineering, and remote sensing from the private and public sectors interested in lake water temperature modeling and its applications. Key Points: Lake thermal dynamics are central in shaping mixing processes and the health of aquatic ecosystems, and climate change alters these dynamicsMathematical models are essential to understand past and project future climate change impacts on lake thermal dynamicsThis study reviews lake water temperature modeling, covering concepts, data sources, and model evaluation for applications across disciplines [ABSTRACT FROM AUTHOR]

In this work, the authors present a digital twin (DT) to analyse the manufacturing process of structural composites by using resin transfer moulding (RTM). During RTM, a dry textile preform is impregnated with a polymer resin injected in a closed mould. RTM is one of the most used production methods for high-performance structural composites. The DT is focused on detecting in-homogeneous resin flow produced by race-tracking channels that divert resin flow to the outlet gates of the mould, producing dry spots and lack of impregnation. The DT core contains two surrogate models based on encoder/decoder deep learning architectures, providing the fast/accurate response necessary for interrogation during manufacturing. The first surrogate acts as the disturbance detector, providing the on-the-fly representation of the fabric permeability with the only information gathered by a set of five pressure sensors distributed over the mould surface. The second offers real-time representation of a set of quantities of interests (QoI): namely, the flow progress and the pressure field inside the mould. Training of both surrogates was performed with synthetic data generated by high-fidelity multi-physics simulations of the flow progress in a porous preform by following Darcy's law. Errors in the pressure field predictions of the surrogates are lower than 1 % with consultation time <50 ms, enabling encapsulation in the digital twin. The DT performance was evaluated by comparing the response against a set of RTM experiments for different race-tracking scenarios. The two most relevant novelties of the work are the use of the concept of the instantiated DT, which provides information on the current state of the process from data provided by a network of distributed sensors, and that this DT has been trained exclusively with synthetic data from multiphysics simulations while evaluated against experimental data from injection tests. [ABSTRACT FROM AUTHOR]

This survey provides a comprehensive overview of traditional techniques and deep learning-based methodologies for monocular visual odometry (VO), with a focus on displacement measurement applications. This paper outlines the fundamental concepts and general procedures for VO implementation, including feature detection, tracking, motion estimation, triangulation, and trajectory estimation. This paper also explores the research challenges inherent in VO implementation, including scale estimation and ground plane considerations. The scientific literature is rife with diverse methodologies aiming to overcome these challenges, particularly focusing on the problem of accurate scale estimation. This issue has been typically addressed through the reliance on knowledge regarding the height of the camera from the ground plane and the evaluation of feature movements on that plane. Alternatively, some approaches have utilized additional tools, such as LiDAR or depth sensors. This survey of approaches concludes with a discussion of future research challenges and opportunities in the field of monocular visual odometry. [ABSTRACT FROM AUTHOR]

With the development of collaborative edge computing (CEC), the manufacturing market is gradually moving toward large-scale, multi-scenario, and dynamic directions. The existing scheduling strategies based on machine learning or deep learning are only applicable to specific scenarios, which is difficult to meet the requirements of dynamic real-time scheduling in multiple scenarios. The proposed digital twin technology provides a new solution for real-time scheduling of multiple scenarios. In this paper, a digital twin-oriented multi-scene real-time scheduler (GNN-RL) is proposed. This scheduler converts task sequences into node trees and sets up two learning layers. The first layer is an online learning representation layer, which uses GNN to learn node features of embedded structures in real time to boost large instances without additional training. The second layer is the online learning policy layer, which introduces imitation learning mappings into optimal scheduling behavior policies adapted to multiple scenarios. Finally, our approach is validated in several scenarios in 3D digital twin factories, such as computationally intensive, delay-sensitive, and task-urgent scenarios. Since the scheduler proposed in this paper learns general features of the embedding graph rather than instance-specific features, it has good generality and scalability, with good generalization and scalability, outperforming other scheduling rules and schedulers on various benchmarks. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in terms of diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish the digital representation of a patient's respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-rays into five distinct categories of lung diseases, including "normal", "covid", "lung_opacity", "pneumonia", and "tuberculosis". The performance of the system was evaluated employing a chest X-ray dataset available in the literature, demonstrating average accuracy of 96.8%, precision of 92%, recall of 97%, and F1-score of 94%. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient's respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights as to personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation. [ABSTRACT FROM AUTHOR]

Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause "all-black images." A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes "all-black images." In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur. [ABSTRACT FROM AUTHOR]

Hydrogen release and dispersion from hydrogen refuelling stations have the potential to cause explosion disaster and bring significant causalities and economic losses to the surroundings. Real-time spatial hydrogen plume concentration prediction is essential for the quick emergency response planning to dissipate such flammable vapor cloud and prevent explosion disaster. Deep learning approaches have recently been applied to real-time gas release and dispersion modeling, however, are 'over-confident' for spatial plume concentration and boundary estimation, which could not support the robust decision-makings. This study proposes a hybrid deep probability learning-based spatial hydrogen plume concentration prediction model, namely DPL_H 2 Plume by integrating deep learning and Variational Bayesian Inference. Numerical model of hydrogen release and dispersion from hydrogen refuelling station is built to construct the benchmark dataset. By using such dataset, two pre-defined parameters, namely Monte Carlo sampling number m = 300 and dropout probability p = 0.1 are determined to ensure the model's tradeoff between inference accuracy and efficiency. Comparison between our proposed model and the state-of-the-art model is also conducted. The results demonstrate that our model exhibits a competitive accuracy of R 2 = 0.97 as well as an inference time 3.32 s. In addition, our model gives the comprehensive estimations including not only spatial hydrogen plume concentration but also its uncertainty. Also, our model provides the more accurate estimation at plume boundary compared to the state-of-the-art model. Overall, our proposed model could provide reliable alternative for constructing a digital twin for emergency management of hydrogen refuelling station. • Deep probabilistic learning-based hydrogen plume prediction model is proposed. • Optimal hyperparameters of variational Bayesian inference are determined. • Model accurately predicts real-time spatial hydrogen plume concentration given scenario-related parameters. • Model predicts additional uncertainty information for comprehensive emergency decision-makings. [ABSTRACT FROM AUTHOR]

Three-dimensional semantic segmentation is the foundation for automatically creating enriched Digital Twin Cities (DTCs) and their updates. For this task, prior-level fusion approaches show more promising results than other fusion levels. This article proposes a new approach by developing and benchmarking three prior-level fusion scenarios to enhance the outcomes of point cloud-enriched semantic segmentation. The latter were compared with a baseline approach that used the point cloud only. In each scenario, specific prior knowledge (geometric features, classified images, or classified geometric information) and aerial images were fused into the neural network's learning pipeline with the point cloud data. The goal was to identify the one that most profoundly enhanced the neural network's knowledge. Two deep learning techniques, "RandLaNet" and "KPConv", were adopted, and their parameters were modified for different scenarios. Efficient feature engineering and selection for the fusion step facilitated the learning process and improved the semantic segmentation results. Our contribution provides a good solution for addressing some challenges, particularly for more accurate extraction of semantically rich objects from the urban environment. The experimental results have demonstrated that Scenario 1 has higher precision (88%) on the SensatUrban dataset compared to the baseline approach (71%), the Scenario 2 approach (85%), and the Scenario 3 approach (84%). Furthermore, the qualitative results obtained by the first scenario are close to the ground truth. Therefore, it was identified as the efficient fusion approach for point cloud-enriched semantic segmentation, which we have named the efficient prior-level fusion (Efficient-PLF) approach. [ABSTRACT FROM AUTHOR]

Developing methods to understand and control defect formation in nanomaterials offers a promising route for materials discovery. Monolayer MX2 phases represent a particularly compelling case for defect engineering of nanomaterials due to the large variability in their physical properties as different defects are introduced into their structure. However, effective identification and quantification of defects remain a challenge even as high-throughput scanning transmission electron microscopy methods improve. This study highlights the benefits of employing first principles calculations to produce digital twins for training deep learning segmentation models for defect identification in monolayer MX2 phases. Around 600 defect structures were obtained using density functional theory calculations, with each monolayer MX2 structure being subjected to multislice simulations for the purpose of generating the digital twins. Several deep learning segmentation architectures were trained on this dataset, and their performances evaluated under a variety of conditions such as recognizing defects in the presence of unidentified impurities, beam damage, grain boundaries, and with reduced image quality from low electron doses. This digital twin approach allows benchmarking different deep learning architectures on a theory dataset, which enables the study of defect classification under a broad array of finely controlled conditions. It thus opens the door to resolving the underpinning physical reasons for model shortcomings and potentially chart paths forward for automated discovery of materials defect phases in experiments. [ABSTRACT FROM AUTHOR]

In recent decades, there have been significant research efforts focusing on wireless indoor localization systems, with fingerprinting techniques based on received signal strength leading the way. The majority of the suggested approaches require challenging and laborious Wi-Fi site surveys to construct a radio map, which is then utilized to match radio signatures with particular locations. In this paper, a novel next-generation cyber-physical wireless indoor positioning system is presented that addresses the challenges of fingerprinting techniques associated with data collection. The proposed approach not only facilitates an interactive digital representation that fosters informed decision-making through a digital twin interface but also ensures adaptability to new scenarios, scalability, and suitability for large environments and evolving conditions during the process of constructing the radio map. Additionally, it reduces the labor cost and laborious data collection process while helping to increase the efficiency of fingerprint-based positioning methods through accurate ground-truth data collection. This is also convenient for working in remote environments to improve human safety in locations where human access is limited or hazardous and to address issues related to radio map obsolescence. The feasibility of the cyber-physical system design is successfully verified and evaluated with real-world experiments in which a ground robot is utilized to obtain a radio map autonomously in real-time in a challenging environment through an informed decision process. With the proposed setup, the results demonstrate the success of RSSI-based indoor positioning using deep learning models, including MLP, LSTM Model 1, and LSTM Model 2, achieving an average localization error of ≤ 2.16 m in individual areas. Specifically, LSTM Model 2 achieves an average localization error as low as 1.55 m and 1.97 m with 83.33 % and 81.05 % of the errors within 2 m for individual and combined areas, respectively. These outcomes demonstrate that the proposed cyber-physical wireless indoor positioning approach, which is based on the application of dynamic Wi-Fi RSS surveying through human feedback using autonomous mobile robots, effectively leverages the precision of deep learning models, resulting in localization performance comparable to the literature. Furthermore, they highlight its potential for suitability for deployment in real-world scenarios and practical applicability. [ABSTRACT FROM AUTHOR]

The rapid rise of artificial intelligence (AI) in medicine in the last few years highlights the importance of developing bigger and better systems for data and model sharing. However, the presence of Protected Health Information (PHI) in medical data poses a challenge when it comes to sharing. One potential solution to mitigate the risk of PHI breaches is to exclusively share pre-trained models developed using private datasets. Despite the availability of these pre-trained networks, there remains a need for an adaptable environment to test and fine-tune specific models tailored for clinical tasks. This environment should be open for peer testing, feedback, and continuous model refinement, allowing dynamic model updates that are especially important in the medical field, where diseases and scanning techniques evolve rapidly. In this context, the Discovery Viewer (DV) platform was developed in-house at the Biomedical Engineering and Imaging Institute at Mount Sinai (BMEII) to facilitate the creation and distribution of cutting-edge medical AI models that remain accessible after their development. The all-in-one platform offers a unique environment for non-AI experts to learn, develop, and share their own deep learning (DL) concepts. This paper presents various use cases of the platform, with its primary goal being to demonstrate how DV holds the potential to empower individuals without expertise in AI to create high-performing DL models. We tasked three non-AI experts to develop different musculoskeletal AI projects that encompassed segmentation, regression, and classification tasks. In each project, 80% of the samples were provided with a subset of these samples annotated to aid the volunteers in understanding the expected annotation task. Subsequently, they were responsible for annotating the remaining samples and training their models through the platform's "Training Module". The resulting models were then tested on the separate 20% hold-off dataset to assess their performance. The classification model achieved an accuracy of 0.94, a sensitivity of 0.92, and a specificity of 1. The regression model yielded a mean absolute error of 14.27 pixels. And the segmentation model attained a Dice Score of 0.93, with a sensitivity of 0.9 and a specificity of 0.99. This initiative seeks to broaden the community of medical AI model developers and democratize the access of this technology to all stakeholders. The ultimate goal is to facilitate the transition of medical AI models from research to clinical settings. [ABSTRACT FROM AUTHOR]

Human-robot collaboration (HRC) has been identified as a highly promising paradigm for human-centric smart manufacturing in the context of Industry 5.0. In order to enhance both human well-being and robotic flexibility within HRC, numerous research efforts have been dedicated to the exploration of human body perception, but many of these studies have focused only on specific facets of human recognition, lacking a holistic perspective of the human operator. A novel approach to addressing this challenge is the construction of a human digital twin (HDT), which serves as a centralized digital representation of various human data for seamless integration into the cyber-physical production system. By leveraging HDT, performance and efficiency optimization can be further achieved in an HRC system. However, the implementation of visual perception-based HDT remains underreported, particularly within the HRC realm. To this end, this study proposes an exemplary vision-based HDT model for highly dynamic HRC applications. The model mainly consists of a convolutional neural network that can simultaneously model the hierarchical human status including 3D human posture, action intention, and ergonomic risk. Then, on the basis of the constructed HDT, a robotic motion planning strategy is further introduced with the aim of adaptively optimizing the robotic motion trajectory. Further experiments and case studies are conducted in an HRC scenario to demonstrate the effectiveness of our approach. [ABSTRACT FROM AUTHOR]

Environmental effects may lead to cracking, stiffness loss, brace damage, and other damages in bridges, frame structures, buildings, etc. Structural Health Monitoring (SHM) technology could prevent catastrophic events by detecting damage early. In recent years, Deep Learning (DL) has developed rapidly and has been applied to SHM to detect, localize, and evaluate diverse damages through efficient feature extraction. This paper analyzes 337 articles through a systematic literature review to investigate the application of DL for SHM in the operation and maintenance phase of facilities from three perspectives: data, DL algorithms, and applications. Firstly, the data types in SHM and the corresponding collection methods are summarized and analyzed. The most common data types are vibration signals and images, accounting for 80% of the literature studied. Secondly, the popular DL algorithm types and application areas are reviewed, of which CNN accounts for 60%. Then, this article carefully analyzes the specific functions of DL application for SHM based on the facility's characteristics. The most scrutinized study focused on cracks, accounting for 30 percent of research papers. Finally, challenges and trends in applying DL for SHM are discussed. Among the trends, the Structural Health Monitoring Digital Twin (SHMDT) model framework is suggested in response to the trend of strong coupling between SHM technology and Digital Twin (DT), which can advance the digitalization, visualization, and intelligent management of SHM. [ABSTRACT FROM AUTHOR]

As human–robot interaction becomes more prevalent in industrial and clinical settings, detecting changes in human posture has become increasingly crucial. While recognizing human actions has been extensively studied, the transition between different postures or movements has been largely overlooked. This study explores using two deep-learning methods, the linear Feedforward Neural Network (FNN) and Long Short-Term Memory (LSTM), to detect changes in human posture among three different movements: standing, walking, and sitting. To explore the possibility of rapid posture-change detection upon human intention, the authors introduced transition stages as distinct features for the identification. During the experiment, the subject wore an inertial measurement unit (IMU) on their right leg to measure joint parameters. The measurement data were used to train the two machine learning networks, and their performances were tested. This study also examined the effect of the sampling rates on the LSTM network. The results indicate that both methods achieved high detection accuracies. Still, the LSTM model outperformed the FNN in terms of speed and accuracy, achieving 91% and 95% accuracy for data sampled at 25 Hz and 100 Hz, respectively. Additionally, the network trained for one test subject was able to detect posture changes in other subjects, demonstrating the feasibility of personalized or generalized deep learning models for detecting human intentions. The accuracies for posture transition time and identification at a sampling rate of 100 Hz were 0.17 s and 94.44%, respectively. In summary, this study achieved some good outcomes and laid a crucial foundation for the engineering application of digital twins, exoskeletons, and human intention control. [ABSTRACT FROM AUTHOR]

Collaborative tasks in multiple systems have attracted considerable attention in contemporary manufacturing environments. Collaborative robots are representative agents for various collaborative industrial tasks. This study focuses on contactless delivery by considering multiple agents. A contactless delivery operation must be performed with well-synchronized cooperation among the sender, a receiver, and flying dynamics of the deliverable. The most challenging task is to predict the catching point of a thrown package by considering both collaborative robots. Accurate catching-point prediction and relevant operations were achieved using the proposed physics-informed neural network-based hybrid multi-stream deep learning framework. Various cooperative environments were considered using multi-modal input data and manufacturing conditions. The proposed framework incorporates these constraints, and the prediction is guided by flying dynamics and trajectory data. The effectiveness of the proposed framework was demonstrated by implementing multi-agent and related manufacturing environments in a digital twin system. The effectiveness of the proposed framework was proven experimentally using analyses and comparisons with existing machine learning methods. [ABSTRACT FROM AUTHOR]

This review paper addresses the critical need for structural prognostics and health management (SPHM) in aircraft maintenance, highlighting its role in identifying potential structural issues and proactively managing aircraft health. With a comprehensive assessment of various SPHM techniques, the paper contributes by comparing traditional and modern approaches, evaluating their limitations, and showcasing advancements in data-driven and model-based methodologies. It explores the implementation of machine learning and deep learning algorithms, emphasizing their effectiveness in improving prognostic capabilities. Furthermore, it explores model-based approaches, including finite element analysis and damage mechanics, illuminating their potential in the diagnosis and prediction of structural health issues. The impact of digital twin technology in SPHM is also examined, presenting real-life case studies that demonstrate its practical implications and benefits. Overall, this review paper will inform and guide researchers, engineers, and maintenance professionals in developing effective strategies to ensure aircraft safety and structural integrity. [ABSTRACT FROM AUTHOR]

Digital twins (DTs) are becoming increasingly popular in various industries, and their potential for healthcare in the metaverse continues to attract attention. The metaverse is a virtual world where individuals interact with digital replicas of themselves and the environment. This paper focuses on personalized and precise medicine and examines the current application of DTs in healthcare within the metaverse. Healthcare practitioners may use immersive virtual worlds to replicate medical scenarios, improve teaching experiences, and provide personalized care to patients. However, the integration of DTs in the metaverse poses technical, regulatory, and ethical challenges that need to be addressed, including data privacy, standards, and accessibility. Through this examination, we aim to provide insights into the transformative potential of DTs in healthcare within the metaverse and encourage further research and development in this exciting domain. [ABSTRACT FROM AUTHOR]

In this study, we propose a population-based, data-driven intelligent controller that leverages neural-network-based digital twins for hypothesis testing. Initially, a diverse set of control laws is generated using genetic programming with the digital twin of the system, facilitating a robust response to unknown disturbances. During inference, the trained digital twin is utilized to virtually test alternative control actions for a multi-objective optimization task associated with each control action. Subsequently, the best policy is applied to the system. To evaluate the proposed model predictive control pipeline, experiments are conducted on a multi-mode heat transfer test rig. The objective is to achieve homogeneous cooling over the surface, minimizing the occurrence of hot spots and energy consumption. The measured variable vector comprises high dimensional infrared camera measurements arranged as a sequence (655,360 inputs), while the control variable includes power settings for fans responsible for convective cooling (3 outputs). Disturbances are induced by randomly altering the local heat loads. The findings reveal that by utilizing an evolutionary algorithm on measured data, a population of control laws can be effectively learned in the virtual space. This empowers the system to deliver robust performance. Significantly, the digital twin-assisted, population-based model predictive control (MPC) pipeline emerges as a superior approach compared to individual control models, especially when facing sudden and random changes in local heat loads. Leveraging the digital twin to virtually test alternative control policies leads to substantial improvements in the controller's performance, even with limited training data. [ABSTRACT FROM AUTHOR]

Digital twin is the digital representation of an entity, and it drives Industry 4.0. This paper presents a bibliometric analysis of digital twin in the supply chain to help researchers, industry practitioners, and academics to understand the trend, development, and focus of the areas of digital twin in the supply chain. This paper found several key clusters of research, including the designing of a digital twin model, integration of a digital twin model, application of digital twin in quality control, and digital twin in digitalization. In the embryonic stage of research, digital twin was tested in the production line with limited optimization. In the development stage, the importance of digital twin in Industry 4.0 was observed, as big data, machine learning, Industrial Internet of Things, blockchain, edge computing, and cloud-based systems complemented digital twin models. Digital twin was applied to improve sustainability in manufacturing and production logistics. In the current prosperity stage with high annual publications, the recent trends of this topic focus on the integration of deep learning, data models, and artificial intelligence for digitalization. This bibliometric analysis also found that the COVID-19 pandemic drove the start of the prosperity stage of digital twin research in the supply chain. Researchers in this field are slowly moving towards applying digital twin for human-centric systems and mass personalization to prepare to transit to Industry 5.0. [ABSTRACT FROM AUTHOR]

Intelligent digital twins closely resemble their real-life counterparts. In health and medical care, they enable the real-time monitoring of patients, whereby large amounts of data can be collected to produce actionable information. These powerful tools are constructed with the aid of artificial intelligence, machine learning, and deep learning; the Internet of Things; and cloud computing to collect a diverse range of digital data (e.g., from digital patient journals, wearable sensors, and digitized monitoring equipment or processes), which can provide information on the health conditions and therapeutic responses of their physical twins. Intelligent digital twins can enable data-driven clinical decision making and advance the realization of personalized care. Migraines are a highly prevalent and complex neurological disorder affecting people of all ages, genders, and geographical locations. It is ranked among the top disabling diseases, with substantial negative personal and societal impacts, but the current treatment strategies are suboptimal. Personalized care for migraines has been suggested to optimize their treatment. The implementation of intelligent digital twins for migraine care can theoretically be beneficial in supporting patient-centric care management. It is also expected that the implementation of intelligent digital twins will reduce costs in the long run and enhance treatment effectiveness. This study briefly reviews the concept of digital twins and the available literature on digital twins for health disorders such as neurological diseases. Based on these, the potential construction and utility of digital twins for migraines will then be presented. The potential and challenges when implementing intelligent digital twins for the future management of migraines are also discussed. [ABSTRACT FROM AUTHOR]

Localizing leakages in large water distribution systems is an important and ever-present problem. Due to the complexity originating from water pipeline networks, too few sensors, and noisy measurements, this is a highly challenging problem to solve. In this work, we present a methodology based on generative deep learning and Bayesian inference for leak localization with uncertainty quantification. A generative model, utilizing deep neural networks, serves as a probabilistic surrogate model that replaces the full equations, while at the same time also incorporating the uncertainty inherent in such models. By embedding this surrogate model into a Bayesian inference scheme, leaks are located by combining sensor observations with a model output approximating the true posterior distribution for possible leak locations. We show that our methodology enables producing fast, accurate, and trustworthy results. It showed a convincing performance on three problems with increasing complexity. For a simple test case, the Hanoi network, the average topological distance (ATD) between the predicted and true leak location ranged from 0.3 to 3 with a varying number of sensors and level of measurement noise. For two more complex test cases, the ATD ranged from 0.75 to 4 and from 1.5 to 10, respectively. Furthermore, accuracies upwards of 83%, 72%, and 42% were achieved for the three test cases, respectively. The computation times ranged from 0.1 to 13 s, depending on the size of the neural network employed. This work serves as an example of a digital twin for a sophisticated application of advanced mathematical and deep learning techniques in the area of leak detection. [ABSTRACT FROM AUTHOR]

Structural damage is inherent in civil engineering structures, and bridges are no exception. It is vital to monitor and keep track of damage in bridge structures as a result of multiple mechanical, environmental and traffic-induced factors. Monitoring the formation and propagation of structural damage is also pertinent for enhancing the service life of bridges. Bridge health monitoring (BHM) has always been an active research area for engineers and stakeholders. While all monitoring techniques intend to provide accurate and decisive information on the remaining useful life, safety, integrity and serviceability of bridges, maintaining uninterrupted operation of a bridge relies strongly on understanding the development and propagation of damage. BHM methods have been extensively researched on bridges over the decades, and new methodologies have started to be used by domain experts, especially within the last decade. Emerging methods, as the products of technology advancements, have resulted in handy tools that have been quickly adopted by bridge engineers. State-of-the-art techniques such as lidar, photogrammetry, virtual reality, augmented reality, digital twins, computer vision, machine learning and deep learning are now integrated parts of the new-generation of BHM operations. This paper presents a brief overview of these latest BHM technologies. [ABSTRACT FROM AUTHOR]

As one pillar of NTT's IOWN (Innovative Optical and Wireless Network) vision, Digital Twin Computing aims to construct the world in a digital space. To this end, it is essential that data be obtained from people and things by sensors. However, advances in sensing technologies have created a new issue in which an increase in the number of data dimensions makes processing time longer, which makes it difficult to analyze and use collected data within a realistic period of time. We asked NTT Distinguished Researcher Yasutoshi Ida to tell us about "fast sparse modeling technology" as a means of solving this problem. [ABSTRACT FROM AUTHOR]

This article introduces a novel framework for diagnosing faults in rolling bearings. The framework combines digital twin data, transfer learning theory, and an enhanced ConvNext deep learning network model. Its purpose is to address the challenges posed by the limited actual fault data density and inadequate result accuracy in existing research on the detection of rolling bearing faults in rotating mechanical equipment. To begin with, the operational rolling bearing is represented in the digital realm through the utilization of a digital twin model. The simulation data produced by this twin model replace traditional experimental data, effectively creating a substantial volume of well-balanced simulated datasets. Next, improvements are made to the ConvNext network by incorporating an unparameterized attention module called the Similarity Attention Module (SimAM) and an efficient channel attention feature referred to as the Efficient Channel Attention Network (ECA). These enhancements serve to augment the network's capability for extracting features. Subsequently, the enhanced network model is trained using the source domain dataset. Simultaneously, the trained model is transferred to the target domain bearing using transfer learning techniques. This transfer learning process enables the accurate fault diagnosis of the main bearing to be achieved. Finally, the proposed method's feasibility is validated, and a comparative analysis is conducted in comparison with similar approaches. The comparative study demonstrates that the proposed method effectively addresses the issue of low mechanical equipment fault data density, leading to improved accuracy in fault detection and classification, along with a certain level of robustness. [ABSTRACT FROM AUTHOR]

For the next coming years, metaverse, digital twin and autonomous vehicle applications are the leading technologies for many complex applications hitherto inaccessible such as health and life sciences, smart home, smart agriculture, smart city, smart car and logistics, Industry 4.0, entertainment (video game) and social media applications, due to recent tremendous developments in process modeling, supercomputing, cloud data analytics (deep learning, etc.), communication network and AIoT/IIoT/IoT technologies. AIoT/IIoT/IoT is a crucial research field because it provides the essential data to fuel metaverse, digital twin, real-time Industry 4.0 and autonomous vehicle applications. However, the science of AIoT is inherently multidisciplinary, and therefore, it is difficult for readers to understand its evolution and impacts. Our main contribution in this article is to analyze and highlight the trends and challenges of the AIoT technology ecosystem including core hardware (MCU, MEMS/NEMS sensors and wireless access medium), core software (operating system and protocol communication stack) and middleware (deep learning on a microcontroller: TinyML). Two low-powered AI technologies emerge: TinyML and neuromorphic computing, but only one AIoT/IIoT/IoT device implementation using TinyML dedicated to strawberry disease detection as a case study. So far, despite the very rapid progress of AIoT/IIoT/IoT technologies, several challenges remain to be overcome such as safety, security, latency, interoperability and reliability of sensor data, which are essential characteristics to meet the requirements of metaverse, digital twin, autonomous vehicle and Industry 4.0. applications. [ABSTRACT FROM AUTHOR]

This document discusses the emergence of deep learning as a transformative tool in the field of operations research (OR). Deep learning, a specialized category of machine learning algorithms, uses multiple layers to uncover hidden patterns and insights from large datasets. It has gained popularity due to its superior predictive performance compared to traditional machine learning models. The integration of deep learning applications into OR has the potential to enhance decision-making, productivity, sustainability, and optimization processes. However, there are challenges to address, such as data availability, interpretability, and computational cost. The document highlights the need for practical research and provides future research directions in areas such as supply chain management, demand forecasting, inventory optimization, and decision-making processes. Overall, deep learning has the potential to transform the field of OR, and this document aims to provide new perspectives for further research and practical applications. [Extracted from the article]

The 3D semantic segmentation of a LiDAR point cloud is essential for various complex infrastructure analyses such as roadway monitoring, digital twin, or even smart city development. Different geometric and radiometric descriptors or diverse combinations of point descriptors can extract objects from LiDAR data through classification. However, the irregular structure of the point cloud is a typical descriptor learning problem—how to consider each point and its surroundings in an appropriate structure for descriptor extraction? In recent years, convolutional neural networks (CNNs) have received much attention for automatic segmentation and classification. Previous studies demonstrated deep learning models' high potential and robust performance for classifying complicated point clouds and permutation invariance. Nevertheless, such algorithms still extract descriptors from independent points without investigating the deep descriptor relationship between the center point and its neighbors. This paper proposes a robust and efficient CNN-based framework named D-Net for automatically classifying a mobile laser scanning (MLS) point cloud in urban areas. Initially, the point cloud is converted into a regular voxelized structure during a preprocessing step. This helps to overcome the challenge of irregularity and inhomogeneity. A density value is assigned to each voxel that describes the point distribution within the voxel's location. Then, by training the designed CNN classifier, each point will receive the label of its corresponding voxel. The performance of the proposed D-Net method was tested using a point cloud dataset in an urban area. Our results demonstrated a relatively high level of performance with an overall accuracy (OA) of about 98% and precision, recall, and F1 scores of over 92%. [ABSTRACT FROM AUTHOR]

Relevant research has investigated how predictive modeling algorithms, deep-learning-based sensing technologies, and big urban data configure immersive hyperconnected virtual spaces in digital twin cities: digital twin modeling tools, monitoring and sensing technologies, and Internet-of-Things-based decision support systems articulate big-data-driven urban geopolitics. This systematic review aims to inspect the recently published literature on digital twin simulation tools, spatial cognition algorithms, and multi-sensor fusion technology in sustainable urban governance networks. We integrate research developing on how blockchain-based digital twins, smart infrastructure sensors, and real-time Internet of Things data assist urban computing technologies. The research problems are whether: data-driven smart sustainable urbanism requires visual recognition tools, monitoring and sensing technologies, and simulation-based digital twins; deep-learning-based sensing technologies, spatial cognition algorithms, and environment perception mechanisms configure digital twin cities; and digital twin simulation modeling, deep-learning-based sensing technologies, and urban data fusion optimize Internet-of-Things-based smart city environments. Our analyses particularly prove that virtual navigation tools, geospatial mapping technologies, and Internet of Things connected sensors enable smart urban governance. Digital twin simulation, data visualization tools, and ambient sound recognition software configure sustainable urban governance networks. Virtual simulation algorithms, deep learning neural network architectures, and cyber-physical cognitive systems articulate networked smart cities. Throughout January and March 2023, a quantitative literature review was carried out across the ProQuest, Scopus, and Web of Science databases, with search terms comprising "sustainable urban governance networks" + "digital twin simulation tools", "spatial cognition algorithms", and "multi-sensor fusion technology". A Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) flow diagram was generated using a Shiny App. AXIS (Appraisal tool for Cross-Sectional Studies), Dedoose, MMAT (Mixed Methods Appraisal Tool), and the Systematic Review Data Repository (SRDR) were used to assess the quality of the identified scholarly sources. Dimensions and VOSviewer were employed for bibliometric mapping through spatial and data layout algorithms. The findings gathered from our analyses clarify that Internet-of-Things-based smart city environments integrate 3D virtual simulation technology, intelligent sensing devices, and digital twin modeling. [ABSTRACT FROM AUTHOR]

Most of the buildings that exist today were built based on 2D drawings. Building information models that represent design-stage product information have become prevalent in the second decade of the 21st century. Still, it will take many decades before such models become the norm for all existing buildings. In the meantime, the building industry lacks the tools to leverage the benefits of digital information management for construction, operation, and renovation. To this end, this paper reviews the state-of-the-art practice and research for constructing (generating) and maintaining (updating) geometric digital twins. This paper also highlights the key limitations preventing current research from being adopted in practice and derives a new geometry-based object class hierarchy that mainly focuses on the geometric properties of building objects, in contrast to widely used existing object categorisations that are mainly function-oriented. We argue that this new class hierarchy can serve as the main building block for prioritising the automation of the most frequently used object classes for geometric digital twin construction and maintenance. We also draw novel insights into the limitations of current methods and uncover further research directions to tackle these problems. Specifically, we believe that adapting deep learning methods can increase the robustness of object detection and segmentation of various types; involving design intents can achieve a high resolution of model construction and maintenance; using images as a complementary input can help to detect transparent and specular objects; and combining synthetic data for algorithm training can overcome the lack of real labelled datasets. [ABSTRACT FROM AUTHOR]

A lot of different methods are being opted for improving the educational standards through monitoring of the classrooms. The developed world uses Smart classrooms to enhance faculty efficiency based on accumulated learning outcomes and interests. Smart classroom boards, audio-visual aids, and multimedia are directly related to the Smart classroom environment. Along with these facilities, more effort is required to monitor and analyze students' outcomes, teachers' performance, attendance records, and contents delivery in on-campus classrooms. One can achieve more improvement in quality teaching and learning outcomes by developing digital twins in on-campus classrooms. In this article, we have proposed DeepClass-Rooms, a digital twin framework for attendance and course contents monitoring for the public sector schools of Punjab, Pakistan. DeepClassRooms is cost-effective and requires RFID readers and high-edge computing devices at the Fog layer for attendance monitoring and content matching, using convolution neural network for on-campus and online classes. [ABSTRACT FROM AUTHOR]

Advanced mathematical and deep learning (DL) algorithms have recently played a crucial role in diagnosing medical parameters and diseases. One of these areas that need to be more focused on is dentistry. This is why creating digital twins of dental issues in the metaverse is a practical and effective technique to benefit from the immersive characteristics of this technology and adapt the real world of dentistry to the virtual world. These technologies can create virtual facilities and environments for patients, physicians, and researchers to access a variety of medical services. Experiencing an immersive interaction between doctors and patients can be another considerable advantage of these technologies, which can dramatically improve the efficiency of the healthcare system. In addition, offering these amenities through a blockchain system enhances reliability, safety, openness, and the ability to trace data exchange. It also brings about cost savings through improved efficiencies. In this paper, a digital twin of cervical vertebral maturation (CVM), which is a critical factor in a wide range of dental surgery, within a blockchain-based metaverse platform is designed and implemented. A DL method has been used to create an automated diagnosis process for the upcoming CVM images in the proposed platform. This method includes MobileNetV2, a mobile architecture that improves the performance of mobile models in multiple tasks and benchmarks. The proposed technique of digital twinning is simple, fast, and suitable for physicians and medical specialists, as well as for adapting to the Internet of Medical Things (IoMT) due to its low latency and computing costs. One of the important contributions of the current study is to use of DL-based computer vision as a real-time measurement method so that the proposed digital twin does not require additional sensors. Furthermore, a comprehensive conceptual framework for creating digital twins of CVM based on MobileNetV2 within a blockchain ecosystem has been designed and implemented, showing the applicability and suitability of the introduced approach. The high performance of the proposed model on a collected small dataset demonstrates that low-cost deep learning can be used for diagnosis, anomaly detection, better design, and many more applications of the upcoming digital representations. In addition, this study shows how digital twins can be performed and developed for dental issues with the lowest hardware infrastructures, reducing the costs of diagnosis and treatment for patients. [ABSTRACT FROM AUTHOR]

Due to its automatic feature learning ability and high performance, deep learning has gradually become the mainstream of artificial intelligence in recent years, playing a role in many fields. Especially in the medical field, the accuracy rate of deep learning even exceeds that of doctors. This paper introduces several deep learning algorithms: Artificial Neural Network (NN), FM-Deep Learning, Convolutional NN and Recurrent NN, and expounds their theory, development history and applications in disease prediction; we analyze the defects in the current disease prediction field and give some current solutions; our paper expounds the two major trends in the future disease prediction and medical field—integrating Digital Twins and promoting precision medicine. This study can better inspire relevant researchers, so that they can use this article to understand related disease prediction algorithms and then make better related research. [ABSTRACT FROM AUTHOR]

As in manufacturing with its Industry 4.0 transformation, the enormous potential of artificial intelligence (AI) is also being recognized in the construction industry. Specifically, the equipment-intensive construction industry can benefit from using AI. AI applications can leverage the data recorded by the numerous sensors on machines and mirror them in a digital twin. Analyzing the digital twin can help optimize processes on the construction site and increase productivity. We present a case from special foundation engineering: the machine production of bored piles. We introduce a hierarchical classification for activity recognition and apply a hybrid deep learning model based on convolutional and recurrent neural networks. Then, based on the results from the activity detection, we use discrete-event simulation to predict construction progress. We highlight the difficulty of defining the appropriate modeling granularity. While activity detection requires equipment movement, simulation requires knowledge of the production flow. Therefore, we present a flow-based production model that can be captured in a modularized process catalog. Overall, this paper aims to illustrate modeling using digital-twin technologies to increase construction process improvement in practice. [ABSTRACT FROM AUTHOR]

Output-only structural health monitoring is a highly active research direction because it is a promising methodology for building digital twin applications providing near-real-time monitoring results of the structure. However, one of the technical bottlenecks is how to work effectively with multiple high-dimensional vibration signals. To address this question, this study develops a two-stage data-driven framework based on various advanced techniques, such as time-series feature extractions, self-learning, graph neural network, and machine learning algorithms. At first, multiple features in statistical, time, and spectral domains, are extracted from raw vibration data; then, they subsequently enter a graph convolution network to account for the spatial correlation of sensor locations. After that, the high-performance adaptive boosting machine learning algorithm is leveraged to assess structures' health states. This method allows for learning a lower-dimensional yet informative representation of vibration data; thus, the subsequent monitoring tasks could be performed with reduced time complexity and economical computational resources. The performance of the proposed method is qualitatively and quantitatively demonstrated through two examples involving both numerical and experimental structural data. Furthermore, comparison and robustness studies are carried out, showing that the proposed approach outperforms various machine learning/deep learning-based methods in terms of accuracy and noise/missing-robustness. [ABSTRACT FROM AUTHOR]

Roll-to-roll gravure (R2Rg) has become highly affiliated with printed electronics in the past few years due to its high yield of printed thin-film transistor (TFT) in active matrix devices, and to its low cost. For printing TFTs with multilayer structures, achieving a high-precision in overlay printing registration accuracy (OPRA) is a key challenge to attain the high degree of TFT integration through R2Rg. To address this challenge efficiently, a digital twin paradigm was first introduced in the R2Rg system with an aim to optimize the OPRA by developing a predictive model based on typical input variables such as web tension, nip force, and printing speed in the R2Rg system. In our introductory-level digital twin, errors in the OPRA were collected with the variable parameters of web tensions, nip forces, and printing speeds from several R2Rg printing processes. Subsequently, statistical features were extracted from the input data followed by the training of a deep learning long-short term memory (LSTM) model for predicting machine directional error (MD) in the OPRA. As a result of training the LSTM model in our digital twin, its attained accuracy of prediction was 77%. Based on this result, we studied the relationship between the nip forces and printing speeds to predict the MD error in the OPRA. The results indicated a correlation between the MD error in the OPRA and the printing speed, as the MD error amplitude in the OPRA tended to decline at the higher printing speed. [ABSTRACT FROM AUTHOR]

The sorting operation of the production line in a heavy industrial scenario has the double complexity of the problem and the data. To improve production efficiency, the operation needs to be optimized. Aimed at this problem, this article designs a data representation method and an evolutionary job scheduling algorithm with an optimized population by deep reinforcement learning (DRL). Moreover, a real industrial dataset is contributed. The representation method represents the job data by referring to the bag-of-words model. The evolutionary algorithm uses DRL to initialize the genetic algorithm (GA)'s population and further evolves the population through the GA to obtain the final scheduling result. The experimental results indicate that the evolutionary algorithm has achieved the largest decrease in the average times for frame clearing on the real and simulated validation datasets, which are 12.54 % and 11.43 % , respectively. It is of great significance for subsequent scheduling of the full-scenario digital twin. [ABSTRACT FROM AUTHOR]

Weld site inspection is a research area of interest in the manufacturing industry. In this study, a digital twin system for welding robots to examine various weld flaws that might happen during welding using the acoustics of the weld site is presented. Additionally, a wavelet filtering technique is implemented to remove the acoustic signal originating from machine noise. Then, an SeCNN-LSTM model is applied to recognize and categorize weld acoustic signals according to the traits of strong acoustic signal time sequences. The model verification accuracy was found to be 91%. In addition, using numerous indicators, the model was compared with seven other models, namely, CNN-SVM, CNN-LSTM, CNN-GRU, BiLSTM, GRU, CNN-BiLSTM, and LSTM. A deep learning model, and acoustic signal filtering and preprocessing techniques are integrated into the proposed digital twin system. The goal of this work was to propose a systematic on-site weld flaw detection approach encompassing data processing, system modeling, and identification methods. In addition, our proposed method could serve as a resource for pertinent research. [ABSTRACT FROM AUTHOR]

As heating, ventilation, and air conditioning (HVAC) systems have become one of the most contributing systems in energy consumption in the world, the control of these large-scale systems remains a challenging duty due to the decoupling effects of control variables. Accordingly, the penetration of these types of systems in all-smart buildings has increased in recent years. Furthermore, the application of digital twin as a fast-growing concept is being developed. In HVAC systems, independent and accurate control of temperature and humidity of the indoor air has been playing an undeniable role in reducing energy consumption. In this paper, to have cost-effective energy management in a single-zone HVAC system, a new reliable digital twin proximal policy optimization (PPO)–based model-independent nonsingular terminal sliding-mode control (MINTSMC) methodology has been proposed. Moreover, due to the nonlinear characteristics of HVAC systems, MINTSMC tends to handle the un-modeled system dynamics and disturbances. For regulating parameters of proposed control, an efficient PPO algorithm has been developed due to its actor-critic-based reinforcement learning. Extensive examinations and comparative analyses with particle swarm optimization designed sliding-mode control and proportional–integral–derivative controller have been made using digital twin of the proposed controller to show the importance, accuracy, and application of this method in the comfort and energy management achievement of HVAC control systems. A digital signal processor computing device has been utilized for implementation by utilizing hardware-in-loop (HIL) in the concept of the digital twin. To determine the interface between established models, software-in-loop, and HIL, the Functional Mock-up Interface has been utilized. The outcomes revealed a superior performance of suggested digital twin-based controller than the compared control methodologies in the compensation of unknown uncertainties, fast-tracking, and smooth response. [ABSTRACT FROM AUTHOR]

• A combined approach is proposed according to MMI, deep learning (FCRBM), and MTLA to forecast short-term load quickly. • A FCRBM-enabled prediction and training model is developed for increasing the accuracy. • A digital twin concept is developed to handle the problem complexities. Because users behave randomly and in a nonlinear way, predicting electrical loads proves to be a difficult procedure. Due to the development of the smart grid (SG) and advanced metering infrastructure (AMI), humans will be capable of recording, monitoring, and analyzing these non-linear behaviors. The use of electric load projection layouts is a necessity in order to make decisions, plan, and evaluate contracts in electrical systems. Consequently, there have been several load prediction methods in the research that demonstrate trade-offs among prediction precision and runtime (convergence rate). The current paper presents a method for short-term load prediction of market in trade-by-trade data that would be quick and precise. Modified mutual information (MMI) is used to extract abstractive characteristics from historic information. Learning empowers the factored conditional restricted Boltzmann machine (FCRBM) for predicting the electrical loads. Ultimately, the efficiency has been optimized using the suggested modified teaching–learning algorithm (MTLA). The suggested architecture has the advantage of improving prediction precision and convergence rate. The MMI method and FCRBM layout improve prediction precision. In addition, MTLA has been used to enhance the convergence rates. Based on simulation outcomes, the suggested quick and precise layout performs better than conventional layouts when it comes to forecasting precision and convergence rates, including Bi-level, MI-artificial neural network (MI-ANN), and accurate fast converging short-term load forecast (AFC-STLF). [ABSTRACT FROM AUTHOR]

Railway track maintenance plays an important role in enabling safe, reliable, and seamless train operations and passenger comfort. Due to the increasing rail transportation, rolling stocks tend to run faster and the load tends to increase continuously. As a result, the track deteriorates quicker, and maintenance needs to be performed more frequently. However, more frequent maintenance activities do not guarantee a better overall performance of the railway system. It is crucial for rail infrastructure managers to optimize predictive and preventative maintenance. This study is the world's first to develop deep machine learning models using three-dimensional recurrent neural network-based co-simulation models to predict track geometry parameters in the next year. Different recurrent neural network-based techniques are used to develop predictive models. In addition, a building information modeling (BIM) model is developed to integrate and cross-functionally co-simulate the track geometry measurement with the prediction for predictive and preventative maintenance purposes. From the study, the developed BIM models can be used to exchange information for predictive maintenance. Machine learning models provide the average R2 of 0.95 and the average mean absolute error of 0.56 mm. The insightful breakthrough demonstrates the potential of machine learning and BIM for predictive maintenance, which can promote the safety and cost effectiveness of railway maintenance. [ABSTRACT FROM AUTHOR]

Having access to accurate and recent digital twins of infrastructure assets benefits the renovation, maintenance, condition monitoring, and construction planning of infrastructural projects. There are many cases where such a digital twin does not yet exist, such as for legacy structures. In order to create such a digital twin, a mobile laser scanner can be used to capture the geometric representation of the structure. With the aid of semantic segmentation, the scene can be decomposed into different object classes. This decomposition can then be used to retrieve cad models from a cad library to create an accurate digital twin. This study explores three deep-learning-based models for semantic segmentation of point clouds in a practical real-world setting: PointNet++, SuperPoint Graph, and Point Transformer. This study focuses on the use case of catenary arches of the Dutch railway system in collaboration with Strukton Rail, a major contractor for rail projects. A challenging, varied, high-resolution, and annotated dataset for evaluating point cloud segmentation models in railway settings is presented. The dataset contains 14 individually labelled classes and is the first of its kind to be made publicly available. A modified PointNet++ model achieved the best mean class Intersection over Union (IoU) of 71% for the semantic segmentation task on this new, diverse, and challenging dataset. [ABSTRACT FROM AUTHOR]

In this paper, we present a deep learning-based reduced-order model (DL-ROM) for the stability prediction of unsteady three-dimensional fluid–structure interaction systems. The proposed DL-ROM has the format of a nonlinear state-space model and employs a recurrent neural network with long short-term memory (LSTM) cells. We consider a canonical fluid–structure system of an elastically mounted sphere coupled with the incompressible fluid flow in a state-space format. Specifically, we develop a nonlinear data-driven coupling for predicting the unsteady forces and the vortex-induced vibration (VIV) lock-in of the freely vibrating sphere in a transverse direction. We design an input–output relationship as a temporal sequence of force and displacement datasets for a low-dimensional approximation of the fluid–structure system. Based on the prior knowledge of the VIV lock-in process, the input function contains a range of frequencies and amplitudes, which significantly affects the system realization ability and enables an efficient DL-ROM without the need for a massive training dataset for the low-dimensional modeling. Once trained, the network provides a nonlinear mapping of input–output dynamics that can predict the coupled fluid–structure dynamics for a longer horizon via the feedback process. By integrating the LSTM network with the eigensystem realization algorithm (ERA), we construct a data-driven state-space model for the reduced-order stability analysis. We investigate the underlying mechanism and stability characteristics of VIV of a freely vibrating sphere via an eigenvalue selection process. Using the reduced-order eigenvalue analysis, we characterize the vibrating sphere-wake lock-in phenomenon and demonstrate that the lock-in responds at preferred vibration frequencies. To understand the frequency lock-in mechanism, we study the eigenvalue trajectories for a range of the reduced oscillation frequencies and the mass ratios. Consistent with the full-order simulations, the frequency lock-in branches are accurately captured by the combined LSTM-ERA procedure. The proposed DL-ROM aligns with the development of physics-based digital twin of engineering systems involving moving boundaries and fluid–structure interactions. [ABSTRACT FROM AUTHOR]