Search

The evolution towards next-generation Beyond 5G (B5G) networks will require not only innovation in transport technologies but also the adoption of smarter, more efficient operations of the use cases that are foreseen to be the high consumers of network resources in the next decades. Among different B5G use cases, the Digital Twin (DT) has been identified as a key high bandwidth-demanding use case. The creation and operation of a DT require the continuous collection of an enormous and widely distributed amount of sensor telemetry data which can overwhelm the transport layer. Therefore, the reduction in such transported telemetry data is an essential objective of smart use case operation. Moreover, deep telemetry data analysis, i.e., anomaly detection, can be executed in a hierarchical way to reduce the processing needed to perform such analysis in a centralized way. In this paper, we propose a smart management system consisting of a hierarchical architecture for telemetry sensor data analysis using deep autoencoders (AEs). The system contains AE-based methods for the adaptive compression of telemetry time series data using pools of AEs (called AAC), as well as for anomaly detection in single (called SS-AD) and multiple (called MS-AGD) sensor streams. Numerical results using experimental telemetry data show compression ratios of up to 64% with reconstruction errors of less than 1%, clearly improving upon the benchmark state-of-the-art methods. In addition, fast and accurate anomaly detection is demonstrated for both single and multiple-sensor scenarios. Finally, a great reduction in transport network capacity resources of 50% and more is obtained by smart use case operation for distributed DT scenarios.

In recent years, the detection performance of SAR-GMTI (synthetic aperture radar-ground moving target indication) algorithm based on deep learning has always been limited by insufficient measured data due to the heavy operation complexity and high cost of real SAR systems. To solve this problem, this paper proposes an overall DT-based implementation framework for SAR ground moving target intelligent detection tasks. In particular, by virtue of a SAR imaging algorithm, a high-fidelity twin replica of SAR moving targets is established in digital space through parameter traversal based on the prior target characteristics of the obtained measured datasets. Then, the constructed SAR twin datasets is fed into the neural network model to train an intelligent detector by fully learning features of the moving targets and preset the SAR scene in the twin space, which can realize the robust detection of ground moving targets in related practical scenarios with no need for multiple and complex field experiments. Moreover, the effectiveness of the proposed framework is verified on the MiniSAR measured system, and a comparison with traditional CFAR detection method is given simultaneously. [ABSTRACT FROM AUTHOR]

This review focuses on the definitions, modalities, applications, and performance of various aspects of digital twins (DTs) in the context of transmission and industrial machinery. In this regard, the context around Industry 4.0 and even aspirations for Industry 5.0 are discussed. The many definitions and interpretations of DTs in this domain are first summarized. Subsequently, their adoption and performance levels for rotating and industrial machineries for manufacturing and lifetime performance are observed, along with the type of validations that are available. A significant focus on integrating fundamental operations of the system and scenarios over the lifetime, with sensors and advanced machine or deep learning, along with other statistical or data-driven methods are highlighted. This review summarizes how individual aspects around DTs are extremely helpful for lifetime design, manufacturing, or decision making even when a DT can remain incomplete or limited. [ABSTRACT FROM AUTHOR]

This article examines the incorporation of the Shopping Assistance Automatic Suggestion (SAAS) model into Virtual Reality (VR) environments in order to improve the online shopping experience. The SAAS model employs sophisticated deep learning methods to offer customized product recommendations, which are conveyed by non-player characters (NPCs) via voice-based interactions. Our goal is to develop an interactive shopping experience that replicates real-life interactions by integrating AI-powered recommendations with immersive VR technology. We gather and standardize data from several open commerce databases, such as Amazon Product and Customer Reviews. The SAAS model, in conjunction with GPT-3, BERT, and T5, undergoes training and testing to evaluate its effectiveness across multiple criteria. The results demonstrate that the SAAS model surpasses other models in delivering contextually aware and pertinent recommendations. The integration process outlines the specific steps involved in capturing, processing, and transforming user interactions in virtual reality (VR) into vocal suggestions provided by non-player characters (NPCs). This strategy improves customization and utilizes the immersive features of virtual reality to effectively engage people. The results of our research establish a higher standard for e-commerce, with the goal of enhancing the user experience of online purchasing by making it more instinctive, engaging, and pleasurable. [ABSTRACT FROM AUTHOR]

Digital transformation is omnipresent in our daily lives and its impact is noticeable through new technologies, like smart devices, AI-Chatbots or the changing work environment. This digitalization also takes place in product development, with the integration of many technologies, such as Industry 4.0, digital twins or data-driven methods, to improve the quality of new products and to save time and costs during the development process. Therefore, the use of data-driven methods reusing existing data has great potential. However, data from product design are very diverse and strongly depend on the respective development phase. One of the first few product representations are sketches and drawings, which represent the product in a simplified and condensed way. But, to reuse the data, the existing sketches must be found with an automated approach, allowing the contained information to be utilized. One approach to solve this problem is presented in this paper, with the detection of principle sketches in the early phase of the development process. The aim is to recognize the symbols in these sketches automatically with object detection models. Therefore, existing approaches were analyzed and a new procedure developed, which uses synthetic training data generation. In the next step, a total of six different data generation types were analyzed and tested using six different one- and two-stage detection models. The entire procedure was then evaluated on two unknown test datasets, one focusing on different gearbox variants and a second dataset derived from CAD assemblies. In the last sections the findings are discussed and a procedure with high detection accuracy is determined. [ABSTRACT FROM AUTHOR]

Gear fault detection and remaining useful life estimation are important tasks for monitoring the health of rotating machinery. In this study, a new benchmark for endurance gear vibration signals is presented and made publicly available. The new dataset was used in the HUMS 2023 conference data challenge to test anomaly detection algorithms. A survey of the suggested techniques is provided, demonstrating that traditional signal processing techniques interestingly outperform deep learning algorithms in this case. Of the 11 participating groups, only those that used traditional approaches achieved good results on most of the channels. Additionally, we introduce a signal processing anomaly detection algorithm and meticulously compare it to a standard deep learning anomaly detection algorithm using data from the HUMS 2023 challenge and simulated signals. The signal processing algorithm surpasses the deep learning algorithm on all tested channels and also on simulated data where there is an abundance of training data. Finally, we present a new digital twin that enables the estimation of the remaining useful life of the tested gear from the HUMS 2023 challenge. [ABSTRACT FROM AUTHOR]

The safe and steady operation of hydropower generation systems is crucial for electricity output in the grid. However, hydropower stations have complicated interior structures, making defect detection difficult without disassembly inspections. The application of digital modeling to hydropower stations will effectively promote the intelligent transformation of hydropower stations as well as reduce the maintenance costs of the system. This study provides a model of the power generating and transmission system for hydropower plants, with an emphasis on primary equipment and measured data. The model utilizes PSCAD to digitalize state response in hydropower plants with various short-circuit faults. The fault information is identified and learned using the Adaptive Time–Frequency Memory (AD-TFM) deep learning model. It is demonstrated that our proposed method can effectively obtain the fault information through radio frequency identification (RFID). The accuracy of the traditional method is 0.90, while the results for AD-TFM show a fault classification accuracy of 0.92, which is more than enough to identify multiple fault types compared to the existing methods. [ABSTRACT FROM AUTHOR]

Urban water management faces new challenges due to the rise of digital solutions and abundant data, leading to the development of data-centric tools for decision-making in global water utilities, with AI technologies poised to become a key trend in the sector. This paper proposes a novel methodology for optimal sensor placement aimed at supporting the creation of a digital twin for water infrastructure. A significant innovation in this study is the creation of a metamodel to estimate pressure at consumption nodes in a water supply system. This metamodel guides the optimal sensor configuration by minimizing the difference between estimated and observed pressures. Our methodology was tested on a synthetic case study, showing accurate results. The estimated pressures at each network node exhibited low error and high accuracy across all sensor configurations tested, highlighting the potential for future development of a digital twin for water distribution systems. [ABSTRACT FROM AUTHOR]

Effective monitoring of road fixtures is essential for urban safety and functionality. However, traditional inspections are time-consuming, costly, and error prone, while current automated solutions struggle with high initial setup costs, limited flexibility preventing wide adaptation, and reliance on centralized processing that can delay response times. This study introduces an edge AI-based remote road fixture monitoring system which automatically and continuously updates the information of the road digital twin (DT). The main component is a small-sized edge device consisting of a camera, GPS, and IMU sensors designed to be installed in typical cars. The device captures images, detects the fixture, and estimates their location by employing deep learning and feature matching. This information is transmitted to a dedicated cloud server and represented on a user-friendly user interface. Experiments were conducted to test the system's performance. The results showed that the device could successfully detect the fixture and estimate their global coordinates. Outputs were marked and shown on the road DT, proving the integrated and smooth operation of the whole system. The proposed Edge AI device demonstrated that it could significantly reduce the data size by 80–84% compared to traditional methods. With a satisfactory object detection accuracy of 65%, the system effectively identifies traffic poles, stop signs, and streetlights, integrating these findings into a digital twin for real-time monitoring. The proposed system improves road monitoring by cutting down on maintenance and emergency response times, increasing the ease of data use, and offering a foundation for an overview of urban road fixtures' current state. However, the system's reliance on the quality of data collected under varying environmental conditions suggests potential improvements for consistent performance across diverse scenarios. [ABSTRACT FROM AUTHOR]

To facilitate the integration of autonomous unmanned air vehicles (UAVs) in day-to-day life, it is imperative that safe navigation can be demonstrated in all relevant scenarios. For UAVs using a navigational protocol driven by artificial neural networks, training and testing data from multiple environmental contexts are needed to ensure that bias is minimised. The reduction in predictive capacity when faced with unfamiliar data is a common weak point in trained networks, which worsens the further the input data deviates from the training data. However, training for multiple environmental variables dramatically increases the man-hours required for data collection and validation. In this work, a potential solution to this data availability issue is presented through the generation and evaluation of photo-realistic image datasets from a simulation of 3D-scanned physical spaces which are theoretically linked in a digital twin (DT) configuration. This simulation is then used to generate environmentally varied iterations of the target object in that physical space by two contextual variables (weather and daylight). This results in an expanded dataset of bicycles that contains weather and time-varied components of the same images which are then evaluated using a generic build of the YoloV3 object detection network; the response is then compared to two real image (night and day) datasets as a baseline. The results reveal that the network response remained consistent across the temporal axis, maintaining a measured domain shift of approximately 23% between the two baselines. [ABSTRACT FROM AUTHOR]

Due to various factors such as aging, natural environment erosion, and man-made destruction, architectural heritage has formed various diseases and cracks, especially in pathology cracks, which are the most typical masonry–timber architectural heritages, directly affecting the structural stability of masonry–timber buildings. This paper uses artificial intelligence and architecture and other multi-disciplinary research methods, taking James Jackson Gymnasium, a famous masonry–timber architectural heritage in Wuhan, as an example, using 3D laser scanning technology to obtain disease details and crack data of architectural heritage, using a Mask R-CNN model to detect crack area, using an FCN model to identify and calculate single cracks, and finally summarizing the type, location, and characteristics of cracks, analyzing the causes of cracks, and then putting forward corresponding hierarchical restoration strategies. The research results build a set of detection and repair systems of masonry–timber architectural heritage pathology cracks, which provide a set of accurate and objective pathology cracks data for architectural heritage protection and repair, and provide a reference for architectural heritage repair. [ABSTRACT FROM AUTHOR]

Mechanistic learning refers to the synergistic combination of mechanistic mathematical modeling and data-driven machine or deep learning. This emerging field finds increasing applications in (mathematical) oncology. This review aims to capture the current state of the field and provides a perspective on how mechanistic learning may progress in the oncology domain. We highlight the synergistic potential of mechanistic learning and point out similarities and differences between purely data-driven and mechanistic approaches concerning model complexity, data requirements, outputs generated, and interpretability of the algorithms and their results. Four categories of mechanistic learning (sequential, parallel, extrinsic, intrinsic) of mechanistic learning are presented with specific examples. We discuss a range of techniques including physics-informed neural networks, surrogate model learning, and digital twins. Example applications address complex problems predominantly from the domain of oncology research such as longitudinal tumor response predictions or time-to-event modeling. As the field of mechanistic learning advances, we aim for this review and proposed categorization framework to foster additional collaboration between the data- and knowledge-driven modeling fields. Further collaboration will help address difficult issues in oncology such as limited data availability, requirements of model transparency, and complex input data which are embraced in a mechanistic learning framework. [ABSTRACT FROM AUTHOR]

3D point clouds are a relevant source of information for multiple applications, including digital twins, building modeling, disaster and risk management, forestry, autonomous driving, and many others. Assigning points to the semantic classes is one of the essential data interpretation steps to effectively use them for further analysis. Deep learning models for semantic segmentation, such as RandLA-Net, are state-of-the-art methods for this task. Although the overall accuracy of classification is usually satisfactory,there are still several shortcomings not allowing assigning correct labels across all the classes. For instance, the receptive field of these networks is often too small to correctly classify point clouds in all cases. These networks suffer also from class imbalance, typical in real-world data sets, and tend to oversmooth small classes. Post-processing approaches help to overcome these problems and achieve better classification accuracy. In this work, we investigate the feasibility of improving the deep-learning outputs by introducing prior knowledge. To do this, the output probabilities of point classes obtained using RandLA-Net are post-processed with a workflow based on Markov Random Fields, in which the unary potentials are adjusted to preserve smaller classes while the pairwise potentials take into account. a hand-tailored inter-class reliability matrix. To validate our method, we apply it to the Hessigheim benchmark. Our MRF-based approach further optimizes these prediction results, effectively and efficiently improving the overall accuracy by approximately 1 to 2 percentage points. [ABSTRACT FROM AUTHOR]

The development of novel and robust digital methods to support the maintenance of existing road infrastructure requires a large amount of harmonized data. Especially in the context of automated modelling having a large amount of matching data from different perspectives enables disruptive, new use cases that might largely impact the efficiency in maintenance of the built environment. Unfortunately, such data compositions are tedious to collect in real world applications, due to many influential factors, leading to deviations between multiple data sources and the sheer complexity in the process of creating a digital model. However, for deep learning applications, a large amount of carefully annotated data is necessary for robust estimations. In this contribution, we tackle this problem by presenting a novel procedural modelling and model configuration approach for generating homogeneous data combinations to step towards direct parameter estimation for machine learning approaches utilizing point clouds of roads and end-to-end model generation of digital road models. [ABSTRACT FROM AUTHOR]

Combining remote-sensing data with in-situ observations to achieve a comprehensive 3D reconstruction of the ocean state presents significant challenges for traditional interpolation techniques. To address this, we developed the CLuster Optimal Interpolation Neural Network (CLOINet), which combines the robust mathematical framework of the Optimal Interpolation (OI) scheme with a self-supervised clustering approach. CLOINet efficiently segments remote sensing images into clusters to reveal non-local correlations, thereby enhancing fine-scale oceanic reconstructions. We trained our network using outputs from an Ocean General Circulation Model (OGCM), which also facilitated various testing scenarios. Our Observing System Simulation Experiments aimed to reconstruct deep salinity fields using Sea Surface Temperature (SST) or Sea Surface Height (SSH), alongside sparse in-situ salinity observations. The results showcased a significant reduction in reconstruction error up to 40% and the ability to resolve scales 50% smaller compared to baseline OI techniques. Remarkably, even though CLOINet was trained exclusively on simulated data, it accurately reconstructed an unseen SST field using only glider temperature observations and satellite chlorophyll concentration data. This demonstrates how deep learning networks like CLOINet can potentially lead the integration of modeling and observational efforts in developing an ocean digital twin. [ABSTRACT FROM AUTHOR]

Urban Air Mobility (UAM) emerges as a transformative approach to address urban congestion and pollution, offering efficient and sustainable transportation for people and goods. Central to UAM is the Operational Digital Twin (ODT), which plays a crucial role in real-time management of air traffic, enhancing safety and efficiency. This study introduces a YOLOTransfer-DT framework specifically designed for Artificial Intelligence (AI) training in simulated environments, focusing on its utility for experiential learning in realistic scenarios. The framework's objective is to augment AI training, particularly in developing an object detection system that employs visual tasks for proactive conflict identification and mission support, leveraging deep and transfer learning techniques. The proposed methodology combines real-time detection, transfer learning, and a novel mix-up process for environmental data extraction, tested rigorously in realistic simulations. Findings validate the use of existing deep learning models for real-time object recognition in similar conditions. This research underscores the value of the ODT framework in bridging the gap between virtual and actual environments, highlighting the safety and cost-effectiveness of virtual testing. This adaptable framework facilitates extensive experimentation and training, demonstrating its potential as a foundation for advanced detection techniques in UAM. [ABSTRACT FROM AUTHOR]

Although brain tumours are few, they have one of the highest mortality rates among all types of cancer due to their abnormal growth and proliferation. Brain tumours develop due to the accumulation of abnormal tissues in the brain. Various forms of abnormal tissue exist, however, in the majority of cases, they develop in a regular manner and perish without creating any detrimental effects. Digital twins are occasionally known as digital mirrors, digital mapping, and digital replicas. All of these are synonymous terms for the identical entity. It is a technique for transferring digital or physical information from one realm to another. Image processing involves enhancing or eliminating data from a photograph to achieve a certain objective. Convolutional neural networks are a specific type of neural network that take signals from images as input and produce the image itself or a subset of its elements as output. This research presents a technique for identifying brain cancers using digital replicas and advanced machine learning algorithms by analysing MRI images. Images obtained from MRI machines are stored in a centralised cloud using Internet of Things (IoT) digital devices. The input pictures and other health-related data are then retrieved from cloud storage. The Particle Swarm Optimization approach chooses features. Brain tumor images are classified using machine learning techniques such as convolutional neural networks, support vector machines, and extreme learning machines. The CNN algorithm demonstrates greater accuracy when assessing MRI images for the purpose of identifying brain tumours.

In this work, the authors present a digital twin (DT) to analyse the manufacturing process of structural composites by using resin transfer moulding (RTM). During RTM, a dry textile preform is impregnated with a polymer resin injected in a closed mould. RTM is one of the most used production methods for high-performance structural composites. The DT is focused on detecting in-homogeneous resin flow produced by race-tracking channels that divert resin flow to the outlet gates of the mould, producing dry spots and lack of impregnation. The DT core contains two surrogate models based on encoder/decoder deep learning architectures, providing the fast/accurate response necessary for interrogation during manufacturing. The first surrogate acts as the disturbance detector, providing the on-the-fly representation of the fabric permeability with the only information gathered by a set of five pressure sensors distributed over the mould surface. The second offers real-time representation of a set of quantities of interests (QoI): namely, the flow progress and the pressure field inside the mould. Training of both surrogates was performed with synthetic data generated by high-fidelity multi-physics simulations of the flow progress in a porous preform by following Darcy's law. Errors in the pressure field predictions of the surrogates are lower than 1 % with consultation time <50 ms, enabling encapsulation in the digital twin. The DT performance was evaluated by comparing the response against a set of RTM experiments for different race-tracking scenarios. The two most relevant novelties of the work are the use of the concept of the instantiated DT, which provides information on the current state of the process from data provided by a network of distributed sensors, and that this DT has been trained exclusively with synthetic data from multiphysics simulations while evaluated against experimental data from injection tests. [ABSTRACT FROM AUTHOR]

This survey provides a comprehensive overview of traditional techniques and deep learning-based methodologies for monocular visual odometry (VO), with a focus on displacement measurement applications. This paper outlines the fundamental concepts and general procedures for VO implementation, including feature detection, tracking, motion estimation, triangulation, and trajectory estimation. This paper also explores the research challenges inherent in VO implementation, including scale estimation and ground plane considerations. The scientific literature is rife with diverse methodologies aiming to overcome these challenges, particularly focusing on the problem of accurate scale estimation. This issue has been typically addressed through the reliance on knowledge regarding the height of the camera from the ground plane and the evaluation of feature movements on that plane. Alternatively, some approaches have utilized additional tools, such as LiDAR or depth sensors. This survey of approaches concludes with a discussion of future research challenges and opportunities in the field of monocular visual odometry. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in terms of diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish the digital representation of a patient's respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-rays into five distinct categories of lung diseases, including "normal", "covid", "lung_opacity", "pneumonia", and "tuberculosis". The performance of the system was evaluated employing a chest X-ray dataset available in the literature, demonstrating average accuracy of 96.8%, precision of 92%, recall of 97%, and F1-score of 94%. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient's respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights as to personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation. [ABSTRACT FROM AUTHOR]

Due to the harsh environment of highway tunnels and frequent breakdowns of various detection sensors and surveillance devices, the operational management of highway tunnels lacks effective data support. This paper analyzes the characteristics of operational surveillance data in highway tunnels. It proposes a multimodal information fusion method based on CNN-LSTM-attention and designs and develops a digital twin for highway tunnel operations. The system addresses issues such as insufficient development and coordination of the technical architecture of operation control systems, weak information service capabilities, and insufficient data application capabilities. The system also lacks intelligent decision-making and control capabilities. The developed system achieves closed-loop management of "accurate perception-risk assessment-decision warning-emergency management" for highway tunnel operations based on data-driven approaches. The engineering demonstration application underscores the system's capacity to enhance tunnel traffic safety, diminish tunnel management costs, and elevate tunnel driving comfort. [ABSTRACT FROM AUTHOR]

For a lithium-ion (Li-ion) battery to operate safely and reliably, an accurate state of health (SOH) estimation is crucial. Data-driven models with manual feature extraction are commonly used for battery SOH estimation, requiring extensive expert knowledge to extract features. In this regard, a novel data pre-processing model is proposed in this paper to extract health-related features automatically from battery-discharging data for SOH estimation. In the proposed method, one-dimensional (1D) voltage data are converted to two-dimensional (2D) data, and a new data set is created using a 2D sliding window. Then, features are automatically extracted in the machine learning (ML) training process. Finally, the estimation of the SOH is achieved by forecasting the battery voltage in the subsequent cycle. The performance of the proposed technique is evaluated on the NASA public data set for a Li-ion battery degradation analysis in four different scenarios. The simulation results show a considerable reduction in the RMSE of battery SOH estimation. The proposed method eliminates the need for the manual extraction and evaluation of features, which is an important step toward automating the SOH estimation process and developing battery digital twins. [ABSTRACT FROM AUTHOR]

Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause "all-black images." A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes "all-black images." In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur. [ABSTRACT FROM AUTHOR]

Three-dimensional semantic segmentation is the foundation for automatically creating enriched Digital Twin Cities (DTCs) and their updates. For this task, prior-level fusion approaches show more promising results than other fusion levels. This article proposes a new approach by developing and benchmarking three prior-level fusion scenarios to enhance the outcomes of point cloud-enriched semantic segmentation. The latter were compared with a baseline approach that used the point cloud only. In each scenario, specific prior knowledge (geometric features, classified images, or classified geometric information) and aerial images were fused into the neural network's learning pipeline with the point cloud data. The goal was to identify the one that most profoundly enhanced the neural network's knowledge. Two deep learning techniques, "RandLaNet" and "KPConv", were adopted, and their parameters were modified for different scenarios. Efficient feature engineering and selection for the fusion step facilitated the learning process and improved the semantic segmentation results. Our contribution provides a good solution for addressing some challenges, particularly for more accurate extraction of semantically rich objects from the urban environment. The experimental results have demonstrated that Scenario 1 has higher precision (88%) on the SensatUrban dataset compared to the baseline approach (71%), the Scenario 2 approach (85%), and the Scenario 3 approach (84%). Furthermore, the qualitative results obtained by the first scenario are close to the ground truth. Therefore, it was identified as the efficient fusion approach for point cloud-enriched semantic segmentation, which we have named the efficient prior-level fusion (Efficient-PLF) approach. [ABSTRACT FROM AUTHOR]

Industrial collaborative robots play an essential role in smart manufacturing because they improve productivity while also ensuring workplace safety. However, the development of prognostic and health management systems to ensure the reliability of these robots has been a major challenge due to the lack of fault data. This paper proposed a digital twin scheme based on the fusion of the robot kinematic and dynamic models' information down to the powertrains (i.e., the joints motor, and gear) along with the control algorithms and uncertainty accommodation based upon deep learning. The presented digital twin concept has the potential to propel simulation-based fault prediction. We also highlight and discuss challenges and opportunities around the development of the hybrid digital twin for condition monitoring of industrial collaborative robots. [ABSTRACT FROM AUTHOR]

The rapid advancement of deep learning and computer vision has driven the intelligent evolution of fire detection, quantification and fighting, although most AI models remain opaque black boxes. This work applies explainable deep learning methods to quantify fire power by flame images and aims to elucidate the underlying mechanism of computer-vision fire calorimetry. The process begins with the utilization of a pre-trained fire segmentation model to create a flame image database in various formats: (1) original RGB, (2) background-free RGB, (3) background-free grey, and (4) background-free binary. This diverse database accounts for factors such as background, color, and brightness. Then, the synthetic database is employed to train and test the fire-calorimetry AI model. Results highlight the dominant role of determining flame area in fire calorimetry, while other factors displaying minimal influence. Enhancing the accuracy of flame segmentation significantly reduces error in computer-vision fire calorimetry to less than 20%. Finally, the study incorporates the Gradient-weighted Class Activation Mapping (Grad-CAM) method to visualize the pixel-level contribution to fire image identification. This research deepens the understanding of vision-based fire calorimetry and providing scientific support for future AI applications in fire monitoring, digital twin, and smart firefighting. [ABSTRACT FROM AUTHOR]

In recent decades, there have been significant research efforts focusing on wireless indoor localization systems, with fingerprinting techniques based on received signal strength leading the way. The majority of the suggested approaches require challenging and laborious Wi-Fi site surveys to construct a radio map, which is then utilized to match radio signatures with particular locations. In this paper, a novel next-generation cyber-physical wireless indoor positioning system is presented that addresses the challenges of fingerprinting techniques associated with data collection. The proposed approach not only facilitates an interactive digital representation that fosters informed decision-making through a digital twin interface but also ensures adaptability to new scenarios, scalability, and suitability for large environments and evolving conditions during the process of constructing the radio map. Additionally, it reduces the labor cost and laborious data collection process while helping to increase the efficiency of fingerprint-based positioning methods through accurate ground-truth data collection. This is also convenient for working in remote environments to improve human safety in locations where human access is limited or hazardous and to address issues related to radio map obsolescence. The feasibility of the cyber-physical system design is successfully verified and evaluated with real-world experiments in which a ground robot is utilized to obtain a radio map autonomously in real-time in a challenging environment through an informed decision process. With the proposed setup, the results demonstrate the success of RSSI-based indoor positioning using deep learning models, including MLP, LSTM Model 1, and LSTM Model 2, achieving an average localization error of ≤ 2.16 m in individual areas. Specifically, LSTM Model 2 achieves an average localization error as low as 1.55 m and 1.97 m with 83.33 % and 81.05 % of the errors within 2 m for individual and combined areas, respectively. These outcomes demonstrate that the proposed cyber-physical wireless indoor positioning approach, which is based on the application of dynamic Wi-Fi RSS surveying through human feedback using autonomous mobile robots, effectively leverages the precision of deep learning models, resulting in localization performance comparable to the literature. Furthermore, they highlight its potential for suitability for deployment in real-world scenarios and practical applicability. [ABSTRACT FROM AUTHOR]

The rapid rise of artificial intelligence (AI) in medicine in the last few years highlights the importance of developing bigger and better systems for data and model sharing. However, the presence of Protected Health Information (PHI) in medical data poses a challenge when it comes to sharing. One potential solution to mitigate the risk of PHI breaches is to exclusively share pre-trained models developed using private datasets. Despite the availability of these pre-trained networks, there remains a need for an adaptable environment to test and fine-tune specific models tailored for clinical tasks. This environment should be open for peer testing, feedback, and continuous model refinement, allowing dynamic model updates that are especially important in the medical field, where diseases and scanning techniques evolve rapidly. In this context, the Discovery Viewer (DV) platform was developed in-house at the Biomedical Engineering and Imaging Institute at Mount Sinai (BMEII) to facilitate the creation and distribution of cutting-edge medical AI models that remain accessible after their development. The all-in-one platform offers a unique environment for non-AI experts to learn, develop, and share their own deep learning (DL) concepts. This paper presents various use cases of the platform, with its primary goal being to demonstrate how DV holds the potential to empower individuals without expertise in AI to create high-performing DL models. We tasked three non-AI experts to develop different musculoskeletal AI projects that encompassed segmentation, regression, and classification tasks. In each project, 80% of the samples were provided with a subset of these samples annotated to aid the volunteers in understanding the expected annotation task. Subsequently, they were responsible for annotating the remaining samples and training their models through the platform's "Training Module". The resulting models were then tested on the separate 20% hold-off dataset to assess their performance. The classification model achieved an accuracy of 0.94, a sensitivity of 0.92, and a specificity of 1. The regression model yielded a mean absolute error of 14.27 pixels. And the segmentation model attained a Dice Score of 0.93, with a sensitivity of 0.9 and a specificity of 0.99. This initiative seeks to broaden the community of medical AI model developers and democratize the access of this technology to all stakeholders. The ultimate goal is to facilitate the transition of medical AI models from research to clinical settings. [ABSTRACT FROM AUTHOR]

The article discusses the modeling of the use of digital twin technologies (a digital twin) for the task of organizing long-term storage of various types of documents. A digital twin in this respect differs from a digital copy, which has no connection with the real original object. A review of the problem was carried out. We argue that, despite the active use of digital twin technology in various areas, its applications in the area of long-term storage of documents remain limited. At the same time, the task of increasing the durability of documents during long-term storage remains important and largely unresolved. The complexity of solving the problem of long-term storage of documents is considered, and a formal statement of the problem of long-term storage using digital twin technologies is carried out. Destructive factors that affect long-term storage documents and significantly reduce their durability have been identified. A system of indicators has been developed to assess the durability (preservation) of documents. The modeling of the use of digital twin technology in the organization of long-term preservation within the framework of Industry 4.0 was carried out. In the course of modeling, the goals and the strategies of long-term storage were established. Primary mathematical models for controlling destructive factors as well as technological solutions for digital twin long-term storage are proposed. It is assumed that the key part of this technology is the Industrial Internet of Things. The effectiveness of the use of digital twin technologies for solving the problem was assessed. The spheres of application and further ways of research are determined. [ABSTRACT FROM AUTHOR]

As the complexity and scale of modern networks continue to grow, the need for efficient, secure management, and optimization becomes increasingly vital. Digital twin (DT) technology has emerged as a promising approach to address these challenges by providing a virtual representation of the physical network, enabling analysis, diagnosis, emulation, and control. The emergence of Software-defined network (SDN) has facilitated a holistic view of the network topology, enabling the use of Graph neural network (GNN) as a data-driven technique to solve diverse problems in future networks. This survey explores the intersection of GNNs and Network digital twins (NDTs), providing an overview of their applications, enabling technologies, challenges, and opportunities. We discuss how GNNs and NDTs can be leveraged to improve network performance, optimize routing, enable network slicing, and enhance security in future networks. Additionally, we highlight certain advantages of incorporating GNNs into NDTs and present two case studies. Finally, we address the key challenges and promising directions in the field, aiming to inspire further advancements and foster innovation in GNN-based NDTs for future networks. [ABSTRACT FROM AUTHOR]

This article examines the incorporation of the Shopping Assistance Automatic Suggestion (SAAS) model into Virtual Reality (VR) environments in order to improve the online shopping experience. The SAAS model employs sophisticated deep learning methods to offer customized product recommendations, which are conveyed by non-player characters (NPCs) via voice-based interactions. Our goal is to develop an interactive shopping experience that replicates real-life interactions by integrating AI-powered recommendations with immersive VR technology. We gather and standardize data from several open commerce databases, such as Amazon Product and Customer Reviews. The SAAS model, in conjunction with GPT-3, BERT, and T5, undergoes training and testing to evaluate its effectiveness across multiple criteria. The results demonstrate that the SAAS model surpasses other models in delivering contextually aware and pertinent recommendations. The integration process outlines the specific steps involved in capturing, processing, and transforming user interactions in virtual reality (VR) into vocal suggestions provided by non-player characters (NPCs). This strategy improves customization and utilizes the immersive features of virtual reality to effectively engage people. The results of our research establish a higher standard for e-commerce, with the goal of enhancing the user experience of online purchasing by making it more instinctive, engaging, and pleasurable.

Environmental effects may lead to cracking, stiffness loss, brace damage, and other damages in bridges, frame structures, buildings, etc. Structural Health Monitoring (SHM) technology could prevent catastrophic events by detecting damage early. In recent years, Deep Learning (DL) has developed rapidly and has been applied to SHM to detect, localize, and evaluate diverse damages through efficient feature extraction. This paper analyzes 337 articles through a systematic literature review to investigate the application of DL for SHM in the operation and maintenance phase of facilities from three perspectives: data, DL algorithms, and applications. Firstly, the data types in SHM and the corresponding collection methods are summarized and analyzed. The most common data types are vibration signals and images, accounting for 80% of the literature studied. Secondly, the popular DL algorithm types and application areas are reviewed, of which CNN accounts for 60%. Then, this article carefully analyzes the specific functions of DL application for SHM based on the facility's characteristics. The most scrutinized study focused on cracks, accounting for 30 percent of research papers. Finally, challenges and trends in applying DL for SHM are discussed. Among the trends, the Structural Health Monitoring Digital Twin (SHMDT) model framework is suggested in response to the trend of strong coupling between SHM technology and Digital Twin (DT), which can advance the digitalization, visualization, and intelligent management of SHM. [ABSTRACT FROM AUTHOR]

Network Function Virtualization (NFV) allows for the dynamic provisioning of Virtual Network Functions (VNFs), adapting services to the complex and dynamic network environment to enhance network performance. However, VNF migration and energy consumption pose significant challenges due to the dynamic nature of the physical network. In order to maximize the acceptance rate of Service Function Chain Requests (SFCR), and reduce VNF migration and energy consumption as much as possible, we summarize several related factors such as the node hosting state, link hosting state, energy consumption, migrated nodes, and whether the mapping is successful. We define the Markov decision process by considering the factors mentioned above. Next, we design the VNF migration algorithm utilizing actor–critic models, graph convolution networks, and LSTM networks. In order to reduce the risk of trial and error during training and prediction in deep reinforcement learning scenarios, we designed a network architecture based on a digital twin (DT). In simulation experiments, compared with the FF algorithm that greedily selects the first available node, our AC_GCN algorithm significantly improves the acceptance rate of SFC requests by 2.9 times more than the FF algorithm in small topology experiments, and 27 times more than the FF algorithm in large topology experiments. Compared with the deep reinforcement learning (DRL) algorithm, which does not consider all the above factors together, for the small topology experiment, our AC_GCN algorithm outperforms the DRL algorithm in terms of request acceptance rate by 13%, underperforms compared to the DRL algorithm in terms of energy consumption by 3.8%, and underperforms compared to the DRL algorithm in terms of the number of migrated nodes for 22%; for the large topology experiment, our AC_GCN algorithm outperforms the DRL algorithm in terms of the request acceptance rate by 7.7%, outperforms the DRL algorithm in terms of energy consumption by 0.4%, and outperforms the DRL algorithm in terms of the number of migrated nodes by 1.6%. [ABSTRACT FROM AUTHOR]

As human–robot interaction becomes more prevalent in industrial and clinical settings, detecting changes in human posture has become increasingly crucial. While recognizing human actions has been extensively studied, the transition between different postures or movements has been largely overlooked. This study explores using two deep-learning methods, the linear Feedforward Neural Network (FNN) and Long Short-Term Memory (LSTM), to detect changes in human posture among three different movements: standing, walking, and sitting. To explore the possibility of rapid posture-change detection upon human intention, the authors introduced transition stages as distinct features for the identification. During the experiment, the subject wore an inertial measurement unit (IMU) on their right leg to measure joint parameters. The measurement data were used to train the two machine learning networks, and their performances were tested. This study also examined the effect of the sampling rates on the LSTM network. The results indicate that both methods achieved high detection accuracies. Still, the LSTM model outperformed the FNN in terms of speed and accuracy, achieving 91% and 95% accuracy for data sampled at 25 Hz and 100 Hz, respectively. Additionally, the network trained for one test subject was able to detect posture changes in other subjects, demonstrating the feasibility of personalized or generalized deep learning models for detecting human intentions. The accuracies for posture transition time and identification at a sampling rate of 100 Hz were 0.17 s and 94.44%, respectively. In summary, this study achieved some good outcomes and laid a crucial foundation for the engineering application of digital twins, exoskeletons, and human intention control. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) have been widely used for object recognition and grasping posture planning in intelligent robotic grasping (IRG). Compared with the traditional usage of CNNs in image recognition, IRGs require high recognition accuracy and computational efficiency. However, the existing methodologies for CNN architecture design often rely on human experience and numerous trial-and-error attempts, which make it a very challenging task to obtain an optimal CNN for IRGs. To tackle this challenge, this paper develops a new differentiable architecture search (DARTS) method considering the floating-point operations (FLOPs) of CNNs, named the DARTS-F method, which converts the discrete CNN architecture search to a gradient-based continuous optimization problem and considers both the prediction accuracy and the computational cost of the CNN during the optimization. To efficiently identify the optimal neural network, this paper adopts a bilevel optimization, which first trains the neural network weights in the inner level and then optimizes the neural network architecture by fine-tuning the operational variables in the outer level. In addition, a new digital twin (DT) of IRG is developed considering the physics of realistic robotic grasping in the DT's virtual space, which could not only improve the IRG accuracy but also avoid the expensive training time. In the experiments, the proposed DARTS-F method could generate an optimized CNN with higher prediction accuracy and lower FLOPs than those obtained by the original DARTS method. The DT framework improves the accuracy of real robotic grasping from 61 to 71%. [ABSTRACT FROM AUTHOR]

Collaborative tasks in multiple systems have attracted considerable attention in contemporary manufacturing environments. Collaborative robots are representative agents for various collaborative industrial tasks. This study focuses on contactless delivery by considering multiple agents. A contactless delivery operation must be performed with well-synchronized cooperation among the sender, a receiver, and flying dynamics of the deliverable. The most challenging task is to predict the catching point of a thrown package by considering both collaborative robots. Accurate catching-point prediction and relevant operations were achieved using the proposed physics-informed neural network-based hybrid multi-stream deep learning framework. Various cooperative environments were considered using multi-modal input data and manufacturing conditions. The proposed framework incorporates these constraints, and the prediction is guided by flying dynamics and trajectory data. The effectiveness of the proposed framework was demonstrated by implementing multi-agent and related manufacturing environments in a digital twin system. The effectiveness of the proposed framework was proven experimentally using analyses and comparisons with existing machine learning methods. [ABSTRACT FROM AUTHOR]

This review paper addresses the critical need for structural prognostics and health management (SPHM) in aircraft maintenance, highlighting its role in identifying potential structural issues and proactively managing aircraft health. With a comprehensive assessment of various SPHM techniques, the paper contributes by comparing traditional and modern approaches, evaluating their limitations, and showcasing advancements in data-driven and model-based methodologies. It explores the implementation of machine learning and deep learning algorithms, emphasizing their effectiveness in improving prognostic capabilities. Furthermore, it explores model-based approaches, including finite element analysis and damage mechanics, illuminating their potential in the diagnosis and prediction of structural health issues. The impact of digital twin technology in SPHM is also examined, presenting real-life case studies that demonstrate its practical implications and benefits. Overall, this review paper will inform and guide researchers, engineers, and maintenance professionals in developing effective strategies to ensure aircraft safety and structural integrity. [ABSTRACT FROM AUTHOR]

Due to the recent rapid development of the ICT (Information and Communications Technology) field, the industrial sector is also experiencing rapid informatization. As a result, malware targeting information leakage and financial gain are increasingly found within IIoT (the Industrial Internet of Things). Moreover, the number of malware variants is rapidly increasing. Therefore, there is a pressing need for a safe and preemptive malware detection method capable of responding to these rapid changes. The existing malware detection method relies on specific byte sequence inclusion in a binary file. However, this method faces challenges in impacting the system or detecting variant malware. In this paper, we propose a data augmentation method based on an adversarial generative neural network to maintain a secure system and acquire necessary learning data. Specifically, we introduce a digital twin environment to safeguard systems and data. The proposed system creates fixed-size images from malware binaries in the virtual environment of the digital twin. Additionally, it generates new malware through an adversarial generative neural network. The image information produced in this manner is then employed for malware detection through deep learning. As a result, the detection performance, in preparation for the emergence of new malware, demonstrated high accuracy, exceeding 97%. [ABSTRACT FROM AUTHOR]

Digital twins (DTs) are becoming increasingly popular in various industries, and their potential for healthcare in the metaverse continues to attract attention. The metaverse is a virtual world where individuals interact with digital replicas of themselves and the environment. This paper focuses on personalized and precise medicine and examines the current application of DTs in healthcare within the metaverse. Healthcare practitioners may use immersive virtual worlds to replicate medical scenarios, improve teaching experiences, and provide personalized care to patients. However, the integration of DTs in the metaverse poses technical, regulatory, and ethical challenges that need to be addressed, including data privacy, standards, and accessibility. Through this examination, we aim to provide insights into the transformative potential of DTs in healthcare within the metaverse and encourage further research and development in this exciting domain. [ABSTRACT FROM AUTHOR]

In this study, we propose a population-based, data-driven intelligent controller that leverages neural-network-based digital twins for hypothesis testing. Initially, a diverse set of control laws is generated using genetic programming with the digital twin of the system, facilitating a robust response to unknown disturbances. During inference, the trained digital twin is utilized to virtually test alternative control actions for a multi-objective optimization task associated with each control action. Subsequently, the best policy is applied to the system. To evaluate the proposed model predictive control pipeline, experiments are conducted on a multi-mode heat transfer test rig. The objective is to achieve homogeneous cooling over the surface, minimizing the occurrence of hot spots and energy consumption. The measured variable vector comprises high dimensional infrared camera measurements arranged as a sequence (655,360 inputs), while the control variable includes power settings for fans responsible for convective cooling (3 outputs). Disturbances are induced by randomly altering the local heat loads. The findings reveal that by utilizing an evolutionary algorithm on measured data, a population of control laws can be effectively learned in the virtual space. This empowers the system to deliver robust performance. Significantly, the digital twin-assisted, population-based model predictive control (MPC) pipeline emerges as a superior approach compared to individual control models, especially when facing sudden and random changes in local heat loads. Leveraging the digital twin to virtually test alternative control policies leads to substantial improvements in the controller's performance, even with limited training data. [ABSTRACT FROM AUTHOR]

Digital twin is the digital representation of an entity, and it drives Industry 4.0. This paper presents a bibliometric analysis of digital twin in the supply chain to help researchers, industry practitioners, and academics to understand the trend, development, and focus of the areas of digital twin in the supply chain. This paper found several key clusters of research, including the designing of a digital twin model, integration of a digital twin model, application of digital twin in quality control, and digital twin in digitalization. In the embryonic stage of research, digital twin was tested in the production line with limited optimization. In the development stage, the importance of digital twin in Industry 4.0 was observed, as big data, machine learning, Industrial Internet of Things, blockchain, edge computing, and cloud-based systems complemented digital twin models. Digital twin was applied to improve sustainability in manufacturing and production logistics. In the current prosperity stage with high annual publications, the recent trends of this topic focus on the integration of deep learning, data models, and artificial intelligence for digitalization. This bibliometric analysis also found that the COVID-19 pandemic drove the start of the prosperity stage of digital twin research in the supply chain. Researchers in this field are slowly moving towards applying digital twin for human-centric systems and mass personalization to prepare to transit to Industry 5.0. [ABSTRACT FROM AUTHOR]

Intelligent digital twins closely resemble their real-life counterparts. In health and medical care, they enable the real-time monitoring of patients, whereby large amounts of data can be collected to produce actionable information. These powerful tools are constructed with the aid of artificial intelligence, machine learning, and deep learning; the Internet of Things; and cloud computing to collect a diverse range of digital data (e.g., from digital patient journals, wearable sensors, and digitized monitoring equipment or processes), which can provide information on the health conditions and therapeutic responses of their physical twins. Intelligent digital twins can enable data-driven clinical decision making and advance the realization of personalized care. Migraines are a highly prevalent and complex neurological disorder affecting people of all ages, genders, and geographical locations. It is ranked among the top disabling diseases, with substantial negative personal and societal impacts, but the current treatment strategies are suboptimal. Personalized care for migraines has been suggested to optimize their treatment. The implementation of intelligent digital twins for migraine care can theoretically be beneficial in supporting patient-centric care management. It is also expected that the implementation of intelligent digital twins will reduce costs in the long run and enhance treatment effectiveness. This study briefly reviews the concept of digital twins and the available literature on digital twins for health disorders such as neurological diseases. Based on these, the potential construction and utility of digital twins for migraines will then be presented. The potential and challenges when implementing intelligent digital twins for the future management of migraines are also discussed. [ABSTRACT FROM AUTHOR]

Digital twin technologies are still developing and are being increasingly leveraged to facilitate daily life activities. This study presents a novel approach for leveraging the capability of mobile devices for photo collection, cloud processing, and deep learning-based 3D generation, with seamless display in virtual reality (VR) wearables. The purpose of our study is to provide a system that makes use of cloud computing resources to offload the resource-intensive activities of 3D reconstruction and deep-learning-based scene interpretation. We establish an end-to-end pipeline from 2D to 3D reconstruction, which automatically builds accurate 3D models from collected photographs using sophisticated deep-learning techniques. These models are then converted to a VR-compatible format, allowing for immersive and interactive experiences on wearable devices. Our findings attest to the completion of 3D entities regenerated by the CAP–UDF model using ShapeNetCars and Deep Fashion 3D datasets with a discrepancy in L2 Chamfer distance of only 0.089 and 0.129, respectively. Furthermore, the demonstration of the end-to-end process from 2D capture to 3D visualization on VR occurs continuously. [ABSTRACT FROM AUTHOR]

Early detection of cracks enables timely mitigation and maintenance actions, ensuring the safety of personnel and equipment within the open-pit coal mine. Monitoring open-pit coal mines and cracks is essential for the safety of workers and for saving national assets. Digital twins (DTs) can be crucial in open-pit coal mine crack detection. DTs enable continuous real-time monitoring of the open-pit mine, including its structures and surrounding environment. Various sensors and internet-of-things devices can be deployed to collect data on factors such as ground movement and strain. Integrating this data into the DT makes it possible to identify and analyze anomalous behavior or changes that may indicate crack formation or propagation. Deep learning-based networks are a crucial factor in detecting open-pit coal mine cracks. In this work, we propose a deep learning-based densely connected lightweight network incorporated into the DT-based framework for detecting cracks and taking predictive maintenance-based decisions by combining historical data, real-time sensor data, and predictive models. The proposed DT-based framework provides insights into the potential crack formation, allowing for proactive maintenance and mitigation measures. We compare the performance of our proposed network on different evaluation measures such as precision, recall, overall accuracy, mean average precision, F1-score, and kappa coefficient, where our proposed lightweight multiscale feature fusion-based network outperformed all other state-of-the-art deep neural networks. We also achieved the best performance on mean average precision by surpassing all other models. Additionally, we also compared the performance of our proposed network with U-Net and recurrent neural network on model training and prediction time benchmarks by outperforming those cutting-edge models.

Wind and photovoltaic (PV) power forecasting are crucial for improving the operational efficiency of power systems and building smart power systems. However, the uncertainty and instability of factors affecting renewable power generation pose challenges to power system operations. To address this, this paper proposes a digital twin-based method for predicting wind and PV power. By utilizing digital twin technology, this approach provides a highly realistic simulation environment that enables accurate monitoring, optimal control, and decision support for power system operations. Furthermore, a digital twin platform for the AI (Artificial Intelligence) Grid is established, allowing real-time monitoring, and ensuring the safe, reliable, and stable operation of the grid. Additionally, a deep learning-based model WPNet is developed to predict wind and PV power at specific future time points. Four datasets are constructed based on weather conditions and historical wind and PV power data from the Flanders and Wallonia regions. The prediction models presented in this paper demonstrate excellent performance on these datasets, achieving mean square error (MSE) values of 0.001399, 0.001833, 0.000704, and 0.002708; mean absolute error (MAE) values of 0.025164, 0.027854, 0.018592, and 0.033501; and root mean square error (RMSE) values of 0.037409, 0.042808, 0.026541, and 0.052042, respectively. [ABSTRACT FROM AUTHOR]

To address the issue of the insufficient safety monitoring of power maintenance vehicles during power operations, this study proposes a vehicle monitoring scheme based on ultra wideband (UWB) and deep learning. The UWB localization algorithm employs Chaotic Particle Swarm Optimization (CSPO) to optimize the Time Difference of Arrival (TDOA)/Angle of Arrival (AOA) locating scheme in order to overcome the adverse effects of the non-visual distance and multipath effects in substations and significantly improve the positioning accuracy of vehicles. To solve the problem of the a large aspect ratio and the angle in the process of power maintenance vehicle operation situational awareness in the mechanical arm of the maintenance vehicle, the arm recognition network is based on the You Only Look Once version 5 (YOLOv5) and modified by Convolutional Block Attention Module (CBAM). The long-edge definition method with circular smoothing label, SIoU loss function, and HardSwish activation function enhance the precision and processing speed for the arm state. The experimental results show that the proposed CPSO-TDOA/AOA outperforms other algorithms in localization accuracy and effectively attenuates the non-visual distance and multipath effects. The recognition accuracy of the YOLOv5-CSL-CBAM network is substantially improved; the mAP value of the vehicles arm reaches 85.04%. The detection speed meets the real-time requirement, and the digital twin of the maintenance vehicle is effectively realized in the 3D substation model. [ABSTRACT FROM AUTHOR]

Localizing leakages in large water distribution systems is an important and ever-present problem. Due to the complexity originating from water pipeline networks, too few sensors, and noisy measurements, this is a highly challenging problem to solve. In this work, we present a methodology based on generative deep learning and Bayesian inference for leak localization with uncertainty quantification. A generative model, utilizing deep neural networks, serves as a probabilistic surrogate model that replaces the full equations, while at the same time also incorporating the uncertainty inherent in such models. By embedding this surrogate model into a Bayesian inference scheme, leaks are located by combining sensor observations with a model output approximating the true posterior distribution for possible leak locations. We show that our methodology enables producing fast, accurate, and trustworthy results. It showed a convincing performance on three problems with increasing complexity. For a simple test case, the Hanoi network, the average topological distance (ATD) between the predicted and true leak location ranged from 0.3 to 3 with a varying number of sensors and level of measurement noise. For two more complex test cases, the ATD ranged from 0.75 to 4 and from 1.5 to 10, respectively. Furthermore, accuracies upwards of 83%, 72%, and 42% were achieved for the three test cases, respectively. The computation times ranged from 0.1 to 13 s, depending on the size of the neural network employed. This work serves as an example of a digital twin for a sophisticated application of advanced mathematical and deep learning techniques in the area of leak detection. [ABSTRACT FROM AUTHOR]

Remote monitoring and maintenance are important for improving the performance of production systems. However, existing studies on this topic usually focus on the monitoring and maintenance of the working conditions of the equipment and pay relatively less attention to the processing craft and processing quality. In addition, as far as we know, there are relatively few industrial case studies on the real applications of remote monitoring and maintenance systems that include both conventional and advanced maintenance techniques under the context of Industry 4.0. Addressing these issues, an industrial case study on the monitoring and maintenance service system for a robot-driven carbon block polishing service system is presented, including its application background and engineering problems, software/hardware architecture and running logic, the monitoring and maintenance-related enabling techniques, and the configuration and operation workflows of the system in the form of screenshots of the functional WebAPPs of the software system. The case study can provide real examples and references for the industrial application of remote monitoring and maintenance service systems on industrial product service systems under the context of Industry 4.0. Advanced techniques such as the Industrial Internet of Things, digital twins, deep learning, and edge/cloud/fog computing have been applied to the system. [ABSTRACT FROM AUTHOR]

Automated extraction of key points from three-dimensional (3D) point clouds in transmission corridors provides technical support for digital twin construction and risk management of the power grid. However, accurately and efficiently segmenting the point clouds of transmission corridors remains a challenging problem. Traditional segmentation methods for transmission corridors suffer from low accuracy and poor generalization ability, and the potential of deep learning in this field has been overlooked. Therefore, the PointNet++ deep learning model is employed as the backbone network for the segmentation of 3D point clouds in transmission corridors. Additionally, given the distinct distribution of key components, an end-to-end CA-PointNet++ architecture is proposed by integrating the Coordinate Attention (CA) module with PointNet++. This approach captures long-distance spatial contextual features and improves feature saliency for more precise segmentation. Furthermore, CA-PointNet++ is evaluated on a dataset of 3D point clouds collected by unmanned aerial vehicles (UAV) equipped with Light Detection and Ranging (LiDAR) for inspecting transmission corridors. The results show that CA-PointNet++ achieved 93.7% overall accuracy (OA) and 67.4% mean Intersection over Union (mIoU). Comparative studies with established deep learning models confirm that our proposed CA-PointNet++ exhibits high accuracy and strong generalization ability for point cloud segmentation tasks in transmission corridors. [ABSTRACT FROM AUTHOR]