Search

Accurate defect detection is crucial for ensuring the trustworthiness of intelligent railway systems. Current approaches either rely on static ensembling of Convolutional Neural Networks (CNNs) or on single deep-learning CNN models. Traditional methods use a large volume of data to identify underlying patterns. However, training a new defect classifier with limited samples often results in overfitting and poor performance on unseen images. To overcome these challenges, we introduce a dynamic weight adaptation mechanism within an ensemble learning framework, enhanced by state-of-the-art transfer learning models (VGG-19, MobileNetV3, and ResNet50). We obtained a good test and validation accuracy of 99%, accompanied by a precision of 0.99, and recall and F1-score of 0.98. Unlike previous methods, our approach demonstrates consistency. Particularly, techniques that involve selecting predictions based on minimum loss previously required a significant number of epochs to stabilize. Data fusion techniques are even more demanding, requiring a substantially higher number of epochs for stabilization. Conversely, our proposed method achieves stable performance and rapid convergence within just 10 epochs, and it shows minimal fluctuation in the training curve (0–5 epochs). This visibly contrasts with earlier methods, which, despite reaching similar levels of accuracy, required significantly more epochs and exhibited greater fluctuations in their training curves. Through these findings, we anticipate that the proposed dynamic weight adaptation-based ensemble approach will further research and development of reusable AI-enabled solutions for rail defect classification. [ABSTRACT FROM AUTHOR]

In the context of Industry 4.0, integrating Digital Twin (DT) technology stands out as a critical challenge for enhancing manufacturing processes and productivity. The combination of DT and Artificial Intelligence (AI) provides a significant benefit for improving processes in real-time. Industries are actively researching these technologies to keep pace with the rapid evolution of technology, utilizing virtual representations for efficient real-time monitoring and control. The present paper proposes a new approach that relies on DT technology for monitoring, optimizing manufacturing processes and enabling quality control through Deep learning (DL). The proposed methodology involves creating a digital replica of the physical system and utilizing DL models for quality control purposes. This approach improves automation and productivity while maintaining high levels of quality assurance in factories. DL is deployed within the DT for gathering data from the physical system and making predictions regarding product quality. The approach is illustrated by considering an experimental industrial prototype. The results obtained are particularly intriguing, demonstrating heightened predictive accuracy in assessing product quality and real-time issue resolution. Overall, the findings underscore the significant and interesting impact of DT technology with DL on manufacturing processes in the context of Industry 4.0. [ABSTRACT FROM AUTHOR]

Modern cyber–physical production systems provide advanced solutions to enhance factory throughput and efficiency. However, monitoring its behaviour and performance becomes challenging as the complexity of a manufacturing system increases. Artificial Intelligence (AI) provides techniques to manage not only decision-making tasks but also to support monitoring. The integration of AI into a factory can be facilitated by a reliable Digital Twin (DT) that enables knowledge-based and data-driven approaches. While computer vision and convolutional neural networks (CNNs) are crucial for monitoring production systems, the need for extensive training data hinders their adoption in real factories. The proposed methodology leverages the Digital Twin of a factory to generate labelled synthetic data for training CNN-based object detection models. Regarding their position and state, the focus is on monitoring entities in manufacturing systems, such as parts, components, fixtures, and tools. This approach reduces the need for large training datasets and enables training when the actual system is unavailable. The trained CNN model is evaluated in various scenarios, with a real case study involving an industrial pilot plant for repairing and recycling Printed Circuit Boards (PCBs). [ABSTRACT FROM AUTHOR]

Effective monitoring of road fixtures is essential for urban safety and functionality. However, traditional inspections are time-consuming, costly, and error prone, while current automated solutions struggle with high initial setup costs, limited flexibility preventing wide adaptation, and reliance on centralized processing that can delay response times. This study introduces an edge AI-based remote road fixture monitoring system which automatically and continuously updates the information of the road digital twin (DT). The main component is a small-sized edge device consisting of a camera, GPS, and IMU sensors designed to be installed in typical cars. The device captures images, detects the fixture, and estimates their location by employing deep learning and feature matching. This information is transmitted to a dedicated cloud server and represented on a user-friendly user interface. Experiments were conducted to test the system's performance. The results showed that the device could successfully detect the fixture and estimate their global coordinates. Outputs were marked and shown on the road DT, proving the integrated and smooth operation of the whole system. The proposed Edge AI device demonstrated that it could significantly reduce the data size by 80–84% compared to traditional methods. With a satisfactory object detection accuracy of 65%, the system effectively identifies traffic poles, stop signs, and streetlights, integrating these findings into a digital twin for real-time monitoring. The proposed system improves road monitoring by cutting down on maintenance and emergency response times, increasing the ease of data use, and offering a foundation for an overview of urban road fixtures' current state. However, the system's reliance on the quality of data collected under varying environmental conditions suggests potential improvements for consistent performance across diverse scenarios. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in terms of diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish the digital representation of a patient's respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-rays into five distinct categories of lung diseases, including "normal", "covid", "lung_opacity", "pneumonia", and "tuberculosis". The performance of the system was evaluated employing a chest X-ray dataset available in the literature, demonstrating average accuracy of 96.8%, precision of 92%, recall of 97%, and F1-score of 94%. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient's respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights as to personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation. [ABSTRACT FROM AUTHOR]

The rapid rise of artificial intelligence (AI) in medicine in the last few years highlights the importance of developing bigger and better systems for data and model sharing. However, the presence of Protected Health Information (PHI) in medical data poses a challenge when it comes to sharing. One potential solution to mitigate the risk of PHI breaches is to exclusively share pre-trained models developed using private datasets. Despite the availability of these pre-trained networks, there remains a need for an adaptable environment to test and fine-tune specific models tailored for clinical tasks. This environment should be open for peer testing, feedback, and continuous model refinement, allowing dynamic model updates that are especially important in the medical field, where diseases and scanning techniques evolve rapidly. In this context, the Discovery Viewer (DV) platform was developed in-house at the Biomedical Engineering and Imaging Institute at Mount Sinai (BMEII) to facilitate the creation and distribution of cutting-edge medical AI models that remain accessible after their development. The all-in-one platform offers a unique environment for non-AI experts to learn, develop, and share their own deep learning (DL) concepts. This paper presents various use cases of the platform, with its primary goal being to demonstrate how DV holds the potential to empower individuals without expertise in AI to create high-performing DL models. We tasked three non-AI experts to develop different musculoskeletal AI projects that encompassed segmentation, regression, and classification tasks. In each project, 80% of the samples were provided with a subset of these samples annotated to aid the volunteers in understanding the expected annotation task. Subsequently, they were responsible for annotating the remaining samples and training their models through the platform's "Training Module". The resulting models were then tested on the separate 20% hold-off dataset to assess their performance. The classification model achieved an accuracy of 0.94, a sensitivity of 0.92, and a specificity of 1. The regression model yielded a mean absolute error of 14.27 pixels. And the segmentation model attained a Dice Score of 0.93, with a sensitivity of 0.9 and a specificity of 0.99. This initiative seeks to broaden the community of medical AI model developers and democratize the access of this technology to all stakeholders. The ultimate goal is to facilitate the transition of medical AI models from research to clinical settings. [ABSTRACT FROM AUTHOR]

Digital twins (DTs) are becoming increasingly popular in various industries, and their potential for healthcare in the metaverse continues to attract attention. The metaverse is a virtual world where individuals interact with digital replicas of themselves and the environment. This paper focuses on personalized and precise medicine and examines the current application of DTs in healthcare within the metaverse. Healthcare practitioners may use immersive virtual worlds to replicate medical scenarios, improve teaching experiences, and provide personalized care to patients. However, the integration of DTs in the metaverse poses technical, regulatory, and ethical challenges that need to be addressed, including data privacy, standards, and accessibility. Through this examination, we aim to provide insights into the transformative potential of DTs in healthcare within the metaverse and encourage further research and development in this exciting domain. [ABSTRACT FROM AUTHOR]

Digital twin is the digital representation of an entity, and it drives Industry 4.0. This paper presents a bibliometric analysis of digital twin in the supply chain to help researchers, industry practitioners, and academics to understand the trend, development, and focus of the areas of digital twin in the supply chain. This paper found several key clusters of research, including the designing of a digital twin model, integration of a digital twin model, application of digital twin in quality control, and digital twin in digitalization. In the embryonic stage of research, digital twin was tested in the production line with limited optimization. In the development stage, the importance of digital twin in Industry 4.0 was observed, as big data, machine learning, Industrial Internet of Things, blockchain, edge computing, and cloud-based systems complemented digital twin models. Digital twin was applied to improve sustainability in manufacturing and production logistics. In the current prosperity stage with high annual publications, the recent trends of this topic focus on the integration of deep learning, data models, and artificial intelligence for digitalization. This bibliometric analysis also found that the COVID-19 pandemic drove the start of the prosperity stage of digital twin research in the supply chain. Researchers in this field are slowly moving towards applying digital twin for human-centric systems and mass personalization to prepare to transit to Industry 5.0. [ABSTRACT FROM AUTHOR]

Today's healthcare facilities require new digital tools to cope with the rapidly increasing demand for technology that can support healthcare operators. The advancement of technology is leading to the pervasive use of IoT devices in daily life, capable of acquiring biomedical and biometric parameters, and providing an opportunity to activate new tools for the medical community. Digital twins (DTs) are a form of technology that are gaining more prominence in these scenarios. Many scientific research papers in the literature are combining artificial intelligence (AI) with DTs. In this work, we propose a case study including a proof of concept based on microservices, the heart DT, for the evaluation of electrocardiogram (ECG) signals by means of an artificial intelligence component. In addition, a higher-level platform is presented and described for the complete management and monitoring of cardiac pathologies. The overall goal is to provide a system that can facilitate the patient–doctor relationship, improve medical treatment times, and reduce costs. [ABSTRACT FROM AUTHOR]

• Integrated digital twins Framework for revolutionizes defect diagnosis for pumps. • Domain adaptation boosts diagnostic model accuracy. • Promising potential for scalable industrial applications. Bearing defects in centrifugal pumps represent a prevalent source of equipment failure, often resulting in significant downtime and maintenance expenses. Deep learning algorithms can be used to detect defects. However, in the real world, there is always a scarcity of labeled data. To address this challenge, we propose a framework integrating digital twin technology with domain adaptation for accurate diagnosis of bearing defects. The proposed framework leverages the concept of digital twins to create a virtual representation of the pump bearing, enabling real-time monitoring and simulation of operating conditions. Domain adaptation techniques are then applied to transfer knowledge from synthetic data generated by the digital twin to the actual operating environment, overcoming the domain gap between synthetic and real-world data. The results highlight the potential of digital twin-assisted combined with domain adaptation techniques for enhancing predictive maintenance strategies in industrial applications. [ABSTRACT FROM AUTHOR]

In this paper, we develop innovative digital twins of cattle status that are powered by artificial intelligence (AI). The work is built on a farm IoT system that remotely monitors and tracks the state of cattle. A digital twin model of cattle based on Deep Learning (DL) is generated using the sensor data acquired from the farm IoT system. The physiological cycle of cattle can be monitored in real time, and the state of the next physiological cycle of cattle can be anticipated using this model. The basis of this work is the vast amount of data that is required to validate the legitimacy of the digital twins model. In terms of behavioural state, this digital twin model has high accuracy, and the loss error of training reach about 0.580 and the loss error of predicting the next behaviour state of cattle is about 5.197 after optimization. The digital twins model developed in this work can be used to forecast the cattle's future time budget. [ABSTRACT FROM AUTHOR]

Preparing the infrastructure for analyzing, recognizing, and characterizing microorganisms in the Metaverse can transform the fields of biology, medicine, and drug discovery. Accordingly, the realization of digital twins of microorganisms, such as viruses, fungi, algae, bacteria, protozoa, archaea, and multicellular animal parasites, can streamline the applicability of the Metaverse and similar emerging technologies like Cyber-Physical Healthcare Systems (CPHS). This is why a new approach to the digital twinning of bacteria has been presented in this research. This method of digital twinning can revolutionize the research and study of bacteria because it allows us to separate useful and harmful bacterial species, increasing the efficiency of treatment noticeably. This innovative method can easily be used by clinics, medical centers, or even by private users physically and virtually and can be adapted to every centralized or decentralized Metaverse Platform. To determine the proper treatment, biologists have always tried to identify the correct bacterial species that prompted a bacterial infection. They use various indicators, such as the bacterial cell's shape and the size of the colony formed by the bacteria, to classify different types of bacteria with different biochemistries and shapes. However, it is challenging because of the extensive similarities between some species. For instance, such similarities exist between Staphylococcus aureus and Staphylococcus saprophyticus, which has caused numerous false diagnostic reports by operators. Wrong species reports bring about treatment failure and increase antibiotic resistance issues. Therefore, the digital twins of bacteria cover all of their identifiable characteristics and overcome many limitations to study them. In this approach, DTL techniques, including MobileNetV2, EfficientNetV2-S, and ResNet-50, have been employed to build digital twins of bacteria species. A hybrid dataset was used for training and evaluation. Among the models, EfficientNetV2-S exhibited the best performance, with a validation accuracy of 99.58% and a test accuracy of 99.33%. The results showed the ability of deep learning models to make bacteria digital twins based on image processing from different labs, thus assisting experts in speeding up the process and reducing diagnostic errors. In addition, in the mispredicted cases, the correct species was among the first three choices of the model. Therefore, not only can experts use DTL approaches to speed up the digital twin realization of microorganisms in the Metaverse, but they can also use these methods to reduce diagnostic errors. • Introducing a technique to streamline digital twinning of microorganisms using CNN. • Describing machine learning digital twins of microorganisms in the Metaverse. • Presenting an exact, economical digital twinning approach via smartphone photography. • Providing a comprehensive bacteria species dataset for future method development. [ABSTRACT FROM AUTHOR]

Early failure detection is required for Fused Deposition Modelling (FDM) 3D printers to reduce material waste. Typically, such systems are created based on images captured during printing or sensor data for tracking the extruder's movement. This work presents a novel approach to sensor data-driven fault diagnosis, utilizing Artificial Intelligence (AI) technology to investigate the temperature imbalance in the extruder and printing surface. First, a Lightweight Convolutional Neural Network (LCNN) is proposed to detect faults from sensory data. The model's architecture concatenates the CNN layer to extract additional features, improving the model's performance while maintaining a lightweight configuration suitable for real-time monitoring systems. Second, the concept of Digital Twin (DT) technology for FDM 3D printer fault detection is introduced. The DT creates a virtual representation of a physical object, and its functionality is validated by examining the network's latency and System Overhead (SO) as the number of clients increases. The simulation results show that the proposed LCNN with a DT environment can effectively monitor, detect, and control the physical workplace with an F1-Score of 0.9981 and an average latency of 995. 4253 ms. Additionally, this research contributes to the development of future technologies for virtual condition monitoring of 3D printer abnormalities, which will be essential for intelligent and autonomous factories. [ABSTRACT FROM AUTHOR]

Digital twins are undergoing growth that enables highly informative and scaleable interaction between physical objects and virtual twins, which is of great significance to the life cycle analysis of composites. Real-time fine evolution is challenging due to vast combinations of input features and high-resolution calculated variables. Here, we systematically demonstrate an AI-based methodology for digital twinning of complex composite structures. First, three types of deep neural networks are created with optionally used autoencoders as surrogate models, with architectures and data processing inspired by the rule-of-mixture of composites. Second, the prediction accuracy and efficiency are evaluated quantitatively and qualitatively, demonstrating the feasibility of predicting 3D displacement and stress fields directly from sensing data of temperature, pressure and loading displacement, and the optimal architecture is selected to be the evolving digital twin. Finally, the real-time interactive experiments are relayed to the digital twin and demonstrated that it can interact with physical objects and evolve online with high accuracy. These results indicate that the computational time can be reduced by 3∼6 orders of magnitude with high information intensity and scalability compared with conventional numerical and experimental methods, which opens up the avenues for the cost-effective and efficient development of digital twin services for composites. [Display omitted] [ABSTRACT FROM AUTHOR]

Pre-clinical molecular imaging, particularly with mice, is an essential part of drug and radiopharmaceutical development. There remain ethical challenges to reduce, refine and replace animal imaging where possible. A number of approaches have been adopted to reduce the use of mice including using algorithmic approaches to animal modelling. Digital twins have been used to create a virtual model of mice, however, exploring the potential of deep learning approaches to digital twin development may enhance capabilities and application in research. Generative adversarial networks produce generated images that sufficiently resemble reality that they could be adapted to create digital twins. Specific genetic mouse models have greater homogeneity making them more receptive to modelling and suitable specifically for digital twin simulation. There are numerous benefits of digital twins in pre-clinical imaging including improved outcomes, fewer animal studies, shorter development timelines and lower costs. [Display omitted] [ABSTRACT FROM AUTHOR]

• Key application areas of deep learning are identified in urban water and wastewater management. • Popular application areas include anomaly detection, system state forecasting, asset monitoring and assessment. • Industrial application of deep learning is still at an early stage with few implementations reported. • Research challenges include data privacy, algorithm development, explainability, multi-agent system and digital twin. • Deep learning should drive urban water systems towards high intelligence and autonomy. Deep learning techniques and algorithms are emerging as a disruptive technology with the potential to transform global economies, environments and societies. They have been applied to planning and management problems of urban water systems in general, however, there is lack of a systematic review of the current state of deep learning applications and an examination of potential directions where deep learning can contribute to solving urban water challenges. Here we provide such a review, covering water demand forecasting, leakage and contamination detection, sewer defect assessment, wastewater system state prediction, asset monitoring and urban flooding. We find that the application of deep learning techniques is still at an early stage as most studies used benchmark networks, synthetic data, laboratory or pilot systems to test the performance of deep learning methods with no practical adoption reported. Leakage detection is perhaps at the forefront of receiving practical implementation into day-to-day operation and management of urban water systems, compared with other problems reviewed. Five research challenges, i.e., data privacy, algorithmic development, explainability and trustworthiness, multi-agent systems and digital twins, are identified as key areas to advance the application and implementation of deep learning in urban water management. Future research and application of deep learning systems are expected to drive urban water systems towards high intelligence and autonomy. We hope this review will inspire research and development that can harness the power of deep learning to help achieve sustainable water management and digitalise the water sector across the world. [Display omitted] [ABSTRACT FROM AUTHOR]

[Display omitted] • Laser scanning and photogrammetric technologies are fused in the pipeline. • Semantic information in images is mapped to 3D laser-scanned point clouds. • Small objects of di_erent classes are detected in the creation of digital twins. • Text information is recognised and used to enrich digital twins. This paper addresses the challenge of enriching geometric digital twins of buildings, with a particular emphasis on capturing small but important entities from the electrical and the fire-safety domain, such as signs, sockets, switches, smoke alarms, etc. Unlike most previous research that focussed on structural elements and processed laser point clouds and images separately, we propose a novel method that fuses laser scanning and photogrammetry methods to capture the relevant objects, recognise them in 2D images and then map these to a 3D space. The considered object classes include electrical elements (light switch, light, speaker, socket, elevator button), safety elements (emergency switch, smoke alarm, fire extinguisher, escape sign), plumbing system elements (pipes), and other objects with useful information (door sign, board). Semantic information like class labels is extracted by applying AI-based image segmentation and then mapped to the 3D point cloud, segmenting the point cloud into point clusters. We subsequently fit geometric primitives to the point clusters and extract text information by AI-based text detection and recognition. The final output of our proposed method is an information-rich digital twin of buildings that contains geometric information, semantic information such as object categories and useful text information which is valuable in many aspects, like condition monitoring, facility maintenance and management. In summary, the paper presents a nearly fully-automated pipeline to enrich a geometric digital twin of buildings with details and provides a comprehensive case study. [ABSTRACT FROM AUTHOR]