Search

The education sector is a rapidly growing global infrastructure for human resources. It is an essential and sensitive data-containing sector where sensitive private information about the user is included in the data. The incorporation of digital twins (DT) into virtual representations is used in higher education to enhance data analytic performance. However, the DT-enabled industry generates enormous amounts of data, making it challenging to manage security and privacy. The management of personal data by human resources involved in critical and resource-constrained tasks has increased since the globalization of Industry 5.0 and the higher education sector. Managing the security and privacy of users' private data through global data collection methods poses significant challenges. We present a framework for delivering decentralized data processing and learning in blockchain-based industry 5.0, with a use-case for higher education that integrates blockchain and deep learning (DL). The framework begins by introducing a new DT model that makes creating a virtual environment to model and replicate security-critical processes in higher education easier. Second, we propose a higher education data analysis model, so that blockchain-based data are ready for the fully functional higher education DT model. At last, the security and cost analyses of the proposed system are presented. Long short-term memory (LSTM) is used for the deep learning model. A custom Python-based blockchain with a proof-of-authentication consensus algorithm is used to implement the blockchain. Our proposed system is designed in such a way that it includes the higher education sector with the concepts of blockchain technology, digital twin, and Industry 5.0. The efficiency and throughput results of the blockchain show that the proposed system is better than the digital twin-based developed systems. The novelty of our proposed system is that educational blockchain with Industry 5.0 is conceptualized and implemented with deep learning models. [ABSTRACT FROM AUTHOR]

In this work, the authors present a digital twin (DT) to analyse the manufacturing process of structural composites by using resin transfer moulding (RTM). During RTM, a dry textile preform is impregnated with a polymer resin injected in a closed mould. RTM is one of the most used production methods for high-performance structural composites. The DT is focused on detecting in-homogeneous resin flow produced by race-tracking channels that divert resin flow to the outlet gates of the mould, producing dry spots and lack of impregnation. The DT core contains two surrogate models based on encoder/decoder deep learning architectures, providing the fast/accurate response necessary for interrogation during manufacturing. The first surrogate acts as the disturbance detector, providing the on-the-fly representation of the fabric permeability with the only information gathered by a set of five pressure sensors distributed over the mould surface. The second offers real-time representation of a set of quantities of interests (QoI): namely, the flow progress and the pressure field inside the mould. Training of both surrogates was performed with synthetic data generated by high-fidelity multi-physics simulations of the flow progress in a porous preform by following Darcy's law. Errors in the pressure field predictions of the surrogates are lower than 1 % with consultation time <50 ms, enabling encapsulation in the digital twin. The DT performance was evaluated by comparing the response against a set of RTM experiments for different race-tracking scenarios. The two most relevant novelties of the work are the use of the concept of the instantiated DT, which provides information on the current state of the process from data provided by a network of distributed sensors, and that this DT has been trained exclusively with synthetic data from multiphysics simulations while evaluated against experimental data from injection tests. [ABSTRACT FROM AUTHOR]

With the development of collaborative edge computing (CEC), the manufacturing market is gradually moving toward large-scale, multi-scenario, and dynamic directions. The existing scheduling strategies based on machine learning or deep learning are only applicable to specific scenarios, which is difficult to meet the requirements of dynamic real-time scheduling in multiple scenarios. The proposed digital twin technology provides a new solution for real-time scheduling of multiple scenarios. In this paper, a digital twin-oriented multi-scene real-time scheduler (GNN-RL) is proposed. This scheduler converts task sequences into node trees and sets up two learning layers. The first layer is an online learning representation layer, which uses GNN to learn node features of embedded structures in real time to boost large instances without additional training. The second layer is the online learning policy layer, which introduces imitation learning mappings into optimal scheduling behavior policies adapted to multiple scenarios. Finally, our approach is validated in several scenarios in 3D digital twin factories, such as computationally intensive, delay-sensitive, and task-urgent scenarios. Since the scheduler proposed in this paper learns general features of the embedding graph rather than instance-specific features, it has good generality and scalability, with good generalization and scalability, outperforming other scheduling rules and schedulers on various benchmarks. [ABSTRACT FROM AUTHOR]

The rapid advancement of deep learning and computer vision has driven the intelligent evolution of fire detection, quantification and fighting, although most AI models remain opaque black boxes. This work applies explainable deep learning methods to quantify fire power by flame images and aims to elucidate the underlying mechanism of computer-vision fire calorimetry. The process begins with the utilization of a pre-trained fire segmentation model to create a flame image database in various formats: (1) original RGB, (2) background-free RGB, (3) background-free grey, and (4) background-free binary. This diverse database accounts for factors such as background, color, and brightness. Then, the synthetic database is employed to train and test the fire-calorimetry AI model. Results highlight the dominant role of determining flame area in fire calorimetry, while other factors displaying minimal influence. Enhancing the accuracy of flame segmentation significantly reduces error in computer-vision fire calorimetry to less than 20%. Finally, the study incorporates the Gradient-weighted Class Activation Mapping (Grad-CAM) method to visualize the pixel-level contribution to fire image identification. This research deepens the understanding of vision-based fire calorimetry and providing scientific support for future AI applications in fire monitoring, digital twin, and smart firefighting. [ABSTRACT FROM AUTHOR]

Groundwater resource analysis is an important technological means of avoiding disease and controlling water pollution. In this field of study, water quality assessments are conducted using sequential parametric values collected in real time. For evaluation reasons, several state-of-the-art water quality evolution mechanism typically employs a single time-invariant model to determine the quality of Water. As a result, it is challenging to illustrate the importance of randomness and contingency in the process of water quality assessment, leading to variations and errors in the procedure of quality assessment. In consideration of these limitations, this study proposes a Digital Twin inspired Hybrid System (DTHS) for water quality assessment in real time. In addition, the degree of water quality is offered as an indication for quantitatively assessing the health risk status. Observational data from a monitoring station in Chaheru, a locality in the Phagwara district of the Indian state of Punjab, are used to demonstrate the efficacy of the proposed approach. The experimental results demonstrate the effectiveness of the proposed framework in terms of water quality determination, computational cost, and stability. The framework has achieved higher prediction accuracy (94.14%), sensitivity (93.74%), specificity (91.47%), and f-measure (92.37%), indicating its ability to accurately determine water quality. Additionally, the framework offers reduced computational delay and improved reliability and stability, making it a trustworthy solution for timely predictions with respect to water quality. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) have been widely used for object recognition and grasping posture planning in intelligent robotic grasping (IRG). Compared with the traditional usage of CNNs in image recognition, IRGs require high recognition accuracy and computational efficiency. However, the existing methodologies for CNN architecture design often rely on human experience and numerous trial-and-error attempts, which make it a very challenging task to obtain an optimal CNN for IRGs. To tackle this challenge, this paper develops a new differentiable architecture search (DARTS) method considering the floating-point operations (FLOPs) of CNNs, named the DARTS-F method, which converts the discrete CNN architecture search to a gradient-based continuous optimization problem and considers both the prediction accuracy and the computational cost of the CNN during the optimization. To efficiently identify the optimal neural network, this paper adopts a bilevel optimization, which first trains the neural network weights in the inner level and then optimizes the neural network architecture by fine-tuning the operational variables in the outer level. In addition, a new digital twin (DT) of IRG is developed considering the physics of realistic robotic grasping in the DT's virtual space, which could not only improve the IRG accuracy but also avoid the expensive training time. In the experiments, the proposed DARTS-F method could generate an optimized CNN with higher prediction accuracy and lower FLOPs than those obtained by the original DARTS method. The DT framework improves the accuracy of real robotic grasping from 61 to 71%. [ABSTRACT FROM AUTHOR]

Collaborative tasks in multiple systems have attracted considerable attention in contemporary manufacturing environments. Collaborative robots are representative agents for various collaborative industrial tasks. This study focuses on contactless delivery by considering multiple agents. A contactless delivery operation must be performed with well-synchronized cooperation among the sender, a receiver, and flying dynamics of the deliverable. The most challenging task is to predict the catching point of a thrown package by considering both collaborative robots. Accurate catching-point prediction and relevant operations were achieved using the proposed physics-informed neural network-based hybrid multi-stream deep learning framework. Various cooperative environments were considered using multi-modal input data and manufacturing conditions. The proposed framework incorporates these constraints, and the prediction is guided by flying dynamics and trajectory data. The effectiveness of the proposed framework was demonstrated by implementing multi-agent and related manufacturing environments in a digital twin system. The effectiveness of the proposed framework was proven experimentally using analyses and comparisons with existing machine learning methods. [ABSTRACT FROM AUTHOR]

Muscle electrophysiology has emerged as a powerful tool to drive human machine interfaces, with many new recent applications outside the traditional clinical domains, such as robotics and virtual reality. However, more sophisticated, functional, and robust decoding algorithms are required to meet the fine control requirements of these applications. Deep learning has shown high potential in meeting these demands, but requires a large amount of high-quality annotated data, which is expensive and time-consuming to acquire. Data augmentation using simulations, a strategy applied in other deep learning applications, has never been attempted in electromyography due to the absence of computationally efficient models. We introduce a concept of Myoelectric Digital Twin - highly realistic and fast computational model tailored for the training of deep learning algorithms. It enables simulation of arbitrary large and perfectly annotated datasets of realistic electromyography signals, allowing new approaches to muscular signal decoding, accelerating the development of human-machine interfaces. Muscle electrophysiology is a promising tool for human-machine approaches in medicine and beyond clinical applications. The authors propose here a model simulating electric signals produced during human movements and apply this data for training of deep learning algorithms. [ABSTRACT FROM AUTHOR]

This document discusses the emergence of deep learning as a transformative tool in the field of operations research (OR). Deep learning, a specialized category of machine learning algorithms, uses multiple layers to uncover hidden patterns and insights from large datasets. It has gained popularity due to its superior predictive performance compared to traditional machine learning models. The integration of deep learning applications into OR has the potential to enhance decision-making, productivity, sustainability, and optimization processes. However, there are challenges to address, such as data availability, interpretability, and computational cost. The document highlights the need for practical research and provides future research directions in areas such as supply chain management, demand forecasting, inventory optimization, and decision-making processes. Overall, deep learning has the potential to transform the field of OR, and this document aims to provide new perspectives for further research and practical applications. [Extracted from the article]

A lot of different methods are being opted for improving the educational standards through monitoring of the classrooms. The developed world uses Smart classrooms to enhance faculty efficiency based on accumulated learning outcomes and interests. Smart classroom boards, audio-visual aids, and multimedia are directly related to the Smart classroom environment. Along with these facilities, more effort is required to monitor and analyze students' outcomes, teachers' performance, attendance records, and contents delivery in on-campus classrooms. One can achieve more improvement in quality teaching and learning outcomes by developing digital twins in on-campus classrooms. In this article, we have proposed DeepClass-Rooms, a digital twin framework for attendance and course contents monitoring for the public sector schools of Punjab, Pakistan. DeepClassRooms is cost-effective and requires RFID readers and high-edge computing devices at the Fog layer for attendance monitoring and content matching, using convolution neural network for on-campus and online classes. [ABSTRACT FROM AUTHOR]

Due to its automatic feature learning ability and high performance, deep learning has gradually become the mainstream of artificial intelligence in recent years, playing a role in many fields. Especially in the medical field, the accuracy rate of deep learning even exceeds that of doctors. This paper introduces several deep learning algorithms: Artificial Neural Network (NN), FM-Deep Learning, Convolutional NN and Recurrent NN, and expounds their theory, development history and applications in disease prediction; we analyze the defects in the current disease prediction field and give some current solutions; our paper expounds the two major trends in the future disease prediction and medical field—integrating Digital Twins and promoting precision medicine. This study can better inspire relevant researchers, so that they can use this article to understand related disease prediction algorithms and then make better related research. [ABSTRACT FROM AUTHOR]

Gears play an important role in virtual manufacturing systems for digital twins; however, the image of gear tooth defects is difficult to acquire owing to its non-convex shape. In this study, a deep learning network is proposed to detect gear defects based on their point cloud representation. This approach mainly consists of three steps: (1) Various types of gear defects are classified into four cases (fracture, pitting, glue, and wear); A 3D gear dataset was constructed with 10000 instances following the aforementioned classification. (2) Gear-PCNet+ + introduces a novel Combinational Convolution Block, proposed based on the gear dataset for gear defect detection to effectively extract the local gear information and identify its complex topology; (3) Compared with other methods, experiments show that this method can achieve better recognition results for gear defects with higher efficiency and practicability. [ABSTRACT FROM AUTHOR]

In order to achieve the causal diagnosis of life health of high-speed spindle system, a digital twin (DT)–driven prediction method is proposed based on the real-time monitoring of thermal characteristics. The finite element method is used to achieve the DT for thermal characteristics through real time correcting the thermal boundaries using the correction models. The long short-term memory recurrent neural network (LSTM-RNN) is used to predict the heat generations of bearings and motor; the prediction results are used to diagnose the health status according to the domain and threshold models. A heat change rate–based causal diagnosis model is proposed to judge the fault sources. The spindle wear and fault experiments are carried out to verify the effectiveness of the proposed DT system. The experimental results show that the DT accuracy of thermal characteristics exceeds 95%, and the proposed DT system can successfully monitor the health status of the spindle system. [ABSTRACT FROM AUTHOR]

The benefits of technologies related to the Internet of Things (IoT), virtual and augmented reality (VR/AR), digital twins, and so on, can be fully realized when associated devices are positioned intuitively. However, AR systems hosted within smartphones pose challenges where auxiliary hardware and computational configurations associated with precise positioning are concerned. To this effect, we propose a deep learning-based indoor measurement system that can determine positions using images collected via beacons designed as IoT terminals. The proposed system is broadly divided into a detection unit, an extraction unit, a positioning unit, and a management server. The beacons were detected using deep learning algorithms, from which the postures were extracted using a homography matrix, and position of the imaging device was determined in reference to the beacon's position. With the unique design of our system, in that it simultaneously performs posture and positioning estimations, high immersive AR can be achieved. Moreover, scalability of the positioning space is also guaranteed as multiple beacons can be monitored at once. For the experiment, we simulated a virtual indoor space comprising pyramid beacons and the results were promising. [ABSTRACT FROM AUTHOR]

For material modeling and discovery, synthetic microstructures play a critical role as digital twins. They provide stochastic samples upon which direct numerical simulations can be conducted to populate material databases. A large ensemble of simulation data on synthetic microstructures may provide supplemental data to inform and refine macroscopic material models, which might not be feasible from physical experiments alone. However, synthesizing realistic microstructures with realistic microstructural attributes is highly challenging. Thus, it is often oversimplified via rough approximations that may yield an inaccurate representation of the physical world. Here, we propose a novel deep learning method that can synthesize realistic three-dimensional microstructures with controlled structural properties using the combination of generative adversarial networks (GAN) and actor-critic (AC) reinforcement learning. The GAN-AC combination enables the generation of microstructures that not only resemble the appearances of real specimens but also yield user-defined physical quantities of interest (QoI). Our validation experiments confirm that the properties of synthetic microstructures generated by the GAN-AC framework are within a 5% error margin with respect to the target values. The scientific contribution of this paper resides in the novel design of the GAN-AC microstructure generator and the mathematical and algorithmic foundations therein. The proposed method will have a broad and substantive impact on the materials community by providing lenses for analyzing structure-property-performance linkages and for implementing the notion of 'materials-by-design'. [ABSTRACT FROM AUTHOR]