Search

The devices deployed across diverse industrial scenarios have generated significant network traffic related to time. The system's irregular operation could result in substantial bad influence. Anomaly detection technologies utilized for identifying possible non-standard behaviours are paramount; furthermore, multivariate time series exhibit complex dependencies besides temporal correlation. However, most previous methods merely consider the temporal and variable correlation of time series data, neglecting the distance metrics among the sequences, leading to a deficiency in the model's anomaly detection ability. We propose a multivariate time series anomaly detection model based on the encoder–decoder architecture (CCER-ED). The model considers the similarity measure between temporal subsequences and designs a multi-scale feature embedding module for leveraging more interrelated properties. Moreover, the interrelations among sensors are explicitly learned using a manifold regularization graph structure. On this basis, an improved data fusion approach based on a multi-head self-attention mechanism is designed for capturing global feature representation, effectively integrating various aspects of information. Evaluations using the real-world datasets SWAT and WADI and performance analysis show that the proposed approach achieves improvement over the baselines in the recall and F1-score of anomaly detection performance at 9.3% and 8.5% (maximum), respectively, outperforming other existing methods. [ABSTRACT FROM AUTHOR]

There is no doubt that the rational and effective use of visible and thermal infrared image data information to achieve cross-modal complementary fusion is the key to improving the performance of RGB-T salient object detection (SOD). A meticulous analysis of the RGB-T SOD data reveals that it mainly consists of three scenarios in which both modalities (RGB and T) have a significant foreground and only a single modality (RGB or T) is disturbed. However, existing methods are obsessed with pursuing more effective cross-modal fusion based on treating both modalities equally. Obviously, the subjective use of equivalence has two significant limitations. Firstly, it does not allow for practical discrimination of which modality makes the dominant contribution to performance. While both modalities may have visually significant foregrounds, differences in their imaging properties will result in distinct performance contributions. Secondly, in a specific acquisition scenario, a pair of images with two modalities will contribute differently to the final detection performance due to their varying sensitivity to the same background interference. Intelligibly, for the RGB-T saliency detection task, it would be more reasonable to generate exclusive weights for the two modalities and select specific fusion mechanisms based on different weight configurations to perform cross-modal complementary integration. Consequently, we propose a weighted guided optional fusion network (WGOFNet) for RGB-T SOD. Specifically, a feature refinement module is first used to perform an initial refinement of the extracted multilevel features. Subsequently, a weight generation module (WGM) will generate exclusive network performance contribution weights for each of the two modalities, and an optional fusion module (OFM) will rely on this weight to perform particular integration of cross-modal information. Simple cross-level fusion is finally utilized to obtain the final saliency prediction map. Comprehensive experiments on three publicly available benchmark datasets demonstrate the proposed WGOFNet achieves superior performance compared with the state-of-the-art RGB-T SOD methods. The source code is available at: https://github.com/WJ-CV/WGOFNet. [ABSTRACT FROM AUTHOR]

Precipitation is a fundamental factor affecting many fields, including freshwater reservation, flood warning and prevention, agriculture, and hydropower planning. Observation-based precipitation data usually come from two primary sources, namely gauges and satellite images. The former provides high reliability but sparse coverage, while the latter offers fine-grained data but is still inaccurate. There have been several efforts to estimate precipitation, including mathematical and probabilistic models and machine learning-based techniques. All existing solutions consider the target problem as a satellite data calibration with gauge data as complementary information. However, this approach fails to provide accurate predictive results due to the sparsity of gauges and significant errors in satellite data. This paper presents a novel precipitation estimating method that highlights the importance of gauge data, the most trustworthy data source. To be more precise, we formulate the precipitation estimation issue as a spatial prediction task with the goal of predicting rainfall data for non-monitoring locations using gauge data at the monitored sites. To this end, we propose a data-driven approach that exploits the encoder–decoder architecture, graph neural network, and the multimodal data fusion strategy. Specifically, we design an encoder that leverages a graph neural network for capturing the spatial relationship among the gauges. Meanwhile, the decoder exploits the convolutional networks to learn the temporal correlation within the historical data. Finally, we integrate satellite images and meteorological information using a multimodal data fusion based on a multilayer perceptron to enhance prediction accuracy. The experimental results show that our proposed model increases the estimation accuracy from 24.3 to 65.2% compared to the state-of-the-art. [ABSTRACT FROM AUTHOR]

With global warming and intensified human activities, extreme convective precipitation has become one of the most frequent natural disasters. An accurate and reliable assessment of severe convective precipitation events can support social stability and economic development. In order to investigate the accuracy enhancement methods and data fusion strategies for the assessment of severe convective precipitation events, this study is driven by the horizontal reflectance factor (ZH) and differential reflectance (ZDR) of the dual-polarization radar. This research work utilizes microphysical information of convective storms provided by radar variables to construct the precipitation event assessment model. Considering the problems of high dimensionality of variable data and low computational efficiency, this study proposes a dual-polarization radar echo-data-layering strategy. Combined with the results of mutual information (MI), this study constructs Bayes–Kalman filter (KF) models (RF, SVR, GRU, LSTM) for the assessment of severe convective precipitation events. Finally, this study comparatively analyzes the evaluation effectiveness and computational efficiency of different models. The results show that the data-layering strategy is able to reduce the data dimensions of 256 × 256 × 34,978 to 5 × 2213, which greatly improves the computational efficiency. In addition, the correlation coefficient of interval III–V calibration period is increased to 0.9, and the overall assessment accuracy of the model is good. Among them, the Bayes–KF-LSTM model has the best assessment effect, and the Bayes–KF-RF has the highest computational efficiency. Further, five typical precipitation events are selected for validation in this study. The stratified precipitation dataset agrees well with the near-surface precipitation, and the model's assessment values are close to the observed values. This study completely utilizes the microphysical information offered by dual-polarized radar ZH and ZDR in precipitation event assessment, which provides a wide range of application possibilities for the assessment of severe convective precipitation events. [ABSTRACT FROM AUTHOR]

The paper addresses the problem of distinguishing the leading agents in the group. The problem is considered in the framework of classification problems, where the agents in the group select the items with respect to certain properties. The suggested method of distinguishing the leading agents utilizes the connectivity between the agents and the Rokhlin distance between the subgroups of the agents. The method is illustrated by numerical examples. The method can be useful in considering the division of labor in swarm dynamics and in the analysis of the data fusion in the tasks based on the wisdom of the crowd techniques. [ABSTRACT FROM AUTHOR]

With the proliferation of digital devices in internet of things (IoT) environment featuring advanced visual capabilities, the task of Image Source Identification (ISI) has become increasingly vital for legal purposes, ensuring the verification of image authenticity and integrity, as well as identifying the device responsible for capturing the original scene. Over the past few decades, researchers have employed both traditional and machine‐learning methods to classify image sources. In the current landscape, data‐driven approaches leveraging deep learning models have emerged as powerful tools for achieving higher accuracy and precision in source prediction. The primary focus of this research is to address the complexities arising from diverse image sources and variable quality in IoT‐generated multimedia data. To achieve this, a Hybrid Data Fusion Approach is introduced, leveraging multiple sources of information to bolster the accuracy and robustness of ISI. This fusion methodology integrates diverse data streams from IoT devices, including metadata, sensor information, and contextual data, amalgamating them into a comprehensive data set for analysis. This study introduces an innovative approach to ISI through the implementation of a Twin Convolutional Neural Network Architecture (TCA) aimed at enhancing the efficacy of source classification. In TCA, the first CNN architecture, referred to as DnCNN, is employed to eliminate noise from the original data set, generating 256 × 256 patches for both training and testing. Subsequently, the second CNN architecture is employed to classify images based on features extracted from various convolutional layers using a 3 × 3 filter, thereby enhancing prediction efficiency. The proposed model demonstrates exceptional accuracy in effectively classifying image sources, showcasing its potential as a robust solution in the realm of ISI. [ABSTRACT FROM AUTHOR]

Intrusion detection in industrial control systems (ICS) is crucial for maintaining secu rity in modern industries. However, the rapid growth of data generated from various sources presents significant challenges, as complex and diverse attacks continue to threaten the integrity of these systems. Traditional intrusion detection systems face limitations in effectively detecting intrusions and suffer from processing delays. To address these issues, there is an urgent need for a real-time and efficient IDS. This study introduces a novel approach to real-time intrusion detection in ICS by leveraging Cloud Computing and Big Data techniques for data fusion. By fusing mul tiple streams of data, our approach enhances intrusion detection performance, reduces false alarm rates, and produces more consistent and accurate results. The contributions of this work are two-fold. Firstly, we propose a real-time IDS that overcomes the limitations of traditional systems through the efficient processing capabilities of Cloud Computing and Big Data techniques. Secondly, we employ data fusion to integrate diverse data sources, resulting in improved intrusion detection accuracy and efficiency. Our proposed IDS achieves higher accuracy rates and demonstrates superior efficiency in detecting intrusions compared to existing solutions. These findings underscore the potential of our approach in enhancing ICS security and mitigating risks posed by evolving attacks. [ABSTRACT FROM AUTHOR]

Regional ionospheric Total Electron Content (TEC) models are most significant to investigate the variability of ionosphere during all-weather conditions. Since the ground-based TEC measurements are not available in oceanic and polar regions, space-based observations are incorporated to increase the positional accuracy and reliability of Global Ionospheric TEC Maps (GIMs). Therefore, data fusion techniques are necessary to enhance the prediction capability of regional ionospheric models by considering multi-source data. In view of this, an attempt is made to investigate Equatorial Ionization Anomaly (EIA) structures in low-latitudinal Indian region using multi-instrument data. Data observations from background model CODEGIM, available International GNSS Service (IGS) stations in India, GNSS receivers at KLEF and Tripura stations, FORMOSAT/COSMIC radio occultation and SWARM during geomagnetic storm period August 26–28, 2021 are used for the study. Spherical Harmonics Function (SHF) of order 4 is employed along with Weighted Least Squares analysis (WLS), where separate weight constraint is computed for each data source. TEC maps of spatial resolution 5° x 5° and temporal resolution of 1 h are generated to illustrate the dynamic behavior of ionosphere. The standard deviation for 3 days is obtained as 0.42, 0.61 and 1.43 TECU respectively. TEC depletions and enhancements are observed on August 27 and 28, with mean values of 12.74 and 15.27 TECU respectively, demonstrating negative and positive storm effects. [ABSTRACT FROM AUTHOR]

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models. [ABSTRACT FROM AUTHOR]

In an era marked by the escalating architectural complexity of the Internet, network intrusion detection stands as a pivotal element in cybersecurity. This paper introduces Learn-IDS, an innovative framework crafted to bridge existing gaps between datasets and the training process within deep learning (DL) models for Network Intrusion Detection Systems (NIDS). To elevate conventional DL-based NIDS methods, which are frequently challenged by the evolving cyber threat landscape and exhibit limited generalizability across various environments, Learn-IDS works as a potent and adaptable platform and effectively tackles the challenges associated with datasets used in deep learning model training. Learn-IDS takes advantage of the raw data to address three challenges of existing published datasets, which are (1) the provided tabular format is not suitable for the diversity of DL models; (2) the fixed traffic instances are not suitable for the dynamic network scenarios; (3) the isolated published datasets cannot meet the cross-dataset requirement of DL-based NIDS studies. The data processing results illustrate that the proposed framework can correctly process and label the raw data with an average of 90% accuracy across three published datasets. To demonstrate how to use Learn-IDS for a DL-based NIDS study, we present two simple case studies. The case study on cross-dataset sampling function reports an average of 30.3% OOD accuracy improvement. The case study on data formatting function shows that introducing temporal information can enhance the detection accuracy by 4.1%.The experimental results illustrate that the proposed framework, through the synergistic fusion of datasets and DL models, not only enhances detection precision but also dynamically adapts to emerging threats within complex scenarios. [ABSTRACT FROM AUTHOR]

KRAS is a pathogenic gene frequently implicated in non-small cell lung cancer (NSCLC). However, biopsy as a diagnostic method has practical limitations. Therefore, it is important to accurately determine the mutation status of the KRAS gene non-invasively by combining NSCLC CT images and genetic data for early diagnosis and subsequent targeted therapy of patients. This paper proposes a Semi-supervised Multimodal Multiscale Attention Model (S2MMAM). S2MMAM comprises a Supervised Multilevel Fusion Segmentation Network (SMF-SN) and a Semi-supervised Multimodal Fusion Classification Network (S2MF-CN). S2MMAM facilitates the execution of the classification task by transferring the useful information captured in SMF-SN to the S2MF-CN to improve the model prediction accuracy. In SMF-SN, we propose a Triple Attention-guided Feature Aggregation module for obtaining segmentation features that incorporate high-level semantic abstract features and low-level semantic detail features. Segmentation features provide pre-guidance and key information expansion for S2MF-CN. S2MF-CN shares the encoder and decoder parameters of SMF-SN, which enables S2MF-CN to obtain rich classification features. S2MF-CN uses the proposed Intra and Inter Mutual Guidance Attention Fusion (I2MGAF) module to first guide segmentation and classification feature fusion to extract hidden multi-scale contextual information. I2MGAF then guides the multidimensional fusion of genetic data and CT image data to compensate for the lack of information in single modality data. S2MMAM achieved 83.27% AUC and 81.67% accuracy in predicting KRAS gene mutation status in NSCLC. This method uses medical image CT and genetic data to effectively improve the accuracy of predicting KRAS gene mutation status in NSCLC. [ABSTRACT FROM AUTHOR]

Due to the complexity of the calculation process of the existing methods, the efficiency of data fusion of the power grid model is low. In order to improve the knowledge fusion effect of power grid model, this paper studied the knowledge fusion method of power grid model based on Seq2seq half pointer and half label method. The Text Rank algorithm is used to calculate the weight of semantic nodes of each grid model, and combined with the topological potential method, the semantic information of the grid model is extracted according to the final weight value, and the Seq2Seq semi-pointer semi-label model framework is constructed. The data of the scheduling automation system OMS and the production management system PMS are used as input. The extracted candidate mesh model semantics and the original mesh model semantics are encoded by Seq2Seq half-pointer half-label model. The semantic data of the power grid model is fused and sent to the Seq2Seq encoder. After the training is completed, the effective information is extracted from the power grid model through the Seq2Seq model to complete the knowledge fusion of the power grid model. Experimental results show that this method eliminates the redundant part of the basic attributes of each data source in the substation grid model after knowledge fusion, and the description of each basic attribute is more standardized, unified and perfect. Under different mesh model data dimensions, the support of the proposed method is all above 98%. The model trained by the proposed method tends to be stable after 120 iterations, and the precision, recall and F1 of the test set are 0.98, 0.93 and 0.91, respectively. At the same time, this method has high efficiency in the knowledge fusion processing of the power grid model, and its data processing speed is less than 160 s. The average integrity of the private data of the power grid model is 98.86%, indicating that the proposed method can better ensure the integrity of the data. Finally, compared with the application of other methods under different data amounts, the mean square error obtained by the proposed method is the smallest, indicating that the proposed method effectively improves the fusion accuracy. [ABSTRACT FROM AUTHOR]

Beijing Satellite 3 is a high-performance optical remote sensing satellite with a spatial resolution of 0.3–0.5 m. It can provide timely and independent ultra-high-resolution spatial big data and comprehensive spatial information application services. At present, there is no relevant research on the fusion method of BJ-3A satellite images. In many applications, high-resolution panchromatic images alone are insufficient. Therefore, it is necessary to fuse them with multispectral images that contain spectral color information. Currently, there is a lack of research on the fusion method of BJ-3A satellite images. This article explores six traditional pixel-level fusion methods (HPF, HCS, wavelet, modified-IHS, PC, and Brovey) for fusing the panchromatic image and multispectral image of the BJ-3A satellite. The fusion results were analyzed qualitatively from two aspects: spatial detail enhancement capability and spectral fidelity. Five indicators, namely mean, standard deviation, entropy, correlation coefficient, and average gradient, were used for quantitative analysis. Finally, the fusion results were comprehensively evaluated from three aspects: spectral curves of ground objects, absolute error figure, and object-oriented classification effects. The findings of the research suggest that the fusion method known as HPF is the optimum and appropriate technique for fusing panchromatic and multispectral images obtained from BJ-3A. These results can be utilized as a guide for the implementation of BJ-3A panchromatic and multispectral data fusion in real-world scenarios. [ABSTRACT FROM AUTHOR]

Bearing operation states will directly determine the performance of the equipment; thus, monitoring operation status and degradation indicators is the key to ensuring continuous and healthy operation of the equipment. However, most of the research uses single-source information data, which makes it difficult to model when dealing with multi-source information, complex data distribution, and noise. In this paper, a bearing performance degradation assessment method based on multi-source information is proposed to comprehensively utilize the data signals of different structures, spaces, types, and sources. First, the adversarial fusion convolutional autoencoder is constructed for obtaining the degradation index of the bearing, while the adversarial learning strategy is applied to achieve the effect of enhancing the robustness and sensitivity of the degradation indicators extracted by the network. Then the degradation index is input into the support vector data description to determine the fault anomalies of the degradation index adaptively and the fuzzy c-means algorithms to obtain the final rolling bearing performance degradation evaluation results. Through the verification results of two experiment datasets, it is found that the proposed model can achieve accurate evaluation and quantitative analysis of the performance degradation process of bearings. As a result, the entire network ensures the reconstruction accuracy of normal samples while simultaneously stretching the reconstruction error of abnormal samples to achieve accurate monitoring of degradation onset. [ABSTRACT FROM AUTHOR]

The paper aims to develop an information system for human emotion recognition in streaming data obtained from a PC or smartphone camera, using different methods of modality merging (image, sound and text). The objects of research are the facial expressions, the emotional color of the tone of a conversation and the text transmitted by a person. The paper proposes different neural network structures for emotion recognition based on unimodal flows and models for the margin of the multimodal data. The analysis determined that the best classification accuracy is obtained for systems with data fusion after processing each channel separately and obtaining individual characteristics. The final analysis of the model based on data from a camera and microphone or recording or broadcast of the screen, which were received in the "live" mode, gave a clear understanding that the quality of the obtained results is highly dependent on the quality of the data preparation and labeling. This is directly related to the fact that the data on which the neural network is trained is highly qualified. The neural network with combined data on the penultimate layer allows a psycho-emotional state recognition accuracy of 0.90 to be obtained. The spatial distribution of emotion analysis was also analyzed for each data modality. The model with late fusion of multimodal data demonstrated the best recognition accuracy. [ABSTRACT FROM AUTHOR]

Since 3D sensors became popular, imaged depth data are easier to obtain in the consumer sector. In applications such as defect localization on industrial objects or mass/volume estimation, precise depth data is important and, thus, benefits from the usage of multiple information sources. However, a combination of RGB images and depth images can not only improve our understanding of objects, capacitating one to gain more information about objects but also enhance data quality. Combining different camera systems using data fusion can enable higher quality data since disadvantages can be compensated. Data fusion itself consists of data preparation and data registration. A challenge in data fusion is the different resolutions of sensors. Therefore, up- and downsampling algorithms are needed. This paper compares multiple up- and downsampling methods, such as different direct interpolation methods, joint bilateral upsampling (JBU), and Markov random fields (MRFs), in terms of their potential to create RGB-D images and improve the quality of depth information. In contrast to the literature in which imaging systems are adjusted to acquire the data of the same section simultaneously, the laboratory setup in this study was based on conveyor-based optical sorting processes, and therefore, the data were acquired at different time periods and different spatial locations. Data assignment and data cropping were necessary. In order to evaluate the results, root mean square error (RMSE), signal-to-noise ratio (SNR), correlation (CORR), universal quality index (UQI), and the contour offset are monitored. With JBU outperforming the other upsampling methods, achieving a meanRMSE = 25.22, mean SNR = 32.80, mean CORR = 0.99, and mean UQI = 0.97. [ABSTRACT FROM AUTHOR]

Implementing a proper integration scheme plays an important role in the performance of integrated navigation systems. Not only does employing a more reliable estimation method improve the accuracy of the integrated navigation system, but this can lead to a more robust solution in the presence of different types of uncertainties. Implementing an integration scheme that has a robust and simple structure is a challenging issue in the design of integrated navigation systems. By inspiring from the concept of PID control, this paper proposes a robust integration scheme for aided inertial navigation systems in the presence of aiding sensor measurement uncertainties. The proposed filter combines the concept of proportional-integral-derivative control theory and the standard Kalman filter estimator to improve the performance of the integration scheme. Thanks to the integral and derivative parts added to the proposed scheme, the integrated system attains a faster and more robust solution in the presence of observation errors and uncertainties. The simulation case studies validate the superior efficacy and capability of the proposed scheme compared to the integration method based on the standard Kalman filter. [ABSTRACT FROM AUTHOR]

As the core link of intelligent manufacturing, the process planning of aviation parts still faces the challenges such as relying on manual experiences for process decision-making and lack of linkage between process design and manufacturing for process optimisation. Process knowledge could support scientific decision-making on process issues, while twin data, namely high-fidelity simulation data and feedback information of manufacturing site, could further verify the process plans and optimise process parameters, so as to continuously improve the quality of process plans. Consequently, this paper proposes a general framework for twin data and knowledge-driven intelligent process planning (TDKIPP) of aviation parts, and analyses four standard procedures that support the above-mentioned reference framework, namely mechanism-data fusion process digital twin model, dynamic process knowledge base, process decision-making and evaluation, machining quality prediction and process feedback optimisation. A thus constructed test bed of TDKIPP and its four application examples about the process planning of a micro turbojet engine integral impeller demonstrate the feasibility and effectiveness of the proposed approach. [ABSTRACT FROM AUTHOR]

In the face of complex scenarios, the information insufficiency of classification tasks dominated by a single modality has led to a bottleneck in classification performance. The joint application of multimodal remote sensing data for surface observation tasks has garnered widespread attention. However, issues such as sample differences between modalities and the lack of correlation in physical features have limited the performance of classification tasks. Establishing effective interaction between multimodal data has become another significant challenge. To fully integrate heterogeneous information from multiple modalities and enhance classification performance, this paper proposes a dual-branch cross-Transformer feature fusion network aimed at joint land cover classification of hyperspectral imagery (HSI) and Light Detection and Ranging (LiDAR) data. The core idea is to leverage the potential of convolutional operators to represent spatial features, combined with the advantages of the Transformer architecture in learning remote dependencies. The framework employs an improved self-attention mechanism to aggregate features within each modality, highlighting the spectral information of HSI and the spatial (elevation) information of LiDAR. The feature fusion module based on cross-attention integrates deep features from two modalities, achieving complementary information through cross-modal attention. The classification task is performed using jointly obtained spectral and spatial features. Experiments were conducted on three multi-source remote sensing classification datasets, demonstrating the effectiveness of the proposed model compared to existing methods. [ABSTRACT FROM AUTHOR]

Advancing the domain of biomedical investigation, integrated multi-omics data have shown exceptional performance in elucidating complex human diseases. However, as the variety of omics information expands, precisely perceiving the informativeness of intra- and inter-omics becomes challenging due to the intricate interrelations, thus presenting significant challenges in the integration of multi-omics data. To address this, we introduce a novel multi-omics integration approach, referred to as TEMINET. This approach enhances diagnostic prediction by leveraging an intra-omics co-informative representation module and a trustworthy learning strategy used to address inter-omics fusion. Considering the multifactorial nature of complex diseases, TEMINET utilizes intra-omics features to construct disease-specific networks; then, it applies graph attention networks and a multi-level framework to capture more collective informativeness than pairwise relations. To perceive the contribution of co-informative representations within intra-omics, we designed a trustworthy learning strategy to identify the reliability of each omics in integration. To integrate inter-omics information, a combined-beliefs fusion approach is deployed to harmonize the trustworthy representations of different omics types effectively. Our experiments across four different diseases using mRNA, methylation, and miRNA data demonstrate that TEMINET achieves advanced performance and robustness in classification tasks. [ABSTRACT FROM AUTHOR]

Completing traffic data is a basic requirement for intelligent transportation systems. However, completing spatiotemporal traffic data poses a significant challenge, especially for high-dimensional data with complex missing mechanisms. Various completion methods targeting different missing mechanisms have showcased the superiority of tensor learning by effectively characterizing intricate spatiotemporal correlations. In this study, a novel tensor completion framework, known as the multi-source tensor completion method for data fusion, is proposed. This framework incorporates passenger transfer relationships between buses and subways into subway data completion, enhancing the data completion accuracy. Moreover, by combining bus transfer passenger flow data with other data dimensions, such as the different road sections, time intervals, and days, an innovative 4D low-rank tensor completion data framework was obtained. In addition, to boost the completion accuracy, a truncated l 2 , p norm optimization model was derived. This model enhances the non-convex performance of the objective function throughout the tensor completion process. The results highlight the superiority of the proposed completion method, leveraging fused subway/bus data over other completion methods that rely solely on subway data. [ABSTRACT FROM AUTHOR]

Digital transformation in manufacturing necessitates the integration of advanced fields such as robotics, the Internet of Things (IoT), and data science. The latter two, in particular, introduce a unique set of challenges related to data acquisition and processing, especially for emerging manufacturing sectors that lack substantial data volumes for analytical software. This paper specifically addresses the challenges associated with limited data within the context of precision poultry farming. We begin by identifying the specific challenges encountered during the development of a smart poultry management software system. Subsequently, we propose potential solutions for each identified challenge. The outcome of this study is a comprehensive algorithm for data processing that encapsulates these proposed solutions, offering a practical approach to overcoming data limitations in precision poultry farming. [ABSTRACT FROM AUTHOR]

In the context of rapid developments in drone technology, the significance of recognizing and detecting low-altitude unmanned aerial vehicles (UAVs) has grown. Although conventional algorithmic enhancements have increased the detection rate of low-altitude UAV targets, they tend to neglect the intricate nature and computational demands of the algorithms. This paper introduces ATD-YOLO, an enhanced target detection model based on the YOLOv5s architecture, aimed at tackling this issue. Firstly, a realistic low-altitude UAV dataset is fashioned by amalgamating various publicly available datasets. Secondly, a C3F module grounded in FasterNet, incorporating Partial Convolution (PConv), is introduced to decrease model parameters while upholding detection accuracy. Furthermore, the backbone network incorporates an Efficient Multi-Scale Attention (EMA) module to extract essential image information while filtering out irrelevant details, facilitating adaptive feature fusion. Additionally, the universal upsampling operator CARAFE (Content-aware reassembly of features) is utilized instead of nearest-neighbor upsampling. This enhancement boosts the performance of the feature pyramid network by expanding the receptive field for data feature fusion. Lastly, the Slim-Neck network is introduced to fine-tune the feature fusion network, thereby reducing the model's floating-point calculations and parameters. Experimental findings demonstrate that the improved ATD-YOLO model achieves an accuracy of 92.8%, with a 31.4% decrease in parameters and a 28.7% decrease in floating-point calculations compared to the original model. The detection speed reaches 75.37 frames per second (FPS). These experiments affirm that the proposed enhancement method meets the deployment requirements for low computational power while maintaining high precision. [ABSTRACT FROM AUTHOR]

In order to solve the problem of large positioning error and incomplete mapping of SLAM based on two-dimensional lidar in indoor environment, a multi-sensor fusion SLAM algorithm for indoor robots was proposed. Aiming at the mismatch problem of the traditional ICP algorithm in the front end of the lidar SLAM, the algorithm adopts the PL-ICP algorithm that is more suitable for the indoor environment, and uses the extended Kalman filter to fuse the wheel odometer and IMU to provide the initial motion estimation value. Then, during the mapping phase, the pseudo 2D laser data converted from the 3D point cloud data obtained by the depth camera is fused with the data obtained from the 2D lidar to compensate for the lack of vertical field of view in the 2D lidar mapping. The final experimental results show that the fusion odometer data has improved the positioning accuracy by at least 33% compared to a single wheeled odometer, providing a higher initial iteration value for the PL-ICP algorithm. At the same time, fusion mapping compensates for the shortcomings of a single two-dimensional lidar mapping, and constructs an environmental map with more complete environmental information. [ABSTRACT FROM AUTHOR]

Predictive Business Process Monitoring (PBPM) is a significant research area in Business Process Management (BPM) aimed at accurately forecasting future behavioral events. At present, deep learning methods are widely cited in PBPM research, but no method has been effective in fusing data information into the control flow for multi-perspective process prediction. Therefore, this paper proposes a process prediction method based on the hierarchical BERT and multi-perspective data fusion. Firstly, the first layer BERT network learns the correlations between different category attribute data. Then, the attribute data is integrated into a weighted event-level feature vector and input into the second layer BERT network to learn the impact and priority relationship of each event on future predicted events. Next, the multi-head attention mechanism within the framework is visualized for analysis, helping to understand the decision-making logic of the framework and providing visual predictions. Finally, experimental results show that the predictive accuracy of the framework surpasses the current state-ofthe- art research methods and significantly enhances the predictive performance of BPM. [ABSTRACT FROM AUTHOR]

In prognostics and health management, the system's degradation condition assessment and corresponding remaining useful life prediction are the most important tasks. Both of these processes are heavily dependent on information gathered by multiple sensors, which eventually causes data fusion-related complex problems. Typically, sensor information contains the speed, pressure, temperature, and similar other types of various system data. These systems' data obtained through sensors can be utilized as a part of the evidence in the evidence-based estimation method. In this work, an artificial intelligence-based novel framework for estimating the remaining useful life using data fusion has been presented. The Dempster–Shafer extended theory is adopted for sensor information modeling and data fusion. Besides, two different scenarios are introduced to determine the similarity between the studied system and the available evidence. As a case study, the turbofan dataset is demonstrated to assess the proposed method. Based on the results, our integrated proposed method performs very competitively compared with the existing methods based on standard scores and performance criteria. [ABSTRACT FROM AUTHOR]

In the manufacturing process of optical lenses, the lack of monitoring and detection of the central processing process leads to low processing efficiency and difficulty in ensuring product consistency. We propose a digital twin system for alignment processing to address this issue. The system adopts a hierarchical architecture based on the digital twin five-dimensional model, aiming to improve the fidelity and interactivity of the virtual model of the centring lathe by combining dimension-driven virtual models with integrated data and physical models of the turning mechanism. We have successfully achieved the semantic and physical fusion of multi-source heterogeneous data during centring processing using information models and OPC UA-based data interaction methods. In addition, we adopted the VMD-GRU method based on feature fusion for real-time monitoring of critical components of the centring lathe. Finally, we validated the feasibility and effectiveness of the digital twin system for the central lathe through development examples. The application of this system is expected to promote the digital and intelligent development of high-precision optical component processing, providing references including references for related manufacturing fields. In summary, we propose a digital monitoring and detection system for the centring process of optical lens manufacturing. The application of this system will help improve product consistency and processing efficiency while reducing risks and costs in the manufacturing process. [ABSTRACT FROM AUTHOR]

Accurate prediction of Electro-Discharge Machining (EDM) results is crucial for industrial applications, aiming to achieve high-performance and cost-efficient machining. However, both the current physical model and the standard Artificial Neural Network (ANN) model exhibit inherent limitations, failing to fully meet the accurate requirements for predicting EDM machining results. In addition, Micro-EDM Drilling can lead to the distortion of the macroscopic shape of machining pits under different input conditions, rendering the use of only the volume of machining pits as the evaluation index insufficient to express the complete morphological information. In this study, we propose a novel hybrid prediction model that combines the strengths of both physical and data-driven models to simultaneously predict Material Removal Rate (MRR) and shape parameters. Our experiment demonstrates that the hybrid model achieves a maximum prediction error of 4.92% for MRR and 5.28% for shape parameters, showcasing excellent prediction accuracy and stability compared to the physical model and the standard ANN model. [ABSTRACT FROM AUTHOR]

The number of fully electric or hybrid ships relying on battery power for propulsion and maneuvering is growing. In order to ensure the safety of these ships, it is important to monitor the capacity that can be stored in the batteries, and classification societies typically require that this can be verified by independent tests—annual capacity tests. However, this paper discusses data‐driven alternatives based on operational sensor data collected from the batteries. There are different strategies for such data‐driven state of health (SOH) estimation. Some approaches require full operational history of the batteries in order to predict SOH, and this may be impractical due to several reasons. Thus, methods that are able to give reliable estimation of SOH based on only snapshots of the data streams are more attractive from a practical point of view. In this paper, data‐driven snapshot methods are explored and applied to degradation data from battery cells cycled in different laboratory tests. Hence, data from different sources are fused together with the aim of achieving better predictions. The paper presents the battery data show how relevant features can be extracted from snapshots of the data and presents data‐driven models for SOH estimation. It is discussed how such methods could be utilized in a data‐driven classification regime for maritime battery systems. Results are encouraging, and yields reasonable degradation estimates for nearly 40% of the tested cells, although the fusion of data from different laboratory tests did not improve results significantly. Results are greatly improved if data from the actual cell is included in the training data, and indicates that better results can be achieved if more representative training data is available. [ABSTRACT FROM AUTHOR]

Many engineering problems involve optimizing a high-dimensional expensive black-box (HEB) design space. To solve such problems efficiently, a knowledge transfer (KT) assisted efficient global optimization (EGO) algorithm is proposed, called the KT-EGO, which extends the EGO algorithm for solving problems over higher dimensions (i.e.d>20). Specifically, the original design space is divided into several low-dimensional subset design spaces. More importantly, in order to extract information from the subset design spaces to accelerate the progress of full optimization, a surrogate-based data fusion strategy is proposed in the KT-EGO. And further, a searching strategy with an adaptive variable range is devised to enhance the exploitation of promising areas. To show the effectiveness of the proposed algorithm, it is compared against state-of-the-art algorithms over 12 benchmark functions and a 28-dimensional engineering optimization for the design of a compressor blade, which fully validates the effectiveness of the KT-EGO for solving HEB problems. [ABSTRACT FROM AUTHOR]

Information from multiple data sources is increasingly available. However, some data sources may produce biased estimates due to biased sampling, data corruption or model misspecification. Thus there is a need for robust data combination methods that can be used with biased sources. In this paper, a robust data fusion-extraction method is proposed. Unlike existing methods, the proposed method can be applied in the important case where researchers have no knowledge of which data sources are unbiased. The proposed estimator is easy to compute and employs only summary statistics; hence it can be applied in many different fields, such as meta-analysis, Mendelian randomization and distributed systems. The proposed estimator is consistent, even if many data sources are biased, and is asymptotically equivalent to the oracle estimator that uses only unbiased data. Asymptotic normality of the proposed estimator is also established. In contrast to existing meta-analysis methods, the theoretical properties are guaranteed for our estimator, even if the number of data sources and the dimension of the parameter diverge as the sample size increases. Furthermore, the proposed method provides consistent selection for unbiased data sources with probability approaching 1. Simulation studies demonstrate the efficiency and robustness of the proposed method empirically. The method is applied to a meta-analysis dataset to evaluate surgical treatment for moderate periodontal disease and to a Mendelian randomization dataset to study the risk factors for head and neck cancer. [ABSTRACT FROM AUTHOR]

We aim to make inferences about a smooth, finite-dimensional parameter by fusing together data from multiple sources. Previous works have studied the estimation of a variety of parameters in similar data fusion settings, including estimation of the average treatment effect and average reward under a policy, with the majority of them merging one historical data source with covariates, actions and rewards, and one data source of the same covariates. In this article, we consider the general case where one or more data sources align with each part of the distribution of the target population, such as the conditional distribution of the reward given actions and covariates. We describe potential gains in efficiency that can arise from fusing these data sources together in a single analysis, which we characterize by a reduction in the semiparametric efficiency bound. We also provide a general means of constructing estimators that achieve these bounds. Numerical simulations demonstrate marked improvements in efficiency from using the proposed estimators rather than their natural alternatives. Finally, we illustrate the magnitude of efficiency gains that can be realized in vaccine immunogenicity studies by fusing data from two HIV vaccine trials. [ABSTRACT FROM AUTHOR]

Urban traffic congestion is of utmost importance for modern societies due to population and economic growth. Thus, it contributes to environmental problems like increasing greenhouse gas emissions and noise pollution. Improved traffic flow in urban networks relies heavily on traffic signal control. Hence, optimizing cycle timing at many intersections is paramount to reducing congestion and increasing sustainability. This paper introduces an alternative to conventional traffic signal control, EcoLight+, which incorporates future noise predictions with the deep dueling Q-network reinforcement Learning algorithm to reduce noise levels, CO 2 emissions, and fuel consumption. An innovative data fusion approach is also proposed to improve our LSTM-based noise prediction model by integrating heterogeneous data from different sources. Our proposed solution allows the system to achieve higher efficiency than its competitors based on real-world data from Tallinn, Estonia. [ABSTRACT FROM AUTHOR]

Data fusion technology plays a pivotal role in aggregating, storing, and mining multi-source data to extract its joint value through the construction of a unified fusion representation model. However, we argue that mainstream methods are limited to precise data, which may not satisfy practical application requirements, as data collected from an information source often exhibits imprecision and uncertainty. In this paper, we develop a Multi-source Fuzzy Data-driven Dynamic Fusion Representation (MFD-DFR) model. This model effectively addresses the challenges related to heterogeneity, dynamics, and quality optimization that arise during the fusion of fuzzy data. To achieve this goal, we first adopt intervals as a means of description to capture the inherent uncertainty in single-source information. We then present a Dynamic Interval Standardization (DIS) algorithm, a novel approach that dynamically deals with the heterogeneity of multi-source fuzzy data without relying on the storage of historical sample data. We next propose a fusion representation model for standardized intervals that improves the quality of single-source fuzzy data through confidence interval estimation. The experimental results convincingly demonstrate that the MFD-DFR model outperforms alternative models in terms of data classification and clustering. We also show the effectiveness of our proposed DIS algorithm in expediting the convergence speed of gradient descent algorithms. [ABSTRACT FROM AUTHOR]

Prior to further processing, completed questionnaires must be screened for the presence of careless respondents. Different people will respond to surveys in different ways. Some take the easy path and fill out the survey carelessly. The proportion of careless respondents determines the survey's quality. As a result, identifying careless respondents is critical for the quality of obtained results. This study aims to explore the characteristics of careless respondents in survey data and evaluate the predictive power and interpretability of different types of data and indices of careless responding. The research question focuses on understanding the behavior of careless respondents and determining the effectiveness of various data sources in predicting their responses. Data from a three-month web-based survey on participants' personality traits such as honesty-humility, emotionality, extraversion, agreeableness, conscientiousness and openness to experience was used in this study. Data for this study was taken from Schroeders et al.. The gradient boosting machine-based prediction model uses data from the answers, time spent for answering, demographic information on the respondents as well as some indices of careless responding from all three types of data. Prediction models were evaluated with tenfold cross-validation repeated a hundred times. Prediction models were compared based on balanced accuracy. Models' explanations were provided with Shapley values. Compared with existing work, data fusion from multiple types of information had no noticeable effect on the performance of the gradient boosting machine model. Variables such as "I would never take a bribe, even if it was a lot", average longstring, and total intra-individual response variability were found to be useful in distinguishing careless respondents. However, variables like "I would be tempted to use counterfeit money if I could get away with it" and intra-individual response variability of the first section of a survey showed limited effectiveness. Additionally, this study indicated that, whereas the psychometric synonym score has an immediate effect and is designed with the goal of identifying careless respondents when combined with other variables, it is not necessarily the optimal choice for fitting a gradient boosting machine model. [ABSTRACT FROM AUTHOR]

The roughness of the part surface is one of the most crucial standards for evaluating machining quality due to its relationship with service performance. For a preferable comprehension of the evolution of surface roughness, this study proposes a novel surface roughness prediction model on the basis of the unity of fuse d signal features and deep learning architecture. The force and vibration signals produced in the milling of P20 die steel are collected, and time and frequency domain feature from the acquired signals are extracted by variational modal decomposition. The GA-MI algorithm is taken to select the signal features that are relevant to the surface roughness of the workpiece. The optimal feature subset is analyzed and used as the input of the prediction model. DBN is adopted to estimate the surface roughness and the model parameters are optimized by ISSA. (Reviewer 1, Q1) The separate force, vibration and fusion signal information are brought into the DBN model and the ISSA-DBN model for the prediction of surface roughness, and the results show that the accuracy of the roughness prediction is as follows, respectively DBN: 78.1%, 68.8% and 84.4%, and ISSA-DBN: 93.8%, 87.5% and 100%. [ABSTRACT FROM AUTHOR]

The relevance of data fusion in handling big data in blockchain-enabled healthcare systems is of utmost importance in today's data-driven healthcare landscape. As healthcare systems continue to generate vast amounts of data from various sources, the need to effectively manage and analyze this data becomes crucial for informed decision-making, improved patient outcomes, and efficient healthcare operations. The gaps for time complexity and inaccuracy of feature fusion in the existing algorithms have been identified by surveying the existing literature and this article is proposing a multi-attribute feature fusion algorithm blockchain communications based on ant colony neural networks (ACNN) to overcome the problems in the state-of-the-arts. This article applies the feature decomposition method for communication between blockchain-based healthcare transactions, and optimizes the information based on the data characteristics. The proposed algorithm identifies the properties and attributes of the data by making use of rough set theory. A genetic algorithm is also used to improve the ACNN which enhances the search ability by minimizing the space complexity of the solution space. The multi-attribute fusion mechanism extracts the information from the blockchain transactions and filters out the characteristics of data using the proposed method, and achieves better accuracy. The empirical results show that the fusion error of the blockchain communications based on multi-attribute feature fusion algorithm is relatively small and stable. The outcomes of the proposed fusion mechanism are promising and it has been found that the proposed mechanism produces accurate results with minimal errors. The average energy consumption rate during the transition of data is below 2% which reflects the viability of the proposed fusion mechanism for blockchain-based healthcare transactions. [ABSTRACT FROM AUTHOR]

Based on the rapid development of Internet new generation information technology, campus culture has become an important force to promote educational innovation. However, the uneven quality of campus culture teaching is also increasingly exposed. Therefore, we propose a set of campus culture intelligent quality assessment feedback system driven by data and knowledge. Based on real multi-modal campus culture data, the evaluation system covers different online teaching forms, and can comprehensively consider and measure the core elements of quality evaluation from the perspective of teachers and students, so as to achieve accurate evaluation and feedback of campus culture. This paper proposes to combine emotion computing with big data analysis, construct a theoretical framework of multi-modal emotion analysis from the perspective of multi-spatial fusion, and explore the students' learning emotion recognition and intelligent assessment based on multi-modal data fusion. By studying the key issues, logical path and implementation path of multimodal learning emotion analysis in campus culture, this paper reveals the mechanism of student emotion development from the perspective of campus culture, expands the intervention practice of student group emotion, and provides technical support and action guidance for after-school teaching and research on campus culture. [ABSTRACT FROM AUTHOR]

In recent years, machine learning methods based on epileptic signals have shown good results with brain-computer interfaces (BCIs). With the continuous expansion of their applications, the demand for labeled epileptic signals is increasing. For a large number of data-driven models, such signals are not suitable, as they extend the calibration cycle. Therefore, a new domain-adaptive TSK fuzzy system model based on multisource data fusion (DA-TSK) is proposed. The purpose of DA-TSK is to maintain high classification performance when the amount of labeled data is insufficient. The DA-TSK model not only has a strong learning ability to learn characteristic information from EEG data but is also interpretable, which aids in the understanding of the analytic process of the model for medical purposes. In particular, this model can make full use of a small amount of labeled EEG data in the source domain and target domain through domain adaptation. Therefore, the DA-TSK model can reduce data dependence to a certain extent and improve the generalization performance of the target classifier. Experiments are performed to evaluate the effectiveness of the DA-TSK model on public EEG datasets based on epileptic signals. The DA-TSK model can obtain satisfactory accuracy when the labeled data are insufficient in the target domain. [ABSTRACT FROM AUTHOR]

Effective civil infrastructure management necessitates the utilization of timely data across the entire asset lifecycle for condition assessment and predictive maintenance. A notable gap in current predictive maintenance practices is the reliance on single-source data instead of heterogeneous data, decreasing data accuracy, reliability, adaptability, and further effectiveness of engineering decision-making. Data fusion is thus demanded to transform low-dimensional decisions from individual sensors into high-dimensional ones for decision optimization. In this context, digital twin (DT) technology is set to revolutionize the civil infrastructure industry by facilitating real-time data processing and informed decision-making. However, data-driven smart civil infrastructure management using DT is not yet achieved, especially in terms of data fusion. This paper aims to establish a conceptual framework for harnessing DT technology with data fusion to ensure the efficiency of civil infrastructures throughout their lifecycle. To achieve this objective, a systematic review of 105 papers was conducted to thematically analyze data fusion approaches and DT frameworks for civil infrastructure management, including their applications, core DT technologies, and challenges. Several gaps are identified, such as the difficulty in data integration due to data heterogeneity, seamless interoperability, difficulties associated with data quality, maintaining the semantic features of big data, technological limitations, and complexities with algorithm selection. Given these challenges, this research proposed a framework emphasizing multilayer data fusion, the integration of open building information modeling (openBIM) and geographic information system (GIS) for immersive visualization and stakeholder engagement, and the adoption of extended industry foundation classes (IFC) for data integration throughout the asset lifecycle. [ABSTRACT FROM AUTHOR]

This paper pioneers the use of the extreme learning machine (ELM) approach for surface roughness prediction in ultra-precision milling, leveraging the excellent fitting ability with small datasets and the fast learning speed of the extreme learning machine method. By providing abundant machining information, the machining parameters and force signal data are fused on the feature level to further improve ELM prediction accuracy. An ultra-precision milling experiment was designed and conducted to verify our proposed data-fusion-based ELM method. The results show that the ELM with data fusion outperforms other state-of-art methods in surface roughness prediction. It achieves an impressively low mean absolute percentage error of 1.6% while requiring a mere 18 s for model training. [ABSTRACT FROM AUTHOR]

Chlorophyll-a concentration (Chl-a) is an important indicator of coastal eutrophication. Remote sensing technology provides a global view of it. However, different types of sensors are subject to design constraints and cannot meet the requirements of high temporal and spatial resolution on nearshore engineering simultaneously. To obtain high-spatiotemporal-resolution images, this study examines the performance of the enhanced spatial and temporal adaptive reflectance fusion model (ESTARFM) on GOCI and Landsat Chl-a data fusion. Considering the rapidly changing rate and consistency of oceanic Chl-a, the ESTARFM was modified via segmented fitting and numerical conversion. The results show that both fusion models can fuse multiple data advantages to obtain high-spatiotemporal-resolution Chl-a images. Compared with the ESTARFM, the modified solution has a better performance in terms of the root mean square error and correlation coefficient, and its results have better spatial consistency for coastal Chl-a. In addition, the new solution expands the data utilization range of data fusion by reducing the influence of the time interval of original data and realizes better monitoring of nearshore Chl-a changes. [ABSTRACT FROM AUTHOR]

IoT (Internet of Things) devices are increasingly being used in healthcare to collect and transmit patient data, which can improve patient outcomes and reduce costs. However, this also creates new challenges for data security and privacy. Thus, the major demand for secure and efficient data-sharing solutions has prompted significant attention due to the increasing volume of shared sensor data. Leveraging a data-fusion-based paradigm within the realm of IoT-protected healthcare systems enabled the collection and analysis of patient data from diverse sources, encompassing medical devices, electronic health records (EHRs), and wearables. This innovative approach holds the potential to yield immediate benefits in terms of enhancing patient care, including more precise diagnoses and treatment plans. It empowers healthcare professionals to devise personalized treatment regimens by amalgamating data from multiple origins. Moreover, it has the capacity to alleviate financial burdens, elevate healthcare outcomes, and augment patient satisfaction. Furthermore, this concept extends to fortifying patient records against unauthorized access and potential misuse. In this study, we propose a novel approach for secure transmission of healthcare data, amalgamating the improved context-aware data-fusion method with an emotional-intelligence-inspired enhanced dynamic Bayesian network (EDBN). The findings indicated that F1 score, accuracy, precision, recall, and ROC-AUC score using DCNN were 89.3%, 87.4%, 91.4%, 92.1%, and 0.56, respectively, which was second-highest to the proposed method. On the other hand, the F1 score, accuracy, precision, recall, and ROC-AUC scores of FRCNN and CNN were low in accuracy at 83.2% and 84.3%, respectively. Our experimental investigation demonstrated superior performance compared with existing methods, as evidenced by various performance metrics, including recall, precision, F measures, and accuracy. [ABSTRACT FROM AUTHOR]

Leaf area index (LAI) is an important biophysical parameter of vegetation and serves as a significant indicator for assessing forest ecosystems. Multi-source remote sensing data enables large-scale and dynamic surface observations, providing effective data for quantifying various indices in forest and evaluating ecosystem changes. However, employing single-source remote sensing spectral or LiDAR waveform data poses limitations for LAI inversion, making the integration of multi-source remote sensing data a trend. Currently, the fusion of active and passive remote sensing data for LAI inversion primarily relies on empirical models, which are mainly constructed based on field measurements and do not provide a good explanation of the fusion mechanism. In this study, we aimed to estimate LAI based on physical model using both spectral imagery and LiDAR waveform, exploring whether data fusion improved the accuracy of LAI inversion. Specifically, based on the physical model geometric-optical and radiative transfer (GORT), a fusion strategy was designed for LAI inversion. To ensure inversion accuracy, we enhanced the data processing by introducing a constraint-based EM waveform decomposition method. Considering the spatial heterogeneity of canopy/ground reflectivity ratio in regional forests, calculation strategy was proposed to improve this parameter in inversion model. The results showed that the constraint-based EM waveform decomposition method improved the decomposition accuracy with an average 12% reduction in RMSE, yielding more accurate waveform energy parameters. The proposed calculation strategy for the canopy/ground reflectivity ratio, considering dynamic variation of parameter, effectively enhanced previous research that relied on a fixed value, thereby improving the inversion accuracy that increasing on the correlation by 5% to 10% and on R² by 62.5% to 132.1%. Based on the inversion strategy we proposed, data fusion could effectively be used for LAI inversion. The inversion accuracy achieved using both spectral and LiDAR data (correlation=0.81, R² = 0.65, RMSE=1.01) surpassed that of using spectral data or LiDAR alone. This study provides a new inversion strategy for large-scale and high-precision LAI inversion, supporting the field of LAI research. [ABSTRACT FROM AUTHOR]

The traditional leveling, total station, and global navigation satellite system (GNSS) and the new differential interferometric synthetic aperture radar (DInSAR) and terrestrial laser scanning (TLS) systems have their own advantages and limitations in the deformation monitoring of mining areas. It is difficult to obtain accurate deformation information only using single-source measurement data. In this study, we propose an LOS deformation correction method for DInSAR in mining areas by fusing ground data without control points. Based on free space data, small deformations at the edges of mining influence areas accurately obtained using DInSAR. By combining leveling/GNSS and TLS methods, it was possible to obtain large deformations in central areas without the need for control points located outside the mining influence range. For overcoming the non-uniform coordinates of the "space–ground" data and the limited overlap of the effective measurement ranges, the subsidence prediction model was employed to assist in its fusion. In addition, in LOS deformation correction, we retained the non-full cycle phase of DInSAR and replaced the full cycle phase with the one from the data fusion. Engineering experiments have shown that the correction results preserve the differences in the LOS deformations at the edge areas of the mine influence range, and they recover the lost LOS deformations at the center areas. Using the difference in the LOS deformation before and after correction as the verification indicator, the maximum absolute value of the errors after correction was 143 mm, which was approximately 6.4% of the maximum LOS deformation. In addition, there were still two errors that were large (−112 mm and −89 mm, respectively), and the absolute values of errors were not more than 75 mm. For all errors, the mean absolute value was 36 mm. Compared with 399 mm before correction, the error was reduced by 91%. This study provides technical support and theoretical reference for deformation monitoring and control in mining areas. [ABSTRACT FROM AUTHOR]

In order to expand the application of remote sensing prospecting technology in gold prospecting, this paper takes the Zhuanshanzi area in Inner Mongolia as an example, and selects Landsat 8 OLI remote sensing data. On the basis of image data preprocessing, the regional tectonic information is enhanced by the fusion of B7B5B3 band. The principal component analysis is used to extract the alteration anomaly information through threshold segmentation. Based on the geological characteristics and remote sensing interpretation information of the region and Zhuanshanzi Gold Deposit, the prospecting indicator of gold deposits in Zhuanshanzi area is established, and 3 prospect areas for prospecting prediction are delineated. The field verification shows that there is gold mineralization in the prospect area. It is believed that the linear and ring structure and remote sensing anomaly information extraction based on OLI remote sensing images can be used as auxiliary means for gold prospecting prediction. [ABSTRACT FROM AUTHOR]

Aiming to solve the problems of the inaccurate dimension reduction of high-dimensional data and insufficient information utilization in traditional manufacturing process monitoring methods—in which mostly only the distance information of pairwise points is used as the similarity index for the data dimension reduction—this paper proposes a data-manifold-based monitoring method that combines the distance information and angle information of pairwise points. First, the intrinsic dimension of manufacturing process data is estimated by combining multiple geometric features on the data manifold. Second, considering the angle information and distance information in the neighborhood of process data, the method to construct local features of the data manifold is given; further, a fusion method of local features and global–local features of manifold data based on the eigendimension is proposed, which constructs the data dimension-reduction mapping matrix to improve the integrity of data information extraction. Then, the data index of process monitoring is given and employed to monitor the manufacturing process. Finally, Tennessee Eastman (TE) process simulation data were used to verify the effectiveness of the proposed method. The results show that compared with other methods, the anomaly detection rate of the proposed method was increased by more than 50%, while the false alarm rate was decreased by 21.4%, which proves that the method can significantly improve the efficiency of manufacturing process anomaly monitoring. [ABSTRACT FROM AUTHOR]

In order to improve the UAV prevention and control capability in key areas and improve the rapid identification and trajectory prediction accuracy of the ground detection system in anti-UAV early warnings, an improved LSTM trajectory prediction network CA-LSTM (CNN-Attention-LSTM) based on attention enhancement and convolution fusion structure is proposed. Firstly, the native Yolov5 network is improved to enhance its detection ability for small targets of infrared UAVs, and the trajectory of UAVs in image space is constructed. Secondly, the LSTM network and convolutional neural network are integrated to improve the expression ability of the deep features of UAV trajectory data, and at the same time, the attention structure is designed to more comprehensively obtain time series context information, improve the influence on important time series features, and realize coarse–fine-grained feature fusion. Finally, tests were carried out on a homemade UAV infrared detection dataset. The experimental results show that the algorithm proposed in this paper can quickly and accurately identify infrared UAV targets and can achieve more accurate predictions of UAV flight trajectories, which are reduced by 9.43% and 23.81% in terms of MAPE and MSE indicators compared with the native LSTM network (the smaller the values of these evaluation indexes, the better the prediction results). [ABSTRACT FROM AUTHOR]

Single molecule localization microscopy offers resolution nearly down to the molecular level with specific molecular labelling, and is thereby a promising tool for structural biology. In practice, however, the actual value to this field is limited primarily by incomplete fluorescent labelling of the structure. This missing information can be completed by merging information from many structurally identical particles in a particle fusion approach similar to cryo-EM single-particle analysis. In this paper, we present a data analysis of particle fusion results of fluorescently labelled Nup96 nucleoporins in the Nuclear Pore Complex to show that Nup96 occurs in a spatial arrangement of two rings of 8 units with two Nup96 copies per unit giving a total of 32 Nup96 copies per pore. We use Artificial Intelligence assisted modeling in Alphafold to extend the existing cryo-EM model of Nup96 to accurately pinpoint the positions of the fluorescent labels and show the accuracy of the match between fluorescent and cryo-EM data to be better than 3 nm in-plane and 5 nm out-of-plane. [ABSTRACT FROM AUTHOR]

Early diagnosis of Alzheimer's disease (AD) plays a key role in preventing and responding to this neurodegenerative disease. It has shown that, compared with a single imaging modality‐based classification of AD, synergy exploration among multimodal neuroimages is beneficial for the pathological identification. However, effectively exploiting multimodal information is still a big challenge due to the lack of efficient fusion methods. Herein, a multimodal fusion network based on attention mechanism is proposed, in which magnetic resonance imaging (MRI) and positron emission computed tomography (PET) images are converted into feature vectors with the same dimension, while the demographic information and clinical data are preprocessed and converted into feature vectors through embedding. This attention model can focus on important feature points, fuse the multimodal information more effectively, and thus provide accurate diagnosis and prediction for different pathological stages. The results show that the model achieves an accuracy of 84.1% for triple classification tasks in normal cognition (NC) versus mild cognitive impairment (MCI) versus AD and 93.9% prediction accuracy in stable MCI (sMCI) versus progressive MCI (pMCI). In contrast to the existing multimodal diagnosis methods, our model yields a state‐of‐the‐art accuracy of AD diagnosis, which is powerful and promising in clinical practice. [ABSTRACT FROM AUTHOR]