Search

This study addresses the challenges of engaging Chinese-speaking audiences in international sports events due to fragmented communication models and limited media integration. A novel interaction model based on multi-channel data fusion is proposed to enhance information dissemination and user engagement. The model integrates data from traditional media, internet media, and social media into a cohesive platform, utilizing advanced data fusion techniques, microservices architecture, and technologies such as Docker, Kubernetes, and WebSocket for high availability and real-time interaction. Additionally, Nginx with the RTMP module and Akamai CDN ensures highquality streaming services. Experimental results demonstrate the platform's effectiveness in data integration, content publishing, and real-time user interaction, significantly improving Chinese engagement in international sports events. This research provides practical strategies for event organizers to enhance communication, leading to higher audience satisfaction and participation, and contributes to the theoretical framework of sports event communication through innovative and inclusive practices. [ABSTRACT FROM AUTHOR]

This study proposes an approach of leveraging information gathered from multiple traffic data sources at different resolutions to obtain approximate inference on the traffic distribution of Chicago's O'Hare Airport area. Specifically, it proposes the ingestion of traffic datasets at different resolutions to build spatiotemporal models for predicting the distribution of traffic volume on the road network. Due to its good adaptability and flexibility for spatiotemporal data, the Gaussian process (GP) regression was employed to provide short-term forecasts using data collected by loop detectors (sensors) and supplemented by telematics data. The GP regression is used to make predictions of the distribution of the proportion of sensor data traffic volume represented by the telematics data for each location of the sensors. Consequently, the fitted GP model can be used to determine the approximate traffic distribution for a testing location outside of the training points. Policymakers in the transportation sector can find the results of this work helpful for making informed decisions relating to current and future transportation conditions in the area. [ABSTRACT FROM AUTHOR]

Although the data fusion of hyperspectral images (HSI) and light detection and ranging (LiDAR) has provided significant gains for land-cover classification, it also brings technical obstacles (i.e., it is difficult to capture discriminative local and global spatial-spectral from redundant data and build interactions between heterogeneous data). In this paper, a classification network named enhanced spectral attention and adaptive spatial learning guided network (ESASNet) is proposed for the joint use of HSI and LiDAR. Specifically, first, by combining a convolutional neural network (CNN) with the transformer, adaptive spatial learning (ASL) and enhanced spectral learning (ESL) are proposed to learn the spectral-spatial features from the HSI data and the elevation features from the LiDAR data in the local and global receptive field. Second, considering the characteristics of HSI with a continuous, narrowband spectrum, ESL is designed by adding enhanced local self-attention to enhance the mining of the spectral correlations across the adjacent spectrum. Finally, a feature fusion module is proposed to ensure an efficient information exchange between HSI and LiDAR during spectral features and spatial feature fusion. Experimental evaluations on the HSI-LiDAR dataset clearly illustrate that ESASNet performs better in feature extraction than the state-of-the-art methods. The code is available at https://github.com/AirsterMode/ESASNet. [ABSTRACT FROM AUTHOR]

A multi-sensor information fusion algorithm based on fault-tolerant Kalman filter is proposed in phase-sensitive optical time-domain reflectometer (Φ-OTDR) system, for achieving fading-free distributed vibration sensing. Firstly, a fault-tolerant dual-core complementary array model is designed. The Rayleigh scattering signal denoising, and vibration existence judgment of localization points are carried out to obtain the differentiated frequency demodulation results of the sensing points of the dual-core fiber array. Then a fault-tolerant control strategy is used to determine the sensor weight coefficients and vibration judgment coefficients during data fusion processing, and array data fusion is carried out based on time series data using Kalman filter to realize error value identification and filling. The advantage of this method is the combination of redundant data in a complementary way to improve the system stability. The frequency response ranges from 10 Hz to 2400 Hz and the localization accuracy is 98.33%. The influence of key parameters on the frequency demodulation performance of fault-tolerant Kalman filter is discussed, and a standard deviation of 14.6 Hz and an average error of 7.6 Hz are obtained. The demodulation frequency data matrix obtained by the classical demodulation method has a demodulation error probability of 89.18%, which proves the widespread existence of demodulation errors in vibration signals. The fusion error of demodulation frequency is reduced to 0.25 Hz, the frequency demodulation accuracy reaches 100%, and the demodulation error caused by interference attenuation can be completely eliminated. This system based on fault-tolerant Kalman filter has the characteristics of simple multiplexing structure, interference fading resistance and stable demodulation performance. • A sensor information fusion algorithm based on fault-tolerant Kalman filter is proposed to achieve fading-free sensing. [ABSTRACT FROM AUTHOR]

The rapid and accurate estimation of leaf area index (LAI) through remote sensing holds significant importance for precise crop management. However, the direct construction of a vegetation index model based on multi-spectral data lacks robustness and spatiotemporal expansibility, making its direct application in practical production challenging. This study aimed to establish a simple and effective method for LAI estimation to address the issue of poor accuracy and stability that is encountered by vegetation index models under varying conditions. Based on seven years of field plot trials with different varieties and nitrogen fertilizer treatments, the Kalman filter (KF) fusion method was employed to integrate the estimated outcomes of multiple vegetation index models, and the fusion process was investigated by comparing and analyzing the relationship between fixed and dynamic variances alongside the fusion accuracy of optimal combinations during different growth stages. A novel multi-model integration fusion method, KF-DGDV (Kalman Filtering with Different Growth Periods and Different Vegetation Index Models), which combines the growth characteristics and uncertainty of LAI, was designed for the precise monitoring of LAI across various growth phases of rice. The results indicated that the KF-DGDV technique exhibits a superior accuracy in estimating LAI compared with statistical data fusion and the conventional vegetation index model method. Specifically, during the tillering to booting stage, a high R2 value of 0.76 was achieved, while at the heading to maturity stage, it reached 0.66. In contrast, within the framework of the traditional vegetation index model, the red-edge difference vegetation index (DVIREP) model demonstrated a superior performance, with an R2 value of 0.65, during tillering to booting stage, and 0.50 during the heading to maturity stage, respectively. The multi-model integration method (MME) yielded an R2 value of 0.67 for LAI estimation during the tillering to booting stage, and 0.53 during the heading to maturity stage. Consequently, KF-DGDV presented an effective and stable real-time quantitative estimation method for LAI in rice. [ABSTRACT FROM AUTHOR]

Human trajectories can be tracked by the internal processing of a camera as an edge device. This work aims to match peoples' trajectories obtained from cameras to sensor data such as acceleration and angular velocity, obtained from wearable devices. Since human trajectory and sensor data differ in modality, the matching method is not straightforward. Furthermore, complete trajectory information is unavailable; it is difficult to determine which fragments belong to whom. To solve this problem, we newly proposed the SyncScore model to find the similarity between a unit period trajectory and the corresponding sensor data. We also propose a Likelihood Fusion algorithm that systematically updates the similarity data and integrates it over time while keeping other trajectories in mind. We confirmed that the proposed method can match human trajectories and sensor data with an accuracy, a sensitivity, and an F1 of 0.725. Our models achieved decent results on the UEA dataset. [ABSTRACT FROM AUTHOR]

In order to avoid the loss of optimality of the optimal weighting factor in some cases and to further reduce the estimation error of an unbiased estimator, a multi-sensor adaptive weighted data fusion algorithm based on biased estimation is proposed. First, it is proven that an unbiased estimator can further optimize estimation error, and the reasons for the loss of optimality of the optimal weighting factor are analyzed. Second, the method of constructing a biased estimation value by using an unbiased estimation value and calculating the optimal weighting factor by using estimation error is proposed. Finally, the performance of least squares estimation data fusion, batch estimation data fusion, and biased estimation data fusion is compared through simulation tests, and test results show that biased estimation data fusion has a greater advantage in accuracy, stability, and noise resistance. [ABSTRACT FROM AUTHOR]

Existing methods for inverse synthetic aperture radar (ISAR) target recognition typically rely on a single high-resolution radar signal type, such as ISAR images or high-resolution range profiles (HRRPs). However, ISAR images and HRRP data offer representations of targets across different aspects, each containing valuable information crucial for radar target recognition. Moreover, the process of generating ISAR images inherently facilitates the acquisition of HRRP data, ensuring timely data collection. Therefore, to fully leverage the different information from both HRRP data and ISAR images and enhance ISAR ship target recognition performance, we propose a novel deep fusion network named the Separation-Decision Recognition network (SDRnet). First, our approach employs a convolutional neural network (CNN) to extract initial feature vectors from ISAR images and HRRP data. Subsequently, a feature separation module is employed to derive a more robust target representation. Finally, we introduce a weighted decision module to enhance overall predictive performance. We validate our method using simulated and measured data containing ten categories of ship targets. The experimental results confirm the effectiveness of our approach in improving ISAR ship target recognition. [ABSTRACT FROM AUTHOR]

Satellite precipitation products can help improve precipitation estimates where ground-based observations are lacking; however, their relative accuracy and applicability in data-scarce areas remain unclear. Here, we evaluated the accuracy of different satellite precipitation datasets for the Lancang River Basin, Western China, including the Tropical Rainfall Measuring Mission (TRMM) 3B42RT, the Global Precipitation Measurement Integrated Multi-satellitE Retrievals (GPM IMERG), and Fengyun 2G (FY-2G) datasets. The results showed that GPM IMERG and FY-2G are superior to TRMM 3B42RT for meeting local research needs. A subsequent bias correction on these two datasets significantly increased the correlation coefficient and probability of detection of the products and reduced error indices such as the root mean square error and mean absolute error. To further improve data quality, we proposed a novel correction–fusion method based on window sliding data correction and Bayesian data fusion. Specifically, the corrected FY-2G dataset was merged with GPM IMERG Early, Late, and Final Runs. The resulting FY-Early, FY-Late, and FY-Final fusion datasets showed high correlation coefficients, strong detection performances, and few observation errors, thereby effectively extending local precipitation data sources. The results of this study provide a scientific basis for the rational use of satellite precipitation products in data-scarce areas, as well as reliable data support for precipitation forecasting and water resource management in the Lancang River Basin. [ABSTRACT FROM AUTHOR]

Accurately identifying the spatial range of urban agglomerations holds significant practical importance for the precise allocation of various elements and coordinated development within urban agglomerations. However, current research predominantly focuses on the physical spaces of urban agglomerations, overlooking their sphere of influence. This study begins with the spatial interactions of population elements within urban agglomerations and fuses Weibo sign-in data with NTL data to identify the spatial range of urban agglomerations. It further compares and validates the results before and after the fusion of data. The results reveal that the accuracy of identifying the spatial range of urban agglomerations with the fusion of NTL data and Weibo sign-in data has improved by 7%, with a Kappa increase of 0.1766 compared to using NTL data alone, which indicates that fusing social media data can significantly enhance the accuracy of identifying the spatial range of urban agglomerations. This study proposes a novel approach for identifying the spatial range of urban agglomerations through the fusion of NTL data and social media data from a data fusion perspective. On one hand, it supplements the application of data fusion in the study of urban agglomeration spaces; on the other hand, it accurately identifies the spatial range of urban agglomerations, which holds great practical value for the sustainable development of urban agglomerations. [ABSTRACT FROM AUTHOR]

Approaching precipitation forecast refers to the prediction of precipitation within a short time scale, which is usually regarded as a spatiotemporal sequence prediction problem based on radar echo maps. However, due to its reliance on single-image prediction, it lacks good capture of sudden severe convective events and physical constraints, which may lead to prediction ambiguities and issues such as false alarms and missed alarms. Therefore, this study dynamically combines meteorological elements from surface observations with upper-air reanalysis data to establish complex nonlinear relationships among meteorological variables based on multisource data. We design a Residual Spatiotemporal Convolutional Network (ResSTConvNet) specifically for this purpose. In this model, data fusion is achieved through the channel attention mechanism, which assigns weights to different channels. Feature extraction is conducted through simultaneous three-dimensional and two-dimensional convolution operations using a pure convolutional structure, allowing the learning of spatiotemporal feature information. Finally, feature fitting is accomplished through residual connections, enhancing the model's predictive capability. Furthermore, we evaluate the performance of our model in 0–3 h forecasting. The results show that compared with baseline methods, this network exhibits significantly better performance in predicting heavy rainfall. Moreover, as the forecast lead time increases, the spatial features of the forecast results from our network are richer than those of other baseline models, leading to more accurate predictions of precipitation intensity and coverage area. [ABSTRACT FROM AUTHOR]

In response to the issue of low positioning accuracy and insufficient robustness in small UAVs (unmanned aerial vehicle) caused by sensor noise and cumulative motion errors during flight in complex environments, this paper proposes a multisource, multimodal data fusion method. Initially, it employs a multimodal data fusion of various sensors, including GPS (global positioning system), an IMU (inertial measurement unit), and visual sensors, to complement the strengths and weaknesses of each hardware component, thereby mitigating motion errors to enhance accuracy. To mitigate the impact of sudden changes in sensor data, a high-fidelity UAV model is established in the digital twin based on the real UAV parameters, providing a robust reference for data fusion. By utilizing the extended Kalman filter algorithm, it fuses data from both the real UAV and its digital twin, and the filtered positional information is fed back into the control system of the real UAV. This enables the real-time correction of UAV positional deviations caused by sensor noise and environmental disturbances. The multisource, multimodal fusion Kalman filter method proposed in this paper significantly improves the positioning accuracy of UAVs in complex scenarios and the overall stability of the system. This method holds significant value in maintaining high-precision positioning in variable environments and has important practical implications for enhancing UAV navigation and application efficiency. [ABSTRACT FROM AUTHOR]

With the rapid advancement of sports analytics and fan engagement technologies, the volume and diversity of physique data generated by smart devices across various distributed sports platforms have grown significantly. Extracting insights and enhancing fan experiences from such data offer considerable benefits. Yet, this process unveils two primary challenges. Firstly, efficiently utilizing the vast datasets in sports analytics is daunting due to the complex nature of the sports industry. Secondly, the data collected from diverse sources and stored in distributed platforms contain sensitive information like fan preferences and athlete performance metrics, posing risks of privacy breaches. To address these challenges, we leverage an advanced Locality-Sensitive Hashing technique, known as PSDFP ALSH , tailored for the sports domain. This paper presents a new privacy-preserving method for sports data fusion and prediction in distributed environments, utilizing enhanced Locality-Sensitive Hashing to protect sensitive information while maintaining high data utility. Through extensive experimentation, our approach demonstrates superior performance over existing methods in terms of Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and computational efficiency. [ABSTRACT FROM AUTHOR]

The devices deployed across diverse industrial scenarios have generated significant network traffic related to time. The system's irregular operation could result in substantial bad influence. Anomaly detection technologies utilized for identifying possible non-standard behaviours are paramount; furthermore, multivariate time series exhibit complex dependencies besides temporal correlation. However, most previous methods merely consider the temporal and variable correlation of time series data, neglecting the distance metrics among the sequences, leading to a deficiency in the model's anomaly detection ability. We propose a multivariate time series anomaly detection model based on the encoder–decoder architecture (CCER-ED). The model considers the similarity measure between temporal subsequences and designs a multi-scale feature embedding module for leveraging more interrelated properties. Moreover, the interrelations among sensors are explicitly learned using a manifold regularization graph structure. On this basis, an improved data fusion approach based on a multi-head self-attention mechanism is designed for capturing global feature representation, effectively integrating various aspects of information. Evaluations using the real-world datasets SWAT and WADI and performance analysis show that the proposed approach achieves improvement over the baselines in the recall and F1-score of anomaly detection performance at 9.3% and 8.5% (maximum), respectively, outperforming other existing methods. [ABSTRACT FROM AUTHOR]

The advancements of Internet of Things (IoT) technologies have enabled the implementation of smart and wearable sensors, which can be employed to provide older adults with affordable and accessible continuous biophysiological status monitoring. The quality of such monitoring data, however, is unsatisfactory due to excessive noise induced by various disturbances, such as motion artifacts. Existing methods take advantage of summary statistics, such as mean or median values, for denoising, without taking into account the biophysiological patterns embedded in data. In this research, a functional data analysis modeling method was proposed to enhance the data quality by learning individual subjects' diurnal heart rate (HR) patterns from historical data, which were further improved by fusing newly collected data. This proposed data-fusion approach was developed based on a Bayesian inference framework. Its effectiveness was demonstrated in an HR analysis from a prospective study involving older adults residing in assisted living or home settings. The results indicate that it is imperative to conduct personalized healthcare by estimating individualized HR patterns. Furthermore, the proposed calibration method provides a more accurate (smaller mean errors) and more precise (smaller error standard deviations) HR estimation than raw HR and conventional methods, such as the mean. [ABSTRACT FROM AUTHOR]

Featured Application: In the realm of Intelligent Transportation Systems, accurate prediction of traffic flow is paramount for optimizing traffic management and enhancing road safety. Our research addresses the critical challenge of capturing and modeling the complex spatial–temporal correlations inherent in traffic data. While recent advancements have seen the deployment of Spatial–Temporal Graph Neural Networks (STGNNs) and transformer models to tackle this issue, our study identifies and overcomes significant limitations in existing methodologies. In the realm of Intelligent Transportation Systems (ITSs), traffic flow prediction is crucial for multiple applications. The primary challenge in traffic flow prediction lies in the handling and modeling of the intricate spatial–temporal correlations inherent in transport data. In recent years, many studies have focused on developing various Spatial–Temporal Graph Neural Networks (STGNNs), and researchers have also begun to explore the application of transformers to capture spatial–temporal correlations in traffic data. However, GNN-based methods mainly focus on modeling spatial correlations statically, which significantly limits their capacity to discover dynamic and long-range spatial patterns. Transformer-based methods have not sufficiently extracted the comprehensive representation of traffic data features. To explore dynamic spatial dependencies and comprehensively characterize traffic data, the Spatial–Temporal Fusion Embedding Transformer (STFEformer) is proposed for traffic flow prediction. Specifically, we propose a fusion embedding layer to capture and fuse both native information and spatial–temporal features, aiming to achieve a comprehensive representation of traffic data characteristics. Then, we introduce a spatial self-attention module designed to enhance detection of dynamic and long-range spatial correlations by focusing on interactions between similar nodes. Extensive experiments conducted on three real-world datasets demonstrate that STFEformer significantly outperforms various baseline models, notably achieving up to a 5.6% reduction in Mean Absolute Error (MAE) on the PeMS08 dataset compared to the next-best model. Furthermore, the results of ablation experiments and visualizations are employed to clarify and highlight our model's performance. STFEformer represents a meaningful advancement in traffic flow prediction, potentially influencing future research and applications in ITSs by providing a more robust framework for managing and analyzing traffic data. [ABSTRACT FROM AUTHOR]

With global warming and intensified human activities, extreme convective precipitation has become one of the most frequent natural disasters. An accurate and reliable assessment of severe convective precipitation events can support social stability and economic development. In order to investigate the accuracy enhancement methods and data fusion strategies for the assessment of severe convective precipitation events, this study is driven by the horizontal reflectance factor (ZH) and differential reflectance (ZDR) of the dual-polarization radar. This research work utilizes microphysical information of convective storms provided by radar variables to construct the precipitation event assessment model. Considering the problems of high dimensionality of variable data and low computational efficiency, this study proposes a dual-polarization radar echo-data-layering strategy. Combined with the results of mutual information (MI), this study constructs Bayes–Kalman filter (KF) models (RF, SVR, GRU, LSTM) for the assessment of severe convective precipitation events. Finally, this study comparatively analyzes the evaluation effectiveness and computational efficiency of different models. The results show that the data-layering strategy is able to reduce the data dimensions of 256 × 256 × 34,978 to 5 × 2213, which greatly improves the computational efficiency. In addition, the correlation coefficient of interval III–V calibration period is increased to 0.9, and the overall assessment accuracy of the model is good. Among them, the Bayes–KF-LSTM model has the best assessment effect, and the Bayes–KF-RF has the highest computational efficiency. Further, five typical precipitation events are selected for validation in this study. The stratified precipitation dataset agrees well with the near-surface precipitation, and the model's assessment values are close to the observed values. This study completely utilizes the microphysical information offered by dual-polarized radar ZH and ZDR in precipitation event assessment, which provides a wide range of application possibilities for the assessment of severe convective precipitation events. [ABSTRACT FROM AUTHOR]

With the proliferation of digital devices in internet of things (IoT) environment featuring advanced visual capabilities, the task of Image Source Identification (ISI) has become increasingly vital for legal purposes, ensuring the verification of image authenticity and integrity, as well as identifying the device responsible for capturing the original scene. Over the past few decades, researchers have employed both traditional and machine‐learning methods to classify image sources. In the current landscape, data‐driven approaches leveraging deep learning models have emerged as powerful tools for achieving higher accuracy and precision in source prediction. The primary focus of this research is to address the complexities arising from diverse image sources and variable quality in IoT‐generated multimedia data. To achieve this, a Hybrid Data Fusion Approach is introduced, leveraging multiple sources of information to bolster the accuracy and robustness of ISI. This fusion methodology integrates diverse data streams from IoT devices, including metadata, sensor information, and contextual data, amalgamating them into a comprehensive data set for analysis. This study introduces an innovative approach to ISI through the implementation of a Twin Convolutional Neural Network Architecture (TCA) aimed at enhancing the efficacy of source classification. In TCA, the first CNN architecture, referred to as DnCNN, is employed to eliminate noise from the original data set, generating 256 × 256 patches for both training and testing. Subsequently, the second CNN architecture is employed to classify images based on features extracted from various convolutional layers using a 3 × 3 filter, thereby enhancing prediction efficiency. The proposed model demonstrates exceptional accuracy in effectively classifying image sources, showcasing its potential as a robust solution in the realm of ISI. [ABSTRACT FROM AUTHOR]

Regional ionospheric Total Electron Content (TEC) models are most significant to investigate the variability of ionosphere during all-weather conditions. Since the ground-based TEC measurements are not available in oceanic and polar regions, space-based observations are incorporated to increase the positional accuracy and reliability of Global Ionospheric TEC Maps (GIMs). Therefore, data fusion techniques are necessary to enhance the prediction capability of regional ionospheric models by considering multi-source data. In view of this, an attempt is made to investigate Equatorial Ionization Anomaly (EIA) structures in low-latitudinal Indian region using multi-instrument data. Data observations from background model CODEGIM, available International GNSS Service (IGS) stations in India, GNSS receivers at KLEF and Tripura stations, FORMOSAT/COSMIC radio occultation and SWARM during geomagnetic storm period August 26–28, 2021 are used for the study. Spherical Harmonics Function (SHF) of order 4 is employed along with Weighted Least Squares analysis (WLS), where separate weight constraint is computed for each data source. TEC maps of spatial resolution 5° x 5° and temporal resolution of 1 h are generated to illustrate the dynamic behavior of ionosphere. The standard deviation for 3 days is obtained as 0.42, 0.61 and 1.43 TECU respectively. TEC depletions and enhancements are observed on August 27 and 28, with mean values of 12.74 and 15.27 TECU respectively, demonstrating negative and positive storm effects. [ABSTRACT FROM AUTHOR]

The paper addresses the problem of distinguishing the leading agents in the group. The problem is considered in the framework of classification problems, where the agents in the group select the items with respect to certain properties. The suggested method of distinguishing the leading agents utilizes the connectivity between the agents and the Rokhlin distance between the subgroups of the agents. The method is illustrated by numerical examples. The method can be useful in considering the division of labor in swarm dynamics and in the analysis of the data fusion in the tasks based on the wisdom of the crowd techniques. [ABSTRACT FROM AUTHOR]

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models. [ABSTRACT FROM AUTHOR]

In an era marked by the escalating architectural complexity of the Internet, network intrusion detection stands as a pivotal element in cybersecurity. This paper introduces Learn-IDS, an innovative framework crafted to bridge existing gaps between datasets and the training process within deep learning (DL) models for Network Intrusion Detection Systems (NIDS). To elevate conventional DL-based NIDS methods, which are frequently challenged by the evolving cyber threat landscape and exhibit limited generalizability across various environments, Learn-IDS works as a potent and adaptable platform and effectively tackles the challenges associated with datasets used in deep learning model training. Learn-IDS takes advantage of the raw data to address three challenges of existing published datasets, which are (1) the provided tabular format is not suitable for the diversity of DL models; (2) the fixed traffic instances are not suitable for the dynamic network scenarios; (3) the isolated published datasets cannot meet the cross-dataset requirement of DL-based NIDS studies. The data processing results illustrate that the proposed framework can correctly process and label the raw data with an average of 90% accuracy across three published datasets. To demonstrate how to use Learn-IDS for a DL-based NIDS study, we present two simple case studies. The case study on cross-dataset sampling function reports an average of 30.3% OOD accuracy improvement. The case study on data formatting function shows that introducing temporal information can enhance the detection accuracy by 4.1%.The experimental results illustrate that the proposed framework, through the synergistic fusion of datasets and DL models, not only enhances detection precision but also dynamically adapts to emerging threats within complex scenarios. [ABSTRACT FROM AUTHOR]

KRAS is a pathogenic gene frequently implicated in non-small cell lung cancer (NSCLC). However, biopsy as a diagnostic method has practical limitations. Therefore, it is important to accurately determine the mutation status of the KRAS gene non-invasively by combining NSCLC CT images and genetic data for early diagnosis and subsequent targeted therapy of patients. This paper proposes a Semi-supervised Multimodal Multiscale Attention Model (S2MMAM). S2MMAM comprises a Supervised Multilevel Fusion Segmentation Network (SMF-SN) and a Semi-supervised Multimodal Fusion Classification Network (S2MF-CN). S2MMAM facilitates the execution of the classification task by transferring the useful information captured in SMF-SN to the S2MF-CN to improve the model prediction accuracy. In SMF-SN, we propose a Triple Attention-guided Feature Aggregation module for obtaining segmentation features that incorporate high-level semantic abstract features and low-level semantic detail features. Segmentation features provide pre-guidance and key information expansion for S2MF-CN. S2MF-CN shares the encoder and decoder parameters of SMF-SN, which enables S2MF-CN to obtain rich classification features. S2MF-CN uses the proposed Intra and Inter Mutual Guidance Attention Fusion (I2MGAF) module to first guide segmentation and classification feature fusion to extract hidden multi-scale contextual information. I2MGAF then guides the multidimensional fusion of genetic data and CT image data to compensate for the lack of information in single modality data. S2MMAM achieved 83.27% AUC and 81.67% accuracy in predicting KRAS gene mutation status in NSCLC. This method uses medical image CT and genetic data to effectively improve the accuracy of predicting KRAS gene mutation status in NSCLC. [ABSTRACT FROM AUTHOR]

Beijing Satellite 3 is a high-performance optical remote sensing satellite with a spatial resolution of 0.3–0.5 m. It can provide timely and independent ultra-high-resolution spatial big data and comprehensive spatial information application services. At present, there is no relevant research on the fusion method of BJ-3A satellite images. In many applications, high-resolution panchromatic images alone are insufficient. Therefore, it is necessary to fuse them with multispectral images that contain spectral color information. Currently, there is a lack of research on the fusion method of BJ-3A satellite images. This article explores six traditional pixel-level fusion methods (HPF, HCS, wavelet, modified-IHS, PC, and Brovey) for fusing the panchromatic image and multispectral image of the BJ-3A satellite. The fusion results were analyzed qualitatively from two aspects: spatial detail enhancement capability and spectral fidelity. Five indicators, namely mean, standard deviation, entropy, correlation coefficient, and average gradient, were used for quantitative analysis. Finally, the fusion results were comprehensively evaluated from three aspects: spectral curves of ground objects, absolute error figure, and object-oriented classification effects. The findings of the research suggest that the fusion method known as HPF is the optimum and appropriate technique for fusing panchromatic and multispectral images obtained from BJ-3A. These results can be utilized as a guide for the implementation of BJ-3A panchromatic and multispectral data fusion in real-world scenarios. [ABSTRACT FROM AUTHOR]

Since 3D sensors became popular, imaged depth data are easier to obtain in the consumer sector. In applications such as defect localization on industrial objects or mass/volume estimation, precise depth data is important and, thus, benefits from the usage of multiple information sources. However, a combination of RGB images and depth images can not only improve our understanding of objects, capacitating one to gain more information about objects but also enhance data quality. Combining different camera systems using data fusion can enable higher quality data since disadvantages can be compensated. Data fusion itself consists of data preparation and data registration. A challenge in data fusion is the different resolutions of sensors. Therefore, up- and downsampling algorithms are needed. This paper compares multiple up- and downsampling methods, such as different direct interpolation methods, joint bilateral upsampling (JBU), and Markov random fields (MRFs), in terms of their potential to create RGB-D images and improve the quality of depth information. In contrast to the literature in which imaging systems are adjusted to acquire the data of the same section simultaneously, the laboratory setup in this study was based on conveyor-based optical sorting processes, and therefore, the data were acquired at different time periods and different spatial locations. Data assignment and data cropping were necessary. In order to evaluate the results, root mean square error (RMSE), signal-to-noise ratio (SNR), correlation (CORR), universal quality index (UQI), and the contour offset are monitored. With JBU outperforming the other upsampling methods, achieving a meanRMSE = 25.22, mean SNR = 32.80, mean CORR = 0.99, and mean UQI = 0.97. [ABSTRACT FROM AUTHOR]

The paper aims to develop an information system for human emotion recognition in streaming data obtained from a PC or smartphone camera, using different methods of modality merging (image, sound and text). The objects of research are the facial expressions, the emotional color of the tone of a conversation and the text transmitted by a person. The paper proposes different neural network structures for emotion recognition based on unimodal flows and models for the margin of the multimodal data. The analysis determined that the best classification accuracy is obtained for systems with data fusion after processing each channel separately and obtaining individual characteristics. The final analysis of the model based on data from a camera and microphone or recording or broadcast of the screen, which were received in the "live" mode, gave a clear understanding that the quality of the obtained results is highly dependent on the quality of the data preparation and labeling. This is directly related to the fact that the data on which the neural network is trained is highly qualified. The neural network with combined data on the penultimate layer allows a psycho-emotional state recognition accuracy of 0.90 to be obtained. The spatial distribution of emotion analysis was also analyzed for each data modality. The model with late fusion of multimodal data demonstrated the best recognition accuracy. [ABSTRACT FROM AUTHOR]

In the face of complex scenarios, the information insufficiency of classification tasks dominated by a single modality has led to a bottleneck in classification performance. The joint application of multimodal remote sensing data for surface observation tasks has garnered widespread attention. However, issues such as sample differences between modalities and the lack of correlation in physical features have limited the performance of classification tasks. Establishing effective interaction between multimodal data has become another significant challenge. To fully integrate heterogeneous information from multiple modalities and enhance classification performance, this paper proposes a dual-branch cross-Transformer feature fusion network aimed at joint land cover classification of hyperspectral imagery (HSI) and Light Detection and Ranging (LiDAR) data. The core idea is to leverage the potential of convolutional operators to represent spatial features, combined with the advantages of the Transformer architecture in learning remote dependencies. The framework employs an improved self-attention mechanism to aggregate features within each modality, highlighting the spectral information of HSI and the spatial (elevation) information of LiDAR. The feature fusion module based on cross-attention integrates deep features from two modalities, achieving complementary information through cross-modal attention. The classification task is performed using jointly obtained spectral and spatial features. Experiments were conducted on three multi-source remote sensing classification datasets, demonstrating the effectiveness of the proposed model compared to existing methods. [ABSTRACT FROM AUTHOR]

Advancing the domain of biomedical investigation, integrated multi-omics data have shown exceptional performance in elucidating complex human diseases. However, as the variety of omics information expands, precisely perceiving the informativeness of intra- and inter-omics becomes challenging due to the intricate interrelations, thus presenting significant challenges in the integration of multi-omics data. To address this, we introduce a novel multi-omics integration approach, referred to as TEMINET. This approach enhances diagnostic prediction by leveraging an intra-omics co-informative representation module and a trustworthy learning strategy used to address inter-omics fusion. Considering the multifactorial nature of complex diseases, TEMINET utilizes intra-omics features to construct disease-specific networks; then, it applies graph attention networks and a multi-level framework to capture more collective informativeness than pairwise relations. To perceive the contribution of co-informative representations within intra-omics, we designed a trustworthy learning strategy to identify the reliability of each omics in integration. To integrate inter-omics information, a combined-beliefs fusion approach is deployed to harmonize the trustworthy representations of different omics types effectively. Our experiments across four different diseases using mRNA, methylation, and miRNA data demonstrate that TEMINET achieves advanced performance and robustness in classification tasks. [ABSTRACT FROM AUTHOR]

Completing traffic data is a basic requirement for intelligent transportation systems. However, completing spatiotemporal traffic data poses a significant challenge, especially for high-dimensional data with complex missing mechanisms. Various completion methods targeting different missing mechanisms have showcased the superiority of tensor learning by effectively characterizing intricate spatiotemporal correlations. In this study, a novel tensor completion framework, known as the multi-source tensor completion method for data fusion, is proposed. This framework incorporates passenger transfer relationships between buses and subways into subway data completion, enhancing the data completion accuracy. Moreover, by combining bus transfer passenger flow data with other data dimensions, such as the different road sections, time intervals, and days, an innovative 4D low-rank tensor completion data framework was obtained. In addition, to boost the completion accuracy, a truncated l 2 , p norm optimization model was derived. This model enhances the non-convex performance of the objective function throughout the tensor completion process. The results highlight the superiority of the proposed completion method, leveraging fused subway/bus data over other completion methods that rely solely on subway data. [ABSTRACT FROM AUTHOR]

Digital transformation in manufacturing necessitates the integration of advanced fields such as robotics, the Internet of Things (IoT), and data science. The latter two, in particular, introduce a unique set of challenges related to data acquisition and processing, especially for emerging manufacturing sectors that lack substantial data volumes for analytical software. This paper specifically addresses the challenges associated with limited data within the context of precision poultry farming. We begin by identifying the specific challenges encountered during the development of a smart poultry management software system. Subsequently, we propose potential solutions for each identified challenge. The outcome of this study is a comprehensive algorithm for data processing that encapsulates these proposed solutions, offering a practical approach to overcoming data limitations in precision poultry farming. [ABSTRACT FROM AUTHOR]

The field of multimodal emotion recognition is increasingly gaining popularity as a research area. It involves analyzing human emotions across multiple modalities, such as acoustic, visual, and language. Emotion recognition is more effective as a multimodal learning task than relying on a single modality. In this paper, we present an unimodal and multimodal long short-term memory model with a class weight parameter technique for emotion recognition on the CMU-Multimodal Opinion Sentiment and Emotion Intensity dataset. In addition, a critical challenge lies in selecting the most effective fusion method for integrating multiple modalities. To address this, we applied four different fusion techniques: Early fusion, late fusion, deep fusion, and tensor fusion. These fusion methods improved the performance of multimodal emotion recognition compared to unimodal approaches. With the highly imbalanced number of samples per emotion class in the MOSEI dataset, adding a class weight parameter technique leads our model to outperform the state of the art on all three modalities — acoustic, visual, and language — as well as on all the fusion models. The challenges of class imbalance, which can lead to biased model performance, and using an effective fusion method for integrating multiple modalities often result in decreased accuracy in recognizing less frequent emotion classes. Our proposed model shows 2–3% performance improvement in the unimodal and 2% in the multimodal over the state-of-the-art achieved results. [ABSTRACT FROM AUTHOR]

In the manufacturing process of optical lenses, the lack of monitoring and detection of the central processing process leads to low processing efficiency and difficulty in ensuring product consistency. We propose a digital twin system for alignment processing to address this issue. The system adopts a hierarchical architecture based on the digital twin five-dimensional model, aiming to improve the fidelity and interactivity of the virtual model of the centring lathe by combining dimension-driven virtual models with integrated data and physical models of the turning mechanism. We have successfully achieved the semantic and physical fusion of multi-source heterogeneous data during centring processing using information models and OPC UA-based data interaction methods. In addition, we adopted the VMD-GRU method based on feature fusion for real-time monitoring of critical components of the centring lathe. Finally, we validated the feasibility and effectiveness of the digital twin system for the central lathe through development examples. The application of this system is expected to promote the digital and intelligent development of high-precision optical component processing, providing references including references for related manufacturing fields. In summary, we propose a digital monitoring and detection system for the centring process of optical lens manufacturing. The application of this system will help improve product consistency and processing efficiency while reducing risks and costs in the manufacturing process. [ABSTRACT FROM AUTHOR]

Accurate prediction of Electro-Discharge Machining (EDM) results is crucial for industrial applications, aiming to achieve high-performance and cost-efficient machining. However, both the current physical model and the standard Artificial Neural Network (ANN) model exhibit inherent limitations, failing to fully meet the accurate requirements for predicting EDM machining results. In addition, Micro-EDM Drilling can lead to the distortion of the macroscopic shape of machining pits under different input conditions, rendering the use of only the volume of machining pits as the evaluation index insufficient to express the complete morphological information. In this study, we propose a novel hybrid prediction model that combines the strengths of both physical and data-driven models to simultaneously predict Material Removal Rate (MRR) and shape parameters. Our experiment demonstrates that the hybrid model achieves a maximum prediction error of 4.92% for MRR and 5.28% for shape parameters, showcasing excellent prediction accuracy and stability compared to the physical model and the standard ANN model. [ABSTRACT FROM AUTHOR]

Data fusion technology plays a pivotal role in aggregating, storing, and mining multi-source data to extract its joint value through the construction of a unified fusion representation model. However, we argue that mainstream methods are limited to precise data, which may not satisfy practical application requirements, as data collected from an information source often exhibits imprecision and uncertainty. In this paper, we develop a Multi-source Fuzzy Data-driven Dynamic Fusion Representation (MFD-DFR) model. This model effectively addresses the challenges related to heterogeneity, dynamics, and quality optimization that arise during the fusion of fuzzy data. To achieve this goal, we first adopt intervals as a means of description to capture the inherent uncertainty in single-source information. We then present a Dynamic Interval Standardization (DIS) algorithm, a novel approach that dynamically deals with the heterogeneity of multi-source fuzzy data without relying on the storage of historical sample data. We next propose a fusion representation model for standardized intervals that improves the quality of single-source fuzzy data through confidence interval estimation. The experimental results convincingly demonstrate that the MFD-DFR model outperforms alternative models in terms of data classification and clustering. We also show the effectiveness of our proposed DIS algorithm in expediting the convergence speed of gradient descent algorithms. [ABSTRACT FROM AUTHOR]

The roughness of the part surface is one of the most crucial standards for evaluating machining quality due to its relationship with service performance. For a preferable comprehension of the evolution of surface roughness, this study proposes a novel surface roughness prediction model on the basis of the unity of fuse d signal features and deep learning architecture. The force and vibration signals produced in the milling of P20 die steel are collected, and time and frequency domain feature from the acquired signals are extracted by variational modal decomposition. The GA-MI algorithm is taken to select the signal features that are relevant to the surface roughness of the workpiece. The optimal feature subset is analyzed and used as the input of the prediction model. DBN is adopted to estimate the surface roughness and the model parameters are optimized by ISSA. (Reviewer 1, Q1) The separate force, vibration and fusion signal information are brought into the DBN model and the ISSA-DBN model for the prediction of surface roughness, and the results show that the accuracy of the roughness prediction is as follows, respectively DBN: 78.1%, 68.8% and 84.4%, and ISSA-DBN: 93.8%, 87.5% and 100%. [ABSTRACT FROM AUTHOR]

Prior to further processing, completed questionnaires must be screened for the presence of careless respondents. Different people will respond to surveys in different ways. Some take the easy path and fill out the survey carelessly. The proportion of careless respondents determines the survey's quality. As a result, identifying careless respondents is critical for the quality of obtained results. This study aims to explore the characteristics of careless respondents in survey data and evaluate the predictive power and interpretability of different types of data and indices of careless responding. The research question focuses on understanding the behavior of careless respondents and determining the effectiveness of various data sources in predicting their responses. Data from a three-month web-based survey on participants' personality traits such as honesty-humility, emotionality, extraversion, agreeableness, conscientiousness and openness to experience was used in this study. Data for this study was taken from Schroeders et al.. The gradient boosting machine-based prediction model uses data from the answers, time spent for answering, demographic information on the respondents as well as some indices of careless responding from all three types of data. Prediction models were evaluated with tenfold cross-validation repeated a hundred times. Prediction models were compared based on balanced accuracy. Models' explanations were provided with Shapley values. Compared with existing work, data fusion from multiple types of information had no noticeable effect on the performance of the gradient boosting machine model. Variables such as "I would never take a bribe, even if it was a lot", average longstring, and total intra-individual response variability were found to be useful in distinguishing careless respondents. However, variables like "I would be tempted to use counterfeit money if I could get away with it" and intra-individual response variability of the first section of a survey showed limited effectiveness. Additionally, this study indicated that, whereas the psychometric synonym score has an immediate effect and is designed with the goal of identifying careless respondents when combined with other variables, it is not necessarily the optimal choice for fitting a gradient boosting machine model. [ABSTRACT FROM AUTHOR]

Based on the rapid development of Internet new generation information technology, campus culture has become an important force to promote educational innovation. However, the uneven quality of campus culture teaching is also increasingly exposed. Therefore, we propose a set of campus culture intelligent quality assessment feedback system driven by data and knowledge. Based on real multi-modal campus culture data, the evaluation system covers different online teaching forms, and can comprehensively consider and measure the core elements of quality evaluation from the perspective of teachers and students, so as to achieve accurate evaluation and feedback of campus culture. This paper proposes to combine emotion computing with big data analysis, construct a theoretical framework of multi-modal emotion analysis from the perspective of multi-spatial fusion, and explore the students' learning emotion recognition and intelligent assessment based on multi-modal data fusion. By studying the key issues, logical path and implementation path of multimodal learning emotion analysis in campus culture, this paper reveals the mechanism of student emotion development from the perspective of campus culture, expands the intervention practice of student group emotion, and provides technical support and action guidance for after-school teaching and research on campus culture. [ABSTRACT FROM AUTHOR]

This paper pioneers the use of the extreme learning machine (ELM) approach for surface roughness prediction in ultra-precision milling, leveraging the excellent fitting ability with small datasets and the fast learning speed of the extreme learning machine method. By providing abundant machining information, the machining parameters and force signal data are fused on the feature level to further improve ELM prediction accuracy. An ultra-precision milling experiment was designed and conducted to verify our proposed data-fusion-based ELM method. The results show that the ELM with data fusion outperforms other state-of-art methods in surface roughness prediction. It achieves an impressively low mean absolute percentage error of 1.6% while requiring a mere 18 s for model training. [ABSTRACT FROM AUTHOR]

Effective civil infrastructure management necessitates the utilization of timely data across the entire asset lifecycle for condition assessment and predictive maintenance. A notable gap in current predictive maintenance practices is the reliance on single-source data instead of heterogeneous data, decreasing data accuracy, reliability, adaptability, and further effectiveness of engineering decision-making. Data fusion is thus demanded to transform low-dimensional decisions from individual sensors into high-dimensional ones for decision optimization. In this context, digital twin (DT) technology is set to revolutionize the civil infrastructure industry by facilitating real-time data processing and informed decision-making. However, data-driven smart civil infrastructure management using DT is not yet achieved, especially in terms of data fusion. This paper aims to establish a conceptual framework for harnessing DT technology with data fusion to ensure the efficiency of civil infrastructures throughout their lifecycle. To achieve this objective, a systematic review of 105 papers was conducted to thematically analyze data fusion approaches and DT frameworks for civil infrastructure management, including their applications, core DT technologies, and challenges. Several gaps are identified, such as the difficulty in data integration due to data heterogeneity, seamless interoperability, difficulties associated with data quality, maintaining the semantic features of big data, technological limitations, and complexities with algorithm selection. Given these challenges, this research proposed a framework emphasizing multilayer data fusion, the integration of open building information modeling (openBIM) and geographic information system (GIS) for immersive visualization and stakeholder engagement, and the adoption of extended industry foundation classes (IFC) for data integration throughout the asset lifecycle. [ABSTRACT FROM AUTHOR]

Chlorophyll-a concentration (Chl-a) is an important indicator of coastal eutrophication. Remote sensing technology provides a global view of it. However, different types of sensors are subject to design constraints and cannot meet the requirements of high temporal and spatial resolution on nearshore engineering simultaneously. To obtain high-spatiotemporal-resolution images, this study examines the performance of the enhanced spatial and temporal adaptive reflectance fusion model (ESTARFM) on GOCI and Landsat Chl-a data fusion. Considering the rapidly changing rate and consistency of oceanic Chl-a, the ESTARFM was modified via segmented fitting and numerical conversion. The results show that both fusion models can fuse multiple data advantages to obtain high-spatiotemporal-resolution Chl-a images. Compared with the ESTARFM, the modified solution has a better performance in terms of the root mean square error and correlation coefficient, and its results have better spatial consistency for coastal Chl-a. In addition, the new solution expands the data utilization range of data fusion by reducing the influence of the time interval of original data and realizes better monitoring of nearshore Chl-a changes. [ABSTRACT FROM AUTHOR]

IoT (Internet of Things) devices are increasingly being used in healthcare to collect and transmit patient data, which can improve patient outcomes and reduce costs. However, this also creates new challenges for data security and privacy. Thus, the major demand for secure and efficient data-sharing solutions has prompted significant attention due to the increasing volume of shared sensor data. Leveraging a data-fusion-based paradigm within the realm of IoT-protected healthcare systems enabled the collection and analysis of patient data from diverse sources, encompassing medical devices, electronic health records (EHRs), and wearables. This innovative approach holds the potential to yield immediate benefits in terms of enhancing patient care, including more precise diagnoses and treatment plans. It empowers healthcare professionals to devise personalized treatment regimens by amalgamating data from multiple origins. Moreover, it has the capacity to alleviate financial burdens, elevate healthcare outcomes, and augment patient satisfaction. Furthermore, this concept extends to fortifying patient records against unauthorized access and potential misuse. In this study, we propose a novel approach for secure transmission of healthcare data, amalgamating the improved context-aware data-fusion method with an emotional-intelligence-inspired enhanced dynamic Bayesian network (EDBN). The findings indicated that F1 score, accuracy, precision, recall, and ROC-AUC score using DCNN were 89.3%, 87.4%, 91.4%, 92.1%, and 0.56, respectively, which was second-highest to the proposed method. On the other hand, the F1 score, accuracy, precision, recall, and ROC-AUC scores of FRCNN and CNN were low in accuracy at 83.2% and 84.3%, respectively. Our experimental investigation demonstrated superior performance compared with existing methods, as evidenced by various performance metrics, including recall, precision, F measures, and accuracy. [ABSTRACT FROM AUTHOR]

Leaf area index (LAI) is an important biophysical parameter of vegetation and serves as a significant indicator for assessing forest ecosystems. Multi-source remote sensing data enables large-scale and dynamic surface observations, providing effective data for quantifying various indices in forest and evaluating ecosystem changes. However, employing single-source remote sensing spectral or LiDAR waveform data poses limitations for LAI inversion, making the integration of multi-source remote sensing data a trend. Currently, the fusion of active and passive remote sensing data for LAI inversion primarily relies on empirical models, which are mainly constructed based on field measurements and do not provide a good explanation of the fusion mechanism. In this study, we aimed to estimate LAI based on physical model using both spectral imagery and LiDAR waveform, exploring whether data fusion improved the accuracy of LAI inversion. Specifically, based on the physical model geometric-optical and radiative transfer (GORT), a fusion strategy was designed for LAI inversion. To ensure inversion accuracy, we enhanced the data processing by introducing a constraint-based EM waveform decomposition method. Considering the spatial heterogeneity of canopy/ground reflectivity ratio in regional forests, calculation strategy was proposed to improve this parameter in inversion model. The results showed that the constraint-based EM waveform decomposition method improved the decomposition accuracy with an average 12% reduction in RMSE, yielding more accurate waveform energy parameters. The proposed calculation strategy for the canopy/ground reflectivity ratio, considering dynamic variation of parameter, effectively enhanced previous research that relied on a fixed value, thereby improving the inversion accuracy that increasing on the correlation by 5% to 10% and on R² by 62.5% to 132.1%. Based on the inversion strategy we proposed, data fusion could effectively be used for LAI inversion. The inversion accuracy achieved using both spectral and LiDAR data (correlation=0.81, R² = 0.65, RMSE=1.01) surpassed that of using spectral data or LiDAR alone. This study provides a new inversion strategy for large-scale and high-precision LAI inversion, supporting the field of LAI research. [ABSTRACT FROM AUTHOR]

The traditional leveling, total station, and global navigation satellite system (GNSS) and the new differential interferometric synthetic aperture radar (DInSAR) and terrestrial laser scanning (TLS) systems have their own advantages and limitations in the deformation monitoring of mining areas. It is difficult to obtain accurate deformation information only using single-source measurement data. In this study, we propose an LOS deformation correction method for DInSAR in mining areas by fusing ground data without control points. Based on free space data, small deformations at the edges of mining influence areas accurately obtained using DInSAR. By combining leveling/GNSS and TLS methods, it was possible to obtain large deformations in central areas without the need for control points located outside the mining influence range. For overcoming the non-uniform coordinates of the "space–ground" data and the limited overlap of the effective measurement ranges, the subsidence prediction model was employed to assist in its fusion. In addition, in LOS deformation correction, we retained the non-full cycle phase of DInSAR and replaced the full cycle phase with the one from the data fusion. Engineering experiments have shown that the correction results preserve the differences in the LOS deformations at the edge areas of the mine influence range, and they recover the lost LOS deformations at the center areas. Using the difference in the LOS deformation before and after correction as the verification indicator, the maximum absolute value of the errors after correction was 143 mm, which was approximately 6.4% of the maximum LOS deformation. In addition, there were still two errors that were large (−112 mm and −89 mm, respectively), and the absolute values of errors were not more than 75 mm. For all errors, the mean absolute value was 36 mm. Compared with 399 mm before correction, the error was reduced by 91%. This study provides technical support and theoretical reference for deformation monitoring and control in mining areas. [ABSTRACT FROM AUTHOR]

Aiming to solve the problems of the inaccurate dimension reduction of high-dimensional data and insufficient information utilization in traditional manufacturing process monitoring methods—in which mostly only the distance information of pairwise points is used as the similarity index for the data dimension reduction—this paper proposes a data-manifold-based monitoring method that combines the distance information and angle information of pairwise points. First, the intrinsic dimension of manufacturing process data is estimated by combining multiple geometric features on the data manifold. Second, considering the angle information and distance information in the neighborhood of process data, the method to construct local features of the data manifold is given; further, a fusion method of local features and global–local features of manifold data based on the eigendimension is proposed, which constructs the data dimension-reduction mapping matrix to improve the integrity of data information extraction. Then, the data index of process monitoring is given and employed to monitor the manufacturing process. Finally, Tennessee Eastman (TE) process simulation data were used to verify the effectiveness of the proposed method. The results show that compared with other methods, the anomaly detection rate of the proposed method was increased by more than 50%, while the false alarm rate was decreased by 21.4%, which proves that the method can significantly improve the efficiency of manufacturing process anomaly monitoring. [ABSTRACT FROM AUTHOR]

In order to improve the UAV prevention and control capability in key areas and improve the rapid identification and trajectory prediction accuracy of the ground detection system in anti-UAV early warnings, an improved LSTM trajectory prediction network CA-LSTM (CNN-Attention-LSTM) based on attention enhancement and convolution fusion structure is proposed. Firstly, the native Yolov5 network is improved to enhance its detection ability for small targets of infrared UAVs, and the trajectory of UAVs in image space is constructed. Secondly, the LSTM network and convolutional neural network are integrated to improve the expression ability of the deep features of UAV trajectory data, and at the same time, the attention structure is designed to more comprehensively obtain time series context information, improve the influence on important time series features, and realize coarse–fine-grained feature fusion. Finally, tests were carried out on a homemade UAV infrared detection dataset. The experimental results show that the algorithm proposed in this paper can quickly and accurately identify infrared UAV targets and can achieve more accurate predictions of UAV flight trajectories, which are reduced by 9.43% and 23.81% in terms of MAPE and MSE indicators compared with the native LSTM network (the smaller the values of these evaluation indexes, the better the prediction results). [ABSTRACT FROM AUTHOR]

Single molecule localization microscopy offers resolution nearly down to the molecular level with specific molecular labelling, and is thereby a promising tool for structural biology. In practice, however, the actual value to this field is limited primarily by incomplete fluorescent labelling of the structure. This missing information can be completed by merging information from many structurally identical particles in a particle fusion approach similar to cryo-EM single-particle analysis. In this paper, we present a data analysis of particle fusion results of fluorescently labelled Nup96 nucleoporins in the Nuclear Pore Complex to show that Nup96 occurs in a spatial arrangement of two rings of 8 units with two Nup96 copies per unit giving a total of 32 Nup96 copies per pore. We use Artificial Intelligence assisted modeling in Alphafold to extend the existing cryo-EM model of Nup96 to accurately pinpoint the positions of the fluorescent labels and show the accuracy of the match between fluorescent and cryo-EM data to be better than 3 nm in-plane and 5 nm out-of-plane. [ABSTRACT FROM AUTHOR]

Early diagnosis of Alzheimer's disease (AD) plays a key role in preventing and responding to this neurodegenerative disease. It has shown that, compared with a single imaging modality‐based classification of AD, synergy exploration among multimodal neuroimages is beneficial for the pathological identification. However, effectively exploiting multimodal information is still a big challenge due to the lack of efficient fusion methods. Herein, a multimodal fusion network based on attention mechanism is proposed, in which magnetic resonance imaging (MRI) and positron emission computed tomography (PET) images are converted into feature vectors with the same dimension, while the demographic information and clinical data are preprocessed and converted into feature vectors through embedding. This attention model can focus on important feature points, fuse the multimodal information more effectively, and thus provide accurate diagnosis and prediction for different pathological stages. The results show that the model achieves an accuracy of 84.1% for triple classification tasks in normal cognition (NC) versus mild cognitive impairment (MCI) versus AD and 93.9% prediction accuracy in stable MCI (sMCI) versus progressive MCI (pMCI). In contrast to the existing multimodal diagnosis methods, our model yields a state‐of‐the‐art accuracy of AD diagnosis, which is powerful and promising in clinical practice. [ABSTRACT FROM AUTHOR]

A disease, known as citrus greening, is a major threat to the citrus industry. The objective of this study was to investigate the feasibility of rapid detection and improving the identification accuracy of citrus greening with visible and near-infrared spectra under spectral fusion. After we obtained the spectra of the collected citrus leaves and used the polymerase chain reaction for part of them, five types of samples were sorted out: slight, moderate, serious, nutrient deficiency, and normal. This study of spectral fusion was conducted on three levels as spectral data, characteristic, and model decision, and the identification capacity was tested using prediction samples. It was found that the effect of a least squares support vector machine model for feature-level fusion based on principal component analysis presented the best performance, while in the Lin_Kernel function; the accuracy was 100%, penalty coefficient γ was 0.09, and operation time was 0.66 s. It is better than the single spectral discriminant model. The results showed that the fusion of visible and near-infrared spectra was feasible for the nondestructive detection of citrus greening disease. This method is of great significance for the healthy development of the citrus industry, and provides important reference value for the application of spectral fusion in other fields. [ABSTRACT FROM AUTHOR]

In a world in continuous evolution and in which human needs grow exponentially according to the increasing world population, the advent of new technologies plays a fundamental role in all fields of industry, especially in agriculture. Optimizing times, automating machines, and guaranteeing product quality are key objectives in the field of Agriculture 4.0, which integrates various innovative technologies to meet the needs of producers and consumers while guaranteeing respect for the environment and the planet's resources. In this context, our research aims to propose an integrated system using data coming from an innovative experimental atmospheric and forecasting simulator (capable of predicting some characteristic climate variables subsequently validated with local sensors), combined with indices deriving from Remote Sensing and UAV images (treated with the data fusion method), that can give fundamental information related to Agriculture 4.0 with particular reference to the subsequent phases of system automation. These data, in fact, can be collected in an open-source GIS capable of displaying areas that need irrigation and fertilization and, moreover, establishing the path of an automated drone for the monitoring of the crops and the route of a self-driving tractor for the irrigation of the areas of interest. [ABSTRACT FROM AUTHOR]

Air pollution is one of the most harmful natural hazards in Tehran metropolitan. Particles with a diameter of less than 2.5 micrometers (PM2.5) as one of the most harmful pollutants have endangered the health of people living in Tehran. One of the PM2.5 estimation techniques is the use of Aerosol Optical Depth (AOD) products derived from satellite observations. Various AOD products are retrieved with different algorithms that do not have the same accuracy and spatial resolution. Due to the differences in many assumptions and approximations adopted in the AOD retrieval process, the generated AOD products involve uncertainties. This issue reduces the accuracy of PM2.5 concentration estimation. The purpose of this study was to investigate the possibility of fusing AOD products obtained from MODIS sensor observations (retrieved by Deep Blue and Dark Target algorithms) to estimate PM2.5 more accurately. First, the performance of different machine learning algorithms in estimating PM2.5 from AOD data was evaluated. As a result, the XGBoost algorithm with the highest performance was selected as the base model for PM2.5 estimation. Then, the AOD products were fused using a weighted averaging based on the retrieval quality of the primary products. Finally, the fused AOD product along with meteorological data were employed to estimate PM2.5 using XGboost. The results demonstrated that the accuracy of PM2.5 estimation from the fused AOD product is better than when the AOD products are used individually (R2= 0.77, MAE = 7.00 μg/m³, RMSE = 9.59 μg/m³). Thus, the retrieval quality of AOD products will lead to more accurate estimation of PM2.5 in the end. [ABSTRACT FROM AUTHOR]