Search

This study addresses the challenges of engaging Chinese-speaking audiences in international sports events due to fragmented communication models and limited media integration. A novel interaction model based on multi-channel data fusion is proposed to enhance information dissemination and user engagement. The model integrates data from traditional media, internet media, and social media into a cohesive platform, utilizing advanced data fusion techniques, microservices architecture, and technologies such as Docker, Kubernetes, and WebSocket for high availability and real-time interaction. Additionally, Nginx with the RTMP module and Akamai CDN ensures highquality streaming services. Experimental results demonstrate the platform's effectiveness in data integration, content publishing, and real-time user interaction, significantly improving Chinese engagement in international sports events. This research provides practical strategies for event organizers to enhance communication, leading to higher audience satisfaction and participation, and contributes to the theoretical framework of sports event communication through innovative and inclusive practices. [ABSTRACT FROM AUTHOR]

This study proposes an approach of leveraging information gathered from multiple traffic data sources at different resolutions to obtain approximate inference on the traffic distribution of Chicago's O'Hare Airport area. Specifically, it proposes the ingestion of traffic datasets at different resolutions to build spatiotemporal models for predicting the distribution of traffic volume on the road network. Due to its good adaptability and flexibility for spatiotemporal data, the Gaussian process (GP) regression was employed to provide short-term forecasts using data collected by loop detectors (sensors) and supplemented by telematics data. The GP regression is used to make predictions of the distribution of the proportion of sensor data traffic volume represented by the telematics data for each location of the sensors. Consequently, the fitted GP model can be used to determine the approximate traffic distribution for a testing location outside of the training points. Policymakers in the transportation sector can find the results of this work helpful for making informed decisions relating to current and future transportation conditions in the area. [ABSTRACT FROM AUTHOR]

Although the data fusion of hyperspectral images (HSI) and light detection and ranging (LiDAR) has provided significant gains for land-cover classification, it also brings technical obstacles (i.e., it is difficult to capture discriminative local and global spatial-spectral from redundant data and build interactions between heterogeneous data). In this paper, a classification network named enhanced spectral attention and adaptive spatial learning guided network (ESASNet) is proposed for the joint use of HSI and LiDAR. Specifically, first, by combining a convolutional neural network (CNN) with the transformer, adaptive spatial learning (ASL) and enhanced spectral learning (ESL) are proposed to learn the spectral-spatial features from the HSI data and the elevation features from the LiDAR data in the local and global receptive field. Second, considering the characteristics of HSI with a continuous, narrowband spectrum, ESL is designed by adding enhanced local self-attention to enhance the mining of the spectral correlations across the adjacent spectrum. Finally, a feature fusion module is proposed to ensure an efficient information exchange between HSI and LiDAR during spectral features and spatial feature fusion. Experimental evaluations on the HSI-LiDAR dataset clearly illustrate that ESASNet performs better in feature extraction than the state-of-the-art methods. The code is available at https://github.com/AirsterMode/ESASNet. [ABSTRACT FROM AUTHOR]

A multi-sensor information fusion algorithm based on fault-tolerant Kalman filter is proposed in phase-sensitive optical time-domain reflectometer (Φ-OTDR) system, for achieving fading-free distributed vibration sensing. Firstly, a fault-tolerant dual-core complementary array model is designed. The Rayleigh scattering signal denoising, and vibration existence judgment of localization points are carried out to obtain the differentiated frequency demodulation results of the sensing points of the dual-core fiber array. Then a fault-tolerant control strategy is used to determine the sensor weight coefficients and vibration judgment coefficients during data fusion processing, and array data fusion is carried out based on time series data using Kalman filter to realize error value identification and filling. The advantage of this method is the combination of redundant data in a complementary way to improve the system stability. The frequency response ranges from 10 Hz to 2400 Hz and the localization accuracy is 98.33%. The influence of key parameters on the frequency demodulation performance of fault-tolerant Kalman filter is discussed, and a standard deviation of 14.6 Hz and an average error of 7.6 Hz are obtained. The demodulation frequency data matrix obtained by the classical demodulation method has a demodulation error probability of 89.18%, which proves the widespread existence of demodulation errors in vibration signals. The fusion error of demodulation frequency is reduced to 0.25 Hz, the frequency demodulation accuracy reaches 100%, and the demodulation error caused by interference attenuation can be completely eliminated. This system based on fault-tolerant Kalman filter has the characteristics of simple multiplexing structure, interference fading resistance and stable demodulation performance. • A sensor information fusion algorithm based on fault-tolerant Kalman filter is proposed to achieve fading-free sensing. [ABSTRACT FROM AUTHOR]

This study addresses the issue of inaccurate single damage fingerprint recognition during the process of bridge damage identification. To improve accuracy, the proposed approach involves fusing displacement mode difference and curvature mode difference data for single damage identification, and curvature mode difference and displacement mode wavelet coefficient difference data for two damage identification. The methodology begins by establishing a finite element model of the cable-stayed bridge and obtaining the original damage fingerprints, displacement modes, curvature modes, and wavelet coefficient differences of displacement modes through modal analysis. A fusion program based on the D-S evidence theory criterion is then developed using Matlab to calculate the displacement mode difference (DMD), curvature mode difference (CMD), and wavelet coefficient difference of displacement mode (WCDM) for data fusion. The recognition effect of a single fingerprint is analyzed using modal data for both single and two damage conditions. Additionally, the fusion of multiple fingerprint initial data is performed, and the recognition effect of the data fusion method is quantitatively analyzed through sub peak to peak comparison. It is observed that when the fusion index is used as the recognition index, the sub peak to peak ratio is smaller compared to using the curvature mode as the damage index. Consequently, the reduction in single damage is more significant, ranging from 12% to 48%, while the reduction in multi damage is approximately 2%. This method demonstrates the ability to accurately identify the location of damage, yielding satisfactory recognition results and showing promising feasibility. [ABSTRACT FROM AUTHOR]

Estimates of population abundance are required to study the impacts of human activities on populations and assess their conservation status. Despite considerable effort to improve data collection, uncertainty around estimates of cetacean densities can remain large. A fundamental concept underlying distance sampling is the detection function. Here we focus on reducing the uncertainty in the estimation of detection function parameters in analyses combining data sets from multiple surveys, with known effects on the precision of density estimates. We developed detection functions using infinite mixture models that can be applied on data collating multiple species and/or surveys. These models enable automatic clustering by fusing the species and surveys with similar detection functions. We present a simulation analysis of a multisurvey data set in a Bayesian framework where we demonstrated that distance sampling models including fusion effects showed lower uncertainty than classical distance sampling models. We illustrated the benefits of this new model using data of line transect surveys from the Bay of Biscay and Iberian Coast. Future estimates of abundance using conventional distance sampling models on large multispecies surveys or on data sets combining multiple surveys could benefit from this new model to provide more precise density estimates. [ABSTRACT FROM AUTHOR]

The rapid and accurate estimation of leaf area index (LAI) through remote sensing holds significant importance for precise crop management. However, the direct construction of a vegetation index model based on multi-spectral data lacks robustness and spatiotemporal expansibility, making its direct application in practical production challenging. This study aimed to establish a simple and effective method for LAI estimation to address the issue of poor accuracy and stability that is encountered by vegetation index models under varying conditions. Based on seven years of field plot trials with different varieties and nitrogen fertilizer treatments, the Kalman filter (KF) fusion method was employed to integrate the estimated outcomes of multiple vegetation index models, and the fusion process was investigated by comparing and analyzing the relationship between fixed and dynamic variances alongside the fusion accuracy of optimal combinations during different growth stages. A novel multi-model integration fusion method, KF-DGDV (Kalman Filtering with Different Growth Periods and Different Vegetation Index Models), which combines the growth characteristics and uncertainty of LAI, was designed for the precise monitoring of LAI across various growth phases of rice. The results indicated that the KF-DGDV technique exhibits a superior accuracy in estimating LAI compared with statistical data fusion and the conventional vegetation index model method. Specifically, during the tillering to booting stage, a high R2 value of 0.76 was achieved, while at the heading to maturity stage, it reached 0.66. In contrast, within the framework of the traditional vegetation index model, the red-edge difference vegetation index (DVIREP) model demonstrated a superior performance, with an R2 value of 0.65, during tillering to booting stage, and 0.50 during the heading to maturity stage, respectively. The multi-model integration method (MME) yielded an R2 value of 0.67 for LAI estimation during the tillering to booting stage, and 0.53 during the heading to maturity stage. Consequently, KF-DGDV presented an effective and stable real-time quantitative estimation method for LAI in rice. [ABSTRACT FROM AUTHOR]

Human trajectories can be tracked by the internal processing of a camera as an edge device. This work aims to match peoples' trajectories obtained from cameras to sensor data such as acceleration and angular velocity, obtained from wearable devices. Since human trajectory and sensor data differ in modality, the matching method is not straightforward. Furthermore, complete trajectory information is unavailable; it is difficult to determine which fragments belong to whom. To solve this problem, we newly proposed the SyncScore model to find the similarity between a unit period trajectory and the corresponding sensor data. We also propose a Likelihood Fusion algorithm that systematically updates the similarity data and integrates it over time while keeping other trajectories in mind. We confirmed that the proposed method can match human trajectories and sensor data with an accuracy, a sensitivity, and an F1 of 0.725. Our models achieved decent results on the UEA dataset. [ABSTRACT FROM AUTHOR]

In order to avoid the loss of optimality of the optimal weighting factor in some cases and to further reduce the estimation error of an unbiased estimator, a multi-sensor adaptive weighted data fusion algorithm based on biased estimation is proposed. First, it is proven that an unbiased estimator can further optimize estimation error, and the reasons for the loss of optimality of the optimal weighting factor are analyzed. Second, the method of constructing a biased estimation value by using an unbiased estimation value and calculating the optimal weighting factor by using estimation error is proposed. Finally, the performance of least squares estimation data fusion, batch estimation data fusion, and biased estimation data fusion is compared through simulation tests, and test results show that biased estimation data fusion has a greater advantage in accuracy, stability, and noise resistance. [ABSTRACT FROM AUTHOR]

Existing methods for inverse synthetic aperture radar (ISAR) target recognition typically rely on a single high-resolution radar signal type, such as ISAR images or high-resolution range profiles (HRRPs). However, ISAR images and HRRP data offer representations of targets across different aspects, each containing valuable information crucial for radar target recognition. Moreover, the process of generating ISAR images inherently facilitates the acquisition of HRRP data, ensuring timely data collection. Therefore, to fully leverage the different information from both HRRP data and ISAR images and enhance ISAR ship target recognition performance, we propose a novel deep fusion network named the Separation-Decision Recognition network (SDRnet). First, our approach employs a convolutional neural network (CNN) to extract initial feature vectors from ISAR images and HRRP data. Subsequently, a feature separation module is employed to derive a more robust target representation. Finally, we introduce a weighted decision module to enhance overall predictive performance. We validate our method using simulated and measured data containing ten categories of ship targets. The experimental results confirm the effectiveness of our approach in improving ISAR ship target recognition. [ABSTRACT FROM AUTHOR]

Satellite precipitation products can help improve precipitation estimates where ground-based observations are lacking; however, their relative accuracy and applicability in data-scarce areas remain unclear. Here, we evaluated the accuracy of different satellite precipitation datasets for the Lancang River Basin, Western China, including the Tropical Rainfall Measuring Mission (TRMM) 3B42RT, the Global Precipitation Measurement Integrated Multi-satellitE Retrievals (GPM IMERG), and Fengyun 2G (FY-2G) datasets. The results showed that GPM IMERG and FY-2G are superior to TRMM 3B42RT for meeting local research needs. A subsequent bias correction on these two datasets significantly increased the correlation coefficient and probability of detection of the products and reduced error indices such as the root mean square error and mean absolute error. To further improve data quality, we proposed a novel correction–fusion method based on window sliding data correction and Bayesian data fusion. Specifically, the corrected FY-2G dataset was merged with GPM IMERG Early, Late, and Final Runs. The resulting FY-Early, FY-Late, and FY-Final fusion datasets showed high correlation coefficients, strong detection performances, and few observation errors, thereby effectively extending local precipitation data sources. The results of this study provide a scientific basis for the rational use of satellite precipitation products in data-scarce areas, as well as reliable data support for precipitation forecasting and water resource management in the Lancang River Basin. [ABSTRACT FROM AUTHOR]

Accurately identifying the spatial range of urban agglomerations holds significant practical importance for the precise allocation of various elements and coordinated development within urban agglomerations. However, current research predominantly focuses on the physical spaces of urban agglomerations, overlooking their sphere of influence. This study begins with the spatial interactions of population elements within urban agglomerations and fuses Weibo sign-in data with NTL data to identify the spatial range of urban agglomerations. It further compares and validates the results before and after the fusion of data. The results reveal that the accuracy of identifying the spatial range of urban agglomerations with the fusion of NTL data and Weibo sign-in data has improved by 7%, with a Kappa increase of 0.1766 compared to using NTL data alone, which indicates that fusing social media data can significantly enhance the accuracy of identifying the spatial range of urban agglomerations. This study proposes a novel approach for identifying the spatial range of urban agglomerations through the fusion of NTL data and social media data from a data fusion perspective. On one hand, it supplements the application of data fusion in the study of urban agglomeration spaces; on the other hand, it accurately identifies the spatial range of urban agglomerations, which holds great practical value for the sustainable development of urban agglomerations. [ABSTRACT FROM AUTHOR]

Approaching precipitation forecast refers to the prediction of precipitation within a short time scale, which is usually regarded as a spatiotemporal sequence prediction problem based on radar echo maps. However, due to its reliance on single-image prediction, it lacks good capture of sudden severe convective events and physical constraints, which may lead to prediction ambiguities and issues such as false alarms and missed alarms. Therefore, this study dynamically combines meteorological elements from surface observations with upper-air reanalysis data to establish complex nonlinear relationships among meteorological variables based on multisource data. We design a Residual Spatiotemporal Convolutional Network (ResSTConvNet) specifically for this purpose. In this model, data fusion is achieved through the channel attention mechanism, which assigns weights to different channels. Feature extraction is conducted through simultaneous three-dimensional and two-dimensional convolution operations using a pure convolutional structure, allowing the learning of spatiotemporal feature information. Finally, feature fitting is accomplished through residual connections, enhancing the model's predictive capability. Furthermore, we evaluate the performance of our model in 0–3 h forecasting. The results show that compared with baseline methods, this network exhibits significantly better performance in predicting heavy rainfall. Moreover, as the forecast lead time increases, the spatial features of the forecast results from our network are richer than those of other baseline models, leading to more accurate predictions of precipitation intensity and coverage area. [ABSTRACT FROM AUTHOR]

Integration of multiple data sources presents a challenge for accurate prediction of molecular patho-phenotypic features in automated analysis of data from human model systems. Here, we applied a machine learning-based data integration to distinguish patho-phenotypic features at the subcellular level for dilated cardiomyopathy (DCM). We employed a human induced pluripotent stem cell-derived cardiomyocyte (iPSC-CM) model of a DCM mutation in the sarcomere protein troponin T (TnT), TnT-R141W, compared to isogenic healthy (WT) control iPSC-CMs. We established a multimodal data fusion (MDF)-based analysis to integrate source datasets for Ca2+ transients, force measurements, and contractility recordings. Data were acquired for three additional layer types, single cells, cell monolayers, and 3D spheroid iPSC-CM models. For data analysis, numerical conversion as well as fusion of data from Ca2+ transients, force measurements, and contractility recordings, a non-negative blind deconvolution (NNBD)-based method was applied. Using an XGBoost algorithm, we found a high prediction accuracy for fused single cell, monolayer, and 3D spheroid iPSC-CM models (≥92 ± 0.08 %), as well as for fused Ca2+ transient, beating force, and contractility models (>96 ± 0.04 %). Integrating MDF and XGBoost provides a highly effective analysis tool for prediction of patho-phenotypic features in complex human disease models such as DCM iPSC-CMs. [ABSTRACT FROM AUTHOR]

RGB-D salient object detection (SOD) has gained more and more research interest in recent years. Due to various imaging mechanisms of RGB and depth modalities, RGB-D images contain different information. Thus, how to effectively fuse multi-modality features and aggregate multi-scale features to generate accurate saliency prediction are still the problems. In this article, we present a Multi-Modality Information Refinement Fusion Network (MIRFNet) for RGB-D SOD to solve the problems. Specifically, a Feature-Enhancement and Cross-Refinement Module (FCM) is proposed to reduce redundant features and the gap between cross-modality data to achieve multi-modality feature fusion effectively. In FCM, the Feature-Enhancement step utilizes attention mechanisms to obtain enhanced features which contain less redundant information and more common salient information, and the Cross-Refinement step employs the enhanced features to reduce the gap between cross-modality features and achieve effective feature fusion. Then, we propose an Edge Guidance Module (EGM) to extract edge information from RGB features. Finally, to effectively aggregate multi-level features and achieve accurate saliency prediction, a Feature-Aggregation and Edge-Refinement Module (FEM) is designed, which introduces specific-modality information and edge information to conduct sufficient information interaction. In FEM, the Feature-Aggregation step aggregates multi-scale features with specific-modality information, and the Edge-Refinement step uses edge information to refine the aggregation features. Extensive experiments demonstrate that MIRFNet can achieve comparable performance against the other 12 SOTA methods on five datasets. [ABSTRACT FROM AUTHOR]

Implementing a proper integration scheme plays an important role in the performance of integrated navigation systems. Not only does employing a more reliable estimation method improve the accuracy of the integrated navigation system, but this can lead to a more robust solution in the presence of different types of uncertainties. Implementing an integration scheme that has a robust and simple structure is a challenging issue in the design of integrated navigation systems. By inspiring from the concept of PID control, this paper proposes a robust integration scheme for aided inertial navigation systems in the presence of aiding sensor measurement uncertainties. The proposed filter combines the concept of proportional-integral-derivative control theory and the standard Kalman filter estimator to improve the performance of the integration scheme. Thanks to the integral and derivative parts added to the proposed scheme, the integrated system attains a faster and more robust solution in the presence of observation errors and uncertainties. The simulation case studies validate the superior efficacy and capability of the proposed scheme compared to the integration method based on the standard Kalman filter. [ABSTRACT FROM AUTHOR]

The objective of the study is to measure and rank the performance of the Black Sea Economic Cooperation Organization (BSECO) member countries for the different four years using Multi-Criteria Decision Making (MCDM) techniques widely used in performance measurement. This is the first study using CRITIC (Criteria Importance through Intercritera Correlation), COPRAS (Compress PRoportional ASssessment- Complex Relative Assessment) and Borda Count Methods to rank countries on basic energy indicators using MCDM. The CRITIC method was used to calculate the critical weights of the criteria established in the first stage of the three-stage work. It is an objective method of MCDM. The performance of BSECO member countries is ranked using the COPRAS method. The weights calculated in the second stage are used for the ranking. In the last stage, using the Borda count method, which is a data fusion technique, a single ranking was obtained by integrating the rankings obtained under different scenarios. According to this result, Albania was the first, Georgia was the second and Armenia was the third. The last place was taken by Türkiye. Thus, MCDM techniques can provide effective and comprehensive results in this kind of problems. It can be observed that the unbiased results are objective measures of the criteria used. [ABSTRACT FROM AUTHOR]

The current object tracking methods mostly fuse different modal information to make localization decisions, which has the problems of insufficient information extraction, simple fusion methods, and inability to accurately track targets in low-light scenes. To this end, a Transformer-based multi-modal object tracking algorithm (Trans-RGBT) is proposed. Firstly, the visible and infrared images are extracted separately by using a pseudo-twin network, and fully fused at the feature level. Secondly, the first frame of target information is modulated into feature vector of the frame to be tracked to obtain a dedicated tracker. Then, transformer method is applied to code and decode for target in the field of view. Spatial position of the target in the field of view is predicted by the spatial position prediction branch and the interference target is filtered out by combining the historical information to obtain accurate position of the target. Finally, external rectangular frame of the target is predicted by using the rectangular frame regression network, so as to achieve accurate target tracking. Full experiments are conducted on the latest large-scale dataset VTUAV and RGBT234. In comparison with the twin network (Siam-based) and filtering (filter-based) algorithms, Trans-RGBT has higher accuracy, better robustness and achieves a real-time tracking speed of 22 frames per second. [ABSTRACT FROM AUTHOR]

Solar energetic particle (SEP) events, originating from solar flares and Coronal Mass Ejections, present significant hazards to space exploration and technology on Earth. Accurate prediction of these high‐energy events is essential for safeguarding astronauts, spacecraft, and electronic systems. In this study, we conduct an in‐depth investigation into the application of multimodal data fusion techniques for the prediction of high‐energy SEP events, particularly ∼100 MeV events. Our research utilizes six machine learning (ML) models, each finely tuned for time series analysis, including Univariate Time Series (UTS), Image‐based model (Image), Univariate Feature Concatenation (UFC), Univariate Deep Concatenation (UDC), Univariate Deep Merge (UDM), and Univariate Score Concatenation (USC). By combining time series proton flux data with solar X‐ray images, we exploit complementary insights into the underlying solar phenomena responsible for SEP events. Rigorous evaluation metrics, including accuracy, F1‐score, and other established measures, are applied, along with K‐fold cross‐validation, to ensure the robustness and generalization of our models. Additionally, we explore the influence of observation window sizes on classification accuracy. Plain Language Summary: This study is centered on forecasting solar energetic particle (SEP) events, which can pose serious risks to astronauts and technology. We employed advanced machine learning (ML) techniques to make these predictions. Our research involved integrating various data sources, including information about protons and X‐rays emitted by the Sun, to enhance the accuracy of our forecasts. We evaluated the performance of four distinct multimodal time series data fusion models along with two distinct unimodal time series models to determine the most effective approach for predicting these solar events. Additionally, we examined how the choice of time window for predictions influenced their accuracy. To aid in interpreting the results, we utilized visual representations known as heatmaps, which provide a graphical view of the data. Our findings have significant implications for improving the safety and success of space missions. By achieving precise predictions of SEP events, we can better protect astronauts, spacecraft, and vital electronic systems both in space and on Earth. Key Points: Combining proton flux data and solar X‐ray images for precise Solar Energetic Particle event predictionUtilizing six specialized machine learning models to improve SEP event prediction accuracy through time series analysisExploring the impact of varying observation window sizes on classification accuracy in data fusion [ABSTRACT FROM AUTHOR]

In response to the issue of low positioning accuracy and insufficient robustness in small UAVs (unmanned aerial vehicle) caused by sensor noise and cumulative motion errors during flight in complex environments, this paper proposes a multisource, multimodal data fusion method. Initially, it employs a multimodal data fusion of various sensors, including GPS (global positioning system), an IMU (inertial measurement unit), and visual sensors, to complement the strengths and weaknesses of each hardware component, thereby mitigating motion errors to enhance accuracy. To mitigate the impact of sudden changes in sensor data, a high-fidelity UAV model is established in the digital twin based on the real UAV parameters, providing a robust reference for data fusion. By utilizing the extended Kalman filter algorithm, it fuses data from both the real UAV and its digital twin, and the filtered positional information is fed back into the control system of the real UAV. This enables the real-time correction of UAV positional deviations caused by sensor noise and environmental disturbances. The multisource, multimodal fusion Kalman filter method proposed in this paper significantly improves the positioning accuracy of UAVs in complex scenarios and the overall stability of the system. This method holds significant value in maintaining high-precision positioning in variable environments and has important practical implications for enhancing UAV navigation and application efficiency. [ABSTRACT FROM AUTHOR]

With the rapid advancement of sports analytics and fan engagement technologies, the volume and diversity of physique data generated by smart devices across various distributed sports platforms have grown significantly. Extracting insights and enhancing fan experiences from such data offer considerable benefits. Yet, this process unveils two primary challenges. Firstly, efficiently utilizing the vast datasets in sports analytics is daunting due to the complex nature of the sports industry. Secondly, the data collected from diverse sources and stored in distributed platforms contain sensitive information like fan preferences and athlete performance metrics, posing risks of privacy breaches. To address these challenges, we leverage an advanced Locality-Sensitive Hashing technique, known as PSDFP ALSH , tailored for the sports domain. This paper presents a new privacy-preserving method for sports data fusion and prediction in distributed environments, utilizing enhanced Locality-Sensitive Hashing to protect sensitive information while maintaining high data utility. Through extensive experimentation, our approach demonstrates superior performance over existing methods in terms of Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and computational efficiency. [ABSTRACT FROM AUTHOR]

The devices deployed across diverse industrial scenarios have generated significant network traffic related to time. The system's irregular operation could result in substantial bad influence. Anomaly detection technologies utilized for identifying possible non-standard behaviours are paramount; furthermore, multivariate time series exhibit complex dependencies besides temporal correlation. However, most previous methods merely consider the temporal and variable correlation of time series data, neglecting the distance metrics among the sequences, leading to a deficiency in the model's anomaly detection ability. We propose a multivariate time series anomaly detection model based on the encoder–decoder architecture (CCER-ED). The model considers the similarity measure between temporal subsequences and designs a multi-scale feature embedding module for leveraging more interrelated properties. Moreover, the interrelations among sensors are explicitly learned using a manifold regularization graph structure. On this basis, an improved data fusion approach based on a multi-head self-attention mechanism is designed for capturing global feature representation, effectively integrating various aspects of information. Evaluations using the real-world datasets SWAT and WADI and performance analysis show that the proposed approach achieves improvement over the baselines in the recall and F1-score of anomaly detection performance at 9.3% and 8.5% (maximum), respectively, outperforming other existing methods. [ABSTRACT FROM AUTHOR]

The advancements of Internet of Things (IoT) technologies have enabled the implementation of smart and wearable sensors, which can be employed to provide older adults with affordable and accessible continuous biophysiological status monitoring. The quality of such monitoring data, however, is unsatisfactory due to excessive noise induced by various disturbances, such as motion artifacts. Existing methods take advantage of summary statistics, such as mean or median values, for denoising, without taking into account the biophysiological patterns embedded in data. In this research, a functional data analysis modeling method was proposed to enhance the data quality by learning individual subjects' diurnal heart rate (HR) patterns from historical data, which were further improved by fusing newly collected data. This proposed data-fusion approach was developed based on a Bayesian inference framework. Its effectiveness was demonstrated in an HR analysis from a prospective study involving older adults residing in assisted living or home settings. The results indicate that it is imperative to conduct personalized healthcare by estimating individualized HR patterns. Furthermore, the proposed calibration method provides a more accurate (smaller mean errors) and more precise (smaller error standard deviations) HR estimation than raw HR and conventional methods, such as the mean. [ABSTRACT FROM AUTHOR]

Featured Application: In the realm of Intelligent Transportation Systems, accurate prediction of traffic flow is paramount for optimizing traffic management and enhancing road safety. Our research addresses the critical challenge of capturing and modeling the complex spatial–temporal correlations inherent in traffic data. While recent advancements have seen the deployment of Spatial–Temporal Graph Neural Networks (STGNNs) and transformer models to tackle this issue, our study identifies and overcomes significant limitations in existing methodologies. In the realm of Intelligent Transportation Systems (ITSs), traffic flow prediction is crucial for multiple applications. The primary challenge in traffic flow prediction lies in the handling and modeling of the intricate spatial–temporal correlations inherent in transport data. In recent years, many studies have focused on developing various Spatial–Temporal Graph Neural Networks (STGNNs), and researchers have also begun to explore the application of transformers to capture spatial–temporal correlations in traffic data. However, GNN-based methods mainly focus on modeling spatial correlations statically, which significantly limits their capacity to discover dynamic and long-range spatial patterns. Transformer-based methods have not sufficiently extracted the comprehensive representation of traffic data features. To explore dynamic spatial dependencies and comprehensively characterize traffic data, the Spatial–Temporal Fusion Embedding Transformer (STFEformer) is proposed for traffic flow prediction. Specifically, we propose a fusion embedding layer to capture and fuse both native information and spatial–temporal features, aiming to achieve a comprehensive representation of traffic data characteristics. Then, we introduce a spatial self-attention module designed to enhance detection of dynamic and long-range spatial correlations by focusing on interactions between similar nodes. Extensive experiments conducted on three real-world datasets demonstrate that STFEformer significantly outperforms various baseline models, notably achieving up to a 5.6% reduction in Mean Absolute Error (MAE) on the PeMS08 dataset compared to the next-best model. Furthermore, the results of ablation experiments and visualizations are employed to clarify and highlight our model's performance. STFEformer represents a meaningful advancement in traffic flow prediction, potentially influencing future research and applications in ITSs by providing a more robust framework for managing and analyzing traffic data. [ABSTRACT FROM AUTHOR]

There is no doubt that the rational and effective use of visible and thermal infrared image data information to achieve cross-modal complementary fusion is the key to improving the performance of RGB-T salient object detection (SOD). A meticulous analysis of the RGB-T SOD data reveals that it mainly consists of three scenarios in which both modalities (RGB and T) have a significant foreground and only a single modality (RGB or T) is disturbed. However, existing methods are obsessed with pursuing more effective cross-modal fusion based on treating both modalities equally. Obviously, the subjective use of equivalence has two significant limitations. Firstly, it does not allow for practical discrimination of which modality makes the dominant contribution to performance. While both modalities may have visually significant foregrounds, differences in their imaging properties will result in distinct performance contributions. Secondly, in a specific acquisition scenario, a pair of images with two modalities will contribute differently to the final detection performance due to their varying sensitivity to the same background interference. Intelligibly, for the RGB-T saliency detection task, it would be more reasonable to generate exclusive weights for the two modalities and select specific fusion mechanisms based on different weight configurations to perform cross-modal complementary integration. Consequently, we propose a weighted guided optional fusion network (WGOFNet) for RGB-T SOD. Specifically, a feature refinement module is first used to perform an initial refinement of the extracted multilevel features. Subsequently, a weight generation module (WGM) will generate exclusive network performance contribution weights for each of the two modalities, and an optional fusion module (OFM) will rely on this weight to perform particular integration of cross-modal information. Simple cross-level fusion is finally utilized to obtain the final saliency prediction map. Comprehensive experiments on three publicly available benchmark datasets demonstrate the proposed WGOFNet achieves superior performance compared with the state-of-the-art RGB-T SOD methods. The source code is available at: https://github.com/WJ-CV/WGOFNet. [ABSTRACT FROM AUTHOR]

Precipitation is a fundamental factor affecting many fields, including freshwater reservation, flood warning and prevention, agriculture, and hydropower planning. Observation-based precipitation data usually come from two primary sources, namely gauges and satellite images. The former provides high reliability but sparse coverage, while the latter offers fine-grained data but is still inaccurate. There have been several efforts to estimate precipitation, including mathematical and probabilistic models and machine learning-based techniques. All existing solutions consider the target problem as a satellite data calibration with gauge data as complementary information. However, this approach fails to provide accurate predictive results due to the sparsity of gauges and significant errors in satellite data. This paper presents a novel precipitation estimating method that highlights the importance of gauge data, the most trustworthy data source. To be more precise, we formulate the precipitation estimation issue as a spatial prediction task with the goal of predicting rainfall data for non-monitoring locations using gauge data at the monitored sites. To this end, we propose a data-driven approach that exploits the encoder–decoder architecture, graph neural network, and the multimodal data fusion strategy. Specifically, we design an encoder that leverages a graph neural network for capturing the spatial relationship among the gauges. Meanwhile, the decoder exploits the convolutional networks to learn the temporal correlation within the historical data. Finally, we integrate satellite images and meteorological information using a multimodal data fusion based on a multilayer perceptron to enhance prediction accuracy. The experimental results show that our proposed model increases the estimation accuracy from 24.3 to 65.2% compared to the state-of-the-art. [ABSTRACT FROM AUTHOR]

With global warming and intensified human activities, extreme convective precipitation has become one of the most frequent natural disasters. An accurate and reliable assessment of severe convective precipitation events can support social stability and economic development. In order to investigate the accuracy enhancement methods and data fusion strategies for the assessment of severe convective precipitation events, this study is driven by the horizontal reflectance factor (ZH) and differential reflectance (ZDR) of the dual-polarization radar. This research work utilizes microphysical information of convective storms provided by radar variables to construct the precipitation event assessment model. Considering the problems of high dimensionality of variable data and low computational efficiency, this study proposes a dual-polarization radar echo-data-layering strategy. Combined with the results of mutual information (MI), this study constructs Bayes–Kalman filter (KF) models (RF, SVR, GRU, LSTM) for the assessment of severe convective precipitation events. Finally, this study comparatively analyzes the evaluation effectiveness and computational efficiency of different models. The results show that the data-layering strategy is able to reduce the data dimensions of 256 × 256 × 34,978 to 5 × 2213, which greatly improves the computational efficiency. In addition, the correlation coefficient of interval III–V calibration period is increased to 0.9, and the overall assessment accuracy of the model is good. Among them, the Bayes–KF-LSTM model has the best assessment effect, and the Bayes–KF-RF has the highest computational efficiency. Further, five typical precipitation events are selected for validation in this study. The stratified precipitation dataset agrees well with the near-surface precipitation, and the model's assessment values are close to the observed values. This study completely utilizes the microphysical information offered by dual-polarized radar ZH and ZDR in precipitation event assessment, which provides a wide range of application possibilities for the assessment of severe convective precipitation events. [ABSTRACT FROM AUTHOR]

With the proliferation of digital devices in internet of things (IoT) environment featuring advanced visual capabilities, the task of Image Source Identification (ISI) has become increasingly vital for legal purposes, ensuring the verification of image authenticity and integrity, as well as identifying the device responsible for capturing the original scene. Over the past few decades, researchers have employed both traditional and machine‐learning methods to classify image sources. In the current landscape, data‐driven approaches leveraging deep learning models have emerged as powerful tools for achieving higher accuracy and precision in source prediction. The primary focus of this research is to address the complexities arising from diverse image sources and variable quality in IoT‐generated multimedia data. To achieve this, a Hybrid Data Fusion Approach is introduced, leveraging multiple sources of information to bolster the accuracy and robustness of ISI. This fusion methodology integrates diverse data streams from IoT devices, including metadata, sensor information, and contextual data, amalgamating them into a comprehensive data set for analysis. This study introduces an innovative approach to ISI through the implementation of a Twin Convolutional Neural Network Architecture (TCA) aimed at enhancing the efficacy of source classification. In TCA, the first CNN architecture, referred to as DnCNN, is employed to eliminate noise from the original data set, generating 256 × 256 patches for both training and testing. Subsequently, the second CNN architecture is employed to classify images based on features extracted from various convolutional layers using a 3 × 3 filter, thereby enhancing prediction efficiency. The proposed model demonstrates exceptional accuracy in effectively classifying image sources, showcasing its potential as a robust solution in the realm of ISI. [ABSTRACT FROM AUTHOR]

Intrusion detection in industrial control systems (ICS) is crucial for maintaining secu rity in modern industries. However, the rapid growth of data generated from various sources presents significant challenges, as complex and diverse attacks continue to threaten the integrity of these systems. Traditional intrusion detection systems face limitations in effectively detecting intrusions and suffer from processing delays. To address these issues, there is an urgent need for a real-time and efficient IDS. This study introduces a novel approach to real-time intrusion detection in ICS by leveraging Cloud Computing and Big Data techniques for data fusion. By fusing mul tiple streams of data, our approach enhances intrusion detection performance, reduces false alarm rates, and produces more consistent and accurate results. The contributions of this work are two-fold. Firstly, we propose a real-time IDS that overcomes the limitations of traditional systems through the efficient processing capabilities of Cloud Computing and Big Data techniques. Secondly, we employ data fusion to integrate diverse data sources, resulting in improved intrusion detection accuracy and efficiency. Our proposed IDS achieves higher accuracy rates and demonstrates superior efficiency in detecting intrusions compared to existing solutions. These findings underscore the potential of our approach in enhancing ICS security and mitigating risks posed by evolving attacks. [ABSTRACT FROM AUTHOR]

Regional ionospheric Total Electron Content (TEC) models are most significant to investigate the variability of ionosphere during all-weather conditions. Since the ground-based TEC measurements are not available in oceanic and polar regions, space-based observations are incorporated to increase the positional accuracy and reliability of Global Ionospheric TEC Maps (GIMs). Therefore, data fusion techniques are necessary to enhance the prediction capability of regional ionospheric models by considering multi-source data. In view of this, an attempt is made to investigate Equatorial Ionization Anomaly (EIA) structures in low-latitudinal Indian region using multi-instrument data. Data observations from background model CODEGIM, available International GNSS Service (IGS) stations in India, GNSS receivers at KLEF and Tripura stations, FORMOSAT/COSMIC radio occultation and SWARM during geomagnetic storm period August 26–28, 2021 are used for the study. Spherical Harmonics Function (SHF) of order 4 is employed along with Weighted Least Squares analysis (WLS), where separate weight constraint is computed for each data source. TEC maps of spatial resolution 5° x 5° and temporal resolution of 1 h are generated to illustrate the dynamic behavior of ionosphere. The standard deviation for 3 days is obtained as 0.42, 0.61 and 1.43 TECU respectively. TEC depletions and enhancements are observed on August 27 and 28, with mean values of 12.74 and 15.27 TECU respectively, demonstrating negative and positive storm effects. [ABSTRACT FROM AUTHOR]

The paper addresses the problem of distinguishing the leading agents in the group. The problem is considered in the framework of classification problems, where the agents in the group select the items with respect to certain properties. The suggested method of distinguishing the leading agents utilizes the connectivity between the agents and the Rokhlin distance between the subgroups of the agents. The method is illustrated by numerical examples. The method can be useful in considering the division of labor in swarm dynamics and in the analysis of the data fusion in the tasks based on the wisdom of the crowd techniques. [ABSTRACT FROM AUTHOR]

Medical imaging techniques play a crucial role in diagnosing major diseases such as cardiovascular diseases, cancers, and neurological disorders. The BMC Methods Collection "Advances in medical imaging techniques" will showcase the latest advancements in this field, including state-of-the-art imaging modalities, novel biomedical applications, progress in molecular probes and radiopharmaceuticals, and innovative methodologies for image analysis, data fusion, and visualization. [ABSTRACT FROM AUTHOR]

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models. [ABSTRACT FROM AUTHOR]

In an era marked by the escalating architectural complexity of the Internet, network intrusion detection stands as a pivotal element in cybersecurity. This paper introduces Learn-IDS, an innovative framework crafted to bridge existing gaps between datasets and the training process within deep learning (DL) models for Network Intrusion Detection Systems (NIDS). To elevate conventional DL-based NIDS methods, which are frequently challenged by the evolving cyber threat landscape and exhibit limited generalizability across various environments, Learn-IDS works as a potent and adaptable platform and effectively tackles the challenges associated with datasets used in deep learning model training. Learn-IDS takes advantage of the raw data to address three challenges of existing published datasets, which are (1) the provided tabular format is not suitable for the diversity of DL models; (2) the fixed traffic instances are not suitable for the dynamic network scenarios; (3) the isolated published datasets cannot meet the cross-dataset requirement of DL-based NIDS studies. The data processing results illustrate that the proposed framework can correctly process and label the raw data with an average of 90% accuracy across three published datasets. To demonstrate how to use Learn-IDS for a DL-based NIDS study, we present two simple case studies. The case study on cross-dataset sampling function reports an average of 30.3% OOD accuracy improvement. The case study on data formatting function shows that introducing temporal information can enhance the detection accuracy by 4.1%.The experimental results illustrate that the proposed framework, through the synergistic fusion of datasets and DL models, not only enhances detection precision but also dynamically adapts to emerging threats within complex scenarios. [ABSTRACT FROM AUTHOR]

KRAS is a pathogenic gene frequently implicated in non-small cell lung cancer (NSCLC). However, biopsy as a diagnostic method has practical limitations. Therefore, it is important to accurately determine the mutation status of the KRAS gene non-invasively by combining NSCLC CT images and genetic data for early diagnosis and subsequent targeted therapy of patients. This paper proposes a Semi-supervised Multimodal Multiscale Attention Model (S2MMAM). S2MMAM comprises a Supervised Multilevel Fusion Segmentation Network (SMF-SN) and a Semi-supervised Multimodal Fusion Classification Network (S2MF-CN). S2MMAM facilitates the execution of the classification task by transferring the useful information captured in SMF-SN to the S2MF-CN to improve the model prediction accuracy. In SMF-SN, we propose a Triple Attention-guided Feature Aggregation module for obtaining segmentation features that incorporate high-level semantic abstract features and low-level semantic detail features. Segmentation features provide pre-guidance and key information expansion for S2MF-CN. S2MF-CN shares the encoder and decoder parameters of SMF-SN, which enables S2MF-CN to obtain rich classification features. S2MF-CN uses the proposed Intra and Inter Mutual Guidance Attention Fusion (I2MGAF) module to first guide segmentation and classification feature fusion to extract hidden multi-scale contextual information. I2MGAF then guides the multidimensional fusion of genetic data and CT image data to compensate for the lack of information in single modality data. S2MMAM achieved 83.27% AUC and 81.67% accuracy in predicting KRAS gene mutation status in NSCLC. This method uses medical image CT and genetic data to effectively improve the accuracy of predicting KRAS gene mutation status in NSCLC. [ABSTRACT FROM AUTHOR]

Due to the complexity of the calculation process of the existing methods, the efficiency of data fusion of the power grid model is low. In order to improve the knowledge fusion effect of power grid model, this paper studied the knowledge fusion method of power grid model based on Seq2seq half pointer and half label method. The Text Rank algorithm is used to calculate the weight of semantic nodes of each grid model, and combined with the topological potential method, the semantic information of the grid model is extracted according to the final weight value, and the Seq2Seq semi-pointer semi-label model framework is constructed. The data of the scheduling automation system OMS and the production management system PMS are used as input. The extracted candidate mesh model semantics and the original mesh model semantics are encoded by Seq2Seq half-pointer half-label model. The semantic data of the power grid model is fused and sent to the Seq2Seq encoder. After the training is completed, the effective information is extracted from the power grid model through the Seq2Seq model to complete the knowledge fusion of the power grid model. Experimental results show that this method eliminates the redundant part of the basic attributes of each data source in the substation grid model after knowledge fusion, and the description of each basic attribute is more standardized, unified and perfect. Under different mesh model data dimensions, the support of the proposed method is all above 98%. The model trained by the proposed method tends to be stable after 120 iterations, and the precision, recall and F1 of the test set are 0.98, 0.93 and 0.91, respectively. At the same time, this method has high efficiency in the knowledge fusion processing of the power grid model, and its data processing speed is less than 160 s. The average integrity of the private data of the power grid model is 98.86%, indicating that the proposed method can better ensure the integrity of the data. Finally, compared with the application of other methods under different data amounts, the mean square error obtained by the proposed method is the smallest, indicating that the proposed method effectively improves the fusion accuracy. [ABSTRACT FROM AUTHOR]

Beijing Satellite 3 is a high-performance optical remote sensing satellite with a spatial resolution of 0.3–0.5 m. It can provide timely and independent ultra-high-resolution spatial big data and comprehensive spatial information application services. At present, there is no relevant research on the fusion method of BJ-3A satellite images. In many applications, high-resolution panchromatic images alone are insufficient. Therefore, it is necessary to fuse them with multispectral images that contain spectral color information. Currently, there is a lack of research on the fusion method of BJ-3A satellite images. This article explores six traditional pixel-level fusion methods (HPF, HCS, wavelet, modified-IHS, PC, and Brovey) for fusing the panchromatic image and multispectral image of the BJ-3A satellite. The fusion results were analyzed qualitatively from two aspects: spatial detail enhancement capability and spectral fidelity. Five indicators, namely mean, standard deviation, entropy, correlation coefficient, and average gradient, were used for quantitative analysis. Finally, the fusion results were comprehensively evaluated from three aspects: spectral curves of ground objects, absolute error figure, and object-oriented classification effects. The findings of the research suggest that the fusion method known as HPF is the optimum and appropriate technique for fusing panchromatic and multispectral images obtained from BJ-3A. These results can be utilized as a guide for the implementation of BJ-3A panchromatic and multispectral data fusion in real-world scenarios. [ABSTRACT FROM AUTHOR]

Bearing operation states will directly determine the performance of the equipment; thus, monitoring operation status and degradation indicators is the key to ensuring continuous and healthy operation of the equipment. However, most of the research uses single-source information data, which makes it difficult to model when dealing with multi-source information, complex data distribution, and noise. In this paper, a bearing performance degradation assessment method based on multi-source information is proposed to comprehensively utilize the data signals of different structures, spaces, types, and sources. First, the adversarial fusion convolutional autoencoder is constructed for obtaining the degradation index of the bearing, while the adversarial learning strategy is applied to achieve the effect of enhancing the robustness and sensitivity of the degradation indicators extracted by the network. Then the degradation index is input into the support vector data description to determine the fault anomalies of the degradation index adaptively and the fuzzy c-means algorithms to obtain the final rolling bearing performance degradation evaluation results. Through the verification results of two experiment datasets, it is found that the proposed model can achieve accurate evaluation and quantitative analysis of the performance degradation process of bearings. As a result, the entire network ensures the reconstruction accuracy of normal samples while simultaneously stretching the reconstruction error of abnormal samples to achieve accurate monitoring of degradation onset. [ABSTRACT FROM AUTHOR]

Since 3D sensors became popular, imaged depth data are easier to obtain in the consumer sector. In applications such as defect localization on industrial objects or mass/volume estimation, precise depth data is important and, thus, benefits from the usage of multiple information sources. However, a combination of RGB images and depth images can not only improve our understanding of objects, capacitating one to gain more information about objects but also enhance data quality. Combining different camera systems using data fusion can enable higher quality data since disadvantages can be compensated. Data fusion itself consists of data preparation and data registration. A challenge in data fusion is the different resolutions of sensors. Therefore, up- and downsampling algorithms are needed. This paper compares multiple up- and downsampling methods, such as different direct interpolation methods, joint bilateral upsampling (JBU), and Markov random fields (MRFs), in terms of their potential to create RGB-D images and improve the quality of depth information. In contrast to the literature in which imaging systems are adjusted to acquire the data of the same section simultaneously, the laboratory setup in this study was based on conveyor-based optical sorting processes, and therefore, the data were acquired at different time periods and different spatial locations. Data assignment and data cropping were necessary. In order to evaluate the results, root mean square error (RMSE), signal-to-noise ratio (SNR), correlation (CORR), universal quality index (UQI), and the contour offset are monitored. With JBU outperforming the other upsampling methods, achieving a meanRMSE = 25.22, mean SNR = 32.80, mean CORR = 0.99, and mean UQI = 0.97. [ABSTRACT FROM AUTHOR]

The paper aims to develop an information system for human emotion recognition in streaming data obtained from a PC or smartphone camera, using different methods of modality merging (image, sound and text). The objects of research are the facial expressions, the emotional color of the tone of a conversation and the text transmitted by a person. The paper proposes different neural network structures for emotion recognition based on unimodal flows and models for the margin of the multimodal data. The analysis determined that the best classification accuracy is obtained for systems with data fusion after processing each channel separately and obtaining individual characteristics. The final analysis of the model based on data from a camera and microphone or recording or broadcast of the screen, which were received in the "live" mode, gave a clear understanding that the quality of the obtained results is highly dependent on the quality of the data preparation and labeling. This is directly related to the fact that the data on which the neural network is trained is highly qualified. The neural network with combined data on the penultimate layer allows a psycho-emotional state recognition accuracy of 0.90 to be obtained. The spatial distribution of emotion analysis was also analyzed for each data modality. The model with late fusion of multimodal data demonstrated the best recognition accuracy. [ABSTRACT FROM AUTHOR]

In the face of complex scenarios, the information insufficiency of classification tasks dominated by a single modality has led to a bottleneck in classification performance. The joint application of multimodal remote sensing data for surface observation tasks has garnered widespread attention. However, issues such as sample differences between modalities and the lack of correlation in physical features have limited the performance of classification tasks. Establishing effective interaction between multimodal data has become another significant challenge. To fully integrate heterogeneous information from multiple modalities and enhance classification performance, this paper proposes a dual-branch cross-Transformer feature fusion network aimed at joint land cover classification of hyperspectral imagery (HSI) and Light Detection and Ranging (LiDAR) data. The core idea is to leverage the potential of convolutional operators to represent spatial features, combined with the advantages of the Transformer architecture in learning remote dependencies. The framework employs an improved self-attention mechanism to aggregate features within each modality, highlighting the spectral information of HSI and the spatial (elevation) information of LiDAR. The feature fusion module based on cross-attention integrates deep features from two modalities, achieving complementary information through cross-modal attention. The classification task is performed using jointly obtained spectral and spatial features. Experiments were conducted on three multi-source remote sensing classification datasets, demonstrating the effectiveness of the proposed model compared to existing methods. [ABSTRACT FROM AUTHOR]

Advancing the domain of biomedical investigation, integrated multi-omics data have shown exceptional performance in elucidating complex human diseases. However, as the variety of omics information expands, precisely perceiving the informativeness of intra- and inter-omics becomes challenging due to the intricate interrelations, thus presenting significant challenges in the integration of multi-omics data. To address this, we introduce a novel multi-omics integration approach, referred to as TEMINET. This approach enhances diagnostic prediction by leveraging an intra-omics co-informative representation module and a trustworthy learning strategy used to address inter-omics fusion. Considering the multifactorial nature of complex diseases, TEMINET utilizes intra-omics features to construct disease-specific networks; then, it applies graph attention networks and a multi-level framework to capture more collective informativeness than pairwise relations. To perceive the contribution of co-informative representations within intra-omics, we designed a trustworthy learning strategy to identify the reliability of each omics in integration. To integrate inter-omics information, a combined-beliefs fusion approach is deployed to harmonize the trustworthy representations of different omics types effectively. Our experiments across four different diseases using mRNA, methylation, and miRNA data demonstrate that TEMINET achieves advanced performance and robustness in classification tasks. [ABSTRACT FROM AUTHOR]

Completing traffic data is a basic requirement for intelligent transportation systems. However, completing spatiotemporal traffic data poses a significant challenge, especially for high-dimensional data with complex missing mechanisms. Various completion methods targeting different missing mechanisms have showcased the superiority of tensor learning by effectively characterizing intricate spatiotemporal correlations. In this study, a novel tensor completion framework, known as the multi-source tensor completion method for data fusion, is proposed. This framework incorporates passenger transfer relationships between buses and subways into subway data completion, enhancing the data completion accuracy. Moreover, by combining bus transfer passenger flow data with other data dimensions, such as the different road sections, time intervals, and days, an innovative 4D low-rank tensor completion data framework was obtained. In addition, to boost the completion accuracy, a truncated l 2 , p norm optimization model was derived. This model enhances the non-convex performance of the objective function throughout the tensor completion process. The results highlight the superiority of the proposed completion method, leveraging fused subway/bus data over other completion methods that rely solely on subway data. [ABSTRACT FROM AUTHOR]

Digital transformation in manufacturing necessitates the integration of advanced fields such as robotics, the Internet of Things (IoT), and data science. The latter two, in particular, introduce a unique set of challenges related to data acquisition and processing, especially for emerging manufacturing sectors that lack substantial data volumes for analytical software. This paper specifically addresses the challenges associated with limited data within the context of precision poultry farming. We begin by identifying the specific challenges encountered during the development of a smart poultry management software system. Subsequently, we propose potential solutions for each identified challenge. The outcome of this study is a comprehensive algorithm for data processing that encapsulates these proposed solutions, offering a practical approach to overcoming data limitations in precision poultry farming. [ABSTRACT FROM AUTHOR]

In the context of rapid developments in drone technology, the significance of recognizing and detecting low-altitude unmanned aerial vehicles (UAVs) has grown. Although conventional algorithmic enhancements have increased the detection rate of low-altitude UAV targets, they tend to neglect the intricate nature and computational demands of the algorithms. This paper introduces ATD-YOLO, an enhanced target detection model based on the YOLOv5s architecture, aimed at tackling this issue. Firstly, a realistic low-altitude UAV dataset is fashioned by amalgamating various publicly available datasets. Secondly, a C3F module grounded in FasterNet, incorporating Partial Convolution (PConv), is introduced to decrease model parameters while upholding detection accuracy. Furthermore, the backbone network incorporates an Efficient Multi-Scale Attention (EMA) module to extract essential image information while filtering out irrelevant details, facilitating adaptive feature fusion. Additionally, the universal upsampling operator CARAFE (Content-aware reassembly of features) is utilized instead of nearest-neighbor upsampling. This enhancement boosts the performance of the feature pyramid network by expanding the receptive field for data feature fusion. Lastly, the Slim-Neck network is introduced to fine-tune the feature fusion network, thereby reducing the model's floating-point calculations and parameters. Experimental findings demonstrate that the improved ATD-YOLO model achieves an accuracy of 92.8%, with a 31.4% decrease in parameters and a 28.7% decrease in floating-point calculations compared to the original model. The detection speed reaches 75.37 frames per second (FPS). These experiments affirm that the proposed enhancement method meets the deployment requirements for low computational power while maintaining high precision. [ABSTRACT FROM AUTHOR]

In order to solve the problem of large positioning error and incomplete mapping of SLAM based on two-dimensional lidar in indoor environment, a multi-sensor fusion SLAM algorithm for indoor robots was proposed. Aiming at the mismatch problem of the traditional ICP algorithm in the front end of the lidar SLAM, the algorithm adopts the PL-ICP algorithm that is more suitable for the indoor environment, and uses the extended Kalman filter to fuse the wheel odometer and IMU to provide the initial motion estimation value. Then, during the mapping phase, the pseudo 2D laser data converted from the 3D point cloud data obtained by the depth camera is fused with the data obtained from the 2D lidar to compensate for the lack of vertical field of view in the 2D lidar mapping. The final experimental results show that the fusion odometer data has improved the positioning accuracy by at least 33% compared to a single wheeled odometer, providing a higher initial iteration value for the PL-ICP algorithm. At the same time, fusion mapping compensates for the shortcomings of a single two-dimensional lidar mapping, and constructs an environmental map with more complete environmental information. [ABSTRACT FROM AUTHOR]

In prognostics and health management, the system's degradation condition assessment and corresponding remaining useful life prediction are the most important tasks. Both of these processes are heavily dependent on information gathered by multiple sensors, which eventually causes data fusion-related complex problems. Typically, sensor information contains the speed, pressure, temperature, and similar other types of various system data. These systems' data obtained through sensors can be utilized as a part of the evidence in the evidence-based estimation method. In this work, an artificial intelligence-based novel framework for estimating the remaining useful life using data fusion has been presented. The Dempster–Shafer extended theory is adopted for sensor information modeling and data fusion. Besides, two different scenarios are introduced to determine the similarity between the studied system and the available evidence. As a case study, the turbofan dataset is demonstrated to assess the proposed method. Based on the results, our integrated proposed method performs very competitively compared with the existing methods based on standard scores and performance criteria. [ABSTRACT FROM AUTHOR]

The field of multimodal emotion recognition is increasingly gaining popularity as a research area. It involves analyzing human emotions across multiple modalities, such as acoustic, visual, and language. Emotion recognition is more effective as a multimodal learning task than relying on a single modality. In this paper, we present an unimodal and multimodal long short-term memory model with a class weight parameter technique for emotion recognition on the CMU-Multimodal Opinion Sentiment and Emotion Intensity dataset. In addition, a critical challenge lies in selecting the most effective fusion method for integrating multiple modalities. To address this, we applied four different fusion techniques: Early fusion, late fusion, deep fusion, and tensor fusion. These fusion methods improved the performance of multimodal emotion recognition compared to unimodal approaches. With the highly imbalanced number of samples per emotion class in the MOSEI dataset, adding a class weight parameter technique leads our model to outperform the state of the art on all three modalities — acoustic, visual, and language — as well as on all the fusion models. The challenges of class imbalance, which can lead to biased model performance, and using an effective fusion method for integrating multiple modalities often result in decreased accuracy in recognizing less frequent emotion classes. Our proposed model shows 2–3% performance improvement in the unimodal and 2% in the multimodal over the state-of-the-art achieved results. [ABSTRACT FROM AUTHOR]

Predictive Business Process Monitoring (PBPM) is a significant research area in Business Process Management (BPM) aimed at accurately forecasting future behavioral events. At present, deep learning methods are widely cited in PBPM research, but no method has been effective in fusing data information into the control flow for multi-perspective process prediction. Therefore, this paper proposes a process prediction method based on the hierarchical BERT and multi-perspective data fusion. Firstly, the first layer BERT network learns the correlations between different category attribute data. Then, the attribute data is integrated into a weighted event-level feature vector and input into the second layer BERT network to learn the impact and priority relationship of each event on future predicted events. Next, the multi-head attention mechanism within the framework is visualized for analysis, helping to understand the decision-making logic of the framework and providing visual predictions. Finally, experimental results show that the predictive accuracy of the framework surpasses the current state-ofthe- art research methods and significantly enhances the predictive performance of BPM. [ABSTRACT FROM AUTHOR]

Simple stacking of InSAR Digital Elevation Models (DEMs) has shown potential to increase DEM quality. In order to obtain a straight-forward stacking procedure that reduces the uncertainty of InSAR DEMs, in this contribution we evaluate in detail the impact of different stacking routines on the accuracy of stacked DEMs. For that end, we performed systematic tests in a region of Córdoba, Argentina. First, we produced a set of 54 Sentinel-1 and 10 SAOCOM-1 InSAR DEMs, which were evaluated with respect to a reference photogrammetric DEM. We then tested different stacking workflows, obtaining stacked DEMs with a higher average accuracy than that of the single-pair DEMs. This suggests that the uncertainty in the quality of the InSAR DEMs can be overcome by simple stacking techniques. Further post-processing of the stacked DEMs involved planimetric position correction by co-registration with the reference DEM, altimetric correction by linear regression adjustment to the national altimetric network, and multidirectional filtering to correct for speckling and outliers. The evaluation of the final stacked DEMs with respect to the reference shows that the SAOCOM-1 stacked DEM has a mean biased error of 0.39 m with a standard deviation of 3.77 m, whereas the Sentinel-1 stacked DEM has a mean biased error of 2.25 m with a standard deviation of 7.61 m. Both DEMs offered a smaller pixel size (15 m) than the available Argentine digital elevation model MDE-Ar (30 m), but with a lower accuracy. In turn, the combination of the SAOCOM-1 and Sentinel-1 stacked DEMs resulted in a 50 % and 33 % reduction in the mean biased error and the standard deviation, respectively, with respect to the SAOCOM-1 stacked DEM; an accuracy close to that of MDE-Ar, with a smaller pixel size. Although further improvements could be accomplished by exploring more sophisticated stacking and data-fusion techniques, these results constitute a significant step towards the systematization of a methodology to obtain reliable DEMs from SAR data. • Simple stacking constitutes a reliable solution to overcome the quality uncertainty of InSAR DEMs. • SAOCOM-1 data proved to be useful for production of medium resolution, high quality DEMs. • The weighted combination of SAOCOM-1 and Sentinel-1 stacks improved DEM accuracy in terms of bias and standard deviation. [ABSTRACT FROM AUTHOR]