11,668 results on '"multisensor data fusion"'
Search Results
2. Research and Application of Hyperfine Realistic 3D Modeling Construction Based on Multisource Point Cloud Data.
- Author
-
Chen Si, Bogang Yang, Zengliang Liu, Mengjia Luo, Yongguo Wang, Yingchun Tao, and Xiaogang Zuo
- Subjects
POINT cloud ,MULTISENSOR data fusion ,URBAN renewal ,CARRIAGES & carts ,IMAGING systems ,DATA modeling - Abstract
At present, there are diverse data sources and mature technologies for the 3D modeling of cities, and 3D modeling is also developing towards component-level and refined modeling. In this study, we combined the needs of refined management in the central area of Beijing and elaborated on the practice of using various point cloud collection devices to carry out multisource point cloud data collection and ultrafine 3D modeling in areas where flight operations are not possible. There are three main areas of innovation: (1) the development of full-element ground acquisition and multisource point cloud joint 3D modeling technology, which solves the technical problems of acquiring all types of ground scanning data, such as those obtained using static, station-, cart-, backpack-, and vehicle-mounted laser scanning instruments, and handheld scanners, as well as multisource point cloud data fusion and modeling; (2) the development of a vehicle-mounted ultrahigh-resolution image acquisition system, which improves the efficiency of the vehicle scanner by increasing the exposure frequency to enhance its travel speed and (3) the use of tools to automatically extract urban components based on point clouds, which improved the efficiency of 3D modeling and achieved the fine-grained modeling of massive components in the region. On the basis of the system platform, the management and implementation of urban component-level information can be achieved. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
3. Global Displacement Reconstruction of Lattice Tower Using Limited Acceleration and Strain Sensors.
- Author
-
Fu, Xing, Zhang, Qing, Ren, Liang, and Li, Hong-Nan
- Subjects
- *
KALMAN filtering , *STRAIN sensors , *MULTISENSOR data fusion , *REFERENCE values , *PROBLEM solving , *TOWERS - Abstract
Displacement is an important parameter for evaluating structural performance. However, the accurate measurement of global dynamic displacement remains a challenging task. To solve this problem, this paper proposes a global dynamic displacement reconstruction method for lattice tower structures, fusing limited acceleration and strain data. First, the strain-displacement mapping method for cantilever beams with variable cross-sections is presented and then extended to lattice towers. Thereafter, a modified multi-rate data fusion algorithm incorporating Kalman filtering and the proposed strain-displacement mapping methods is developed to fuse the acceleration and strain data to reconstruct the global dynamic displacement of the tower. The numerical simulation, model test and full-scale test demonstrate that the reconstructed dynamic displacements using the proposed method agree well with the reference values in both the time and frequency domains, and the parametric analysis has also been carried out, exhibiting great robustness and high reconstruction accuracy. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
4. Fast detection and obstacle avoidance on UAVs using lightweight convolutional neural network based on the fusion of radar and camera.
- Author
-
Wang, Xiyue, Wang, Xinsheng, Zhou, Zhiquan, and Song, Yanhong
- Subjects
CONVOLUTIONAL neural networks ,FIELD programmable gate arrays ,MULTISENSOR data fusion ,COMPUTATIONAL complexity ,RADAR ,DEEP learning - Abstract
Multi-sensor information fusion (MSIF) technology based on deep convolutional neural networks (CNN) has been widely used in UAV obstacle avoidance. However, detection efficiency needs to be improved in practice because of its high computational complexity and limited airborne hardware resources. A lightweight CNN-based fast detection method based on the fusion of millimeter-wave (MMW) radar and camera is proposed in this paper. In the data preprocessing stage, the input images to the network were preprocessed based on the radar and image data. A rough detection algorithm calculates and segments the saliency image to obtain regions of interest (ROI). The computational complexity of the network training and prediction was reduced by setting the image pixels outside the ROI. In the detection stage based on deep learning, a lightweight network structure based on ResNet18 was designed to fuse the saliency images at different convolution depths. In the post-decoding stage, the calibration points are fused for local non-maximum suppression (NMS). In contrast to typical detection methods, the proposed method improves the detection speed by removing redundant pixels and local NMS, increasing the detection accuracy by fusing the feature information of the radar and camera in multiple stages. The experimental results indicate that compared with the latest lightweight network (YOLOv8n), the detection accuracy is increased by 10.51%, and the FPS increased by 44.43%. Compared with the latest YOLOv8s and YOLOv9m models, the FPS is increased by 3.0X-4.4X. The field programmable gate array (FPGA) implementation achieves a performance of 60.0 FPS. This is an improvement compared with typical methods, demonstrating that the proposed method is more effective than state-of-the-art models. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
5. ABAFT: an adaptive weight-based fusion technique for travel time estimation using multi-source data with different confidence and spatial coverage.
- Author
-
Respati, Sara, Chung, Edward, Zheng, Zuduo, and Bhaskar, Ashish
- Subjects
- *
TRAVEL time (Traffic engineering) , *TRAFFIC monitoring , *TIME perception , *MULTISENSOR data fusion , *DATA quality - Abstract
The evolution of traffic monitoring systems provides rich traffic data from multiple sensors. Fuzing the data has the potential to enhance the quality of travel time estimation. It also provides better spatial-temporal coverage in traffic observations. However, each sensor's unique data collection process results in fusion challenges with respect to the coverage and data quality differences between various sources. These factors determine the degree of confidence that should be considered when fuzing different types of data. To this end, this paper proposes an adaptive weight-based fusion technique (ABAFT) that considers data spatial coverage and quality or confidence as the factors constructing the weight. The proposed ABAFT was tested using different scenarios on synthetic GPS and Bluetooth MAC Scanners data from an urban arterial corridor. The results show that the ABAFT can increase the travel time estimation accuracy by over 10%, and reliability by over 8% compared to the single sensor estimators. It also outperforms the simple average and standard-error-based fusion by around 4%. ABAFT is easy to be implemented on multiple sources of information available to transport agencies for a single point of truth. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
6. DCAI-CLUD: a data-centric framework for the construction of land-use datasets.
- Author
-
Wu, Hao, Jiang, Zhangwei, Dong, Anning, Gao, Ronghui, Yan, Xiaoqin, Hu, Zhihui, Mao, Fengling, Liu, Hong, Li, Pengxuan, Luo, Peng, Guo, Zijin, Guan, Qingfeng, and Yao, Yao
- Subjects
- *
METROPOLIS , *ARTIFICIAL intelligence , *MULTISENSOR data fusion , *REMOTE sensing , *MATHEMATICAL optimization - Abstract
A high-quality land-use dataset is crucial for constructing a high-performance land-use classification model. Due to the complexity and spatial heterogeneity of land-use, the dataset construction process is inefficient and costly. This challenge affects the quality of datasets, consequently impacting the model's performance. The emerging field of Data-Centric Artificial Intelligence (DCAI) is expected to deliver techniques for dataset optimization, offering a promising solution to the problem. Therefore, this study proposes a data-centric framework named DCAI-CLUD for the construction of land-use datasets. Based on this framework, the accuracy and rate of data labeling are improved by 5.93 and 28.97%. The Gini index of the dataset and the proportion of samples with non-mixed land-use categories are enhanced by 3.27 and 8.52%. The overall accuracy (OA) and Kappa of the land-use classification model improved significantly by 27.87 and 58.08%. This study is the first to introduce DCAI into the field of geographic information and remote sensing and verify its effectiveness. The proposed framework can effectively improve the construction efficiency and quality of the dataset and synchronously optimize the model performance. Based on the proposed framework, we constructed a multi-source land-use dataset of major cities in China named CN-MSLU-100K. HIGHLIGHTS: A framework for optimizing the land-use dataset construction process is proposed. Filtering and pre-labeling improved the quality and efficiency of data labeling. The performance of land-use classification model is enhanced by dataset optimization. Preconceived results have a subjective impact on the data labelers. The first study to introduce DCAI for land-use classification is launched. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
7. Human activity recognition: A comprehensive review.
- Author
-
Kaur, Harmandeep, Rani, Veenu, and Kumar, Munish
- Subjects
- *
HUMAN behavior , *DEEP learning , *MULTISENSOR data fusion , *VIRTUAL reality , *COACHES (Athletics) , *HUMAN activity recognition - Abstract
Human Activity Recognition (HAR) is a highly promising research area meant to automatically identify and interpret human behaviour using data received from sensors in various contexts. The potential uses of HAR are many, among them health care, sports coaching or monitoring the elderly or disabled. Nonetheless, there are numerous hurdles to be circumvented for HAR's precision and usefulness to be improved. One of the challenges is that there is no uniformity in data collection and annotation making it difficult to compare findings among different studies. Furthermore, more comprehensive datasets are necessary so as to include a wider range of human activities in different contexts while complex activities, which consist of multiple sub‐activities, are still a challenge for recognition systems. Researchers have proposed new frontiers such as multi‐modal sensor data fusion and deep learning approaches for enhancing HAR accuracy while addressing these issues. Also, we are seeing more non‐traditional applications such as robotics and virtual reality/augmented world going forward with their use cases of HAR. This article offers an extensive review on the recent advances in HAR and highlights the major challenges facing this field as well as future opportunities for further researches. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
8. An Intelligent Cloud-Based IoT-Enabled Multimodal Edge Sensing Device for Automated, Real-Time, Comprehensive, and Standardized Water Quality Monitoring and Assessment Process Using Multisensor Data Fusion Technologies.
- Author
-
Mohammadi, Mohsen, Assaf, Ghiwa, Assaad, Rayan H., and Chang, Aichih "Jasmine"
- Subjects
- *
MULTISENSOR data fusion , *WATER quality monitoring , *BIOCHEMICAL oxygen demand , *GRAPHICAL user interfaces , *WATER quality , *MICROCONTROLLERS - Abstract
Amid escalating global challenges such as population growth, pollution, and climate change, access to safe and clean water has emerged as a critical issue. It is estimated that there are 4 billion cases of water-related diseases worldwide that cause 3.4 million deaths every year. This underscores the urgent need for efficient water quality monitoring and assessment. Traditional assessment techniques include laboratory-based methods that are manual, costly, time-consuming, and risky. Although some studies leveraged Internet of Things (IoT)-based systems to examine water quality, they only relied on a limited number of water quality parameters (and thus do not offer a comprehensive and accurate water quality assessment), mainly due to the technical difficulties to integrate multiple sensors to a single device. In fact, due to the issues of multimodality, heterogeneity, and complexity of data, the interoperability among sensors with various measurements, sampling rates, and technical requirements makes it very challenging to seamlessly integrate multiple sensors into one device. This study overcame these technical challenges by leveraging multisensor data fusion capabilities to develop an intelligent cloud-based IoT multimodal edge sensing device to provide an automated, real-time, and comprehensive assessment process of water quality. First, a total of nine water quality parameters were identified and considered. Second, the sensing device was designed and developed using an ESP32 embedded system, which is a low-cost, low-power system on a chip (SoC) microcontroller integrated with Wi-Fi and dual-mode Bluetooth connectivity by fusing data from six different sensors that measure the nine identified water parameters on the edge. Third, the overall water quality was evaluated using the National Sanitation Foundation Water Quality Index (NSFWQI). Fourth, a cloud-based server was created to publish the data instantly, and a graphical user interface (GUI) was developed to provide easy-to-understand real-time visualization and information of the water quality. The real-world applicability and practicality of the developed IoT-enabled sensing device was tested and verified in a pilot project (i.e., a case study) of a building located in Newark, New Jersey, for a duration of 6 months. This paper adds to the body of knowledge by being the first research developing a single IoT-enabled device that is capable of reporting NSFWQI in real-time based on 9 water quality indicators encompassing both physical [temperature, total dissolved solids (TDS), turbidity, and pH] and chemical [potassium, phosphorus, nitrogen, dissolved oxygen (DO), and 5-day biochemical oxygen demand (BOD5)] parameters. Thus, this study serves as a multifaceted improvement across different dimensions, fostering healthier, more efficient, and technologically advanced environments. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
9. Vision-Based Detection of Unsafe Worker Guardrail Climbing Based on Posture and Instance Segmentation Data Fusion.
- Author
-
Mei, Xinyu, Ma, Wendi, Xu, Feng, and Zhang, Zhipeng
- Subjects
- *
BUILDING sites , *MULTISENSOR data fusion , *CONSTRUCTION management , *SYSTEM safety , *ACCIDENTAL falls , *STAIR climbing - Abstract
Currently, the incidence of accidents involving falls from height at construction sites caused by workers climbing guardrails is still high. Traditional unsafe behavior management mainly relies on a safety patrol of construction-site supervisors, which consumes considerable laborpower and time. There is still a critical need for an automated safety management method to identify unsafe guardrail climbing behavior. This study proposes a worker behavior identification method based on visual data fusion of a worker's surrounding environment and posture data. Videos of seven participants' guardrail climbing behavior through multiangle and multidistance cameras were analyzed to verify this method. By analyzing the environment and posture of the participants, three methods based on environment, posture, and fusion data were used to detect the stage of guardrail climbing action of the workers and compare them with the ground truth labeled by safety experts. The precision and recall of worker guardrail climbing behavior based on the fusion method were 82% and 83% respectively, which is better performance than that obtained using a single method. The data fusion–based method avoids the misjudgment generated by a single detection method and can identify the guardrail climbing behavior more accurately. Practical Applications: Guardrail climbing is a typical unsafe behavior that exposes workers to a high risk of falling from height. However, there is a lack of research on the interaction between workers and guardrail systems in the construction industry. This study provides a nonintrusive method for automating detection and management of guardrail climbing behavior on construction site. Using existing surveillance cameras, this method can be deployed at low cost with slight interference with workers. Based on the detection, appropriate interventions are expected to effectively reduce workers' unsafe behaviors during construction and improve safety on site. The detection of guardrail climbing, which is one of the variety of unsafe behaviors associated with falls from height, can enrich the intelligent construction safety management system effectively. Moreover, this study also provides reference and quantitative indicators (e.g., a guardrail climbing unsafe behavior database) for risk assessment and early warning of workers who are exposed to risk of fall from height. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
10. Adaptive intelligent agent for cloud edge collaborative industrial inspection driven by multimodal data fusion and deep transformation networks.
- Author
-
Hao, Jia, Sun, Jiawei, Zhu, Zhicheng, Chen, Zhaoxin, and Yan, Yan
- Subjects
WORK environment ,INTELLIGENT agents ,MULTISENSOR data fusion ,INDUSTRIAL safety ,FAILURE (Psychology) - Abstract
Currently, the rapid development of the industrial Internet has led to the creation of a massive number of intelligent agents that are widely and distributively applied in various edge scenarios. The work conditions in these edge scenarios are complex, uncertain, and random. Traditional manual updates or human judgments are used for task decision-making in large-scale distributive intelligent agent edge work scenarios, which lack dynamic perception and autonomous recognition capabilities for edge work conditions. This inevitably leads to low decision-making accuracy, poor reliability, and ultimately, task failure. To address this issue, this study proposes an adaptive task identification strategy based on cloud-edge collaboration. This method utilizes a cloud-edge collaborative industrial intelligent application architecture to achieve cloud-based training and encapsulation of the task model, with online calling at the edge-end. Then, edge-end intelligent agents identify edge work conditions through multi-source data fusion, enabling accurate task decision-making. Finally, the edge-end requests the cloud for task model matching. The effectiveness of the proposed method is validated in an industrial safety situation virtual detection system. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. Indoor occupancy monitoring using environmental feature fusion and semi-supervised machine learning models.
- Author
-
Mena-Martinez, Alma, Alvarado-Uribe, Joanna, Molino-Minero-Re, Erik, and Ceballos, Hector G.
- Subjects
MACHINE learning ,ENERGY consumption of buildings ,ATMOSPHERIC pressure ,FEATURE selection ,MULTISENSOR data fusion - Abstract
Smart buildings optimize energy consumption and occupant comfort through Heating, Ventilation and Air Conditioning, and lighting management. Nevertheless, large venues require data fusion techniques to improve analysis and forecasting. This study aims to evaluate the effectiveness of using different feature fusion techniques, environmental sensors, and semi-supervised learning to estimate indoor occupancy in a 230 m
2 office. Using five Internet of Things devices measuring air temperature, relative humidity, and barometric pressure, data was collected for 99 days with 6800 entries (on average) and only 14% labeled. Eight feature selection methods were evaluated along with three supervised and two semi-supervised classification methods. Results indicate that the Chi-squared-based approach for feature fusion outperformed others. Similarly, the semi-supervised Self-Training model achieved better performance than the supervised methods. This research shows that combining semi-supervised learning and data fusion allows for estimating the occupancy level in large indoor spaces with high accuracy and low labeling costs. Highlights This study pioneers in exploring semi-supervised learning and distinct feature fusion methods for estimating indoor occupancy levels in a 230 m $ ^2 $ 2 open office using only Internet of Things (IoT) environmental sensors (air temperature, relative humidity, and barometric pressure). A comprehensive comparison of statistical methods, feature selection, and dimensionality reduction techniques are conducted to determine their ability to generate robust feature fusion sets. The feature fusion selected through the Chi-squared test stood out with a high accuracy F1-score (average of 0.95) and an average accuracy of 0.99. The Self-Training model reached the best performance from semi-supervised learning, with an average F1-Score of 0.90 and an average accuracy of 0.97, based on a dataset with a large proportion of unlabelled data (16,847 entries) and only 9367 labels. For supervised learning, Random Forest achieved a high accuracy (average of 0.98) and F1-score (average of 0.93) across various feature sets. [ABSTRACT FROM AUTHOR]- Published
- 2024
- Full Text
- View/download PDF
12. An innovative machine learning optimization-based data fusion strategy for distributed wireless sensor networks.
- Author
-
Sollapure, Naganna Shankar and Govindaswamy, Poornima
- Subjects
MULTISENSOR data fusion ,DISTRIBUTED sensors ,SUPPORT vector machines ,TIME complexity ,FEATURE selection ,WIRELESS sensor networks - Abstract
Self-sufficient sensors scattered over different regions of the world comprise distributed wireless sensor networks (DWSNs), which track a range of environmental and physical factors such as pressure, temperature, vibration, sound, motion, and pollution. The use of data fusion becomes essential for combining information from various sensors and system performance. In this study, we suggested the multi-class support vector machine (SDF-MCSVM) with synthetic minority over-sampling techniques (SMOTE) data fusion for wireless sensor network (WSN) performance. The dataset includes 1,334 instances of hourly averaged answers for 12 variables from an AIR quality chemical multisensor device. To create a balanced dataset, the unbalanced data was first pre-processed using the SMOTE. The grey wolf optimization (GWO) approach is then used to reduce features in an effort to improve the efficacy and efficiency of feature selection procedures. This method is applied to classify the fused feature vectors into multiple categories at once to improve classification performance in WSNs and address unbalance datasets. The result shows the proposed method reaches high precision, accuracy, F1-score, recall, and specificity. The computational complexity and processing time were decreased in the study by using the proposed method. This is great potential for accurate and timely data fusion in dispersed WSNs with the successful integration of data fusion technologies. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
13. An adaptive and late multifusion framework in contextual representation based on evidential deep learning and Dempster–Shafer theory.
- Author
-
El-Din, Doaa Mohey, Hassanein, Aboul Ella, and Hassanien, Ehab E.
- Subjects
ARTIFICIAL neural networks ,MULTISENSOR data fusion ,AGRICULTURE ,INTERDISCIPLINARY research ,DEEP learning ,AMBIGUITY ,PARTICLE swarm optimization - Abstract
There is a growing interest in multidisciplinary research in multimodal synthesis technology to stimulate diversity of modal interpretation in different application contexts. The real requirement for modality diversity across multiple contextual representation fields is due to the conflicting nature of data in multitarget sensors, which introduces other obstacles including ambiguity, uncertainty, imbalance, and redundancy in multiobject classification. This paper proposes a new adaptive and late multimodal fusion framework using evidence-enhanced deep learning guided by Dempster–Shafer theory and concatenation strategy to interpret multiple modalities and contextual representations that achieves a bigger number of features for interpreting unstructured multimodality types based on late fusion. Furthermore, it is designed based on a multifusion learning solution to solve the modality and context-based fusion that leads to improving decisions. It creates a fully automated selective deep neural network and constructs an adaptive fusion model for all modalities based on the input type. The proposed framework is implemented based on five layers which are a software-defined fusion layer, a preprocessing layer, a dynamic classification layer, an adaptive fusion layer, and an evaluation layer. The framework is formalizing the modality/context-based problem into an adaptive multifusion framework based on a late fusion level. The particle swarm optimization was used in multiple smart context systems to improve the final classification layer with the best optimal parameters that tracing 30 changes in hyperparameters of deep learning training models. This paper applies multiple experimental with multimodalities inputs in multicontext to show the behaviors the proposed multifusion framework. Experimental results on four challenging datasets including military, agricultural, COIVD-19, and food health data provide impressive results compared to other state-of-the-art multiple fusion models. The main strengths of proposed adaptive fusion framework can classify multiobjects with reduced features automatically and solves the fused data ambiguity and inconsistent data. In addition, it can increase the certainty and reduce the redundancy data with improving the unbalancing data. The experimental results of multimodalities experiment in multicontext using the proposed multimodal fusion framework achieve 98.45% of accuracy. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
14. A modified multiple-criteria decision-making approach based on a protein-protein interaction network to diagnose latent tuberculosis.
- Author
-
Ayalvari, Somayeh, Kaedi, Marjan, and Sehhati, Mohammadreza
- Subjects
- *
LATENT tuberculosis , *MULTIPLE criteria decision making , *DNA microarrays , *FEATURE selection , *MULTISENSOR data fusion - Abstract
Background: DNA microarrays provide informative data for transcriptional profiling and identifying gene expression signatures to help prevent progression of latent tuberculosis infection (LTBI) to active disease. However, constructing a prognostic model for distinguishing LTBI from active tuberculosis (ATB) is very challenging due to the noisy nature of data and lack of a generally stable analysis approach. Methods: In the present study, we proposed an accurate predictive model with the help of data fusion at the decision level. In this regard, results of filter feature selection and wrapper feature selection techniques were combined with multiple-criteria decision-making (MCDM) methods to select 10 genes from six microarray datasets that can be the most discriminative genes for diagnosing tuberculosis cases. As the main contribution of this study, the final ranking function was constructed by combining protein-protein interaction (PPI) network with an MCDM method (called Decision-making Trial and Evaluation Laboratory or DEMATEL) to improve the feature ranking approach. Results: By applying data fusion at the decision level on the 10 introduced genes in terms of fusion of classifiers of random forests (RF) and k-nearest neighbors (KNN) regarding Yager's theory, the proposed algorithm reached a sensitivity of 0.97, specificity of 0.90, and accuracy of 0.95. Finally, with the help of cumulative clustering, the genes involved in the diagnosis of latent and activated tuberculosis have been introduced. Conclusions: The combination of MCDM methods and PPI networks can significantly improve the diagnosis different states of tuberculosis. Clinical trial number: Not applicable. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
15. Incidence and Risk Factors of Lumbosacral Complications Following Long‐Segment Spinal Fusion in Adult Degenerative Scoliosis.
- Author
-
Jiang, Tinghua, Zhang, Xinuo, Su, Qingjun, Meng, Xianglong, Pan, Aixing, Zhang, Hanwen, and Hai, Yong
- Subjects
- *
PREOPERATIVE risk factors , *VISUAL analog scale , *MULTISENSOR data fusion , *MULTIVARIATE analysis , *LOGISTIC regression analysis - Abstract
ABSTRACT Purpose Methods Results Conclusion Long‐segment spinal fusions are associated with lumbosacral complications (LSC), but the associated risk factors are not known. This study aimed to identify the risk factors for LSC after long‐segment instrumented fusion with distal fixation to the L5 vertebral body in adult degenerative scoliosis (ADS).We retrospectively evaluated 294 patients with ADS who underwent long‐segment floating fusion between January 2014 and March 2022, with follow‐up for at least 2 years. Patients were matched to the baseline data using fusion level > 5 as a grouping variable. Patients who completed matching were divided into two groups according to the presence or absence of LSC. Univariate logistic regression was applied to identify potential risk factors for LSC, and multivariate logistic regression was used to identify independent risk factors for postoperative LSC.The overall incidence of LSC was 21.77% in the 294 patients, with disc degeneration in 28 (9.52%) and radiographic ASD in 44 (14.97%) patients. The mean time to LSC development after surgery was 26.91 ± 8.43 months. A total of 54 pairs of patients were matched and grouped, and the complication group had higher Oswestry Disability Index (ODI) and visual analog scale (VAS) scores at the last follow‐up. Multivariate analysis showed that gender (OR = 0.274, p = 0.026 [0.087, 0.859]); levels of fusion > 5 (OR = 3.127, p = 0.029 [1.120, 8.730]), main curve correction rate (OR = 0.009, p = 0.005 [0.000, 0.330]), and postoperative pelvic incidence minus lumbar lordosis (PI‐LL) > 15° (OR = 3.346, p = 0.022 [1.195, 9.373]) were independent risk factors for postoperative LSC. The area under the curve value of the prediction model was 0.804, with a 95% confidence interval of 0.715–0.892, indicating that the model had a high prediction accuracy. Collinearity statistics showed no collinearity between variables.Sex, level of fusion > 5, main curve correction rate, and postoperative PI‐LL > 15° were independent risk factors for the development of LSC after long‐segment floating fusion. These results will improve our ability to predict personal risk conditions and provide better medical optimisation for surgery. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
16. Solar powered integrated multi sensors to monitor inland lake water quality using statistical data fusion technique with Kalman filter.
- Author
-
Priyanka, E. B., Thangavel, S., Mohanasundaram, R., and Anand, R.
- Subjects
- *
ECOSYSTEM management , *WATER quality , *MULTISENSOR data fusion , *STATISTICS , *ENVIRONMENTAL management , *CHLOROPHYLL in water - Abstract
This study proposes a data-driven statistical model using multi sensor fusion and Kalman filtering for real-time water quality assessment in lakes. A recursive estimation technique, the Kalman Filter, is employed to handle uncertainties and enhance computational efficiency. The fusion process integrates data from sensors monitoring parameters like chlorophyll concentration, surface water elevation, temperature, and precipitation, producing Markov features to capture temporal transitions and environmental dynamics. Data synchronization and fusion are achieved through recursive KF methods, enabling real-time adaptive management in response to environmental fluctuations such as seasonal changes, precipitation (6–18%), and evaporation rates (1.2–11.9 mm/day). Over a 30-day evaluation period, the model accurately predicted chlorophyll concentrations, reaching 128 mg / m 3 in mid-level inflow regions (3.6 m water elevation) compared to 86 mg / m 3 in extreme inflow areas (5.5 m). The integration of Markov feature extraction and eigenvalue estimation enhanced prediction stability and sensitivity, with the KF maintaining computational efficiency at 7.8 ms per computation cycle. The model's accuracy was validated by achieving a residual error of less than 0.05 with minimal noise interference. Overall, the system provides a resilient and precise framework for real-time lake water quality assessment, capable of handling multi-parameter uncertainties and dynamic environmental changes, thereby supporting informed decision-making for aquatic ecosystem management. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
17. Research on distribution automation security situational awareness technology based on risk transmission path and multi-source information fusion.
- Author
-
Liu, Jingzhi, Yang, Hongyi, Qu, Quanlei, Liu, Zhidong, and Cao, Yang
- Subjects
AUTOMATION equipment ,MULTISENSOR data fusion ,ANT algorithms ,RISK perception ,INFORMATION processing ,SITUATIONAL awareness - Abstract
It may be difficult for existing methods to make full use of the correlation and complementarity of various kinds of information when processing multi-source information. In order to accurately perceive the security situation of distribution automation and ensure the safe and stable operation of distribution network, the multi-source information fusion distribution automation security situation awareness technology based on risk transmission path is studied. Based on the risk transmission path, the distribution automation security situational awareness factors are analyzed, and the main factors affecting the distribution automation security situation are divided into two dimensions: internal source and external source, and eight main awareness factors; Different types of sensors are set in the main areas of security situational awareness factors to collect data of different awareness factors. Using ant colony algorithm to optimize DS evidence fusion method, data with different perception factors are fused, and data fusion results with different perception factors are obtained. The distribution automation security situational awareness model is constructed, and the security situational awareness results are obtained based on the data fusion results of the awareness factors. If the results are higher than the set threshold, the abnormal signal can be output to determine the area where the distribution automation abnormal equipment is located. The experimental results show that the multi-source data fusion effect of this method is good, and it can accurately perceive the security status of different nodes of the experimental object at different time nodes. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
18. Bridge Monitoring Using Smartphones Installed on Driving Vehicles: Oriented to Crowdsourcing Model.
- Author
-
Liu, Chengyin, Zhang, Jun, Quan, Yixin, Zeng, Qing, and Ren, Zhicheng
- Subjects
- *
SHAKING table tests , *STRUCTURAL health monitoring , *MULTISENSOR data fusion , *PARAMETER identification , *CITIES & towns - Abstract
The acquisition of bridge frequency by using the ubiquitous ordinary passenger vehicles and smartphones in cities has attracted an increasing amount of attention. This study proposes a bridge monitoring method and develops a vehicle–bridge crowdsourcing monitoring (VBCM) platform for public participation. It takes smartphones carried by vehicles as monitoring terminals for a long-term bridge monitoring task. To validate the feasibility of available smartphone brands as a signal collector, a small shake table test is carried out and the processing scheme for the smartphone sampling data is investigated. A smartphone sensor frequency gain technique is proposed to satisfy the fusion of multisensor data in different smartphones. Furthermore, a magnetic target identification technique is proposed to pick up and extract the bridge response signal segment corresponding to the vehicle’s entering and leaving, as well as to eliminate redundant data. To this end, the network of multiple smartphones is synchronized. For the sake of applicability and feasibility, a series of scaled experiments are conducted in the laboratory considering an adapted toy car driving over a simply supported steel bridge. The results demonstrated the practicality of the proposed methodology. The combination of easily accessible smartphones oriented to a crowdsourcing model and a driving vehicle lowers the threshold for the bridge monitoring process, which also pinpoints a potential for future structural health monitoring development. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
19. Characterization of Differences in Chemical Profiles and Antioxidant Activities of Schisandra chinensis and Schisandra sphenanthera Based on Multi-Technique Data Fusion.
- Author
-
Lin, Lujie, Tang, Zhuqian, Xie, Huijuan, Yang, Lixin, Yang, Bin, and Li, Hua
- Subjects
- *
SCHISANDRA chinensis , *REACTIVE oxygen species , *MULTIVARIATE analysis , *CHINESE medicine , *MULTISENSOR data fusion - Abstract
Schisandra chinensis (Turcz.) Baill. (S. chinensis) and Schisandra sphenanthera Rehd. et Wils (S. sphenanthera) are called "Wuweizi" in traditional Chinese medicine, and they have distinct clinical applications. To systematically compare the differential characteristics of S. chinensis and S. sphenanthera, this study employed ultra-performance liquid chromatography–quadrupole time-of-flight mass spectrometry (UPLC-QTOF-MS) and gas chromatography–mass spectrometry (GC-MS) to construct chemical profiles of these two species from different regions. In total, 31 non-volatiles and 37 volatiles were identified in S. chinensis, whereas 40 non-volatiles and 34 volatiles were detected in S. sphenanthera. A multivariate statistical analysis showed that the non-volatiles tigloygomisin P, schisandrol A, schisantherin C, and 6-O-benzoylgomisin O and the volatiles ylangene, γ-muurolene, and β-pinene distinguish these species. Additionally, the metabolism of oxygen free radicals can contribute to the development of various diseases, including cardiovascular and neurodegenerative diseases. Therefore, antioxidant activities were evaluated using 1,1-diphenyl-2-picrylhydrazyl (DPPH) and 2,2′-azino-bis-3-ethylbenzthiazoline-6-sulphonic acid (ABTS) scavenging assays. The results showed that S. sphenanthera exhibited significantly higher antioxidant potential. A gray relational analysis indicated that the key contributors to the antioxidant activity of S. chinensis were schisandrol A, gomisin G, schisantherin C, pregomisin, gomisin J, and schisantherin B. For S. sphenanthera, the key contributors included gomisin K2, schisantherin B, gomisin J, pregomisin, schisantherin C, schisandrin, gomisin G, schisantherin A, schisanhenol, and α-pinene. The identification of the differential chemical markers and the evaluation of the antioxidant activities provide a foundation for further research into the therapeutic applications of these species. This innovative study provides a robust framework for the quality control and therapeutic application of S. chinensis and S. sphenanthera, offering new insights into their medicinal potential. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
20. Neural Approach to Coordinate Transformation for LiDAR–Camera Data Fusion in Coastal Observation.
- Author
-
Garczyńska-Cyprysiak, Ilona, Kazimierski, Witold, and Włodarczyk-Sielicka, Marta
- Subjects
- *
OPTICAL radar , *LIDAR , *MULTISENSOR data fusion , *COORDINATE transformations , *ROOT-mean-squares , *RADIAL basis functions - Abstract
The paper presents research related to coastal observation using a camera and LiDAR (Light Detection and Ranging) mounted on an unmanned surface vehicle (USV). Fusion of data from these two sensors can provide wider and more accurate information about shore features, utilizing the synergy effect and combining the advantages of both systems. Fusion is used in autonomous cars and robots, despite many challenges related to spatiotemporal alignment or sensor calibration. Measurements from various sensors with different timestamps have to be aligned, and the measurement systems need to be calibrated to avoid errors related to offsets. When using data from unstable, moving platforms, such as surface vehicles, it is more difficult to match sensors in time and space, and thus, data acquired from different devices will be subject to some misalignment. In this article, we try to overcome these problems by proposing the use of a point matching algorithm for coordinate transformation for data from both systems. The essence of the paper is to verify algorithms based on selected basic neural networks, namely the multilayer perceptron (MLP), the radial basis function network (RBF), and the general regression neural network (GRNN) for the alignment process. They are tested with real recorded data from the USV and verified against numerical methods commonly used for coordinate transformation. The results show that the proposed approach can be an effective solution as an alternative to numerical calculations, due to process improvement. The image data can provide information for identifying characteristic objects, and the obtained accuracies for platform dynamics in the water environment are satisfactory (root mean square error—RMSE—smaller than 1 m in many cases). The networks provided outstanding results for the training set; however, they did not perform as well as expected, in terms of the generalization capability of the model. This leads to the conclusion that processing algorithms cannot overcome the limitations of matching point accuracy. Further research will extend the approach to include information on the position and direction of the vessel. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
21. Spatial Resolution Enhancement Framework Using Convolutional Attention-Based Token Mixer.
- Author
-
Peng, Mingyuan, Li, Canhai, Li, Guoyuan, and Zhou, Xiaoqing
- Subjects
- *
SPATIAL resolution , *MULTISENSOR data fusion , *REMOTE sensing , *REMOTE-sensing images , *TEST methods - Abstract
Spatial resolution enhancement in remote sensing data aims to augment the level of detail and accuracy in images captured by satellite sensors. We proposed a novel spatial resolution enhancement framework using the convolutional attention-based token mixer method. This approach leveraged spatial context and semantic information to improve the spatial resolution of images. This method used the multi-head convolutional attention block and sub-pixel convolution to extract spatial and spectral information and fused them using the same technique. The multi-head convolutional attention block can effectively utilize the local information of spatial and spectral dimensions. The method was tested on two kinds of data types, which were the visual-thermal dataset and the visual-hyperspectral dataset. Our method was also compared with the state-of-the-art methods, including traditional methods and deep learning methods. The experiment results showed that the method was effective and outperformed state-of-the-art methods in overall, spatial, and spectral accuracies. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
22. A Depth Awareness and Learnable Feature Fusion Network for Enhanced Geometric Perception in Semantic Correspondence.
- Author
-
Li, Fazeng, Zou, Chunlong, Yun, Juntong, Huang, Li, Liu, Ying, Tao, Bo, and Xie, Yuanmin
- Subjects
- *
MULTISENSOR data fusion , *AWARENESS , *AMBIGUITY , *DEEP learning , *DETECTORS , *ROBOTS - Abstract
Deep learning is becoming the most widely used technology for multi-sensor data fusion. Semantic correspondence has recently emerged as a foundational task, enabling a range of downstream applications, such as style or appearance transfer, robot manipulation, and pose estimation, through its ability to provide robust correspondence in RGB images with semantic information. However, current representations generated by self-supervised learning and generative models are often limited in their ability to capture and understand the geometric structure of objects, which is significant for matching the correct details in applications of semantic correspondence. Furthermore, efficiently fusing these two types of features presents an interesting challenge. Achieving harmonious integration of these features is crucial for improving the expressive power of models in various tasks. To tackle these issues, our key idea is to integrate depth information from depth estimation or depth sensors into feature maps and leverage learnable weights for feature fusion. First, depth information is used to model pixel-wise depth distributions, assigning relative depth weights to feature maps for perceiving an object's structural information. Then, based on a contrastive learning optimization objective, a series of weights are optimized to leverage feature maps from self-supervised learning and generative models. Depth features are naturally embedded into feature maps, guiding the network to learn geometric structure information about objects and alleviating depth ambiguity issues. Experiments on the SPair-71K and AP-10K datasets show that the proposed method achieves scores of 81.8 and 83.3 on the percentage of correct keypoints (PCK) at the 0.1 level, respectively. Our approach not only demonstrates significant advantages in experimental results but also introduces the depth awareness module and a learnable feature fusion module, which enhances the understanding of object structures through depth information and fully utilizes features from various pre-trained models, offering new possibilities for the application of deep learning in RGB and depth data fusion technologies. We will also continue to focus on accelerating model inference and optimizing model lightweighting, enabling our model to operate at a faster speed. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
23. A New Scene Sensing Model Based on Multi-Source Data from Smartphones.
- Author
-
Ding, Zhenke, Deng, Zhongliang, Hu, Enwen, Liu, Bingxun, Zhang, Zhichao, and Ma, Mingyang
- Subjects
- *
CONVOLUTIONAL neural networks , *METAHEURISTIC algorithms , *MULTISENSOR data fusion , *ARTIFICIAL satellites in navigation , *GLOBAL Positioning System , *SENSOR networks - Abstract
Smartphones with integrated sensors play an important role in people's lives, and in advanced multi-sensor fusion navigation systems, the use of individual sensor information is crucial. Because of the different environments, the weights of the sensors will be different, which will also affect the method and results of multi-source fusion positioning. Based on the multi-source data from smartphone sensors, this study explores five types of information—Global Navigation Satellite System (GNSS), Inertial Measurement Units (IMUs), cellular networks, optical sensors, and Wi-Fi sensors—characterizing the temporal, spatial, and mathematical statistical features of the data, and it constructs a multi-scale, multi-window, and context-connected scene sensing model to accurately detect the environmental scene in indoor, semi-indoor, outdoor, and semi-outdoor spaces, thus providing a good basis for multi-sensor positioning in a multi-sensor navigation system. Detecting environmental scenes provides an environmental positioning basis for multi-sensor fusion localization. This model is divided into four main parts: multi-sensor-based data mining, a multi-scale convolutional neural network (CNN), a bidirectional long short-term memory (BiLSTM) network combined with contextual information, and a meta-heuristic optimization algorithm. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
24. Methods for Evaluating Tibial Accelerations and Spatiotemporal Gait Parameters during Unsupervised Outdoor Movement.
- Author
-
Silder, Amy, Wong, Ethan J., Green, Brian, McCloughan, Nicole H., and Hoch, Matthew C.
- Subjects
- *
ACCELERATION (Mechanics) , *INERTIAL confinement fusion , *UNITS of measurement , *MULTISENSOR data fusion , *HEART beat - Abstract
The purpose of this paper is to introduce a method of measuring spatiotemporal gait patterns, tibial accelerations, and heart rate that are matched with high resolution geographical terrain features using publicly available data. These methods were demonstrated using data from 218 Marines, who completed loaded outdoor ruck hikes between 5–20 km over varying terrain. Each participant was instrumented with two inertial measurement units (IMUs) and a GPS watch. Custom code synchronized accelerometer and positional data without a priori sensor synchronization, calibrated orientation of the IMUs in the tibial reference frame, detected and separated only periods of walking or running, and computed acceleration and spatiotemporal outcomes. GPS positional data were georeferenced with geographic information system (GIS) maps to extract terrain features such as slope, altitude, and surface conditions. This paper reveals the ease at which similar data can be gathered among relatively large groups of people with minimal setup and automated data processing. The methods described here can be adapted to other populations and similar ground-based activities such as skiing or trail running. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
25. A Novel Defect Quantification Method Utilizing Multi-Sensor Magnetic Flux Leakage Signal Fusion.
- Author
-
Liu, Wenlong, Ren, Lemei, and Tian, Guansan
- Subjects
- *
MAGNETIC flux leakage , *MULTISENSOR data fusion , *MAGNETIC dipoles , *POINT defects , *STRUCTURAL models - Abstract
In the assessment of pipeline integrity using magnetic flux leakage (MFL) detection, it is crucial to quantify defects accurately and efficiently using MFL signals. However, in complex detection environments, traditional defect inversion methods exhibit low quantification accuracy and efficiency due to the complexity of their algorithms or excessive reliance on a priori knowledge and expert experience. To address these issues, this study presents a novel defect quantification method based on multi-sensor signal fusion (MSSF). The method employs a multi-sensor probe to fuse the MFL signals under multiple lift-off values, enhancing the diversity of defect information. This enables defect-opening profile recognition using the characteristic approximation approach (CAA). Subsequently, the MSSF method is based on a 3D magnetic dipole model and integrates the structural features of multi-sensor probes to develop an algorithm. This algorithm iteratively determines the defect depth at multiple data acquisition points within the defect region to obtain the maximum defect depth. The feasibility of the MSSF quantification method is validated through finite element simulation and physical experiments. The results demonstrate that the proposed method achieves accurate defect quantification while enhancing efficiency, with the number of iterations for each defect depth calculation point consistently requiring fewer than 15 iterations. For rectangular metal loss, perforation, and conical defects, quantification errors are less than 10%, meeting practical inspection requirements. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
26. Fusion of Raman and FTIR Spectroscopy Data Uncovers Physiological Changes Associated with Lung Cancer.
- Author
-
Hano, Harun, Suarez, Beatriz, Lawrie, Charles H., and Seifert, Andreas
- Subjects
- *
LUNG cancer , *FOURIER transform infrared spectroscopy , *FEATURE selection , *MULTISENSOR data fusion , *RAMAN spectroscopy - Abstract
Due to the high mortality rate, more effective non-invasive diagnostic methods are still needed for lung cancer, the most common cause of cancer-related death worldwide. In this study, the integration of Raman and Fourier-transform infrared spectroscopy with advanced data-fusion techniques is investigated to improve the detection of lung cancer from human blood plasma samples. A high statistical significance was found for important protein-related oscillations, which are crucial for differentiating between lung cancer patients and healthy controls. The use of low-level data fusion and feature selection significantly improved model accuracy and emphasizes the importance of structural protein changes in cancer detection. Although other biomolecules such as carbohydrates and nucleic acids also contributed, proteins proved to be the decisive markers found using this technique. This research highlights the power of these combined spectroscopic methods to develop a non-invasive diagnostic tool for discriminating lung cancer from healthy state, with the potential to extend such studies to a variety of other diseases. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
27. Cross-Spectral Navigation with Sensor Handover for Enhanced Proximity Operations with Uncooperative Space Objects.
- Author
-
Bussolino, Massimiliano, Civardi, Gaia Letizia, Quirino, Matteo, Bechini, Michele, and Lavagna, Michèle
- Subjects
- *
INFRARED imaging , *THERMOGRAPHY , *MULTISPECTRAL imaging , *KALMAN filtering , *MULTISENSOR data fusion - Abstract
Close-proximity operations play a crucial role in emerging mission concepts, such as Active Debris Removal or small celestial bodies exploration. When approaching a non-cooperative target, the increased risk of collisions and reduced reliance on ground intervention necessitate autonomous on-board relative pose (position and attitude) estimation. Although navigation strategies relying on monocular cameras which operate in the visible (VIS) spectrum have been extensively studied and tested in flight for navigation applications, their accuracy is heavily related to the target's illumination conditions, thus limiting their applicability range. The novelty of the paper is the introduction of a thermal-infrared (TIR) camera to complement the VIS one to mitigate the aforementioned issues. The primary goal of this work is to evaluate the enhancement in navigation accuracy and robustness by performing VIS-TIR data fusion within an Extended Kalman Filter (EKF) and to assess the performance of such navigation strategy in challenging illumination scenarios. The proposed navigation architecture is tightly coupled, leveraging correspondences between a known uncooperative target and feature points extracted from multispectral images. Furthermore, handover from one camera to the other is introduced to enable seamlessly operations across both spectra while prioritizing the most significant measurement sources. The pipeline is tested on Tango spacecraft synthetically generated VIS and TIR images. A performance assessment is carried out through numerical simulations considering different illumination conditions. Our results demonstrate that a combined VIS-TIR navigation strategy effectively enhances operational robustness and flexibility compared to traditional VIS-only navigation chains. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
28. Three-Dimensional Geometric-Physical Modeling of an Environment with an In-House-Developed Multi-Sensor Robotic System.
- Author
-
Zhang, Su, Yu, Minglang, Chen, Haoyu, Zhang, Minchao, Tan, Kai, Chen, Xufeng, Wang, Haipeng, and Xu, Feng
- Subjects
- *
OPTICAL radar , *LIDAR , *GEOMETRICAL constructions , *MULTISENSOR data fusion , *OPTICAL images , *SYNTHETIC aperture radar , *MULTISPECTRAL imaging - Abstract
Environment 3D modeling is critical for the development of future intelligent unmanned systems. This paper proposes a multi-sensor robotic system for environmental geometric-physical modeling and the corresponding data processing methods. The system is primarily equipped with a millimeter-wave cascaded radar and a multispectral camera to acquire the electromagnetic characteristics and material categories of the target environment and simultaneously employs light detection and ranging (LiDAR) and an optical camera to achieve a three-dimensional spatial reconstruction of the environment. Specifically, the millimeter-wave radar sensor adopts a multiple input multiple output (MIMO) array and obtains 3D synthetic aperture radar images through 1D mechanical scanning perpendicular to the array, thereby capturing the electromagnetic properties of the environment. The multispectral camera, equipped with nine channels, provides rich spectral information for material identification and clustering. Additionally, LiDAR is used to obtain a 3D point cloud, combined with the RGB images captured by the optical camera, enabling the construction of a three-dimensional geometric model. By fusing the data from four sensors, a comprehensive geometric-physical model of the environment can be constructed. Experiments conducted in indoor environments demonstrated excellent spatial-geometric-physical reconstruction results. This system can play an important role in various applications, such as environment modeling and planning. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
29. Deep-Learning for Change Detection Using Multi-Modal Fusion of Remote Sensing Images: A Review.
- Author
-
Saidi, Souad, Idbraim, Soufiane, Karmoude, Younes, Masse, Antoine, and Arbelo, Manuel
- Subjects
- *
SURFACE of the earth , *REMOTE sensing , *DEEP learning , *MULTISENSOR data fusion , *RESEARCH personnel - Abstract
Remote sensing images provide a valuable way to observe the Earth's surface and identify objects from a satellite or airborne perspective. Researchers can gain a more comprehensive understanding of the Earth's surface by using a variety of heterogeneous data sources, including multispectral, hyperspectral, radar, and multitemporal imagery. This abundance of different information over a specified area offers an opportunity to significantly improve change detection tasks by merging or fusing these sources. This review explores the application of deep learning for change detection in remote sensing imagery, encompassing both homogeneous and heterogeneous scenes. It delves into publicly available datasets specifically designed for this task, analyzes selected deep learning models employed for change detection, and explores current challenges and trends in the field, concluding with a look towards potential future developments. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
30. A Review of Satellite-Based CO 2 Data Reconstruction Studies: Methodologies, Challenges, and Advances.
- Author
-
Hu, Kai, Liu, Ziran, Shao, Pengfei, Ma, Keyu, Xu, Yao, Wang, Shiqian, Wang, Yuanyuan, Wang, Han, Di, Li, Xia, Min, and Zhang, Youke
- Subjects
- *
REMOTE sensing , *MULTISENSOR data fusion , *GREENHOUSE gases , *CARBON dioxide , *IMAGE reconstruction - Abstract
Carbon dioxide is one of the most influential greenhouse gases affecting human life. CO2 data can be obtained through three methods: ground-based, airborne, and satellite-based observations. However, ground-based monitoring is typically composed of sparsely distributed stations, while airborne monitoring has limited coverage and spatial resolution; they cannot fully reflect the spatiotemporal distribution of CO2. Satellite remote sensing plays a crucial role in monitoring the global distribution of atmospheric CO2, offering high observation accuracy and wide coverage. However, satellite remote sensing still faces spatiotemporal constraints, such as interference from clouds (or aerosols) and limitations from satellite orbits, which can lead to significant data loss. Therefore, the reconstruction of satellite-based CO2 data becomes particularly important. This article summarizes methods for the reconstruction of satellite-based CO2 data, including interpolation, data fusion, and super-resolution reconstruction techniques, and their advantages and disadvantages, it also provides a comprehensive overview of the classification and applications of super-resolution reconstruction techniques. Finally, the article offers future perspectives, suggesting that ideas like image super-resolution reconstruction represent the future trend in the field of satellite-based CO2 data reconstruction. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
31. Short‐term power prediction of distributed PV based on multi‐scale feature fusion with TPE‐CBiGRU‐SCA.
- Author
-
Zou, Hongbo, Yang, Changhua, Ma, Henrui, Zhu, Suxun, Sun, Jialun, Yang, Jinlong, and Wang, Jiahao
- Subjects
- *
PREDICTION theory , *DATA mining , *FEATURE extraction , *DATA analysis , *MULTISENSOR data fusion - Abstract
To address the challenge of insufficient comprehensive extraction and fusion of meteorological conditions, temporal features, and power periodic features in short‐term power prediction for distributed photovoltaic (PV) farms, a TPE‐CBiGRU‐SCA model based on multiscale feature fusion is proposed. First, multiscale feature fusion of meteorological features, temporal features, and hidden periodic features is performed in PV power to construct the model input features. Second, the relationships between PV power and its influencing factors are modelled from spatial and temporal scales using CNN and Bi‐GRU, respectively. The spatiotemporal features are then weighted and fused using the SCA attention mechanism. Finally, TPE‐based hyperparameter optimization is used to refine network parameters, achieving PV power prediction for a single field station. Validation with data from a PV field station shows that this method significantly enhances feature extraction comprehensiveness through multiscale fusion at both data and model layers. This improvement leads to a reduction in MAE and RMSE by 26.03% and 38.15%, respectively, and an increase in R2 to 96.22%, representing a 3.26% improvement over other models. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
32. Robust multi-outcome regression with correlated covariate blocks using fused LAD-lasso.
- Author
-
Möttönen, Jyrki, Lähderanta, Tero, Salonen, Janne, and Sillanpää, Mikko J.
- Subjects
- *
REGRESSION analysis , *MULTISENSOR data fusion , *MULTIVARIATE analysis , *RETIREMENT - Abstract
Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust fused LAD-lasso method for multiple outcomes is presented that addresses the challenges of non-normal outcome distributions and outlying observations. Measured covariate data from space or time, or spectral bands or genomic positions often have natural correlation structure arising from measuring distance between the covariates. The proposed multi-outcome approach includes handling of such covariate blocks by a group fusion penalty, which encourages similarity between neighboring regression coefficient vectors by penalizing their differences, for example, in sequential data situation. Properties of the proposed approach are illustrated by extensive simulations using BIC-type criteria for model selection. The method is also applied to a real-life skewed data on retirement behavior with longitudinal heteroscedastic explanatory variables. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
33. Multi-label remote sensing classification with self-supervised gated multi-modal transformers.
- Author
-
Na Liu, Ye Yuan, Guodong Wu, Sai Zhang, Jie Leng, and Lihong Wan
- Subjects
TRANSFORMER models ,SYNTHETIC aperture radar ,REMOTE sensing ,MULTISENSOR data fusion ,RESEARCH personnel - Abstract
Introduction: With the great success of Transformers in the field of machine learning, it is also gradually attracting widespread interest in the field of remote sensing (RS). However, the research in the field of remote sensing has been hampered by the lack of large labeled data sets and the inconsistency of data modes caused by the diversity of RS platforms. With the rise of self-supervised learning (SSL) algorithms in recent years, RS researchers began to pay attention to the application of "pre-training and fine-tuning" paradigm in RS. However, there are few researches on multi-modal data fusion in remote sensing field. Most of them choose to use only one of the modal data or simply splice multiple modal data roughly. Method: In order to study a more efficient multi-modal data fusion scheme, we propose a multi-modal fusion mechanism based on gated unit control (MGSViT). In this paper, we pretrain the ViT model based on BigEarthNet dataset by combining two commonly used SSL algorithms, and propose an intra-modal and inter-modal gated fusion unit for feature learning by combiningmultispectral (MS) and synthetic aperture radar (SAR). Our method can effectively combine different modal data to extract key feature information. Results and discussion: After fine-tuning and comparison experiments, we outperformthemost advanced algorithms in all downstream classification tasks. The validity of our proposed method is verified. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
34. A practical approach to building a calcareous nannofossil knowledge graph.
- Author
-
Zhao, Hongyi, Hu, Bin, Ma, Chao, Jiang, Shijun, Zhang, Yi, Li, Xin, Chen, Lirong, Cai, Can, Ye, Longgang, Zhou, Shengjian, and Wang, Chengshan
- Subjects
- *
KNOWLEDGE graphs , *RDF (Document markup language) , *NANNOFOSSILS , *MULTISENSOR data fusion , *STANDARD language , *ONTOLOGIES (Information retrieval) - Abstract
Following sustained development, numerous palaeontology databases and datasets of various types have been created. However, the lack of a unified standard language to describe knowledge and unclear sharing mechanisms between different databases and datasets has limited the large‐scale integration and application of paleontological data. The knowledge graph, as a key technology for semantic translation and data fusion, offers a possible solution to these challenges. Given the potential of knowledge graphs to overcome these obstacles, this paper presents a practical approach to express paleontological knowledge in a knowledge graph via the resource description framework language. By delving into the structured data associated with calcareous nannofossil biozones (the UC zone, CC zone and NC zone), we propose an ontology to describe the semantic units and logical relationships of paleontological biozones and species and then integrate relevant species records from unstructured research reports to construct a knowledge graph for calcareous nannofossils, that integrates multisource paleobiological data and knowledge reconstruction. Our focus lies in detailing the technical aspects of constructing a paleontological knowledge graph. The results demonstrate that knowledge graphs can integrate semistructured and unstructured paleontological data from various sources. This work aims to assist palaeontologists in building and utilizing knowledge graphs, serving as an initial effort for future paleontological knowledge reasoning. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
35. TransCDR: a deep learning model for enhancing the generalizability of drug activity prediction through transfer learning and multimodal data fusion.
- Author
-
Xia, Xiaoqiong, Zhu, Chaoyu, Zhong, Fan, and Liu, Lei
- Subjects
- *
GENETIC mutation , *MULTISENSOR data fusion , *CELL lines , *ANTINEOPLASTIC agents , *INDIVIDUALIZED medicine - Abstract
Background: Accurate and robust drug response prediction is of utmost importance in precision medicine. Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR), their performances can be improved by addressing issues such as insufficient data modality, suboptimal fusion algorithms, and poor generalizability for novel drugs or cell lines. Results: We introduce TransCDR, which uses transfer learning to learn drug representations and fuses multi-modality features of drugs and cell lines by a self-attention mechanism, to predict the IC50 values or sensitive states of drugs on cell lines. We are the first to systematically evaluate the generalization of the CDR prediction model to novel (i.e., never-before-seen) compound scaffolds and cell line clusters. TransCDR shows better generalizability than 8 state-of-the-art models. TransCDR outperforms its 5 variants that train drug encoders (i.e., RNN and AttentiveFP) from scratch under various scenarios. The most critical contributors among multiple drug notations and omics profiles are Extended Connectivity Fingerprint and genetic mutation. Additionally, the attention-based fusion module further enhances the predictive performance of TransCDR. TransCDR, trained on the GDSC dataset, demonstrates strong predictive performance on the external testing set CCLE. It is also utilized to predict missing CDRs on GDSC. Moreover, we investigate the biological mechanisms underlying drug response by classifying 7675 patients from TCGA into drug-sensitive or drug-resistant groups, followed by a Gene Set Enrichment Analysis. Conclusions: TransCDR emerges as a potent tool with significant potential in drug response prediction. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
36. Wind turbine condition monitoring dataset of Fraunhofer LBF.
- Author
-
Mostafavi, Atabak and Friedmann, Andreas
- Subjects
WIND speed ,WIND turbines ,TESTING equipment ,MULTISENSOR data fusion ,WEATHER ,ROLLING contact - Abstract
Fraunhofer wind turbine dataset contains monitoring data from a 750 W wind turbine, including accelerometers and tachometer, to capture structural response, bearing vibrations and rotational velocity. Additionally, temperatures, wind speed and wind direction have been measured, while weather conditions have been acquired from selected sources. Various damage scenarios, including mass imbalance, and aerodynamic imbalance as well as damages on bearings' outer race, inner race and roller element have been implemented. The availability of time series data makes the dataset well suited for both machine learning and signal processing-based condition monitoring applications. The availability of heterogeneous sensors has created a dataset particularly suited for information fusion, data fusion, multi-sensor approaches, and holistic monitoring. Experiments were conducted in real-world conditions outside of a controlled laboratory environment, thereby introducing challenges such as variable rotor speed, noise, overloads, and other environmental factors. Consequently, the dataset is qualified for tasks involving uncertainty quantification and signal pre-processing. This document will detail the test equipment, experimental procedures, simulated damage cases and measurement parameters. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
37. Assessing Credibility in Bayesian Networks Structure Learning.
- Author
-
Barth, Vitor, Serrão, Fábio, and Maciel, Carlos
- Subjects
- *
BAYESIAN analysis , *DIRECTED acyclic graphs , *LATENT variables , *DYNAMICAL systems , *MULTISENSOR data fusion - Abstract
Learning Bayesian networks from data aims to create a Directed Acyclic Graph that encodes significant statistical relationships between variables and their joint probability distributions. However, when using real-world data with limited knowledge of the original dynamical system, it is challenging to determine if the learned DAG accurately reflects the underlying relationships, especially when the data come from multiple independent sources. This paper describes a methodology capable of assessing the credible interval for the existence and direction of each edge within Bayesian networks learned from data, without previous knowledge of the underlying dynamical system. It offers several advantages over classical methods, such as data fusion from multiple sources, identification of latent variables, and extraction of the most prominent edges with their respective credible interval. The method is evaluated using simulated datasets of various sizes and a real use case. Our approach was verified to achieve results comparable to the most recent studies in the field, while providing more information on the model's credibility. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
38. Spatiotemporal Information, Near-Field Perception, and Service for Tourists by Distributed Camera and BeiDou Positioning System in Mountainous Scenic Areas.
- Author
-
Shi, Kuntao, Zhu, Changming, Li, Junli, Zhang, Xin, Yang, Fan, Zhang, Kun, and Shen, Qian
- Subjects
- *
STANDARD deviations , *STREAMING video & television , *VIDEO signals , *ARTIFICIAL satellites in navigation , *MULTISENSOR data fusion , *TRACKING algorithms - Abstract
The collaborative use of camera near-field sensors for monitoring the number and status of tourists is a crucial aspect of smart scenic spot management. This paper proposes a near-field perception technical system that achieves dynamic and accurate detection of tourist targets in mountainous scenic areas, addressing the challenges of real-time passive perception and safety management of tourists. The technical framework involves the following steps: Firstly, real-time video stream signals are collected from multiple cameras to create a distributed perception network. Then, the YOLOX network model is enhanced with the CBAM module and ASFF method to improve the dynamic recognition of preliminary tourist targets in complex scenes. Additionally, the BYTE target dynamic tracking algorithm is employed to address the issue of target occlusion in mountainous scenic areas, thereby enhancing the accuracy of model detection. Finally, the video target monocular spatial positioning algorithm is utilized to determine the actual geographic location of tourists based on the image coordinates. The algorithm was deployed in the Tianmeng Scenic Area of Yimeng Mountain in Shandong Province, and the results demonstrate that this technical system effectively assists in accurately perceiving and spatially positioning tourists in mountainous scenic spots. The system demonstrates an overall accuracy in tourist perception of over 90%, with spatial positioning errors less than 1.0 m and a root mean square error (RMSE) of less than 1.14. This provides auxiliary technical support and effective data support for passive real-time dynamic precise perception and safety management of regional tourist targets in mountainous scenic areas with no/weak satellite navigation signals. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
39. 鱼肉切割技术的发展现状与展望.
- Author
-
肖哲非, 马田田, and 沈建
- Subjects
- *
LABOR market , *COMPUTER vision , *MULTISENSOR data fusion , *ARTIFICIAL intelligence , *FISHERY processing , *DEEP learning - Abstract
Cutting is a pivotal step in the initial processing of fish products, encompassing beheading, trimming, slicing, and dicing. Traditional metal-knife cutting methods are marred by inefficiency, imprecision, and a propensity for bacterial growth, failing to meet market demands for precision and quality. Additionally, the reluctance of workers to perform manual labor in wet conditions exacerbates labor shortages and inefficiency. Adopting innovative cutting technologies, complemented by intelligent controls, is thus imperative. This study reviews the advancements and applications of waterjet and ultrasonic knives in sustainable cutting methods within the fish and food industries. It evaluates their respective merits and demerits, noting that waterjets excel in cutting hard-textured fish. At the same time, ultrasonic knives are adept at handling fish's viscous, elastic, and adhesive properties. The abstract further explores the integration of intelligent technologies in fish cutting, such as machine vision for precise cutting paths, simulation technology for adjusting process parameters, and multi-sensor data fusion for decision-making, which could potentially replace human labor. The study also addresses the current challenges and future directions for these technologies, highlighting the potential of artificial intelligence, machine learning, and deep learning to enhance the autonomy and robustness of fish-cutting equipment. By reducing operational and maintenance costs and integrating advanced technologies, the study envisions a future where fish cutting is more automated, intelligent, and capable of producing high-quality products efficiently to satisfy escalating market demands. This research is a valuable reference for industry professionals and researchers aiming to innovate in fish product processing, thereby enhancing the automation and intelligence of fish-cutting processes. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
40. A Tunnel Fire Detection Method Based on an Improved Dempster-Shafer Evidence Theory.
- Author
-
Wang, Haiying, Shi, Yuke, Chen, Long, and Zhang, Xiaofeng
- Subjects
- *
HEAT release rates , *DEMPSTER-Shafer theory , *MULTISENSOR data fusion , *WIND tunnels , *WIND speed , *FIRE detectors - Abstract
Tunnel fires are generally detected using various sensors, including measuring temperature, CO concentration, and smoke concentration. To address the ambiguity and inconsistency in multi-sensor data, this paper proposes a tunnel fire detection method based on an improved Dempster-Shafer (DS) evidence theory for multi-sensor data fusion. To solve the problem of evidence conflict in the DS theory, a two-level multi-sensor data fusion framework is adopted. The first level of fusion involves feature fusion of the same type of sensor data, removing ambiguous data to obtain characteristic data, and calculating the basic probability assignment (BPA) function through the feature interval. The second-level fusion derives basic probability numbers from the BPA, calculates the degree of evidence conflict, normalizes the BPA to obtain the relative conflict degree, and optimizes the BPA using the trust coefficient. The classical DS evidence theory is then used to integrate and obtain the probability of tunnel fire occurrence. Different heat release rates, tunnel wind speeds, and fire locations are set, forming six fire scenarios. Sensor monitoring data under each simulation condition are extracted and fused using the improved DS evidence theory. The results show that there is a 67.5%, 83.5%, 76.8%, 83%, 79.6%, and 84.1% probability of detecting fire when it occurs, respectively, and identifies fire occurrence in approximately 2.4 s, an improvement from 64.7% to 70% over traditional methods. This demonstrates the feasibility and superiority of the proposed method, highlighting its significant importance in ensuring personnel safety. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
41. Sowing Depth Monitoring System for High-Speed Precision Planters Based on Multi-Sensor Data Fusion.
- Author
-
Wang, Song, Yi, Shujuan, Zhao, Bin, Li, Yifei, Li, Shuaifei, Tao, Guixiang, Mao, Xin, and Sun, Wensheng
- Subjects
- *
STANDARD deviations , *VIBRATION (Mechanics) , *MULTISENSOR data fusion , *MEASUREMENT errors , *SEARCH algorithms , *KALMAN filtering - Abstract
High-speed precision planters are subject to high-speed (12~16 km/h) operation due to terrain undulation caused by mechanical vibration and sensor measurement errors caused by the sowing depth monitoring system's accuracy reduction problems. Thus, this study investigates multi-sensor data fusion technology based on the sowing depth monitoring systems of high-speed precision planters. Firstly, a sowing depth monitoring model comprising laser, ultrasonic, and angle sensors as the multi-sensor monitoring unit is established. Secondly, these three single sensors are filtered using the Kalman filter. Finally, a multi-sensor data fusion algorithm for optimising four key parameters in the extended Kalman filter (EKF) using an improved sparrow search algorithm (ISSA) is proposed. Subsequently, the filtered data from the three single sensors are integrated to address the issues of mechanical vibration interference and sensor measurement errors. In order to ascertain the superiority of the ISSA-EKF, the ISSA-EKF and SSA-EKF are simulated, and their values are compared with the original monitoring value of the sensor and the filtered sowing depth value. The simulation test demonstrates that the ISSA-EKF-based sowing depth monitoring algorithm for high-speed precision planters, with a mean absolute error (MAE) of 0.083 cm, root mean square error (RMSE) of 0.103 cm, and correlation coefficient (R) of 0.979 achieves high-precision monitoring. This is evidenced by a significant improvement in accuracy when compared with the original monitoring value of the sensor, the filtered value, and the SSA-EKF. The results of a field test demonstrate that the ISSA-EKF-based sowing depth monitoring system for high-speed precision planters enhances the precision and reliability of the monitoring system when compared with the three single-sensor monitoring values. The average MAE and RMSE are reduced by 0.071 cm and 0.075 cm, respectively, while the average R is improved by 0.036. This study offers a theoretical foundation for the advancement of sowing depth monitoring systems for high-speed precision planters. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
42. A Multi-Sensor Fusion Underwater Localization Method Based on Unscented Kalman Filter on Manifolds.
- Author
-
Wang, Yang, Xie, Chenxi, Liu, Yinfeng, Zhu, Jialin, and Qin, Jixing
- Subjects
- *
LIE algebras , *MULTISENSOR data fusion , *KALMAN filtering , *AUTONOMOUS underwater vehicles , *NONLINEAR systems - Abstract
In recent years, the simplified computation of position and velocity changes in nonlinear systems using Lie groups and Lie algebra has been widely used in the study of robot localization systems. The unscented Kalman filter (UKF) can effectively deal with nonlinear systems through the unscented transformation, and in order to more accurately describe the robot localization system, the UKF method based on Lie groups has been studied successively. The computational complexity of the UKF on Lie groups is high, and in order to simplify its computation, the Lie groups are applied to the manifold, which efficiently handles the state and uncertainty and ensures that the system maintains the geometric constraints and computational simplicity during the updating process. In this paper, a multi-sensor fusion localization method based on an unscented Kalman filter on manifolds (UKF-M) is investigated. Firstly, a system model and a multi-sensor model are established based on an Autonomous Underwater Vehicle (AUV), and a corresponding UKF-M is designed for the system. Secondly, the multi-sensor fusion method is designed, and the fusion method is applied to the UKF-M. Finally, the proposed method is validated using an underwater cave dataset. The experiments demonstrate that the proposed method is suitable for underwater environments and can significantly correct the cumulative error in the trajectory estimation to achieve accurate underwater localization. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
43. Improved Multi-Sensor Fusion Dynamic Odometry Based on Neural Networks.
- Author
-
Luo, Lishu, Peng, Fulun, and Dong, Longhui
- Subjects
- *
OPTICAL radar , *LIDAR , *MULTISENSOR data fusion , *AUTONOMOUS robots , *UNITS of measurement - Abstract
High-precision simultaneous localization and mapping (SLAM) in dynamic real-world environments plays a crucial role in autonomous robot navigation, self-driving cars, and drone control. To address this dynamic localization issue, in this paper, a dynamic odometry method is proposed based on FAST-LIVO, a fast LiDAR (light detection and ranging)–inertial–visual odometry system, integrating neural networks with laser, camera, and inertial measurement unit modalities. The method first constructs visual–inertial and LiDAR–inertial odometry subsystems. Then, a lightweight neural network is used to remove dynamic elements from the visual part, and dynamic clustering is applied to the LiDAR part to eliminate dynamic environments, ensuring the reliability of the remaining environmental data. Validation of the datasets shows that the proposed multi-sensor fusion dynamic odometry can achieve high-precision pose estimation in complex dynamic environments with high continuity, reliability, and dynamic robustness. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
44. Retrieval and Comparison of Multi-Satellite Polar Ozone Data from the EMI Series Instruments.
- Author
-
Wu, Kaili, Xu, Ziqiang, Luo, Yuhan, Li, Qidi, Yu, Kai, and Si, Fuqi
- Subjects
- *
OZONE layer depletion , *TRACE gases , *LIGHT absorption , *OPTICAL spectroscopy , *MULTISENSOR data fusion , *OZONE generators - Abstract
The Environmental Trace Gases Monitoring Instrument (EMI) series are second-generation Chinese spectrometers on board the GaoFen-5 (GF-5) and DaQi-1 (DQ-1) satellites. In this study, a comparative analysis of EMI series data was conducted to determine the daily trend of ozone concentration changes owing to different transit times and to improve the overall quality and reliability of EMI series datasets. The daily EMI total ozone column (TOC) obtained using the Differential Optical Absorption Spectroscopy (DOAS) method were compared to vertical column density (VCD) gathered by the TROPOspheric Monitoring Instrument (TROPOMI). The results from October to November 2023 indicated a fine correlation (R = 0.98) between the daily EMI series data and a fine correlation (R ≥ 0.95) and spatial distribution closely resembling that of the TROPOMI TOCs. Furthermore, the EMI series data fusion results were highly correlated with TROPOMI TOCs (R = 0.99). Since the EMI series instruments had two different overpass times and the volume of available data at same pixel was increased by approximately three-fold, the temporal and spatial resolution was improved a lot. The results indicated that, compared to a single sensor, the EMI series DOAS TOCs generated more accurate and stable global TOC results and also enabled looking at the changes in the intraday TOCs. These outcomes highlight the potential of the EMI instruments for reliably monitoring the ozone variations in polar regions. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
45. Similarity-based multimodal regression.
- Author
-
Chen, Andrew A, Weinstein, Sarah M, Adebimpe, Azeez, Gur, Ruben C, Gur, Raquel E, Merikangas, Kathleen R, Satterthwaite, Theodore D, Shinohara, Russell T, and Shou, Haochang
- Subjects
- *
MOBILE health , *HUMAN phenotype , *MULTISENSOR data fusion , *PHYSICAL activity , *MEDICAL statistics - Abstract
To better understand complex human phenotypes, large-scale studies have increasingly collected multiple data modalities across domains such as imaging, mobile health, and physical activity. The properties of each data type often differ substantially and require either separate analyses or extensive processing to obtain comparable features for a combined analysis. Multimodal data fusion enables certain analyses on matrix-valued and vector-valued data, but it generally cannot integrate modalities of different dimensions and data structures. For a single data modality, multivariate distance matrix regression provides a distance-based framework for regression accommodating a wide range of data types. However, no distance-based method exists to handle multiple complementary types of data. We propose a novel distance-based regression model, which we refer to as Similarity-based Multimodal Regression (SiMMR), that enables simultaneous regression of multiple modalities through their distance profiles. We demonstrate through simulation, imaging studies, and longitudinal mobile health analyses that our proposed method can detect associations between clinical variables and multimodal data of differing properties and dimensionalities, even with modest sample sizes. We perform experiments to evaluate several different test statistics and provide recommendations for applying our method across a broad range of scenarios. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
46. Crop stress detection from UAVs: best practices and lessons learned for exploiting sensor synergies.
- Author
-
Chakhvashvili, Erekle, Machwitz, Miriam, Antala, Michal, Rozenstein, Offer, Prikaziuk, Egor, Schlerf, Martin, Naethe, Paul, Wan, Quanxing, Komárek, Jan, Klouek, Tomáš, Wieneke, Sebastian, Siegmann, Bastian, Kefauver, Shawn, Kycko, Marlena, Balde, Hamadou, Paz, Veronica Sobejano, Jimenez-Berni, Jose A., Buddenbaum, Henning, Hänchen, Lorenz, and Wang, Na
- Subjects
- *
SUSTAINABILITY , *OPTICAL sensors , *AGRICULTURAL productivity , *MULTISENSOR data fusion , *METEOROLOGICAL stations - Abstract
Introduction: Detecting and monitoring crop stress is crucial for ensuring sufficient and sustainable crop production. Recent advancements in unoccupied aerial vehicle (UAV) technology provide a promising approach to map key crop traits indicative of stress. While using single optical sensors mounted on UAVs could be sufficient to monitor crop status in a general sense, implementing multiple sensors that cover various spectral optical domains allow for a more precise characterization of the interactions between crops and biotic or abiotic stressors. Given the novelty of synergistic sensor technology for crop stress detection, standardized procedures outlining their optimal use are currently lacking. Materials and methods: This study explores the key aspects of acquiring high-quality multi-sensor data, including the importance of mission planning, sensor characteristics, and ancillary data. It also details essential data pre-processing steps like atmospheric correction and highlights best practices for data fusion and quality control. Results: Successful multi-sensor data acquisition depends on optimal timing, appropriate sensor calibration, and the use of ancillary data such as ground control points and weather station information. When fusing different sensor data it should be conducted at the level of physical units, with quality flags used to exclude unstable or biased measurements. The paper highlights the importance of using checklists, considering illumination conditions and conducting test flights for the detection of potential pitfalls. Conclusion: Multi-sensor campaigns require careful planning not to jeopardise the success of the campaigns. This paper provides practical information on how to combine different UAV-mounted optical sensors and discuss the proven scientific practices for image data acquisition and post-processing in the context of crop stress monitoring. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
47. Accuracy of manual and artificial intelligence‐based superimposition of cone‐beam computed tomography with digital scan data, utilizing an implant planning software: A randomized clinical study.
- Author
-
Ntovas, Panagiotis, Marchand, Laurent, Finkelman, Matthew, Revilla‐León, Marta, and Att, Wael
- Subjects
- *
CONE beam computed tomography , *ARTIFICIAL intelligence , *MULTISENSOR data fusion , *DEEP learning , *LENGTH measurement - Abstract
Objectives: To investigate the accuracy of conventional and automatic artificial intelligence (AI)‐based registration of cone‐beam computed tomography (CBCT) with intraoral scans and to evaluate the impact of user's experience, restoration artifact, number of missing teeth, and free‐ended edentulous area. Materials and Methods: Three initial registrations were performed for each of the 150 randomly selected patients, in an implant planning software: one from an experienced user, one from an inexperienced operator, and one from a randomly selected post‐graduate student of implant dentistry. Six more registrations were performed for each dataset by the experienced clinician: implementing a manual or an automatic refinement, selecting 3 small or 3 large in‐diameter surface areas and using multiple small or multiple large in‐diameter surface areas. Finally, an automatic AI‐driven registration was performed, using the AI tools that were integrated into the utilized implant planning software. The accuracy between each type of registration was measured using linear measurements between anatomical landmarks in metrology software. Results: Fully automatic‐based AI registration was not significantly different from the conventional methods tested for patients without restorations. In the presence of multiple restoration artifacts, user's experience was important for an accurate registration. Registrations' accuracy was affected by the number of free‐ended edentulous areas, but not by the absolute number of missing teeth (p <.0083). Conclusions: In the absence of imaging artifacts, automated AI‐based registration of CBCT data and model scan data can be as accurate as conventional superimposition methods. The number and size of selected superimposition areas should be individually chosen depending on each clinical situation. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
48. Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system.
- Author
-
Ernst, Dominik, Vogel, Sören, Neumann, Ingo, and Alkhatib, Hamza
- Subjects
- *
OPTICAL radar , *LIDAR , *LASER measurement , *KALMAN filtering , *MULTISENSOR data fusion - Abstract
Kinematic multi-sensor systems (MSS) describe their movements through six-degree-of-freedom trajectories, which are often evaluated primarily for accuracy. However, understanding their self-reported uncertainty is crucial, especially when operating in diverse environments like urban, industrial, or natural settings. This is important, so the following algorithms can provide correct and safe decisions, i.e. for autonomous driving. In the context of localization, light detection and ranging sensors (LiDARs) are widely applied for tasks such as generating, updating, and integrating information from maps supporting other sensors to estimate trajectories. However, popular low-cost LiDARs deviate from other geodetic sensors in their uncertainty modeling. This paper therefore demonstrates the uncertainty evaluation of a LiDAR-based MSS localizing itself using an inertial measurement unit (IMU) and matching LiDAR observations to a known map. The necessary steps for accomplishing the sensor data fusion in a novel Error State Kalman filter (ESKF) will be presented considering the influences of the sensor uncertainties and their combination. The results provide new insights into the impact of random and systematic deviations resulting from parameters and their uncertainties established in prior calibrations. The evaluation is done using the Mahalanobis distance to consider the deviations of the trajectory from the ground truth weighted by the self-reported uncertainty, and to evaluate the consistency in hypothesis testing. The evaluation is performed using a real data set obtained from an MSS consisting of a tactical grade IMU and a Velodyne Puck in combination with reference data by a Laser Tracker in a laboratory environment. The data set consists of measurements for calibrations and multiple kinematic experiments. In the first step, the data set is simulated based on the Laser Tracker measurements to provide a baseline for the results under assumed perfect corrections. In comparison, the results using a more realistic simulated data set and the real IMU and LiDAR measurements provide deviations about a factor of five higher leading to an inconsistent estimation. The results offer insights into the open challenges related to the assumptions for integrating low-cost LiDARs in MSSs. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
49. Feasibility study on discrimination of Polygonatum kingianum origins by NIR and MIR spectra data.
- Author
-
Wang, Yue and Wang, Yuanzhong
- Subjects
- *
MACHINE learning , *CONVOLUTIONAL neural networks , *BIOLOGICAL evolution , *MULTISENSOR data fusion , *INFRARED spectroscopy - Abstract
Most existing studies have focused on identifying the origin of species with protected geographical indications while neglecting to determine the proximate geographical origin of different species. In this study, we investigated the feasibility of using near‐ and mid‐infrared spectroscopy to identify the origin of 156
Polygonatum kingianum samples from six regions in Yunnan, China. In this work, spectral images of different modes reveal more information about theP. kingianum . Comparing the performance of traditional machine learning models according to single spectrum and data fusion, the middle‐level data fusion‐principal component model has the best performance, and its sensitivity, specificity, and accuracy are all 1, and the model has the least number of variables. The residual convolutional neural network (ResNet) model constructed in the 1050–850 cm−1 band confirms that fewer variables are beneficial in improving the accuracy of the model. In conclusion, this study verifies the feasibility of the proposed strategy and establishes a practical model to determine the source ofP. kingianum . [ABSTRACT FROM AUTHOR]- Published
- 2024
- Full Text
- View/download PDF
50. Freeway crash risk prediction considering unobserved heterogeneity: A random effect negative binomial regression approach.
- Author
-
Cheng, Zeyang, Yao, Xinpeng, Bao, Yiman, Li, Yiming, Feng, Zhongxiang, and Wang, Zijian
- Subjects
- *
RANDOM effects model , *TRAFFIC flow , *REGRESSION analysis , *MULTISENSOR data fusion , *PREDICTION models - Abstract
Unobserved heterogeneity of crashes remains a significant issue for freeways that influence crash prediction, and therefore deserves much attention. Using a fusion data set of crash data, driving behavior data, and traffic flow data, this study explores the spatiotemporal heterogeneity of crash determinants for different freeway segments (e.g. Yixing section and Liyang section of Ning-Hang freeway of China) and then predict the crash probability. A random effect negative binomial regression model is built to investigate the contributing factors of the crashes. Remarkable differences are observed in the crash determinants for Yixing section (include average vehicle speed, hourly average traffic volume, average free speed, road segment length, and number of left lane-merging) and Liyang section (include average intensity of aggressive driving behavior, average kilometer traffic volume). The results found the traffic flow has a more significant impact on crashes than the driving behaviors. It is found that the crash probability is a monotone decreasing function when the predicted number of crash is 0. With the increase of the number of predicted crash, the crash probability gradually converges from a large value to 0. Then the probability of other predicted number of crashes (e.g. crash = 1, crash = 2, crash = 3) presents a quadratic parabola trends. The model comparison demonstrates that the proposed model outperforms conventional model, and the prediction performance for Liyang section is better than that of Yixing section. The research findings are interesting and important for preventing crashes. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.