Search

The differences in sensor imaging mechanisms, observation angles, and scattering characteristics of terrestrial objects significantly limit the registration performance of synthetic aperture radar (SAR) and optical heterologous images. Traditional methods particularly struggle in weak feature regions, such as harbors and islands with substantial water coverage, as well as in desolate areas like deserts. This paper introduces a robust heterologous image registration technique based on region-adaptive keypoint selection that integrates image texture features, targeting two pivotal aspects: feature point extraction and matching point screening. Initially, a dual threshold criterion based on block region information entropy and variance products effectively identifies weak feature regions. Subsequently, it constructs feature descriptors to generate similarity maps, combining histogram parameter skewness with non-maximum suppression (NMS) to enhance matching point accuracy. Extensive experiments have been conducted on conventional SAR-optical datasets and typical SAR-optical images with different weak feature regions to assess the method's performance. The findings indicate that this method successfully removes outliers in weak feature regions and completes the registration task of SAR and optical images with weak feature regions. [ABSTRACT FROM AUTHOR]

Finding patches is a crucial step in a pavement performance survey. The study develops a machine learning and image processing algorithm-established automatic method for identifying asphalt pavement patches. The GrayLevel Co-Occurrence Matrix and image texture-based features derived from color channel statistics are used as input parameters to describe the condition of the pavement. For feature extraction, image processing methods like the projective integral of images, steerable filters, and an improved image thresholding method were used. Support Vector Machine is employed for categorizing the differentiating patched regions from non-patch ones. The suggested combination of image texture analytical methods has been trained using an IA data set created from 400 image samples. The feature set, which combines the characteristics of cracked objects with those generated from the projective integral, can produce the desired result. To make the model's execution simpler, a patch recognition program was created and implemented in MATLAB. As a result, the recently created method has the potential to be an instrument for traffic management organizations through the assessment of pavement performance. The results of the experiments indicate that the newly developed method may achieve excellent accuracy prediction results with a classifier performance rate of about 96%. Such a method could enable transportation authorities to assess the state of asphalt pavement. [ABSTRACT FROM AUTHOR]

Cardiac magnetic resonance imaging (MRI) usually requires a long acquisition time. The movement of the patients during MRI acquisition will produce image artifacts. Previous studies have shown that clear MR image texture edges are of great significance for pathological diagnosis. In this paper, a motion artifact reduction method for cardiac MRI based on edge enhancement network is proposed. Firstly, the four-plane normal vector adaptive fractional differential mask is applied to extract the edge features of blurred images. The four-plane normal vector method can reduce the noise information in the edge feature maps. The adaptive fractional order is selected according to the normal mean gradient and the local Gaussian curvature entropy of the images. Secondly, the extracted edge feature maps and blurred images are input into the de-artifact network. In this network, the edge fusion feature extraction network and the edge fusion transformer network are specially designed. The former combines the edge feature maps with the fuzzy feature maps to extract the edge feature information. The latter combines the edge attention network and the fuzzy attention network, which can focus on the blurred image edges. Finally, extensive experiments show that the proposed method can obtain higher peak signal-to-noise ratio and structural similarity index measure compared to state-of-art methods. The de-artifact images have clear texture edges. [ABSTRACT FROM AUTHOR]

Faced with the problem of incompatibility between traditional information acquisition mode and spaceborne earth observation tasks, starting from the general mathematical model of compressed sensing, a theoretical model of block compressed sensing was established, and a full-process adaptive coding and decoding compressed sensing framework for remote sensing images was proposed, which includes five parts: mode selection, feature factor extraction, adaptive shape segmentation, adaptive sampling rate allocation and image reconstruction. Unlike previous semi-adaptive or local adaptive methods, the advantages of the adaptive encoding and decoding method proposed in this paper are mainly reflected in four aspects: (1) Ability to select encoding modes based on image content, and maximizing the use of the richness of the image to select appropriate sampling methods; (2) Capable of utilizing image texture details for adaptive segmentation, effectively separating complex and smooth regions; (3) Being able to detect the sparsity of encoding blocks and adaptively allocate sampling rates to fully explore the compressibility of images; (4) The reconstruction matrix can be adaptively selected based on the size of the encoding block to alleviate block artifacts caused by non-stationary characteristics of the image. Experimental results show that the method proposed in this article has good stability for remote sensing images with complex edge textures, with the peak signal-to-noise ratio and structural similarity remaining above 35 dB and 0.8. Moreover, especially for ocean images with relatively simple image content, when the sampling rate is 0.26, the peak signal-to-noise ratio reaches 50.8 dB, and the structural similarity is 0.99. In addition, the recovered images have the smallest BRISQUE value, with better clarity and less distortion. In the subjective aspect, the reconstructed image has clear edge details and good reconstruction effect, while the block effect is effectively suppressed. The framework designed in this paper is superior to similar algorithms in both subjective visual and objective evaluation indexes, which is of great significance for alleviating the incompatibility between traditional information acquisition methods and satellite-borne earth observation missions. [ABSTRACT FROM AUTHOR]

The utilisation of magnetic resonance imaging (MRI) images for the automated detection of Alzheimer's disease has garnered significant attention in recent years. This interest stems from the progress made in machine learning techniques and the possible application of such methods in the field of diagnostics. This study aims to evaluate the performance of 16 histogram-based image texture descriptors and features extracted from 18 pre-trained convolutional neural networks in characterising brain patterns observed in 2D slices of MRI images. The primary objective is to determine the most effective feature types for this task. The characteristics were taken from the magnetic resonance imaging (MRI) dataset given by the Alzheimer's Disease Neuroimaging Initiative (ADNI). The study involved the calculation of features on 2D axial, coronal, and sagittal slices, followed by classification using five binary machine learning algorithms. The objective was to differentiate between individuals with normal cognitive function and those diagnosed with Alzheimer's disease. The proposed methodology additionally facilitated the identification of specific brain areas to be selected for each axis, in order to achieve optimal accuracy. This involved determining the matching feature and classifier combinations. [ABSTRACT FROM AUTHOR]

Current image feature extraction methods fail to adapt to the fine features of apple image texture, resulting in image matching errors and degraded image processing accuracy. A multi-view orthogonal image acquisition system was constructed with apples as the research object. The system consists of four industrial cameras placed around the apple at different angles and one camera placed on top. Following the image acquisition through the system, synthetic image pairs—both before and after transformation—were generated as the input dataset. This generation process involved each image being subjected to random transformations. Through learning to extract more distinctive and descriptive features, the deep learning-based keypoint detection method surpasses traditional techniques by broadening the application range and enhancing detection accuracy. Therefore, a lightweight network called ALIKE-APPLE was proposed for surface feature point detection. The baseline model for ALIKE-APPLE is ALIKE, upon which improvements have been made to the image feature encoder and feature aggregation modules. It comprises an Improved Convolutional Attention Module (ICBAM) and a Boosting Resolution Sampling Module (BRSM). The proposed ICBAM replaced max pooling in the original image feature encoder for downsampling. It enhanced the feature fusion capability of the model by utilizing spatial contextual information and learning region associations in the image. The proposed BRSM replaced the bilinear interpolation in the original feature aggregator for upsampling, overcoming the apple side image's geometric distortion and effectively preserving the texture details and edge information. The model size was shrunk by optimizing the number of downsampling operations from the image encoder of the original model. The experimental results showed that the average number of observed keypoints and the average matching accuracy were improved by 166.41% and 37.07%, respectively, compared with the baseline model. The feature detection model of ALIKE-APPLE was found to perform better than the optimal SuperPoint. The feature point distribution of ALIKE-APPLE showed an improvement of 10.29% in average standard deviation (Std), 8.62% in average coefficient of variation (CV), and 156.12% in average feature point density (AFPD). Moreover, the mean matching accuracy (MMA) of ALIKE-APPLE improved by 125.97%. Thus, ALIKE-APPLE boasts a more consistent allocation of feature points and greater precision in matching. [ABSTRACT FROM AUTHOR]

To obtain timely, accurate, and reliable information on wheat yield dynamics. The UAV DJI Wizard 4-multispectral version was utilized to acquire multispectral images of winter wheat during the tasseling, grouting, and ripening periods, and to manually acquire ground yield data. Sixteen vegetation indices were screened by correlation analysis, and eight textural features were extracted from five single bands in three fertility periods. Subsequently, models for estimating winter wheat yield were developed utilizing multiple linear regression (MLR), partial least squares (PLS), BP neural network (BPNN), and random forest regression (RF), respectively. (1) The results indicated a consistent correlation between the two variable types and yield across various fertility periods. This correlation consistently followed a sequence: heading period > filling period > mature stage. (2) The model's accuracy improves significantly when incorporating both texture features and vegetation indices for estimation, surpassing the accuracy achieved through the estimation of a single variable type. (3) Among the various models considered, the partial least squares (PLS) model integrating texture features and vegetation indices exhibited the highest accuracy in estimating winter wheat yield. It achieved a coefficient of determination (R2) of 0.852, a root mean square error (RMSE) of 74.469 kg·hm−2, and a normalized root mean square error (NRMSE) of 7.41%. This study validates the significance of utilizing image texture features along with vegetation indices to enhance the accuracy of models estimating winter wheat yield. It demonstrates that UAV multispectral images can effectively establish a yield estimation model. Combining vegetation indices and texture features results in a more accurate and predictive model compared to using a single index. [ABSTRACT FROM AUTHOR]

Sentiment analysis is a key component of many social media analysis projects. Additionally, prior research has concentrated on a single modality in particular, such as text descriptions for visual information. In contrast to standard image databases, social images frequently connect to one another, making sentiment analysis challenging. The majority of methods now in use consider different images individually, rendering them useless for interrelated images. We proposed a hybrid Arithmetic Optimization Algorithm- Hunger Games Search (AOA-HGS)-optimized Ensemble Multi-scale Residual Attention Network (EMRA-Net) technique in this paper to explore the modal correlations including texts, audio, social links, and video for more effective multimodal sentiment analysis. The hybrid AOA-HGS technique learns complementary and comprehensive features. The EMRA-Net uses two segments, including Ensemble Attention CNN (EA-CNN) and Three-scale Residual Attention Convolutional Neural Network (TRA-CNN), to analyze the multimodal sentiments. The loss of spatial domain image texture features can be reduced by adding the Wavelet transform to TRA-CNN. The feature-level fusion technique known as EA-CNN is used to combine visual, audio, and textual information. The proposed method performs significantly better than the existing multimodel sentimental analysis techniques of HALCB, HDF, and MMLatch when evaluated using the Multimodal Emotion Lines Dataset (MELD) and EmoryNLP datasets. Also, even though the size of the training set varies, the proposed method outperformed other techniques in terms of recall, accuracy, F score, and precision and takes less time to compute in both datasets. [ABSTRACT FROM AUTHOR]

To ensure the timely detection of safety hazards in transmission lines and to enhance accurately the detection of insulator defects in complicated environments, this study proposes a 3D attention-focused pure convolutional target detection algorithm (CMYOLOv7) based on you only look once v7 (YOLOv7) for defect detection on insulators in complicated environments. Firstly, to address the incapacity of focusing on the target in the backbone feature extraction networks, this study proposes a focused pure convolutional feature extraction module (ConvSimCB) to enhance the extraction and focus capability on insulator defect features. Secondly, to solve the problem of loss of key detail feature information caused by maximum pooling in spatial pyramid pooling module (SPPCSPC), this study proposes a mixed spatial pyramid pooling module (MIXPCSPC) to retain abundant image texture detail information and increase accuracy in detection of tiny insulator defects. Finally, a lightweight generic upsampling operator (CARAFE) is introduced to enhance the feature map resolution to address image distortion caused by the Nearest Neighbor Method of upsampling. This study proposed CMYOLOv7 achieves 98.37% precision, 90.59% recall, 95.68% mean average precision (MAP), and 94% F1 score, higher than YOLOv7 by 0.61%, 8.64%, 5.41%, and 5%. [ABSTRACT FROM AUTHOR]

The fusion of infrared and visible images aims to extract and fuse thermal target information and texture details to the fullest extent possible, enhancing the visual understanding capabilities of images for both humans and computers in complex scenes. However, existing methods have difficulties in preserving the comprehensiveness of source image feature information and enhancing the saliency of image texture information. Therefore, we put forward a novel infrared and visible image fusion algorithm based on global information-enhanced attention network (GIEA). Specifically, we develop an attention-guided Transformer module (AGTM) to make sure the fused images have enough global information. This module combines the convolutional neural network and Transformer to perform adequate feature extraction from shallow to deep layers, and utilize the attention network for multi-level feature-guided learning. Then, we build the contrast enhancement module (CENM), which enhances the feature representation and contrast of the image so that the fused image contains significant texture information. Furthermore, our network is driven to fully preserve the texture and structure details of the source images with a loss function that consists of content loss and total variance loss. Numerous experiments demonstrate that our fusion approach outperforms other fusion approaches in both subjective and objective assessments. • Combining CNN and Transformer to fully extract complementary features. • Designed an attention network for multi-level feature learning. • Designed a contrast enhancement module to enhance feature saliency. [ABSTRACT FROM AUTHOR]

Structural features are capable of effectively capturing the overall texture variations in images. However, in locally prominent areas with visible veins, other characteristics such as directionality, convexity–concavity, and curvature also play a crucial role in recognition, and their impact cannot be overlooked. This paper introduces a novel approach, the histogram of variable curvature directional binary statistical (HVCDBS), which combines the structural and directional features of images. The proposed method is designed for extracting discriminative multifeature information in vein recognition. First, a multidirection and multicurvature Gabor filter is introduced for convolution with vein images, yielding directional and convexity–concavity information at each pixel, along with curvature information for the corresponding curve. Simultaneously incorporating the original image feature information, these four aspects of information are fused and encoded to construct a variable curvature binary pattern (VCBP) with multifeatures. Second, the feature map containing multifeature information is blockwise processed to build variable curvature binary statistical features. Finally, competitive Gabor directional binary statistical features are combined, and a matching score‐level fusion scheme is employed based on maximizing the interclass distance and minimizing the intraclass distance to determine the optimal weights. This process fuses the two feature maps into a one‐dimensional feature vector, achieving an effective representation of vein images. Extensive experiments were conducted on four widely utilized vein databases, and the results indicate that the proposed algorithm, compared with solely extraction of structural features, achieved higher recognition rates and lower equal error rates. [ABSTRACT FROM AUTHOR]

Introduction: Mechanical damage significantly reduces the market value of fruits, making the early detection of such damage a critical aspect of agricultural management. This study focuses on the early detection of mechanical damage in blueberries (variety: Sapphire) through a non-destructive method. Methods: The proposed method integrates hyperspectral image fusion with a multi-strategy improved support vector machine (SVM) model. Initially, spectral features and image features were extracted from the hyperspectral information using the successive projections algorithm (SPA) and Grey Level Co-occurrence Matrix (GLCM), respectively. Different models including SVM, RF (Random Forest), and PLS-DA (Partial Least Squares Discriminant Analysis) were developed based on the extracted features. To refine the SVM model, its hyperparameters were optimized using a multi-strategy improved Beluga Whale Optimization (BWO) algorithm. Results: The SVM model, upon optimization with the multi-strategy improved BWO algorithm, demonstrated superior performance, achieving the highest classification accuracy among the models tested. The optimized SVM model achieved a classification accuracy of 95.00% on the test set. Discussion: The integration of hyperspectral image information through feature fusion proved highly efficient for the early detection of bruising in blueberries. However, the effectiveness of this technology is contingent upon specific conditions in the detection environment, such as light intensity and temperature. The high accuracy of the optimized SVM model underscores its potential utility in post-harvest assessment of blueberries for early detection of bruising. Despite these promising results, further studies are needed to validate the model under varying environmental conditions and to explore its applicability to other fruit varieties. [ABSTRACT FROM AUTHOR]

Objective: The purpose of this study was to determine and compare the performance of pre-treatment clinical risk score (CRS), radiomics models based on computed (CT), and their combination for predicting time to recurrence (TTR) and disease-specific survival (DSS) in patients with colorectal cancer liver metastases. Methods: We retrospectively analyzed a prospectively maintained registry of 241 patients treated with systemic chemotherapy and surgery for colorectal cancer liver metastases. Radiomics features were extracted from baseline, pre-treatment, contrast-enhanced CT images. Multiple aggregation strategies were investigated for cases with multiple metastases. Radiomics signatures were derived using feature selection methods. Random survival forests (RSF) and neural network survival models (DeepSurv) based on radiomics features, alone or combined with CRS, were developed to predict TTR and DSS. Leveraging survival models predictions, classification models were trained to predict TTR within 18 months and DSS within 3 years. Classification performance was assessed with area under the receiver operating characteristic curve (AUC) on the test set. Results: For TTR prediction, the concordance index (95% confidence interval) was 0.57 (0.57–0.57) for CRS, 0.61 (0.60–0.61) for RSF in combination with CRS, and 0.70 (0.68–0.73) for DeepSurv in combination with CRS. For DSS prediction, the concordance index was 0.59 (0.59–0.59) for CRS, 0.57 (0.56–0.57) for RSF in combination with CRS, and 0.60 (0.58–0.61) for DeepSurv in combination with CRS. For TTR classification, the AUC was 0.33 (0.33–0.33) for CRS, 0.77 (0.75–0.78) for radiomics signature alone, and 0.58 (0.57–0.59) for DeepSurv score alone. For DSS classification, the AUC was 0.61 (0.61–0.61) for CRS, 0.57 (0.56–0.57) for radiomics signature, and 0.75 (0.74–0.76) for DeepSurv score alone. Conclusion: Radiomics-based survival models outperformed CRS for TTR prediction. More accurate, noninvasive, and early prediction of patient outcome may help reduce exposure to ineffective yet toxic chemotherapy or high-risk major hepatectomies. [ABSTRACT FROM AUTHOR]

Breast cancer is one of the major health issues with high mortality rates and a substantial impact on patients and healthcare systems worldwide. Various Computer-Aided Diagnosis (CAD) tools, based on breast thermograms, have been developed for early detection of this disease. However, accurately segmenting the Region of Interest (ROI) from thermograms remains challenging. This paper presents an approach that leverages image acquisition protocol parameters to identify the lateral breast region and estimate its bottom boundary using a second-degree polynomial. The proposed method demonstrated high efficacy, achieving an impressive Jaccard coefficient of 86% and a Dice index of 92% when evaluated against manually created ground truths. Textural features were extracted from each view's ROI, with significant features selected via Mutual Information for training Multi-Layer Perceptron (MLP) and K-Nearest Neighbors (KNN) classifiers. Our findings revealed that the MLP classifier outperformed the KNN, achieving an accuracy of 86%, a specificity of 100%, and an Area Under the Curve (AUC) of 0.85. The consistency of the method across both sides of the breast suggests its viability as an auto-segmentation tool. Furthermore, the classification results suggests that lateral views of breast thermograms harbor valuable features that can significantly aid in the early detection of breast cancer. [ABSTRACT FROM AUTHOR]

Background: The rarity of primary central nervous system lymphoma (PCNSL) and treatment heterogeneity contributes to a lack of prognostic models for evaluating posttreatment remission. This study aimed to develop and validate radiomic‐based models to predict the durable response (DR) to high‐dose methotrexate (HD‐MTX)‐based chemotherapy in PCNSL patients. Methods: A total of 159 patients pathologically diagnosed with PCNSL between 2011 and 2021 across two institutions were enrolled. According to the NCCN guidelines, the DR was defined as the remission lasting ≥1 year after receiving HD‐MTX‐based chemotherapy. For each patient, a total of 1218 radiomic features were extracted from prebiopsy T1 contrast‐enhanced MR images. Multiple machine‐learning algorithms were utilized for feature selection and classification to build a radiomic signature. The radiomic‐clinical integrated models were developed using the random forest method. Model performance was externally validated to verify its clinical utility. Results: A total of 105 PCNSL patients were enrolled after excluding 54 cases with ineligibility. The training and validation cohorts comprised 76 and 29 individuals, respectively. Among them, 65 patients achieved DR. The radiomic signature, consisting of 8 selected features, demonstrated strong predictive performance, with area under the curves of 0.994 in training cohort and 0.913 in validation cohort. This signature was independently associated with the DR in both cohorts. Both the radiomic signature and integrated models significantly outperformed the clinical models in two cohorts. Decision curve analysis underscored the clinical utility of the established models. Conclusions: This radiomic signature and integrated models have the potential to accurately predict the DR to HD‐MTX‐based chemotherapy in PCNSL patients, providing valuable therapeutic insights. [ABSTRACT FROM AUTHOR]

Proximate analysis, including ash, volatile matter, moisture, fixed carbon, and calorific value, is a fundamental aspect of fuel testing and serves as the primary method for evaluating coal quality, which is critical for the processing and utilization of coal. The traditional analytical methods involve time-consuming and costly combustion processes, particularly when applied to large volumes of coal that need to be sampled in massive batches. Hyperspectral imaging is promising for the rapid and nondestructive determination of coal quality indices. In this study, a fast and nondestructive coal proximate analysis method with combined spectral-spatial features was developed using a hyperspectral imaging system in the 450–2500 nm range. The processed spectra were evaluated using PLSR, with the most effective MSC spectra selected. To reduce the spectral redundancy and improve the accuracy, the SPA, Boruta, iVISSA, and CARS algorithms were adopted to extract the characteristic wavelengths, and 16 prediction models were constructed and optimized based on the PLSR, RF, BPNN, and LSSVR algorithms within the Optuna framework for each quality indicator. For spatial information, the histogram statistics, gray-level covariance matrix, and Gabor filters were employed to extract the texture features within the characteristic wavelengths. The texture feature-based and combined spectral-texture feature-based prediction models were constructed by applying the spectral modeling strategy, respectively. Compared with the models based on spectral or texture features only, the LSSVR models with combined spectral-texture features achieved the highest prediction accuracy in all quality metrics, with R p 2 values of 0.993, 0.989, 0.979, 0.948, and 0.994 for Ash, VM, MC, FC, and CV, respectively. This study provides a technical reference for hyperspectral imaging technology as a new method for the rapid, nondestructive proximate analysis and quality assessment of coal. [ABSTRACT FROM AUTHOR]

Single-image super-resolution (SISR) seeks to elucidate the mapping relationships between low-resolution and high-resolution images. However, high-performance network models often entail a significant number of parameters and computations, presenting limitations in practical applications. Therefore, prioritizing a light weight and efficiency becomes crucial when applying image super-resolution (SR) to real-world scenarios. We propose a straightforward and efficient method, the Multi-Branch Feature Extraction Residual Network (MFERN), to tackle lightweight image SR through the fusion of multi-information self-calibration and multi-attention information. Specifically, we have devised a Multi-Branch Residual Feature Fusion Module (MRFFM) that leverages a multi-branch residual structure to succinctly and effectively fuse multiple pieces of information. Within the MRFFM, we have designed the Multi-Scale Attention Feature Fusion Block (MAFFB) to adeptly extract features via convolution and self-calibration attention operations. Furthermore, we introduce a Dual Feature Calibration Block (DFCB) to dynamically fuse feature information using dynamic weight values derived from the upper and lower branches. Additionally, to overcome the limitation of convolution in solely extracting local information, we incorporate a Transformer module to effectively integrate global information. The experimental results demonstrate that our MFERN exhibits outstanding performance in terms of model parameters and overall performance. [ABSTRACT FROM AUTHOR]

Entomological radar is one of the most effective tools for monitoring insect migration, capable of detecting migratory insects concentrated in layers and facilitating the analysis of insect migration behavior. However, traditional entomological radar, with its low resolution, can only provide a rough observation of layer concentrations. The advent of High-Resolution Phased Array Radar (HPAR) has transformed this situation. With its high range resolution and high data update rate, HPAR can generate detailed concentration spatiotemporal distribution heatmaps. This technology facilitates the detection of changes in insect concentrations across different time periods and altitudes, thereby enabling the observation of large-scale take-off, landing, and layering phenomena. However, the lack of effective techniques for extracting insect concentration data of different phenomena from these heatmaps significantly limits detailed analyses of insect migration patterns. This paper is the first to apply instance segmentation technology to the extraction of insect data, proposing a method for segmenting and extracting insect concentration data from spatiotemporal distribution heatmaps at different phenomena. To address the characteristics of concentrations in spatiotemporal distributions, we developed the Heatmap Feature Fusion Network (HFF-Net). In HFF-Net, we incorporate the Global Context (GC) module to enhance feature extraction of concentration distributions, utilize the Atrous Spatial Pyramid Pooling with Depthwise Separable Convolution (SASPP) module to extend the receptive field for understanding various spatiotemporal distributions of concentrations, and refine segmentation masks with the Deformable Convolution Mask Fusion (DCMF) module to enhance segmentation detail. Experimental results show that our proposed network can effectively segment concentrations of different phenomena from heatmaps, providing technical support for detailed and systematic studies of insect migration behavior. [ABSTRACT FROM AUTHOR]

With the development of image feature matching technology, feature matching algorithms based on deep learning have achieved excellent results, but in scenarios with low texture or extreme perspective changes, the matching accuracy is still difficult to guarantee. In this paper, a superresolution reconstruction method based on a Residual-ESPCN (efficient subpixel convolutional neural network) approach is proposed based on LoFTR (local feature matching with transformers). The superresolution method is used to improve the interpolation method used in ASFF (adaptive spatial feature fusion) to increase the image resolution, enhance the detailed information of the image, and make the extracted features richer. Then, ASFF is introduced into the local feature extraction module of LoFTR, which can alleviate the inconsistency problem of information transmission between different scale features of the feature pyramid and lessen the amount of information lost during transmission from low- to high-resolution levels. Moreover, to improve the adaptability of the algorithm to different scenarios, OTSU is introduced to adaptively calculate the threshold of feature matching. The experimental results show that in different indoor or outdoor scenarios, our proposed algorithm for matching features can effectively improve the adaptability of feature matching and can achieve good results in terms of the area under the curve (AUC), accuracy and recall. [ABSTRACT FROM AUTHOR]

The feature extraction and analysis of gymnastics images is an essential foundation for estimating human posture. The primary step is to obtain various joint points of athletes based on basic information such as human texture and contour in the sports images. The reconstruction and analysis of the human skeleton is completed based on the feature data of the joint points. In this process, traditional algorithm models often have certain shortcomings in the accuracy of feature extraction for motion images. This paper combines multi-scale feature fusion algorithms to construct a gymnastics motion image feature extraction model, which can achieve more accurate and efficient analysis and research for the feature extraction process of motion images, further improving the detection accuracy of joint points in motion images; this lays an essential foundation for feature extraction of gymnastics images. At the same time, it also provides more methods for skeleton reconstruction based on image feature information during the motion process, improving the efficiency and accuracy of reconstruction. [ABSTRACT FROM AUTHOR]

Background: Vascular invasion (VI) is closely related to the metastasis, recurrence, prognosis, and treatment of gastric cancer. Currently, predicting VI preoperatively using traditional clinical examinations alone remains challenging. This study aims to explore the value of radiomics analysis based on preoperative enhanced CT images in predicting VI in gastric cancer. Methods: We retrospectively analyzed 194 patients with gastric adenocarcinoma who underwent enhanced CT examination. Based on pathology analysis, patients were divided into the VI group (n = 43) and the non-VI group (n = 151). Radiomics features were extracted from arterial phase (AP) and portal venous phase (PP) CT images. The radiomics score (Rad-score) was then calculated. Prediction models based on image features, clinical factors, and a combination of both were constructed. The diagnostic efficiency and clinical usefulness of the models were evaluated using receiver operating characteristic (ROC) curves and decision curve analysis (DCA). Results: The combined prediction model included the Rad-score of AP, the Rad-score of PP, Ki-67, and Lauren classification. In the training group, the area under the curve (AUC) of the combined prediction model was 0.83 (95% CI 0.76–0.89), with a sensitivity of 64.52% and a specificity of 92.45%. In the validation group, the AUC was 0.80 (95% CI 0.67–0.89), with a sensitivity of 66.67% and a specificity of 88.89%. DCA indicated that the combined prediction model might have a greater net clinical benefit than the clinical model alone. Conclusion: The integrated models, incorporating enhanced CT radiomics features, Ki-67, and clinical factors, demonstrate significant predictive capability for VI. Moreover, the radiomics model has the potential to optimize personalized clinical treatment selection and patient prognosis assessment. [ABSTRACT FROM AUTHOR]

Camellia oleifera is a crop of high economic value, yet it is particularly susceptible to various diseases and pests that significantly reduce its yield and quality. Consequently, the precise segmentation and classification of diseased Camellia leaves are vital for managing pests and diseases effectively. Deep learning exhibits significant advantages in the segmentation of plant diseases and pests, particularly in complex image processing and automated feature extraction. However, when employing single-modal models to segment Camellia oleifera diseases, three critical challenges arise: (A) lesions may closely resemble the colors of the complex background; (B) small sections of diseased leaves overlap; (C) the presence of multiple diseases on a single leaf. These factors considerably hinder segmentation accuracy. A novel multimodal model, CNN–Transformer Dual U-shaped Network (CTDUNet), based on a CNN–Transformer architecture, has been proposed to integrate image and text information. This model first utilizes text data to address the shortcomings of single-modal image features, enhancing its ability to distinguish lesions from environmental characteristics, even under conditions where they closely resemble one another. Additionally, we introduce Coordinate Space Attention (CSA), which focuses on the positional relationships between targets, thereby improving the segmentation of overlapping leaf edges. Furthermore, cross-attention (CA) is employed to align image and text features effectively, preserving local information and enhancing the perception and differentiation of various diseases. The CTDUNet model was evaluated on a self-made multimodal dataset compared against several models, including DeeplabV3+, UNet, PSPNet, Segformer, HrNet, and Language meets Vision Transformer (LViT). The experimental results demonstrate that CTDUNet achieved an mean Intersection over Union (mIoU) of 86.14%, surpassing both multimodal models and the best single-modal model by 3.91% and 5.84%, respectively. Additionally, CTDUNet exhibits high balance in the multi-class segmentation of Camellia oleifera diseases and pests. These results indicate the successful application of fused image and text multimodal information in the segmentation of Camellia disease, achieving outstanding performance. [ABSTRACT FROM AUTHOR]

Industrial anomaly detection is constrained by the scarcity of anomaly samples, limiting the applicability of supervised learning methods. Many studies have focused on anomaly detection by generating anomaly images and adopting self-supervised learning approaches. Leveraging pre-trained networks on ImageNet has been explored to assist in this training process. However, achieving accurate anomaly detection remains time-consuming due to the network's depth and parameter count not being reduced. In this paper, we propose a self-supervised learning method based on Feature Enhancement Patch Distribution Modeling (FEPDM), which generates simulated anomalies. Unlike direct training on the original feature extraction network, our approach utilizes a pre-trained network to extract multi-scale features. By aggregating these multi-scale features, we are able to train at the feature level, thereby adapting more efficiently to various network structures and reducing domain bias with respect to natural image classification. Additionally, it significantly reduces the number of parameters in the training process. Introducing this approach not only enhances the model's generalization ability but also significantly improves the efficiency of anomaly detection. The method was evaluated on MVTec AD and BTAD datasets, and (image-level, pixel-level) AUROC scores of (95.7%, 96.2%), (93.4%, 97.6%) were obtained, respectively. The experimental results have convincingly demonstrated the efficacy of our method in tackling the scarcity of abnormal samples in industrial scenarios, while simultaneously highlighting its broad generalizability. [ABSTRACT FROM AUTHOR]

The coastal zone is abundant in natural resources but has become increasingly fragile in recent years due to climate change and extensive, improper exploitation. Accurate land use and land cover (LULC) mapping of coastal zones using remotely sensed data is crucial for monitoring environmental changes. Traditional classification methods based on statistical learning require significant spectral differences between ground objects. However, state-of-the-art end-to-end deep learning methods can extract advanced features from remotely sensed data. In this study, we employed ResNet50 as the feature extraction network within the U-Net architecture to achieve accurate classification of coastal areas and assess the model's performance. Experiments were conducted using Gaofen-2 (GF-2) high-resolution remote sensing data from Shuangyue Bay, a typical coastal area in Guangdong Province. We compared the classification results with those obtained from two popular deep learning models, SegNet and DeepLab v3+, as well as two advanced statistical learning models, Support Vector Machine (SVM) and Random Forest (RF). Additionally, this study further explored the significance of Gray Level Co-occurrence Matrix (GLCM) texture features, Histogram Contrast (HC) features, and Normalized Difference Vegetation Index (NDVI) features in the classification of coastal areas. The research findings indicated that under complex ground conditions, the U-Net model achieved the highest overall accuracy of 86.32% using only spectral channels from GF-2 remotely sensed data. When incorporating multiple features, including spectrum, texture, contrast, and vegetation index, the classification accuracy of the U-Net algorithm significantly improved to 93.65%. The major contributions of this study are twofold: (1) it demonstrates the advantages of deep learning approaches, particularly the U-Net model, for LULC classification in coastal zones using high-resolution remote sensing images, and (2) it analyzes the contributions of spectral and spatial features of GF-2 data for different land cover types through a spectral and spatial combination method. [ABSTRACT FROM AUTHOR]

In low-light environments, the amount of light captured by the camera sensor is reduced, resulting in lower image brightness. This makes it difficult to recognize or completely lose details in the image, which affects subsequent processing of low-light images. Low-light image enhancement methods can increase image brightness while better-restoring color and detail information. A generative adversarial network is proposed for low-quality image enhancement to improve the quality of low-light images. This network consists of a generative network and an adversarial network. In the generative network, a multi-scale feature extraction module, which consists of dilated convolutions, regular convolutions, max pooling, and average pooling, is designed. This module can extract low-light image features from multiple scales, thereby obtaining richer feature information. Secondly, an illumination attention module is designed to reduce the interference of redundant features. This module assigns greater weight to important illumination features, enabling the network to extract illumination features more effectively. Finally, an encoder-decoder generative network is designed. It uses the multi-scale feature extraction module, illumination attention module, and other conventional modules to enhance low-light images and improve quality. Regarding the adversarial network, a dual-discriminator structure is designed. This network has a global adversarial network and a local adversarial network. They determine if the input image is actual or generated from global and local features, enhancing the performance of the generator network. Additionally, an improved loss function is proposed by introducing color loss and perceptual loss into the conventional loss function. It can better measure the color loss between the generated image and a normally illuminated image, thus reducing color distortion during the enhancement process. The proposed method, along with other methods, is tested using both synthesized and real low-light images. Experimental results show that, compared to other methods, the images enhanced by the proposed method are closer to normally illuminated images for synthetic low-light images. For real low-light images, the images enhanced by the proposed method retain more details, are more apparent, and exhibit higher performance metrics. Overall, compared to other methods, the proposed method demonstrates better image enhancement capabilities for both synthetic and real low-light images. [ABSTRACT FROM AUTHOR]

Suitable and effective matching area selection is crucial for gravity matching‐aided navigation. In this paper, an all‐field extended extremum algorithm based on an adaptive threshold (AT‐AEE) is proposed for matching area selection in the Arctic Sea. The gradient data is obtained by using the convolution of gravity reference graph data and all‐field extended extremum parameters. Then, the adaptive threshold method was employed to determine the optimal gradient threshold based on gravity anomaly data across various test areas. Data points with gradients exceeding the specified threshold are identified as local candidate points for matching areas. The test areas containing a certain proportion of local candidate points are designated as the suitable matching areas. Nine test areas in the Arctic Sea with different gravity change characteristics were chosen for simulation experiments to verify the performance of the proposed algorithm. Simulation experiments showed that superior navigation positioning results could be obtained in the matching areas selected by the AT‐AEE algorithm. Compared to traditional algorithm, the matching areas derived from the AT‐AEE algorithm performed with a better consistency in the gravity matching navigation results. In suitable matching areas with the proportion of local candidate points reaching 70%, the average positioning errors could be reduced to less than 1.5 n miles. [ABSTRACT FROM AUTHOR]

The complementary combination of emphasizing target objects in infrared images and rich texture details in visible images can effectively enhance the information entropy of fused images, thereby providing substantial assistance for downstream composite high-level vision tasks, such as nighttime vehicle intelligent driving. However, mainstream fusion algorithms lack specific research on the contradiction between the low information entropy and high pixel intensity of visible images under harsh light nighttime road environments. As a result, fusion algorithms that perform well in normal conditions can only produce low information entropy fusion images similar to the information distribution of visible images under harsh light interference. In response to these problems, we designed an image fusion network resilient to harsh light environment interference, incorporating entropy and information theory principles to enhance robustness and information retention. Specifically, an edge feature extraction module was designed to extract key edge features of salient targets to optimize fusion information entropy. Additionally, a harsh light environment aware (HLEA) module was proposed to avoid the decrease in fusion image quality caused by the contradiction between low information entropy and high pixel intensity based on the information distribution characteristics of harsh light visible images. Finally, an edge-guided hierarchical fusion (EGHF) module was designed to achieve robust feature fusion, minimizing irrelevant noise entropy and maximizing useful information entropy. Extensive experiments demonstrate that, compared to other advanced algorithms, the method proposed fusion results contain more useful information and have significant advantages in high-level vision tasks under harsh nighttime lighting conditions. [ABSTRACT FROM AUTHOR]

Poplar (Populus L.) anthracnose is an infectious disease that seriously affects the growth and yields of poplar trees, and large-scale poplar infections have led to huge economic losses in the Chinese poplar industry. To efficiently and accurately detect poplar anthracnose for improved prevention and control, this study collected hyperspectral data from the leaves of four types of poplar trees, namely healthy trees and those with black spot disease, early-stage anthracnose, and late-stage anthracnose, and constructed a poplar anthracnose detection model based on machine learning and deep learning. We then comprehensively analyzed poplar anthracnose using advanced hyperspectral-based plant disease detection methodologies. Our research focused on establishing a detection model for poplar anthracnose based on small samples, employing the Design of Experiments (DoE)-based entropy weight method to obtain the best preprocessing combination to improve the detection model's overall performance. We also analyzed the spectral characteristics of poplar anthracnose by comparing typical feature extraction methods (principal component analysis (PCA), variable combination population analysis (VCPA), and the successive projection algorithm (SPA)) with the vegetation index (VI) method (spectral disease indices (SDIs)) for data dimensionality reduction. The results showed notable improvements in the SDI-based model, which achieved 89.86% accuracy. However, this was inferior to the model based on typical feature extraction methods. Nevertheless, it achieved 100% accuracy for early-stage anthracnose and black spot disease in a controlled environment respectively. We conclude that the SDI-based model is suitable for low-cost detection tasks and is the best poplar anthracnose detection model. These findings contribute to the timely detection of poplar growth and will greatly facilitate the forestry sector's development. [ABSTRACT FROM AUTHOR]

The task of food image recognition, a nuanced subset of fine-grained image recognition, grapples with substantial intra-class variation and minimal inter-class differences. These challenges are compounded by the irregular and multi-scale nature of food images. Addressing these complexities, our study introduces an advanced model that leverages multiple attention mechanisms and multi-stage local fusion, grounded in the ConvNeXt architecture. Our model employs hybrid attention (HA) mechanisms to pinpoint critical discriminative regions within images, substantially mitigating the influence of background noise. Furthermore, it introduces a multi-stage local fusion (MSLF) module, fostering long-distance dependencies between feature maps at varying stages. This approach facilitates the assimilation of complementary features across scales, significantly bolstering the model's capacity for feature extraction. Furthermore, we constructed a dataset named Roushi60, which consists of 60 different categories of common meat dishes. Empirical evaluation of the ETH Food-101, ChineseFoodNet, and Roushi60 datasets reveals that our model achieves recognition accuracies of 91.12%, 82.86%, and 92.50%, respectively. These figures not only mark an improvement of 1.04%, 3.42%, and 1.36% over the foundational ConvNeXt network but also surpass the performance of most contemporary food image recognition methods. Such advancements underscore the efficacy of our proposed model in navigating the intricate landscape of food image recognition, setting a new benchmark for the field. [ABSTRACT FROM AUTHOR]

The question "How does it work" has motivated many scientists. Through the study of natural phenomena and behaviors, many intelligence algorithms have been proposed to solve various optimization problems. This paper aims to offer an informative guide for researchers who are interested in tackling optimization problems with intelligence algorithms. First, a special neural network was comprehensively discussed, and it was called a zeroing neural network (ZNN). It is especially intended for solving time-varying optimization problems, including origin, basic principles, operation mechanism, model variants, and applications. This paper presents a new classification method based on the performance index of ZNNs. Then, two classic bio-inspired algorithms, a genetic algorithm and a particle swarm algorithm, are outlined as representatives, including their origin, design process, basic principles, and applications. Finally, to emphasize the applicability of intelligence algorithms, three practical domains are introduced, including gene feature extraction, intelligence communication, and the image process. [ABSTRACT FROM AUTHOR]

The surface quality of milled blade-root grooves in industrial turbine blades significantly influences their mechanical properties. The surface texture reveals the interaction between the tool and the workpiece during the machining process, which plays a key role in determining the surface quality. In addition, there is a significant correlation between acoustic vibration signals and surface texture features. However, current research on surface quality is still relatively limited, and most considers only a single signal. In this paper, 160 sets of industrial field data were collected by multiple sensors to study the surface quality of a blade-root groove. A surface texture feature prediction method based on acoustic vibration signal fusion is proposed to evaluate the surface quality. Fast Fourier transform (FFT) is used to process the signal, and the clean and smooth features are extracted by combining wavelet denoising and multivariate smoothing denoising. At the same time, based on the gray-level co-occurrence matrix, the surface texture image features of different angles of the blade-root groove are extracted to describe the texture features. The fused acoustic vibration signal features are input, and the texture features are output to establish a texture feature prediction model. After predicting the texture features, the surface quality is evaluated by setting a threshold value. The threshold is selected based on all sample data, and the final judgment accuracy is 90%. [ABSTRACT FROM AUTHOR]

Background: Pepper Phytophthora blight is a devastating disease during the growth process of peppers, significantly affecting their yield and quality. Accurate, rapid, and non-destructive early detection of pepper Phytophthora blight is of great importance for pepper production management. This study investigated the possibility of using multispectral imaging combined with machine learning to detect Phytophthora blight in peppers. Peppers were divided into two groups: one group was inoculated with Phytophthora blight, and the other was left untreated as a control. Multispectral images were collected at 0-h samples before inoculation and at 48, 60, 72, and 84 h after inoculation. The supporting software of the multispectral imaging system was used to extract spectral features from 19 wavelengths, and textural features were extracted using a gray-level co-occurrence matrix (GLCM) and a local binary pattern (LBP). The principal component analysis (PCA), successive projection algorithm (SPA), and genetic algorithm (GA) were used for feature selection from the extracted spectral and textural features. Two classification models were established based on effective single spectral features and significant spectral textural fusion features: a partial least squares discriminant analysis (PLS_DA) and one-dimensional convolutional neural network (1D-CNN). A two-dimensional convolutional neural network (2D-CNN) was constructed based on five principal component (PC) coefficients extracted from the spectral data using PCA, weighted, and summed with 19-channel multispectral images to create new PC images. Results: The results indicated that the models using PCA for feature selection exhibit relatively stable classification performance. The accuracy of PLS-DA and 1D-CNN based on single spectral features is 82.6% and 83.3%, respectively, at the 48h mark. In contrast, the accuracy of PLS-DA and 1D-CNN based on spectral texture fusion reached 85.9% and 91.3%, respectively, at the same 48h mark. The accuracy of the 2D-CNN based on 5 PC images is 82%. Conclusions: The research indicates that Phytophthora blight infection can be detected 48 h after inoculation (36 h before visible symptoms). This study provides an effective method for the early detection of Phytophthora blight in peppers. [ABSTRACT FROM AUTHOR]

The movement of glaciers plays a crucial role in environmental and geological processes, significantly influencing the formation and dynamics of ice bodies. This study leverages feature tracking technology to analyze optical and Synthetic Aperture Radar (SAR) remote sensing imagery, specifically GF-1 optical images and GF-3, Sentinel-1 SAR images, captured during the 2020 to 2021 ablation season in Gongar. The aim was to quantify glacier surface velocities and to evaluate the comparative effectiveness of different remote sensing modalities in capturing these dynamics. Our findings indicate a strong consistency in the spatial distribution of glacier surface velocities derived from diverse remote sensing data sources, with high-precision optical imagery (GF-1) yielding the most accurate velocity measurements, followed by Sentinel-1 SAR data. Notably, large glaciers in Gongar exhibited rapid movements, with an average velocity of 0.16 m/d, primarily at elevations between 4,500 and 6,500 m. The fastest velocities were recorded at approximately 4,500 m elevation. Glaciers with inclines ranging from 10° to 60° displayed the highest velocities within the 20°-30° slope range. It was observed that glaciers on the southeast slope moved faster, exhibiting the highest average surface velocity, in contrast to those on the west slope, which moved more slowly. The surface velocity of the ice tongue region of Krayaylak Glacier that the largest glacier in Pamir, was observed to be lower than 0.6 m/d, indicating a slow movement speed. The study also reveals that the effectiveness of different remote sensing data in detecting glacier velocity in Gongar, with high-resolution data more accurately capturing surface velocities in melting areas or those with slower movement. This study underscores the importance of multi-source remote sensing data in understanding glacier dynamics and contributes valuable insights into the mechanisms driving glacier movements. [ABSTRACT FROM AUTHOR]

The accurate extraction of agricultural parcels from remote sensing images is crucial for advanced agricultural management and monitoring systems. Existing methods primarily emphasize regional accuracy over boundary quality, often resulting in fragmented outputs due to uniform crop types, diverse agricultural practices, and environmental variations. To address these issues, this paper proposes DSTBA-Net, an end-to-end encoder–decoder architecture. Initially, we introduce a Dual-Stream Feature Extraction (DSFE) mechanism within the encoder, which consists of Residual Blocks and Boundary Feature Guidance (BFG) to separately process image and boundary data. The extracted features are then fused in the Global Feature Fusion Module (GFFM), utilizing Transformer technology to further integrate global and detailed information. In the decoder, we employ Feature Compensation Recovery (FCR) to restore critical information lost during the encoding process. Additionally, the network is optimized using a boundary-aware weighted loss strategy. DSTBA-Net aims to achieve high precision in agricultural parcel segmentation and accurate boundary extraction. To evaluate the model's effectiveness, we conducted experiments on agricultural parcel extraction in Denmark (Europe) and Shandong (Asia). Both quantitative and qualitative analyses show that DSTBA-Net outperforms comparative methods, offering significant advantages in agricultural parcel extraction. [ABSTRACT FROM AUTHOR]

O6-methylguanine-DNA methyltransferase (MGMT) has been demonstrated to be an important prognostic and predictive marker in glioblastoma (GBM). To establish a reliable radiomics model based on MRI data to predict the MGMT promoter methylation status of GBM. A total of 183 patients with glioblastoma were included in this retrospective study. The visually accessible Rembrandt images (VASARI) features were extracted for each patient, and a total of 14676 multi-region features were extracted from enhanced, necrotic, "non-enhanced, and edematous" areas on their multiparametric MRI. Twelve individual radiomics models were constructed based on the radiomics features from different subregions and different sequences. Four single-sequence models, three single-region models and the combined radiomics model combining all individual models were constructed. Finally, the predictive performance of adding clinical factors and VASARI characteristics was evaluated. The ComRad model combining all individual radiomics models exhibited the best performance in test set 1 and test set 2, with the area under the receiver operating characteristic curve (AUC) of 0.839 (0.709–0.963) and 0.739 (0.581–0.897), respectively. The results indicated that the radiomics model combining multi-region and multi-parametric MRI features has exhibited promising performance in predicting MGMT methylation status in GBM. The Modeling scheme that combining all individual radiomics models showed best performance among all constructed moels. [ABSTRACT FROM AUTHOR]

Background: The aim of this study is to investigate the added value of combining tumour blood flow (BF) and metabolism parameters, including texture features, with clinical parameters to predict, at baseline, the pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) in patients with newly diagnosed breast cancer (BC). Methods: One hundred and twenty-eight BC patients underwent a 18F-FDG PET/CT before any treatment. Tumour BF and metabolism parameters were extracted from first-pass dynamic and delayed PET images, respectively. Standard and texture features were extracted from BF and metabolic images. Prediction of pCR was performed using logistic regression, random forest and support vector classification algorithms. Models were built using clinical (C), clinical and metabolic (C+M) and clinical, metabolic and tumour BF (C+M+BF) information combined. Algorithms were trained on 80% of the dataset and tested on the remaining 20%. Univariate and multivariate features selections were carried out on the training dataset. A total of 50 shuffle splits were performed. The analysis was carried out on the whole dataset (HER2 and Triple Negative (TN)), and separately in HER2 (N=76) and TN (N=52) tumours. Results: In the whole dataset, the highest classification performances were observed for C+M models, significantly (p-value<0.01) higher than C models and better than C+M+BF models (mean balanced accuracy of 0.66, 0.61, and 0.64 respectively). For HER2 tumours, equal performances were noted for C and C+M models, with performances higher than C+M+BF models (mean balanced accuracy of 0.64, and 0.61 respectively). Regarding TN tumours, the best classification results were reported for C+M models, with better performances than C and C+M+BF models but not significantly (mean balanced accuracy of 0.65, 0.63, and 0.62 respectively). Conclusion: Baseline clinical data combined with global and texture tumour metabolism parameters assessed by 18F-FDG PET/CT provide a better prediction of pCR after NAC in patients with BC compared to clinical parameters alone for TN, and HER2 and TN tumours together. In contrast, adding BF parameters to the models did not improve prediction, regardless of the tumour subgroup analysed. [ABSTRACT FROM AUTHOR]

Image super-resolution (SR) technology can improve the resolution of images and provide clearer and more reliable remote sensing images of high quality to better serve the subsequent applications. However, when reconstructing high-frequency feature areas of remote sensing images, existing SR reconstruction methods are prone to artifacts that affect visual effects and make it difficult to generate real texture details. In order to address this issue, a texture-detail-enhanced dense generative adversarial network (TDEGAN) for remote sensing image SR is presented. The generator uses multi-level dense connections, residual connections, and Shuffle attention (SA) to improve the feature extraction ability. A PatchGAN-style discrimination network is designed to effectively perform local discrimination and helps the network generate rich, detailed features. To reduce the impact of artifacts, we introduce an artifact loss function, which is combined with the exponential moving average (EMA) technique to distinguish the artifacts generated from the actual texture details through local statistics, which can help the network reduce artifacts and generate more realistic texture details. Experiments show that TDEGAN can better restore the texture details of remote sensing images and achieves certain advantages in terms of evaluation indicators and visualization. [ABSTRACT FROM AUTHOR]

Simultaneous Localization and Mapping (SLAM) is a crucial function for most autonomous systems, allowing them to both navigate through and create maps of unfamiliar surroundings. Traditional Visual SLAM, also commonly known as VSLAM, relies on frame-based cameras and structured processing pipelines, which face challenges in dynamic or low-light environments. However, recent advancements in event camera technology and neuromorphic processing offer promising opportunities to overcome these limitations. Event cameras inspired by biological vision systems capture the scenes asynchronously, consuming minimal power but with higher temporal resolution. Neuromorphic processors, which are designed to mimic the parallel processing capabilities of the human brain, offer efficient computation for real-time data processing of event-based data streams. This paper provides a comprehensive overview of recent research efforts in integrating event cameras and neuromorphic processors into VSLAM systems. It discusses the principles behind event cameras and neuromorphic processors, highlighting their advantages over traditional sensing and processing methods. Furthermore, an in-depth survey was conducted on state-of-the-art approaches in event-based SLAM, including feature extraction, motion estimation, and map reconstruction techniques. Additionally, the integration of event cameras with neuromorphic processors, focusing on their synergistic benefits in terms of energy efficiency, robustness, and real-time performance, was explored. The paper also discusses the challenges and open research questions in this emerging field, such as sensor calibration, data fusion, and algorithmic development. Finally, the potential applications and future directions for event-based SLAM systems are outlined, ranging from robotics and autonomous vehicles to augmented reality. [ABSTRACT FROM AUTHOR]

Due to the widespread use of mulching film in cotton planting in China, residual mulching film mixed with machine-picked cotton poses a significant hazard to cotton processing. Detecting residual mulching film in seed cotton has become particularly challenging due to the film's semi-transparent nature. This study constructed an imaging system combining an area array camera and a line scan camera. A detection scheme was proposed that utilized features from both image types. To simulate online detection, samples were placed on a conveyor belt moving at 0.2 m/s, with line lasers at a wavelength of 650 nm as light sources. For area array images, feature extraction was performed to establish a partial least squares discriminant analysis (PLS-DA) model. For line scan images, texture feature analysis was used to build a support vector machine (SVM) classification model. Subsequently, image features from both cameras were merged to construct an SVM model. Experimental results indicated that detection methods based on area array and line scan images had accuracies of 75% and 79%, respectively, while the feature fusion method achieved an accuracy of 83%. This study demonstrated that the proposed method could effectively improve the accuracy of residual mulching film detection in seed cotton, providing a basis for reducing residual mulching film content during processing. [ABSTRACT FROM AUTHOR]

The fusion of multi-modal medical images has great significance for comprehensive diagnosis and treatment. However, the large differences between the various modalities of medical images make multi-modal medical image fusion a great challenge. This paper proposes a novel multi-scale fusion network based on multi-dimensional dynamic convolution and residual hybrid transformer, which has better capability for feature extraction and context modeling and improves the fusion performance. Specifically, the proposed network exploits multi-dimensional dynamic convolution that introduces four attention mechanisms corresponding to four different dimensions of the convolutional kernel to extract more detailed information. Meanwhile, a residual hybrid transformer is designed, which activates more pixels to participate in the fusion process by channel attention, window attention, and overlapping cross attention, thereby strengthening the long-range dependence between different modes and enhancing the connection of global context information. A loss function, including perceptual loss and structural similarity loss, is designed, where the former enhances the visual reality and perceptual details of the fused image, and the latter enables the model to learn structural textures. The whole network adopts a multi-scale architecture and uses an unsupervised end-to-end method to realize multi-modal image fusion. Finally, our method is tested qualitatively and quantitatively on mainstream datasets. The fusion results indicate that our method achieves high scores in most quantitative indicators and satisfactory performance in visual qualitative analysis. [ABSTRACT FROM AUTHOR]

Due to the extremely irregular nonlinear degradation of images obtained in real underwater environments, it is difficult for existing underwater image enhancement methods to stably restore degraded underwater images, thus making it challenging to improve the efficiency of marine work. We propose a hybrid algorithm model for underwater image color restoration and texture enhancement, termed HA-Net. First, we introduce a dynamic color correction algorithm based on depth estimation to restore degraded images and mitigate color attenuation in underwater images by calculating the depth of targets and backgrounds. Then, we propose a multi-scale U-Net to enhance the network's feature extraction capability and introduce a parallel attention module to capture image spatial information, thereby improving the model's accuracy in recognizing deep semantics such as fine texture. Finally, we propose a global information compensation algorithm to enhance the output image's integrity and boost the network's learning ability. Experimental results on synthetic standard data sets and real data demonstrate that our method produces images with clear texture and bright colors, outperforming other algorithms in both subjective and objective evaluations, making it more suitable for real marine environments. [ABSTRACT FROM AUTHOR]

Introduction: Soybeans are an important crop used for food, oil, and feed. However, China's soybean self-sufficiency is highly inadequate, with an annual import volume exceeding 80%. RGB cameras serve as powerful tools for estimating crop yield, and machine learning is a practical method based on various features, providing improved yield predictions. However, selecting different input parameters and models, specifically optimal features and model effects, significantly influences soybean yield prediction. Methods: This study used an RGB camera to capture soybean canopy images from both the side and top perspectives during the R6 stage (pod filling stage) for 240 soybean varieties (a natural population formed by four provinces in China: Sichuan, Yunnan, Chongqing, and Guizhou). From these images, the morphological, color, and textural features of the soybeans were extracted. Subsequently, feature selection was performed on the image parameters using a Pearson correlation coefficient threshold =0.5. Five machine learning methods, namely, CatBoost, LightGBM, RF, GBDT, and MLP, were employed to establish soybean yield estimation models based on the individual and combined image parameters from the two perspectives extracted from RGB images. Results: (1) GBDT is the optimal model for predicting soybean yield, with a test set R2 value of 0.82, an RMSE of 1.99 g/plant, and an MAE of 3.12%. (2) The fusion of multiangle and multitype indicators is conducive to improving soybean yield prediction accuracy. Conclusion: Therefore, this combination of parameters extracted from RGB images via machine learning has great potential for estimating soybean yield, providing a theoretical basis and technical support for accelerating the soybean breeding process. [ABSTRACT FROM AUTHOR]

Remote sensing images usually contain abundant targets and complex information distributions. Consequently, networks are required to model both global and local information in the super-resolution (SR) reconstruction of remote sensing images. The existing SR reconstruction algorithms generally focus on only local or global features, neglecting effective feedback for reconstruction errors. Therefore, a Global Residual Multi-attention Fusion Back-projection Network (SRBPSwin) is introduced by combining the back-projection mechanism with the Swin Transformer. We incorporate a concatenated Channel and Spatial Attention Block (CSAB) into the Swin Transformer Block (STB) to design a Multi-attention Hybrid Swin Transformer Block (MAHSTB). SRBPSwin develops dense back-projection units to provide bidirectional feedback for reconstruction errors, enhancing the network's feature extraction capabilities and improving reconstruction performance. SRBPSwin consists of the following four main stages: shallow feature extraction, shallow feature refinement, dense back projection, and image reconstruction. Firstly, for the input low-resolution (LR) image, shallow features are extracted and refined through the shallow feature extraction and shallow feature refinement stages. Secondly, multiple up-projection and down-projection units are designed to alternately process features between high-resolution (HR) and LR spaces, obtaining more accurate and detailed feature representations. Finally, global residual connections are utilized to transfer shallow features during the image reconstruction stage. We propose a perceptual loss function based on the Swin Transformer to enhance the detail of the reconstructed image. Extensive experiments demonstrate the significant reconstruction advantages of SRBPSwin in quantitative evaluation and visual quality. [ABSTRACT FROM AUTHOR]

Underwater applications present unique challenges such as color deviation, noise, and low contrast, which can degrade image quality. Addressing these issues, we propose a novel approach called the learnable full-frequency transformer dual generative adversarial network (LFT-DGAN). Our method comprises several key innovations. Firstly, we introduce a reversible convolution-based image decomposition technique. This method effectively separates underwater image information into low-, medium-, and high-frequency domains, enabling more thorough feature extraction. Secondly, we employ image channels and spatial similarity to construct a learnable full-frequency domain transformer. This transformer facilitates interaction between different branches of information, enhancing the overall image processing capabilities. Finally, we develop a robust dual-domain discriminator capable of learning spatial and frequency domain characteristics of underwater images. Extensive experimentation demonstrates the superiority of the LFT-DGAN method over state-of-the-art techniques across multiple underwater datasets. Our approach achieves significantly improved quality and evaluation metrics, showcasing its effectiveness in addressing the challenges posed by underwater imaging. [ABSTRACT FROM AUTHOR]

Imaging hyperspectral technology is becoming popular in agriculture to provide detailed information on crop growth. In this work, we propose an estimation of rapeseed pod's water content model and identification of maturity levels (green, yellow, and full) model by using this technology. Four types of hyperspectral features are extracted—color, texture, spectral three-edge parameters, and spectral indices. By integrating these features, satisfactory results are achieved: the optimal feature combination is from spectral indices and three-edge parameters, with low RRMSE and RE for yellow maturity. Incorporating spectral indices significantly improved the pod's water content estimation, reducing RRMSE by up to 43.30% and 30.11% in the green and full maturity stages. Random forest and support vector machine with kernel method (SVM-KM) algorithms outperformed other statistical models, with SVM-KM achieving up to 96.90% accuracy in identifying maturity levels. These findings provide valuable insights for managing rapeseed production during the pod stage. [ABSTRACT FROM AUTHOR]

Various types of foreign fibres may be mixed in the planting, transportation, and production processes of cotton, which not only cause equipment to be out of control, but also leads to a decrease in the quality of cotton textile products and economic losses. The machine vision based detection method for cotton foreign fibres is widely used. Based on existing related research, we construct a classification dataset for cotton foreign fibres in practical scenarios, named the CF2113‐10 dataset. The authors design a basic foreign fibre classification network called CottonNet that balances performance and efficiency. The classification accuracy on the validation set reached 94.2%. In order to enhance the high‐level feature extraction ability, this paper improves the feature fusion method of residual networks and proposes CottonNet‐Res, which improves the classification accuracy to 95.1%. Finally, a classification model based on feature difference fitting, CottonNet‐Fusion, is proposed to address the classification problem of foreign fibre images sampled in complex environments. The classification accuracy of foreign fibre images sampled in ordinary scenes has improved to 97.4%, while the images sampled in complex environments maintain an accuracy of 90.3%. [ABSTRACT FROM AUTHOR]

This paper proposes a method for generating interferometric phase diagrams, which includes interferometric image registration based on Dot Trace Texture Information (DTTI) and interferometric phase filtering based on semantic segmentation. First, the InSAR images are sharpened according to the different backscattering characteristics of various pixel values, and DTTI is extracted to generate the Dot Trace Texture Map (DTTM). Second, SIFT feature points are extracted from two InSAR coherent complex images. They are then screened by comparison with DTTI. These selected points are used to calculate the registration relationship, ensuring precise registration of the two images. Third, the interferometric phase diagram is segmented by semantics based on correlation coefficients. For high-quality interferometric phase regions, we use two-dimensional frequency domain rotational symmetric Gaussian Laplace and wavelet domain filters successively. For lowquality regions, we use an average filter to smooth out noise. The superiority of the proposed algorithm was verified through comparative experiments. [ABSTRACT FROM AUTHOR]

Timely and accurate estimation of Above-Ground-Biomass (AGB) in cotton is essential for precise production monitoring. The study was conducted in Shaya County, Aksu Region, Xinjiang, China. It employed an unmanned aerial vehicle (UAV) as a low-altitude monitoring platform to capture multispectral images of the cotton canopy. Subsequently, spectral features and textural features were extracted, and feature selection was conducted using Pearson's correlation (P), Principal Component Analysis (PCA), Multivariate Stepwise Regression (MSR), and the ReliefF algorithm (RfF), combined with the machine learning algorithm to construct an estimation model of cotton AGB. The results indicate a high consistency between the mean (MEA) and the corresponding spectral bands in textural features with the AGB correlation. Moreover, spectral and textural feature fusion proved to be more stable than models utilizing single spectral features or textural features alone. Both the RfF algorithm and ANN model demonstrated optimization effects on features, and their combination effectively reduced the data redundancy while improving the model performance. The RfF-ANN-AGB model constructed based on the spectral and textural features fusion worked better, and using the features SIPI2, RESR, G_COR, and RE_DIS, exhibited the best performance, achieving a test sets R2 of 0.86, RMSE of 0.23 kg·m−2, MAE of 0.16 kg·m−2, and nRMSE of 0.39. The findings offer a comprehensive modeling strategy for the precise and rapid estimation of cotton AGB. [ABSTRACT FROM AUTHOR]

In recent years, various data-driven algorithms have been applied to the classification and staging of brain glioma MRI detection. However, the restricted availability of brain glioma MRI data in purely data-driven deep learning algorithms has presented challenges in extracting high-quality features and capturing their complex patterns. Moreover, the analysis methods designed for 2D data necessitate the selection of ideal tumor image slices, which does not align with practical clinical scenarios. Our research proposes an novel brain glioma staging model, Medical Cognition Embedded (MCE) model for 3D data. This model embeds knowledge characteristics into data-driven approaches to enhance the quality of feature extraction. Approach includes the following key components: (1) Deep feature extraction, drawing upon the imaging technical characteristics of different MRI sequences, has led to the design of two methods at both the algorithmic and strategic levels to mimic the learning process of real image interpretation by medical professionals during film reading; (2) We conduct an extensive Radiomics feature extraction, capturing relevant features such as texture, morphology, and grayscale distribution; (3) By referencing key points in radiological diagnosis, Radiomics feature experimental results, and the imaging characteristics of various MRI sequences, we manually create diagnostic features (Diag-Features). The efficacy of proposed methodology is rigorously evaluated on the publicly available BraTS2018 and BraTS2020 datasets. Comparing it to most well-known purely data-driven models, our method achieved higher accuracy, recall, and precision, reaching 96.14%, 93.4%, 97.06%, and 97.57%, 92.80%, 95.96%, respectively. [ABSTRACT FROM AUTHOR]

To create a radiogenomics map and evaluate the correlation between molecular and imaging phenotypes in localized prostate cancer (PCa), using radical prostatectomy histopathology as a reference standard. Radiomic features were extracted from T2-weighted (T2WI) and Apparent Diffusion Coefficient (ADC) images of clinically localized PCa patients (n = 15) across different Gleason score-based risk categories. DNA extraction was performed on formalin-fixed, paraffin-embedded (FFPE) samples. Gene expression analysis of androgen receptor expression, apoptosis, and hypoxia was conducted using the Chromosome Analysis Suite (ChAS) application and OSCHIP files. The relationship between gene expression alterations and textural features was assessed using Pearson's correlation analysis. Receiver operating characteristic (ROC) analysis was utilized to evaluate the predictive accuracy of the model. A significant correlation was observed between radiomic texture features and copy number variation (CNV) of genes associated with apoptosis, hypoxia, and androgen receptor (p-value ≤ 0.05). The identified radiomic features, including Sum Entropy ADC, Inverse Difference ADC, Sum Variance T2WI, Entropy T2WI, Difference Variance T2WI, and Angular Secondary Moment T2WI, exhibited potential for predicting cancer grade and biological processes such as apoptosis and hypoxia. Incorporating radiomics and genomics into a prediction model significantly improved the prediction of prostate cancer grade (clinically significant prostate cancer), yielding an AUC of 0.95. Radiomic texture features significantly correlate with genotypes for apoptosis, hypoxia, and androgen receptor expression in localised prostate cancer. Integration of these into the prediction model improved prediction accuracy of clinically significant prostate cancer. [ABSTRACT FROM AUTHOR]