Search

Head pose estimation is an especially challenging task due to the complexity nonlinear mapping from 2D feature space to 3D pose space. To address the above issue, this paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network. Firstly, a new network, the region and difference‐aware feature pyramid network (RD‐FPN), is proposed for 2D keypoints detection to alleviate the background interference and enhance the feature expressiveness. Then, particle swarm optimized contrastive learning is constructed to alternatively match 2D and 3D keypoints, which takes the multimodal keypoints matching accuracy as the optimization objective, while considering the similarity of cross‐modal positive and negative sample pairs from contrastive learning as a local contrastive constraint. Finally, multimodal entangled graph convolution network is designed to enhance the ability of establishing geometric relationships between keypoints and head pose angles based on second‐order bilinear attention, in which point‐edge attention is introduced to improve the representation of geometric features between multimodal keypoints. Compared with other methods, the average error of our method is reduced by 8.23%, indicating the accuracy, generalization, and efficiency of our method on the 300W‐LP, AFLW2000, BIWI datasets. [ABSTRACT FROM AUTHOR]

Transformer possesses a broader perceptual scope, while the Convolutional Neural Network (CNN) excels at capturing local information. In this paper, the authors propose the Multi‐Sclale Feature Aggregation Network (MSFA‐Net) for single‐image dehazing which is fused with the advantages of Transformer and CNN. Our MSFA‐Net is based on the encoder–decoder structure, and there are four main innovations. Firstly, the authors make some improvements to the original Swin Transformer to make it more effective for dehazing tasks, and the authors name it Spatial Information Aggregation Transformer (SIAT). The authors place the SIAT in both encoder and decoder of MSFA‐Net for feature extraction. The authors propose an upsampling module called Efficient Spatial Resolution Recovery (ESRR) which is placed in the decoder part. Compared to commonly used transposed convolutions, the authors' ESRR module has fewer computational cost. Considering that the haze distribution is always uneven and the information from each channel is different, the authors introduce the Dynamic Multi‐Attention (DMA) module to provide pixel‐wise weights and channel‐wise weights for input features. The authors place the DMA module between the encoder and decoder parts. As the network depth increases, the spatial structural information from the high‐resolution layer tends to degrade. To deal with the problem, the authors propose the Multi‐Scale Feature Fusion (MSFF) module to recover missing spatial structural information. The authors place the MSFF module in both the encoder and decoder parts. Extensive experimental results show that the authors' proposed dehazing network achieves state‐of‐the‐art dehazing performance with relatively low computational cost. [ABSTRACT FROM AUTHOR]

This study introduces a novel approach that addresses the limitations of existing methods by integrating 2D image processing with 3D point cloud analysis, enhanced by interpretable neural networks. Unlike traditional methods that rely on either 2D or 3D data alone, our approach leverages the complementary strengths of both data types to improve detection accuracy in environments adversely affected by welding spatter and smoke. Our system employs an improved Faster R-CNN model with a ResNet50 backbone for 2D image analysis, coupled with an innovative orthogonal plane intersection line extraction algorithm for 3D point cloud processing. By incorporating explainable components such as visualizable feature maps and a transparent region proposal network, we address the "black box" issue common in deep learning models.This architecture enables a more transparent decision-making process, providing technicians with necessary insights to understand and trust the system's outputs. The Faster-RCNN structure is designed to break down the object detection process into distinct, understandable steps, from initial feature extraction to final bounding box refinement. This fusion of 2D-3D data analysis and interpretability not only improves detection performance but also sets a new standard for transparency and reliability in automated welding systems, facilitating wider adoption in industrial applications. [ABSTRACT FROM AUTHOR]

In view of the complexity and diversity of hyperspectral images (HSIs), the classification task has been a major challenge in the field of remote sensing image processing. Hyperspectral classification (HSIC) methods based on neural architecture search (NAS) is a current attractive frontier that not only automatically searches for neural network architectures best suited to the characteristics of HSI data, but also avoids the possible limitations of manual design of neural networks when dealing with new classification tasks. However, the existing NAS-based HSIC methods have the following limitations: (1) the search space lacks efficient convolution operators that can fully extract discriminative spatial–spectral features, and (2) NAS based on traditional differentiable architecture search (DARTS) has performance collapse caused by unfair competition. To overcome these limitations, we proposed a neural architecture search method with receptive field spatial–spectral attention (RFSS-NAS), which is specifically designed to automatically search the optimal architecture for HSIC. Considering the core needs of the model in extracting more discriminative spatial–spectral features, we designed a novel and efficient attention search space. The core component of this innovative space is the receptive field spatial–spectral attention convolution operator, which is capable of precisely focusing on the critical information in the image, thus greatly enhancing the quality of feature extraction. Meanwhile, for the purpose of solving the unfair competition issue in the traditional differentiable architecture search (DARTS) strategy, we skillfully introduce the Noisy-DARTS strategy. The strategy ensures the fairness and efficiency of the search process and effectively avoids the risk of performance crash. In addition, to further improve the robustness of the model and ability to recognize difficult-to-classify samples, we proposed a fusion loss function by combining the advantages of the label smoothing loss and the polynomial expansion perspective loss function, which not only smooths the label distribution and reduces the risk of overfitting, but also effectively handles those difficult-to-classify samples, thus improving the overall classification accuracy. Experiments on three public datasets fully validate the superior performance of RFSS-NAS. [ABSTRACT FROM AUTHOR]

Fires not only cause devastating consequences for human life and property, but also lead to soil erosion in forests. Therefore, it is necessary to design a novel algorithm that can quickly monitor smoke from fires. Most existing smoke segmentation methods do not consider the segmentation accuracy of algorithms under limited computational resources. To address this research gap, this paper proposes a lightweight smoke segmentation algorithm based on DeepLabV3+ that achieves fast inference speed and high accuracy for different sizes smoke. To reduce the number of parameters, the feature extraction network of the DeeplabV3+ algorithm is replaced by MobileNetV2, which enhances the extraction ability of the algorithm in segment smoke images. Then, the Convolutional Block Attention Module (CBAM) is added to the encoder part to enhance the perception of the algorithm for small smoke and effectively alleviates smoke mis‐segmentation. Furthermore, a newly designed loss function is used in the network. The experimental results show that the proposed method has improved by 1.27% in Smoke IoU and 1.21% in mPA compared with other methods. The weight size has been reduced to 10.76% of the original DeepLabV3+, and the inference time is only 33.71ms. Therefore, it is a more suitable early fire detection algorithm for resource‐constrained environments. [ABSTRACT FROM AUTHOR]

Synthetic images facilitate stereo matching. However, synthetic images may suffer from image distortion, domain bias, and stereo mismatch, which would significantly restrict the widespread use of stereo matching models in the real world. The first goal in this paper is to synthesize real‐looking images for minimizing the domain bias between the synthesized and real images. For this purpose, sharpened disparity maps are produced from a mono real image. Then, stereo image pairs are synthesized using these imperfect disparity maps and the single real image in the proposed pipeline. Although the synthesized images are as realistic as possible, the domain styles of the synthesized images are always very different from the real images. Thus, the second goal is to enhance the domain generalization ability of the stereo matching network. For that, the feature extraction layer is replaced with a teacher–student model. Then, a constraint of binocular contrast features is imposed on the output of the model. When tested on the KITTI, ETH3D, and Middlebury datasets, the accuracy of the method outperforms traditional methods by at least 30%. Experiments demonstrate that the approaches are general and can be conveniently embedded into existing stereo networks. [ABSTRACT FROM AUTHOR]

In agriculture, crops are severely affected by illnesses, which reduce their production every year. The detection of plant diseases during their initial stages is critical and thus needs to be addressed. Researchers have been making significant progress in the development of automatic plant disease recognition techniques through the utilization of machine learning (ML), image processing, and deep learning (DL). This study analyses the recent advancements made by researchers in the field of ML techniques for identifying plant diseases. This study also examines various methods used by researchers to produce ML solutions, such as image preprocessing, segmentation, and feature extraction. This study highlights the challenges encountered while creating plant disease identification systems, such as small datasets, image capture conditions, and the generalizability of the models, and discusses possible solutions to cater to these problems. Still, the development of a solution that automatically detects various plant diseases for various plant species remains a big challenge. To address these challenges, there is a need to create a system that is trained on an extensive dataset that contains images of various types of diseases a plant can suffer from, and plant images should be taken at various stages of the disease's development. This study further presents an analysis of various methods used at different stages of plant disease identification. [ABSTRACT FROM AUTHOR]

The ability to extract high‐quality features from data is critical for machine learning applications. With the development of deep learning, various methods have been developed for image feature extraction, and unsupervised techniques have gained popularity due to their ability to operate without response variables. Autoencoders with encoder–decoder architectures are a common example of such techniques, but they are limited by a lack of proportional relationship between model reconstruction and encoder feature extraction performance. If the decoder is composed of multiple layers and mapping to a higher dimension is easier, the feature extraction performance of the encoder is likely to decrease. However, previous research has not adequately addressed this limitation. This study identifies the limitations of conventional unsupervised feature extraction techniques that utilize the encoder–decoder architecture, and proposes a novel feature extraction technique called SAFE, which utilizes a self‐attention mechanism to eliminate decoder effects and improve the performance of encoder. To validate the effectiveness of the proposed model, we conducted experiments using diverse datasets (MNIST, Fashion MNIST, SVHN, and WM811K). The results of the experiments demonstrated that our proposed method exhibited, on average, 2%–10% higher performance in terms of accuracy and F‐measure compared to the existing feature extraction techniques in the classification problem. While our research has limitations, specifically in its applicability only to the selection of image features, future studies should be undertaken to explore its potential application in various fields. [ABSTRACT FROM AUTHOR]

When a camera lens is directly faced with a strong light source, image flare commonly occurs, significantly reducing the clarity and texture of the photo and interfering with image processing tasks that rely on visual sensors, such as image segmentation and feature extraction. A novel flare removal network, the Sparse-UFormer neural network, has been developed. The network integrates two core components onto the UFormer architecture: the mixed-scale feed-forward network (MSFN) and top-k sparse attention (TKSA), creating the sparse-transformer module. The MSFN module captures rich multi-scale information, enabling the more effective addressing of flare interference in images. The TKSA module, designed with a sparsity strategy, focuses on key features within the image, thereby significantly enhancing the precision and efficiency of flare removal. Furthermore, in the design of the loss function, besides the conventional flare, background, and reconstruction losses, a structural similarity index loss has been incorporated to ensure the preservation of image details and structure while removing the flare. Ensuring the minimal loss of image information is a fundamental premise for effective image restoration. The proposed method has been demonstrated to achieve state-of-the-art performance on the Flare7K++ test dataset and in challenging real-world scenarios, proving its effectiveness in removing flare artefacts from images. [ABSTRACT FROM AUTHOR]

The present paper aims to conduct an experiment that compares different methods of detecting objects in images. Programs were developed to evaluate the efficiency of SURF, BRISK, MSER, and ORB object detection methods. Four static gray images with sufficiently different histograms were used. The experiment also highlighted the need for image preprocessing to improve feature extraction and detection. Thus, a programmed method for adjusting pixel groups was developed. This method proved useful when one of the listed algorithms failed to detect the object in the original image, but succeeded after adjustment. The effectiveness of detection methods and the evaluation of their performance depend on the application, image preparation, algorithms used, and their implementation. Results of the detection methods were presented numerically (similarities, gradients, distances, etc.) and graphically. [ABSTRACT FROM AUTHOR]

The quality detection of alfalfa hay is crucial for the development of animal husbandry. In this study, a method for quality detection of alfalfa hay based on the fusion of multisource information including near-infrared spectroscopy, image processing techniques, and electronic nose is proposed. After SG convolution smoothing, feature wavelengths were extracted using Competitive Adaptive Re-weighting Scheme and Successive Projections Algorithm from the spectral data. The image data were denoised using adaptive wavelet thresholding, and color and texture features were extracted using color histograms and random forest algorithms, respectively. Electronic nose data using principal component analysis was used for data dimensionality reduction. Support Vector Machine, Extreme Learning Machine, and Multi-Layer Perceptron were employed to establish quality detection models of alfalfa hay based on spectroscopy, image, gas information, and their combination, respectively. Experimental results demonstrate that the fusion of near-infrared spectroscopy, image data, and gas information effectively enhances the classification accuracy of the model. The accuracy of the test set reaches 100%, with root mean square error and determination coefficient values of 0.1728 and 0.9239, respectively, surpassing prediction models established solely on individual information. This study provides new insights into alfalfa hay quality detection. [ABSTRACT FROM AUTHOR]

In clinical conditions limited by equipment, attaining lightweight skin lesion segmentation is pivotal as it facilitates the integration of the model into diverse medical devices, thereby enhancing operational efficiency. However, the lightweight design of the model may face accuracy degradation, especially when dealing with complex images such as skin lesion images with irregular regions, blurred boundaries, and oversized boundaries. To address these challenges, we propose an efficient lightweight attention network (ELANet) for the skin lesion segmentation task. In ELANet, two different attention mechanisms of the bilateral residual module (BRM) can achieve complementary information, which enhances the sensitivity to features in spatial and channel dimensions, respectively, and then multiple BRMs are stacked for efficient feature extraction of the input information. In addition, the network acquires global information and improves segmentation accuracy by putting feature maps of different scales through multi-scale attention fusion (MAF) operations. Finally, we evaluate the performance of ELANet on three publicly available datasets, ISIC2016, ISIC2017, and ISIC2018, and the experimental results show that our algorithm can achieve 89.87%, 81.85%, and 82.87% of the mIoU on the three datasets with a parametric of 0.459 M, which is an excellent balance between accuracy and lightness and is superior to many existing segmentation methods. [ABSTRACT FROM AUTHOR]

The advancement of new energy vehicles has led to more demanding standards for detecting defects in cylindrical coated lithium batteries. The current research lacks robustness and has low performance. This paper seeks to provide real-time defect identification in cylindrical coated lithium batteries and improve the object detection method of the YOLOv5s model. This paper presents an MGSEC3 module with multi-scale feature extraction and integration of the SENet network in the YOLOv5 Backbone network. This module aims to reduce computational burden and enhance feature extraction efficiency as much as possible. At the same time, the CARAFE operator is utilized to enhance the up-sampling operator in order to reduce the loss of feature information. In addition, enhancements to the loss function enhance both the detection performance and convergence speed. The enhanced YOLOv5s model achieved an average detection rate of 82.4% on the custom cylindrical coated lithium battery dataset, 2.3% higher than the original YOLOv5s. This paper significantly enhances the precision and efficiency of flaw identification in cylindrical coated lithium batteries. [ABSTRACT FROM AUTHOR]

Current research on apron conflict detection is often limited to the interaction between the aircraft as a whole and other objects, making it difficult to accomplish targeted identification of vulnerable and high‐cost aircraft components. However, the implementation of detailed aircraft identification is of great significance to enhance the safety of airport surface operations. Based on the excellent performance of High‐Resolution Network (HRNet) in keypoint detection, a lightweight end‐to‐end keypoint detection network, namely Squeeze and Excitation High‐Resolution Network (SEHRNet), is proposed in this paper to solve the problems of HRNet's slower computation and more redundancy. First, the errors arising from coordinate transformations in the coding and decoding process are solved by an improved feature map coding and decoding process. Second, replace the BasicBlock in HRNet with the Depthwise separable convolutions based on the Squeeze‐and‐Excitation Networks, which drastically cuts the computational cost of the network. Third, the improved Bottleneck module is used to further enhance the capability of feature extraction. Experimental results prove that, based on the aircraft keypoint detection dataset, the SEHRNet proposed in this paper shows stronger applicability compared to the current mainstream networks. Compared with the original HRNet, the improved network has higher accuracy, faster speed, and lighter model for aircraft keypoint detection. [ABSTRACT FROM AUTHOR]

Intelligent sorting of coal and gangue is of great significance to the intelligent construction of coal mines as well as green development. In this study, we propose a coal and gangue segmentation method with an improved classical segmentation network Mask R‐CNN, denoted as Multichannel Forward‐Linked Confusion Convolution Module (MFCCM)‐Mask R‐CNN. First, we design a MFCCM to construct the feature extraction network by stacking, second, we design a multiscale high‐resolution feature pyramid network structure to realize multipath fusion of feature information to enhance the position and contour information of the target, and finally, we propose a multiscale Mask head to enhance the diversity of information, and capture the more representative and unique features. Training and testing models using self‐built RGB coal and gangue data sets, the accuracy of the improved algorithm reaches 97.38%, which is an improvement of 1.66% compared to the original model. Compared with other segmentation models Unet, Deeplab V3+, Yoloact, Yolov7, and the model after replacing the backbone network, the MFCCM‐Mask R‐CNN has higher precision and recall, and can more accurately realize the efficient segmentation of coal and gangue. [ABSTRACT FROM AUTHOR]

Corn is one of the major crops in Sudan. Disease outbreaks can significantly reduce maize production, causing huge damage. Conventionally, disease diagnosis is made through visual inspection of the damage in fields or through laboratory tests conducted by experts on the affected plant parts of the crop. This process typically requires highly skilled personnel, and it can be time-consuming to complete the necessary tasks. Machine learning methods can be implemented to rapidly and accurately detect disease and reduce the risk of crop failure due to disease outbreaks. This study aimed to use traditional machine learning techniques to detect maize diseases using image processing techniques. A total of 600 images were obtained from the open-source Plant Village dataset for experimentation. In this study, image segmentation was done using K-means clustering, and a total of 4 GLCM texture features and two statistical features were extracted from the images. In this study, four traditional machine learning algorithms were applied to detect diseased maize leaves (common rust and gray leaf spot) and healthy maize leaves. The results showed that all the algorithms performed well in identifying the diseased and healthy leaves, with accuracy rates ranging from 90% to 92.7%. The highest accuracy scores were obtained with support vector machine and artificial neural networks, respectively. [ABSTRACT FROM AUTHOR]

In recent years, with the increasing demand for high-quality images in various fields, more and more attention has been focused on noise removal techniques for image processing. The effective elimination of unwanted noise plays a crucial role in improving image quality. To meet this challenge, many noise removal methods have been proposed, among which the diffusion model has become one of the focuses of many researchers. In order to make the restored image closer to the real image and retain more features of the image, this paper proposes a DIR-SDE method with reference to the diffusion models of IR-SDE and IDM, which improve the feature retention of the image in the de-raining process, and then improve the realism of the image for the image de-raining task. In this study, IR-SDE was used as the base structure of the diffusion model, IR-SDE was improved, and DINO-ViT was combined to enhance the image features. During the diffusion process, the image features were extracted using DINO-ViT, and these features were fused with the original images to enhance the learning effect of the model. The model was also trained and validated with the Rain100H dataset. Compared with the IR-SDE method, it improved 0.003 in the SSIM, 0.003 in the LPIPS, and 1.23 in the FID. The experimental results show that the diffusion model proposed in this study can effectively improve the image restoration performance. [ABSTRACT FROM AUTHOR]

Advances in computer image recognition have significantly impacted many industries, including healthcare, security and autonomous systems. This paper aims to explore the potential of improving image algorithms to enhance computer image recognition. Specifically, we will focus on regression methods as a means to improve the accuracy and efficiency of identifying images. In this study, we will analyze various regression techniques and their applications in computer image recognition, as well as the resulting performance improvements through detailed examples and data analysis. This paper deals with the problems related to visual image processing in outdoor unstructured environment. Finally, the heterogeneous patterns are converted into the same pattern, and the heterogeneous patterns are extracted from the fusion features of data modes. The simulation results show that the perception ability and recognition ability of outdoor image recognition in complex environment are improved. [ABSTRACT FROM AUTHOR]

The classification of vehicles presents notable challenges within the domain of image processing. Traditional models suffer from inefficiency, prolonged training times for datasets, intricate feature extraction, and variable assignment complexities for classification. Conventional methods applied to categorize vehicles from extensive datasets often lead to errors, misclassifications, and unproductive outcomes. Consequently, leveraging machine learning techniques emerges as a promising solution to tackle these challenges. This study adopts a machine learning approach to alleviate image misclassifications and manage large quantities of vehicle images effectively. Specifically, a contrast enhancement technique is employed in the pre-processing stage to highlight pixel values in vehicle images. In the feature segmentation stage, Mask-R-CNN is utilized to categorize pixels into predefined classes. VGG16 is then employed to extract features from vehicle images, while an autoencoder aids in selecting features by learning non-linear input features and compressing representation features. Finally, the CatBoost (CB) algorithm is implemented for vehicle classification (VC) in diverse critical environments, such as inclement weather, twilight, and instances of vehicle blockage. Extensive experiments are conducted using different large-scale datasets with various machine learning platforms. The findings indicate that CB (presumably a specific method or algorithm) attains the highest level of performance on the large-scale dataset named UFPR-ALPR, with an accuracy rate of 98.89%. [ABSTRACT FROM AUTHOR]

Aiming at the problems of incomplete dehazing, color distortion, and loss of detail and edge information encountered by existing algorithms when processing images of underground coal mines, an image dehazing algorithm for underground coal mines, named CAB CA DSConv Fusion gUNet (CCDF-gUNet), is proposed. First, Dynamic Snake Convolution (DSConv) is introduced to replace traditional convolutions, enhancing the feature extraction capability. Second, residual attention convolution blocks are constructed to simultaneously focus on both local and global information in images. Additionally, the Coordinate Attention (CA) module is utilized to learn the coordinate information of features so that the model can better capture the key information in images. Furthermore, to simultaneously focus on the detail and structural consistency of images, a fusion loss function is introduced. Finally, based on the test verification of the public dataset Haze-4K, the Peak Signal-to-Noise Ratio (PSNR), Structural Similarity (SSIM), and Mean Squared Error (MSE) are 30.72 dB, 0.976, and 55.04, respectively, and on a self-made underground coal mine dataset, they are 31.18 dB, 0.971, and 49.66, respectively. The experimental results show that the algorithm performs well in dehazing, effectively avoids color distortion, and retains image details and edge information, providing some theoretical references for image processing in coal mine surveillance videos. [ABSTRACT FROM AUTHOR]

To reduce the occurrence of information loss and distortion in image style transfer, a method is proposed for researching and designing image style transfer technology based on multi‐scale convolutional neural networks (CNNs) feature fusion. Initially, the VGG19 model is designed for coarse and fine‐scale networks to achieve multi‐scale CNN feature extraction of target image information. Subsequently, while setting the corresponding feature loss function, an additional least‐squares penalty parameter is introduced to balance the optimal total loss function. Finally, leveraging the characteristics of stochastic gradient descent iteration, image features are fused and reconstructed to obtain better style transfer images. Experimental evaluations utilize peak signal‐to‐noise ratio (PSNR), structural similarity index (SSIM), information entropy (IE), and mean squared error (MSE) as metrics for assessing the transferred images, comparing them with three typical image style transfer methods. Results demonstrate that the proposed method achieves optimal performance across all metrics, realizing superior image style transfer effects. [ABSTRACT FROM AUTHOR]

Slug flow processes draw much attention in chemical and pharmaceutical manufacturing thanks to their ability to eliminate downtime costs and batch‐to‐batch variation. Using in‐line video can monitor the current process status and improve the stability of the slug flow. However, there are no effective image processing methods aiming at such videos from chemical experiments due to limited training sample size and the variety of experimental settings. The paper proposes a training‐free method to automatically detect and measure the slugs from in‐line videos. Multiple image features are fused to identify the slug shapes under various lighting conditions, a six‐point model is fitted to achieve better volume estimation, and a consistency score is estimated to quantify the detection uncertainty. The proposed algorithm achieves similar results to manual labeling for various types of slug flow processes, improving the accuracy of slug column estimation by a large margin compared to the existing automatic methods. Finally, using it to monitor the slug flow process's stability and the change of the slug volume in an injection point are demonstrated. The method not only shows that handcrafted image features have the capability for detection and segmentation from chemical experiment images but also paves the road for a training‐based algorithm for the task. [ABSTRACT FROM AUTHOR]

In recent years, many methods for image super‐resolution (SR) have relied on pairs of low‐resolution (LR) and high‐resolution (HR) images for training, where the degradation process is predefined by bicubic downsampling. While such approaches perform well in standard benchmark tests, they often fail to accurately replicate the complexity of real‐world image degradation. To address this challenge, researchers have proposed the use of unpaired image training to implicitly model the degradation process. However, there is a significant domain gap between the real‐world LR and the synthetic LR images from HR, which severely degrades the SR performance. A novel unsupervised image‐blind super‐resolution method that exploits degradation feature‐based learning for real‐image super‐resolution reconstruction (RDFL) is proposed. Their approach learns the degradation process from HR to LR using a generative adversarial network (GAN) and constrains the data distribution of the synthetic LR with real degraded images. The authors then encode the degraded features into a Transformer‐based SR network for image super‐resolution reconstruction through degradation representation learning. Extensive experiments on both synthetic and real datasets demonstrate the effectiveness and superiority of the RDFL method, which achieves visually pleasing reconstruction results. [ABSTRACT FROM AUTHOR]

Recent advances in deep convolutional neural networks have shown improved performance in face super‐resolution through joint training with other tasks such as face analysis and landmark prediction. However, these methods have certain limitations. One major limitation is the requirement for manual marking information on the dataset for multi‐task joint learning. This additional marking process increases the computational cost of the network model. Additionally, since prior information is often estimated from low‐quality faces, the obtained guidance information tends to be inaccurate. To address these challenges, a novel Decoder Structure Guided CNN‐Transformer Network (DCTNet) is introduced, which utilises the newly proposed Global‐Local Feature Extraction Unit (GLFEU) for effective embedding. Specifically, the proposed GLFEU is composed of an attention branch and a Transformer branch, to simultaneously restore global facial structure and local texture details. Additionally, a Multi‐Stage Feature Fusion Module is incorporated to fuse features from different network stages, further improving the quality of the restored face images. Compared with previous methods, DCTNet improves Peak Signal‐to‐Noise Ratio by 0.23 and 0.19 dB on the CelebA and Helen datasets, respectively. Experimental results demonstrate that the designed DCTNet offers a simple yet powerful solution to recover detailed facial structures from low‐quality images. [ABSTRACT FROM AUTHOR]

The fast scenario transfer for portrait styles has been a universal concern in the area of image processing. Conventionally, it was realized mostly by manual manipulation based on expertise experience, which costs a large amount of human labor. To fit the growing business volume in the era of Internet 4.0, it is supposed to investigate reliable autonomous workflow that generates portrait-style results via intelligent algorithms. Therefore, this paper proposes a fast scenario transfer method for portrait styles through collaborative awareness of convolutional neural network (CNN) and generative learning (GAL). On the one hand, a CNN structure is designed to make feature extraction towards the initial images, which can be used for following image generation. On the other hand, the GAL is utilized to generate new images with post-transferred scenario styles, so that the expected scenario style transfer results can be output by generating new images through long-term iterations. Especially, the loss function is designed by simultaneously considering local and global characteristics. Finally, the analysis and experimental results show that the correction process can be completed by injecting the extracted input face features into the feature maps of corresponding sizes in the generation process using a pre-trained feature extractor. Thus, the face conversion efficiency can be improved. [ABSTRACT FROM AUTHOR]

Online detection of action start is a significant and challenging task that requires prompt identification of action start positions and corresponding categories within streaming videos. This task presents challenges due to data imbalance, similarity in boundary content, and real‐time detection requirements. Here, a novel Time‐Attentive Fusion Network is introduced to address the requirements of improved action detection accuracy and operational efficiency. The time‐attentive fusion module is proposed, which consists of long‐term memory attention and the fusion feature learning mechanism, to improve spatial‐temporal feature learning. The temporal memory attention mechanism captures more effective temporal dependencies by employing weighted linear attention. The fusion feature learning mechanism facilitates the incorporation of current moment action information with historical data, thus enhancing the representation. The proposed method exhibits linear complexity and parallelism, enabling rapid training and inference speed. This method is evaluated on two challenging datasets: THUMOS'14 and ActivityNet v1.3. The experimental results demonstrate that the proposed method significantly outperforms existing state‐of‐the‐art methods in terms of both detection accuracy and inference speed. [ABSTRACT FROM AUTHOR]

In order to balance accuracy and real‐time performance in semantic segmentation, this paper proposes a real‐time semantic segmentation algorithm model based on attention mechanism and multi‐branch feature fusion using Fast convolutional neural network model (Fast‐SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at https://github.com/ccchhheeennn/model. [ABSTRACT FROM AUTHOR]

The No‐Reference Image Quality Assessment (NR‐IQA) method can predict quality scores of distorted images without the reference image. However, due to the variability in both color and structure of images, existing NR‐IQA methods struggle to accurately predict quality scores of distorted images. Therefore, an NR‐IQA method based on a Dual‐Branch Residual Network (DBRIQA) for evaluating the quality scores of color‐distorted images is proposed. First, guided filtering is applied to the hue images in the HSV space to extract distortion information from the image's color. Then, due to significant differences in distorted images, enhancements are made to the traditional residual blocks, forming a feature extraction module that captures multi‐scale features from the image. In order to capture the global relationships in the distorted image, a Global‐Level Attention Block (GLAB) is introduced, facilitating the interaction of information among the extracted features. Experiments were conducted across four publicly available IQA datasets, including LIVE, CSIQ, TID2008, and TID2013. The experimental results demonstrate that the proposed method exhibits strong performance and generalization capabilities in predicting image quality compared to peer methods. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) is a popular neurological disorder affecting a critical part of the world's population. Its early diagnosis is extremely imperative for enhancing the quality of patients' lives. Recently, improved technologies like image processing, artificial intelligence involving machine learning, deep learning, and transfer learning have been introduced for detecting AD. This review describes the contribution of image processing, feature extraction, optimization, and classification approach in AD recognition. It deeply investigates different methods adopted for multiclass diagnosis of AD. The paper further presents a brief comparison of existing AD studies in terms of techniques adopted, performance measures, classification accuracy, publication year, and datasets. It then summarizes the important technical barriers in reviewed works. This paper allows the readers to gain profound knowledge regarding AD diagnosis for promoting extensive research in this field. [ABSTRACT FROM AUTHOR]

The synthesis of rain fields is essential in multiple research fields and applications, including Single‐image Derain. However, there is a lack of research on simulated rain fields, and the existing rain field generation models struggle to capture complex spatial distributions and generate truly random rain fields. To address this, the authors propose a generative adversarial networks‐based rain field generation network, which consists of a generator, a discriminator, and a feature extraction block that can produce realistic and complex rain fields. The authors' experiments demonstrate that this method achieves an average Frechet Inception Distance score of 0.035, and user studies indicate that the generated rain distribution looks naturally. [ABSTRACT FROM AUTHOR]

Infrared object detection and tracking in dense urban traffic remain a challenge due to factors such as low contrast, small intra‐class differences, and frequent false positives and negatives. To overcome these, the authors introduce YOLO‐IR, an algorithm based on the enhanced YOLOv8s, and YOLO‐DeepOC‐IR, a comprehensive infrared multi‐object tracking method for urban traffic, integrating both detection and tracking. During preprocessing, three infrared image enhancement techniques, local contrast multi‐scale enhancement, non‐local means, and contrast limited adaptive histogram equalization, are applied for better reliability in dense scenes. To further improve the performance, the original YOLOv8s backbone is replaced with MobileVITv3 to enhance detection accuracy and robustness. This infrared feature extraction module, incorporated into the detector, combines canny edge detection, Gabor filtering, and open operation layers, significantly boosting object detection in infrared imagery. The tracker's feature processing capabilities are improved using the learned arrangements of three patch codes descriptor and locality‐sensitive hashing for feature extraction and matching. Experimental results on FLIR ADAS v2 and InfiRay datasets indicate superior performance of this method, achieving 78.6% mAP and 151.1 FPS in detection, and up to 80.8% moving object tracking accuracy, 78.6% identification F1 score, and 62.1% higher order tracking accuracy in multi‐object tracking. [ABSTRACT FROM AUTHOR]

Pixel‐level labeling of regions of interest in an image is a key step in building a labeled training dataset for supervised deep learning networks of images. However, traditional manual labeling of cancerous regions in digital pathological images by doctors is time‐consuming and inefficient. To address this issue, this paper proposes an automatic labeling method for whole slide images, which combines clustering and edge detection techniques. The proposed method utilizes the multi‐level feature fusion model and the Long‐Short Term Memory network to discriminate the cancerous nature of the whole slide images, thereby improving the classification accuracy of the whole slide images. Subsequently, the automatic labeling of cancerous regions is achieved by integrating a density‐based clustering algorithm and an edge point extraction algorithm, both based on the discriminated results of the cancerous properties of whole slide images. The experimental results demonstrate the effectiveness of the proposed method, which offers an efficient and accurate solution to the challenging task of cancerous region labeling in digital pathological images. [ABSTRACT FROM AUTHOR]

Despite the existence of various super‐resolution (SR) methods, most of them focus on designing models for specific upscaling factors rather than fully exploiting inter‐scale correlation to improve efficiency. In contrast, multi‐scale SR methods can effectively reduce the redundancy of network parameters by aggregating the feature extraction processes corresponding to multiple scales into a unified process. The aim of this study is to enhance the compactness and efficiency of the SR model. Thus, an efficient multi‐scale SR method called the diverse branch feature refinement network (DBFRN) is proposed. By decoupling the training process and inference process based on the idea of structural re‐parameterization, multi‐branch topology is adopted to enrich multi‐scale learning and merge branches to achieve efficient inference with equivalent effects. Specifically, two re‐parameterization strategies are designed and two corresponding feature refinement blocks for different feature levels in multi‐scale SR network. Extensive experiments demonstrate that the proposed multi‐scale SR method is effective and efficient, and it can outperform advanced single‐scale methods in terms of quantity and quality. [ABSTRACT FROM AUTHOR]

Feature matching plays a crucial role in computer vision, with applications in visual localization, simultaneous localization and mapping (SLAM), image stitching, and more. It establishes correspondences between sets of feature points from multiple images, enabling various tasks. Over the years, feature matching has witnessed significant development, with an increasing number of methods being applied. However, different methods exhibit different degrees of applicability in different scenarios and requirements due to their different rationales. To cope with these issues, a comprehensive analysis and comparison of matching methods are essential. Existing reviews often lack coverage of deep learning models and focus more on feature detection and description, neglecting the matching process. This survey investigates feature detection, description, and matching techniques within the feature‐based image‐matching pipeline. Representative methods, their mechanisms, and application scenarios are also briefly introduced. In addition, comprehensive evaluations of classical and state‐of‐the‐art methods are conducted through extensive experiments on representative datasets. Particularly, matching‐based applications are compared to fully demonstrate the advantages of the methods. Lastly, this survey highlights current problems and development directions in matching methods, serving as a reference for researchers in the field. [ABSTRACT FROM AUTHOR]

Simple Summary: In the sorting process of Chinese softshell turtles, it is necessary to classify them based on their weight and accurately identify their plastron and carapace. This process requires heavy manual labor and complex mechanical processing methods. To improve processing efficiency and reduce costs, this article introduces machine vision technology, and a new image processing method is proposed. This method can estimate the weight of Chinese softshell turtles and accurately locate the positions of their plastron and carapace. The automation level of aquaculture can be greatly enhanced, and hardware costs can be reduced through software optimization through this approach. With the rapid development of the turtle breeding industry in China, the demand for automated turtle sorting is increasing. The automatic sorting of Chinese softshell turtles mainly consists of three parts: visual recognition, weight prediction, and individual sorting. This paper focuses on two aspects, i.e., visual recognition and weight prediction, and a novel method for the object detection and weight prediction of Chinese softshell turtles is proposed. In the individual sorting process, computer vision technology is used to estimate the weight of Chinese softshell turtles and classify them by weight. For the visual recognition of the body parts of Chinese softshell turtles, a color space model is proposed in this paper to separate the turtles from the background effectively. By applying multiple linear regression analysis for modeling, the relationship between the weight and morphological parameters of Chinese softshell turtles is obtained, which can be used to estimate the weight of turtles well. An improved deep learning object detection network is used to extract the features of the plastron and carapace of the Chinese softshell turtles, achieving excellent detection results. The mAP of the improved network reached 96.23%, which can meet the requirements for the accurate identification of the body parts of Chinese softshell turtles. [ABSTRACT FROM AUTHOR]

The image classification task of porcelain fragments is of great significance for the digital preservation of cultural heritage. However, common issues are encountered in the image processing of porcelain fragments, including the low computation speed, decreased accuracy due to the uneven distribution of sample categories, and model instability. This study proposes a novel Capsule Network model, referred to as LBCapsNet, which is suitable for the extraction of features from images of porcelain artifacts fragments. A bottleneck-like channel transformation module denoted by ChannelTrans, which resides between the convolutional layer and the PrimaryCaps layer, was first designed. This module is used to reduce the computational complexity and enhance the processing speed when dealing with intricate porcelain images. The MF-R loss function was then proposed by incorporating focal loss into the original loss function. This allows to address the issue of imbalanced distribution of ceramic shard samples and reduce the classification errors, which leads to faster convergence with smoother trend. Finally, an adaptive dynamic routing mechanism is designed with a dynamic learning rate to enhance the overall stability of the classification process. The experimental results obtained on public datasets, such as MNIST, Fashion- MNIST, CIFAR10, FMD and DTD as well as porcelain fragments dataset, demonstrate that LBCapsNet achieves high classification accuracy with faster and more stable computation compared with existing methods. Furthermore, the ability of LBCapsNet to process special textures can provide technical support for the digital preservation and restoration of cultural heritage. [ABSTRACT FROM AUTHOR]

The effective segmentation of clouds and cloud shadows is crucial for surface feature extraction, climate monitoring, and atmospheric correction, but it remains a critical challenge in remote sensing image processing. Cloud features are intricate, with varied distributions and unclear boundaries, making accurate extraction difficult, with only a few networks addressing this challenge. To tackle these issues, we introduce a multi-scale receptive field aggregation network (MRFA-Net). The MRFA-Net comprises an MRFA-Encoder and MRFA-Decoder. Within the encoder, the net includes the asymmetric feature extractor module (AFEM) and multi-scale attention, which capture diverse local features and enhance contextual semantic understanding, respectively. The MRFA-Decoder includes the multi-path decoder module (MDM) for blending features and the global feature refinement module (GFRM) for optimizing information via learnable matrix decomposition. Experimental results demonstrate that our model excelled in generalization and segmentation performance when addressing various complex backgrounds and different category detections, exhibiting advantages in terms of parameter efficiency and computational complexity, with the MRFA-Net achieving a mean intersection over union (MIoU) of 94.12% on our custom Cloud and Shadow dataset, and 87.54% on the open-source HRC_WHU dataset, outperforming other models by at least 0.53% and 0.62%. The proposed model demonstrates applicability in practical scenarios where features are difficult to distinguish. [ABSTRACT FROM AUTHOR]

Nowadays, many image processing and machine learning (ML) methods are used in mango-quality classification systems. Existing algorithms perform independently to capture the relationships between features in the dataset. Nevertheless, each method has its advantages and disadvantages. As a result, this study presents an ensemble-learning framework that combines the strengths of multiple ML algorithms to make predictions. Initially, different image processing algorithms are used to extract external mango features. Next, the dataset is constructed by combining those features with weight values from sensor signals. Following that, different ML algorithms are evaluated on the dataset to determine which ones are robust. Subsequently, various ensemble-learning approaches are deployed, such as bagging, boosting, and stacking. Finally, those models are evaluated and compared, to decide which model is suited for this study's dataset. In the experimental part, the assessment of errors demonstrates the usefulness of image processing algorithms. Furthermore, evaluation of the training models revealed that the stacking model, which integrates several methods in both the base learner and meta-learner, produced the highest results in precision, recall, F1-score, and accuracy, with values of 0.9855, 0.9901, 0.9876, and 0.9863, respectively. These experimental results confirm the robustness of the proposed methodologies for classifying mango quality. [ABSTRACT FROM AUTHOR]

The accurate online detection of laser welding penetration depth has been a critical problem to which the industry has paid the most attention. Aiming at the laser welding process of TC4 titanium alloy, a multi-sensor monitoring system that obtained the keyhole/molten pool images and laser-induced plasma spectrum was built. The influences of laser power on the keyhole/molten pool morphologies and plasma thermo-mechanical characteristics were investigated. The results showed that there were significant correlations among the variations of the keyhole–molten pool, plasma spectrum, and penetration depth. The image features and spectral features were extracted by image processing and dimension-reduction methods, respectively. Moreover, several penetration depth prediction models based on single-sensor features and multi-sensor features were established. The mean square error of the neural network model built by multi-sensor features was 0.0162, which was smaller than that of the model built by single-sensor features. The established high-precision model provided a theoretical basis for real-time feedback control of the penetration depth in the laser welding process. [ABSTRACT FROM AUTHOR]

Inverse halftoning is a technology that converts a binary image into a continuous tone image. Due to the wide application of inverse halftoning, many scholars have proposed several deep convolutional neural networks (DCNN) to optimize their performance. According to the observation, there is still room for improvement in content generation and detail recovery of the inverse halftone images generated by using the existing methods. Therefore, an inverse halftoning method based on supervised DCNN is proposed in this paper. The method consists of two parts: the multi‐level feature extraction model uses the down‐sampling to extract the features from the halftone image and remove the halftone noise dots on flat areas, which is implemented by four convolutional layers; the image reconstruction model uses up‐sampling to reconstruct image information, which is realized by four convolutional layers and two dense residual blocks. At the same time, in order to further recover the details, the down‐sampling feature maps and up‐sampling feature maps of the same size are concatenated by addition layers. Experimental results show that compared with other methods, the inverse halftone images obtained by the proposed network have better results in both subjective and objective evaluations. [ABSTRACT FROM AUTHOR]

Semantic segmentation of remote sensing (RS) images is a pivotal branch in the realm of RS image processing, which plays a significant role in urban planning, building extraction, vegetation extraction, etc. With the continuous advancement of remote sensing technology, the spatial resolution of remote sensing images is progressively improving. This escalation in resolution gives rise to challenges like imbalanced class distributions among ground objects in RS images, the significant variations of ground object scales, as well as the presence of redundant information and noise interference. In this paper, we propose a multi-scale context extraction network, ASPP+-LANet, based on the LANet for semantic segmentation of high-resolution RS images. Firstly, we design an ASPP+ module, expanding upon the ASPP module by incorporating an additional feature extraction channel, redesigning the dilation rates, and introducing the Coordinate Attention (CA) mechanism so that it can effectively improve the segmentation performance of ground object targets at different scales. Secondly, we introduce the Funnel ReLU (FReLU) activation function for enhancing the segmentation effect of slender ground object targets and refining the segmentation edges. The experimental results show that our network model demonstrates superior segmentation performance on both Potsdam and Vaihingen datasets, outperforming other state-of-the-art (SOTA) methods. [ABSTRACT FROM AUTHOR]

Internal pore defects are inevitable during laser powder bed fusion (LPBF), which have a significant impact on the mechanical properties of the parts. Therefore, detecting pores and obtaining their morphology will contribute to the quality of LPBF parts. Currently, supervised models are used for defect image detection, which requires a large amount of LPBF sample data, image labeling, and computing power equipment during the training process, resulting in high detection costs. This study extensively collected LPBF sample data and proposed a method for pore defect classification by obtaining its morphological features while detecting pore defects in optical microscopy (OM) images under various conditions. Compared with other advanced models, the proposed method achieves better detection accuracy on pore defect datasets with limited data. In addition, quickly detecting pore defects in a large number of labeling ground truth images will also contribute to the development of deep learning. In terms of image segmentation, the average accuracy scores of this method in the test images exceed 85%. The research results indicate that the algorithm proposed in this paper is suitable for quickly and accurately identifying pore defects from optical microscopy images. [ABSTRACT FROM AUTHOR]

Skin cancer is a perilous kind of cancer caused by damaged DNA and it leads to death. This damaged DNA causes uncontrolled proliferation of cells. Even though, the image analysis of lesions is highly difficult due to light reflections from skin surface, fluctuations at color lighting, variety of lesions' forms and sizes in skin cancer. Because of these issues, automatic recognition of skin cancer accurateness is decreased. Therefore, a Graph Convolutional Neural Network (GCNN) by ResNet 152 Transfer Learning Architype optimized with Chameleon Swarm Optimization Algorithm (GCNN-ResNet 152 TL-CSOA) is proposed at this manuscript for enhancing skin cancer detection with classification in medical image processing. Initially, the input images are taken from International Skin Imaging Collaboration (ISIC) of dermoscopic skin cancer imagery data set. Afterward, the input images are pre-processed utilizing trilateral filter method for removing noise. The pre-processed output is supplied to the process of feature extraction. Here, image features, like morphologic, gray scale statistic and Haralick texture features are extracted by Gray-Level Co-Occurrence Matrix window adaptive approach (GLCM-WAA) technique. After that, the GCNN-ResNet 152 TL classifies the skin cancer images into Actinic Keratosis, Basal Cell Carcinoma, Malignant Melanoma and Squamous Cell Carcinoma. Additionally, GCNN-ResNet 152 TL weight parameters is tuned by Chameleon Swarm Optimization Algorithm (CSOA). The simulation process is executed at Python tool. From simulation, the proposed approach attains 23.34%, 12.03%, 21.42% improved accuracy and 18.23%, 21.23%, 14.56% higher sensitivity compared with existing approaches. [ABSTRACT FROM AUTHOR]

RGB depth (RGB‐D) salient object detection (SOD) is a meaningful and challenging task, which has achieved good detection performance in dealing with simple scenes using convolutional neural networks, however, it cannot effectively handle scenes with complex contours of salient objects or similarly coloured salient objects and background. A novel end‐to‐end framework is proposed for RGB‐D SOD, which comprises of four main components: the cross‐modal attention feature enhancement (CMAFE) module, the multi‐level contextual feature interaction (MLCFI) module, the boundary feature extraction (BFE) module, and the multi‐level boundary attention guidance (MLBAG) module. The CMAFE module retains the more effective salient features by employing a dual‐attention mechanism to filter noise from two modalities. In the MLCFI module, a shuffle operation is used for high‐level and low‐level channels to promote cross‐channel information communication, and rich semantic information is extracted. The BFE module converts salient features into boundary features to generate boundary maps. The MLBAG module produces saliency maps by aggregating multi‐level boundary saliency maps to guide cross‐modal features in the decode stage. Extensive experiments are conducted on six public benchmark datasets, with the results demonstrating that the proposed model significantly outperforms 23 state‐of‐the‐art RGB‐D SOD models with regards to multiple evaluation metrics. [ABSTRACT FROM AUTHOR]

The quaternion windowed linear canonical transform is a tool for processing multidimensional data and enhancing the quality and efficiency of signal and image processing; however, it has disadvantages due to the noncommutativity of quaternion multiplication. In contrast, reduced biquaternions, as a special case of four-dimensional algebra, possess unique advantages in computation because they satisfy the multiplicative exchange rule. This paper proposes the reduced biquaternion windowed linear canonical transform (RBWLCT) by combining the reduced biquaternion signal and the windowed linear canonical transform that has computational efficiency thanks to the commutative property. Firstly, we introduce the concept of a RBWLCT, which can extract the time local features of an image and has the advantages of both time-frequency analysis and feature extraction; moreover, we also provide some fundamental properties. Secondly, we propose convolution and correlation operations for RBWLCT along with their corresponding generalized convolution, correlation, and product theorems. Thirdly, we present a fast algorithm for RBWLCT and analyze its computational complexity based on two dimensional Fourier transform (2D FTs). Finally, simulations and examples are provided to demonstrate that the proposed transform effectively captures the local RBWLCT-frequency components with enhanced degrees of freedom and exhibits significant concentrations. [ABSTRACT FROM AUTHOR]

The bridge bottom crack detection provides important state information for bridge disease control and safety assessment. This paper proposes a detection method based on deep learning Faster R‐CNN and BIM (Building Information Modeling). The UAV (Unmanned Aerial Vehicle) was used for close aerial photography to obtain high‐resolution crack images of the concrete surface at the bottom of a bridge. Through deep learning algorithms, a Faster R‐CNN model is trained and established for crack identifications. The crack identification accuracy rate and recall rate reach 92.03% and 96.54%, respectively. Crack images are mapped to a BIM model developed for the chosen bridge, and the box girder family with cracks and the three crack families of transverse cracks, longitudinal cracks and turtle cracks are established. The cracks are located and the visualization of the beam bridge with cracks was completed. In order to better assess the health condition of the bridge. The results show that the combination of UAV bridge crack detection and modelling solves the remote, visual and automated detection of cracks on the surface of bridge structures, which are difficult to reach manually, and has important scientific research and engineering application value. [ABSTRACT FROM AUTHOR]

Infrared image processing is an effective method for diagnosing faults in electrical equipment, in which target device segmentation and temperature feature extraction are key steps. Target device segmentation separates the device to be diagnosed from the image, while temperature feature extraction analyzes whether the device is overheating and has potential faults. However, the segmentation of infrared images of electrical equipment is slow due to issues such as high computational complexity, and the temperature information extracted lacks accuracy due to the insufficient consideration of the non-linear relationship between the image grayscale and temperature. Therefore, in this study, we propose an optimized maximum between-class variance thresholding method (OTSU) segmentation algorithm based on the Gray Wolf Optimization (GWO) algorithm, which accelerates the segmentation speed by optimizing the threshold determination process using OTSU. The experimental results show that compared to the non-optimized method, the optimized segmentation method increases the threshold calculation time by more than 83.99% while maintaining similar segmentation results. Based on this, to address the issue of insufficient accuracy in temperature feature extraction, we propose a temperature value extraction method for infrared images based on the K-nearest neighbor (KNN) algorithm. The experimental results demonstrate that compared to traditional linear methods, this method achieves a 73.68% improvement in the maximum residual absolute value of the extracted temperature values and a 78.95% improvement in the average residual absolute value. [ABSTRACT FROM AUTHOR]

Siamese‐based trackers have demonstrated robust performance in object tracking, while Transformers have achieved widespread success in object detection. Currently, many researchers use a hybrid structure of convolutional neural networks and Transformers to design the backbone network of trackers, aiming to improve performance. However, this approach often underutilises the global feature extraction capability of Transformers. The authors propose a novel Transformer‐based tracker that fuses spatial and temporal features. The tracker consists of a multilayer spatial feature fusion network (MSFFN), a temporal feature fusion network (TFFN), and a prediction head. The MSFFN includes two phases: feature extraction and feature fusion, and both phases are constructed with a Transformer. Compared with the hybrid structure of "CNNs + Transformer," the proposed method enhances the continuity of feature extraction and the ability of information interaction between features, enabling comprehensive feature extraction. Moreover, to consider the temporal dimension, the authors propose a TFFN for updating the template image. The network utilises the Transformer to fuse the tracking results of multiple frames with the initial frame, allowing the template image to continuously incorporate more information and maintain the accuracy of target features. Extensive experiments show that the tracker STFT achieves state‐of‐the‐art results on multiple benchmarks (OTB100, VOT2018, LaSOT, GOT‐10K, and UAV123). Especially, the tracker STFT achieves remarkable area under the curve score of 0.652 and 0.706 on the LaSOT and OTB100 benchmark respectively. [ABSTRACT FROM AUTHOR]

Feature extraction and matching are the basic procedures of the so-called Visual Odometer (VO), Simultaneous Localization and Mapping (SLAM) and many other image processing algorithms. Oriented features from accelerated segment test (FAST) and rotated binary robust independent elementary features (ORB) algorithm are widely used since they are computationally faster. In this paper, we proposed a method to generate a value for a feature, the value is called signature. In the matching step, we only compute Hamming distances of descriptors with the same signatures. Hence, the matching time is shortened. Compared with the original ORB algorithm, features to be matched dropped 69.63% on TUM datasets and 85.7% on VGG datasets by adopting our strategy. In addition, the precision is above 85% on both VGG and TUM datasets. We design a customized hardware architecture for ORB feature extraction and matching based on the proposed method. The hardware structure is implemented on Xilinx ZCU102 evaluation board. The clock frequency is set to 150 MHz. Our Field Programmable Gate Arrays (FPGA) system achieves 193 fps on 1 2 8 0 × 7 2 0 images with 1984 features on average and 314 fps on 6 4 0 × 4 8 0 images with 700 features on average, which is more efficient compared to the state-of-the-art works. [ABSTRACT FROM AUTHOR]

Purpose: To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies. Methods: We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated. Result: In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community. Conclusion: In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers. Critical relevance statement: A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning. Key points: • A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score (https://metricsscore.github.io/metrics/METRICS.html) and a repository created to collect feedback from the radiomics community (https://github.com/metricsscore/metrics). [ABSTRACT FROM AUTHOR]