Search

In this work, we introduce a novel framework, GAN-based Image Processing (GAN-IP), to design and manipulate digital experimental settings that effectively combine computer vision and image processing technology. Using the skills of Generative Adversarial Networks (GANs), GAN-IP creates and complements virtual scenes and affords rich, adaptive surroundings for analysing and creating computationally smart and perceptive algorithms. GAN-IP solves the pressing troubles of variability and absence of data through synthesising realistic pictures and scenarios, enabling simulations of the diverse environments in which computer vision structures have to function. Our approach improves the fidelity and sort of digital scenes and introduces a way to mechanically alter and evoke a pleasant image, enabling more accurate and powerful computer vision and prescient models. Through extensive experimentation, GAN-IP demonstrates remarkable improvements in the performance of computer vision tasks, including object detection, segmentation, and recognition in complicated virtual environments. This research lays the foundation for future studies in this field and provides an adaptive tool for researchers and practitioners to simulate and test superior computer imaginative and prescient image processing technologies. [ABSTRACT FROM AUTHOR]

Optical analog image processing technology is expected to provide an effective solution for high-throughput and real-time data processing with low power consumption. In various operations, optical spatial differential operations are essential in edge extraction, data compression, and feature classification. Unfortunately, existing methods can only perform low-order or selectively perform a particular high-order differential operation. Here, we propose and experimentally demonstrate a Bessel vortex modulated metalens composed of a single complex amplitude metasurface, which can perform multiple-order radial differential operations over a wide band by presetting the order of the corresponding Bessel vortex. This architecture further enables angle multiplexing to create multiple information channels that synchronously perform multi-order spatial differential operations, indicating the superiority of the proposed devices in parallel processing. Our approach may find various applications in artificial intelligence, machine vision, autonomous driving, and advanced biomedical imaging. A Bessel vortex modulated metalens is used for wide-band, multiple-order radial differential operations by presetting the order of the corresponding Bessel vortex. This enables synchronous spatial differential operations, with applications in optical data processing, machine vision and bio-imaging. [ABSTRACT FROM AUTHOR]

Image super‐resolution (SR) has been widely applied in remote sensing to generate high‐resolution (HR) images without increasing hardware costs. However, SR is a severe ill‐posed problem. As deep learning advances, existing methods have solved this problem to a certain extent. However, the complex spatial distribution of remote sensing images still poses a challenge in effectively extracting abundant high‐frequency details from the images. Here, a single‐image super‐resolution (SISR) network based on the generative adversarial network (GAN) for remote sensing is presented, called JOA‐GAN. Firstly, a joint‐attention module (JOA) is proposed to focus the network on high‐frequency regions in remote sensing images to enhance the quality of image reconstruction. In the generator network, a multi‐scale densely connected feature extraction block (ERRDB) is proposed, which acquires features at different scales using MSconv blocks containing multi‐scale convolutions and automatically adjusts the features by JOA. In the discriminator network, the relative discriminator is used to compute the relative probability instead of the absolute probability, which helps the network learn clearer and more realistic texture details. JOA‐GAN is compared with other advanced methods, and the results demonstrate that JOA‐GAN has improved objective evaluation metrics and achieved superior visual effects. [ABSTRACT FROM AUTHOR]

In recent years, multi‐human parsing has become a focal point in research, yet prevailing methods often rely on intermediate stages and lacking pixel‐level analysis. Moreover, their high computational demands limit real‐world efficiency. To address these challenges and enable real‐time performance, low‐latency end‐to‐end network is proposed. This approach leverages vision transformer and convolutional neural network in a dual‐encoded network, featuring a lightweight Transformer‐based vision encoder) and a convolution encoder based on Darknet. This combination adeptly captures long‐range dependencies and spatial relationships. Incorporating a fuse block enables the seamless merging of features from the encoders. Residual connections in the decoder design amplify information flow. Experimental validation on crowd instance‐level human parsing and look into person datasets showcases the WNet's effectiveness, achieving high‐speed multi‐human parsing at 26.7 frames per second. Ablation studies further underscore WNet's capabilities, emphasizing its efficiency and accuracy in complex multi‐human parsing tasks. [ABSTRACT FROM AUTHOR]

Missing pixel imputation presents a critical challenge in image processing and computer vision, particularly in applications such as image restoration and inpainting. The primary objective of this paper is to accurately estimate and reconstruct missing pixel values to restore complete visual information. This paper introduces a novel model called the Enhanced Connected Pixel Identity GAN with Neutrosophic (ECP-IGANN), which is designed to address two fundamental issues inherent in existing GAN architectures for missing pixel generation: (1) mode collapse, which leads to a lack of diversity in generated pixels, and (2) the preservation of pixel integrity within the reconstructed images. ECP-IGANN incorporates two key innovations to improve missing pixel imputation. First, an identity block is integrated into the generation process to facilitate the retention of existing pixel values and ensure consistency. Second, the model calculates the values of the 8-connected neighbouring pixels around each missing pixel, thereby enhancing the coherence and integrity of the imputed pixels. The efficacy of ECP-IGANN was rigorously evaluated through extensive experimentation across five diverse datasets: BigGAN-ImageNet, the 2024 Medical Imaging Challenge Dataset, the Autonomous Vehicles Dataset, the 2024 Satellite Imagery Dataset, and the Fashion and Apparel Dataset 2024. These experiments assessed the model's performance in terms of diversity, pixel imputation accuracy, and mode collapse mitigation, with results demonstrating significant improvements in the Inception Score (IS) and Fréchet Inception Distance (FID). ECP-IGANN markedly enhanced image segmentation performance in the validation phase across all datasets. Key metrics, such as Dice Score, Accuracy, Precision, and Recall, were improved substantially for various segmentation models, including Spatial Attention U-Net, Dense U-Net, and Residual Attention U-Net. For example, in the 2024 Medical Imaging Challenge Dataset, the Residual Attention U-Net's Dice Score increased from 0.84 to 0.90, while accuracy improved from 0.88 to 0.93 following the application of ECP-IGANN. Similar performance enhancements were observed with the other datasets, highlighting the model's robust generalizability across diverse imaging domains. [ABSTRACT FROM AUTHOR]

The recently developed high-throughput system for cell spheroid generation (SpheroWell) is a promising technology for cost- and time-efficient in vitro analysis of, for example, chondrogenic differentiation. It is a compartmental growth surface where spheroids develop from a cell monolayer by self-assembling and aggregation. In order to automatize the analysis of spheroids, we aimed to develop imaging software and improve the localization of cell compartments and fully formed spheroids. Our workflow provides automated detection and localization of spheroids in different formation stages within Petri dishes based on images created with a low-budget camera imaging setup. This automated detection enables a fast and inexpensive analysis workflow by processing a stack of images within a short period of time, which is essential for the extraction of early readout parameters. Our workflow combines image processing algorithms and deep learning-based image localization/segmentation methods like Mask R-CNN and Unet++. These methods are refined by an evolution strategy for automated grid detection, which is able to improve the overall segmentation and classification quality. Besides the already pre-trained neural networks and predefined image processing parameters, our evolution-based post-processing provides the required adaptability for our workflow to deliver a consistent and reproducible quality. This is especially important due to the use of a low-budget imaging setup with various light conditions. The to-be-detected objects of the three different stages show improved results using our evolutionary post-processing for monolayer and starting aggregation with Dice coefficients of 0.7301 and 0.8562, respectively, compared with the raw scores of 0.2879 and 0.8187. The Dice coefficient of the fully formed spheroids in both cases is 0.8829. With our algorithm, we provide automated analyses of cell spheroid by self-assembling in SpheroWell dishes, even if the images are created using a low-budget camera setup. [ABSTRACT FROM AUTHOR]

This article presents the research results in the application of image processing in determining the position, direction, and moving speed of different objects when they move in the free space in the field of view of measuring cameras. The research includes developing an algorithm to detect, identify, and locate objects and an algorithm to calculate the movement direction and instantaneous velocity of the object. Two robots with measurement systems were designed for testing, one carries the investigating object, and the other the camera. These robots can communicate with a computer system using a tele-wireless system. A program was also built for capturing images and analyzing the state of the model automatically. Experimental results show that the position, angle, and velocity of different objects can be captured well. The average error in determining the direction of movement is an average of 1.25°, and the error of the moving speed is less than 0.5 m/s. The research results provide a potential tool for designing robots for highly effective detection. The algorithm and the measurement system are simple and inexpensive but highly effective, and they can be used in the initial process of determining an object. A detailed description of the algorithm, robot system, and testing will be presented in this study. [ABSTRACT FROM AUTHOR]

Featured Application: This paper describes an application that is currently used in the national railway transportation system to measure zigzag length. Currently, measurements are performed in the laboratory based on images recorded of the contact point between the pantograph and the contact wire based on the geographical position of the present location. A prospective future application provides a real-time approach for measuring zigzag length by employing pattern recognition in images. Recent years have seen outstanding developments in research and technology, highlighting the importance of railway transportation, especially the implementation of high-speed trains, which is becoming more and more challenging. This facilitates extensive research into the science and technology of the electrical interaction between the components of pantograph–catenary systems (PCSs). Problems regarding the PCS can result in infrastructure incidents, potentially stopping train operations. A common cause of failure in electrified railway PCS is a contact wire's zigzag length that exceeds the prescribed technical limit, which can be caused by missing droppers or faults in the mounting mechanism. This work proposes a video camera-based monitoring technique for zigzag geometry measurement that additionally employs a Global Positioning System (GPS) sensor to detect the current geographical position of the point of zigzag length measurement. There are two proposed techniques for measuring the length of the zigzag based on image processing. In the first technique, using previously recorded data, the images are analyzed in the laboratory, and in the second, the images are analyzed in real time. Based on the results, we suggest a model and prediction of zigzag length employing hybrid deep neural networks. [ABSTRACT FROM AUTHOR]

The grading of products is important in many ways. One of the important activities after harvesting agricultural products is product grading based on shape and color dimensions. This activity in the agricultural transformation industries, Bas Controller, improves various processes on fruits and vegetables with the same dimensions, which improves the storage conditions of the product, creates added value for the farmer, and gives the consumer the power to choose. The main focus of this study is the application of image processing in the field of identification and classification of fruits. It is an application that has received much less attention than other applications of image processing. The proposed systems presented in this article, are software solutions based on image processing techniques, including histogram matching techniques, for detection, Sable edge detection algorithms, Private edge and Kenny edge, Otsu threshold limit, and clustering method It is an automatic mean and classification of different degrees of fruit. In addition, it has been mentioned more about the examination and description of product grading and clustering methods, that by using the proposed application hardware and its connection with the software, a big step can be taken in product quality grading. This method can be used in product classification and packaging. The accuracy rate for peaches, lemons, apples, and tomatoes is 94.58%, 88.23%, 70%, and 93.33%, respectively. The best accuracy for all 20 sample levels is for peach fruit. [ABSTRACT FROM AUTHOR]

The advent of deep neural networks and improved computational power have brought a revolutionary transformation in the fields of computer vision and image processing. Within the realm of computer vision, there has been a significant interest in the area of synthetic image generation, which is a creative side of AI. Many researchers have introduced innovative methods to identify deep neural network‐based architectures involved in image generation via different modes of input, like text, scene graph layouts and so forth to generate synthetic images. Computer‐generated images have been found to contribute a lot to the training of different machine and deep‐learning models. Nonetheless, we have observed an immediate need for a comprehensive and systematic literature review that encompasses a summary and critical evaluation of current primary studies' approaches toward image generation. To address this, we carried out a systematic literature review on synthetic image generation approaches published from 2018 to February 2023. Moreover, we have conducted a systematic review of various datasets, approaches to image generation, performance metrics for existing methods, and a brief experimental comparison of DCGAN (deep convolutional generative adversarial network) and cGAN (conditional generative adversarial network) in the context of image generation. Additionally, we have identified applications related to image generation models with critical evaluation of the primary studies on the subject matter. Finally, we present some future research directions to further contribute to the field of image generation using deep neural networks. [ABSTRACT FROM AUTHOR]

Urban Heat Islands are a major environmental and public health concern, causing temperature increase in urban areas. This study used satellite imagery and machine learning to analyze the spatial and temporal patterns of land surface temperature distribution in the Metropolitan Area of Merida (MAM), Mexico, from 2001 to 2021. The results show that land surface temperature has increased in the MAM over the study period, while the urban footprint has expanded. The study also found a high correlation ( r > 0.8) between changes in land surface temperature and land cover classes (urbanization/deforestation). If the current urbanization trend continues, the difference between the land surface temperature of the MAM and its surroundings is expected to reach 3.12 °C ± 1.11 °C by the year 2030. Hence, the findings of this study suggest that the Urban Heat Island effect is a growing problem in the MAM and highlight the importance of satellite imagery and machine learning for monitoring and developing mitigation strategies. [ABSTRACT FROM AUTHOR]

The rapid growth of deep learning technology has made object detection in remote sensing images an important aspect of computer vision, finding applications in military surveillance, maritime rescue, and environmental monitoring. Nonetheless, the capture of remote sensing images at high altitudes causes significant scale variations, resulting in a heterogeneous range of object scales. These varying scales pose significant challenges for detection algorithms. To solve the scale variation problem, traditional detection algorithms compute multi-layer feature maps. However, this approach introduces significant computational redundancy. Inspired by the mechanism of cognitive scaling mechanisms handling multi-scale information, we propose a novel Scale Selection Network (SSN) to eliminate computational redundancy through scale attentional allocation. In particular, we have devised a lightweight Landmark Guided Scale Attention Network, which is capable of predicting potential scales in an image. The detector only needs to focus on the selected scale features, which greatly reduces the inference time. Additionally, a fast Reversible Scale Semantic Flow Preserving strategy is proposed to directly generate multi-scale feature maps for detection. Experiments demonstrate that our method facilitates the acceleration of image pyramid-based detectors by approximately 5.3 times on widely utilized remote sensing object detection benchmarks. [ABSTRACT FROM AUTHOR]

Bird‐related outages greatly threaten the safety of overhead transmission and distribution lines, while electrocution and collisions of birds with power lines, especially endangered species, are significant environmental concerns. Automatic bird recognition can be helpful to mitigate this contradiction. This paper proposes a method for automatic classification of bird species related to power line faults combining deep convolution features with error‐correcting output codes support vector machine (ECOC‐SVM). An image dataset of about 20 high‐risk and 20 low‐risk bird species was constructed, and the feed‐forward denoising convolutional neural network was used for image preprocessing. The deep convolution features of bird images were extracted by DarkNet‐53, and taken as inputs of the ECOC‐SVM for model training and bird species classification. The gradient‐weighted class activation mapping was used for visual explanations of the model decision region. The experimental results indicate that the average accuracy of the proposed method can reach 94.39%, and its performance was better than other models using different feature extraction networks and classification algorithms. [ABSTRACT FROM AUTHOR]

Growing concerns about food safety and waste have increased consumer demand for high-quality agricultural products, particularly at the postharvest stage. This demand has prompted the development of non-destructive methods to assess or inspect the internal quality of fruits and vegetables. The backscattering imaging technique, also known as diffuse reflectance imaging, is considered a highly promising approach. Numerous studies have focused on practical applications, using laser light at selected wavelengths to develop quick multispectral methods. Due to the rapid interaction of photons with biological tissue, together with the highly computational performance of machine vision, backscattering imaging can offer a valuable alternative to traditional methods. Its primary benefits include quick measurements without chemical sample preparation, easy integration with high-throughput automatic quality control, and reduced waste, since this non-destructive technique does not damage samples. This review presents a comprehensive overview of backscattering imaging, including the measurement geometry, data analysis, and design considerations for vision systems. Additionally, it explores this technique's advantages, challenges, and accuracy, as demonstrated using various case studies. [ABSTRACT FROM AUTHOR]

We introduce a novel end-to-end deep-learning solution for rapidly estimating a dense spherical depth map of an indoor environment. Our input is a single equirectangular image registered with a sparse depth map, as provided by a variety of common capture setups. Depth is inferred by an efficient and lightweight single-branch network, which employs a dynamic gating system to process together dense visual data and sparse geometric data. We exploit the characteristics of typical man-made environments to efficiently compress multi-resolution features and find short- and long-range relations among scene parts. Furthermore, we introduce a new augmentation strategy to make the model robust to different types of sparsity, including those generated by various structured light sensors and LiDAR setups. The experimental results demonstrate that our method provides interactive performance and outperforms state-of-the-art solutions in computational efficiency, adaptivity to variable depth sparsity patterns, and prediction accuracy for challenging indoor data, even when trained solely on synthetic data without any fine tuning. [ABSTRACT FROM AUTHOR]

Driving while inattentive or fatigued significantly contributes to traffic accidents and puts road users at a significantly higher risk of collision. The rise in road accidents due to driver inattention resulting from distractive objects, for example, mobile phones, drinking, or tiredness, requires intelligent traffic monitoring systems to promote road safety. However, outdated detection technologies cannot handle the poor accuracy and the lack of real‐time processing possibility especially when combined with the variations of driving environment. This paper introduces "ME‐YOLOv8" which operates driver's distraction and fatigue through a modified version of YOLOv8, which includes modules multi‐head self‐attention (MHSA) and efficient channel attention (ECA) modules applied, where the goal of MHSA is to improve the sensitivity of global features and the ECA attentions focus on critical features. Additionally, a dataset was created containing 3660 images covering multiple distracted and drowsy driver scenarios. The results reflect the enhanced detection capabilities of ME‐YOLOv8 and demonstrate its effectiveness in real‐time scenarios. This study demonstrates a significant advancement in the application of AI to public safety and highlights the critical role that state‐of‐the‐art deep learning algorithms play in lowering the risks associated with distracted and tired driving. [ABSTRACT FROM AUTHOR]

Advances in deep learning can address a variety of computer vision problems. In particular, deep learning has shown high performance in image processing. However, large datasets are required to train deep learning models. Previous studies have addressed the problem of data scarcity via the few-shot learning technique. However, a drawback of these studies is that large datasets are required when new tasks are performed. Hence, this study uses data augmentation techniques to address this shortcoming. Furthermore, we propose an image classification system with a few-shot learning technique that achieves high accuracy, even on rare datasets. Compared with traditional image classification models, the proposed system improves classification accuracy by approximately 18% using 100 data points. [ABSTRACT FROM AUTHOR]

The construction industry plays an important role in China's economy. However, traditional construction quality inspection methods have problems such as low efficiency, high leakage rate, and poor real-time performance. Therefore, taking the appearance quality defects of reinforced concrete engineering as an example, this study combines building information models and computer vision technology. By this way, it can achieve automatic quality inspection and intelligent quality problem prevention, to improve the quality management level during the construction process. In this study, ResNet50 network was pre-trained and classified using a self-made defect image database. After transfer learning, the accuracy values of the training and testing sets remained stable at around 0.95 and the loss value remained stable at around 0.10 after 10 epochs, indicating a significant improvement in learning performance. In the defect area quantification experiment, four corner coordinates of the defect image were calculated. These corner coordinates are simultaneously obtained and saved during on-site image acquisition. According to the calculation results, the defect area of honeycomb is approximately 67.67 square centimetres. These results confirm that this method improves the efficiency and accuracy of quality inspection and has potential application in quality inspection of prefabricated building construction. [ABSTRACT FROM AUTHOR]

This research work focuses on the design and implementation of a highly advanced field-programmable gate array (FPGA)-based system-on-chip (SoC) solution for real-time edge detection. By utilizing a Zynq processor and leveraging the powerful Vivado software, the aim is to overcome the significant computational challenges associated with achieving real-time edge detection. Edge detection in real-time scenarios presents several obstacles, including the possibility of missing edges due to noise and the substantial processing requirements of any edge detection technique. To address these challenges, the proposed SoC system synergistically combines the computational capabilities of an FPGA board and a Zynq processor, harnessing hardware acceleration to achieve high-performance edge detection. The OV7670 camera module serves as the primary input medium, capturing image frames for subsequent processing. These captured frames undergo initial processing before being seamlessly transferred to the FPGA fabric through customized intellectual property (IP) blocks. These IP blocks efficiently handle crucial tasks such as frame capturing, conversion to AXI Stream interface signals, and integration with the video direct memory access (VDMA) IP. The VDMA IP plays a pivotal role by facilitating high-speed data movement between the FPGA fabric and the Zynq processor IP, thereby enabling streamlined and efficient data transfer and processing. At the heart of this project lies the real-time edge detection algorithm, which is skillfully implemented on the Zynq processor. The resulting edge-detected frames are then visually presented and displayed on an output device utilizing the AXI4-Stream to Video Out IP. To ensure optimal utilization of available hardware resources, the comprehensive Vivado software suite provides a wide array of tools for designing, implementing, and programming the FPGA fabric. By leveraging FPGA-based systems, this project effectively addresses the critical need for real-time edge detection in time-sensitive scenarios. The result is a portable and manageable device that exhibits versatility, as it can be employed in various applications while reliably detecting edges in real-time situations. [ABSTRACT FROM AUTHOR]

Countersink inspection is crucial in various automated assembly lines, especially in the aerospace and automotive sectors. Advancements in machine vision introduced automated robotic inspection of countersinks using laser scanners and monocular cameras. Nevertheless, the aforementioned sensing pipelines require the robot to pause on each hole for inspection due to high latency and measurement uncertainties with motion, leading to prolonged execution times of the inspection task. The neuromorphic vision sensor, on the other hand, has the potential to expedite the countersink inspection process, but the unorthodox output of the neuromorphic technology prohibits utilizing traditional image processing techniques. Therefore, novel event-based perception algorithms need to be introduced. We propose a countersink detection approach on the basis of event-based motion compensation and the mean-shift clustering principle. In addition, our framework presents a robust event-based circle detection algorithm to precisely estimate the depth of the countersink specimens. The proposed approach expedites the inspection process by a factor of 10 × compared to conventional countersink inspection methods. The work in this paper was validated for over 50 trials on three countersink workpiece variants. The experimental results show that our method provides a standard deviation of 0.025 mm and an accuracy of 0.026 mm for countersink depth inspection despite the low resolution of commercially available neuromorphic cameras. Video Link: https://www.dropbox.com/s/pateqqwh4d605t3/final_video_new.mp4?dl=0. [ABSTRACT FROM AUTHOR]

In various countries worldwide, the incidence of colon cancer-related deaths has been on the rise in recent years. Early detection of symptoms and identification of intestinal polyps are crucial for improving the cure rate of colon cancer patients. Automated computer-aided diagnosis (CAD) has emerged as a solution to the low efficiency of traditional methods relying on manual diagnosis by physicians. Deep learning is the latest direction of CAD development and has shown promise for colonoscopic polyp segmentation. In this paper, we present a multi-level encoder-decoder architecture for polyp segmentation based on the Transformer architecture, termed NA-SegFormer. To improve the performance of existing Transformer-based segmentation algorithms for edge segmentation on colon polyps, we propose a patch merging module with a neighbor attention mechanism based on overlap patch merging. Since colon tract polyps vary greatly in size and different datasets have different sample sizes, we used a unified focal loss to solve the problem of category imbalance in colon tract polyp data. To assess the effectiveness of our proposed method, we utilized video capsule endoscopy and typical colonoscopy polyp datasets, as well as a dataset containing surgical equipment. On the datasets Kvasir-SEG, Kvasir-Instrument and KvasirCapsule-SEG, the Dice score of our proposed model reached 94.30%, 94.59% and 82.73%, with an accuracy of 98.26%, 99.02% and 81.84% respectively. The proposed method achieved inference speed with an Frame-per-second (FPS) of 125.01. The results demonstrated that our suggested model effectively segmented polyps better than several well-known and latest models. In addition, the proposed method has advantages in trade-off between inference speed and accuracy, and it will be of great significance to real-time colonoscopic polyp segmentation. The code is available at https://github.com/promisedong/NAFormer. [ABSTRACT FROM AUTHOR]

Leukemia is a type of blood tumour that occurs because of abnormal enhancement in WBCs (white blood cells) in the bone marrow of the human body. Blood-forming tissue cancer influences the lymphatic and bone marrow system. The early diagnosis and detection of leukaemia, i.e., the accurate difference of malignant leukocytes with little expense at the beginning of the disease, is a primary challenge in the disease analysis field. Despite the higher occurrence of leukemia, there is a lack of flow cytometry tools, and the procedures accessible at medical diagnostics centres are time-consuming. Distinct researchers have implemented computer-aided diagnostic (CAD) and machine learning (ML) methods for laboratory image analysis, aiming to manage the restrictions of late leukemia analysis. This study proposes a new Falcon optimization algorithm with deep convolutional neural network for Leukemia detection and classification (FOADCNN-LDC) technique. The main objective of the FOADCNN-LDC technique is to classify and recognize leukemia. The FOADCNN-LDC technique utilizes a median filtering (MF) based noise removal process to eradicate the image noise. Besides, the FOADCNN-LDC technique employs the ShuffleNetv2 model for the feature extraction process. Moreover, the detection and classification of the leukemia process are performed by utilizing the convolutional denoising autoencoder (CDAE) model. The FOA is implemented to select the hyperparameter of the CDAE model. The simulation process of the FOADCNN-LDC approach is performed on a benchmark medical dataset. The investigational analysis of the FOADCNN-LDC approach highlighted a superior accuracy value of 99.62% over existing techniques. [ABSTRACT FROM AUTHOR]

In order to improve the accuracy of granular image detection during image scaling, an image scaling algorithm combining the interpolation algorithm of protective features and Kalman filtering of neurons is proposed. Firstly, the interpolation algorithm of protective features is de‐designed according to the phenomenon of sudden change of edge grey values, and the difference and trend of grey values in horizontal and vertical directions are used to obtain the pre‐scaled image with maximum contrast. Then the grey value data input of the pre‐scaled image is introduced into the Kalman filter of neurons, and the filtering process is optimized by using the black‐box thinking of neurons, and the pre‐scaled image is smoothed. Finally, the scale transformation is implemented to obtain the final grey value to complete the final scaling, so that the image has both visual experience and features. Comparison with mainstream image scaling algorithms shows that the proposed algorithm can effectively overcome the degradation of granularity image detection accuracy due to image scaling, with point acutance value (PAV) improved by 10%–41%, and the granularity detection error caused by image scaling algorithms reduced from about 0.7% to about 0.1%, with a relative improvement of 85%. [ABSTRACT FROM AUTHOR]

Head pose estimation is an especially challenging task due to the complexity nonlinear mapping from 2D feature space to 3D pose space. To address the above issue, this paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network. Firstly, a new network, the region and difference‐aware feature pyramid network (RD‐FPN), is proposed for 2D keypoints detection to alleviate the background interference and enhance the feature expressiveness. Then, particle swarm optimized contrastive learning is constructed to alternatively match 2D and 3D keypoints, which takes the multimodal keypoints matching accuracy as the optimization objective, while considering the similarity of cross‐modal positive and negative sample pairs from contrastive learning as a local contrastive constraint. Finally, multimodal entangled graph convolution network is designed to enhance the ability of establishing geometric relationships between keypoints and head pose angles based on second‐order bilinear attention, in which point‐edge attention is introduced to improve the representation of geometric features between multimodal keypoints. Compared with other methods, the average error of our method is reduced by 8.23%, indicating the accuracy, generalization, and efficiency of our method on the 300W‐LP, AFLW2000, BIWI datasets. [ABSTRACT FROM AUTHOR]

Transformer possesses a broader perceptual scope, while the Convolutional Neural Network (CNN) excels at capturing local information. In this paper, the authors propose the Multi‐Sclale Feature Aggregation Network (MSFA‐Net) for single‐image dehazing which is fused with the advantages of Transformer and CNN. Our MSFA‐Net is based on the encoder–decoder structure, and there are four main innovations. Firstly, the authors make some improvements to the original Swin Transformer to make it more effective for dehazing tasks, and the authors name it Spatial Information Aggregation Transformer (SIAT). The authors place the SIAT in both encoder and decoder of MSFA‐Net for feature extraction. The authors propose an upsampling module called Efficient Spatial Resolution Recovery (ESRR) which is placed in the decoder part. Compared to commonly used transposed convolutions, the authors' ESRR module has fewer computational cost. Considering that the haze distribution is always uneven and the information from each channel is different, the authors introduce the Dynamic Multi‐Attention (DMA) module to provide pixel‐wise weights and channel‐wise weights for input features. The authors place the DMA module between the encoder and decoder parts. As the network depth increases, the spatial structural information from the high‐resolution layer tends to degrade. To deal with the problem, the authors propose the Multi‐Scale Feature Fusion (MSFF) module to recover missing spatial structural information. The authors place the MSFF module in both the encoder and decoder parts. Extensive experimental results show that the authors' proposed dehazing network achieves state‐of‐the‐art dehazing performance with relatively low computational cost. [ABSTRACT FROM AUTHOR]

To address the high cost associated with acquiring hyperspectral data, spectral reconstruction (SR) has emerged as a prominent research area. However, contemporary SR techniques are more focused on image processing tasks in computer vision than on practical applications. Furthermore, the prevalent approach of employing single-dimensional features to guide reconstruction, aimed at reducing computational overhead, invariably compromises reconstruction accuracy, particularly in complex environments with intricate ground features and severe spectral mixing. Effectively utilizing both local and global information in spatial and spectral dimensions for spectral reconstruction remains a significant challenge. To tackle these challenges, this study proposes an integrated network of 3D CNN and U-shaped Transformer for heterogeneous spectral reconstruction, ICTH, which comprises a shallow feature extraction module (CSSM) and a deep feature extraction module (TDEM), implementing a coarse-to-fine spectral reconstruction scheme. To minimize information loss, we designed a novel spatial–spectral attention module (S2AM) as the foundation for constructing a U-transformer, enhancing the capture of long-range information across all dimensions. On three hyperspectral datasets, ICTH has exhibited remarkable strengths across quantitative, qualitative, and single-band detail assessments, while also revealing significant potential for subsequent applications, such as generalizability and vegetation index calculations) in two real-world datasets. [ABSTRACT FROM AUTHOR]

Currently, there is a demand for an increase in the diversity and quality of new products reaching the consumer market. This fact imposes new challenges for different industrial sectors, including processes that integrate machine vision. Hardware acceleration and improvements in processing efficiency are becoming crucial for vision-based algorithms to follow the complexity growth of future industrial systems. This article presents a generic library of pre-processing filters for execution in field-programmable gate arrays (FPGAs) to reduce the overall image processing time in vision systems. An experimental setup based on the Zybo Z7 Pcam 5C Demo project was developed and used to validate the filters described in VHDL (VHSIC hardware description language). Finally, a comparison of the execution times using GPU and CPU platforms was performed as well as an evaluation of the integration of the current work in an industrial application. The results showed a decrease in the pre-processing time from milliseconds to nanoseconds when using FPGAs. [ABSTRACT FROM AUTHOR]

Existing approaches for image deraining often rely on synthetic or unpaired real-world rainy datasets, leading to sub-optimal generalization ability when processing the complex and diverse real-world rain degradation. To address these challenges, we propose a novel iterative semantic-guided detail fusion model with implicit neural representations (INR-ISDF). This approach addresses the challenges of complex solution domain variations, reducing the usual negative impacts found in these situations. Firstly, the input rainy images are processed through implicit neural representations (INRs) to obtain normalized images. Residual calculations are then used to assess the illumination inconsistency caused by rain degradation, thereby enabling an accurate identification of the degradation locations. Subsequently, the location information is incorporated into the detail branch of the dual-branch architecture, while the normalized images obtained from the INR are used to enhance semantic processing. Finally, we use semantic clues to iteratively guide the progressive fusion of details to achieve improved image processing results. To tackle the partial correspondence between real rain images and the given ground truth, we propose a two-stage training strategy that utilizes adjustments in the semantic loss function coefficients and phased freezing of the detail branch to prevent potential overfitting issues. Extensive experiments verify the effectiveness of our proposed method in eliminating the degradation in real-world rainy images. [ABSTRACT FROM AUTHOR]

Quantum-dot cellular automata (QCA) are one of the most promising alternatives to traditional VLSI technology despite significant current obstacles. The QCA has the advantages of very low power dissipation, faster switching speed, and extremely low circuit area, which can be used in designing nano-scale image processing circuits. Morphological operations and processing of digital image processing is a significant topic for researchers because it is widely used for analyzing, enhancing, and modifying images to extract meaningful information or improve their visual quality. Image processing is also used for image retrieval and enhancement, image compression, object recognition, machine vision, and medical applications. QCA technology, as a new and leading technology with great potential, can play a fundamental role in morphological operations, processing digital images, image editing, medical imaging, facial recognition, and autonomous vehicles. In recent years, researchers in this field have presented many circuits, but they have many flaws in terms of speed, accuracy, and area consumption, and the need to create more efficient circuits is felt more than ever. Therefore, in this article, a new design for morphological operations and processing digital images is presented using QCA technology. This paper presents a new efficient QCA-based implementation of image processing based on the direct interactions between the QCA cells. This circuit uses two majority gates of five new inputs to produce the output and produces the desired output. In addition, a comparison and analysis of the area and clocking complexity, design cost, and energy dissipation through simulation using QCADesigner and QCADesigner-E are done. The results show that the presented circuit produces the expected and correct output results in 0.75 clock phases, and the obtained results show the high speed and low consumption space of the presented circuit. In addition, the presented circuit performs better than the previous best circuits in terms of quantum cost and delay, and according to the mentioned advantages, it can be used to improve and expand other circuits in image processing. [ABSTRACT FROM AUTHOR]

Fire detection and extinguishing systems are critical for safeguarding lives and minimizing property damage. These systems are especially vital in combating forest fires. In recent years, several forest fires have set records for their size, duration, and level of destruction. Traditional fire detection methods, such as smoke and heat sensors, have limitations, prompting the development of innovative approaches using advanced technologies. Utilizing image processing, computer vision, and deep learning algorithms, we can now detect fires with exceptional accuracy and respond promptly to mitigate their impact. In this article, we conduct a comprehensive review of articles from 2013 to 2023, exploring how these technologies are applied in fire detection and extinguishing. We delve into modern techniques enabling real-time analysis of the visual data captured by cameras or satellites, facilitating the detection of smoke, flames, and other fire-related cues. Furthermore, we explore the utilization of deep learning and machine learning in training intelligent algorithms to recognize fire patterns and features. Through a comprehensive examination of current research and development, this review aims to provide insights into the potential and future directions of fire detection and extinguishing using image processing, computer vision, and deep learning. [ABSTRACT FROM AUTHOR]

As generative models become more advanced and essential, interest in using these models for image editing is growing. Nevertheless, conventional image editing methods still have many problems and can alter the intrinsic properties (e.g. geometry) of an object during the editing process. In this article, a novel geometry‐preserved image editing method is presented, where key points, keyframe, or canny edges are utilized as inputs for geometric constraints. A text prompt is fed into the inversion pipeline along with the input image and key points/keyframes/canny for editing. Then, new images are generated based on the editing pipeline of the denoising diffusion implicit model. Experiments demonstrate that the method outperforms its baselines. [ABSTRACT FROM AUTHOR]

Potholes and other road surface damages pose significant risks to vehicles and traffic safety. The current methods of in situ visual inspection for potholes or cracks are inefficient, costly, and hazardous. Therefore, there is a pressing need to develop automated systems for assessing road surface conditions, aiming to efficiently and accurately reconstruct, recognize, and locate potholes. In recent years, various methods utilizing (a) computer vision, (b) three-dimensional (3D) point clouds, or (c) smartphone data have been employed to map road surface quality conditions. Machine learning and deep learning techniques have increasingly enhanced the performance of these methods. This review aims to provide a comprehensive overview of cutting-edge computer vision and machine learning algorithms for pothole detection. It covers topics such as sensing systems for acquiring two-dimensional (2D) and 3D road data, classical algorithms based on 2D image processing, segmentation-based algorithms using 3D point cloud modeling, machine learning, deep learning algorithms, and hybrid approaches. The review highlights that hybrid methods combining traditional image processing and advanced machine learning techniques offer the highest accuracy in pothole detection. Machine learning approaches, particularly deep learning, demonstrate superior adaptability and detection rates, while traditional 2D and 3D methods provide valuable baseline techniques. By reviewing and evaluating existing vision-based methods, this paper clarifies the current landscape of pothole detection technologies and identifies opportunities for future research and development. Additionally, insights provided by this review can inform the design and implementation of more robust and effective systems for automated road surface condition assessment, thereby contributing to enhanced roadway safety and infrastructure management. [ABSTRACT FROM AUTHOR]

In maritime transportation, a ship's draft survey serves as a primary method for weighing bulk cargo. The accuracy of the ship's draft reading determines the fairness of bulk cargo transactions. Human visual-based draft reading methods face issues such as safety concerns, high labor costs, and subjective interpretation. Therefore, some image processing methods are utilized to achieve automatic draft reading. However, due to the limitations in the spectral characteristics of RGB images, existing image processing methods are susceptible to water surface environmental interference, such as reflections. To solve this issue, we obtained and annotated 524 multispectral images of a ship's draft as the research dataset, marking the first application of integrating NIR information and RGB images for automatic draft reading tasks. Additionally, a dual-branch backbone named BIF is proposed to extract and combine spectral information from RGB and NIR images. The backbone network can be combined with the existing segmentation head and detection head to perform waterline segmentation and draft detection. By replacing the original ResNet-50 backbone of YOLOv8, we reached a mAP of 99.2% in the draft detection task. Similarly, combining UPerNet with our dual-branch backbone, the mIoU of the waterline segmentation task was improved from 98.9% to 99.3%. The inaccuracy of the draft reading is less than ±0.01 m, confirming the efficacy of our method for automatic draft reading tasks. [ABSTRACT FROM AUTHOR]

Access to large image volumes through camera traps and crowdsourcing provides novel possibilities for animal monitoring and conservation. It calls for automatic methods for analysis, in particular, when re-identifying individual animals from the images. Most existing re-identification methods rely on either hand-crafted local features or end-to-end learning of fur pattern similarity. The former does not need labeled training data, while the latter, although very data-hungry typically outperforms the former when enough training data is available. We propose a novel re-identification pipeline that combines the strengths of both approaches by utilizing modern learnable local features and feature aggregation. This creates representative pattern feature embeddings that provide high re-identification accuracy while allowing us to apply the method to small datasets by using pre-trained feature descriptors. We report a comprehensive comparison of different modern local features and demonstrate the advantages of the proposed pipeline on two very different species. [ABSTRACT FROM AUTHOR]

Public health initiatives must be made using evidence-based decision-making to have the greatest impact. Machine learning algorithms are created to gather, store, process, and analyze data to provide knowledge and guide decisions. A crucial part of any surveillance system is image analysis. The communities of computer vision and machine learning have become curious about it as of late. This study uses a variety of machine learning, and image processing approaches to detect and forecast malarial illness. In our research, we discovered the potential of deep learning techniques as innovative tools with a broader applicability for malaria detection, which benefits physicians by assisting in the diagnosis of the condition. We investigate the common confinements of deep learning for computer frameworks and organizing, including the requirement for data preparation, preparation overhead, real-time execution, and explaining ability, and uncover future inquiries about bearings focusing on these constraints. [ABSTRACT FROM AUTHOR]

This paper presents an advanced automatic number plate recognition (ANPR) system designed specifically for Qatar's diverse license plate landscape and challenging environmental conditions. Leveraging the YOLOv8 deep learning model, particularly the YOLOv8s variant, we achieve state-of-the-art accuracy in both license plate detection and number recognition. Our innovative approach includes a comprehensive dataset enhancement technique that simulates adverse conditions, significantly improving the model's robustness in real-world scenarios. We integrate edge computing using a Raspberry Pi with server-side processing, demonstrating an efficient solution for real-time ANPR applications. The system maintains greater than 93% overall performance across various environmental conditions, including night-time and rainy scenarios. We also explore the impact of various pre-processing techniques, including edge detection, k-mean thresholding, DBSCAN, and Gaussian mixture models, on the ANPR system's performance. Our findings indicate that modern deep learning models like YOLOv8 are sufficiently robust to handle raw input images and do not significantly benefit from additional pre-processing. With its high accuracy and real-time processing capability, the proposed system represents a significant advancement in ANPR technology and is particularly suited for Qatar's unique traffic management needs and smart city initiatives. [ABSTRACT FROM AUTHOR]

An online inspection method based on machine vision was proposed and validated to address the issues of high work intensity, low efficiency, low accuracy, and risk of missed inspection in traditional sampling methods for screw threads of rebar head. Firstly, an industrial camera was used to capture real-time images of the processed rebar thread heads, preprocess the images, and locate the target positions in the images to reduce the complexity and running time of subsequent algorithms. Then, the Canny operator was used to roughly extract the edge feature information of the rebar head, and the Shi–Tomasi algorithm was used for corner inspection to achieve precise optimization of sub-pixel level corners. Based on robust linear regression, the diagonal points were fitted with lines to detect the corresponding size parameters. Finally, an inspection system on screw threads of rebar head parameter was designed and developed, which consisted of an image-acquisition device, Siemens PLC controller, and inspection software. Test results show that this method can achieve online inspection without contact, with inspection accuracy reaching the micrometer level, and 8–10 rebar heads can be inspected per second. [ABSTRACT FROM AUTHOR]

In response to the recent formalization of Filipino Sign Language (FSL) and the lack of comprehensive studies, this paper introduces a real-time FSL gesture recognition system. Unlike existing systems, which are often limited to static signs and asynchronous recognition, it offers dynamic gesture capturing and recognition of 10 common expressions and five transactional inquiries. To this end, the system sequentially employs cropping, contrast adjustment, grayscale conversion, resizing, and normalization of input image streams. These steps serve to extract the region of interest, reduce the computational load, ensure uniform input size, and maintain consistent pixel value distribution. Subsequently, a Convolutional Neural Network and Long-Short Term Memory (CNN-LSTM) model was employed to recognize nuances of real-time FSL gestures. The results demonstrate the superiority of the proposed technique over existing FSL recognition systems, achieving an impressive average accuracy, recall, and precision rate of 98%, marking an 11.3% improvement in accuracy. Furthermore, this article also explores lightweight conversion methods, including post-quantization and quantization-aware training, to facilitate the deployment of the model on resource-constrained platforms. The lightweight models show a significant reduction in model size and memory utilization with respect to the base model when executed in a Raspberry Pi minicomputer. Lastly, the lightweight model trained with the quantization-aware technique (99%) outperforms the post-quantization approach (97%), showing a notable 2% improvement in accuracy. [ABSTRACT FROM AUTHOR]

Abstract Counting high‐density objects quickly and accurately is a popular area of research. Crowd counting has significant social and economic value and is a major focus in artificial intelligence. Despite many advancements in this field, many of them are not widely known, especially in terms of research data. The authors proposed a three‐tier standardised dataset taxonomy (TSDT). The Taxonomy divides datasets into small‐scale, large‐scale and hyper‐scale, according to different application scenarios. This theory can help researchers make more efficient use of datasets and improve the performance of AI algorithms in specific fields. Additionally, the authors proposed a new evaluation index for the clarity of the dataset: average pixel occupied by each object (APO). This new evaluation index is more suitable for evaluating the clarity of the dataset in the object counting task than the image resolution. Moreover, the authors classified the crowd counting methods from a data‐driven perspective: multi‐scale networks, single‐column networks, multi‐column networks, multi‐task networks, attention networks and weak‐supervised networks and introduced the classic crowd counting methods of each class. The authors classified the existing 36 datasets according to the theory of three‐tier standardised dataset taxonomy and discussed and evaluated these datasets. The authors evaluated the performance of more than 100 methods in the past five years on different levels of popular datasets. Recently, progress in research on small‐scale datasets has slowed down. There are few new datasets and algorithms on small‐scale datasets. The studies focused on large or hyper‐scale datasets appear to be reaching a saturation point. The combined use of multiple approaches began to be a major research direction. The authors discussed the theoretical and practical challenges of crowd counting from the perspective of data, algorithms and computing resources. The field of crowd counting is moving towards combining multiple methods and requires fresh, targeted datasets. Despite advancements, the field still faces challenges such as handling real‐world scenarios and processing large crowds in real‐time. Researchers are exploring transfer learning to overcome the limitations of small datasets. The development of effective algorithms for crowd counting remains a challenging and important task in computer vision and AI, with many opportunities for future research.

Abstract Although many new methods have emerged in text‐driven images, the large computational power required for model training causes these methods to have a slow training process. Additionally, these methods consume a considerable amount of video random access memory (VRAM) resources during training. When generating high‐resolution images, the VRAM resources are often insufficient, which results in the inability to generate high‐resolution images. Nevertheless, recent Vision Transformers (ViTs) advancements have demonstrated their image classification and recognition capabilities. Unlike the traditional Convolutional Neural Networks based methods, ViTs have a Transformer‐based architecture, leverage attention mechanisms to capture comprehensive global information, moreover enabling enhanced global understanding of images through inherent long‐range dependencies, thus extracting more robust features and achieving comparable results with reduced computational load. The adaptability of ViTs to text‐driven image manipulation was investigated. Specifically, existing image generation methods were refined and the FastFaceCLIP method was proposed by combining the image‐text semantic alignment function of the pre‐trained CLIP model with the high‐resolution image generation function of the proposed FastFace. Additionally, the Multi‐Axis Nested Transformer module was incorporated for advanced feature extraction from the latent space, generating higher‐resolution images that are further enhanced using the Real‐ESRGAN algorithm. Eventually, extensive face manipulation‐related tests on the CelebA‐HQ dataset challenge the proposed method and other related schemes, demonstrating that FastFaceCLIP effectively generates semantically accurate, visually realistic, and clear images using fewer parameters and less time.

Abstract Image super‐resolution (SR) has been widely applied in remote sensing to generate high‐resolution (HR) images without increasing hardware costs. However, SR is a severe ill‐posed problem. As deep learning advances, existing methods have solved this problem to a certain extent. However, the complex spatial distribution of remote sensing images still poses a challenge in effectively extracting abundant high‐frequency details from the images. Here, a single‐image super‐resolution (SISR) network based on the generative adversarial network (GAN) for remote sensing is presented, called JOA‐GAN. Firstly, a joint‐attention module (JOA) is proposed to focus the network on high‐frequency regions in remote sensing images to enhance the quality of image reconstruction. In the generator network, a multi‐scale densely connected feature extraction block (ERRDB) is proposed, which acquires features at different scales using MSconv blocks containing multi‐scale convolutions and automatically adjusts the features by JOA. In the discriminator network, the relative discriminator is used to compute the relative probability instead of the absolute probability, which helps the network learn clearer and more realistic texture details. JOA‐GAN is compared with other advanced methods, and the results demonstrate that JOA‐GAN has improved objective evaluation metrics and achieved superior visual effects.

Abstract In recent years, multi‐human parsing has become a focal point in research, yet prevailing methods often rely on intermediate stages and lacking pixel‐level analysis. Moreover, their high computational demands limit real‐world efficiency. To address these challenges and enable real‐time performance, low‐latency end‐to‐end network is proposed. This approach leverages vision transformer and convolutional neural network in a dual‐encoded network, featuring a lightweight Transformer‐based vision encoder) and a convolution encoder based on Darknet. This combination adeptly captures long‐range dependencies and spatial relationships. Incorporating a fuse block enables the seamless merging of features from the encoders. Residual connections in the decoder design amplify information flow. Experimental validation on crowd instance‐level human parsing and look into person datasets showcases the WNet's effectiveness, achieving high‐speed multi‐human parsing at 26.7 frames per second. Ablation studies further underscore WNet's capabilities, emphasizing its efficiency and accuracy in complex multi‐human parsing tasks.

Abstract Driving while inattentive or fatigued significantly contributes to traffic accidents and puts road users at a significantly higher risk of collision. The rise in road accidents due to driver inattention resulting from distractive objects, for example, mobile phones, drinking, or tiredness, requires intelligent traffic monitoring systems to promote road safety. However, outdated detection technologies cannot handle the poor accuracy and the lack of real‐time processing possibility especially when combined with the variations of driving environment. This paper introduces “ME‐YOLOv8” which operates driver`s distraction and fatigue through a modified version of YOLOv8, which includes modules multi‐head self‐attention (MHSA) and efficient channel attention (ECA) modules applied, where the goal of MHSA is to improve the sensitivity of global features and the ECA attentions focus on critical features. Additionally, a dataset was created containing 3660 images covering multiple distracted and drowsy driver scenarios. The results reflect the enhanced detection capabilities of ME‐YOLOv8 and demonstrate its effectiveness in real‐time scenarios. This study demonstrates a significant advancement in the application of AI to public safety and highlights the critical role that state‐of‐the‐art deep learning algorithms play in lowering the risks associated with distracted and tired driving.

Abstract Bird‐related outages greatly threaten the safety of overhead transmission and distribution lines, while electrocution and collisions of birds with power lines, especially endangered species, are significant environmental concerns. Automatic bird recognition can be helpful to mitigate this contradiction. This paper proposes a method for automatic classification of bird species related to power line faults combining deep convolution features with error‐correcting output codes support vector machine (ECOC‐SVM). An image dataset of about 20 high‐risk and 20 low‐risk bird species was constructed, and the feed‐forward denoising convolutional neural network was used for image preprocessing. The deep convolution features of bird images were extracted by DarkNet‐53, and taken as inputs of the ECOC‐SVM for model training and bird species classification. The gradient‐weighted class activation mapping was used for visual explanations of the model decision region. The experimental results indicate that the average accuracy of the proposed method can reach 94.39%, and its performance was better than other models using different feature extraction networks and classification algorithms.

Abstract Leukemia is a type of blood tumour that occurs because of abnormal enhancement in WBCs (white blood cells) in the bone marrow of the human body. Blood-forming tissue cancer influences the lymphatic and bone marrow system. The early diagnosis and detection of leukaemia, i.e., the accurate difference of malignant leukocytes with little expense at the beginning of the disease, is a primary challenge in the disease analysis field. Despite the higher occurrence of leukemia, there is a lack of flow cytometry tools, and the procedures accessible at medical diagnostics centres are time-consuming. Distinct researchers have implemented computer-aided diagnostic (CAD) and machine learning (ML) methods for laboratory image analysis, aiming to manage the restrictions of late leukemia analysis. This study proposes a new Falcon optimization algorithm with deep convolutional neural network for Leukemia detection and classification (FOADCNN-LDC) technique. The main objective of the FOADCNN-LDC technique is to classify and recognize leukemia. The FOADCNN-LDC technique utilizes a median filtering (MF) based noise removal process to eradicate the image noise. Besides, the FOADCNN-LDC technique employs the ShuffleNetv2 model for the feature extraction process. Moreover, the detection and classification of the leukemia process are performed by utilizing the convolutional denoising autoencoder (CDAE) model. The FOA is implemented to select the hyperparameter of the CDAE model. The simulation process of the FOADCNN-LDC approach is performed on a benchmark medical dataset. The investigational analysis of the FOADCNN-LDC approach highlighted a superior accuracy value of 99.62% over existing techniques.

Abstract In order to improve the accuracy of granular image detection during image scaling, an image scaling algorithm combining the interpolation algorithm of protective features and Kalman filtering of neurons is proposed. Firstly, the interpolation algorithm of protective features is de‐designed according to the phenomenon of sudden change of edge grey values, and the difference and trend of grey values in horizontal and vertical directions are used to obtain the pre‐scaled image with maximum contrast. Then the grey value data input of the pre‐scaled image is introduced into the Kalman filter of neurons, and the filtering process is optimized by using the black‐box thinking of neurons, and the pre‐scaled image is smoothed. Finally, the scale transformation is implemented to obtain the final grey value to complete the final scaling, so that the image has both visual experience and features. Comparison with mainstream image scaling algorithms shows that the proposed algorithm can effectively overcome the degradation of granularity image detection accuracy due to image scaling, with point acutance value (PAV) improved by 10%–41%, and the granularity detection error caused by image scaling algorithms reduced from about 0.7% to about 0.1%, with a relative improvement of 85%.

Abstract Head pose estimation is an especially challenging task due to the complexity nonlinear mapping from 2D feature space to 3D pose space. To address the above issue, this paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network. Firstly, a new network, the region and difference‐aware feature pyramid network (RD‐FPN), is proposed for 2D keypoints detection to alleviate the background interference and enhance the feature expressiveness. Then, particle swarm optimized contrastive learning is constructed to alternatively match 2D and 3D keypoints, which takes the multimodal keypoints matching accuracy as the optimization objective, while considering the similarity of cross‐modal positive and negative sample pairs from contrastive learning as a local contrastive constraint. Finally, multimodal entangled graph convolution network is designed to enhance the ability of establishing geometric relationships between keypoints and head pose angles based on second‐order bilinear attention, in which point‐edge attention is introduced to improve the representation of geometric features between multimodal keypoints. Compared with other methods, the average error of our method is reduced by 8.23%, indicating the accuracy, generalization, and efficiency of our method on the 300W‐LP, AFLW2000, BIWI datasets.

Abstract Transformer possesses a broader perceptual scope, while the Convolutional Neural Network (CNN) excels at capturing local information. In this paper, the authors propose the Multi‐Sclale Feature Aggregation Network (MSFA‐Net) for single‐image dehazing which is fused with the advantages of Transformer and CNN. Our MSFA‐Net is based on the encoder–decoder structure, and there are four main innovations. Firstly, the authors make some improvements to the original Swin Transformer to make it more effective for dehazing tasks, and the authors name it Spatial Information Aggregation Transformer (SIAT). The authors place the SIAT in both encoder and decoder of MSFA‐Net for feature extraction. The authors propose an upsampling module called Efficient Spatial Resolution Recovery (ESRR) which is placed in the decoder part. Compared to commonly used transposed convolutions, the authors’ ESRR module has fewer computational cost. Considering that the haze distribution is always uneven and the information from each channel is different, the authors introduce the Dynamic Multi‐Attention (DMA) module to provide pixel‐wise weights and channel‐wise weights for input features. The authors place the DMA module between the encoder and decoder parts. As the network depth increases, the spatial structural information from the high‐resolution layer tends to degrade. To deal with the problem, the authors propose the Multi‐Scale Feature Fusion (MSFF) module to recover missing spatial structural information. The authors place the MSFF module in both the encoder and decoder parts. Extensive experimental results show that the authors’ proposed dehazing network achieves state‐of‐the‐art dehazing performance with relatively low computational cost.

Abstract Image steganography is the art of concealing secret information within images to prevent detection. In deep‐learning‐based image steganography, a common practice is to fuse the secret image with the cover image to directly generate the stego image. However, not all features are equally critical for data hiding, and some insignificant ones may lead to the appearance of residual artifacts in the stego image. In this article, a novel network architecture for image steganography with hybrid attention mechanism based on generative adversarial network is introduced. This model consists of three subnetworks: a generator for generate stego images, an extractor for extracting the secret images, and a discriminator to simulate the detection process, which aids the generator in producing more realistic stego images. A specific hybrid attention mechanism (HAM) module is designed that effectively fuses information across channel and spatial domains, facilitating adaptive feature refinement within deep image representations. The experimental results suggest that the HAM module not only enhances the image quality during both the steganography and extraction processes but also improves the model's undetectability. Stego images are mixed with varying levels of noise in the training process, which can further improve robustness. Finally, it is verified that the model outperforms current steganography approaches on three datasets and exhibits good undetectability.

Abstract Accurate detection of algae in microscopic image plays a crucial role in water quality monitoring. However, the existing object detection methods still face challenges in accurately detecting different categories of algae in microscopic image. In order to improve the accuracy, an improved YOLOv5s model is proposed for microalgae detection, by combining a Receptive Field Enhancement (RFE) module, the Wise‐IoU v3 dynamic non‐monotonic focal loss function, and a Dynamic head (Dyhead), which is termed receptive field enhancement wise‐IoU dyhead (RWD)‐you only look once (YOLO). Firstly, to detect microalgae of various scales, the Bottleneck in the C3 module of YOLOv5s is replaced with a more reasonable RFE module. Secondly, Wise‐IoU v3 is applied to enhance detection accuracy by assigning varying weights between high‐quality and low‐quality images. Finally, Dyhead is introduced to enhance the representation capacity of the detection head by integrating three attention mechanisms: scale awareness, spatial awareness, and task awareness. The proposed RWD‐YOLO model significantly enhances the accuracy of algae detection in microscopic image. Specifically, the experimental results on the microalgae dataset show that the RWD‐YOLO achieves an mAP@0.5 of 93.2% and an mAP@0.5:0.95 of 65.1%. Compared to the original YOLOv5s, mAP@0.5 and mAP@0.5:0.95 are improved by 3.7% and 5.7%, respectively.