Search

Rapid, accurate, and fully automated estimation of both length and width of asphalt pavement cracks, essential for achieving a proactive asset management, presents a significant challenge, primarily due to limitations in the effectiveness of automatic image segmentation and the accuracy of crack width and length estimation algorithms. To address this challenge, this paper introduces the Branch Growing (BG) algorithm, specifically designed for crack length estimation in asphalt pavements, along with an optimized OrthoBoundary algorithm tailored for crack width estimation. Leveraging four widely adopted deep learning models for asphalt pavement crack segmentation, four distinct sets of image segmentation results have been produced. Subsequently, a comprehensive evaluation has been conducted to assess the effectiveness of both crack dimensions estimation algorithms. The findings demonstrate that the integration of the BG algorithm, the optimized OrthoBoundary algorithm, and the fully convolutional network with the HRNet backbone achieve a prediction accuracy of 80.21% for crack length estimation and 84.32% for average width estimation. Moreover, the image processing speed, at a resolution of 3024 × 3024, can be maintained at approximately 5 s, with average width estimation observed to be up to 9.1‐fold faster than the unoptimized OrthoBoundary algorithm. These results signify advancements in automated crack quantification methodologies, with implications for enhancing civil infrastructure maintenance practices. [ABSTRACT FROM AUTHOR]

Most multiple object tracking algorithms depend on the output of the detector. Aiming at the problem that the higher detection quality model is restricted by the computing power, and the robustness of the lightweight detection model is easily affected by motion blur, this paper proposes a lightweight moving object detector based on improved YOLOv8 combined with dynamic confidence compensation algorithm. The algorithm combines various technical means such as network structure optimization, lightweight design, self‐knowledge distillation, loss function improvement and dynamic confidence compensation. ByteTrack is used as a tracker to conduct experiments on PASCAL VOC07+12 data set and UA‐DETRAC test sequence. Compared with the baseline YOLOv8n+ByteTrack, the proposed algorithm improves the HOTA by 1.3% when the single frame tracking delay is reduced by 1.1%. Mostly tracked target is improved by 79.7%, mostly lost target is reduced by 10.9%, and the detection effect is better than the original detector and other popular object detectors. The YOLODCC model achieves a balance between lightweight and multi‐object motion blur. [ABSTRACT FROM AUTHOR]

Face shape priors such as landmarks, heatmaps, and parsing maps are widely used to improve face super resolution (SR). It is observed that face priors provide locations of high‐frequency details in key facial areas such as the eyes and mouth. However, existing methods fail to effectively exploit the high‐frequency information by using the priors as either constraints or inputs. This paper proposes a novel high frequency highway (H2F${\rm H}_2{\rm F}$) framework to better utilize prior information for face SR, which dynamically decomposes the final SR face into a coarse SR face and a high frequency (HF) face. The coarse SR face is reconstructed from a low‐resolution face via a texture branch, using only pixel‐wise reconstruction loss. Meanwhile, the HF face is directly generated from face priors via an HF branch that employs the proposed inception–hourglass model. As a result, H2F${\rm H}_2{\rm F}$ allows the face priors to have a direct impact on the SR face by adding the outputs of both branches as the final result and provides an extra face editing function. Extensive experiments show that H2F${\rm H}_2{\rm F}$ significantly outperforms state‐of‐the‐art face SR methods, is general for different texture branch models and face priors, and is robust to dataset mismatch and pose variations. [ABSTRACT FROM AUTHOR]

Image super‐resolution (SR) has been widely applied in remote sensing to generate high‐resolution (HR) images without increasing hardware costs. However, SR is a severe ill‐posed problem. As deep learning advances, existing methods have solved this problem to a certain extent. However, the complex spatial distribution of remote sensing images still poses a challenge in effectively extracting abundant high‐frequency details from the images. Here, a single‐image super‐resolution (SISR) network based on the generative adversarial network (GAN) for remote sensing is presented, called JOA‐GAN. Firstly, a joint‐attention module (JOA) is proposed to focus the network on high‐frequency regions in remote sensing images to enhance the quality of image reconstruction. In the generator network, a multi‐scale densely connected feature extraction block (ERRDB) is proposed, which acquires features at different scales using MSconv blocks containing multi‐scale convolutions and automatically adjusts the features by JOA. In the discriminator network, the relative discriminator is used to compute the relative probability instead of the absolute probability, which helps the network learn clearer and more realistic texture details. JOA‐GAN is compared with other advanced methods, and the results demonstrate that JOA‐GAN has improved objective evaluation metrics and achieved superior visual effects. [ABSTRACT FROM AUTHOR]

Currently, in the field of processing 3D point cloud data, two primary representation methods have emerged: point‐based methods and voxel‐based methods. However, the former suffer from significant computational costs and lack the ease of handling exhibited by voxel‐based methods. Conversely, the later often encounter challenges related to information loss resulting from downsampling operations, thereby impeding subsequent tasks. To address these limitations, this article introduces a novel density‐based representation method for voxel partitioning. Additionally, a corresponding network structure is devised to extract features from this specific density representation, thereby facilitating the successful completion of classification tasks. The experiments are implemented on ModelNet40 and MNIST demonstrate that the proposed 3D convolution can achieve the‐state‐of‐the‐art performance based on the voxels. [ABSTRACT FROM AUTHOR]

Developing real‐time cloud segmentation technology is urgent for many remote sensing based applications such as weather forecasting. Existing deep learning based cloud segmentation methods involve two shortcomings. (a): They tend to produce discontinuous boundaries and fail to capture less salient feature, which corresponds to thin cloud pixels; (b): they are unrobust towards different scenarios. Those issues are circumvented by integrating U‐Net and the swin transformer together, with an efficiently designed dual attention mechanism based skip connection. Typically, a swin transformer based encoder‐decoder network, by incorporating a dual attentional skip connection with Swin‐UNet (DASUNet) is proposed. DASUNet captures the global relationship of image patches based on its window attention mechanism, which fits the real‐time requirement. Moreover, DASUNet characterizes the less salient features by equipping with token dual attention modules among the skip connection, which compensates the ignorance of less salient features incurred from traditional attention mechanism during the stacking of transformer layers. Experiments on ground‐based images (SWINySeg) and remote sensing images (HRC‐WHU, 38‐Cloud) show that, DASUNet achieves the state‐of‐the‐art or competitive results for cloud segmentation (six top‐1 positions of six metrics among 11 methods on SWINySeg, two top‐1 positions of five metrics among 10 methods on HRC‐WHU, two top‐1 positions of four metrics among 12 methods with ParaNum ≤30M$\le 30{\rm M}$ on 38‐Cloud), with 100FPS implementation speed averagely for each 224×224$224\times 224$ image. [ABSTRACT FROM AUTHOR]

Target detection in autonomous driving tasks presents a complex and critical challenge due to the diversity of targets and the intricacy of the environment. To address this issue, this paper proposes an enhanced YOLOv8 model. Firstly, the original large target detection head is removed and replaced with a detection head tailored for small targets and high‐level semantic details. Secondly, an adaptive feature fusion method is proposed, where input feature maps are processed using dilated convolutions with different dilation rates, followed by adaptive feature fusion to generate adaptive weights. Finally, an improved attention mechanism is incorporated to enhance the model's focus on target regions. Additionally, the impact of Group Shuffle Convolution (GSConv) on the model's detection speed is investigated. Validated on two public datasets, the model achieves a mean Average Precision (mAP) of 53.7% and 53.5%. Although introducing GSConv results in a slight decrease in mAP, it significantly improves frames per second. These findings underscore the effectiveness of the proposed model in autonomous driving tasks. [ABSTRACT FROM AUTHOR]

Taken in low‐light intensity conditions, image with low brightness affects processing precision. In this article, the Gamma Function based on the brightness average and weighted fusion method according to gray entropy is proposed, which is combined with the improved Retinex algorithm. First, the maximum values of R, G, and B channels in original image are extracted to generate the primary illumination map. Second, the illumination map is optimized and adjusted via the Gamma correction function based on the average brightness value. Finally, the illumination map and detail layer are fused by a weighted fusion algorithm of gray entropy to obtain the reflection map. Reflection maps are used as enhancement. The algorithm proposed in this article can improve the brightness and maintain light distribution in the original image with higher precision and less color distortion. [ABSTRACT FROM AUTHOR]

In recent years, deep learning models have dramatically influenced image inpainting. However, many existing studies still suffer from over‐smoothed or blurred textures when missing regions are large or contain rich visual details. To restore textures at a fine‐grained level, a multi‐stage inpainting approach is proposed, which applies a series of partial inpainting modules as well as a progressive inpainting module to inpaint missing areas from their boundaries to the centre successively. Some improvements are made on the partial convolutions to reduce artifacts like blurriness, which require a convolution kernel to contain known pixels more than a certain proportion. Towards photorealistic inpainting results, the intermediate outputs from each stage are used to compute the loss. Finally, to facilitate the training process, a multi‐step training is designed that progressively adds inpainting modules to optimize the model. Experiments show that this method outperforms the current excellent techniques on the publicly available datasets: CelebA, Places2 and Paris StreetView. [ABSTRACT FROM AUTHOR]

A recent approach to image steganography is to use deep learning. Mainly, convolutional neural networks can extract complex features and use them as patterns to combine hidden messages and images. Also, by using generative adversarial networks, it is possible to generate realistic and high‐quality stego images without any noticeable artifacts. Previous methods suffered from challenges such as simple architecture, low network accuracy, imbalance between capacity and transparency, vanishing gradients, and low capacity. This study introduces a steganography framework named VidaGAN that utilizes deep learning techniques. The network being proposed is made up of three components: an encoder, a decoder, and a critic, and introduces a novel architecture and several innovations to address some of the unresolved challenges mentioned above. This study introduces a novel method for embedding any type of binary data into images using generative adversarial networks, enabling us to enhance the visual appeal of images generated by the specified model. This neural network called VarIable aDAptive GAN (VidaGAN) achieved state‐of‐the‐art status by reaching a hiding capacity of 3.9 bits per pixel in the DIV2K dataset. Furthermore, examination by the StegExpose steganalysis tool shows an AUC of 0.6, a suitable threshold for transparency. [ABSTRACT FROM AUTHOR]

In recent years, multi‐human parsing has become a focal point in research, yet prevailing methods often rely on intermediate stages and lacking pixel‐level analysis. Moreover, their high computational demands limit real‐world efficiency. To address these challenges and enable real‐time performance, low‐latency end‐to‐end network is proposed. This approach leverages vision transformer and convolutional neural network in a dual‐encoded network, featuring a lightweight Transformer‐based vision encoder) and a convolution encoder based on Darknet. This combination adeptly captures long‐range dependencies and spatial relationships. Incorporating a fuse block enables the seamless merging of features from the encoders. Residual connections in the decoder design amplify information flow. Experimental validation on crowd instance‐level human parsing and look into person datasets showcases the WNet's effectiveness, achieving high‐speed multi‐human parsing at 26.7 frames per second. Ablation studies further underscore WNet's capabilities, emphasizing its efficiency and accuracy in complex multi‐human parsing tasks. [ABSTRACT FROM AUTHOR]

Considering the challenges of low multi‐object detection accuracy and difficulty in identifying small targets caused by challenging environmental conditions including irregular lighting patterns and ambient noise levels in the mining environment with autonomous electric locomotives. A new network model based on SOD−YOLOv5s−4L has been proposed to detect multi‐objects for autonomous electric locomotives in underground coal mines. Improvements have been applied in YOLOv5s to construct the SOD−YOLOv5s−4L model, by introducing the SIoU loss function to address the mismatch between real and predicted bounding box directions, facilitating the model to learn target position information more efficiently. This research introduces a decoupled head to enhance feature fusion and improve the positioning precision of the network model, enabling rapid capture of multi‐scale target features. Furthermore, the detection capability of the model has been increased by introducing the small target detection layer which is developed by increasing the number of detection layers from three to four. The experimental results on multiple object detection dataset show that the proposed model achieves significant improvement in mean average precision (mAP) of almost 98% for various types of targets and an average precision (AP) of nearly 99% for small targets on the other hand it achieves 5.19% (mAP) and 9.79% (AP) compared to the YOLOv5s model. Furthermore, comparative analysis with other models like YOLOv7 and YOLOv8 shows that the proposed model has superior performance in terms of object detection. [ABSTRACT FROM AUTHOR]

This paper proposes a novel approach for absolute velocity estimation of unmanned aerial vehicles in unknown and unmapped GNSS‐denied environments. The proposed method leverages the advantages of Fourier‐based image phase correlation and utilizes off‐the‐shelf onboard sensors, including a downward‐facing monocular camera, an inertial sensor, and a sonar. The non‐matching tracking approach is particularly appealing, offering accurate estimation while remaining robust against frequency‐dependent noise, significant intensity variations, and time‐varying illumination disturbances. In the proposed method, the first step involves computing global pixel motion from consecutive images using phase correlation, which utilizes the shift property of the Fourier transform. This pixel motion estimation serves as the basis for creating a closed‐loop solution for absolute velocity estimation. To further enhance accuracy, a Kalman filter is implemented to fuse all available data and provide a reliable velocity estimate. Validation of the proposed visual‐inertial technique is conducted through simulation experiments using AirSim and real‐world flight tests. The results demonstrate the practicality and effectiveness of the approach across a range of challenging scenarios. [ABSTRACT FROM AUTHOR]

Visual smoke semantic segmentation is a challenging task due to semi‐transparency, variable shapes, and complex textures of smoke. To improve segmentation performance, a convolutional neural network and transformer hybrid network are proposed based on pyramid Gaussian pooling (PGP) for smoke segmentation. In order to utilize low‐pass filtering to suppress noise, a PGP method is designed. Then, the output of PGP is reshaped to construct a set of visual tokens for transformers, thus a PGP‐transformer module is presented to make full use of the self‐attention mechanism. Finally, the PGP‐transformer module is inserted into the U‐shaped architecture with skip connections. A large number of experiments have proved that the method is significantly superior to existing state‐of‐the‐art algorithms on virtual and real smoke datasets, and ablation experiments have also verified the effectiveness of the proposed modules. [ABSTRACT FROM AUTHOR]

The article proposes a real‐time apple picking method based on an improved YOLOv5. This method accurately recognizes different apple targets on fruit trees for robots and helps them adjust their position to avoid obstructions during fruit picking. Firstly, the original BottleneckCSP module in the YOLOv5 backbone network is enhanced to extract deeper features from images while maintaining lightweight. Secondly, the ECA module is embedded into the improved backbone network to better extract features of different apple targets. Lastly, the initial anchor frame size of the network is adjusted to avoid recognizing apples in distant planting rows. The results demonstrate that this improved model achieves high accuracy rates and recall rates for recognizing various types of apple picking methods with an average recognition time of 0.025s per image. Compared with other models tested on six types of apple picking methods, including the original YOLOv5 model as well as YOLOv3 and EfficientDet‐D0 algorithms, our improved model shows significant improvements in mAP by 1.95%, 17.6%, and 12.7% respectively. This method provides technical support for robots' picking hands to actively avoid obstructions caused by branches during fruit harvesting, effectively reducing apple loss. [ABSTRACT FROM AUTHOR]

Effective use of the wealth of information provided by Distributed Acoustic Sensing (DAS) for mass movement monitoring remains a challenge. We propose a semi‐supervised neural network tailored to screen DAS data related to a series of rock collapses leading to a major failure of approximately 1.2 million m3 ${\mathrm{m}}^{3}$ on 15 June 2023 in Brienz, Eastern Switzerland. Besides DAS, the dataset from 16 May to 30 June 2023 includes Doppler radar data for partially ground‐truth labeling. The proposed algorithm is capable of distinguishing between rock‐slope failures and background noise, including road and train traffic, with a detection precision of over 95% $95\%$. It identifies hundreds of precursory failures and shows sustained detection hours before and during the major collapse. Event size and signal‐to‐noise ratio (SNR) are the key performance dependencies. As a critical part of our algorithm operates unsupervised, we suggest that it is suitable for general monitoring of natural hazards. Plain Language Summary: Steep mountains and hills produce dangerous rockfalls and similar phenomena such as landslides and debris flows. A major collapse is typically preceded by a series of rockfalls over days or months. It is therefore crucial to reliably detect these events and recognize the warning signs of an impending major collapse. When rocks bounce on the ground they release seismic waves, which generate vibrations that propagate long distances. Such vibrations stretch and compress fiber optic cables within the ground enough so they can be measured with a novel technique called Distributed Acoustic Sensing (DAS). Here we show how to identify such DAS signals using machine learning algorithms to detect precursory rockfall activity and a major collapse on a slope in Switzerland. We compare our detections with radar measurements, which are highly reliable but also come at a greater cost for installation. Since we can apply DAS to unused fiber within the ground, our approach may pave the way for the next generation of natural hazard warning. Key Points: A semi‐supervised neural network is developed for rock‐slope failure monitoring with Distributed Acoustic Sensing at Brienz, SwitzerlandOur model achieves over 95% precision for rock slope failures detected by a Doppler radar system over 45 daysThe sustained detection of slope failures before the major collapse highlights the potential of our approach for early warning [ABSTRACT FROM AUTHOR]

The advent of deep neural networks and improved computational power have brought a revolutionary transformation in the fields of computer vision and image processing. Within the realm of computer vision, there has been a significant interest in the area of synthetic image generation, which is a creative side of AI. Many researchers have introduced innovative methods to identify deep neural network‐based architectures involved in image generation via different modes of input, like text, scene graph layouts and so forth to generate synthetic images. Computer‐generated images have been found to contribute a lot to the training of different machine and deep‐learning models. Nonetheless, we have observed an immediate need for a comprehensive and systematic literature review that encompasses a summary and critical evaluation of current primary studies' approaches toward image generation. To address this, we carried out a systematic literature review on synthetic image generation approaches published from 2018 to February 2023. Moreover, we have conducted a systematic review of various datasets, approaches to image generation, performance metrics for existing methods, and a brief experimental comparison of DCGAN (deep convolutional generative adversarial network) and cGAN (conditional generative adversarial network) in the context of image generation. Additionally, we have identified applications related to image generation models with critical evaluation of the primary studies on the subject matter. Finally, we present some future research directions to further contribute to the field of image generation using deep neural networks. [ABSTRACT FROM AUTHOR]

Bird‐related outages greatly threaten the safety of overhead transmission and distribution lines, while electrocution and collisions of birds with power lines, especially endangered species, are significant environmental concerns. Automatic bird recognition can be helpful to mitigate this contradiction. This paper proposes a method for automatic classification of bird species related to power line faults combining deep convolution features with error‐correcting output codes support vector machine (ECOC‐SVM). An image dataset of about 20 high‐risk and 20 low‐risk bird species was constructed, and the feed‐forward denoising convolutional neural network was used for image preprocessing. The deep convolution features of bird images were extracted by DarkNet‐53, and taken as inputs of the ECOC‐SVM for model training and bird species classification. The gradient‐weighted class activation mapping was used for visual explanations of the model decision region. The experimental results indicate that the average accuracy of the proposed method can reach 94.39%, and its performance was better than other models using different feature extraction networks and classification algorithms. [ABSTRACT FROM AUTHOR]

Kidney tumours are among the top ten most common tumours, the automatic segmentation of medical images can help locate tumour locations. However, the segmentation of kidney tumour images still faces several challenges: firstly, there is a lack of renal tumour endoscopic datasets and no segmentation techniques for renal tumour endoscopic images; secondly, the intra‐class inconsistency of tumours caused by variations in size, location, and shape of renal tumours; thirdly, difficulty in semantic fusion during decoding; and finally, the issue of boundary blurring in the localization of lesions. To address the aforementioned issues, a new dataset called Re‐TMRS is proposed, and for this dataset, the transformer‐based boundary feedback network for kidney tumour segmentation (BFT‐Net) is proposed. This network incorporates an adaptive context extract module (ACE) to emphasize local contextual information, reduces the semantic gap through the mixed feature capture module (MFC), and ultimately improves boundary extraction capability through end‐to‐end optimization learning in the boundary assist module (BA). Through numerous experiments, it is demonstrated that the proposed model exhibits excellent segmentation ability and generalization performance. The mDice and mIoU on the Re‐TMRS dataset reach 91.1% and 91.8%, respectively. [ABSTRACT FROM AUTHOR]

In this study, a new approach is presented that eliminates stereotactic frameworks and the use of markers, offering an alternative to traditional brain biopsy systems. The classical biopsy operation involves the registration of magnetic resonance (MR) and computed tomography (CT) information taken from the patient at different times. Typically, the surgeon's planning information, which takes an average of 4 h on MR, is transferred to CT, and the surgical operation commences. However, this approach necessitates two separate acquisitions (MR and CT), adversely affecting patient comfort and increasing the workload. In the proposed system, it is recommended to register MR‐Depth camera data instead of MR‐CT registration. To achieve this, a 3D face pattern is obtained from the data received from the depth camera attached to the robot arm and overlapped with the mesh obtained by segmentation of the MR. It was observed that registration with sub‐millimeter precision was achieved using the CMFreg surface registration technique. [ABSTRACT FROM AUTHOR]

Driving while inattentive or fatigued significantly contributes to traffic accidents and puts road users at a significantly higher risk of collision. The rise in road accidents due to driver inattention resulting from distractive objects, for example, mobile phones, drinking, or tiredness, requires intelligent traffic monitoring systems to promote road safety. However, outdated detection technologies cannot handle the poor accuracy and the lack of real‐time processing possibility especially when combined with the variations of driving environment. This paper introduces "ME‐YOLOv8" which operates driver's distraction and fatigue through a modified version of YOLOv8, which includes modules multi‐head self‐attention (MHSA) and efficient channel attention (ECA) modules applied, where the goal of MHSA is to improve the sensitivity of global features and the ECA attentions focus on critical features. Additionally, a dataset was created containing 3660 images covering multiple distracted and drowsy driver scenarios. The results reflect the enhanced detection capabilities of ME‐YOLOv8 and demonstrate its effectiveness in real‐time scenarios. This study demonstrates a significant advancement in the application of AI to public safety and highlights the critical role that state‐of‐the‐art deep learning algorithms play in lowering the risks associated with distracted and tired driving. [ABSTRACT FROM AUTHOR]

Road damage detection (RDD) is critical to society's safety and the efficient allocation of resources. Most road damage detection methods which directly adopt various object detection models face some significant challenges due to the characteristics of the RDD task. First, the damaged objects in the road images are highly diverse in scales and difficult to differentiate, making it more challenging than other tasks. Second, existing methods neglect the relationship between the feature distribution and model structure, which makes it difficult for optimization. To address these challenges, this study proposes an efficient dense attention fusion network with channel correlation loss for road damage detection. First, the K‐Means++ algorithm is applied for data preprocessing to optimize the initial cluster centers and improve the model detection accuracy. Second, a dense attention fusion module is proposed to learn spatial‐spectral attention to enhance multi‐scale fusion features and improve the ability of the model to detect damage areas at different scales. Third, the channel correlation loss is adopted in the class prediction process to maintain the separability of intra and inter‐class. The experimental results on the collected RDDA dataset and RDD2022 dataset show that the proposed method achieves state‐of‐the‐art performance. [ABSTRACT FROM AUTHOR]

Machine learning‐assisted computer vision represents a state‐of‐the‐art technique for extracting meaningful features from visual data autonomously. This approach facilitates the quantitative analysis of images, enabling object detection and tracking. In this study, we utilize advanced computer vision to precisely identify droplet motions and quantify their impact forces with spatiotemporal resolution at the picoliter or millisecond scale. Droplets, captured by a high‐speed camera, are denoised through neuromorphic image processing. These processed images are employed to train convolutional neural networks, allowing the creation of segmented masks and bounding boxes around moving droplets. The trained networks further digitize time‐varying multi‐dimensional droplet features, such as droplet diameters, spreading and sliding motions, and corresponding impact forces. Our innovative method offers accurate measurement of small impact forces with a resolution of approximately 10 pico‐newtons for droplets in the micrometer range across various configurations with the time resolution at hundreds of microseconds. [ABSTRACT FROM AUTHOR]

Recent years have witnessed notable advancements in medical image segmentation through deep convolutional neural networks. However, a notable limitation lies in the local operation of convolution, which hinders the ability to fully exploit global semantic information. To overcome the challenges prevalent in medical image segmentation, the feature ensemble network with multi‐scale atrous transformer is proposed. At the core of the approach lies the multi‐scale contextual integration module, which is based on the multi‐scale atrous transformer and facilitates contextual integration of multi‐level features. To extract discriminative fine‐grained features of the target region, a hybrid attention mechanism that synergistically combines spatial and channel attention, thereby sharpening the model's focus on crucial target information within high‐level features, is incorporated. Additionally, the channel‐aware feature reconstruction module is introduced as an innovative component engineered to tackle feature similarity issues across different categories. This module performs feature reconstruction based on channel perception, effectively widening the feature gap between categories and enhancing the segmentation capability. It is worth mentioning that our approach surpasses the state‐of‐the‐art method using three benchmark datasets in medical image segmentation. [ABSTRACT FROM AUTHOR]

Image processing often requires filtering, which can be effectively performed by using B‐spline surface approximation. This article presents a fast method of approximating data in rectangular (image) form using such surfaces. The method considers dynamic changes of data by representing rows and columns in chordal parameterized form. To improve performance, after parametrization, lines are uniformly resampled using linear interpolation. It allows using the same basis functions with uniform parameterization for approximation of all processed lines. After approximation, reconstruction of original parameterization is required, but its computational complexity is also linear. [ABSTRACT FROM AUTHOR]

In order to improve the accuracy of granular image detection during image scaling, an image scaling algorithm combining the interpolation algorithm of protective features and Kalman filtering of neurons is proposed. Firstly, the interpolation algorithm of protective features is de‐designed according to the phenomenon of sudden change of edge grey values, and the difference and trend of grey values in horizontal and vertical directions are used to obtain the pre‐scaled image with maximum contrast. Then the grey value data input of the pre‐scaled image is introduced into the Kalman filter of neurons, and the filtering process is optimized by using the black‐box thinking of neurons, and the pre‐scaled image is smoothed. Finally, the scale transformation is implemented to obtain the final grey value to complete the final scaling, so that the image has both visual experience and features. Comparison with mainstream image scaling algorithms shows that the proposed algorithm can effectively overcome the degradation of granularity image detection accuracy due to image scaling, with point acutance value (PAV) improved by 10%–41%, and the granularity detection error caused by image scaling algorithms reduced from about 0.7% to about 0.1%, with a relative improvement of 85%. [ABSTRACT FROM AUTHOR]

Head pose estimation is an especially challenging task due to the complexity nonlinear mapping from 2D feature space to 3D pose space. To address the above issue, this paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network. Firstly, a new network, the region and difference‐aware feature pyramid network (RD‐FPN), is proposed for 2D keypoints detection to alleviate the background interference and enhance the feature expressiveness. Then, particle swarm optimized contrastive learning is constructed to alternatively match 2D and 3D keypoints, which takes the multimodal keypoints matching accuracy as the optimization objective, while considering the similarity of cross‐modal positive and negative sample pairs from contrastive learning as a local contrastive constraint. Finally, multimodal entangled graph convolution network is designed to enhance the ability of establishing geometric relationships between keypoints and head pose angles based on second‐order bilinear attention, in which point‐edge attention is introduced to improve the representation of geometric features between multimodal keypoints. Compared with other methods, the average error of our method is reduced by 8.23%, indicating the accuracy, generalization, and efficiency of our method on the 300W‐LP, AFLW2000, BIWI datasets. [ABSTRACT FROM AUTHOR]

Transformer possesses a broader perceptual scope, while the Convolutional Neural Network (CNN) excels at capturing local information. In this paper, the authors propose the Multi‐Sclale Feature Aggregation Network (MSFA‐Net) for single‐image dehazing which is fused with the advantages of Transformer and CNN. Our MSFA‐Net is based on the encoder–decoder structure, and there are four main innovations. Firstly, the authors make some improvements to the original Swin Transformer to make it more effective for dehazing tasks, and the authors name it Spatial Information Aggregation Transformer (SIAT). The authors place the SIAT in both encoder and decoder of MSFA‐Net for feature extraction. The authors propose an upsampling module called Efficient Spatial Resolution Recovery (ESRR) which is placed in the decoder part. Compared to commonly used transposed convolutions, the authors' ESRR module has fewer computational cost. Considering that the haze distribution is always uneven and the information from each channel is different, the authors introduce the Dynamic Multi‐Attention (DMA) module to provide pixel‐wise weights and channel‐wise weights for input features. The authors place the DMA module between the encoder and decoder parts. As the network depth increases, the spatial structural information from the high‐resolution layer tends to degrade. To deal with the problem, the authors propose the Multi‐Scale Feature Fusion (MSFF) module to recover missing spatial structural information. The authors place the MSFF module in both the encoder and decoder parts. Extensive experimental results show that the authors' proposed dehazing network achieves state‐of‐the‐art dehazing performance with relatively low computational cost. [ABSTRACT FROM AUTHOR]

Traditional dehazing algorithms have long been limited in their ability to remove fog effectively, especially in preserving details. This study proposes an improved dark channel prior dehazing algorithm designed to overcome the limitations of traditional algorithms by refining the transmission map and estimating atmospheric light intensity. The algorithm fully exploits the anti‐haze characteristics of the Gabor filter to extract multi‐directional texture features. By fusing these features to form a guidance map for guided filtering, it effectively reduces the blurring caused by guided filtering on the image edges, thereby producing a more accurate transmission map. Simultaneously, an enhanced atmospheric light successfully reduces interference from white objects in the image. The experiment phase utilized the publicly available RESIDE dataset for validation. The algorithm achieved a Peak Signal‐to‐Noise Ratio (PSNR) of 22.4 and a Structural Similarity Index (SSIM) of 0.88. These metrics indicate the algorithm's superior dehazing capabilities. [ABSTRACT FROM AUTHOR]

Automatic segmentation of renal tumours during renal cell carcinoma surgery can help doctors accurately locate the tumour region, protect the tissues and organs around the kidneys, enhance surgical efficiency, and reduce the possibility of leakage and misdiagnosis. However, since general polyp endoscopic image segmentation models have many problems when facing the task of renal tumour segmentation, there needs to be more research on the segmentation of endoscopic images of renal tumours. This paper proposes a multi‐scale dynamic segmentation kernel network for endoscopic image segmentation of kidney tumours. First, a spatial receptive field module is proposed to augment the feature information and improve the performance of the whole network. Second, an enhanced cross‐attention module is offered to attenuate the effect of a high‐similarity segmentation background. Finally, a multi‐scale dynamic segmentation kernel module is introduced to gradually refine the segmentation results from small to large sizes to obtain more accurate tumour boundaries. Extensive experiments on the established kidney tumour endoscopic dataset and publicly available endoscopic datasets show that this method exhibits enhanced performance and generalization capabilities compared to existing techniques. On this renal tumour dataset, MDSK‐Net achieved excellent results of 94.1% and 90.1% on mDice and mIoU. [ABSTRACT FROM AUTHOR]

Metaheuristic is one of the techniques to improve the security of image encryption. However, existing metaheuristic image cryptosystems based on metaheuristic may have convergence difficulties during the optimization process, which cause insecurity and slow convergence. Besides, the time cost of the parallel execution model applied to metaheuristic image cryptosystems is not low enough. Therefore, a parallel many‐objective optimized key generation framework is proposed. Firstly, if four or more security indicators of cryptosystem, which are the results of security test, need to be optimized, the many‐objective optimization algorithm is employed to the proposed framework. With method adjusts the chaotic system parameters as the optimization key, which effectively avoid the convergence difficulty of the encryption key. Secondly, a master‐slave parallel model is improved to metaheuristic encryption. The model allocates the most time‐consuming fitness calculation work to slave nodes, which makes the modified model more reasonable and thus reduces the encryption time. To evaluate the performance of the proposed framework, a specific encryption scheme is constructed, that utilizes a 2D quadric map and many‐objective optimization algorithm based on dominance and decomposition (MOEA/DD) to optimize five security indicators. Experimental results reveal that this scheme has good security performances and less parallel encryption time. [ABSTRACT FROM AUTHOR]

As generative models become more advanced and essential, interest in using these models for image editing is growing. Nevertheless, conventional image editing methods still have many problems and can alter the intrinsic properties (e.g. geometry) of an object during the editing process. In this article, a novel geometry‐preserved image editing method is presented, where key points, keyframe, or canny edges are utilized as inputs for geometric constraints. A text prompt is fed into the inversion pipeline along with the input image and key points/keyframes/canny for editing. Then, new images are generated based on the editing pipeline of the denoising diffusion implicit model. Experiments demonstrate that the method outperforms its baselines. [ABSTRACT FROM AUTHOR]

Medical image segmentation through the use of deep learning is becoming a trend targeting to automate disease detection and provide effective treatment. Traditionally huge manual efforts are associated with medical image processing by medical staff. The wide use of neural networks driven by the progressive advancement in computing power and the availability of training data provides instrumental means to automate medical image processing. A polyp refers to an abnormal growth that can occur in various parts of the body. While the majority of polyps are noncancerous or benign, there are instances where certain types can develop into cancer. Detecting and segmenting polyps is highly valuable for identifying early signs and potentially enabling more effective treatment of colon cancer. In this paper, we introduce a novel method for segmenting polyp images. The proposed method utilizes convolutional neural networks (CNNs) and employs an enhanced attention mechanism. To cater to a more granular attention view, this paper enhances the Convolutional Block Attention Module by introducing the multi‐focal channel attention (MFCA) concept, which we call MFCA. In the proposed MFCA channel attention, focal attention spots allow us to consider scattered areas of interest more effectively. To evaluate the effectiveness of the proposed method, multiple experiments are conducted on five well‐known benchmark datasets for polyp image segmentation: Kvasir, CVC‐Clinic DB, CVC‐Colon DB, CVC‐T, and ETIS‐Larib. Various testing scenarios are examined, including the impact of two focal attention spots and four focal attention spots. The experimental results demonstrated that the proposed method achieved superior performance compared to previous state‐of‐the‐art techniques on two of the benchmark datasets, and ranked second on a third dataset. [ABSTRACT FROM AUTHOR]

Glioblastoma multiforme (GBM) is the most prevalent and aggressive primary brain tumour that has the worst prognosis in adults. Currently, the automatic segmentation of this kind of tumour is being intensively studied. Here, the automatic three‐dimensional segmentation of the GBM is achieved with its related subzones (active tumour, inner necrosis, and peripheral oedema). Preliminary segmentations were first defined based on the four basic magnetic resonance imaging modalities and classic image processing methods (multithreshold Otsu, Chan–Vese active contours, and morphological erosion). After an automatic gap‐filling post processing step, these preliminary segmentations were combined and corrected by a supervised artificial neural network of multilayer perceptron type with a hidden layer of 80 neurons, fed by 30 selected radiomic features of gray intensity and texture. Network classification has an overall accuracy of 83.9%, while the complete combined algorithm achieves average Dice similarity coefficients of 89.3%, 80.7%, 79.7%, and 66.4% for the entire region of interest, active tumour, oedema, and necrosis segmentations, respectively. These values are in the range of the best reported in the present bibliography, but even with better Hausdorff distances and lower computational costs. Results presented here evidence that it is possible to achieve the automatic segmentation of this kind of tumour by traditional radiomics. This has relevant clinical potential at the time of diagnosis, precision radiotherapy planning, or post‐treatment response evaluation. [ABSTRACT FROM AUTHOR]

We establish a sample‐ and data‐processing pipeline that allows for high‐throughput optical microscope measurement of porous films, provided they are sufficiently optically scattering. Here, self‐limiting electrospray deposition (SLED) is used to manufacture scattering films of different morphologies. This technique compensates for the scattering of the films through background subtraction of the reflection image with the transmission image. This process is implemented through a combination of an ImageJ and MATLAB data pipeline; the Canny edge‐detector is used as the image‐processing algorithm to identify the boundaries of the film. This process is verified against manually measured images; a comparative study between cross‐sectional scanning electron microscopy (where scattering effects are diminished) and optical microscopy also verifies that our optical microscopy technique can be used to consistently, non‐destructively measure film thickness regardless of film morphology. In addition, this technique can be used in combination with dense film measurements to measure film porosity. [ABSTRACT FROM AUTHOR]

This research investigates the Circle of Willis, a critical vascular structure vital for cerebral blood supply. A modified novel dual‐pathway multi‐scale hierarchical upsampling network (HUNet) is presented, tailored explicitly for accurate segmentation of Circle of Willis anatomical components from medical imaging data. Evaluating both the multi‐label magnetic resonance angiography region of interest and the multi‐label magnetic resonance angiography whole brain‐case datasets, HUNet consistently outperforms the convolutional U‐net model, demonstrating superior capabilities and achieving higher accuracy across various classes. Additionally, the HUNet model achieves an exceptional dice similarity coefficient of 98.61 and 97.95, along with intersection over union scores of 73.32 and 85.76 in both the multi‐label magnetic resonance angiography region of interest and the multi‐label magnetic resonance angiography whole brain‐case datasets, respectively. These metrics highlight HUNet's exceptional performance in achieving precise and accurate segmentation of anatomical structures within the Circle of Willis, underscoring its robustness in medical image segmentation tasks. Visual representations substantiate HUNet's efficacy in delineating Circle of Willis structures, offering comprehensive insights into its superior performance. [ABSTRACT FROM AUTHOR]

Synthetic aperture radar (SAR) image change detection suffers from poor quality of the difference image and low detection accuracy. Hence, this paper proposes a SAR image change detection method based on a fused difference image and an optimized random forest scheme, termed LRN‐SSARF. Specifically, a fusion operator difference image LRN is proposed, which is generated using a weighted fusion of log‐ratio (LR), ratio (R), and normalized ratio (NoR). This difference image generation method reduces noise's influence. Then, the Otsu algorithm is applied to segment the difference image and select the training samples. The training samples are input into the random forest (RF) model optimised by the sparrow search algorithm (SSA) for training and classification. Finally, the region link is uesd to refine the detection results and generate the final result. The change detection results of six real SAR image scenes highlight that the proposed algorithm has a high detection accuracy, and affords appealing integrity and detailed information about the change regions. Specially, the detection accuracy advantage of the Bangladesh dataset is larger, with the accuracy and Kappa coefficient reaching 98.04% and 92.00%, much higher than the competitor methods. [ABSTRACT FROM AUTHOR]

Image hiding is a task that hides secret images into cover images. The purposes of image hiding are to ensure the secret images are invisible to the human and the secret images can be recovered. The current state‐of‐the‐art steganography methods run the risk of secret information leakage. A safe image hiding network (SIHNet) is presented to reduce the leakage of secret information. Based on some phenomena of image hiding methods which use invertible neural network, a reversible secret image processing (SIP) module is proposed to make the secret images suitable for hiding and make the stego images leak less secret information. Besides, a reversible lost information hiding (LIH) module is used to hide the lost information into the cover images, thus the method can recover the secret images better than the method that uses random noise to replace the lost information. Experimental results show that SIHNet outperforms other state‐of‐the‐art methods on the PSNR and SSIM values of the recovered secret images and the stego images. Besides, residual images of other state‐of‐the‐art methods all contain information about secret images while residual images of SIHNet leak almost no secret information. Thus the method can prevent the listener of transmission channel from obtaining the information of the secret image through the residual image, which means SIHNet performs better in security than other state‐of‐the‐art methods. [ABSTRACT FROM AUTHOR]

The salient object detection task tries to simulate the human visual system for most eye‐catching objects or regions detection. However, due to the complexity of the visual mechanisms, current methods will suffer from severe performance degradation, leading to inconsistent prediction results for the same regions, when directly adopting a model trained on a fixed resolution to evaluate at other different resolutions. Considering that consistency in predictions is essential for salient object detection, a cross‐scale resolution consistent salient object detection method, called RCNet, is proposed. Specifically, to enhance the model's capacity for generalization across images of varying resolutions and make the model implicitly learn the scale invariance, a multi‐resolution data enhancement module is constructed to generate images with arbitrary resolutions for the same scene. Moreover, to accomplish better multi‐level feature fusion, a cross‐scale fusion module is developed to fuse high‐level semantic features and low‐level detail features. Additionally, to explicitly learn the scale invariance of the salient scores, a hybrid salient consistency loss is formulated on salient object detection with different resolutions. Comprehensive evaluations on five benchmark datasets show that RCNet achieves a highly competitive result. [ABSTRACT FROM AUTHOR]

Fires not only cause devastating consequences for human life and property, but also lead to soil erosion in forests. Therefore, it is necessary to design a novel algorithm that can quickly monitor smoke from fires. Most existing smoke segmentation methods do not consider the segmentation accuracy of algorithms under limited computational resources. To address this research gap, this paper proposes a lightweight smoke segmentation algorithm based on DeepLabV3+ that achieves fast inference speed and high accuracy for different sizes smoke. To reduce the number of parameters, the feature extraction network of the DeeplabV3+ algorithm is replaced by MobileNetV2, which enhances the extraction ability of the algorithm in segment smoke images. Then, the Convolutional Block Attention Module (CBAM) is added to the encoder part to enhance the perception of the algorithm for small smoke and effectively alleviates smoke mis‐segmentation. Furthermore, a newly designed loss function is used in the network. The experimental results show that the proposed method has improved by 1.27% in Smoke IoU and 1.21% in mPA compared with other methods. The weight size has been reduced to 10.76% of the original DeepLabV3+, and the inference time is only 33.71ms. Therefore, it is a more suitable early fire detection algorithm for resource‐constrained environments. [ABSTRACT FROM AUTHOR]

Doctors typically use non‐contrast‐enhanced computed tomography (NCECT) in the treatment of kidney cancer to map kidney and tumour structural information to functional imaging single‐photon emission computed tomography, which is then used to assess patient kidney function and predict postoperative recovery. However, the assessment of kidney function and formulation of surgical plans is constrained by the low contrast of tumours in NCECT, which hinders the acquisition of accurate tumour boundaries. Therefore, this study designed a radiomics feature‐enhanced level‐set evolution (RFLSE) to precisely segment small‐sample low‐contrast kidney tumours. Integration of high‐dimensional radiomics features into the level‐set energy function enhances the edge detection capability of low‐contrast kidney tumours. The use of sensitive radiomics features to control the regional term parameters achieves adaptive adjustment of the curve evolution amplitude, improving the level‐set segmentation process. The experimental data used low‐contrast, limited‐sample tumours provided by hospitals, as well as the public datasets BUSI18 and KiTS19. Comparative results with advanced energy functionals and deep learning models demonstrate the precision and robustness of RFLSE segmentation. Additionally, the application value of RFLSE in assisting doctors with accurately marking tumours and generating high‐quality pseudo‐labels for deep learning datasets is demonstrated. [ABSTRACT FROM AUTHOR]

Medical image colouring techniques enable to colourize grey‐scale medical images for assisting doctors in diagnosis. Benefiting from the non‐linear fitting ability of deep neural network, deep medical image colouring techniques have achieved remarkable results. However, existing methods are still facing content and structure feature leakage, unrealistic colouring and poor scale invariability. Thus, this paper, proposes a Transformer‐based medical image colouring algorithm with long‐term dependency to avoid feature leakage of coloured images. To be specific, this method employs two different Transformer encoders to generate and encode feature sequences for grey‐scale medical images and real human colour slice images, respectively. Then, a novel multi‐layer Transformer decoder is used to stylize grey‐scale map image features based on the real physical colour feature sequences. For colouring images at different scales, we implement content‐ aware positional encoding with scale invariance and propose style‐aware positional encoding strategy to take realistic and physical colour prior into account. Extensive experimental results indicate our method has achieved better colourization effects than recent state‐of‐the‐art medical image colourization methods. [ABSTRACT FROM AUTHOR]

Image steganography is the art of concealing secret information within images to prevent detection. In deep‐learning‐based image steganography, a common practice is to fuse the secret image with the cover image to directly generate the stego image. However, not all features are equally critical for data hiding, and some insignificant ones may lead to the appearance of residual artifacts in the stego image. In this article, a novel network architecture for image steganography with hybrid attention mechanism based on generative adversarial network is introduced. This model consists of three subnetworks: a generator for generate stego images, an extractor for extracting the secret images, and a discriminator to simulate the detection process, which aids the generator in producing more realistic stego images. A specific hybrid attention mechanism (HAM) module is designed that effectively fuses information across channel and spatial domains, facilitating adaptive feature refinement within deep image representations. The experimental results suggest that the HAM module not only enhances the image quality during both the steganography and extraction processes but also improves the model's undetectability. Stego images are mixed with varying levels of noise in the training process, which can further improve robustness. Finally, it is verified that the model outperforms current steganography approaches on three datasets and exhibits good undetectability. [ABSTRACT FROM AUTHOR]

Lip‐reading deciphers speech by observing lip movements without relying on audio data. The rapid advancements in deep learning have significantly improved lip‐reading for both English and Chinese; however, research on dialects such as Cantonese remains scarce. Consequently, most Chinese lip‐reading datasets focus on Mandarin, with only a few addressing Cantonese. To bridge this gap, a sentence‐level Cantonese lip‐reading dataset, designated as Cantonese lip‐reading sentences are introduced, comprising over 500 unique speakers and more than 30,000 samples. To ensure alignment with real‐world scenarios, no restrictions are imposed on factors such as gender, age, posture, lighting conditions, or speech rate. A comprehensive description of the pipeline employed is provided for collecting and constructing the dataset and introduce an innovative visual frontend, 3D‐visual attention net. This frontend combines the advantages of convolution and self‐attention mechanisms to extract fine‐grained lip region features. These features are subsequently input into the conformer backend for temporal sequence modelling, achieving comparable performance on Chinese Mandarin lip reading dataset, lip reading sentences 2, lip reading sentences 3, and Cantonese lip‐reading sentences datasets. Benchmark tests on Cantonese lip‐reading sentences demonstrate the challenges it poses, providing a novel research foundation for dialect lip‐reading and fostering the advancement of Cantonese lip‐reading tasks. [ABSTRACT FROM AUTHOR]

Image denoising aims to remove noise from images and improve the quality of images. However, most image denoising methods heavily rely on pairwise training strategies and strict prior knowledge about image structure or noise distribution. While these methods exhibit significant results when handling known types of noise, their generalization performance diminishes when confronted with images containing unknown noise distributions. To address this issue, a two‐stage approach is introduced for enhancing the generalizability of image denoising. The proposed method does not rely on a large amount of paired data or prior knowledge of the noise type and level. Instead, it constructs a denoising pipeline with improved generalizability through an MLP‐based denoiser and generative diffusion prior. Specifically, in the first stage, an initial denoised image is predicted with a structure resembling that of the underlying clean image by introducing an MLP‐based U‐shaped denoising network aided by an implicit structural prior. In the second stage, the generalizability and quality of the denoiser are further enhanced by conditioning the result obtained from the previous stage on the pretrained denoising diffusion null‐space model. Extensive experimentation on multiple datasets demonstrates that this method exhibits better denoising performance and generalizability than other image denoising methods. [ABSTRACT FROM AUTHOR]

Accurate detection of algae in microscopic image plays a crucial role in water quality monitoring. However, the existing object detection methods still face challenges in accurately detecting different categories of algae in microscopic image. In order to improve the accuracy, an improved YOLOv5s model is proposed for microalgae detection, by combining a Receptive Field Enhancement (RFE) module, the Wise‐IoU v3 dynamic non‐monotonic focal loss function, and a Dynamic head (Dyhead), which is termed receptive field enhancement wise‐IoU dyhead (RWD)‐you only look once (YOLO). Firstly, to detect microalgae of various scales, the Bottleneck in the C3 module of YOLOv5s is replaced with a more reasonable RFE module. Secondly, Wise‐IoU v3 is applied to enhance detection accuracy by assigning varying weights between high‐quality and low‐quality images. Finally, Dyhead is introduced to enhance the representation capacity of the detection head by integrating three attention mechanisms: scale awareness, spatial awareness, and task awareness. The proposed RWD‐YOLO model significantly enhances the accuracy of algae detection in microscopic image. Specifically, the experimental results on the microalgae dataset show that the RWD‐YOLO achieves an mAP@0.5 of 93.2% and an mAP@0.5:0.95 of 65.1%. Compared to the original YOLOv5s, mAP@0.5 and mAP@0.5:0.95 are improved by 3.7% and 5.7%, respectively. [ABSTRACT FROM AUTHOR]

Micro‐expressions are spontaneous and unconscious facial movements that reveal individuals' genuine inner emotions. They hold significant potential in various psychological testing fields. As the face is a 3D deformation object, the emergence of facial expression leads to spatial deformation of the face. However, existing databases primarily offer 2D video sequences, limiting descriptions of 3D spatial information related to micro‐expressions. Here, a new micro‐expression database is proposed, which contains 2D image sequences and corresponding 3D point cloud sequences. These samples were classified using both an objective method based on the facial action coding system and a non‐objective emotion classification method that considers video contents and participants' self‐reports. A variety of feature extraction techniques are applied to 2D data, including traditional algorithms and deep learning methods. Additionally, a novel local curvature‐based algorithm is developed to extract 3D spatio‐temporal deformation features from the 3D data. The authors evaluated the classification accuracies of these two features individually and their fusion results under leave‐one‐subject‐out (LOSO) and tenfold cross‐validation. The results demonstrate that fusing 3D features with 2D features results in improved recognition performance compared to using 2D features alone. [ABSTRACT FROM AUTHOR]

Due to differences in the quantity and size of observed targets, hyperspectral images are characterized by class imbalance. The standard deep learning classification model training scheme optimizes the overall classification error, which may lead to performance imbalance between classes in hyperspectral image classification frameworks. Therefore, a novel factor annealing decoupling compositional training method is proposed in this paper. Without requiring resampling or reweighting, it implicitly modulates the training process, so standard models can sufficiently learn the representation of the minority classes and further be trained as robust classifiers. Specifically, the label‐distribution‐aware margin loss is combined with the error‐rate‐based cross‐entropy loss via combination factor, which considers both imbalanced data representation learning and classifier overall performance. Then, a factor annealing optimization training scheme is designed to adjust the combination factor, which solves the stage division problem of two‐stage decoupling learning. Experimental results on two hyperspectral image datasets demonstrate that, as compared with other competing approaches, the proposed method can continuously and stably optimize the model parameters, achieving improvements in class average metrics and difficult classes without affecting overall classification performance. [ABSTRACT FROM AUTHOR]

Optic disc (OD) and optic cup (OC) segmentation is an important task in ophthalmic medicine and is crucial for aiding glaucoma screening. With the development of smart healthcare and the increase of large datasets, there is an increasing number of research efforts targeting OD and OC segmentation, making it particularly important to provide a systematic review of the latest advances in the field. This paper presents a systematic review of commonly used datasets, evaluation metrics, and related research results in the field of OD and OC segmentation. The advantages and disadvantages of segmentation techniques based on traditional and deep learning methods are comparatively analysed. In addition, this study emphasizes the importance of OD and OC segmentation efforts in smart healthcare. Despite the technological advances, the lack of generalization capability is still a major obstacle limiting its clinical application. To address this issue, this study explores unsupervised domain adaptation methods to enhance the generalization performance of segmentation techniques and provide new strategies for clinical diagnosis. Finally, this paper discusses the challenges and future research directions faced by OD and OC segmentation when applied in the medical field to help readers comprehensively grasp the research dynamics in this area. [ABSTRACT FROM AUTHOR]

Synthetic images facilitate stereo matching. However, synthetic images may suffer from image distortion, domain bias, and stereo mismatch, which would significantly restrict the widespread use of stereo matching models in the real world. The first goal in this paper is to synthesize real‐looking images for minimizing the domain bias between the synthesized and real images. For this purpose, sharpened disparity maps are produced from a mono real image. Then, stereo image pairs are synthesized using these imperfect disparity maps and the single real image in the proposed pipeline. Although the synthesized images are as realistic as possible, the domain styles of the synthesized images are always very different from the real images. Thus, the second goal is to enhance the domain generalization ability of the stereo matching network. For that, the feature extraction layer is replaced with a teacher–student model. Then, a constraint of binocular contrast features is imposed on the output of the model. When tested on the KITTI, ETH3D, and Middlebury datasets, the accuracy of the method outperforms traditional methods by at least 30%. Experiments demonstrate that the approaches are general and can be conveniently embedded into existing stereo networks. [ABSTRACT FROM AUTHOR]