Search

The scanning electron microscope (SEM) recordings of dynamic nano-electromechanical systems (NEMS) are difficult to analyze due to the noise caused by low frame rate, insufficient resolution, and blurriness induced by applied electric potentials. Here, we develop an image processing platform enhanced by the physics of the underlying system to track the motion of buckling NEMS structures in the presence of high noise levels. The algorithm is composed of an image filter, two data filters, and a nonlinear regression model, which utilizes the expected form of the physical solution. The method was applied to the recordings of a NEMS beam about 150 nm wide, undergoing intra- and inter-well post-buckling states with a transition rate of approximately 0.5 Hz. The algorithm can track the dynamical motion of the NEMS and capture the dependency of deflection amplitude on the compressive force on the beam. With the help of the proposed algorithm, the transition from inter-well to intra-well motion is clearly resolved for buckling NEMS imaged under SEM. [ABSTRACT FROM AUTHOR]

Photoluminescence imaging of field-installed photovoltaic modules has the potential to be a high throughput on-site inspection technique. A contribution to this development is a noninvasive photoluminescence imaging method that has been proposed recently. It is based on acquiring images during a progressing current–voltage curve sweep, resulting in a detection of a continuously changing photoluminescence signal. From this follows the necessity to employ an alternative algorithm based on the Pearson correlation coefficient, which will contribute to efficient, unsupervised image processing and, thus, easier (in real-time) implementation. The new algorithm separates photoluminescence from the reflected sunlight, similar to the conventional subtraction algorithm. However, it is robust to varying solar irradiance and can process the photoluminescence signal emitted from multiple asynchronized strings. We predict that it will enable unsupervised real-time surveillance and detection of functional anomalies at a low computational cost. It is also more sensitive at segmenting ground-reflected photoluminescence. [ABSTRACT FROM AUTHOR]

Tensile testing (aka tension testing) is a widely employed mechanical testing technique for analyzing materials' properties and behavior under applied stress. Tensile testing plays a pivotal role in helping engineers to make informed decision about material selection and usage. Despite its importance, there is a limited numbers of studies that explored the potential of AI techniques for real time monitoring and material behavior prediction in tensile testing. To this end, this work presents a deep learning model designed to predict the material's condition throughout tensile testing and provide an early warning prior to fracture. By leveraging a comprehensive dataset of tension test video samples, the proposed model utilizes both convolution and recurrent neural networks to extract pertinent spatial and temporal visual features, thereby predicting the frames at which material deformation and fracture occur. The evaluation results of our research showed that the proposed model achieved a predictive ability with an F1-score of 97%, on average. The implications of our research are significant for industries and researchers in the field of materials science and engineering. By accurately predicting material status, our model enables autonomous, real time analysis of material behavior during tensile testing, leading to better time and cost efficiency in various applications. [ABSTRACT FROM AUTHOR]

We introduce a novel technique to mitigate the adverse effects of atmospheric turbulence on astronomical imaging. Utilizing a video-to-image neural network trained on simulated data, our method processes a sliding sequence of short-exposure (∼0.2 s) stellar field images to reconstruct an image devoid of both turbulence and noise. We demonstrate the method with simulated and observed stellar fields, and show that the brief exposure sequence allows the network to accurately associate speckles to their originating stars and effectively disentangle light from adjacent sources across a range of seeing conditions, all while preserving flux to a lower signal-to-noise ratio than an average stack. This approach results in a marked improvement in angular resolution without compromising the astrometric stability of the final image. [ABSTRACT FROM AUTHOR]

Finding patches is a crucial step in a pavement performance survey. The study develops a machine learning and image processing algorithm-established automatic method for identifying asphalt pavement patches. The GrayLevel Co-Occurrence Matrix and image texture-based features derived from color channel statistics are used as input parameters to describe the condition of the pavement. For feature extraction, image processing methods like the projective integral of images, steerable filters, and an improved image thresholding method were used. Support Vector Machine is employed for categorizing the differentiating patched regions from non-patch ones. The suggested combination of image texture analytical methods has been trained using an IA data set created from 400 image samples. The feature set, which combines the characteristics of cracked objects with those generated from the projective integral, can produce the desired result. To make the model's execution simpler, a patch recognition program was created and implemented in MATLAB. As a result, the recently created method has the potential to be an instrument for traffic management organizations through the assessment of pavement performance. The results of the experiments indicate that the newly developed method may achieve excellent accuracy prediction results with a classifier performance rate of about 96%. Such a method could enable transportation authorities to assess the state of asphalt pavement. [ABSTRACT FROM AUTHOR]

Multiplicative noise removal is a challenging image processing problem. In this paper, we study a fractional-order nonlinear cross-diffusion system to denoise images corrupted by multiplicative Gamma noise. The system is coupled by two nonlinear, partial differential equations and gray level information, fractional derivative operator is considered in diffusion process to remove high level noise effectively while preserve structure details for texture images and SAR images. We prove the existence of weak solutions and other theoretical properties of the fractional-order cross-diffusion system under some hypotheses. In the numerical aspect, the model is implemented by virtue of the discrete fractional Fourier transform in the frequency domain. Experimental results show that the new system has a good compromise between multiplicative noise removal and structure preservation when compared to other well-known denoising methods. [ABSTRACT FROM AUTHOR]

Background Purpose Methods Results Conclusions Focusing on the complicated pathological features, such as blurred boundaries, severe scale differences between symptoms, and background noise interference, we aim to enhance the reliability of multiple lesions joint segmentation from medical images.Propose a novel reliable multi‐scale wavelet‐enhanced transformer network, which can provide accurate segmentation results with reliability assessment.Focusing on enhancing the model's capability to capture intricate pathological features in medical images, this work introduces a novel segmentation backbone. The backbone integrates a wavelet‐enhanced feature extractor network and incorporates a multi‐scale transformer module developed within the scope of this work. Simultaneously, to enhance the reliability of segmentation outcomes, a novel uncertainty segmentation head is proposed. This segmentation head is rooted in the SL, contributing to the generation of final segmentation results along with an associated overall uncertainty evaluation score map.Comprehensive experiments are conducted on the public database of AI‐Challenge 2018 for retinal edema lesions segmentation and the segmentation of Thoracic Organs at Risk in CT images. The experimental results highlight the superior segmentation accuracy and heightened reliability achieved by the proposed method in comparison to other state‐of‐the‐art segmentation approaches.Unlike previous segmentation methods, the proposed approach can produce reliable segmentation results with an estimated uncertainty and higher accuracy, enhancing the overall reliability of the model. The code will be release on https://github.com/LooKing9218/ReMultiSeg. [ABSTRACT FROM AUTHOR]

Concerns regarding microplastic (MP) contamination in aquatic ecosystems and its impact on seafood require a better understanding of human dietary MP exposure including extensive monitoring. While conventional techniques for MP analysis like infrared or Raman microspectroscopy provide detailed particle information, they are limited by low sample throughput, particularly when dealing with high particle numbers in seafood due to matrix-related residues. Consequently, more rapid techniques need to be developed to meet the requirements of large-scale monitoring. This study focused on semi-automated fluorescence imaging analysis after Nile red staining for rapid MP screening in seafood. By implementing RGB-based fluorescence threshold values, the need for high operator expertise to prevent misclassification was addressed. Food-relevant MP was identified with over 95% probability and differentiated from natural polymers with a 1% error rate. Comparison with laser direct infrared imaging (LDIR), a state-of-the-art method for rapid MP analysis, showed similar particle counts, indicating plausible results. However, highly variable recovery rates attributed to inhomogeneous particle spiking experiments highlight the need for future development of certified reference material including sample preparation. The proposed method demonstrated suitability of high throughput analysis for seafood samples, requiring 0.02–0.06 h/cm2 filter surface compared to 4.5–14.7 h/cm with LDIR analysis. Overall, the method holds promise as a screening tool for more accurate yet resource-intensive MP analysis methods such as spectroscopic or thermoanalytical techniques. [ABSTRACT FROM AUTHOR]

This study presents a novel photodiode technology with augmented optoelectronic capabilities through the incorporation of quantum dots (QDs). The photodiode, composed of Indium Gallium Zinc Oxide‐Tellurium (IGZO‐Te), is engineered for enhanced light sensitivity and tailored optoelectronic interactions. The primary application of this advanced photodiode lies in the domain of artificial intelligence and machine learning, where it plays a pivotal role in simulating synaptic connections for image processing tasks. Due to the exceptional optical and electrical properties of the IGZO‐Te‐QDs active material combination, the photodiode demonstrates consistent and dependable optical synaptic functions linked to learning. This is achieved through conduction modulation and time duration modulation of light stimulus. In addition, the opto‐synaptic functionalities such as short‐term and long‐term memory has also been successfully demonstrated not only on single device but also on 6 × 6 photodiodes array device. These findings underscore the significant potential of the hybrid structure of IGZO‐Te with QDs in optical artificial neuromorphic chips. [ABSTRACT FROM AUTHOR]

ObjectiveAimMethodResultsConclusionThyroid carcinoma ranks as the 9th most prevalent global cancer, accounting for 586,202 cases and 43,636 deaths in 2020. Computerized image analysis, utilizing artificial intelligence algorithms, emerges as a potential tool for tumor evaluation.This study aims to assess and compare chromatin textural characteristics and nuclear dimensions in follicular neoplasms through gray-level co-occurrence matrix (GLCM), fractal, and morphometric analysis.A retrospective cross-sectional study involving 115 thyroid malignancies, specifically 49 papillary thyroid carcinomas with follicular morphology, was conducted from July 2021 to July 2023. Ethical approval was obtained, and histopathological examination, along with image analysis, was performed using ImageJ software.A statistically significant difference was observed in contrast (2.426 (1.774–3.412) vs 2.664 (1.963–3.610), p = .002), correlation (1.202 (1.071–1.298) vs 0.892 (0.833–0.946), p = .01), and ASM (0.071 (0.090–0.131) vs 0.044 (0.019–0.102), p = .036) between NIFTP and IFVPTC. However, morphometric parameters did not yield statistically significant differences among histological variantsComputerized image analysis, though promising in subtype discrimination, requires further refinement and integration with traditional diagnostic parameters. The study suggests potential applications in scenarios where conventional histopathological assessment faces limitations due to limited tissue availability. Despite limitations such as a small sample size and a retrospective design, the findings contribute to understanding thyroid carcinoma characteristics and underscore the need for comprehensive evaluations integrating various diagnostic modalities. [ABSTRACT FROM AUTHOR]

The proliferation of smart conurbations entails an efficient system design for managing all the crowds in public places. Multitude controlling procedures are carried out for controlling compact areas where more number of peoples is present at several groups. Therefore for controlling purpose the proposed method aims to design a pictorial representation using Internet of Things (IoT). The process is carried out by taking images and then organizing it using switching techniques in the presence of square boxes where entire populace is identified on real time experimentations. For processing and controlling the occurrence a separate architecture is designed with analytical equivalences where all data set is stored in cloud platform. Further the incorporation of system model is carried out using Switching Based Algorithm (SBA) which adds more number of columns even for high population cases. In order to verify the effectiveness of proposed model five scenarios are considered with performance evaluation metrics for SBA and all the test results provides best optimal results. Moreover the projected model is improved with an average percentage of 83 as compared to existing models. [ABSTRACT FROM AUTHOR]

Crop yield predictions are important for crop monitoring and agronomic management. The traditional methods for yield predictions are complicated and resource consuming. With the availability of affordable handheld imaging and computing devices, the image processing-based yield prediction methods are gaining popularity. In this work, RGB images of rice panicles are captured using DSLR camera with simple background and processed to determine the panicle area in terms of number of pixels. A machine learning-based model is developed to make predictions for rice yield. The model is trained to make predictions on unseen data. Various machine learning-based regression algorithms including decision tree, random forest, support vector machine, and convolution neural network are tested. The experiments are performed on a publically available dataset from China as well as on a self-acquired dataset in India. The results have shown that image processing and machine learning-based methods can make yield predictions satisfactorily as evident from the coefficient of determination ( R 2 ) that ranges 0.80–0.97 for different cultivars. The prediction error is determined in terms of root mean square error (RMSE) and mean absolute error (MAE). RMSE for different methods lies between 0.14 and 0.40, whereas MAE varies from 0.11 to 0.30. Among the tested algorithms, linear regression achieved the best precision with R 2 = 0.97, RMSE = 0.14, and MAE = 0.11. [ABSTRACT FROM AUTHOR]

STUDY QUESTION Can generative artificial intelligence (AI) models produce high-fidelity images of human blastocysts? SUMMARY ANSWER Generative AI models exhibit the capability to generate high-fidelity human blastocyst images, thereby providing substantial training datasets crucial for the development of robust AI models. WHAT IS KNOWN ALREADY The integration of AI into IVF procedures holds the potential to enhance objectivity and automate embryo selection for transfer. However, the effectiveness of AI is limited by data scarcity and ethical concerns related to patient data privacy. Generative adversarial networks (GAN) have emerged as a promising approach to alleviate data limitations by generating synthetic data that closely approximate real images. STUDY DESIGN, SIZE, DURATION Blastocyst images were included as training data from a public dataset of time-lapse microscopy (TLM) videos (n = 136). A style-based GAN was fine-tuned as the generative model. PARTICIPANTS/MATERIALS, SETTING, METHODS We curated a total of 972 blastocyst images as training data, where frames were captured within the time window of 110–120 h post-insemination at 1-h intervals from TLM videos. We configured the style-based GAN model with data augmentation (AUG) and pretrained weights (Pretrained-T: with translation equivariance; Pretrained-R: with translation and rotation equivariance) to compare their optimization on image synthesis. We then applied quantitative metrics including Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) to assess the quality and fidelity of the generated images. Subsequently, we evaluated qualitative performance by measuring the intelligence behavior of the model through the visual Turing test. To this end, 60 individuals with diverse backgrounds and expertise in clinical embryology and IVF evaluated the quality of synthetic embryo images. MAIN RESULTS AND THE ROLE OF CHANCE During the training process, we observed consistent improvement of image quality that was measured by FID and KID scores. Pretrained and AUG + Pretrained initiated with remarkably lower FID and KID values compared to both Baseline and AUG + Baseline models. Following 5000 training iterations, the AUG + Pretrained-R model showed the highest performance of the evaluated five configurations with FID and KID scores of 15.2 and 0.004, respectively. Subsequently, we carried out the visual Turing test, such that IVF embryologists, IVF laboratory technicians, and non-experts evaluated the synthetic blastocyst-stage embryo images and obtained similar performance in specificity with marginal differences in accuracy and sensitivity. LIMITATIONS, REASONS FOR CAUTION In this study, we primarily focused the training data on blastocyst images as IVF embryos are primarily assessed in blastocyst stage. However, generation of an array of images in different preimplantation stages offers further insights into the development of preimplantation embryos and IVF success. In addition, we resized training images to a resolution of 256 × 256 pixels to moderate the computational costs of training the style-based GAN models. Further research is needed to involve a more extensive and diverse dataset from the formation of the zygote to the blastocyst stage, e.g. video generation, and the use of improved image resolution to facilitate the development of comprehensive AI algorithms and to produce higher-quality images. WIDER IMPLICATIONS OF THE FINDINGS Generative AI models hold promising potential in generating high-fidelity human blastocyst images, which allows the development of robust AI models as it can provide sufficient training datasets while safeguarding patient data privacy. Additionally, this may help to produce sufficient embryo imaging training data with different (rare) abnormal features, such as embryonic arrest, tripolar cell division to avoid class imbalances and reach to even datasets. Thus, generative models may offer a compelling opportunity to transform embryo selection procedures and substantially enhance IVF outcomes. STUDY FUNDING/COMPETING INTEREST(S) This study was supported by a Horizon 2020 innovation grant (ERIN, grant no. EU952516) and a Horizon Europe grant (NESTOR, grant no. 101120075) of the European Commission to A.S. and M.Z.E. the Estonian Research Council (grant no. PRG1076) to A.S. and the EVA (Erfelijkheid Voortplanting & Aanleg) specialty program (grant no. KP111513) of Maastricht University Medical Centre (MUMC+) to M.Z.E. TRIAL REGISTRATION NUMBER Not applicable. [ABSTRACT FROM AUTHOR]

Segmentation is crucial in diagnosing retinal diseases by accurately identifiying retinal vessels. This paper addresses the complexity of segmenting retinal vessels, highlighting the need for precise analysis of blood vessel structures. Despite the progress made by convolutional neural networsks (CNNs) in image segmentation, their limitations in capturing the global structure of retinal vsessels and maintaining segmentation continuity present challenges. To tackle these issues, our proposed network integrates graph convolutional networks (GCNs) and attention mechansims. This allows the model to consider pixel relationships and learn vessel graphical structures, significantly improving segmentation accuracy. Additionally, the attentional feature fusion module, including pixel‐wise and channel‐wise attention mechansims within the U‐Net architecture, refines the model's focus on relevant features. This paper emphasizes the importance of continuty preservation, ensuring an accurate representation of pixel‐level information and structural details during sefmentation. Therefore, our method performs as an effective solution to overcome challenges in retinal vessel segmentation. The proposed method outperformed the state‐of‐the‐art approaches on DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (Structed Analysis of the Retina) datasets with accuracies of 0.12% and 0.14%, respecttively. Importantly, our proposed approach excelled in delineating slender and diminutive blood vessels, crucial for diagnosing vascular‐related diseases. Implementation is accessible on https://github.com/CVLab‐SHUT/VGA‐Net. [ABSTRACT FROM AUTHOR]

In recent years, low‐light image enhancement has become increasingly active. However, in underground mine environments, acquiring high‐quality images is still challenging due to low light, low contrast, and occlusion. To address this problem, this study proposes a low‐light image enhancement method for underground mine based on generative adversarial networks (UM‐GAN), which aims to take full advantage of the ability of GAN to achieve the restoration of details, the reduction of noise, and the improvement of overall image quality. The model proposed in this paper is divided into three main parts. Initially, a generator network adopting an encoder–decoder structure is developed. Subsequently, a novel strategy is introduced to merge information by utilizing inverted greyscale images and low‐light images as inputs. Further image quality enhancement is achieved by incorporating a noise reduction module employing the diffusion model. To ascertain the efficacy of the UM‐GAN method, evaluations are conducted on diverse real‐world and synthetic datasets, juxtaposing the approach against superior methods. Through qualitative and quantitative comparative experiments, the method showcases noteworthy advancements through qualitative and quantitative comparative experiments, substantiating its effectiveness. This research provides new ideas and methods for overcoming image quality problems in underground mine environments and contributes to the development of underground mine image processing. [ABSTRACT FROM AUTHOR]

The surface quality of steel strip is a critical indicator of the quality of hot‐rolled strip, so accurate inspection of its surface is essential. However, the complex texture of steel strip surface defects makes the detection challenging. Here, a multi‐scale feature fusion and attention based YOLOv5 (MFFA‐YOLOv5) model is proposed. Specifically, the bottom layer features are up‐sampled and fused not only with the middle layer features, but also with the top layer features, so that the model better captures the surface texture information of the steel strip. Secondly, an improved attention mechanism module is introduced to deal with the global and local information of the steel strip surface by introducing down‐sampling and up‐sampling paths based on Convolutional Block Attention Module (CBAM). Meanwhile, a self‐attention mechanism path is added to improve the capability of feature representation. Experimental results on the NEU‐DET dataset show that the MFFA‐YOLOv5 model significantly outperforms other state‐of‐the‐art methods. [ABSTRACT FROM AUTHOR]

Slug flow processes draw much attention in chemical and pharmaceutical manufacturing thanks to their ability to eliminate downtime costs and batch‐to‐batch variation. Using in‐line video can monitor the current process status and improve the stability of the slug flow. However, there are no effective image processing methods aiming at such videos from chemical experiments due to limited training sample size and the variety of experimental settings. The paper proposes a training‐free method to automatically detect and measure the slugs from in‐line videos. Multiple image features are fused to identify the slug shapes under various lighting conditions, a six‐point model is fitted to achieve better volume estimation, and a consistency score is estimated to quantify the detection uncertainty. The proposed algorithm achieves similar results to manual labeling for various types of slug flow processes, improving the accuracy of slug column estimation by a large margin compared to the existing automatic methods. Finally, using it to monitor the slug flow process's stability and the change of the slug volume in an injection point are demonstrated. The method not only shows that handcrafted image features have the capability for detection and segmentation from chemical experiment images but also paves the road for a training‐based algorithm for the task. [ABSTRACT FROM AUTHOR]

The demand for less complex and more accurate architectures has always been a priority since the broad usage of computer vision in everyday life, like auto‐drive cars, portable applications, augmented reality systems, medical image analysis etc. There are a lot of methods that have been developed to improve the accuracy and complexity of object detection, like the generations of R‐CNNs and YOLOs. However, these methods are not the most efficient architectures, and there is always room to improve. In this study, the 5th version of YOLO is employed and the improved architecture, Inception‐YOLO, is presented. The model significantly outperforms the SOTA YOLO family. Specifically, the improvements can be summarised as follows: impressive improvement of floating point operations (FLOPs) and number of parameters, as well as improvement in accuracy compared to the models with fewer FLOPs. All our presented approaches, like the optimized inception module, proposed structures for CSP and SPPF, and the improved loss function used in this research, work together to incrementally improve detection results, accuracy, demanded memory, and FLOPs simultaneously. For a glimpse of performance, the Inception‐YOLO‐S model hits 38.7% AP with 5.9M parameters and 11.5 BFLOPs and outperforms YOLOv5‐S with 37.4% AP, 7.2M parameters, and 16.5 BFLOPs. [ABSTRACT FROM AUTHOR]

Low‐light image enhancement is a longstanding challenge in low‐level vision, as images captured in low‐light conditions often suffer from significant aesthetic quality flaws. Recent methods based on deep neural networks have made impressive progress in this area. In contrast to mainstream convolutional neural network (CNN)‐based methods, an effective solution inspired by the transformer, which has shown impressive performance in various tasks, is proposed. This solution is centred around two key components. The first is an image synthesis pipeline, and the second is a powerful transformer‐based pre‐trained model, known as the low‐light image enhancement transformer (LIET). The image synthesis pipeline includes illumination simulation and realistic noise simulation, enabling the generation of more life‐like low‐light images to overcome the issue of data scarcity. LIET combines streamlined CNN‐based encoder‐decoders with a transformer body, efficiently extracting global and local contextual features at a relatively low computational cost. The extensive experiments show that this approach is highly competitive with current state‐of‐the‐art methods. The codes have been released and are available at LIET. [ABSTRACT FROM AUTHOR]

In the realm of video salient object detection (VSOD), the majority of research has traditionally been centered on third‐person perspective videos. However, this focus overlooks the unique requirements of certain first‐person tasks, such as autonomous driving or robot vision. To bridge this gap, a novel dataset and a camera‐based VSOD model, CaMSD, specifically designed for egocentric videos, is introduced. First, the SalEgo dataset, comprising 17,400 fully annotated frames for video salient object detection, is presented. Second, a computational model that incorporates a camera movement module is proposed, designed to emulate the patterns observed when humans view videos. Additionally, to achieve precise segmentation of a single salient object during switches between salient objects, as opposed to simultaneously segmenting two objects, a saliency enhancement module based on the Squeeze and Excitation Block is incorporated. Experimental results show that the approach outperforms other state‐of‐the‐art methods in egocentric video salient object detection tasks. Dataset and codes can be found at https://github.com/hzhang1999/SalEgo. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Computer Vision, discussing the topic of advanced image restoration and enhancement. The editorial highlights the challenges faced in this field, such as the complexity of degradation models for real-world low-quality images and the difficulty of acquiring paired data. It also introduces a special issue of the journal that includes five accepted papers, which focus on video reconstruction and image super-resolution. The editorial concludes by providing brief summaries of each accepted paper. The guest editors of the special issue are also mentioned, along with their research interests and affiliations. [Extracted from the article]

Perception systems in autonomous vehicles need to accurately detect and classify objects within their surrounding environments. Numerous types of sensors are deployed on these vehicles, and the combination of such multimodal data streams can significantly boost performance. The authors introduce a novel sensor fusion framework using deep convolutional neural networks. The framework employs both camera and LiDAR sensors in a multimodal, multiview configuration. The authors leverage both data types by introducing two new innovative fusion mechanisms: element‐wise multiplication and multimodal factorised bilinear pooling. The methods improve the bird's eye view moderate average precision score by +4.97% and +8.35% on the KITTI dataset when compared to traditional fusion operators like element‐wise addition and feature map concatenation. An in‐depth analysis of key design choices impacting performance, such as data augmentation, multi‐task learning, and convolutional architecture design is offered. The study aims to pave the way for the development of more robust multimodal machine vision systems. The authors conclude the paper with qualitative results, discussing both successful and problematic cases, along with potential ways to mitigate the latter. [ABSTRACT FROM AUTHOR]

Recent advances in deep convolutional neural networks have shown improved performance in face super‐resolution through joint training with other tasks such as face analysis and landmark prediction. However, these methods have certain limitations. One major limitation is the requirement for manual marking information on the dataset for multi‐task joint learning. This additional marking process increases the computational cost of the network model. Additionally, since prior information is often estimated from low‐quality faces, the obtained guidance information tends to be inaccurate. To address these challenges, a novel Decoder Structure Guided CNN‐Transformer Network (DCTNet) is introduced, which utilises the newly proposed Global‐Local Feature Extraction Unit (GLFEU) for effective embedding. Specifically, the proposed GLFEU is composed of an attention branch and a Transformer branch, to simultaneously restore global facial structure and local texture details. Additionally, a Multi‐Stage Feature Fusion Module is incorporated to fuse features from different network stages, further improving the quality of the restored face images. Compared with previous methods, DCTNet improves Peak Signal‐to‐Noise Ratio by 0.23 and 0.19 dB on the CelebA and Helen datasets, respectively. Experimental results demonstrate that the designed DCTNet offers a simple yet powerful solution to recover detailed facial structures from low‐quality images. [ABSTRACT FROM AUTHOR]

In recent years, many methods for image super‐resolution (SR) have relied on pairs of low‐resolution (LR) and high‐resolution (HR) images for training, where the degradation process is predefined by bicubic downsampling. While such approaches perform well in standard benchmark tests, they often fail to accurately replicate the complexity of real‐world image degradation. To address this challenge, researchers have proposed the use of unpaired image training to implicitly model the degradation process. However, there is a significant domain gap between the real‐world LR and the synthetic LR images from HR, which severely degrades the SR performance. A novel unsupervised image‐blind super‐resolution method that exploits degradation feature‐based learning for real‐image super‐resolution reconstruction (RDFL) is proposed. Their approach learns the degradation process from HR to LR using a generative adversarial network (GAN) and constrains the data distribution of the synthetic LR with real degraded images. The authors then encode the degraded features into a Transformer‐based SR network for image super‐resolution reconstruction through degradation representation learning. Extensive experiments on both synthetic and real datasets demonstrate the effectiveness and superiority of the RDFL method, which achieves visually pleasing reconstruction results. [ABSTRACT FROM AUTHOR]

Mobile devices and handheld systems, such as the smartphones and tablets universally extended, are becoming increasingly powerful. Their basic hardware configuration is usually state-of-the-art heterogeneous architectures consisting of multi-core processors and some kind of accelerator such as GPUs or DSPs. Specific code adapted to the architecture is mandatory if high-performance computation is required and low-level libraries and parallelism are needed, which constitutes an important barrier for the usual developer in such devices. In this context, we propose the FancyJCL framework. It provides a high-level abstraction layer that hides implementation details and allows to develop parallel programs for mobile devices. The target platform for FancyJCL is mainly Android and Java developers due to their high market penetration. A very simple, seemingly sequential encoding results in parallel efficient OpenCL code. FancyJCL is itself based on the Fancier framework, which enables optimal memory management across memory spaces on unified memory systems. Benchmarks of FancyJCL code developed for a wide range of image processing algorithms show good performance with low development effort. [ABSTRACT FROM AUTHOR]

Conventional image processing and machine learning based on handcrafted features struggle to meet the real time and high-accuracy requirements for industrial defect detection in complex, sensitive, and dynamic environments. To address this issue, this paper proposes AENet, a novel real-time defect detection network based on an encoder-decoder model, which achieves high detection accuracy and efficiency while demonstrating excellent convergence and generalization. Firstly, a spatial channel attention module in the encoding network is designed to exploit both spatial attention and channel attention using a multi-head 3D self-attention mechanism. This improves parallelism and detection efficiency. Secondly, the decoding network of AENet incorporates the cross-level attention fusion module, which fuses input features from different layers. Combined with multi-level upsampling design, the decoder enhances the representation of defect details. Furthermore, we insert a simplified aggregator into the encoder-decoder network to extract feature information at different scales with low computational cost. This aggregation process aids in training and inference on industrial defect datasets by incorporating contextual information. Extensive experimental results demonstrate that AENet outperforms other segmentation models in accomplishing defect recognition and segmentation in challenging optical environments. It exhibits a faster convergence than other networks and a balance between accuracy and speed. It achieves a recognition accuracy of over 96% for almost all types of defects in the actual industrial environment on the NVIDIA Tesla V100 GPU. [ABSTRACT FROM AUTHOR]