Search

Accurate velocity measurement of unmanned aerial vehicles (UAVs) is essential in various applications. Traditional vision-based methods rely heavily on visual features, which are often inadequate in low-light or feature-sparse environments. This study presents a novel approach to measure the axial velocity of UAVs using motion blur images captured by a UAV-mounted monocular camera. We introduce a motion blur model that synthesizes imaging from neighboring frames to enhance motion blur visibility. The synthesized blur frames are transformed into spectrograms using the Fast Fourier Transform (FFT) technique. We then apply a binarization process and the Radon transform to extract light-dark stripe spacing, which represents the motion blur length. This length is used to establish a model correlating motion blur with axial velocity, allowing precise velocity calculation. Field tests in a hydropower station penstock demonstrated an average velocity error of 0.048 m/s compared to ultra-wideband (UWB) measurements. The root-mean-square error was 0.025, with an average computational time of 42.3 ms and CPU load of 17%. These results confirm the stability and accuracy of our velocity estimation algorithm in challenging environments. [ABSTRACT FROM AUTHOR]

Many species rely on celestial cues as a reliable guide for maintaining heading while navigating. In this paper, we propose a method that extracts the Milky Way (MW) shape as an orientation cue in low-light scenarios. We also tested the method on both real and synthetic images and demonstrate that the performance of the method appears to be accurate and reliable to motion blur that might be caused by rotational vibration and stabilisation artefacts. The technique presented achieves an angular accuracy between a minimum of 0.00 ° and a maximum 0.08 ° for real night sky images, and between a minimum of 0.22 ° and a maximum 1.61 ° for synthetic images. The imaging of the MW is largely unaffected by blur. We speculate that the use of the MW as an orientation cue has evolved because, unlike individual stars, it is resilient to motion blur caused by locomotion. [ABSTRACT FROM AUTHOR]

Abstract Accurate velocity measurement of unmanned aerial vehicles (UAVs) is essential in various applications. Traditional vision-based methods rely heavily on visual features, which are often inadequate in low-light or feature-sparse environments. This study presents a novel approach to measure the axial velocity of UAVs using motion blur images captured by a UAV-mounted monocular camera. We introduce a motion blur model that synthesizes imaging from neighboring frames to enhance motion blur visibility. The synthesized blur frames are transformed into spectrograms using the Fast Fourier Transform (FFT) technique. We then apply a binarization process and the Radon transform to extract light-dark stripe spacing, which represents the motion blur length. This length is used to establish a model correlating motion blur with axial velocity, allowing precise velocity calculation. Field tests in a hydropower station penstock demonstrated an average velocity error of 0.048 m/s compared to ultra-wideband (UWB) measurements. The root-mean-square error was 0.025, with an average computational time of 42.3 ms and CPU load of 17%. These results confirm the stability and accuracy of our velocity estimation algorithm in challenging environments.

A method has been proposed to eliminate slight motion blur in the image. The method is implemented in three stages. Blur estimation is achieved by prior information on the distribution image gradient. The Gaussian Orientation Filter (GOF) fits the prior information to find the regression coefficients. Order combines different estimate GOF parameters to generate a removal blur filter. Estimation parameters are fixed and set blur on the image to produce an image without boosting the noise and unwanted. The proposed model optimization solves the problem by minimizing the loss function. The suggested method applies to outdoor and indoor video acquired by modern smartphones. The experiment result display is accurate for the full regression motion blur model. The suggested model example on video dataset conditions has 23 s video time long and 228 MP dataset size. Measurement evaluation established on time consumer, Structural Similarity Index Measure and Peak Signal-to-Noise Ratio. Experimental results show that the image artifact phase is less consuming computational time. The proposed model has a minimized cost function and generates image quality.

Fusing digital images is an essential step in digital image processing, as it allows for integrating information from two or more images into a single image of high quality and clarity. This work fused images resulting from motion blur (left and right) with blur block sizes of 3, 5, 7, 9, and 11. The image resulting from the blur towards the right was combined with the image resulting from the blur towards the left for the same degree of blur using traditional techniques such as addition, multiplication, and new suggested techniques, namely absolute real standard deviation, binary standard deviation, real Covariance, and binary Covariance. The data examined by quality assessment methods with the reference depends on Mutual Information, Correlation Coefficient, Structural Similarity Index metric, Structural Content, Normalized Cross Correlation, and without references like Blind Reference, less Spatial Image Quality Evaluator, Naturalness Image Quality Evaluator, Perception-based Image Quality Evaluator, and Entropy. The best combination method was binary covariance and standard binary division. [ABSTRACT FROM AUTHOR]

Refresh rate is an important specification for gaming OLED monitors. With the development of the gaming industry and the graphics processing unit (GPU), the demand for gaming monitors that supporting high refresh rates is increasing. In this paper, simulation methods for perceived motion blur are proposed to predict the degree of blur according to the refresh rate. Experimental results indicate that the proposed simulation methods are quite effective in predicting the degree of motion blur. In addition, this paper presents the predicted results of blur as the refresh rate increases up to 480Hz. [ABSTRACT FROM AUTHOR]

We evaluated the performance of three flat large‐sized gaming monitors with 35 subjects regarding the recognition of Landolt C with short visualization time and fast movement. A search task using circles in dark and bright conditions and visual fatigue. An OLED monitor performed significantly better than two LCDs. [ABSTRACT FROM AUTHOR]

Recent gaming monitors claim high refresh rates of ≥240 Hz with response times ≤1 ms. However, these temporal metrics do not clearly reveal their true spatiotemporal resolution, which depends on the velocity at which the images are displayed. This is the first study to demonstrate the line‐based dynamic modulation transfer function (MTF) measurement method for comparing the performances of different gaming monitors. A single line was scrolled on the monitors, and a small region of the screen was captured with a high‐speed camera during one display refresh period. The dynamic MTF results elucidate the dependence of spatiotemporal resolution characteristics on the scroll speed, refresh rate, and response time of the monitors. [ABSTRACT FROM AUTHOR]

Traditional methods for motion blur, often relying on a single layer, deviate from the correct colors. We propose a multilayer rendering method that closely approximates the motion blur effect. Our approach stores motion vectors for each pixel, divides these vectors into multiple sample points, and performs a backward search from the current pixel. The color at a sample point is sampled if it shares the same motion vector as its origin. This procedure repeats across layers, with only the nearest color values sampled for depth testing. The average color sampled at each point becomes that of the motion blur. Our experimental results indicate that our method significantly reduces the color deviation commonly found in traditional approaches, achieving structural similarity index measures (SSIM) of 0.8 and 0.92, which represent substantial improvements over the accumulation method. [ABSTRACT FROM AUTHOR]

In the dynamic visual cabinet, the occurrence of motion blur when consumers take out commodities will reduce the accuracy of commodity detection. Recently, although Transformer-based video deblurring networks have achieved results compared to Convolutional Neural Networks in some blurring scenarios, they are still challenging for the non-uniform blurring problem that occurs when consumers pick up the commodities, such as the problem of difficult alignment of blurred video frames of small commodities and the problem of underutilizing the effective information between the video frames of commodities. Therefore, an improved Transformer video deblurring network is proposed. Firstly, a multi-scale Transformer feature extraction method is utilized for non-uniform blurring. Secondly, for the problem of difficult alignment of small-item-blurred video frames, a temporal interactive attention mechanism is designed for video frame alignment. Finally, a feature recurrent fusion mechanism is introduced to supplement the effective information of commodity features. The experimental results show that the proposed method has practical significance in improving the accuracy of commodity detection. Moreover, compared with the recent Transformer deblurring algorithm Video Restoration Transformer, the Peak Signal-to-Noise Ratio of this paper's algorithm is higher than that of the Deep Video Deblurring dataset and the Fuzzy Commodity Dataset by 0.23 dB and 0.81 dB, respectively. [ABSTRACT FROM AUTHOR]

X-rays are common tools used in clinical diagnoses. During the X-ray process, a patient is required to lie still or to hold a deep breath. However, when dealing with patients who may shake involuntarily or with restless children, the required conditions are not always achievable, and blurred images often occur. If these patients receive repeated X-rays, they are exposed to additional amounts of radiation. This research integrates the DeblurGAN model and a convolutional neural network (CNN) to increase the accuracy for classifying clinical X-ray motion blurred images, eliminating the need for repeated clinical X-rays. Results show that classification accuracy of the motion blur group was 87% while the deblurred group was 91%, indicating the process not only improves classification accuracy but also restores the deblurred group images to a 92% level of the original image group. This study verifies the feasibility of applying the DeblurGAN model to medical X-ray image deblurring, helping resolve the challenges presented by a lack of X-ray motion blur image data and allowing InceptionV3 to accurately identify the problem. This method can be further applied to other motion blur medical images (such as MRI and CT) to improve overall clinical diagnosis efficiency. [ABSTRACT FROM AUTHOR]

Motion blur removal caused by camera shake and object motion in 3D space has long been a challenge in computer vision. Although RGB images are commonly used as input data for CNN-based image deblurring, their inherent issues of color overlap and high dimensionality can limit performance. To address these problems, we propose YUVDR, a residual network based on YUV color space, for image deblurring. By using YUV images, we mitigate the issues of color overlap and mutual influence. We introduce novel loss functions and conduct experiments on three datasets, namely GoPro, DVD and NFS, which offer a wide range of image quality levels, scene complexities, and types of motion blur. Our proposed method outperforms state-of-the-art algorithms, yielding a 3-5 dB improvement in the PSNR of test results. In addition, utilizing the YUV color space as the input data can greatly reduce the number of training parameters and model size, by approximately 15 times. This optimization of GPU memory not only improves training efficiency, but also reduces testing time for practical applications. [ABSTRACT FROM AUTHOR]

Copyright of Ingeniería (0121-750X) is the property of Ingenieria and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The motion blur of organic light‐emitting diodes (OLEDs) consists of the brightness and color transition. This paper presents a new and comprehensive evaluation method that can quantify the motion blur more intuitively. By Tri‐stimulus waveform integration, we obtain the brightness and the color evolution trend by every frame after data signal input. [ABSTRACT FROM AUTHOR]

In this study, we have demonstrated the phenomenon of motion blur in mobile phone during the process of application and analyzed the relevant factors that affect motion blur at low gray levels, including thin film transistor (TFT), organic light emitting diodes (OLED), and electronic code. Our findings indicated that the OLED capacitance has a more significant impact on phenomenon of motion blur than TFT and electronic code. Furthermore, we discovered that OLED capacitance is inversely proportional to the brightness of the first frame when switching from a black screen to white/red/green/blue screens. By adjusting holes accumulation at the OLED interface and the thickness of the common layer, it is possible to reduce OLED capacitance while improving objective value and subjective visual performance. [ABSTRACT FROM AUTHOR]

Our research found that there are some low‐brightness application scenarios in the process of using the mobile phone. The smart interface option of the mobile phone is called "dark scene mode/dark color mode". Under this mode, the brightness of the mobile phone is adjusted to the lowest level, the background interface is black, the font displayed is white or the color with gray scale. When read a novel or drag the phone interface, the white text displayed on the screen is dimmer and the color is changed, which is called "Motion blur". In the research process, we compared the TFT device of low‐temperature poly‐silicon with that OLED device of organic light‐emitting material. The research results showed that under low brightness, Motion blurred has been showed different response states when OLED material or its related process parameters has been changed.while the TFT device of low‐temperature poly‐silicon only responded under the condition of high brightness. When brightness decreases, there is a weak correlation between the effects on Motion blurs [ABSTRACT FROM AUTHOR]

RGBT tracking combines visible and thermal infrared images to achieve tracking and faces challenges due to motion blur caused by camera and target movement. In this study, we observe that the tracking in motion blur is significantly affected by both frequency and spatial aspects. And blurred targets exhibit sharp texture details that are represented as high-frequency information. But existing trackers capture low-frequency components while ignoring high-frequency information. To enhance the representation of sharp information in blurred scenes, we introduce multi-frequency and multi-spatial information in network, called FSBNet. First, we construct a modality-specific unsymmetrical architecture and integrate an adaptive soft threshold mechanism into a DCT-based multi-frequency channel attention adapter (DFDA). DFDA adaptively integrates rich multi-frequency information. Second, we propose a masked frequency-based translation adapter (MFTA) to refine drifting failure boxes caused by camera motion. Moreover, we find that small targets get more affected by motion blur compared to larger targets, and we mitigate this issue by designing a cross-scale mutual conversion adapter (CFCA) between the frequency and spatial domains. Extensive experiments on GTOT, RGBT234 and LasHeR benchmarks demonstrate the promising performance of our method in the presence of motion blur. [ABSTRACT FROM AUTHOR]

We propose a new concept image sensor suitable for viewing and sensing applications. This is a report of a CMOS image sensor with a pixel architecture consisting of a 1.5 μm pixel with four-floating-diffusions-shared pixel structures and a 3.0 μm pixel with an in-pixel capacitor. These pixels are four small quadrate pixels and one big square pixel, also called quadrate–square pixels. They are arranged in a staggered pitch array. The 1.5 μm pixel pitch allows for a resolution high enough to recognize distant road signs. The 3 μm pixel with intra-pixel capacitance provides two types of signal outputs: a low-noise signal with high conversion efficiency and a highly saturated signal output, resulting in a high dynamic range (HDR). Two types of signals with long exposure times are read out from the vertical pixel, and four types of signals are read out from the horizontal pixel. In addition, two signals with short exposure times are read out again from the square pixel. A total of eight different signals are read out. This allows two rows to be read out simultaneously while reducing motion blur. This architecture achieves both an HDR of 106 dB and LED flicker mitigation (LFM), as well as being motion-artifact-free and motion-blur-less. As a result, moving subjects can be accurately recognized and detected with good color reproducibility in any lighting environment. This allows a single sensor to deliver the performance required for viewing and sensing applications. [ABSTRACT FROM AUTHOR]

Motion blur is common in video tracking and detection, and severe motion blur can lead to failure in tracking and detection. In this work, a motion-blur hysteresis phenomenon (MBHP) was discovered, which has an impact on tracking and detection accuracy as well as image annotation. In order to accurately quantify MBHP, this paper proposes a motion-blur dataset construction method based on a motion-blur operator (MBO) generation method and self-similar object images, and designs APSF, a MBO generation method. The optimized sub-pixel estimation method of the point spread function (SPEPSF) is used to demonstrate the accuracy and robustness of the APSF method, showing the maximum error (ME) of APSF to be smaller than others (reduced by 86%, when motion-blur length > 20, motion-blur angle = 0), and the mean square error (MSE) of APSF to be smaller than others (reduced by 65.67% when motion-blur angle = 0). A fast image matching method based on a fast correlation response coefficient (FAST-PCC) and improved KCF were used with the motion-blur dataset to quantify MBHP. The results show that MBHP exists significantly when the motion blur changes and the error caused by MBHP is close to half of the difference of the motion-blur length between two consecutive frames. A general flow chart of visual tracking displacement detection with error compensation for MBHP was designed, and three methods for calculating compensation values were proposed: compensation values based on inter-frame displacement estimation error, SPEPSF, and no-reference image quality assessment (NR-IQA) indicators. Additionally, the implementation experiments showed that this error can be reduced by more than 96%. [ABSTRACT FROM AUTHOR]

The quality of the underwater image is impairing with the atmospheric conditions. In this, one of the most significant issues in recent days is due to the motion blur induced by the imaging device or by the movement of the object in underwater image quality degradation. The various parameters of the blurred image must be identified to fix the effect of blurring in post-imaging. Therefore, spectrum-based parameter estimation method is proposed. Initially, to estimate the point spread function (PSF), the angle and the length is measured from image spectrum using radon transform. Then, for the accurate estimation of PSF, Optimized Polynomial Lagrange Interpolation (OPLI) is proposed. The data were collected and analyzed in various natural and structured water bodies in Chennai without affecting the real environment. It is observed that for the underwater images collected, the proposed OPLI approach outperforms compared to few existing traditional estimation methods like cepstral, hough, and radon. Then this veracious interpolated measure of angle and length (VIMAL) is restored using modified Lucy algorithm and is evaluated which results in high performance than the existing classical state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Remote photoplethysmography (rPPG) enables contact-free monitoring of the pulse rate by using a color camera. The fundamental limitation is that motion artifacts and changes in ambient light conditions greatly affect the accuracy of pulse-rate monitoring. We propose use of a high-speed camera and a motion suppression algorithm with high computational efficiency. This system incorporates a number of major improvements including reproduction of pulse wave details, high-precision pulse-rate monitoring of moving subjects, and excellent scene scalability. A series of quantization methods were used to evaluate the effect of different frame rates and different algorithms in pulse-rate monitoring of moving subjects. The experimental results show that use of 180-fps video and a Plane-Orthogonal-to-Skin (POS) algorithm can produce high-precision pulse-rate monitoring results with mean absolute error can be less than 5 bpm and the relative accuracy reaching 94.5%. Thus, it has significant potential to improve personal health care and intelligent health monitoring. [ABSTRACT FROM AUTHOR]

To reduce bird collisions on wind turbines, Automatic Detection Systems have been developed to locate approaching birds and trigger turbines to slowdown to 2–3 rotations per minute (rpm). However, it is unknown whether birds can detect this reduced speed and avoid the turbine. We conducted an operant conditioning experiment on domestic doves (Streptopelia roseogrisea) and Harris's hawks (Parabuteo unicinctus) to assess their ability to discriminate between stationary and rotating miniature wind turbines, depending on the rotation speed and the contrast between the white blades and the background (only for doves for the latter). At high contrast, regardless of the speed tested, hawks were able to differentiate between the rotating and stationary turbines, while doves were not able to discriminate the slow‐rotating turbine (3 rpm) from the stationary one. The discrimination threshold increased to 8 rpm for the doves when the contrast was reduced. Our results suggest that the residual wind turbine speed of 2–3 rpm may not be detected by all bird species under all environmental conditions. Increasing the contrast between wind turbines and their environment may improve the detection of low‐speed rotation by some birds, otherwise, complete turbine shutdown should be recommended. [ABSTRACT FROM AUTHOR]

Context: Vision-based measurement (VBM) systems are becoming popular as an affordable and suitable alternative for scientific and engineering applications. When cameras are used as instruments, motion blur usually emerges as a recurrent and undesirable image degradation, which in fact contains kinematic information that is usually dismissed. Method: This paper introduces an alternative approach to measure relative acceleration from a real invariant uniformly accelerated linear motion-blurred image. This is done by using homomorphic mapping to extract the characteristic Point Spread Function (PSF) of the blurred image, as well as machine learning regression. A total of 125 uniformly accelerated motion-blurred pictures were taken in a light- and distance-controlled environment, at five different accelerations ranging between 0,64 and 2,4 m/s2. This study evaluated 19 variants such as tree ensembles, Gaussian processes (GPR), and linear, support vector machine (SVM), and tree regression. Results: The best RMSE result corresponds to GPR (Matern 5/2), with 0,2547 m/s2 and a prediction speed of 530 observations per second (obs/s). Additionally, some novel deep learning methods were used to obtain the best RMSE value (0,4639 m/s2 for Inception ResNet v2, with a prediction speed of 11 obs/s. Conclusions: The proposed method (homomorphic mapping and machine learning) is a valid alternative for calculating acceleration from invariant motion blur in real-time applications when additive noise is not dominant, even surpassing the deep learning techniques evaluated.

Many species rely on celestial cues as a reliable guide for maintaining heading while navigating. In this paper, we propose a method that extracts the Milky Way (MW) shape as an orientation cue in low-light scenarios. We also tested the method on both real and synthetic images and demonstrate that the performance of the method appears to be accurate and reliable to motion blur that might be caused by rotational vibration and stabilisation artefacts. The technique presented achieves an angular accuracy between a minimum of 0.00° and a maximum 0.08° for real night sky images, and between a minimum of 0.22° and a maximum 1.61° for synthetic images. The imaging of the MW is largely unaffected by blur. We speculate that the use of the MW as an orientation cue has evolved because, unlike individual stars, it is resilient to motion blur caused by locomotion.

Traditional methods for motion blur, often relying on a single layer, deviate from the correct colors. We propose a multilayer rendering method that closely approximates the motion blur effect. Our approach stores motion vectors for each pixel, divides these vectors into multiple sample points, and performs a backward search from the current pixel. The color at a sample point is sampled if it shares the same motion vector as its origin. This procedure repeats across layers, with only the nearest color values sampled for depth testing. The average color sampled at each point becomes that of the motion blur. Our experimental results indicate that our method significantly reduces the color deviation commonly found in traditional approaches, achieving structural similarity index measures (SSIM) of 0.8 and 0.92, which represent substantial improvements over the accumulation method.

Image deblurring is a widely researched topic in low-level vision. Over the last few years, many researchers try to deblur by stacking multi-scale pyramid structures, which inevitably increases the computational complexity. In addition, most of the existing deblurring methods do not adequately model long-range contextual information, making the structure of blurred objects not well restored. To address the above issues, we propose a novel context-aware multi-scale convolutional neural network (CDMC-Net) for image deblurring. We progressively restore latent sharp images in two stages, and a cross-stage feature aggregation (CSFA) strategy is introduced to enhance the information flow interaction between the two stages. The key design of CDMC-Net to reduce the complexity is the use of a multi-input multi-output encoder-decoder at each stage, which can process multi-scale blurry images in a coarse-to-fine manner. Furthermore, to effectively capture long-range context information in different scenarios, we propose a multi-strip feature extraction module (MSFM). Its strip pooling with different kernel sizes allows the network to aggregate rich global and local contextual information. Extensive experimental results demonstrate that CDMC-Net outperforms state-of-the-art motion deblurring methods on both synthetic benchmark datasets and real blurred images. We also use CDMC-Net as a pre-processing step for object detection to further verify the effectiveness of our proposed deblurring method in downstream vision tasks. [ABSTRACT FROM AUTHOR]

Abstract To reduce bird collisions on wind turbines, Automatic Detection Systems have been developed to locate approaching birds and trigger turbines to slowdown to 2–3 rotations per minute (rpm). However, it is unknown whether birds can detect this reduced speed and avoid the turbine. We conducted an operant conditioning experiment on domestic doves (Streptopelia roseogrisea) and Harris's hawks (Parabuteo unicinctus) to assess their ability to discriminate between stationary and rotating miniature wind turbines, depending on the rotation speed and the contrast between the white blades and the background (only for doves for the latter). At high contrast, regardless of the speed tested, hawks were able to differentiate between the rotating and stationary turbines, while doves were not able to discriminate the slow‐rotating turbine (3 rpm) from the stationary one. The discrimination threshold increased to 8 rpm for the doves when the contrast was reduced. Our results suggest that the residual wind turbine speed of 2–3 rpm may not be detected by all bird species under all environmental conditions. Increasing the contrast between wind turbines and their environment may improve the detection of low‐speed rotation by some birds, otherwise, complete turbine shutdown should be recommended.

Copyright of Al-Mustansiriyah Journal of Science is the property of Republic of Iraq Ministry of Higher Education & Scientific Research (MOHESR) and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Key information for the maintenance and diagnosis of structures including bridges can be obtained from the processing of digital images acquired by unmanned aerial vehicle (UAV). However, low-quality images caused by various problems such as UAV movement, inspection environment, and camera parameters can lead to inappropriate structural evaluation due to the difficulty of digital image processing. Therefore, an appropriate assessment method for image quality considering the deterioration of the inspection image in the structural inspection procedure is required. In this study, a new image quality assessment (IQA) using a convolutional neural network (CNN) is proposed in consideration of various degradation factors that may occur in the structure inspection image. The first stage presents a method to obtain consistent quality against various interference factors of deterioration that may occur in inspection images. Adjusting the camera parameters minimizes the degradation of the inspection image. Subsequently, low- and high-quality images are distinguished according to the proposed image acquisition method. The second stage is the classification of the inspection dataset using the CNN-based image quality classifier model through training of data classified according to their quality. Experimental validation of the proposed method shows that the results are similar to the Human Visual System (HVS), which means subjective quality classification, and that the inspection image can be classified with more accurate and shorter processing time.

This work focuses on fused color images resulting from motion blur (left and right) with a blur block size of 11 pixels. The color conversion process was performed from RGB color space (Red, Green, Blue) to HSV (Hue, Saturation, Value), L*a*b*, and Ycbcr (Luminance, Chrominance) color space. The traditional (addition, multiplication) and proposed fusion techniques (absolute real standard deviation) were used for this purpose. The data was examined by quality criteria with reference (Mutual Information, Correlation Coefficient, Structural Content, Normalized Cross Correlation) and without reference (Blind Reference less Image Spatial Quality Evaluator, Naturalness Image Quality Evaluator, and Perception-based Image Quality Evaluator). In results and depending on the criteria, the best fusion method is the proposed real standard deviation.

In order to solve the poor performance of real-time semantic segmentation of night road conditions in video images due to insufficient light andmotion blur, this study proposes a scheme: a fuzzy information complementation strategy based on generativemodels and a network that fuses different intermediate layer outputs to complement spatial semantics which also embeds irregular convolutional attentionmodules for fine extraction of motion target boundaries. First, DeblurGan is used to generate information to fix the lost semantics in the original image; then, the outputs of different intermediate layers are taken out, assigned different weight scaling factors, and fused; finally, the irregular convolutional attention with the best effect is selected. The scheme achieves Global Accuracy of 89.1% Mean and IOU 94.2% on the night driving dataset of this experiment, which exceeds the best performance of DeepLabv3 by 1.3 and 7.2%, and achieves an Accuracy of 83.0% on the small volume label (Moveable). The experimental results demonstrate that the solution can effectively cope with various problems faced by night driving and enhance the model's perception. It also provides a technical reference for the semantic segmentation problem of vehicles driving in the nighttime environment. [ABSTRACT FROM AUTHOR]

In object tracking, motion blur is a common challenge induced by rapid movement of target object or long time exposure of the camera, which leads to poor tracking performance. Traditional solutions usually perform image recovery operations before tracking object. However, most image recovery methods usually have higher computational cost, which decreases the tracking speed. In order to solve the above problems, we propose a deblurring Transformer-based tracking method embedding the conditional cross-attention. The proposed method integrates three important modules: (1) an image quality assessment (IQA) module to estimate image quality; (2) an image deblurring module based on lightweight adversarial network to improve image quality; and (3) a tracking module based on Transformer with conditional cross-attention to enhance the object localization ability. Experimental results on two UAV object tracking benchmarks show that the proposed trackers achieve competitive results compared to several state-of-the-art trackers. [ABSTRACT FROM AUTHOR]

There is an urgent need, accelerated by the COVID-19 pandemic, for methods that allow clinicians and neuroscientists to remotely evaluate hand movements. This would help detect and monitor degenerative brain disorders that are particularly prevalent in older adults. With the wide accessibility of computer cameras, a vision-based real-time hand gesture detection method would facilitate online assessments in home and clinical settings. However, motion blur is one of the most challenging problems in the fast-moving hands data collection. The objective of this study was to develop a computer vision-based method that accurately detects older adults' hand gestures using video data collected in real-life settings. We invited adults over 50 years old to complete validated hand movement tests (fast finger tapping and hand opening–closing) at home or in clinic. Data were collected without researcher supervision via a website programme using standard laptop and desktop cameras. We processed and labelled images, split the data into training, validation and testing, respectively, and then analysed how well different network structures detected hand gestures. We recruited 1,900 adults (age range 50–90 years) as part of the TAS Test project and developed UTAS7k—a new dataset of 7071 hand gesture images, split 4:1 into clear: motion-blurred images. Our new network, RGRNet, achieved 0.782 mean average precision (mAP) on clear images, outperforming the state-of-the-art network structure (YOLOV5-P6, mAP 0.776), and mAP 0.771 on blurred images. A new robust real-time automated network that detects static gestures from a single camera, RGRNet, and a new database comprising the largest range of individual hands, UTAS7k, both show strong potential for medical and research applications. [ABSTRACT FROM AUTHOR]

Vehicle license plate images are often low resolution and blurry because of the large distance and relative motion between the vision sensor and vehicle, making license plate identification arduous. The extensive use of expensive, high-quality vision sensors is uneconomical in most cases; thus, images are initially captured and then translated from low resolution to high resolution. For this purpose, several traditional techniques such as bilinear, bicubic, super-resolution convolutional neural network, and super-resolution generative adversarial network (SRGAN) have been developed over time to upgrade low-quality images. However, most studies in this area pertain to the conversion of low-resolution images to super-resolution images, and little attention has been paid to motion de-blurring. This work extends SRGAN by adding an intelligent motion-deblurring method (termed SRGAN-LP), which helps to enhance the image resolution and remove motion blur from the given images. A comprehensive and new domain-specific dataset was developed to achieve improved results. Moreover, maintaining higher quantitative and qualitative results in comparison to the ground truth images, this study upscales the provided low-resolution image four times and removes the motion blur to a reasonable extent, making it suitable for surveillance applications. [ABSTRACT FROM AUTHOR]

Gastrointestinal endoscopy has been identified as an important tool for cancer diagnosis and therapy, particularly for treating patients with early gastric cancer (EGC). It is well known that the quality of gastroscope images is a prerequisite for achieving a high detection rate of gastrointestinal lesions. Owing to manual operation of gastroscope detection, in practice, it possibly introduces motion blur and produces low-quality gastroscope images during the imaging process. Hence, the quality assessment of gastroscope images is the key process in the detection of gastrointestinal endoscopy. In this study, we first present a novel gastroscope image motion blur (GIMB) database that includes 1,050 images generated by imposing 15 distortion levels of motion blur on 70 lossless images and the associated subjective scores produced with the manual operation of 15 viewers. Then, we design a new artificial intelligence (AI)-based gastroscope image quality evaluator (GIQE) that leverages the newly proposed semi-full combination subspace to learn multiple kinds of human visual system (HVS) inspired features for providing objective quality scores. The results of experiments conducted on the GIMB database confirm that the proposed GIQE showedmore effective performance compared with its state-of-the-art peers. [ABSTRACT FROM AUTHOR]

Motion blur in images usually distorts the information of objects, thus degrading the performance of semantic segmentation. However, there is no previous research on improving the segmentation performance by restoring the frontal-viewing vehicle-camera images taken under motion blur. Therefore, this study proposes a supervised dual attention network for multi-stage motion deblurring (SDAN-MD) for this task. In SDAN-MD, a supervised dual attention module (SDAM) is proposed, which adopts the supervised spatial and channel attention mechanisms to provide a supervisory signal of ground truth. In addition to Charbonnier loss and edge loss, we use perceptual loss utilizing Euclidean distance based on feature maps obtained from the segmentation network.Experiments were conducted with the motion blurred databases from the two open databases of road scene, Cambridge driving Labeled Video Database (CamVid) and Karlsruhe Institute of Technology and Toyota Technological Institute at Chicago (KITTI).The results show that the proposed SDAN-MD achieves 92.89% and 87.27% pixel accuracies in semantic segmentation using these two databases, respectively, outperforming the state-of-the-art methods.

We propose a new concept image sensor suitable for viewing and sensing applications. This is a report of a CMOS image sensor with a pixel architecture consisting of a 1.5 μm pixel with four-floating-diffusions-shared pixel structures and a 3.0 μm pixel with an in-pixel capacitor. These pixels are four small quadrate pixels and one big square pixel, also called quadrate–square pixels. They are arranged in a staggered pitch array. The 1.5 μm pixel pitch allows for a resolution high enough to recognize distant road signs. The 3 μm pixel with intra-pixel capacitance provides two types of signal outputs: a low-noise signal with high conversion efficiency and a highly saturated signal output, resulting in a high dynamic range (HDR). Two types of signals with long exposure times are read out from the vertical pixel, and four types of signals are read out from the horizontal pixel. In addition, two signals with short exposure times are read out again from the square pixel. A total of eight different signals are read out. This allows two rows to be read out simultaneously while reducing motion blur. This architecture achieves both an HDR of 106 dB and LED flicker mitigation (LFM), as well as being motion-artifact-free and motion-blur-less. As a result, moving subjects can be accurately recognized and detected with good color reproducibility in any lighting environment. This allows a single sensor to deliver the performance required for viewing and sensing applications.

Motion blur in dynamic scenes is an important yet challenging research topic. Recently, deep learning methods have achieved impressive performance for dynamic scene deblurring. However, the motion information contained in a blurry image has yet to be fully explored and accurately formulated because: (i) the ground truth of dynamic motion is difficult to obtain; (ii) the temporal ordering is destroyed during the exposure; and (iii) the motion estimation from a blurry image is highly ill-posed. By revisiting the principle of camera exposure, motion blur can be described by the relative motions of sharp content with respect to each exposed position. In this paper, we define exposure trajectories, which represent the motion information contained in a blurry image and explain the causes of motion blur. A novel motion offset estimation framework is proposed to model pixel-wise displacements of the latent sharp image at multiple timepoints. Under mild constraints, our method can recover dense, (non-)linear exposure trajectories, which significantly reduce temporal disorder and ill-posed problems. Finally, experiments demonstrate that the recovered exposure trajectories not only capture accurate and interpretable motion information from a blurry image, but also benefit motion-aware image deblurring and warping-based video extraction tasks. Codes are available on https://github.com/yjzhang96/Motion-ETR. [ABSTRACT FROM AUTHOR]

Efficient imaging is achieved under conditions of high relative velocity between the camera and the subject by using the following imaging system; two galvanometer mirrors are placed vertically in front of the camera, one for motion blur compensation and the other for switching the angle of view. The proposed system can overcome the shortcomings of conventional imaging systems with motion blur compensation, such as a small angle of view, and efficiently acquire high-resolution images. If the angle is changed for each capture while the mirrors are stationary for the exposure time, the natural frequency of the mirrors produces noise, leading to a poor resolution. However, this issue can be managed by generating and using an input that does not contain a natural frequency component. A target moving in one dimension can be captured and it is confirmed that the angle of view was extended from the obtained image. It is expected that the camera will be used for inspections under conditions where the relative speed between the camera and target is high, such as in highway tunnel inspections. [ABSTRACT FROM AUTHOR]

In order to improve the accuracy and efficiency of the feature point matching, this paper proposed a novel feature point matching algorithm in terms of vision and inertial measurement unit（IMU） fusion. Firstly, the algorithm calculated the point diffusion function using the motion information of IMU to remove motion blur, and improved the feature point matching rate. Secondly, based on LK（Lucas-Kanade） optical flow method, this paper introduced gradient error and uses L1 parametric to simulate sparse noise. Furthermore, the feature point position by using IMU is the initial value of the algorithm, and then this paper used BB（Barzilar-Borwein） step to improve the efficiency of the algorithm. Finally, the comparison experiments show that the efficiency and accuracy of the algorithm are better than the LK optical flow method. Especially, the algorithm improves the localization accuracy and robustness of the VINS-Mono framework on the dataset EuRoC. [ABSTRACT FROM AUTHOR]

Image deblurring has been a research hotspot in computer vision and image processing for a long time. The motion blur or focus blur image caused by camera jitter, object motion or defocus will seriously affect the use and follow-up processing of the image. The traditional blind deblurring methods make use of different causes of image motion blur, dividing motion blur into global motion blur and local motion blur. This paper summarizes the methods and research status of image blind deblurring in recent years. Then, on the basis of deep learning image deblurring methods, the image deblurring methods and research status are summarized. At the same time, the traditional blind deblurring methods and deep learning blind deblurring methods are classified and summarized, and the three forms of datasets needed before image deblurring and the quality evaluation criteria after image deblurring are summarized. Then, some of the traditional deblurring and deep learning deblurring methods are quantitatively and qualitatively analyzed and compared on the public deblurring dataset. Finally, the problems faced by the current image deblurring methods are analyzed, the research trend of image deblurring methods is prospected, and the main problems existing in single image blind deblurring are analyzed. The available solutions or ideas are explained one by one, which provides a theoretical basis for the follow-up research.