Search

In the field of steel production, the detection of steel surface defects is one of the most important guarantees for the quality of steel production. In the process of defect detection, there are problems regarding the noise of the acquisition background, the scale of defects, and the detection speed. At present, in the face of complex steel surface defects, realizing efficient real-time steel surface defect detection has become a difficult problem. In this paper, we propose a lightweight and efficient real-time defect detection method, LDE-YOLO, based on YOLOv8. First, we propose a lightweight multi-scale feature extraction module, LighterMSMC, which not only achieves a lightweight backbone network, but also effectively guarantees the long range dependence of the features, so as to realize multi-scale feature extraction more efficiently. Secondly, we propose lightweight re-parameterized feature pyramid, DE-FPN, in which the sparse patterns of the overall features and the detailed features of the local features are efficiently captured by the DE-Block, and then efficiently fused by the PAN feature fusion structure. Finally, we propose Efficient Head, which lightens the model by group convolution while its improves the diagonal correlation of the feature maps on some specific datasets, thus enhancing the detection performance. Our proposed LDE-YOLO obtains 80.8 mAP and 75.5 FPS on NEU-DET , 80.5 mAP and 75.5 FPS on GC10-DET. It obtains 2.5 mAP and 4.7 mAP enhancement compared to the baseline model, and the detection speed is also improved by 10.4 FPS, while in terms of the number of floating point operations and parameters of the model reduced by 60.2% and 49.1%, which is sufficient to illustrate its lightweight effectiveness and realize an efficient real-time steel surface defect detection model. • A lightweight multi-scale feature extraction module LighterMSMC was proposed, for the backbone network. Lightweight convolution PConv and multi-scale feature extraction module LMSMC were applied. While the model is more lightweight, so as to achieve multi-scale feature extraction more efficiently and improve the generalization performance of the defect detection model in complex situations. • Propose a lightweight re-parameterized module, DE-Block, and apply it to the feature fusion part of YOLOv8 to obtain the DE-FPN. DE-Block can better extract sparse patterns from overall features, while supplement detailed features. And its structural design can minimize the parameters increase. During the inference process, convolutions in DE-Block can be re-parameterized to reduce inference costs. Thus, a lightweight feature pyramid structure is constructed. • Propose an efficient decoupled detection head, Efficient Head, to lightweight detection heads through group convolution. Applying the aforementioned methods to YOLOv8, this paper proposes LDE-YOLO, which not only has the ability to effectively detect defects in complex situations. Meanwhile, LDE-YOLO significantly reduces the floating-point operations and parameters of the model, thereby improving its defect detection speed. [ABSTRACT FROM AUTHOR]

Autonomous-rail Rapid Transit (ART) possesses various advantages in intelligent transportation, but it does not effectively recognize road conditions caused solely by deploying single-modal cameras. In this paper, a lightweight fusion-based object detection neural network was designed with multi-modal sensors for the ART. Firstly, the Light Detection and Ranging (LiDAR) applied additional encoding and preprocessing to the point cloud. Secondly, a backbone and a detection head of the network structure were proposed through re-parameterization and pruning techniques. Furthermore, a fusion module was designed with a selective soft attention mechanism to fuse the extracted features. The proposed model was tested on the open autonomous driving dataset; it achieved a 7.38% improvement in mean average precision (mAP) compared to the original you only look once (YOLO) as well as other state-of-the-art (SOTA) models. Finally, practical experiments were conducted in the maintenance center of ART to simulate the operational scenarios and validate the feasibility of the proposed method in this study. By fully utilizing the information in different modalities and addressing the limitations of single-modal recognition, efforts were made to improve the robustness of road object detection for ART under different road conditions. Consequently, our method provides effective solutions which benefit intelligent transportation with advanced algorithms and strategies. [Display omitted] • Multi-modal sensors were applied in the ART operating scenarios for road targets detection. • A lightweight detection model with re-parameterization methods and anchor-free detectors. • Proposed selective soft attention fusion module based on feature-level fusion strategy. • Practical experiments performed in the ART factory for testing and achieving intelligent transportation. [ABSTRACT FROM AUTHOR]

Vehicle and drone-mounted surveillance equipment face severe computational constraints, posing significant challenges for real-time, accurate crack segmentation. This paper introduces the crack location segmentation transformer (CLST) to address these issues. Images are processed to better resemble patches associated with cracks, enabling precise segmentation while significantly reducing the model's computational load. To handle varying segmentation challenges, a range of models with different computational demands has been designed to suit diverse needs. The most lightweight model can be deployed for real-time use on edge devices. A module in the neck of the pipeline encodes crack coordinate information, and end-to-end training has resulted in state-of-the-art performance across multiple datasets. • Crack location segmentation transformer (CLST) is introduced. • Focusing the field of view on the cracks reduces the amount of computation. • Rep-Crackformer can select modes to cope with different scenarios. • CLocation can encode crack spatial information with fewer parametric quantities. [ABSTRACT FROM AUTHOR]

In multi-view video systems, the decoded texture video and its corresponding depth video are utilized to synthesize virtual views from different perspectives using the depth-image-based rendering (DIBR) technology in 3D-high efficiency video coding (3D-HEVC). However, the distortion of the compressed multi-view video and the disocclusion problem in DIBR can easily cause obvious holes and cracks in the synthesized views, degrading the visual quality of the synthesized views. To address this problem, a novel two-stream re-parameterized refocusing hybrid attention (TRRHA) network is proposed to significantly improve the quality of synthesized views. Firstly, a global multi-scale residual information stream is applied to extract the global context information by using refocusing attention module (RAM), and the RAM can detect the contextual feature and adaptively learn channel and spatial attention feature to selectively focus on different areas. Secondly, a local feature pyramid attention information stream is used to fully capture complex local texture details by using re-parameterized refocusing attention module (RRAM). The RRAM can effectively capture multi-scale texture details with different receptive fields, and adaptively adjust channel and spatial weights to adapt to information transformation at different sizes and levels. Finally, an efficient feature fusion module is proposed to effectively fuse the extracted global and local information streams. Extensive experimental results show that the proposed TRRHA achieves significantly better performance than the state-of-the-art methods. The source code will be available at https://github.com/647-bei/TRRHA. • A two-stream re-parameterization refocusing hybrid attention network (TRRHA) for SVQE. • Design includes global multi-scale residual (GMR) and local feature pyramid attention (LFPA). • Proposed re-parameterized refocusing attention module (RRAM) for local multi-scale texture. • Captures multi-scale features with re-parameterized convolution (RC) branches. • Efficient feature fusion module (EFFM) significantly enhances SVQE performance. [ABSTRACT FROM AUTHOR]

Although detectors currently perform well in well-light conditions, their accuracy decreases due to insufficient object information. In addressing this issue, we propose the Re-parameterization Forward Semantic Compensation Network (RFSC-Net). We propose the Reparameterization Residual Efficient Layer Aggregation Networks (RSELAN) for feature extraction, which integrates the concepts of re-parameterization and the Efficient Layer Aggregation Networks (ELAN). While focusing on the fusion of feature maps of the same dimension, it also incorporates upward fusion of lower-level feature maps, enhancing the detailed texture information in higher-level features. Our proposed Forward Semantic Compensation Feature Fusion (FSCFF) network reduces interference from high-level to low-level semantic information, retaining finer details to improve detection accuracy in low-light conditions. Experiments on the low-light ExDark and DarkFace datasets show that RFSC-Net improves mAP by 2% on ExDark and 0.5% on DarkFace over the YOLOv8n baseline, without an increase in parameter counts. Additionally, AP50 is enhanced by 2.1% on ExDark and 1.1% on DarkFace, with a mere 3.7 ms detection latency on ExDark. • Retaining more detailed information improves detection performance in low-light environments. • Fusing lower-level feature maps with higher-level feature can retain more detailed information. • Designed an information compensation detection network that retains more effective detailed information. • The new model outperforms YOLOv8n by 2% in mAP on the low-light ExDark dataset, according to experimental results. [ABSTRACT FROM AUTHOR]

Single image super-resolution is a well-established low-level vision task that aims to reconstruct high-resolution images from low-resolution images. Methods based on Transformer have shown remarkable success and achieved outstanding performance in SISR tasks. While Transformer effectively models global information, it is less effective at capturing high frequencies such as stripes that primarily provide local information. Additionally, it has the potential to further enhance the capture of global information. To tackle this, we propose a novel Large Kernel Hybrid Attention Transformer using re-parameterization. It combines different kernel sizes and different steps re-parameterized convolution layers with Transformer to effectively capture global and local information to learn comprehensive features with low-frequency and high-frequency information. Moreover, in order to solve the problem of using batch normalization layer to introduce artifacts in SISR, we propose a new training strategy which is fusing convolution layer and batch normalization layer after certain training epochs. This strategy can enjoy the acceleration convergence effect of batch normalization layer in training and effectively eliminate the problem of artifacts in the inference stage. For re-parameterization of multiple parallel branch convolution layers, adopting this strategy can further reduce the amount of calculation of training. By coupling these core improvements, our LKHAT achieves state-of-the-art performance for single image super-resolution task. [Display omitted] • The proposed module takes into account both high-frequency and low-frequency information of the image • The proposed module is conducive to generating clear texture details • The training strategy we proposed helps to reduce artifacts [ABSTRACT FROM AUTHOR]

Combining knowledge distillation (KD) and network pruning (NP) shows promise in learning a light network to accelerate object re-identification. However, KD requires an untrained student network to establish more critical connections in early epochs, but NP demands a well-trained student network to avoid destroying critical connections. This presents a dilemma, potentially leading to a collapse of the student network and harming object Re-ID performance. For that, we propose a distillation embedded absorbable pruning (DEAP) method. We design a pruner-convolution-pruner (PCP) unit to resolve the dilemma by loading NP's sparse regularization on extra untrained pruners. Additionally, we propose an asymmetric relation knowledge distillation method. It readily transfers feature representation knowledge and asymmetric pairwise similarity knowledge without using additional adaptation modules. Finally, we apply re-parameterization to absorb pruners of PCP units to simplify student networks. Experiments demonstrate the superiority of DEAP, such as on the VeRi-776 dataset, with ResNet-101 as a teacher, DEAP saves 73.24% of model parameters and 71.98% of floating-point operations without sacrificing accuracy. • We design a distillation embedded absorbable pruning method to readily transfer knowledge a teacher network from to a student network. • We propose an asymmetric relation knowledge distillation method to transfer both feature representation knowledge and pairwise similarity knowledge. • Our method achieves the state-of-the-art performance in terms of both accuracy and speed. [ABSTRACT FROM AUTHOR]

Recent advancements in deep learning have notably advanced the field of image denoising. Yet, blindly increasing the depth or width of convolutional neural networks (CNNs) cannot ameliorate the network effectively, and even leads to training difficulties and sophisticated training tricks. In this paper, a lightweight CNN with heterogeneous kernels (HKCNN) is designed for efficient noise removal. HKCNN comprises four modules: a multiscale block (MB), an attention enhancement block (AEB), an elimination block (EB), and a construct block (CB). Specifically, the MB leverages heterogeneous kernels alongside re-parameterization to capture diverse complementary structure information, bolstering discriminative ability and the denoising robustness of the denoiser. The AEB incorporates an attention mechanism that prioritizes salient features, expediting the training stage and boosting denoising efficacy. The EB and CB are designed to further suppress noise and reconstruct latent clean images. Besides, the HKCNN integrates perceptual loss for both retaining semantic details and improving image perceptual quality, so as to refine the denoising output. Comprehensive qualitative and quantitative evaluations highlight the superior performance of HKCNN over state-of-the-art denoising methods, validating its efficacy in practical image denoising scenarios. [ABSTRACT FROM AUTHOR]

You recklessly told your boss that solving a non-linear system of size n ( n unknowns and n equations) requires a time proportional to n , as you were not very attentive during algorithmic complexity lectures. So now, you have only one night to solve a problem of big size (e.g., 1000 equations/unknowns), otherwise you will be fired in the next morning. The system is well-constrained and structurally irreducible: it does not contain any strictly smaller well-constrained subsystems. Its size is big, so the Newton–Raphson method is too slow and impractical. The most frustrating thing is that if you knew the values of a small number k ≪ n of key unknowns, then the system would be reducible to small square subsystems and easily solved. You wonder if it would be possible to exploit this reducibility, even without knowing the values of these few key unknowns. This article shows that it is indeed possible. This is done at the lowest level, at the linear algebra routines level, so that numerous solvers (Newton–Raphson, homotopy, and also p -adic methods relying on Hensel lifting) widely involved in geometric constraint solving and CAD applications can benefit from this decomposition with minor modifications. For instance, with k ≪ n key unknowns, the cost of a Newton iteration becomes O ( k n 2 ) instead of O ( n 3 ) . Several experiments showing a significant performance gain of our re-parameterization technique are reported in this paper to consolidate our theoretical findings and to motivate its practical usage for bigger systems. [ABSTRACT FROM AUTHOR]

The Ensemble Kalman Filter (EnKF) is a Monte Carlo based method to assimilate the measurement data sequentially in time. Although, EnKF has some advantages over the other Kalman based methods to deal with non-linear and/or high dimensional reservoir models, it also suffers from deficiency in estimation of non-Gaussian parameters. In this work, we propose a re-parameterization method to handle non-Gaussian parameters via Ensemble Kalman Filter framework. For this purpose, concept of cumulative distribution function transformation has been used. In addition, the statistics of prior information have been aggregated in the state vector in order to capture the prior uncertainties of non-Gaussian parameters. To evaluate the performance of the new method, three estimation examples have been implemented. These examples are designed to evaluate the performance of the proposed method to estimate both local and global parameters. The performance of method in handling non-Gaussian prior as well as capturing the prior uncertainty has been assessed. The results revealed that, the proposed method handled both non-Gaussian prior and capturing of the prior uncertainties of the local and global parameters quite efficiently. Compared to previously conducted researches, new algorithm would considerably reduce the number of required ensemble members to converge to the appropriate solution. Standard ensemble Kalman filter and normal score transformation have been also implemented for each setup; the obtained results show that the new proposed method outperforms the other alternate methods. [ABSTRACT FROM AUTHOR]

Highlights: [•] Presents a novel method for both shape design and isogeometric analysis using mapped basis functions. [•] The space spanned by mapped B-spline basis functions is an extension of uniform B-splines over an arbitrary parameterization. [•] The continuity of the resulting surfaces can be arbitrary higher order, including at extraordinary points. [•] The proposed method can be further extended to other basis functions as well as to non-quadrilateral meshes. [ABSTRACT FROM AUTHOR]

Abstract: The problem of fitting spline surfaces to triangular mesh models is of importance in computer-aided design. Many fitting algorithms have been developed. This paper proposes several novel plug-and-play components or strategies: the use of -splines for fitting, a curvature-guided strategy, faithful re-parameterization and initial spline knot re-placement, which can be used to enhance fitting algorithms. We also present an adaptive -spline fitting algorithm integrating these components and strategies. Extensive experiments have been conducted to demonstrate these components. Our fitting algorithm can generate spline surfaces that well respect the geometrical features of input mesh models and have a more compact representation. [Copyright &y& Elsevier]