A compatible detector based on improved YOLOv5 for hydropower device detection in AR inspection system.

Recent advancements in computer vision and augmented reality (AR) technology have created a pathway for enhanced human–computer interaction. Despite the potential benefits, the integration of these technologies is not yet common in the industry. Object detection is the foundation of AR systems for inspection, and an efficient object detection model will enable accurate object localization in AR devices. However, the limited computing capabilities and memory usage of wearable AR devices pose a significant challenge to the deployment of state-of-the-art detectors on these devices in real work scenarios. Moreover, as the person wearing the AR device keeps moving, the constantly changing scale of the captured image often leads to significant information loss when feature maps of different scales are fused. To address these challenges, this paper proposes a new compatible detector YOLO-Master based on improved YOLOv5 through deep learning and AR. The paper introduces several improvements, such as using MobileNetv3 as the backbone to reduce memory overhead and computational costs and designing an attention module MCA based on coordinate to reduce information loss. Besides, 20 hyperparameters of YOLOv5 are optimized by the genetic algorithm(GA) before model training, which can help reduces the loss value generated. YOLO-Master was trained and tested on hydropower device images collected from a power plant in the China Southern Power Grid, and the experiments on a self-made dataset demonstrated that the mAP of the proposed method can reach 70.1%, which is 2.9% higher than the baseline of 67.2%. Additionally, the number of parameters of the model was reduced by 66.7%, enabling the model to ensure accuracy while being compatible with real-time performance, meeting the urgent needs of engineering deployment. • A Compatible detector is proposed for device detection in AR inspection system. • Computation cost is improved by a lightweight backbone network. • A coordinate-based attention module is designed for effective feature fusion. • Optimizing hyperparameters of the new architecture to make the detector robust. [ABSTRACT FROM AUTHOR]