Search

• This paper establishes an image dataset of sika deer obtained from different perspectives. • This paper proposes an AD-YOLOv5 model to detect key parts of the sika deer. • This paper improves the loss function of the model to enhance both the training and inference ability of the model. • This paper proposes an adaptive channel attention mechanism for better extracting shallow features of the key parts of sika deer. • By altering the feature fusion network and combining it with the channel attention mechanism, the feature information is balanced across different scales, which enhances the accuracy of detection. Accurate and rapid fixation of key parts of sika deer is essential for the mechanized and intelligent collection of both deer blood and velvet antler. To solve the low detection accuracy problem of key parts of deer caused by the diversity of deer farm breeding environment and the rapid movement of deer, this paper proposes an AD-YOLOv5 algorithm for detecting key parts of sika deer based on YOLOv5s. Specifically, a new weighted bidirectional feature pyramid network S-BiFPN is first proposed, which both simplifies the structure and effectively performs skip feature fusion to better capture object information at different scales, so that the adaptive feature fusion capability of the model is optimized. Second, this paper proposes to add a SENet module after the C3 module of the 9th Layer in the backbone part of the network, so that the network can adaptively readjust the channel weights of feature maps to enhance the important features for key parts of sika deer and improve the expression ability of the model for key parts. Furthermore, to make the model more stable in the training process, a novel bounding box regression loss function SIoU is led into, which can better learn the position and size of the bounding box by fusing the orientation information between the ground truth box and the predicted box. The effectiveness of the proposed algorithm is demonstrated through ablation experiments. Experimental results show that the mAP @0.5 of the proposed algorithm reaches 97.30 % for the detection of key parts of sika deer, which is 12.85 %, 9.65 %, 9.18 %, 7.13 %, 3.59 %, 4.6 %, 0.90 % and 0.10 % higher than SSD, EfficientDet, YOLOv3, YOLOv4, Faster R-CNN, YOLOv5s, YOLOv7 and YOLOv8s, respectively. This research provides a new idea for detecting key parts of animals in complex environments and lays a theoretical foundation for the development of intelligent fixation devices for sika deer. [ABSTRACT FROM AUTHOR]

Crop counting is a crucial step in crop yield estimation. By counting, crop growth status can be accurately detected and adjusted, improving crop yield and quality. In recent years, with the rapid development of convolutional neural networks, deep learning-based object detection methods have been widely used in crop counting. By summarizing the research related to crop counting, this paper reviews the development status of object detection and crop counting. It then compares deep learning-based object detection counting methods with other counting methods. The paper also introduces public datasets and evaluation metrics commonly used for algorithmic models and provides a more in-depth analysis of the application of object detection in crop counting. Finally, the current problems that need to be solved, such as the lack of datasets, difficulties in small object counting, occlusion in complex environments, and some future directions are summarized. We hope this review will encourage more researchers to use deep-learning object detection methods in agriculture. • The paper compares the advantages and disadvantages of the methods currently used for crop counting tasks. • It is the first summary of object detection-based methods' application in crop counting tasks, covering commonly used models, issues, and challenges. • Public datasets utilized for crop counting tasks through object detection-based methods have been summarized. [ABSTRACT FROM AUTHOR]

• This paper proposes an automatic system of pest detection and counting in granaries. • The automatic system has 2 parts, a car and YOLOv4 model. The car with a camera and a supplementary light can take clear photos of the granary surface. And YOLOv4 model can process photos synchronously and achieve high accuracy in pest detection and counting. • The system solves the randomness and insufficient accuracy of pest traps and human eye recognition. And it can be used to the early warning of pests in granary, which has high accuracy and minimal manual effort. Stored-grain pests cause serious economic losses during grain storage. Therefore, it is important for us to know the accurate number and species of stored grain pests as soon as possible so that appropriate measures can be taken to reduce economic losses. However, current research on grain pest detection has two problems. The background of the dataset does not contain any grain, so the results cannot be applied to detect pests in actual situations. The other problem is that methods based on pest traps cannot reflect situations on the surface of the whole granary. This paper proposes an automatic system of pest detection and counting to solve these problems. This system consists of two main parts: a deep learning object detection model called YOLOv4 and a small car with a camera and a supplementary light. And YOLOv4 model that has been trained is embedded in the car. The car can run on the surface of the granary. The camera on the small car can take photos of the pests for YOLOv4 to identify the species and number of pests. In the experiment, a few hundred kilograms of wheat were used to lay a simulated granary. And 2 typical stored-wheat pests, namely, the red flour beetle and the rice weevil, were taken as the research objects. The experimental results demonstrated that the mean average precision (mAP) of the proposed method reached 97.55%, which can meet the accuracy requirements of the detection and counting of pests in the granary in practical applications. The system solves the randomness and insufficient accuracy of pest traps and human eye recognition. And the system can be used to the early warning of pests in granary, which has high accuracy and completely release manual labor. [ABSTRACT FROM AUTHOR]

• Constructed a dataset of early growth stages of clam seedlings under the microscope. • Four different attention mechanisms were employed in ablation experiments for discussion. • The K-means++ algorithm was used to enhance anchor accuracy, and Soft-NMS was applied to solve missed detections due to dense stacking of clam seedlings. • Heatmaps were constructed for visualization, analysis the effects of attention mechanism. • Software for automatic detection of clam seedlings biological features was developed. In order to monitor the early growth status of clam seedlings and meet the demands of precision seedling cultivation in a factory setting, this study improves the YOLOv5s model and proposes a high-precision and lightweight method for detecting biological features of clam seedlings. Firstly, dataset of clam seedlings under the microscope was constructed. Secondly, we established a clam seedling detection model based on four different attention mechanisms and analyzed the differences in the features focused on by different attention mechanisms in clam seedling detection. The accuracy of the anchors was optimized using the K-means++ algorithm, and the Soft-NMS method was employed to address the issue of missed detections caused by dense stacking of clam seedlings. The proposed approach has the optimal comprehensive performance by comparing various lightweight networks. The results show that the AP-health, AP-death and mAP of this approach are 98.15%, 93.87% and 96.01%, which can meet the standard for high precision. With a transmission speed of 86 FPS, an average response time of 11.54 ms, and a model size of 27.59 MB, the approach satisfies the requirements for efficiency and portability. Finally, a biological feature detection software of clam seedlings was developed, which can automatically calculate phenotypic information such as the number of clam seedlings, survival rate, and average size. This paper provides a basis for real-time and accurate assessment of clam seedlings biological features while offering technical support for the automation and intelligence of clam seedlings production in factories. [ABSTRACT FROM AUTHOR]

• An image restoration method based on convolutional autoencoder is proposed. • Use the area growth method to divide and code the obstruction according to the contour. • Predict the overall outline of citrus based on the unobstructed citrus outline. • Fill the area to be repaired with the selection method of similar pixels. • The repair rate and image recognition rate have been effectively improved. At present, machine vision and deep learning theories have been widely used in fruit recognition and picking. However, in the process of identification and picking, there are often situations where the target is blocked, existing methods cannot accurately identify, or the identification accuracy rate is low. For improving the recognition rate of fruits under occlusion, this paper proposes an image restoration method based on a convolutional auto-encoder. This method first encodes the obstruction and then determines the general shape of the occluded fruit and compares the general shape with the coding part is combined to determine the area to be repaired. Finally, the area to be repaired is filled with pixels to realize the image repair and recognition of the occlusion map. The average repair rate of the method proposed in this paper is 95.96%, the restoration rate is 3.52% higher than the traditional convolution method, the L2 loss value is 0.63% lower than the traditional convolution method, the average detection accuracy of the restored fruits is 94.77%. [ABSTRACT FROM AUTHOR]

• A novel deep learning model is proposed for critical emerging frost detection. • The detection accuracy has been improved and real-time is satisfied. • It provides technical support for other researches related to plant frost detection. Natural radiation frost is a potential threat or even a serious disaster during the growth of agricultural crops. To avoid or reduce the risk of frost damage to crops, frost detection especially the timely and real-time detection of emerging frost crystals, is of great importance in agricultural frost protection. Therefore, this paper proposes an object detection model Frost-YOLOv5 based on microscopic imaging of emerging frost crystals on the leaf surface. Firstly, a YOLOv5 initial detection model was established by observing frost under natural conditions and using microscopic cameras to acquire images of emerging frost crystals formed on the leaf surface. From these images, the channel attention mechanism and spatial attention mechanism were combined to construct a small frost crystal feature depth extraction network. Secondly, the RGB three-channel Wiener filtering algorithm was used to recover the noise source images from motion blur in the frost crystal dataset. Through experimental validation on different light intensities and different frost crystal cluster datasets, the Frost-YOLOv5 model all showed better robustness compared with various object detection algorithms, and its frost crystal detection accuracy P and average accuracy AP values were 98.89% and 81.72%, respectively. Ultimately, the Frost-YOLOv5 model can effectively detect emerging frost crystal targets and provide theoretical principles and technical support for agrometeorological monitoring research. [ABSTRACT FROM AUTHOR]

[Display omitted] • Deep learning automates precise cereal plant head detection in agriculture. • Maize, rice, wheat, and sorghum case studies evaluated. • Comparison of deep learning approaches for object detection and image segmentation. • Challenges and opportunities for future research outlined. • Emphasis on how deep learning can contribute to increasing crop yields and food security. Cereal plant heads must be identified precisely and effectively in a range of agricultural applications, including yield estimation, disease detection, and breeding. Traditional methods that rely on manual feature extraction and thresholding take a lot of time and work, and they are also impacted by crop variability. Deep learning algorithms can be used to automate this procedure because they can directly extract complicated information from images and produce cutting-edge outcomes. This review provides a comprehensive overview of recent research on deep learning-based head detection in cereal plants, emphasizing object detection and image segmentation. We also discuss the major benefits and drawbacks of different deep learning architectures and training methods, as well as examples of their application in maize, rice, wheat, and sorghum. Developing robust image processing algorithms, using deep learning in other domains like unmanned aerial vehicles, and utilizing large and diverse datasets are all challenges outlined in our study as future research directions. Through the integration of advanced computer vision techniques with precision agriculture, this paper attempts to promote further research and innovation in this intriguing field. We provide a thorough analysis of current developments in deep learning-based head detection for cereal plants and emphasize how this technology can contribute significantly to precision agriculture. [ABSTRACT FROM AUTHOR]

• The algorithm for the detection of weeds in paddy field was proposed. • A dataset containing rice and weeds was established. • The method for rice crop localization algorithm was proposed. • The proposed model achieves a high accuracy of 94.1% and a high speed of 24.3 fps. Weeds are one of the main hazards affecting the yield and quality of rice. In farmland ecosystem, weeds compete with rice for resources such as light, water, soil and space, and also cause plant disease by providing habitats for pests, resulting in a decline in yield of rice. Spraying herbicides is used most frequently due to their lower cost than manual weeding and they can effectively control a varieties of weeds. Precise spraying application may utilise intelligent technology to precisely limit the weed growth at specific locations and control the consumption of herbicides, which not only has lower cost and risk for the environment but also increases the economic benefits of agricultural products. The target of this work is to use deep learning model to perform weed detection in rice crop images and to achieve accurate real-time detection and low machine cost resulting in widely used in practice. For this purpose, a dataset of rice and weeds for object detection is established by means of on-site shooting and crawling of images on the web, which contains rice and eight categories of weeds. However, the overlap between crops and weeds poses a great challenge to weed detection. To overcome this challenge, this paper proposed a model named WeedDet based on RetinaNet, which improves the feature extraction ability of the backbone, feature pyramid network and detection head to deal with the complex information in the image, respectively. And the structure of feature pyramid and detection head are lightened to improve speed of detection. The specific implementation methods are as follows: Firstly, we propose Det-ResNet to reduce the loss of detailed information and improve the feature extraction ability of detailed textures by modifying the initial convolution structure of ResNet. In addition, the improved feature pyramid network fuses the features extracted by Det-ResNet with higher efficiency without loss of accuracy. Secondly, we propose Efficient Retina Head (ERetina-Head) with thin feature maps (small channel number feature maps) and large separable convolution, which not only saves memory and computation, but also pooling more powerful feature maps during training and inference. Finally, we combine Smooth L 1 loss and GIoU loss to calculate the regression loss. In addition, Varifocal loss is used to unify the classification and quality evaluation branches in training. Our network achieves a high mAP of 94.1% and the frame rate of 24.3 fps, which is 5.5% mAP and 5.6 fps higher than the baseline RetinaNet. Experiments show that fps of WeedDet (24.3) is second only to YOLOv3 (26.3) while the mAP is 9.9% (0.941 vs 0.842) higher than YOLOv3, and the mAP is also higher than other models, verifying the effectiveness and efficiency of the model. [ABSTRACT FROM AUTHOR]

• Mechanical weeding module for precise hoeing in vegetable farming. • Real-time precise stem detection in RGB images on embedded computer. • Deep learning object detection based neural network for precise stem location. • Tracking algorithm for temporal aggregation of stems in successive frames. • F1-score of 94.74% and 93.82% for maize and bean with sub-centimetric location accuracy. Developing alternatives to the chemical weeding process usually carried out in vegetable crop farming is necessary in order to reach a more sustainable agriculture. However, a precise mechanical weeding requires specific sensors and advanced computer vision algorithms to process crop and weed discrimination in real-time. In this paper we propose an algorithm able to detect, locate, and track the stem position of crops in images which is suitable for precision actions in vegetable fields such as mechanical hoeing within crop rows. The algorithm is twofold: (i) a deep neural network for object detection is first used to detect crop stems in individual RGB images and then (ii) an aggregation algorithm further refines the detections taking advantage of the temporal redundancy in consecutive frames. We evaluated the pipeline on images of maize and bean crops at an early stage of development, acquired in field conditions with a camera embedded in an experimental mechanical weeding system. We reported F1-scores of respectively 94.74% and 93.82% with a location accuracy around 0.7 cm when compared with human annotation. Moreover, this pipeline can operate in real-time on an embedded computer consuming as little power as 30 W. [ABSTRACT FROM AUTHOR]

• An image synthesis and semi-supervised learning pipeline is proposed. • The pipeline constructs an image library of plant instances with pixelwise masks. • Images can be synthesized using the library for site-specific weed detection. • Without manual labels, the pipeline achieves precision close to supervised learning. • Ablation study provides insights into the construction of a weed image database. Precise and efficient weed detection in agricultural fields is the key for robotic weed control. Recent developments in convolutional neural networks (CNNs) have achieved significant success in this regard. CNNs that simultaneously localize and classify objects in images are the predominant forms that have been widely used to detect crops and weeds. However, the use of CNNs in agriculture, particularly for weed detection, has been impeded by a lack of large training dataset with ground truth annotations. Cut-and-paste image synthesis approach and semi-supervised learning are popular methods to alleviate the training data deficiency problem. In this paper, we propose a novel image synthesis and semi-supervised learning pipeline to train site-specific weed detection models without the need for manually labeled images. The CNN models trained by this pipeline achieve performance levels close to that of the supervised models. We investigated the behavior of the proposed pipeline by varying several key components and showed that color match between the training and testing images, training-time color augmentation, and iterative semi-supervised learning largely improve the model performance. These promising results can be used to guide the construction of a weed image database applicable to different weed detection scenarios. [ABSTRACT FROM AUTHOR]