Search

• We proposed a delineating field parcel model (TSANet) based on satellite image time series. • TSANet learn the relevance of spatial-spectral-temporal feature representation. • TSANet is robust across space and time. • TSANet performs better than pervious methods. • The time series data from the main growing period has a greater impact. Satellite image time series (SITS), such as Sentinel-2 imagery, plays a crucial role in the delineation of agricultural fields by reducing the impacts of ambiguities due to the spatial arrangement of field boundaries. Existing delineate field parcel models rely extensively on spatial features derived from single-date imagery. However, several studies have exploited the potential of SITS to effectively tackle the complexities associated with the intrinsic consistency between agricultural fields and their boundaries. This paper proposes a novel Two-Stream Attention convolutional neural network (TSANet) to capture the subtle difference between agricultural fields from SITS. Specifically, a field temporal semantic stream is introduced to adaptively leverage the significance of spatial-spectral-temporal feature representation associated with the location of agricultural parcels, especially where transitions in crop types take place. Considering the consistency between field parcels and their boundaries, we developed a field boundary prediction stream to enhance the extraction of edge features, particularly for the extraction of small and irregular agricultural parcels. Moreover, a field parcel refining block is employed to further enhance the geometric accuracy of agricultural fields. We conducted experiments on Sentinel-2 images from the Netherlands. Results showed that our approach produced a better layout of agricultural fields, with an average F1-score of 0.91 than the existing 3D-UNet, U-TEA, and BiConvLSTM. In addition, through the analysis of both quantitative and qualitative results, the stronger robustness of the model compared to other algorithms has been verified by temporal transfer and large-scale spatial prediction. We compared the difference between SITS and the corresponding composite images, which further verified the influence of temporal variation on the proposed approach. This paper provides a general guide for delineating agricultural parcels using SITS. [ABSTRACT FROM AUTHOR]

• The Transformer can effectively suppress the interference of complex background information on disease recognition. • The overlapping patch embedding improves the local continuity of the input image information of Vision Transformer. • We build a scalable and efficient identification model ConvViT to identify kiwifruit disease in complex environments with fewer parameters and computation. • ConvViT has good generalization and is a potential backbone network for feature extraction. The complex background of disease images and the small contrast between the disease area and the background easily confuse, seriously affecting the robustness and accuracy of kiwifruit disease identification models. To address the above problems, this paper proposes a disease identification model based on Vision Transformer and Convolutional Neural Network, ConvViT(Convolutional Neural Network and Vision Transformer), to identify diseases by extracting effective features of kiwifruit disease spots. The proposed ConvViT includes convolutional structure and Transformer structure: The convolutional structure is used to extract the global features of the image, and the Transformer structure is used to obtain the local features of the disease area to help the CNN see better. Meanwhile, the paper designs different models according to the number of parameters and FLOPs (floating-point operations) to improve the model's scalability. The model variants of different sizes are designed to be lightweight to run on devices with different resource constraints. We achieved 98.78% identification accuracy on the self-built kiwifruit disease dataset, with up to 4.53% improvement in identification accuracy compared to the same level of Resnet, ViT, and ResMLP, and more than 10% reduction in the number of parameters and FLOPs. Experimental results on the PlantVillage dataset and the AI Challenger 2018 also show that ConvViT has good generalizability, indicating that the proposed model can solve kiwifruit disease identification problems in complex environments and be valuable a backbone network for other identification tasks with practical applications. [ABSTRACT FROM AUTHOR]

• An image restoration method based on convolutional autoencoder is proposed. • Use the area growth method to divide and code the obstruction according to the contour. • Predict the overall outline of citrus based on the unobstructed citrus outline. • Fill the area to be repaired with the selection method of similar pixels. • The repair rate and image recognition rate have been effectively improved. At present, machine vision and deep learning theories have been widely used in fruit recognition and picking. However, in the process of identification and picking, there are often situations where the target is blocked, existing methods cannot accurately identify, or the identification accuracy rate is low. For improving the recognition rate of fruits under occlusion, this paper proposes an image restoration method based on a convolutional auto-encoder. This method first encodes the obstruction and then determines the general shape of the occluded fruit and compares the general shape with the coding part is combined to determine the area to be repaired. Finally, the area to be repaired is filled with pixels to realize the image repair and recognition of the occlusion map. The average repair rate of the method proposed in this paper is 95.96%, the restoration rate is 3.52% higher than the traditional convolution method, the L2 loss value is 0.63% lower than the traditional convolution method, the average detection accuracy of the restored fruits is 94.77%. [ABSTRACT FROM AUTHOR]

• In this paper, we proposed a chrysanthemum image phenotype recognition framework based on transfer learning and bilinear Convolutional Neural Network for fine-grained chrysanthemum image data, we conducted extensive experiment and comparison, and experimental result proves that our proposal can achieve better performance and lower losses compared with other network models. • In addition, we highlight the on-line recognition, including training and testing. As one of the largest families of flowering plants, chrysanthemum has a wide variety and variation. There exists small phenotypic differences between classes, leading to the fact that classifying the class of chrysanthemum is a challenging fine-grained image classification problem. The fine-grained image classification task based on deep learning often concerns a large number of parameters and requires a long training time. For tackling these issues, this paper proposes a chrysanthemum image phenotype classification framework based on transfer learning and bilinear Convolutional Neural Network. After pre-processing the images, the symmetric VGG16 network is adopted as a feature extractor. The pre-trained parameters are then transferred to the proposed framework, which is divided into two stages for training the full connection layer and fine tuning all layers respectively. The phenotypic features of chrysanthemum output from the two networks are transposed and multiplied. Last the global features are input into the classification layer for classification. In this paper, a total of eight methods, including other bilinear network models, non-transfer learning and non-bilinear models, are compared with our proposal. The experimental result proves that our proposal can achieve better performance and lower loss, compared with other network models, by reaching at an accuracy rate of 0.9815 and a recall rate of 0.9800. [ABSTRACT FROM AUTHOR]

• Propose a more concise method for independent identification of crops and diseases. • A trilinear CNN model was constructed for crop and disease identification. • Improve the generalization of new models using pre-trained models on specific data. Plant diseases may threaten the safety of crops around the world, and timely detection of crop diseases and accurate determination of disease species are important to protect crop safety and control the spread of diseases. Recent studies have proposed the application of modern automatic recognition systems based on convolutional neural networks to the identification tasks of multiple crops and diseases. Although some research results have been achieved, studies have shown that these models are not optimal because they are susceptible to features unrelated to crop diseases, and have poor application ability in real-world environments. Therefore, this paper proposes a more concise method that separating the crop and disease identification and classify them independently, and demonstrates that it is more effective than the traditional crop-disease pairs approach. Meanwhile, we constructed a trilinear convolutional neural networks model using bilinear pooling and used images obtained in a real-world environment for the study of crop disease identification. The crop and disease identification accuracies achieved 99.99% and 99.7% on the test set in a controlled laboratory environment, and 84.11% and 75.58% on the test set in a real-world environment, respectively. The work in this paper improves the application value of crop disease identification research in the real-world. [ABSTRACT FROM AUTHOR]

• A rapid, non-invasive, and environmentally friendly solution is presented to identify 50 quality grades of 21 different tea brands of black tea and green tea. • TeaNet, TeaResnet, and TeaMobilenet are firstly proposed to process NIR data and the spatial information of the transformed pseudo image could be exploited by TeaNet, TeaResnet, and TeaMobilenet • The accuracy of the proposed TeaResnet could reach up to 100%. • SNV is the best preprocessing method for NIR data among MC, SG, SNV, Norm and there is a positive correlation between standard deviation and model performance. A high standard of tea quality control is extremely important for the sake of the health protection of consumers. With the fast-growing of Deep Learning, the intelligent and labor-free authentication of the tea quality, becomes a substantially demanded yet unexplored area, with two key problems yet to be solved: (1) sampling of tea data, with a fast and environmentally friendly approach, (2) distinguishment of tea, in terms of building an accurate tea classifier. To solve the above two problems, NIR spectroscopy is used to collect the tea NIR data in a fast, non-invasive, and environmentally friendly manner. And this paper proposed a series of brand new convolutional neural networks(CNNs) for NIR-based tea data, called TeaNet, TeaResnet, and TeaMobilenet. Due to the success of the different network architectures in the classification task, this paper applies the basic convolution block, the residual block, and the inverted residual block into the network architecture designs, corresponding to TeaNet, TeaResnet, and TeaMobilenet. To serve as the input of networks, NIR data is transformed into a pseudo image and then the model exploits the information in NIR data to make a classification. In an extensive experimental study, we compare TeaNet, TeaResnet, and TeaMobilenet with the traditional machine learning algorithms like Support Vector Machine (SVM) and Random Forest. The experimental results indicate that TeaNet, TeaResnet, and TeaMobilenet could break through the accuracy bottleneck of traditional machine learning algorithms and reach up to a 100% accuracy rate. At the same time, the comparative experiments of the four preprocessing methods-Mean Centering (MC), Savitzky-Golay smoothing (SG), Standard Normal Variate (SNV), and Normalization(Norm) indicate that there is a positive correlation between standard deviation and classification performance. SNV is the best preprocessing method for tea near-infrared spectroscopy data with the greatest standard deviation. [ABSTRACT FROM AUTHOR]

• An RGB-D camera is mounted on the UAV to collect RGB and depth images. • Combine object detection with semantic segmentation. • A method combining CNN and RGB-D image information. • The 3D localization of branch picking points based on deep learning. • The performance of the whole scheme was evaluated by orchard experiments. Longan is a famous speciality fruit and cultivated medicinal plant that has important edible and medicinal value; how to improve productivity in harvest is an important issue. At present, longan is mainly planted in hilly areas. For complex site conditions and tall trees, the ground harvesting machineries cannot work normally. In this study, aiming at harvesting longan fruit using unmanned aerial vehicles, a method combining an improved YOLOv5s, improved DeepLabv3+ model and depth image information is proposed, which is used for the three-dimensional (3D) positioning of branch picking points in complex natural environments. First, the improved YOLOv5s model is used to quickly detect longan fruit skewers and the main fruit branches from a complex orchard environment. The correct main fruit branch is obtained according to its relative position relationship and is extracted as the input to the semantic segmentation model. Second, using the improved DeepLabv3+ model, the image extracted in the previous step is semantically segmented to obtain the 2D coordinate information of the main longan fruit branches. Finally, combined with the growth characteristics of a longan fruit string, RGB-D information fusion is carried out on the main fruit branches in 3D space to obtain the central axis and pose information of the main fruit branches, and the 3D coordinates of the picking points are calculated, which provides destination information for a longan harvesting drone. To verify the effectiveness of the proposed method, an experiment for identifying and locating the main fruit branches and picking points was carried out in a longan orchard. The experimental results show that the longan string fruit and main fruit branch detection accuracy is 85.50%, and the main fruit branch semantic segmentation accuracy is 94.52%. The whole algorithm takes 0.58 s in the actual scene and can quickly and accurately locate the picking points. In summary, this paper fully exploits the advantages of the combination of a convolutional neural network and RGB-D image information, further improving the efficiency of longan harvesting drones in accurately positioning picking points in 3D space. [ABSTRACT FROM AUTHOR]

• Propose a transfer-learning based model that captures the semantics of diseased plant leaf. • Fusion of Deep features and HOG feature for effective capture of rich local spatial properties in plant leaf images. • Introduce the centre-loss constraint to enhance the discriminative ability of the fused features. With the continuing changes in the structure of plant and cultivation patterns, new diseases are constantly appearing on the leaves of plant, exacerbating the threat to food security and agricultural production in many areas of the world. Thus, a rapid and accurate recognition of various diseases in plant will not only significantly reduce unnecessary planting costs, but also alleviate the economic losses and environmental pollution caused by incorrect disease diagnosis. Recent advances in deep learning have improved the performance in recognizing plant leaf diseases. In this paper, we present a general framework for recognizing plant diseases. Firstly, we propose a deep feature descriptor based on transfer learning to obtain a high-level latent feature representation. Then, we integrate the deep features with traditional handcrafted features by feature fusion to capture the local texture information in plant leaf images. In addition, centre loss is incorporated to further enhance the discriminative ability of the fused feature. The centre loss simultaneously minimizes intra-class distance and maximizes inter-class distance to learn both compact and separate features. Extensive experiments have been conducted on three publicly available datasets (two Apple Leaf datasets and one Coffee Leaf dataset) to validate the effectiveness of proposed method. The propose method achieves 99.79%, 92.59% and 97.12% classification accuracies on the three datasets, respectively. The experiment results demonstrate that the proposed method effectively captures the discriminative feature representation for distinguishing plant leaf diseases. [ABSTRACT FROM AUTHOR]

• Identification and segmentation of weed species is of great importance. • Semantic segmentation on natural images requires enormous manual annotation. • The proposed architecture increases the performance in distinguishing between weed species. • The proposed methodology reduces the annotation effort to one third. • The use of synthetic datasets doubles the segmentation performance. Weeds compete with productive crops for soil, nutrients and sunlight and are therefore a major contributor to crop yield loss, which is why safer and more effective herbicide products are continually being developed. Digital evaluation tools to automate and homogenize field measurements are of vital importance to accelerate their development. However, the development of these tools requires the generation of semantic segmentation datasets, which is a complex, time-consuming and not easily affordable task. In this paper, we present a deep learning segmentation model that is able to distinguish between different plant species at the pixel level. First, we have generated three extensive datasets targeting one crop species (Zea mays), three grass species (Setaria verticillata, Digitaria sanguinalis, Echinochloa crus-galli) and three broadleaf species (Abutilon theophrasti, Chenopodium albums, Amaranthus retroflexus). The first dataset consists of real field images that were manually annotated. The second dataset is composed of images of plots where only one species is present at a time and the third type of dataset was synthetically generated from images of individual plants mimicking the distribution of real field images. Second, we have proposed a semantic segmentation architecture by extending a PSPNet architecture with an auxiliary classification loss to aid model convergence. Our results show that the network performance increases when supplementing the real field image dataset with the other types of datasets without increasing the manual annotation effort. More specifically, the use of the real field dataset obtains a Dice-Søensen Coefficient (DSC) score of 25.32. This performance increases when this dataset is combined with the single-species class dataset (DSC= 47.97) or the synthetic dataset (DSC= 45.20). As for the proposed model, the ablation method shows that by removing the proposed auxiliary classification loss, the segmentation performance decreases (DSC= 45.96) compared to the proposed architecture method (DSC= 47.97). The proposed method shows better performance than the current state of the art. In addition, the use of proposed single-species or synthetic datasets can double the performance of the algorithm than when using real datasets without additional manual annotation effort. [ABSTRACT FROM AUTHOR]

• Machine-vision system for animal identification. • Deep learning algorithms were used for sheep identification. • ArcFace loss function used for animal identification. • Sheep identification based on facial images. This paper describes a sheep biometric identification system based on facial images. A machine vision system and deep learning model were developed and applied for animal identification. The system included two 8-MegaPixels cameras installed in a controlled water trough adapted to work with NVIDIA Jetson Nano-embedded system-on-module (SoM). Data from 81 Assaf breed sheep, aged two to three months, from two different groups of sheep, were collected over a period of two weeks. The biometric identification model included two steps: face detection and classification. In order to locate and localize the sheep's face in an image, the Faster R-CNN deep learning object detection algorithm was applied. The detected face was provided as input to seven different classification models. Different transfer learning methods were examined. The best performance was obtained using a ResNet50V2 model with the state-of-art ArcFace loss function. The identification system resulted in average accuracies of 95% for the two groups tested. When applying transfer learning methods, average identification accuracies improved to 97% in both groups, and the training process was accomplished in half the time. The newly developed system proves the feasibility of individual biometric identification of sheep on commercial farms. [ABSTRACT FROM AUTHOR]

• A new disease evaluation method fusing deep learning and fuzzy logic is proposed. • DeepLabV3+ with ResNet50 backbone is utilized for images segmentation. • A fuzzy reference system is introduced for grape disease grades classification. • Two complementary indices are given to determine the disease grades. Grape black measles disease may be one of the best known, longest studied and most destructive of all plant diseases, which ultimately reduces productivity and quality of products. Timely, effective and accurate evaluation of grape black measles disease is acknowledged as a crucial step in field management. In this paper, an effective automatic detection and severity analysis method is proposed for grape black measles disease based on deep learning and fuzzy logic. In the first phase, the state-of-the-art ResNet50-based DeepLabV3+ semantic segmentation model is trained for pixel-level predictions in images of individual leaves exhibiting pathological lesions caused by fungus. In this way, the extracted features including ROI and POI are obtained. Second, for each feature, the fuzzy rule-based system is developed for predicting the harm degree of disease. Also, appropriate membership functions for the inputs and output are considered for fuzzification and defuzzification purposes in the fuzzy logic system. Finally, grape leaves are divided into grades of Healthy, Mild, Medium and Severe. Experimental results report an overall classification accuracy of 97.75% on the hold-out test dataset. It is concluded that the DeepLabV3+ model-based fuzzy reference system can be used effectively to classify grape leaves with different disease risks, based on combination of image analysis and statistical calculation. [ABSTRACT FROM AUTHOR]

• Detect and locate fruits based on deep learning is the key to the success of fruit picking. • UAV fuzzy image preprocessing is the basic condition for longan detection. • Reduce the number of calculations and parameters is vital for target detection task. • The positioning strategy of suitable cutting points on fruit branches is elaborated in detail. • The performance of picking platform is evaluated by performing picking experiments. In agriculture, fruit picking robots on the ground have difficulty adapting to the terrain conditions of mountain orchards and cannot pick longan fruit from tall longan trees. In this paper, aiming to allow picking of longan fruit by unmanned aerial vehicles (UAVs), a deep learning-based scheme to quickly and accurately detect and locate suitable picking points on fruit branches is proposed. The scheme includes a UAV fuzzy image preprocessing method, longan detection based on a convolutional neural network (CNN), red, green, blue and depth (RGB-D) information fusion and an accurate target location strategy. First, the UAV is equipped with an Intel Realsense D455 camera, which collects longan images from the front for training and testing the model. Second, the lightweight MobileNet backbone network is used to improve the performance of the You Only Look Once version 4 (YOLOv4) model in feature extraction. The results for the test set show that compared with the classical feature pyramid network (FPN), YOLOv3 and YOLOv4 models, this model reduces the computation, parameters and detection time of the model. Compared with MobileNet single-shot multibox detector (MobileNet-SSD) and YOLOv4-tiny, this model exhibits improved detection accuracy. Third, according to the target detection result map, a strategy is formulated to accurately determine the suitable picking point on the main branch of the result. Finally, the performance of the improved model and picking platform in the harvest scene is evaluated by performing picking experiments in a longan orchard. In summary, we fully exploit the advantages of the combination of UAVs, RGB-D cameras and CNNs to improve the speed and accuracy of target detection and location for longan picking by UAVs based on vision. [ABSTRACT FROM AUTHOR]

• A deep convolutional neural network for the detection of Solanum rostratum Dunal. • A method for UAV image cropping to improve the accuracy and speed of weed pixel segmentation. • A method for calculating coverage that can be used to assess the extent of invasive weed damage. • Analyzed the effect of UAV flight height for weeds detection. Solanum rostratum Dunal is a common invasive weed that can cause significant harm to local natural environments and ecosystems. The prerequisite for preventing and managing the invasion of Solanum rostratum Dunal is timely detection and reasonable assessment of its damage level. Therefore, this paper proposes a deep learning-based image segmentation method for the detection of the invasion degree of Solanum rostratum Dunal. The Solanum rostratum Dunal images are acquired by UAV and then cropped into sub-images of the same size following a specific processing method. The sub-images are fed into a U-Net based convolutional neural network DeepSolanum-Net for processing. The pixels belonging to the Solanum rostratum Dunal plants are extracted and labeled after the sub-images pass through the DeepSolanum-Net. All the processed sub-images are stitched and reduced to the size of the original image, and all the target pixels belonging to the Solanum rostratum Dunal in the original image are segmented out from the background image. The coverage rate and the area covered by the Solanum rostratum Dunal on the ground are calculated based on the image segmentation results and the flight altitude of the UAV. A field test is executed and the test results demonstrate that the recognition precision of effective pixels of Solanum rostratum Dunal plants reach 89.95% and the recall rate reach 90.3% when the proposed method is used. [ABSTRACT FROM AUTHOR]

• Spaceborne one-shot hyperspectral imagery for crop mapping in cloudy season. • The three-dimensional CNN model is found to be competent for identifying crops. • The in-depth features are analyzed and visualized using the t-SNE technique. • Results show one-shot hyperspectral images is superior to multi-temporal images in cloudy season. Crop mapping is essential for agricultural management, economic development planning, and ecological conservation. Remote sensing with a large field of view provides us with a potential technique for large-scale crop mapping. However, most of the previous studies have focused on multi-temporal crop mapping, requiring multiple imaging over a period of time, which is impossible in the cloudy season due to the absence of clear atmospheric windows. Recently, with the progress of spaceborne hyperspectral imaging technology, wide-width hyperspectral satellite images, which provide abundant spectral and spatial structure information, have made the precision crop mapping of large areas possible. This paper focuses on deep learning based crop mapping using one-shot hyperspectral satellite imagery, where three convolutional neural network (CNN) models, i.e., 1D-CNN, 2D-CNN, and 3D-CNN models, are applied for end-to-end crop mapping. In addition, a manifold learning based visualization approach, i.e., t-distributed stochastic neighbor embedding (t-SNE), is introduced to illustrate the discriminative ability of the deep semantic features extracted by the different CNN models. To demonstrate the advantages of one-shot hyperspectral satellite images, an experiment was designed to compare the crop mapping performance of different remote sensing data sources, where both mono-temporal and multi-temporal multispectral images (MSIs) of the same research area were introduced for a systematic comparison. The classification accuracy when using hyperspectral satellite images was found to reach more than 94%, which was much better than that when using mono-temporal MSIs, and was comparable to the result when using multi-temporal MSIs. These findings will be important for the application of hyperspectral data when mapping large-area crop landscapes, and they confirm the potential of CNN models, particularly 3D-CNN models, for crop recognition. [ABSTRACT FROM AUTHOR]