Back to Search Start Over

FOTCA: hybrid transformer-CNN architecture using AFNO for accurate plant leaf disease image recognition

Authors :
Bo Hu
Wenqian Jiang
Juan Zeng
Chen Cheng
Laichang He
Source :
Frontiers in Plant Science, Vol 14 (2023)
Publication Year :
2023
Publisher :
Frontiers Media S.A., 2023.

Abstract

Plants are widely grown around the world and have high economic benefits. plant leaf diseases not only negatively affect the healthy growth and development of plants, but also have a negative impact on the environment. While traditional manual methods of identifying plant pests and diseases are costly, inefficient and inaccurate, computer vision technologies can avoid these drawbacks and also achieve shorter control times and associated cost reductions. The focusing mechanism of Transformer-based models(such as Visual Transformer) improves image interpretability and enhances the achievements of convolutional neural network (CNN) in image recognition, but Visual Transformer(ViT) performs poorly on small and medium-sized datasets. Therefore, in this paper, we propose a new hybrid architecture named FOTCA, which uses Transformer architecture based on adaptive Fourier Neural Operators(AFNO) to extract the global features in advance, and further down sampling by convolutional kernel to extract local features in a hybrid manner. To avoid the poor performance of Transformer-based architecture on small datasets, we adopt the idea of migration learning to make the model have good scientific generalization on OOD (Out-of-Distribution) samples to improve the model’s overall understanding of images. In further experiments, Focal loss and hybrid architecture can greatly improve the convergence speed and recognition accuracy of the model in ablation experiments compared with traditional models. The model proposed in this paper has the best performance with an average recognition accuracy of 99.8% and an F1-score of 0.9931. It is sufficient for deployment in plant leaf disease image recognition.

Details

Language :
English
ISSN :
1664462X
Volume :
14
Database :
Directory of Open Access Journals
Journal :
Frontiers in Plant Science
Publication Type :
Academic Journal
Accession number :
edsdoj.83aee69e8c654ee4815440e8f124a506
Document Type :
article
Full Text :
https://doi.org/10.3389/fpls.2023.1231903