Back to Search Start Over

S²CL -- Leaf Net : Recognizing Leaf Images Like Human Botanists.

Authors :
CONG ZOU
RUI WANG
CHENG JIN
SANYI ZHANG
XIN WANG
Source :
ACM Transactions on Multimedia Computing, Communications & Applications; Jan2024, Vol. 20 Issue 1, p1-20, 20p
Publication Year :
2024

Abstract

Automatically classifying plant leaves is a challenging fine-grained classification task because of the diversity in leaf morphology, including size, texture, shape, and venation. Although powerful deep learning-based methods have achieved great improvement in leaf classification, these methods still require a large number of well-labeled samples for supervised training,which is difficult to get. In contrast, relying on the specific coarseto-fine classification strategy, human botanists only require a small number of samples for accurate leaf recognition. Inspired by the classification strategy of human botanists, we propose a novel S²CL -- Leaf Net, which exploits multi-granularity clues with a hierarchical attention mechanism and boosts the learning ability with the supervised sampling contrastive learning with limited training samples to classify plant leaves as human botanists do. Specifically, to fully explore and exploit the subtle details of the leaves, a novel sampling transformation mechanism is combinedwith the supervised contrastive learning to enhance the network's perception of details by amplifying the discriminative regions with a weighted sampling of different regions. Furthermore, we construct the hierarchical attention mechanism to produce attention maps of different granularity, which helps to discover details in leaves that are important for classification. Experiments are conducted on the open-access leaf datasets, including Flavia, Swedish, and LeafSnap, which prove the effectiveness of the proposed S²CL -- Leaf Net . [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
15516857
Volume :
20
Issue :
1
Database :
Complementary Index
Journal :
ACM Transactions on Multimedia Computing, Communications & Applications
Publication Type :
Academic Journal
Accession number :
172389825
Full Text :
https://doi.org/10.1145/3615659