A graph-guided transformer based on dual-stream perception for hyperspectral image classification.

The excellent capabilities of Transformers and Graph Neural Networks (GNNs) in modelling long-range dependencies and handling irregular data have led to their widespread application in hyperspectral image (HSI) classification tasks. However, the Graph Transformer combining both advantages is rarely used in this field and has some limitations. Current Graph Transformers consider interactions between all nodes within the graph, adding complexity and introducing unnecessary information from noisy nodes. Moreover, the rich spectral information in HSIs is often ignored, and there is a lack of effective fusion of spatial information. In this paper, we propose a dual-stream graph-guided Transformer for HSI classification. In spatial dimension, superpixels are utilized to guide spatial graph generation, capturing global topological dependencies and local details effectively in HSIs. In terms of spectrum, we innovatively construct a spectral graph based on spectral channels and adopt a contribution score-based strategy to adaptively filter out irrelevant edges, achieving sparsity while preserving spectral context relationships. Experimental results demonstrate the significant competitive advantage of our method in HSI classification tasks on three public datasets. The code is available at . [ABSTRACT FROM AUTHOR]