Back to Search
Start Over
Siamese transformer RGBT tracking.
- Source :
- Applied Intelligence; Nov2023, Vol. 53 Issue 21, p24709-24723, 15p
- Publication Year :
- 2023
-
Abstract
- Siamese-based RGBT trackers have attracted wide attention because of their high efficiency. However, there is a lack of an effective multimodal fusion module and information interaction between the search area and template area, which leads to poor performance of these siamese-based RGBT trackers. To solve this problem, inspire by the global information modeling capability of the transformer, we construct a siamese-based transformer RGBT tracker consisting of a single unified transformer module. Specifically, we propose a unified transformer fusion module to achieve feature extraction and global information interaction in the siamese RGBT tracker, i.e., the interaction between the search area and template area, the interaction between different modalities. It consists of self-attention and cross-attention, which are used to extract features and information interaction respectively. In addition, to alleviate the impact of multimodal fusion on the efficiency of template update in the tracking stage, we propose a feature-level template update strategy, which effectively improves tracking efficiency. To verify the effectiveness of our tracker, we evaluate it on five benchmark datasets including GTOT, RGBT210, RGBT234, LasHeR and VTUAV, and the results show that our tracker achieves excellent performance compared to the state-of-the-art methods. [ABSTRACT FROM AUTHOR]
- Subjects :
- FEATURE extraction
ARTIFICIAL satellite tracking
DATA mining
INFORMATION modeling
Subjects
Details
- Language :
- English
- ISSN :
- 0924669X
- Volume :
- 53
- Issue :
- 21
- Database :
- Complementary Index
- Journal :
- Applied Intelligence
- Publication Type :
- Academic Journal
- Accession number :
- 173152505
- Full Text :
- https://doi.org/10.1007/s10489-023-04741-y