Back to Search Start Over

TrackingMamba: Visual State Space Model for Object Tracking

Authors :
Qingwang Wang
Liyao Zhou
Pengcheng Jin
Qu Xin
Hangwei Zhong
Haochen Song
Tao Shen
Source :
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol 17, Pp 16744-16754 (2024)
Publication Year :
2024
Publisher :
IEEE, 2024.

Abstract

In recent years, UAV object tracking has provided technical support across various fields. Most existing work relies on convolutional neural networks (CNNs) or visual transformers. However, CNNs have limited receptive fields, resulting in suboptimal performance, while transformers require substantial computational resources, making training and inference challenging. Mountainous and jungle environments-critical components of the Earth's surface and key scenarios for UAV object tracking-present unique challenges due to steep terrain, dense vegetation, and rapidly changing weather conditions, which complicate UAV tracking. The lack of relevant datasets further reduces tracking accuracy. This article introduces a new tracking framework based on a state-space model called TrackingMamba, which uses a single-stream tracking architecture with Vision Mamba as its backbone. TrackingMamba not only matches transformer-based trackers in global feature extraction and long-range dependence modeling but also maintains computational efficiency with linear growth. Compared to other advanced trackers, TrackingMamba delivers higher accuracy with a simpler model framework, fewer parameters, and reduced FLOPs. Specifically, on the UAV123 benchmark, TrackingMamba outperforms the baseline model OSTtrack-256, improving AUC by 2.59% and Precision by 4.42%, while reducing parameters by 95.52% and FLOPs by 95.02%. The article also evaluates the performance and shortcomings of TrackingMamba and other advanced trackers in the complex and critical context of jungle environments, and it explores potential future research directions in UAV jungle object tracking.

Details

Language :
English
ISSN :
19391404 and 21511535
Volume :
17
Database :
Directory of Open Access Journals
Journal :
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Publication Type :
Academic Journal
Accession number :
edsdoj.48b5f825e3148b79175f327d4c9a43e
Document Type :
article
Full Text :
https://doi.org/10.1109/JSTARS.2024.3458938