P2AT: Pyramid pooling axial transformer for real-time semantic segmentation.

Recently, Transformer-based models have achieved promising results in various vision tasks, due to their ability to model long-range dependencies. However, transformers are computationally expensive, which limits their applications in real-time tasks such as autonomous driving. In addition, efficient local and global feature selection and fusion are vital for accurate dense prediction, especially driving scene understanding tasks. In this paper, we propose a real-time semantic segmentation architecture named Pyramid Pooling Axial Transformer (P2AT). The proposed P2AT takes a coarse feature from the CNN encoder to produce scale-aware contextual features, which are then combined with the multi-level feature aggregation scheme to produce enhanced contextual features. Specifically, we introduce a pyramid pooling axial transformer to capture intricate spatial and channel dependencies, leading to improved performance on semantic segmentation. Then, we design a Bidirectional Fusion module (BiF) to combine semantic information at different levels. Meanwhile, a Global Context Enhancer (GCE) is introduced to compensate for the inadequacy of concatenating different semantic levels. Finally, a decoder block is proposed to help maintain a larger receptive field. We evaluate P2AT variants on three challenging scene-understanding datasets. In particular, our P2AT variants achieve state-of-art results on the Camvid dataset 80.5%, 81.0%, 81.1% for P2AT-S, P2AT-M, and P2AT-L, respectively. Furthermore, our experiments on Cityscapes and Pascal VOC 2012 have demonstrated the efficiency of the proposed architecture. The source code will be available at https://github.com/mohamedac29/P2AT. • Real-time semantic segmentation with Pyramid Pooling Axial Transformer (P2AT). • Transformer that captures intricate spatial and channel dependencies. • Bidirectional Fusion module for effective semantic information integration. • Refine and corrects the inadequacy of concatenating different semantic levels. • Evaluation of perception algorithms on challenging scene understanding datasets. [ABSTRACT FROM AUTHOR]