Back to Search
Start Over
Multi-Scale and Occlusion Aware Network for Vehicle Detection and Segmentation on UAV Aerial Images
- Source :
- Remote Sensing; Volume 12; Issue 11; Pages: 1760, Remote Sensing, Vol 12, Iss 1760, p 1760 (2020)
- Publication Year :
- 2020
- Publisher :
- MDPI AG, 2020.
-
Abstract
- With the advantage of high maneuverability, Unmanned Aerial Vehicles (UAVs) have been widely deployed in vehicle monitoring and controlling. However, processing the images captured by UAV for the extracting vehicle information is hindered by some challenges including arbitrary orientations, huge scale variations and partial occlusion. In seeking to address these challenges, we propose a novel Multi-Scale and Occlusion Aware Network (MSOA-Net) for UAV based vehicle segmentation, which consists of two parts including a Multi-Scale Feature Adaptive Fusion Network (MSFAF-Net) and a Regional Attention based Triple Head Network (RATH-Net). In MSFAF-Net, a self-adaptive feature fusion module is proposed, which can adaptively aggregate hierarchical feature maps from multiple levels to help Feature Pyramid Network (FPN) deal with the scale change of vehicles. The RATH-Net with a self-attention mechanism is proposed to guide the location-sensitive sub-networks to enhance the vehicle of interest and suppress background noise caused by occlusions. In this study, we release a large comprehensive UAV based vehicle segmentation dataset (UVSD), which is the first public dataset for UAV based vehicle detection and segmentation. Experiments are conducted on the challenging UVSD dataset. Experimental results show that the proposed method is efficient in detecting and segmenting vehicles, and outperforms the compared state-of-the-art works.
- Subjects :
- feature pyramid network
010504 meteorology & atmospheric sciences
Computer science
Science
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
0211 other engineering and technologies
02 engineering and technology
01 natural sciences
Background noise
Market segmentation
self-attention mechanism
Vehicle detection
Occlusion
Segmentation
Computer vision
Pyramid (image processing)
021101 geological & geomatics engineering
0105 earth and related environmental sciences
vehicle segmentation
vehicle detection
aerial images
business.industry
Feature (computer vision)
General Earth and Planetary Sciences
Artificial intelligence
Scale (map)
business
Subjects
Details
- ISSN :
- 20724292
- Volume :
- 12
- Database :
- OpenAIRE
- Journal :
- Remote Sensing
- Accession number :
- edsair.doi.dedup.....e3aebe04830a0253d00ee4c2008e106e