Search

Wide Area Motion Imagery (WAMI) yields high resolution images with a large number of extremely small objects. Target objects have large spatial displacements throughout consecutive frames. This nature of WAMI images makes object tracking and detection challenging. In this paper, we present our deep neural network-based combined object detection and tracking model, namely, Heat Map Network (HM-Net). HM-Net is significantly faster than state-of-the-art frame differencing and background subtraction-based methods, without compromising detection and tracking performances. HM-Net follows object center-based joint detection and tracking paradigm. Simple heat map-based predictions support unlimited number of simultaneous detections. The proposed method uses two consecutive frames and the object detection heat map obtained from the previous frame as input, which helps HM-Net monitor spatio-temporal changes between frames and keep track of previously predicted objects. Although reuse of prior object detection heat map acts as a vital feedback-based memory element, it can lead to unintended surge of false positive detections. To increase robustness of the method against false positives and to eliminate low confidence detections, HM-Net employs novel feedback filters and advanced data augmentations. HM-Net outperforms state-of-the-art WAMI moving object detection and tracking methods on WPAFB dataset with its 96.2% F1 and 94.4% mAP detection scores, while achieving 61.8 % mAP tracking score on the same dataset. This performance corresponds to an improvement of 2.1% for F1, 6.1% for mAP scores on detection, and 9.5% for mAP score on tracking over state-of-the-art.

Accurate prediction of path loss is essential for the design and optimization of wireless communication networks. Existing path loss prediction methods typically suffer from the trade-off between accuracy and computational efficiency. In this paper, we present a deep learning based approach with clear advantages over the existing ones. The proposed method is based on the Generative Adversarial Network (GAN) technique to predict path loss map of a target area from the satellite image or the height map of the area. The proposed method produces the path loss map of the entire target area in a single inference, with accuracy close to the one produced by ray tracing simulations. The method is tested at 900MHz transmission frequency; the trained model and source codes are publicly available on a Github page.

Path loss prediction is essential for network planning in any wireless communication system. For cellular networks, it is usually achieved through extensive received signal power measurements in the target area. When the 3D model of an area is available, ray tracing simulations can be utilized; however, an important drawback of such an approach is the high computational complexity of the simulations. In this paper, we present a fundamentally different approach for path loss distribution prediction directly from 2D satellite images based on deep convolutional neural networks. While training process is time consuming and completed offline, inference can be done in real time. Another advantage of the proposed approach is that 3D model of the area is not needed during inference since the network simply uses an image captured by an aerial vehicle or satellite as its input. Simulation results show that the path loss distribution can be accurately predicted for different communication frequencies and transmitter heights.

Optimal network planning for wireless communication systems requires the detailed knowledge of the channel parameters of the target coverage area. Channel parameters can be estimated through extensive measurements in the environment. Alternatively, ray tracing simulations can be done if the 3D model of the environment is available. One drawback of ray tracing simulations is the high computational complexity; therefore, ray tracing is not suitable for real-time coverage optimization. In this paper, we present a deep convolutional neural network-based approach to estimate channel parameters (specifically, path loss exponent and standard deviation of shadowing) directly from 2D satellite images. While deep learning methods require high computational resources for training and large amount of training data, once trained, the network can make predictions fast. Also, unlike the ray tracing simulations, there is no need for 3D model generation, and therefore, it can be applied easily using the images obtained from satellites or aerial vehicles. These make the proposed method a computationally efficient and reliable alternative to ray tracing simulations. The experimental results show that path loss exponent and large-scale shadowing factor at 900 MHz can be correctly classified by 88% and 76% accuracy, respectively.

Superresolution (SR) is a well-known technique to increase the quality of an image using multiple overlapping pictures of a scene. SR requires accurate registration of the images, both geometrically and photometrically. Most of the SR articles in the literature have considered geometric registration only, assuming that images are captured under the same photometric conditions. This is not necessarily true as external illumination conditions and/or camera parameters (such as exposure time, aperture size, and white balancing) may vary for different input images. Therefore, photometric modeling is a necessary task for superresolution. In this paper, we investigate superresolution image reconstruction when there is photometric variation among input images.