Search

Abstract In this article, a simple, yet effective, Bayesian scheme for tracks maintenance, promotion, and deletion in drone surveillance radar is presented. It enables the simultaneous tracking of the target body and micro‐Doppler components that originate from the motion of rotors (if any) onboard an unmanned air system. This not only delivers more accurate multi‐target tracking, but also substantially improves the radar automatic target classification capability (e.g. discriminating between drone and non‐drone targets). Challenging and diverse real staring radar datasets are used here to demonstrate the efficacy and benefits of the proposed track management approach.

Pan–tilt–zoom cameras are commonly used for surveillance applications. Their automation could reduce the workload of human operators and increase the safety of airports by tracking anomalous objects such as drones. Reinforcement learning is an artificial intelligence method that outperforms humans on certain specific tasks. However, there exists a lack of data and benchmarks for pan–tilt–zoom control mechanisms in tracking airborne objects. Here, we show a simulated environment that contains a pan–tilt–zoom camera being used to train and evaluate a reinforcement learning agent. We found that the agent can learn to track the drone in our basic tracking scenario, outperforming a solved scenario benchmark value. The agent is also tested on more complex scenarios, where the drone is occluded behind obstacles. While the agent does not quantitatively outperform the optimal human model, it shows qualitative signs of learning to solve the complex, occluded non-linear trajectory scenario. Given further training, investigation, and different algorithms, we believe a reinforcement learning agent could be used to solve such scenarios consistently. Our results demonstrate how complex drone surveillance tracking scenarios may be solved and fully autonomized by reinforcement learning agents. We hope our environment becomes a starting point for more sophisticated autonomy in control of pan–tilt–zoom cameras tracking of drones and surveilling airspace for anomalous objects. For example, distributed, multi-agent systems of pan–tilt–zoom cameras combined with other sensors could lead towards fully autonomous surveillance, challenging experienced human operators.

Abstract Radar sensing offers a method of achieving 24‐h all‐weather drone surveillance, but in order to be maximally effective, systems need to be able to discriminate between birds and drones. This work examines drone‐bird classification performance as a function of signal to noise ratio (SNR). Classification at low SNR values is necessary in order to classify drones with a small radar cross‐section (RCS), as well as to facilitate reliable classification at longer ranges. To investigate the relationship between classification performance and SNR, Gaussian noise is added to an experimentally obtained dataset of radar spectrograms. Classification is performed by convolutional neural networks (CNNs). It is shown that for the data available classification accuracy drops with falling SNR, as might be expected for any given CNN. The degree to which performance degrades with reduced SNR is presented. It is further shown that simpler network architectures are more robust to noise. Finally, it is demonstrated that data augmentation can be used as a means of enhancing classification accuracy at lower SNR values. Bayesian optimisation is used to find the optimal augmentation hyperparameters and overall, classification accuracies of 92% are achieved at low SNR.