1. Reinforcement Learning-Based Downlink Interference Control for Ultra-Dense Small Cells
- Author
-
Liang Xiao, H. Vincent Poor, Sicong Liu, Xiaoyue Wan, Yilin Xiao, Li-Chun Wang, and Hailu Zhang
- Subjects
Computer science ,Applied Mathematics ,020206 networking & telecommunications ,Throughput ,02 engineering and technology ,Energy consumption ,Transmitter power output ,Interference (wave propagation) ,Computer Science Applications ,Telecommunications link ,Computer Science::Networking and Internet Architecture ,0202 electrical engineering, electronic engineering, information engineering ,Electronic engineering ,Cellular network ,Reinforcement learning ,Electrical and Electronic Engineering ,Computer Science::Information Theory ,Communication channel ,Power control - Abstract
The dense deployment of small cells in 5G cellular networks raises the issue of controlling downlink inter-cell interference under time-varying channel states. In this paper, we propose a reinforcement learning based power control scheme to suppress downlink inter-cell interference and save energy for ultra-dense small cells. This scheme enables base stations to schedule the downlink transmit power without knowing the interference distribution and the channel states of the neighboring small cells. A deep reinforcement learning based interference control algorithm is designed to further accelerate learning for ultra-dense small cells with a large number of active users. Analytical convergence performance bounds including throughput, energy consumption, inter-cell interference, and the utility of base stations are provided and the computational complexity of our proposed scheme is discussed. Simulation results show that this scheme optimizes the downlink interference control performance after sufficient power control instances and significantly increases the network throughput with less energy consumption compared with a benchmark scheme.
- Published
- 2020