1. DRL-Based Low-Latency Content Delivery for 6G Massive Vehicular IoT
- Author
-
Wenjing Li, Lei Feng, Fanqin Zhou, Peng Yu, Luoming Meng, and Xiaoyu Que
- Subjects
Computer Networks and Communications ,business.industry ,Computer science ,Reliability (computer networking) ,Throughput ,Computer Science Applications ,Transmission (telecommunications) ,Hardware and Architecture ,Component (UML) ,Signal Processing ,Reinforcement learning ,Latency (engineering) ,business ,Set (psychology) ,Information Systems ,Computer network - Abstract
Vehicle-to-everything communication is an indispensable component of 6G networks that could help to facilitate future transportation systems. However, massive vehicles and unstable vehicle-to-vehicle (V2V) links may become bottlenecks for the low-latency delivery of contents, such as safety-critical emergency messages and multimedia. Instead of resolving the problem in a centralized way, we propose a massive vehicular Internet of Things (IoT) system and investigate the approach that would enable each vehicle to decide the transmission mode from three modes, i.e., vehicle-to-network (V2N), vehicle-to-infrastructure (V2I) and V2V sidelinks, and wireless resources. Specifically, a multi-agent deep reinforcement learning framework is formulated by combining the multi-agent reinforcement learning approach, WoLF-PHC, with the techniques from deep Q-learning (DQN) to gain the formulated framework the capability of capturing the effects of interaction between learning agents and states of complex environment. The framework is set to maximize the throughput of vehicles while maintaining the latency and reliability constraints of the vehicle communication links. However, it could be easily extended to other objectives. The simulation results demonstrate that the proposed approach outperforms the compared ones in total traffic capacity and satisfaction rate of the vehicles in communication.
- Published
- 2022