Search

Network slicing (NwS) is one of the main technologies in the fifth-generation of mobile communication and beyond (5G+). One of the important challenges in the NwS is information uncertainty which mainly involves demand and channel state information (CSI). Demand uncertainty is divided into three types: number of users requests, amount of bandwidth, and requested virtual network functions workloads. Moreover, the CSI uncertainty is modeled by three methods: worst-case, probabilistic, and hybrid. In this paper, our goal is to maximize the utility of the infrastructure provider by exploiting deep reinforcement learning algorithms in end-to-end NwS resource allocation under demand and CSI uncertainties. The proposed formulation is a nonconvex mixed-integer non-linear programming problem. To perform robust resource allocation in problems that involve uncertainty, we need a history of previous information. To this end, we use a recurrent deterministic policy gradient (RDPG) algorithm, a recurrent and memory-based approach in deep reinforcement learning. Then, we compare the RDPG method in different scenarios with soft actor-critic (SAC), deep deterministic policy gradient (DDPG), distributed, and greedy algorithms. The simulation results show that the SAC method is better than the DDPG, distributed, and greedy methods, respectively. Moreover, the RDPG method out performs the SAC approach on average by 70%.

In this paper, we study a Deep Reinforcement Learning (DRL) based framework for an online end-user service provisioning in a Network Function Virtualization (NFV)-enabled network. We formulate an optimization problem aiming to minimize the cost of network resource utilization. The main challenge is provisioning the online service requests by fulfilling their Quality of Service (QoS) under limited resource availability. Moreover, fulfilling the stochastic service requests in a large network is another challenge that is evaluated in this paper. To solve the formulated optimization problem in an efficient and intelligent manner, we propose a Deep Q-Network for Adaptive Resource allocation (DQN-AR) in NFV-enable network for function placement and dynamic routing which considers the available network resources as DQN states. Moreover, the service's characteristics, including the service life time and number of the arrival requests, are modeled by the Uniform and Exponential distribution, respectively. In addition, we evaluate the computational complexity of the proposed method. Numerical results carried out for different ranges of parameters reveal the effectiveness of our framework. In specific, the obtained results show that the average number of admitted requests of the network increases by 7 up to 14% and the network utilization cost decreases by 5 and 20 %.

In this paper, a novel method for joint radio resource allocation (RRA), three-dimensional placement (3DP), and user association of aerial base stations (ABSs) as a main problem in the internet of things (IoT) networks is proposed. In our proposed model, we consider two schemes: a) line of sight (LoS) b) generalized. In the LoS scheme, all the ABSs should see the IoT users as LoS. In the generalized scheme, ABSs can see some of the IoT users as LoS and some of them as NLoS. The main goal of this paper is to minimize the overal transmit power of the IoT users while satisfying some quality of service (QoS) constraints in uplink scenario. To solve the optimization problems and to convert the main problems with high complexity into the subproblems with lower complexity, we decompose them into two subproblems namely 3DP subproblem and joint RRA and user association (JRU) subproblem. The methods which we use to solve our proposed optimization problems are Semi Definite Relaxation (SDR) and Geometric Programming (GP). Finally, using simulations, we evaluate the performance of the proposed schemes for different values of the network parameters., Comment: 10 pages, 6 figures, 3 tables, submitted to journal