Search

In this paper, we leverage reinforcement learning (RL) and cross-layer network coding (CLNC) for efficiently pre-fetching requested contents to the local caches and delivering these contents to requesting users in a downlink fog-radio access network (F-RAN) with device-to-device (D2D) communications. In the considered system, fog access points (F-APs) and cache-enabled D2D (CE-D2D) users are equipped with local caches that alleviate traffic burden at the fronthaul and facilitate rapid delivery of the users’ contents. To this end, the CLNC scheme optimizes the coding decisions, transmission rates, and power levels of both F-APs and CE-D2D users, and RL scheme optimizes caching strategy. A joint content placement and delivery problem is formulated as an optimization problem with a goal to maximize system sum-rate. The problem is an NP-hard problem. To efficiently solve it, we first develop an innovative decentralized CLNC coalition formation (CLNC-CF) switch algorithm to obtain a stable solution for the content delivery problem, where F-APs and CE-D2D users utilize CLNC resource allocation. By considering statistics of channel and users’ content request into account, we then develop a multi-agent RL algorithm for optimizing the content placement at both F-APs and CE-D2D users. Simulation results show that the proposed joint CLNC-CF-RL framework can effectively improve the sum-rate by up to 30%, 60%, and 150%, respectively, compared to: 1) an optimal uncoded algorithm, 2) a standard rate-aware-NC algorithm, and 3) a benchmark classical NC with network-layer optimization. [ABSTRACT FROM AUTHOR]

In this paper, we consider a computation offloading problem in a three-tier network consisting of multiple mobile users (MUs), multiple edge clouds, and a central cloud. On this basis, we formulate a system Energy Time Cost ($ETC$) minimization problem by jointly optimizing the resource allocation, mobile-edge matching decision, and offloading decision. Due to the difficulty of directly solving the formulated problem, we decompose it and propose two offloading algorithms, namely Gale-Shapley based Minimum/Sequential Offloading Algorithm (GS-MOA/GS-SOA), to optimize offloading decisions by minimizing the system $ETC$ , in which the mobile-edge matching strategies based on the proposed Gale-Shapley based Mobile-Edge mAtching aLgorithm (GS-MEAL) and resource allocations are optimized iteratively. The simulations show the effectiveness of our proposed algorithm. [ABSTRACT FROM AUTHOR]