Search

Federated learning (FL) as an emerging distributed machine learning (ML) paradigm enables participants to train their on-device data locally and share model parameters with others by the parameter server. Differing from the centralized ML, FL splits the high requirements of training data and computing power from the server to clients, which is well adapted to unmanned aerial vehicle (UAV) swarms with scattered nodes, heterogeneous data, and limited computing power. However, pretrained models are unsatisfactory in unfamiliar scenes and most existing approaches fail to concentrate on the communication-sensitivity and real-time requirements in UAV-enabled FL scenarios. To address this problem, this article proposes participant and sample selection for efficient online FL in UAV swarms (FedOL). Through the combination of online learning and FL, UAVs can supplement real-time samples and quickly improve the model accuracy in unfamiliar scenes. Meanwhile, to reduce the training latency with expected model accuracy, FedOL allows the server UAV to select participants with high training utility, while the client UAVs select more important samples. We implement FedOL and deploy it on UAV embedded devices. Experimental results show that compared with existing FL approaches, FedOL speeds up by about 2.61x and reaches the final accuracy about 1.02x higher.

Unmanned aerial vehicles (UAVs) have been widely used in military and civilian fields by carrying out intelligent applications with deep learning technologies, such as battlefield search and rescue; intelligence, surveillance, and reconnaissance (ISR); and smart city monitoring. Due to deeper and more complex models of deep neural networks (DNNs) and limited on-board resources in UAVs, most existing works either rely on cloud-based intelligence by transmitting original data to remote powerful cloud servers and running DNNs inference therein, or involve edge intelligence by executing lightweight DNN models on-board. Unfortunately, the former is faced with unacceptable long transmission latency and possible network instability over air-to-ground links, while the latter is restricted to relatively low accuracy via lightweight models. Although a few recent works propose to collaboratively run complex DNNs inference within a swarm of UAVs to achieve both high accuracy and low latency, they seldom consider the strong confrontation environment of the battle-field, the unreliable air-to-air links among UAVs as well as likely hardware/software breakdowns in UAV airborne computers, which could result in the failure of collaborative inference. This article proposes a novel architecture based on an observation, orientation, decision, and action (OODA) loop, called elastic collaborative edge intelligence (eCoEI), which could fully utilize the resources of computation and storage in a UAV swarm, and enable the swarm to collaboratively perform DNN inference tasks in an elastic manner in the face of any lost links. This article also designs a prototype system of the proposed eCoEI and conducts a proof-of-concept evaluation to validate its feasibility as well as effectiveness. Experimental results show that the eCoEI has an outstanding ability to deal with single point of failure and network fluctuations within a UAV swarm for collaborative edge intelligence. Finally, the main techn

As the demands for immediate and effective responses increase in both civilian and military domains, the unmanned aerial vehicle (UAV) swarms emerge as effective solutions, in which multiple cooperative UAVs can work together to achieve specific goals. However, how to manage such complex systems to ensure real-time adaptability lack sufficient researches. Hence, in this paper, we propose the cooperative cognitive dynamic system (CCDS), to optimize the management for UAV swarms. CCDS leverages a hierarchical and cooperative control structure that enables real-time data processing and decision. Accordingly, CCDS optimizes the UAV swarm management via dynamic reconfigurability and adaptive intelligent optimization. In addition, CCDS can be integrated with the biomimetic mechanism to efficiently allocate tasks for UAV swarms. Further, the distributed coordination of CCDS ensures reliable and resilient control, thus enhancing the adaptability and robustness. Finally, the potential challenges and future directions are analyzed, to provide insights into managing UAV swarms in dynamic heterogeneous networking.

The environment of low-altitude urban airspace is complex and variable due to numerous obstacles, non-cooperative aircrafts, and birds. Unmanned aerial vehicles (UAVs) leveraging environmental information to achieve three-dimension collision-free trajectory planning is the prerequisite to ensure airspace security. However, the timely information of surrounding situation is difficult to acquire by UAVs, which further brings security risks. As a mature technology leveraged in traditional civil aviation, the automatic dependent surveillance-broadcast (ADS-B) realizes continuous surveillance of the information of aircrafts. Consequently, we leverage ADS-B for surveillance and information broadcasting, and divide the aerial airspace into multiple sub-airspaces to improve flight safety in UAV trajectory planning. In detail, we propose the secure sub-airspaces planning (SSP) algorithm and particle swarm optimization rapidly-exploring random trees (PSO-RRT) algorithm for the UAV trajectory planning in law-altitude airspace. The performance of the proposed algorithm is verified by simulations and the results show that SSP reduces both the maximum number of UAVs in the sub-airspace and the length of the trajectory, and PSO-RRT reduces the cost of UAV trajectory in the sub-airspace.

Cream cheese is an important export product for Australia; cream cheese production and consumption also continue to increase in many countries. The traditional manufacture of cream cheese generates a large volume of acid whey (~65–70%, w/w) that is often treated as wastewater, animal feed or fertilizer and can have a negative impact on the environment. Membrane ultrafiltration (UF) can be used to pre-concentrate the milk used in cream cheese production to improve the retention of whey proteins, increase productivity and reduce the generation of acid whey. The effect of UF concentration on the properties of milk and subsequent effects on the acid-coagulated gels and resulting cream cheese were investigated in this thesis. The thesis commences with a literature review of cream cheese manufacture and membrane filtration in Chapter 2. The fundamental and physico-chemical properties of cream cheese acid gels made from the addition of UF milk are then reported in Chapter 3. It was hypothesised that UF addition would impact the properties of both the milk and acid gels formed during the early stages of cream cheese production. Skim milk was concentrated to a volumetric concentration factor (VCF) of 2.5 or 5 by UF and the milk samples were standardized to a protein-to-fat ratio of ~0.23 to achieve a milk composition typical of that used for full fat cream cheese production. The UF cheese milk had a similar particle size distribution to the unconcentrated cheese milk after homogenization but increased viscosity and a slower rate of acidification, which could be improved by increasing starter culture concentration. The acid gels formed with the addition of UF retentate contained more protein and fat, resulting in a higher storage modulus, firmness and viscosity. A denser microstructure was observed in the acid gels formed with UF retentate and quantitative two- or three-dimensional analysis of confocal images found a greater volume percentage of protein and fat, decreased por

A heterogeneous unmanned aerial vehicle (UAV) network where UAVs carrying different resources form coalition and cooperatively carry out tasks is of crucial importance for fulfilling diverse tasks. However, the existing coalition formation (CF) game model only optimizes the composition of UAVs in a single coalition, which results in disjoined coalitions. In order to tackle this issue, a sequential overlapping coalition formation (OCF) game is proposed by considering the overlapping and complementary relations of resource properties and the task execution order. Moreover, different from the Pareto and selfish orders, a bilateral mutual benefit transfer (BMBT) order is proposed to optimize the cooperative task resource allocation through partial cooperation among overlapping coalition members. Furthermore, using the preference relation between UAVs carrying resources and tasks requiring the same type of resource, a preference gravity-guided tabu search (PGG-TS) algorithm is developed to obtain a stable coalition structure. Numerical results verify that the proposed PGG-TS algorithm increases the average utility of tasks by 12.5% and 38.5% compared with the split-merge preferred OCF algorithm and non-overlapping CF algorithm, respectively. The utility of the proposed BMBT order increases by 25.1% and 34.3% compared with selfish and Pareto orders, respectively., QC 20230803

Reconfigurable Intelligent Surfaces (RISs) have great potential for Internet of Things (IoT) applications due to their cost-effectiveness and energy-efficiency. However, under the application of RIS, current RIS systems cannot actively predict and avoid interference, as evolving interference signals can dynamically change their frequency bands. To address this issue, we develop a learning-based dynamic RIS spectrum access scheme to avoid interference and enhance wireless transmission reliability. An intelligent metasurface-based modulation (MM) is designed for generating and reflecting anti-interference radio-frequency signals. Specifically, a Dyna-Q algorithm is employed at the RIS controller to learn the frequency of interference signals, which is used to determine the frequency of the carrier signals. Experiments are conducted on the proposed RIS demo system to evaluate its anti-interference capability, and the results show that our scheme leads to an increase of at least 50% in the system throughput. These numerical results demonstrate the effectiveness of proposed scheme., QC 20230706

Recently, many exciting usage scenarios and groundbreaking technologies for sixth generation (6G) networks have drawn more and more attention. The revolution of 6G mainly lies in ubiquitous intelligence, which promotes the development of edge intelligence (EI) by running artificial intelligence (AI) algorithms at the network edge. By embedding training capabilities across the network nodes, federated learning (FL) can achieve high security and alleviate network traffic congestion, which provides a promising way to realize the ubiquitous EI. While traditional FL usually relies static terrestrial base stations (BSs) for the global model aggregation, unmanned aerial vehicles (UAVs) could effectively supplement the terrestrial BSs because of their high maneuverability, thereby building the air-ground integrated FL (AGIFL). Nevertheless, how to effectively deploy the UAV and allocate resources to boost the learning performance and achieve high energy efficiency in the AGIFL remains largely unexplored. In this paper, we study how to jointly optimize the UAV location and resource allocation to minimize the incurred cost in terms of two objectives: i) the minimization of terrestrial users' energy consumption; ii) the minimization of tradeoff between energy consumption and training latency. The formulated non-convex problems are efficiently solved by alternating optimization techniques based on successive convex approximation (SCA) approaches after appropriate problem decomposition. Extensive simulation results show that our proposed algorithms can reduce more cost than three benchmarks while guaranteeing the learning accuracy. Furthermore, we construct a real-world AGIFL system, implement the proposed algorithms in the system, and carry out field experiments to verify the superiority of our algorithms.

Semantic communication is envisioned as a promising technique to break through the Shannon limit. However, semantic inference and semantic error correction have not been well studied. Moreover, error correction methods of existing semantic communication frameworks are inexplicable and inflexible, which limits the achievable performance. In this paper, to tackle this issue, a knowledge graph is exploited to develop semantic communication systems. Two cognitive semantic communication frameworks are proposed for the single-user and multiple-user communication scenarios. Moreover, a simple, general, and interpretable semantic alignment algorithm for semantic information detection is proposed. Furthermore, an effective semantic correction algorithm is proposed by mining the inference rule from the knowledge graph. Additionally, the pre-trained model is fine-tuned to recover semantic information. For the multi-user cognitive semantic communication system, a message recovery algorithm is proposed to distinguish messages of different users by matching the knowledge level between the source and the destination. Extensive simulation results conducted on a public dataset demonstrate that our proposed single-user and multi-user cognitive semantic communication systems are superior to benchmark communication systems in terms of the data compression rate and communication reliability. Finally, we present realistic single-user and multi-user cognitive semantic communication systems results by building a software-defined radio prototype system., Comment: arXiv admin note: text overlap with arXiv:2202.11958

Multi-access edge computing (MEC) is regarded as a promising technology in the sixth-generation communication. However, the antenna gain is always affected by the environment when unmanned aerial vehicles (UAVs) are served as MEC platforms, resulting in unexpected channel errors. In order to deal with the problem and reduce the power consumption in the UAV-based MEC, we jointly optimize the access scheme and power allocation in the hierarchical UAV-based MEC. Specifically, UAVs are deployed in the lower layer to collect data from ground users. Moreover, a UAV with powerful computation ability is deployed in the upper layer to assist with computing. The goal is to guarantee the quality of service and minimize the total power consumption. We consider the errors caused by various perturbations in realistic circumstances and formulate a distributionally robust chance-constrained optimization problem with an uncertainty set. The problem with chance constraints is intractable. To tackle this issue, we utilize the conditional value-at-risk method to reformulate the problem into a semidefinite programming form. Then, a joint algorithm for access scheme and power allocation is designed. Finally, we conduct simulations to demonstrate the efficiency of the proposed algorithm.

The space-air-ground integrated network (SAGIN) is dynamic and flexible, which can support transmitting data in environments lacking ground communication facilities. However, the nodes of SAGIN are heterogeneous and it is intractable to share the resources to provide multiple services. Therefore, in this paper, we consider using network function virtualization technology to handle the problem of agile resource allocation. In particular, the service function chains (SFCs) are constructed to deploy multiple virtual network functions of different tasks. To depict the dynamic model of SAGIN, we propose the reconfigurable time extension graph. Then, an optimization problem is formulated to maximize the number of completed tasks, i.e., the successful deployed SFC. It is a mixed integer linear programming problem, which is hard to solve in limited time complexity. Hence, we transform it as a many-to-one two-sided matching game problem. Then, we design a Gale-Shapley based algorithm. Finally, via abundant simulations, it is verified that the designed algorithm can effectively deploy SFCs with efficient resource utilization.

With the continuous increment of maritime applications, the development of marine networks for data offloading becomes necessary. However, the limited maritime network resources are very difficult to satisfy real-time demands. Besides, how to effectively handle multiple compute-intensive tasks becomes another intractable issue. Hence, in this paper, we focus on the decision of maritime task offloading by the cooperation of unmanned aerial vehicles (UAVs) and vessels. Specifically, we first propose a cooperative offloading framework, including the demands from marine Internet of Things (MIoTs) devices and resource providers from UAVs and vessels. Due to the limited energy and computation ability of UAVs, it is necessary to help better apply the vessels to computation offloading. Then, we formulate the studied problem into a Markov decision process, aiming to minimize the total execution time and energy cost. Then, we leverage Lyapunov optimization to convert the long-term constraints of the total execution time and energy cost into their short-term constraints, further yielding a set of per-time-slot optimization problems. Furthermore, we propose a Q-learning based approach to solve the short-term problem efficiently. Finally, simulation results are conducted to verify the correctness and effectiveness of the proposed algorithm., Comment: 6 pages, 6 figures, conference

Traditional federated learning (FL) usually relies on static ground base stations (BSs) for model aggregation. Unmanned aerial vehicles (UAVs), due to their flexible 3D deployment, can effectively complement ground BSs, enabling the establishment of air-ground integrated FL to boost ubiquitous edge intelligence. However, for online FL under such an air-ground setting, resource-limited users need to determine the resource allocation and sample selection to enhance training performance and achieve high energy efficiency. This paper studies how to minimize the tradeoff between energy consumption and training performance of air-gound online FL, and proposes an efficient algorithm to solve the aforementioned problem. Simulation results validate the effectiveness of our proposed algorithm in terms of both training effect and energy consumption.

With the increasing use of autonomous unmanned aerial vehicles (UAVs), it is critical to ensure that they are continuously tracked and controlled, especially when UAVs operate beyond the communication range of ground stations (GSs). Conventional surveillance methods for UAVs, such as satellite communications, ground mobile networks and radars are subject to high costs and latency. The automatic dependent surveillance-broadcast (ADS-B) emerges as a promising method to monitor UAVs, due to the advantages of real-time capabilities, easy deployment and affordable cost. Therefore, we employ the ADS-B for UAV trajectory tracking in this work. However, the inherent noise in the transmitted data poses an obstacle for precisely tracking UAVs. Hence, we propose the algorithm of recurrent neural network-enhanced interacting multiple model-Kalman filter (RNN-enhanced IMM-KF) for UAV trajectory filtering. Specifically, the algorithm utilizes the RNN to capture the maneuvering behavior of UAVs and the noise level in the ADS-B data. Moreover, accurate UAV tracking is achieved by adaptively adjusting the process noise matrix and observation noise matrix of IMM-KF with the assistance of the RNN. The proposed algorithm can facilitate GSs to make timely decisions during trajectory deviations of UAVs and improve the airspace safety. Finally, via comprehensive simulations, the total root mean square error of the proposed algorithm decreases by 28.56%, compared to the traditional IMM-KF.

Secure communications are of paramount importance in spectrum sharing networks due to the allocation and sharing characteristics of spectrum resources. To further explore the potential of intelligent reflective surfaces (IRSs) in enhancing spectrum sharing and secure transmission performance, a multiple intelligent reflection surface (multi-IRS)-assisted sensing-enhanced wideband spectrum sharing network is investigated by considering physical layer security techniques. An intelligent resource allocation scheme based on double deep Q networks (D3QN) algorithm and soft Actor-Critic (SAC) algorithm is proposed to maximize the secure transmission rate of the secondary network by jointly optimizing IRS pairings, subchannel assignment, transmit beamforming of the secondary base station, reflection coefficients of IRSs and the sensing time. To tackle the sparse reward problem caused by a significant amount of reflection elements of multiple IRSs, the method of hierarchical reinforcement learning is exploited. An alternative optimization (AO)-based conventional mathematical scheme is introduced to verify the computational complexity advantage of our proposed intelligent scheme. Simulation results demonstrate the efficiency of our proposed intelligent scheme as well as the superiority of multi-IRS design in enhancing secrecy rate and spectrum utilization. It is shown that inappropriate deployment of IRSs can reduce the security performance with the presence of multiple eavesdroppers (Eves), and the arrangement of IRSs deserves further consideration.

The unmanned aerial vehicle (UAV)-based wireless mesh networks can economically provide wireless services for the areas with disasters. However, the capacity of air-to-air communications is limited due to the multi-hop transmissions. In this paper, the spectrum sharing between UAV-based wireless mesh networks and ground networks is studied to improve the capacity of the UAV networks. Considering the distribution of UAVs as a three-dimensional (3D) homogeneous Poisson point process (PPP) within a vertical range, the stochastic geometry is applied to analyze the impact of the height of UAVs, the transmit power of UAVs, the density of UAVs and the vertical range, etc., on the coverage probability of ground network user and UAV network user, respectively. The optimal height of UAVs is numerically achieved in maximizing the capacity of UAV networks with the constraint of the coverage probability of ground network user. This paper provides a basic guideline for the deployment of UAV-based wireless mesh networks., Comment: 6 pages, 6 figures

Unmanned aerial vehicles (UAVs) are recognized as promising technologies for area coverage due to the flexibility and adaptability. However, the ability of a single UAV is limited, and as for the large-scale three-dimensional (3D) scenario, UAV swarms can establish seamless wireless communication services. Hence, in this work, we consider a scenario of UAV swarm deployment and trajectory to satisfy 3D coverage considering the effects of obstacles. In detail, we propose a hierarchical swarm framework to efficiently serve the large-area users. Then, the problem is formulated to minimize the total trajectory loss of the UAV swarm. However, the problem is intractable due to the non-convex property, and we decompose it into smaller issues of users clustering, UAV swarm hovering points selection, and swarm trajectory determination. Moreover, we design a Q-learning based algorithm to accelerate the solution efficiency. Finally, we conduct extensive simulations to verify the proposed mechanisms, and the designed algorithm outperforms other referred methods.

Resource allocation is of crucial importance in wireless communications. However, it is extremely challenging to design efficient resource allocation schemes for future wireless communication networks since the formulated resource allocation problems are generally non-convex and consist of various coupled variables. Moreover, the dynamic changes of practical wireless communication environment and user service requirements thirst for efficient real-time resource allocation. To tackle these issues, a novel partially observable deep multi-agent active inference (PODMAI) framework is proposed for realizing intelligent resource allocation. A belief based learning method is exploited for updating the policy by minimizing the variational free energy. A decentralized training with a decentralized execution multi-agent strategy is designed to overcome the limitations of the partially observable state information. Exploited the proposed framework, an intelligent spectrum allocation and trajectory optimization scheme is developed for a spectrum sharing unmanned aerial vehicle (UAV) network with dynamic transmission rate requirements as an example. Simulation results demonstrate that our proposed framework can significantly improve the sum transmission rate of the secondary network compared to various benchmark schemes. Moreover, the convergence speed of the proposed PODMAI is significantly improved compared with the conventional reinforcement learning framework. Overall, our proposed framework can enrich the intelligent resource allocation frameworks and pave the way for realizing real-time resource allocation., Comment: Some technical errors occured in the manuscript

The unmanned aerial vehicle (UAV) network is popular these years due to its various applications. In the UAV network, routing is significantly affected by the distributed network topology, leading to the issue that UAVs are vulnerable to deliberate damage. Hence, this paper focuses on the routing plan and recovery for UAV networks with attacks. In detail, a deliberate attack model based on the importance of nodes is designed to represent enemy attacks. Then, a node importance ranking mechanism is presented, considering the degree of nodes and link importance. However, it is intractable to handle the routing problem by traditional methods for UAV networks, since link connections change with the UAV availability. Hence, an intelligent algorithm based on reinforcement learning is proposed to recover the routing path when UAVs are attacked. Simulations are conducted and numerical results verify the proposed mechanism performs better than other referred methods., Comment: IEEE GLOBECOM 2023, 6 pages, 4 figures

Unmanned aerial vehicle (UAV) communication is of crucial importance for diverse practical applications. However, it is susceptible to the severe spectrum scarcity problem and interference since it operates in the unlicensed spectrum band. In order to tackle those issues, a dynamic spectrum sharing network is considered with the anti-jamming technique. Moreover, an intelligent spectrum allocation and trajectory optimization scheme is proposed to adapt to diverse jamming models by exploiting our designed novel online-offline multi-agent actor-critic and deep deterministic policy-gradient framework. Simulation results demonstrate the high efficiency of our proposed framework. It is also shown that our proposed scheme achieves the largest transmission rate among all benchmark schemes., Comment: Some technical errors occured in the manuscript

Space-air-ground integrated networks (SAGINs) help enhance the service performance in the sixth generation communication system. SAGIN is basically composed of satellites, aerial vehicles, ground facilities, as well as multiple terrestrial users. Therein, the low earth orbit (LEO) satellites are popular in recent years due to the low cost of development and launch, global coverage and delay-enabled services. Moreover, LEO satellites can support various applications, e.g., direct access, relay, caching and computation. In this work, we firstly provide the preliminaries and framework of SAGIN, in which the characteristics of LEO satellites, high altitude platforms, as well as unmanned aerial vehicles are analyzed. Then, the roles and potentials of LEO satellite in SAGIN are analyzed for access services. A couple of advanced techniques such as multi-access edge computing (MEC) and network function virtualization are introduced to enhance the LEO-based access service abilities as hierarchical MEC and network slicing in SAGIN. In addition, corresponding use cases are provided to verify the propositions. Besides, we also discuss the open issues and promising directions in LEO-enabled SAGIN access services for the future research.

Numerous communication networks are emerging to serve the various demands and improve the quality of service. Heterogeneous users have different requirements on quality metrics such as delay and service efficiency. Besides, the networks are equipped with different types and amounts of resources, and how to efficiently optimize the usage of such limited resources to serve more users is the key issue for communication networks. One powerful mathematical optimization mechanism to solve the above issue is column generation (CG), which can deal with the optimization problems with complicating constraints and block angular structures. In this paper, we first review the preliminaries of CG. Further, the branch-and-price (BP) algorithm is elaborated, which is designed by embedding CG into the branch-and-bound scheme to efficiently obtain the optimal solution. The applications of CG and BP in various communication networks are then provided, such as space-air-ground networks and device-to-device networks. In short, our goal is to help readers refine the applications of the CG optimization tool in terms of problem formulation and solution. We also discuss the possible challenges and prospective directions when applying CG in the communication networks.

With the vigorous development of artificial intelligence (AI), the intelligent applications based on deep neural network (DNN) change people's lifestyles and the production efficiency. However, the huge amount of computation and data generated from the network edge becomes the major bottleneck, and traditional cloud-based computing mode has been unable to meet the requirements of real-time processing tasks. To solve the above problems, by embedding AI model training and inference capabilities into the network edge, edge intelligence (EI) becomes a cutting-edge direction in the field of AI. Furthermore, collaborative DNN inference among the cloud, edge, and end device provides a promising way to boost the EI. Nevertheless, at present, EI oriented collaborative DNN inference is still in its early stage, lacking a systematic classification and discussion of existing research efforts. Thus motivated, we have made a comprehensive investigation on the recent studies about EI oriented collaborative DNN inference. In this paper, we firstly review the background and motivation of EI. Then, we classify four typical collaborative DNN inference paradigms for EI, and analyze the characteristics and key technologies of them. Finally, we summarize the current challenges of collaborative DNN inference, discuss the future development trend and provide the future research direction.

Edge intelligence is anticipated to underlay the pathway to connected intelligence for 6G networks, but the organic confluence of edge computing and artificial intelligence still needs to be carefully treated. To this end, this article discusses the concepts of edge intelligence from the semantic cognitive perspective. Two instructive theoretical models for edge semantic cognitive intelligence (ESCI) are first established. Afterwards, the ESCI framework orchestrating deep learning with semantic communication is discussed. Two representative applications are present to shed light on the prospect of ESCI in 6G networks. Some open problems are finally listed to elicit the future research directions of ESCI., Comment: 9 pages, 7 figures, accepted by China Communications as an invited paper

In this paper, we study the cluster head detection problem of a two-level unmanned aerial vehicle (UAV) swarm network (USNET) with multiple UAV clusters, where the inherent follow strategy (IFS) of low-level follower UAVs (FUAVs) with respect to high-level cluster head UAVs (HUAVs) is unknown. We first propose a graph attention self-supervised learning algorithm (GASSL) to detect the HUAVs of a single UAV cluster, where the GASSL can fit the IFS at the same time. Then, to detect the HUAVs in the USNET with multiple UAV clusters, we develop a multi-cluster graph attention self-supervised learning algorithm (MC-GASSL) based on the GASSL. The MC-GASSL clusters the USNET with a gated recurrent unit (GRU)-based metric learning scheme and finds the HUAVs in each cluster with GASSL. Numerical results show that the GASSL can detect the HUAVs in single UAV clusters obeying various kinds of IFSs with over 98% average accuracy. The simulation results also show that the clustering purity of the USNET with MC-GASSL exceeds that with traditional clustering algorithms by at least 10% average. Furthermore, the MC-GASSL can efficiently detect all the HUAVs in USNETs with various IFSs and cluster numbers with low detection redundancies.

Semantic communication is envisioned as a promising technique to break through the Shannon limit. However, the existing semantic communication frameworks do not involve inference and error correction, which limits the achievable performance. In this paper, in order to tackle this issue, a cognitive semantic communication framework is proposed by exploiting knowledge graph. Moreover, a simple, general and interpretable solution for semantic information detection is developed by exploiting triples as semantic symbols. It also allows the receiver to correct errors occurring at the symbolic level. Furthermore, the pre-trained model is fine-tuned to recover semantic information, which overcomes the drawback that a fixed bit length coding is used to encode sentences of different lengths. Simulation results on the public WebNLG corpus show that our proposed system is superior to other benchmark systems in terms of the data compression rate and the reliability of communication.

In this paper, we jointly design the power control and position dispatch for Multi-unmanned aerial vehicle (UAV)-enabled communication in device-to-device (D2D) networks. Our objective is to maximize the total transmission rate of downlink users (DUs). Meanwhile, the quality of service (QoS) of all D2D users must be satisfied. We comprehensively considered the interference among D2D communications and downlink transmissions. The original problem is strongly non-convex, which requires high computational complexity for traditional optimization methods. And to make matters worse, the results are not necessarily globally optimal. In this paper, we propose a novel graph neural networks (GNN) based approach that can map the considered system into a specific graph structure and achieve the optimal solution in a low complexity manner. Particularly, we first construct a GNN-based model for the proposed network, in which the transmission links and interference links are formulated as vertexes and edges, respectively. Then, by taking the channel state information and the coordinates of ground users as the inputs, as well as the location of UAVs and the transmission power of all transmitters as outputs, we obtain the mapping from inputs to outputs through training the parameters of GNN. Simulation results verified that the way to maximize the total transmission rate of DUs can be extracted effectively via the training on samples. Moreover, it also shows that the performance of proposed GNN-based method is better than that of traditional means.

With the explosive increment of computation requirements, the multi-access edge computing (MEC) paradigm appears as an effective mechanism. Besides, as for the Internet of Things (IoT) in disasters or remote areas requiring MEC services, unmanned aerial vehicles (UAVs) and high altitude platforms (HAPs) are available to provide aerial computing services for these IoT devices. In this paper, we develop the hierarchical aerial computing framework composed of HAPs and UAVs, to provide MEC services for various IoT applications. In particular, the problem is formulated to maximize the total IoT data computed by the aerial MEC platforms, restricted by the delay requirement of IoT and multiple resource constraints of UAVs and HAPs, which is an integer programming problem and intractable to solve. Due to the prohibitive complexity of exhaustive search, we handle the problem by presenting the matching game theory based algorithm to deal with the offloading decisions from IoT devices to UAVs, as well as a heuristic algorithm for the offloading decisions between UAVs and HAPs. The external effect affected by interplay of different IoT devices in the matching is tackled by the externality elimination mechanism. Besides, an adjustment algorithm is also proposed to make the best of aerial resources. The complexity of proposed algorithms is analyzed and extensive simulation results verify the efficiency of the proposed algorithms, and the system performances are also analyzed by the numerical results.

In this paper, we study the resource allocation problem for an intelligent reflecting surface (IRS)-assisted OFDM system. The system sum rate maximization framework is formulated by jointly optimizing subcarrier allocation, base station transmit beamforming and IRS phase shift. Considering the continuous and discrete hybrid action space characteristics of the optimization variables, we propose an efficient resource allocation algorithm combining multiple deep Q networks (MDQN) and deep deterministic policy-gradient (DDPG) to deal with this issue. In our algorithm, MDQN are employed to solve the problem of large discrete action space, while DDPG is introduced to tackle the continuous action allocation. Compared with the traditional approaches, our proposed MDQN-DDPG based algorithm has the advantage of continuous behavior improvement through learning from the environment. Simulation results demonstrate superior performance of our design in terms of system sum rate compared with the benchmark schemes., Comment: 6 pages, 6 figures, accept by ICC 2022

Unmanned aerial vehicle (UAV) swarm enabled edge computing is envisioned to be promising in the sixth generation wireless communication networks due to their wide application sensories and flexible deployment. However, most of the existing works focus on edge computing enabled by a single or a small scale UAVs, which are very different from UAV swarm-enabled edge computing. In order to facilitate the practical applications of UAV swarm-enabled edge computing, the state of the art research is presented in this article. The potential applications, architectures and implementation considerations are illustrated. Moreover, the promising enabling technologies for UAV swarm-enabled edge computing are discussed. Furthermore, we outline challenges and open issues in order to shed light on the future research directions., Comment: 17 pages, 5 figures, to be published in IEEE Wireless Communications Magazine

In adversarial scenarios, it is crucial to timely monitor what tactical messages that opponent transmitters are sending to intended receiver(s), and disrupt the transmissions immediately if in need. The issue becomes more challenging in face of an intelligent transmitter. To address the above-stated issue, a full-duplex (FD) technique is utilized to enable simultaneous jamming and eavesdropping (SJE) at a friendly jammer node. In particular, the "Two Birds with One Stone" strategy is utilized at the jammer node to realize effective rate degradation and information eavesdropping. A confrontation game between an intelligence-empowered FD jammer and its opponent is investigated. Specifically, to capture their adversarial relationship in an environment with incomplete information, a power-domain Bayesian-Stackelberg game is proposed. The existence of a Stackelberg equilibrium (SE) power solution is proved. The semi-closed-form solutions of SE are derived, which are proved to be asymptotically optimal (have a gap of less than 1% with the exact utility), and improves the jammer node 10% utility compared with the Nash equilibrium. Additionally, the SJE strategy outperforms the half-duplex (HD) and other benchmark schemes., QC 20220113

Unmanned aerial vehicle (UAV)-enabled mobile edge computing has been recognized as a promising technology to flexibly and efficiently handle computation-intensive and latency-sensitive tasks in the era of fifth generation (5G) and beyond. In this paper, we study the problem of Service Provisioning for UAV-enabled mobile edge computiNg (SPUN). Specifically, under task latency requirements and various resource constraints, we jointly optimize the service placement, UAV movement trajectory, task scheduling, and computation resource allocation, to minimize the overall energy consumption of all terrestrial user equipments (UEs). Due to the non-convexity of the SPUN problem as well as complex coupling among mixed integer variables, it is a non-convex mixed integer nonlinear programming (MINLP) problem. To solve this challenging problem, we propose two alternating optimization-based suboptimal solutions with different time complexities. In the first solution with relatively high complexity in the worst case, the joint service placement and task scheduling subproblem, and UAV trajectory subproblem are iteratively solved by the Branch and Bound (BnB) method and successive convex approximation (SCA), respectively, while the optimal solution to the computation resource allocation subproblem is efficiently obtained in the closed form. To avoid the high complexity caused by BnB, in the second solution, we propose a novel approximation algorithm based on relaxation and randomized rounding techniques for the joint service placement and task scheduling subproblem, while the other two subproblems are solved in the same way as that of the first solution. Extensive simulations demonstrate that the proposed solutions achieve significantly lower energy consumption of UEs compared to three benchmarks. © 1983-2012 IEEE.

Future Internet involves several emerging technologies such as 5G and beyond 5G networks, vehicular networks, unmanned aerial vehicle (UAV) networks, and Internet of Things (IoTs). Moreover, future Internet becomes heterogeneous and decentralized with a large number of involved network entities. Each entity may need to make its local decision to improve the network performance under dynamic and uncertain network environments. Standard learning algorithms such as single-agent Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) have been recently used to enable each network entity as an agent to learn an optimal decision-making policy adaptively through interacting with the unknown environments. However, such an algorithm fails to model the cooperations or competitions among network entities, and simply treats other entities as a part of the environment that may result in the non-stationarity issue. Multi-agent Reinforcement Learning (MARL) allows each network entity to learn its optimal policy by observing not only the environments, but also other entities' policies. As a result, MARL can significantly improve the learning efficiency of the network entities, and it has been recently used to solve various issues in the emerging networks. In this paper, we thus review the applications of MARL in the emerging networks. In particular, we provide a tutorial of MARL and a comprehensive survey of applications of MARL in next generation Internet. In particular, we first introduce single-agent RL and MARL. Then, we review a number of applications of MARL to solve emerging issues in future Internet. The issues consist of network access, transmit power control, computation offloading, content caching, packet routing, trajectory design for UAV-aided networks, and network security issues.

In this paper, we study the self-healing problem of unmanned aerial vehicle (UAV) swarm network (USNET) that is required to quickly rebuild the communication connectivity under unpredictable external disruptions (UEDs). Firstly, to cope with the one-off UEDs, we propose a graph convolutional neural network (GCN) and find the recovery topology of the USNET in an on-line manner. Secondly, to cope with general UEDs, we develop a GCN based trajectory planning algorithm that can make UAVs rebuild the communication connectivity during the self-healing process. We also design a meta learning scheme to facilitate the on-line executions of the GCN. Numerical results show that the proposed algorithms can rebuild the communication connectivity of the USNET more quickly than the existing algorithms under both one-off UEDs and general UEDs. The simulation results also show that the meta learning scheme can not only enhance the performance of the GCN but also reduce the time complexity of the on-line executions.

With the advent of the Internet-of-Things (IoT) era, the ever-increasing number of devices and emerging applications have triggered the need for ubiquitous connectivity and more efficient computing paradigms. These stringent demands have posed significant challenges to the current wireless networks and their computing architectures. In this article, we propose a high-altitude platform (HAP) network-enabled edge computing paradigm to tackle the key issues of massive IoT connectivity. Specifically, we first provide a comprehensive overview of the recent advances in non-terrestrial network-based edge computing architectures. Then, the limitations of the existing solutions are further summarized from the perspectives of the network architecture, random access procedure, and multiple access techniques. To overcome the limitations, we propose a HAP-enabled aerial cell-free massive multiple-input multiple-output network to realize the edge computing paradigm, where multiple HAPs cooperate via the edge servers to serve IoT devices. For the case of a massive number of devices, we further adopt a grant-free massive access scheme to guarantee low-latency and high-efficiency massive IoT connectivity to the network. Besides, a case study is provided to demonstrate the effectiveness of the proposed solution. Finally, to shed light on the future research directions of HAP network-enabled edge computing paradigms, the key challenges and open issues are discussed., Comment: 8 pages, 6 figures. The current version has been accepted by IEEE Wireless Communications Magzine Special Issue on Aerial Computing: Drones for Multi-Access Edge Computing

Automatic modulation classification enables intelligent communications and it is of crucial importance in today's and future wireless communication networks. Although many automatic modulation classification schemes have been proposed, they cannot tackle the intra-class diversity problem caused by the dynamic changes of the wireless communication environment. In order to overcome this problem, inspired by face recognition, a novel automatic modulation classification scheme is proposed by using the multi-scale network in this paper. Moreover, a novel loss function that combines the center loss and the cross entropy loss is exploited to learn both discriminative and separable features in order to further improve the classification performance. Extensive simulation results demonstrate that our proposed automatic modulation classification scheme can achieve better performance than the benchmark schemes in terms of the classification accuracy. The influence of the network parameters and the loss function with the two-stage training strategy on the classification accuracy of our proposed scheme are investigated.

Many machine learning frameworks have been proposed and used in wireless communications for realizing diverse goals. However, their incapability of adapting to the dynamic wireless environment and tasks and of self-learning limit their extensive applications and achievable performance. Inspired by the great flexibility and adaptation of primate behaviors due to the brain cognitive mechanism, a unified cognitive learning (CL) framework is proposed for the dynamic wireless environment and tasks. The mathematical framework for our proposed CL is established. Using the public and authoritative dataset, we demonstrate that our proposed CL framework has three advantages, namely, the capability of adapting to the dynamic environment and tasks, the self-learning capability and the capability of 'good money driving out bad money' by taking modulation recognition as an example. The proposed CL framework can enrich the current learning frameworks and widen the applications., Comment: This paper has been submitted to IEEE Wireless Communications Magazine(minor revision)

As a parent compound of Li-rich electrodes, Li2MnO3 exhibits high capacity during the initial charge; however, it suffers notoriously low Coulombic efficiency due to oxygen and surface activities. Here, we successfully optimize the oxygen activities toward reversible oxygen redox reactions by intentionally introducing protons into lithium octahedral vacancies in the Li2MnO3 system with its original structural integrity maintained. Combining structural probes, theoretical calculations, and resonant inelastic X-ray scattering results, a moderate coupling between the introduced protons and lattice oxygen at the oxidized state is revealed, which stabilizes the oxygen activities during charging. Such a coupling leads to an unprecedented initial Coulombic efficiency (99.2%) with a greatly improved discharge capacity of 302 mAh g-1 in the protonated Li2MnO3 electrodes. These findings directly demonstrate an effective concept for controlling oxygen activities in Li-rich systems, which is critical for developing high-energy cathodes in batteries.

To meet application demands of electric vehicles, cathode materials of batteries have to overcome the life limitation and performance attenuation caused by crack propagation on the surface of electrode particles. With the increase of size and power of batteries, the voltage gradient generated by metal foil current collectors with high conductivity cannot be neglected. This study reconstructed a porous microstructure based on images of surface morphologies of lithium manganese oxide particles collected by a field emission-scanning electron microscope. Based on this, a multi-scale and multi-physics simulation model coupling electro-chemo-thermo-mechanical behaviours was developed to predict heterogeneous mechanical stress and capacity loss of a large-scale flexible lithium-ion battery. The results arising from use of the model show that: (1) Lithium in electrode particles cannot be diffused in time under a high-charge and discharge rate, and the capacity loss of the battery is directly proportional to the stress generated on the electrode particles. Capacity loss at discharge rate of 10C is 46% higher than that at the rate of 1C and corresponding stress in the microstructure increases by 16%. (2) In the design of the battery layout adopted in this study, utilization rates of electrodes and temperature fields are highly heterogeneous at the higher rate. Mechanical stress near the tab is 8% higher than that at the bottom edge, and it is speculated that the rate of aging of the tab is 35% higher. (3) Mechanical stress during lithium extraction in the cathode during charge is less than half of that during discharge. Attributed to small influences of material activity and excellent performance of lithium titanate oxide in the anode, capacity loss during charge is only 2%. (4) During discharge, stress in the contact region of between particles is the largest, resulting in the decrease of the activity and the low lithium-ion concentration. This leads to cracks during cyclic

As a parent compound of Li-rich electrodes, Li2MnO3 exhibits high capacity during the initial charge; however, it suffers notoriously low Coulombic efficiency due to oxygen and surface activities. Here, we successfully optimize the oxygen activities toward reversible oxygen redox reactions by intentionally introducing protons into lithium octahedral vacancies in the Li2MnO3 system with its original structural integrity maintained. Combining structural probes, theoretical calculations, and resonant inelastic X-ray scattering results, a moderate coupling between the introduced protons and lattice oxygen at the oxidized state is revealed, which stabilizes the oxygen activities during charging. Such a coupling leads to an unprecedented initial Coulombic efficiency (99.2%) with a greatly improved discharge capacity of 302 mAh g-1 in the protonated Li2MnO3 electrodes. These findings directly demonstrate an effective concept for controlling oxygen activities in Li-rich systems, which is critical for developing high-energy cathodes in batteries.

To meet application demands of electric vehicles, cathode materials of batteries have to overcome the life limitation and performance attenuation caused by crack propagation on the surface of electrode particles. With the increase of size and power of batteries, the voltage gradient generated by metal foil current collectors with high conductivity cannot be neglected. This study reconstructed a porous microstructure based on images of surface morphologies of lithium manganese oxide particles collected by a field emission-scanning electron microscope. Based on this, a multi-scale and multi-physics simulation model coupling electro-chemo-thermo-mechanical behaviours was developed to predict heterogeneous mechanical stress and capacity loss of a large-scale flexible lithium-ion battery. The results arising from use of the model show that: (1) Lithium in electrode particles cannot be diffused in time under a high-charge and discharge rate, and the capacity loss of the battery is directly proportional to the stress generated on the electrode particles. Capacity loss at discharge rate of 10C is 46% higher than that at the rate of 1C and corresponding stress in the microstructure increases by 16%. (2) In the design of the battery layout adopted in this study, utilization rates of electrodes and temperature fields are highly heterogeneous at the higher rate. Mechanical stress near the tab is 8% higher than that at the bottom edge, and it is speculated that the rate of aging of the tab is 35% higher. (3) Mechanical stress during lithium extraction in the cathode during charge is less than half of that during discharge. Attributed to small influences of material activity and excellent performance of lithium titanate oxide in the anode, capacity loss during charge is only 2%. (4) During discharge, stress in the contact region of between particles is the largest, resulting in the decrease of the activity and the low lithium-ion concentration. This leads to cracks during cyclic

Ubiquitous intelligence has been widely recognized as a critical vision of the future sixth generation (6G) networks, which implies the intelligence over the whole network from the core to the edge including end devices. Nevertheless, fulfilling such vision, particularly the intelligence at the edge, is extremely challenging, due to the limited resources of edge devices as well as the ubiquitous coverage envisioned by 6G. To empower the edge intelligence, in this article, we propose a novel framework called AGIFL (Air-Ground Integrated Federated Learning), which organically integrates air-ground integrated networks and federated learning (FL). In the AGIFL, leveraging the flexible on-demand 3D deployment of aerial nodes such as unmanned aerial vehicles (UAVs), all the nodes can collaboratively train an effective learning model by FL. We also conduct a case study to evaluate the effect of two different deployment schemes of the UAV over the learning and network performance. Last but not the least, we highlight several technical challenges and future research directions in the AGIFL., Comment: Submitted to IEEE for possible publication

In this paper, we investigate the massive MIMO relay system, where the relay station (RS) forwards the signals from multiple remote users to the base station (BS). Large-scale antenna arrays in conjunction with low-resolution analog-to-digital converters (ADCs) are equipped at the RS and the BS to guarantee the high spectral efficiency with low cost. Considering the ever-present spatial correlation at both the RS and the BS, we first study the canonical channel estimation process, from which a tractable equivalent form of the channel estimate is extracted for further analysis. Under these transmission impairments along with the ADC quantization imperfection, we derive the closed-form approximation of the achievable rate. Then the impacts of power scaling, spatial correlation level, and ADC resolution bits are revealed comprehensively to guide the practical system deployment and implementation. Numerical results are presented to verify the theoretical analysis in a straightforward way., Comment: 13 pages, 7 figures, accepted by IEEE Transactions on Vehicular Technology

The air-ground integrated network is a key component of future sixth generation (6G) networks to support seamless and near-instant super-connectivity. There is a pressing need to intelligently provision various services in 6G networks, which however is challenging. To meet this need, in this article, we propose a novel architecture called UaaS (UAVs as a Service) for the air-ground integrated network, featuring UAV as a key enabler to boost edge intelligence with the help of machine learning (ML) techniques. We envision that the proposed UaaS architecture could intelligently provision wireless communication service, edge computing service, and edge caching service by a network of UAVs, making full use of UAVs' flexible deployment and diverse ML techniques. We also conduct a case study where UAVs participate in the model training of distributed ML among multiple terrestrial users, whose result shows that the model training is efficient with a negligible energy consumption of UAVs, compared to the flight energy consumption. Finally, we discuss the challenges and open research issues in the UaaS., Comment: 12 pages, 6 figures, submitted to IEEE for possible publication

AI heralds a step-change in the performance and capability of wireless networks and other critical infrastructures. However, it may also cause irreversible environmental damage due to their high energy consumption. Here, we address this challenge in the context of 5G and beyond, where there is a complexity explosion in radio resource management (RRM). On the one hand, deep reinforcement learning (DRL) provides a powerful tool for scalable optimization for high dimensional RRM problems in a dynamic environment. On the other hand, DRL algorithms consume a high amount of energy over time and risk compromising progress made in green radio research. This paper reviews and analyzes how to achieve green DRL for RRM via both architecture and algorithm innovations. Architecturally, a cloud based training and distributed decision-making DRL scheme is proposed, where RRM entities can make lightweight deep local decisions whilst assisted by on-cloud training and updating. On the algorithm level, compression approaches are introduced for both deep neural networks and the underlying Markov Decision Processes, enabling accurate low-dimensional representations of challenges. To scale learning across geographic areas, a spatial transfer learning scheme is proposed to further promote the learning efficiency of distributed DRL entities by exploiting the traffic demand correlations. Together, our proposed architecture and algorithms provide a vision for green and on-demand DRL capability., Comment: under review in IEEE Communications Magazine

One-bit radar, performing signal sampling and quantization by a one-bit ADC, is a promising technology for many civilian applications due to its low-cost and low-power consumptions. In this paper, problems encountered by one-bit LFMCW radar are studied and a two-stage target detection method termed as the dimension-reduced generalized approximate message passing (DR-GAMP) approach is proposed. Firstly, the spectrum of one-bit quantized signals in a scenario with multiple targets is analyzed. It is indicated that high-order harmonics may result in false alarms (FAs) and cannot be neglected. Secondly, based on the spectrum analysis, the DR-GAMP approach is proposed to carry out target detection. Specifically, linear preprocessing methods and target predetection are firstly adopted to perform the dimension reduction, and then, the GAMP algorithm is utilized to suppress high-order harmonics and recover true targets. Finally, numerical simulations are conducted to evaluate the performance of one-bit LFMCW radar under typical parameters. It is shown that compared to the conventional radar applying linear processing methods, one-bit LFMCW radar has about $1.3$ dB performance gain when the input signal-to-noise ratios (SNRs) of targets are low. In the presence of a strong target, it has about $1.0$ dB performance loss., Comment: Paper has been accepted in IEEE TAES

The ultra-dense small cell networks (SCNs) have been regarded as a promising technology to solve the data traffic explosion in future. However, the complicated relationships among large scale users and cells practically demand a cooperative grouping mechanism to account for the shortage of resources in SCNs. Then, a group buying market mechanism provides a win-win situation and an effective resource allocation in the view of economics. With additional decision information being provided, the context awareness enhances and improves the group buying mechanism. In this article, we propose a Context-Aware Group Buying (CAGB) mechanism to allocate the resources in ultra-dense SCNs. The feasibility, necessity, and effectiveness of CAGB are analyzed first. Then, we introduce the group buying mechanism and some common context awareness. The relationship between context awareness and group buying is also analyzed. Some important technologies in SCNs are discussed in the view of CAGB, such as load balancing, spectrum management, and cooperative caching. Then, the graphical coalition formation games (CFGs) of CAGB are also presented to match the complicated network topologies in SCNs. Two CAGB-based use cases about spectrum market and cooperative caching are presented. Finally, future research issues about context awareness, grouping mechanism, and buying mechanism are discussed., Comment: 8 pages, 4 figures, accepted by IEEE Wireless Communications on 2018/06/12

For large unmanned aerial vehicle (UAV) networks, the timely communication is needed to accomplish a series of missions accurately and effectively. The relay technology will play an important role in UAV networks by helping drones communicating with long-distance drones, which solves the problem of the limited transmission power of drones. In this paper, the relay selection is seen as the entry point to improve the performance of self-organizing network with multiple optimizing factors. Different from the ground relay models, the relay selection in UAV communication networks presents new challenges, including heterogeneous, dynamic, dense and limited information characteristics. More effective schemes with distributed, fast, robust and scalable features are required to solve the optimizing problem. After discussing the challenges and requirements, we find that the matching game is suitable to model the complex relay model. The advantages of the matching game in self-organizing UAV communications are discussed. Moreover, we provide extensive applications of matching markets, and then propose a novel classification of matching game which focuses on the competitive relationship between players. Specifically, basic preliminary models are presented and some future research directions of matching game in UAV relay models are discussed., Comment: 8 pages, 5 figures, to appear in IEEE Wireless Communications

Drones, also known as mini-unmanned aerial vehicles, have attracted increasing attention due to their boundless applications in communications, photography, agriculture, surveillance and numerous public services. However, the deployment of amateur drones poses various safety, security and privacy threats. To cope with these challenges, amateur drone surveillance becomes a very important but largely unexplored topic. In this article, we firstly present a brief survey to show the state-of-the-art studies on amateur drone surveillance. Then, we propose a vision, named Dragnet, by tailoring the recent emerging cognitive internet of things framework for amateur drone surveillance. Next, we discuss the key enabling techniques for Dragnet in details, accompanied with the technical challenges and open issues. Furthermore, we provide an exemplary case study on the detection and classification of authorized and unauthorized amateur drones, where, for example, an important event is being held and only authorized drones are allowed to fly over.

This letter investigates the problem of anti-jamming communications in dynamic and unknown environment through on-line learning. Different from existing studies which need to know (estimate) the jamming patterns and parameters, we use the spectrum waterfall, i.e., the raw spectrum environment, directly. Firstly, to cope with the challenge of infinite state of raw spectrum information, a deep anti-jamming Q-network is constructed. Then, a deep anti-jamming reinforcement learning algorithm is proposed to obtain the optimal anti-jamming strategies. Finally, simulation results validate the the proposed approach. The proposed approach is relying only on the local observed information and does not need to estimate the jamming patterns and parameters, which implies that it can be widely used various anti-jamming scenarios., Comment: 4 pages, 7 figures, Contributing to a periodical