Search

This paper considers an adversarial scenario between a legitimate eavesdropper and a suspicious communication pair. All three nodes are equipped with multiple antennas. The eavesdropper, which operates in a full-duplex model, aims to wiretap the dubious communication pair via proactive jamming. On the other hand, the suspicious transmitter, which can send artificial noise (AN) to disturb the wiretap channel, aims to guarantee secrecy. More specifically, the eavesdropper adjusts jamming power to enhance the wiretap rate, while the suspicious transmitter jointly adapts the transmit power and noise power against the eavesdropping. Considering the partial observation and complicated interactions between the eavesdropper and the suspicious pair in unknown system dynamics, we model the problem as an imperfect-information stochastic game. To approach the Nash equilibrium solution of the eavesdropping game, we develop a multi-agent reinforcement learning (MARL) algorithm, termed neural fictitious self-play with soft actor-critic (NFSP-SAC), by combining the fictitious self-play (FSP) with a deep reinforcement learning algorithm, SAC. The introduction of SAC enables FSP to handle the problems with continuous and high dimension observation and action space. The simulation results demonstrate that the power allocation policies learned by our method empirically converge to a Nash equilibrium, while the compared reinforcement learning algorithms suffer from severe fluctuations during the learning process. [ABSTRACT FROM AUTHOR]

It is challenging to monitor suspicious links in massive multiple input multiple output-orthogonal frequency division multiplexing (MIMO-OFDM) systems with directional beamforming. When the monitor and suspicious user are not in the coverage of the same beam, to implement legitimate monitoring, we propose the proactive eavesdropping scheme in which the monitor acts as a spoofing relay to realize beam misleading and data eavesdropping. In the phase of beam sweep, the beam misleading algorithm induces the transmitter to choose the beam which is beneficial to the monitor by optimizing the relay precoding matrices. In the phase of data transmission, the data eavesdropping algorithm elevates the monitoring rate by optimizing the relay power split factors and power gain factors of all subcarriers. Due to the unknown channel state information between suspicious pairs, we propose to find the optimal precoders and power split factors by the multi-agent deep deterministic policy gradient (MADDPG) algorithm. The simulation results verify the effectiveness and superiority of the proposed eavesdropping scheme. [ABSTRACT FROM AUTHOR]