Search

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The collective goal of the agents is to communicate intermittently via a central server to find a policy that maximizes the average of long-term cumulative rewards across environments. The limited existing work on this topic either only provide asymptotic rates, or generate biased policies, or fail to establish any benefits of collaboration. In response, we propose Fast-FedPG - a novel federated policy gradient algorithm with a carefully designed bias-correction mechanism. Under a gradient-domination condition, we prove that our algorithm guarantees (i) fast linear convergence with exact gradients, and (ii) sub-linear rates that enjoy a linear speedup w.r.t. the number of agents with noisy, truncated policy gradients. Notably, in each case, the convergence is to a globally optimal policy with no heterogeneity-induced bias. In the absence of gradient-domination, we establish convergence to a first-order stationary point at a rate that continues to benefit from collaboration., Comment: Accepted to the Decision and Control Conference (CDC), 2024

Sensor-aided beamforming reduces the overheads associated with beam training in millimeter-wave (mmWave) multi-input-multi-output (MIMO) communication systems. Most prior work, though, neglects the challenges associated with establishing multi-user (MU) communication links in mmWave MIMO systems. In this paper, we propose a new framework for sensor-aided beam training in MU mmWave MIMO system. We leverage the beamspace representation of the channel that contains only the angles-of-departure (AoDs) of the channel's significant multipath components. We show that a deep neural network (DNN)-based multimodal sensor fusion framework can estimate the beamspace representation of the channel using sensor data. To aid the DNN training, we introduce a novel supervised soft-contrastive loss (SSCL) function that leverages the inherent similarity between channels to extract similar features from the sensor data for similar channels. Finally, we design an MU beamforming strategy that uses the estimated beamspaces of the channels to select analog precoders for all users in a way that prevents transmission to multiple users over the same directions. Compared to the baseline, our approach achieves more than 4$\times$ improvement in the median sum-spectral efficiency (SE) at 42 dBm equivalent isotropic radiated power (EIRP) with 4 active users. This demonstrates that sensor data can provide more channel information than previously explored, with significant implications for machine learning (ML)-based communication and sensing systems.

Codebook-based beam selection is one approach for configuring millimeter wave communication links. The overhead required to reconfigure the transmit and receive beam pair, though, increases in highly dynamic vehicular communication systems. Location information coupled with machine learning (ML) beam recommendation is one way to reduce the overhead of beam pair selection. In this paper, we develop ML-based location-aided approaches to decouple the beam selection between the user equipment (UE) and the base station (BS). We quantify the performance gaps due to decoupling beam selection and also disaggregating the UE's location information from the BS. Our simulation results show that decoupling beam selection with available location information at the BS performs comparable to joint beam pair selection at the BS. Moreover, decoupled beam selection without location closely approaches the performance of beam pair selection at the BS when sufficient beam pairs are swept., Comment: Submitted to IEEE BlackSeaCom 2024, 6 pages, 5 figures

Obtaining accurate and timely channel state information (CSI) is a fundamental challenge for large antenna systems. Mobile systems like 5G use a beam management framework that joins the initial access, beamforming, CSI acquisition, and data transmission. The design of codebooks for these stages, however, is challenging due to their interrelationships, varying array sizes, and site-specific channel and user distributions. Furthermore, beam management is often focused on single-sector operations while ignoring the overarching network- and system-level optimization. In this paper, we proposed an end-to-end learned codebook design algorithm, network beamspace learning (NBL), that captures and optimizes codebooks to mitigate interference while maximizing the achievable performance with extremely large hybrid arrays. The proposed algorithm requires limited shared information yet designs codebooks that outperform traditional codebooks by over 10dB in beam alignment and achieve more than 25% improvements in network spectral efficiency., Comment: To be submitted to IEEE Transactions on Wireless Communications

The use of one-bit analog-to-digital converter (ADC) has been considered as a viable alternative to high resolution counterparts in realizing and commercializing massive multiple-input multiple-output (MIMO) systems. However, the issue of discarding the amplitude information by one-bit quantizers has to be compensated. Thus, carefully tailored methods need to be developed for one-bit channel estimation and data detection as the conventional ones cannot be used. To address these issues, the problems of one-bit channel estimation and data detection for MIMO orthogonal frequency division multiplexing (OFDM) system that operates over uncorrelated frequency selective channels are investigated here. We first develop channel estimators that exploit Gaussian discriminant analysis (GDA) classifier and approximated versions of it as the so-called weak classifiers in an adaptive boosting (AdaBoost) approach. Particularly, the combination of the approximated GDA classifiers with AdaBoost offers the benefit of scalability with the linear order of computations, which is critical in massive MIMO-OFDM systems. We then take advantage of the same idea for proposing the data detectors. Numerical results validate the efficiency of the proposed channel estimators and data detectors compared to other methods. They show comparable/better performance to that of the state-of-the-art methods, but require dramatically lower computational complexities and run times.

Fluid antenna systems (FASs) can reconfigure their locations freely within a spatially continuous space. To keep favorable antenna positions, the channel state information (CSI) acquisition for FASs is essential. While some techniques have been proposed, most existing FAS channel estimators require several channel assumptions, such as slow variation and angular-domain sparsity. When these assumptions are not reasonable, the model mismatch may lead to unpredictable performance loss. In this paper, we propose the successive Bayesian reconstructor (S-BAR) as a general solution to estimate FAS channels. Unlike model-based estimators, the proposed S-BAR is prior-aided, which builds the experiential kernel for CSI acquisition. Inspired by Bayesian regression, the key idea of S-BAR is to model the FAS channels as a stochastic process, whose uncertainty can be successively eliminated by kernel-based sampling and regression. In this way, the predictive mean of the regressed stochastic process can be viewed as the maximum a posterior (MAP) estimator of FAS channels. Simulation results verify that, in both model-mismatched and model-matched cases, the proposed S-BAR can achieve higher estimation accuracy than the existing schemes., Comment: Accepted by IEEE WCNC 2024. This paper proposes S-BAR as a general solution to estimate FAS channels. More insights can be found in the journal version of this paper: arXiv:2312.06551. arXiv admin note: substantial text overlap with arXiv:2312.06551

The increasing demand for wireless data transfer has been the driving force behind the widespread adoption of Massive MIMO (multiple-input multiple-output) technology in 5G. The next-generation MIMO technology is now being developed to cater to the new data traffic and performance expectations generated by new user devices and services in the next decade. The evolution towards "ultra-massive MIMO (UM-MIMO)" is not only about adding more antennas but will also uncover new propagation and hardware phenomena that can only be treated by jointly utilizing insights from the communication, electromagnetic (EM), and circuit theory areas. This article offers a comprehensive overview of the key benefits of the UM-MIMO technology and the associated challenges. It explores massive multiplexing facilitated by radiative near-field effects, characterizes the spatial degrees-of-freedom, and practical channel estimation schemes tailored for massive arrays. Moreover, we provide a tutorial on EM theory and circuit theory, and how it is used to obtain physically consistent antenna and channel models. Subsequently, the article describes different ways to implement massive and dense antenna arrays, and how to co-design antennas with signal processing. The main open research challenges are identified at the end., Comment: Submitted to Proceedings of the IEEE, 36 pages, 23 figures

Fluid antenna systems (FASs) can reconfigure their antenna locations freely within a spatially continuous space. To keep favorable antenna positions, the channel state information (CSI) acquisition for FASs is essential. While some techniques have been proposed, most existing FAS channel estimators require several channel assumptions, such as slow variation and angular-domain sparsity. When these assumptions are not reasonable, the model mismatch may lead to unpredictable performance loss. In this paper, we propose the successive Bayesian reconstructor (S-BAR) as a general solution to estimate FAS channels. Unlike model-based estimators, the proposed S-BAR is prior-aided, which builds the experiential kernel for CSI acquisition. Inspired by Bayesian regression, the key idea of S-BAR is to model the FAS channels as a stochastic process, whose uncertainty can be successively eliminated by kernel-based sampling and regression. In this way, the predictive mean of the regressed stochastic process can be viewed as the maximum a posterior (MAP) estimator of FAS channels. Simulation results verify that, in both model-mismatched and model-matched cases, the proposed S-BAR can achieve higher estimation accuracy than the existing schemes., Comment: 13 pages, 8 figures. This paper proposes S-BAR as a general solution to estimate FAS channels. Unlike model-based estimators, the proposed S-BAR is prior-aided, which builds the experiential kernel for CSI acquisition. Simulation codes will be provided at: http://oa.ee.tsinghua.edu.cn/dailinglong/publications/publications.html

Beam management is a strategy to unify beamforming and channel state information (CSI) acquisition with large antenna arrays in 5G. Codebooks serve multiple uses in beam management including beamforming reference signals, CSI reporting, and analog beam training. In this paper, we propose and evaluate a machine learning-refined codebook design process for extremely large multiple-input multiple-output (X-MIMO) systems. We propose a neural network and beam selection strategy to design the initial access and refinement codebooks using end-to-end learning from beamspace representations. The algorithm, called Extreme-Beam Management (X-BM), can significantly improve the performance of extremely large arrays as envisioned for 6G and capture realistic wireless and physical layer aspects. Our results show an 8dB improvement in initial access and overall effective spectral efficiency improvements compared to traditional codebook methods., Comment: To be submitted to IEEE TMLCN

Antenna behaviors such as mutual coupling, near-field propagation, and polarization cannot be neglected in signal and channel models for wireless communication. We present an electromagnetic-based array manifold that accounts for several complicated behaviors and can model arbitrary antenna configurations. We quantize antennas into a large number of Hertzian dipoles to develop a model for the radiated array field. The resulting abstraction provides a means to predict the electric field for general non-homogeneous array geometries through a linear model that depends on the point source location, the position of each Hertzian dipole, and a set of coefficients obtained from electromagnetic simulation. We then leverage this model to formulate a beamforming gain optimization that can be adapted to account for polarization of the receive field as well as constraints on the radiated power density. Numerical results demonstrate that the proposed method achieves accuracy that is close to that of electromagnetic simulations. By leveraging the developed array manifold for beamforming, systems can achieve higher beamforming gains compared to beamforming with less accurate models.

Impedance-matching networks affect power transfer from the radio frequency (RF) chains to the antennas. Their design impacts the signal to noise ratio (SNR) and the achievable rate. In this paper, we maximize the information-theoretic achievable rate of a multiple-input-single-output (MISO) system with wideband matching constraints. Using a multiport circuit theory approach with frequency-selective scattering parameters, we propose a general framework for optimizing the MISO achievable rate that incorporates Bode-Fano wideband matching theory. We express the solution to the achievable rate optimization problem in terms of the optimized transmission coefficient and the Lagrangian parameters corresponding to the Bode-Fano inequality constraints. We apply this framework to a single electric Chu's antenna and an array of two electric Chu's antennas. We compare the optimized achievable rate obtained numerically with other benchmarks like the ideal achievable rate computed by disregarding matching constraints and the achievable rate obtained by using sub-optimal matching strategies like conjugate matching and frequency-flat transmission. We also propose a practical methodology to approximate the achievable rate bound by using the optimal transmission coefficient to derive a physically realizable matching network through the ADS software.

With increasing frequencies, bandwidths, and array apertures, the phenomenon of beam squint arises as a serious impairment to beamforming. Fully digital arrays with true time delay per antenna element are a potential solution, but they require downconversion at each element. This paper shows that hybrid arrays can perform essentially as well as digital arrays once the number of radio-frequency chains exceeds a certain threshold that is far below the number of elements. The result is robust, holding also for suboptimum but highly appealing beamspace architectures.

Multi-band operation in wireless networks can improve data rates by leveraging the benefits of propagation in different frequency ranges. Distinctive beam management procedures in different bands complicate band assignment because they require considering not only the channel quality but also the associated beam management overhead. Reinforcement learning (RL) is a promising approach for multi-band operation as it enables the system to learn and adjust its behavior through environmental feedback. In this paper, we formulate a sequential decision problem to jointly perform band assignment and beam management. We propose a method based on hierarchical RL (HRL) to handle the complexity of the problem by separating the policies for band selection and beam management. We evaluate the proposed HRL-based algorithm on a realistic channel generated based on ray-tracing simulators. Our results show that the proposed approach outperforms traditional RL approaches in terms of reduced beam training overhead and increased data rates under a realistic vehicular channel.

In this paper, we propose a novel architecture for a lens antenna array (LAA) designed to work with a small number of antennas and enable angle-of-arrival (AoA) estimation for advanced 5G vehicle-to-everything (V2X) use cases that demand wider bandwidths and higher data rates. We derive a received signal in terms of optical analysis to consider the variability of the focal region for different carrier frequencies in a wideband multi-carrier system. By taking full advantage of the beam squint effect for multiple pilot signals with different frequencies, we propose a novel reconfiguration of antenna array (RAA) for the sparse LAA and a max-energy antenna selection (MS) algorithm for the AoA estimation. In addition, this paper presents an analysis of the received power at the single antenna with the maximum energy and compares it to simulation results. In contrast to previous studies on LAA that assumed a large number of antennas, which can require high complexity and hardware costs, the proposed RAA with MS estimation algorithm is shown meets the requirements of 5G V2X in a vehicular environment while utilizing limited RF hardware and has low complexity., Comment: 15 pages, 10 figures

Dynamic metasurface antennas (DMA) provide a solution to form compact, cost-effective, energy-efficient multiple-input-multiple output (MIMO) arrays. In this paper, we implement a practical hierarchical codebook with a realistic DMA design through electromagnetic simulations. We leverage existing DMA models to derive a novel method for enhancing the beamforming gain. We find that the proposed method provides better coverage and spectral efficiency results than prior methods. We also present and verify a new technique for creating wide beamwidths through the DMA and hierarchical codebook. Additionally, we use a detailed transmitter architecture model to determine the power consumption savings of the DMA compared to a typical phased array. The DMA largely outperforms a passive phased array in terms of spectral and energy efficiency due to high component loss from a high-resolution passive phase shifter. While the DMA provides lower spectral efficiency results than the active phased array, the DMA achieves a higher energy efficiency because of the significant power consumption for the active phase shifters. Therefore, we find that DMAs in a realistic wireless environment provide sufficient coverage and spectral efficiency compared to typical phased arrays while maintaining a substantially lower power consumption., Comment: 30 pages, 8 figures (not including subfigures)

We propose an adaptive coding approach to achieve linear-quadratic-Gaussian (LQG) control with near-minimum bitrate prefix-free feedback. Our approach combines a recent analysis of a quantizer design for minimum rate LQG control with work on universal lossless source coding for sources on countable alphabets. In the aforementioned quantizer design, it was established that the quantizer outputs are an asymptotically stationary, ergodic process. To enable LQG control with provably near-minimum bitrate, the quantizer outputs must be encoded into binary codewords efficiently. This is possible given knowledge of the probability distributions of the quantizer outputs, or of their limiting distribution. Obtaining such knowledge is challenging; the distributions do not readily admit closed form descriptions. This motivates the application of universal source coding. Our main theoretical contribution in this work is a proof that (after an invertible transformation), the quantizer outputs are random variables that fall within an exponential or power-law envelope class (depending on the plant dimension). Using ideas from universal coding on envelope classes, we develop a practical, zero-delay version of these algorithms that operates with fixed precision arithmetic. We evaluate the performance of this algorithm numerically, and demonstrate competitive results with respect to fundamental tradeoffs between bitrate and LQG control performance., Comment: 8 pages 5 figures, under submission to the 2023 IEEE Conference on Decision and Control

Beam codebooks are a recent feature to enable high dimension multiple-input multiple-output in 5G. Codebooks comprised of customizable beamforming weights can be used to transmit reference signals and aid the channel state information (CSI) acquisition process. Codebooks are also used for quantizing feedback following CSI acquisition. In this paper, we characterize the role of each codebook used during the beam management process and design a neural network to find codebooks that improve overall system performance. Evaluating a codebook requires considering the system-level dependency between the codebooks, feedback, overhead, and spectral efficiency. The proposed neural network is built on translating codebook and feedback knowledge into a consistent beamspace basis similar to a virtual channel model to generate initial access codebooks. This beamspace codebook algorithm is designed to directly integrate with current 5G beam management standards without changing the feedback format or requiring additional side information. Our simulations show that the neural network codebooks improve over traditional codebooks, even in dispersive sub-6GHz environments. We further use our framework to evaluate CSI feedback formats with regard to multi-user spectral efficiency. Our results suggest that optimizing codebook performance can provide valuable performance improvements, but optimizing the feedback configuration is also important in sub-6GHz bands., Comment: In submission to IEEE Transactions on Wireless Communications

Massive multiple-input multiple-output (MIMO) is an important technology in fifth generation (5G) cellular networks and beyond. To help design the beamforming at the base station, 5G has introduced new support in the form of flexible feedback and configurable antenna array geometries. In this article, we present an overview of MIMO throughout the mobile standards, highlight the new beam-based feedback system in 5G NR, and describe how this feedback system enables massive MIMO through beam management. Finally, we conclude with challenges related to massive MIMO in 5G., Comment: In preparation for submission to IEEE Communications Magazine

Cooperative relays improve reliability and coverage in wireless networks by providing multiple paths for data transmission. Relaying will play an essential role in vehicular networks at higher frequency bands, where mobility and frequent signal blockages cause link outages. To ensure connectivity in a relay-aided vehicular network, the relay selection policy should be designed to efficiently find unblocked relays. Inspired by recent advances in beam management in mobile millimeter wave (mmWave) networks, this paper address the question: how can the best relay be selected with minimal overhead from beam management? In this regard, we formulate a sequential decision problem to jointly optimize relay selection and beam management. We propose a joint relay selection and beam management policy based on deep reinforcement learning (DRL) using the Markov property of beam indices and beam measurements. The proposed DRL-based algorithm learns time-varying thresholds that adapt to the dynamic channel conditions and traffic patterns. Numerical experiments demonstrate that the proposed algorithm outperforms baselines without prior channel knowledge. Moreover, the DRL-based algorithm can maintain high spectral efficiency under fast-varying channels.

Beamforming is a signal processing technique to steer, shape, and focus an electromagnetic wave using an array of sensors toward a desired direction. It has been used in several engineering applications such as radar, sonar, acoustics, astronomy, seismology, medical imaging, and communications. With the advances in multi-antenna technologies largely for radar and communications, there has been a great interest on beamformer design mostly relying on convex/nonconvex optimization. Recently, machine learning is being leveraged for obtaining attractive solutions to more complex beamforming problems. This article captures the evolution of beamforming in the last twenty-five years from convex-to-nonconvex optimization and optimization-to-learning approaches. It provides a glimpse of this important signal processing technique into a variety of transmit-receive architectures, propagation zones, paths, and conventional/emerging applications., Comment: Accepted Paper in IEEE Signal Processing Magazine Special Issue on the 75th Anniversary of IEEE Signal Processing Society

From an information theoretic perspective, joint communication and sensing (JCAS) represents a natural generalization of communication network functionality. However, it requires the re-evaluation of network performance from a multi-objective perspective. We develop a novel mathematical framework for characterizing the sensing and communication coverage probability and ergodic rate in JCAS networks. We employ a formulation of sensing parameter estimation based on mutual information to extend the notions of coverage probability and ergodic rate to the radar setting. We define sensing coverage probability as the probability that the rate of information extracted about the parameters of interest associated with a typical radar target exceeds some threshold, and sensing ergodic rate as the spatial average of the aforementioned rate of information. Using this framework, we analyze the downlink sensing and communication coverage and rate of a mmWave JCAS network employing a shared waveform, directional beamforming, and monostatic sensing. Leveraging tools from stochastic geometry, we derive upper and lower bounds for these quantities. We also develop several general technical results including: i) a generic method for obtaining closed form upper and lower bounds on the Laplace Transform of a shot noise process, ii) a new analog of H{\"o}lder's Inequality to the setting of harmonic means, and iii) a relation between the Laplace and Mellin Transforms of a non-negative random variable. We use the derived bounds to numerically investigate the performance of JCAS networks under varying base station and blockage density. Among several insights, our numerical analysis indicates that network densification improves sensing SINR performance -- in contrast to communications., Comment: 87 pages, 5 figures. Published in IEEE Transactions on Information Theory

Joint communications and sensing (JCAS) is potentially a hallmark technology for the sixth generation mobile network (6G). Most existing JCAS designs are based on digital arrays, analog arrays with tunable phase shifters, or hybrid arrays, which are effective but are generally complicated to design and power inefficient. This article introduces the energy-efficient and easy-to-design multi-beam antenna arrays (MBAAs) for JCAS. Using pre-designed and fixed analog devices, such as lens or Butler matrix, MBAA can simultaneously steer multiple beams yet with negligible power consumption compared with other techniques. Moreover, MBAAs enable flexible beam synthesis, accurate angle-of-arrival estimation, and easy handling/utilization of the beam squint effect. All these features have not been well captured by the JACS community yet. To promote the awareness of them, we intuitively illustrate them and also exploit them for constructing a multi-beam JCAS framework. Finally, the challenges and opportunities are discussed to foster the development of green JCAS systems., Comment: to appear in IEEE Communications Magazine; 7 pages, 5 figures, 1 table

Since most of vehicular radar systems are already exploiting millimeter-wave (mmWave) spectra, it would become much more feasible to implement a joint radar and communication system by extending communication frequencies into the mmWave band. In this paper, an IEEE 802.11ad waveform-based radar imaging technique is proposed for vehicular settings. A roadside unit (RSU) transmits the IEEE 802.11ad waveform to a vehicle for communications while the RSU also listens to the echoes of transmitted waveform to perform inverse synthetic aperture radar (ISAR) imaging. To obtain high-resolution images of the vehicle, the RSU needs to accurately estimate round-trip delays, Doppler shifts, and velocity of vehicle. The proposed ISAR imaging first estimates the round-trip delays using a good correlation property of Golay complementary sequences in the IEEE 802.11ad preamble. The Doppler shifts are then obtained using least square estimation from the echo signals and refined to compensate phase wrapping caused by phase rotation. The velocity of vehicle is determined using an equation of motion and the estimated Doppler shifts. Simulation results verify that the proposed technique is able to form high-resolution ISAR images from point scatterer models of realistic vehicular settings with different viewpoints. The proposed ISAR imaging technique can be used for various vehicular applications, e.g., traffic condition analyses or advanced collision warning systems.

High-resolution fully digital transceivers are infeasible at millimeter-wave (mmWave) due to their increased power consumption, cost, and hardware complexity. The use of low-resolution converters is one possible solution to realize fully digital architectures at mmWave. In this paper, we consider a setting in which a fully digital base station with constant envelope quantized (CEQ) digital-to-analog converters on each radio frequency chain communicates with multiple single antenna users with individual signal-to-quantization-plus-interference-plus-noise ratio (SQINR) constraints over frequency selective channels. We first establish uplink downlink duality for the system with CEQ hardware constraints and OFDM-based transmission considered in this paper. Based on the uplink downlink duality principle, we present a solution to the multi-user multi-carrier beamforming and power allocation problem that maximizes the minimum SQINR over all users and sub-carriers. We then present a per sub-carrier version of the originally proposed solution that decouples all sub-carriers of the OFDM waveform resulting in smaller sub-problems that can be solved in a parallel manner. Our numerical results based on 3GPP channel models generated from Quadriga demonstrate improvements in terms of ergodic sum rate and ergodic minimum rate over state-of-the-art linear solutions. We also show improved performance over non-linear solutions in terms of the coded bit error rate with the increased flexibility of assigning individual user SQINRs built into the proposed framework., Comment: arXiv admin note: text overlap with arXiv:2206.14427

In this work we consider discrete-time multiple-input multiple-output (MIMO) linear-quadratic-Gaussian (LQG) control where the feedback consists of variable length binary codewords. To simplify the decoder architecture, we enforce a strict prefix constraint on the codewords. We develop a data compression architecture that provably achieves a near minimum time-average expected bitrate for a fixed constraint on the LQG performance. The architecture conforms to the strict prefix constraint and does not require time-varying lossless source coding, in contrast to the prior art., Comment: 7 pages, 2 figures, accepted to the 2022 IEEE Mediterranean Conference on Communications and Networking (MeditCom 2022)

In this paper, we develop algorithms for joint user scheduling and three types of mmWave link configuration: relay selection, codebook optimization, and beam tracking in millimeter wave (mmWave) networks. Our goal is to design an online controller that dynamically schedules users and configures their links to minimize the system delay. To solve this complex scheduling problem, we model it as a dynamic decision-making process and develop two reinforcement learning-based solutions. The first solution is based on deep reinforcement learning (DRL), which leverages the proximal policy optimization to train a neural network-based solution. Due to the potential high sample complexity of DRL, we also propose an empirical multi-armed bandit (MAB)-based solution, which decomposes the decision-making process into a sequential of sub-actions and exploits classic maxweight scheduling and Thompson sampling to decide those sub-actions. Our evaluation of the proposed solutions confirms their effectiveness in providing acceptable system delay. It also shows that the DRL-based solution has better delay performance while the MAB-based solution has a faster training process., Comment: 17 pages, 10 Figures

The increased power consumption of high-resolution data converters at higher carrier frequencies and larger bandwidths is becoming a bottleneck for communication systems. In this paper, we consider a fully digital base station equipped with 1-bit analog-to-digital (in uplink) and digital-to-analog (in downlink) converters on each radio frequency chain. The base station communicates with multiple single antenna users with individual SINR constraints. We first establish the uplink downlink duality principle under 1-bit hardware constraints under an uncorrelated quantization noise assumption. We then present a linear solution to the multi-user downlink beamforming problem based on the uplink downlink duality principle. The proposed solution takes into account the hardware constraints and jointly optimizes the downlink beamformers and the power allocated to each user. Optimized dithering obtained by adding dummy users to the true system users ensures that the uncorrelated quantization noise assumption is true under realistic settings. Detailed simulations carried out using 3GPP channel models generated from Quadriga show that our proposed solution outperforms state of the art solutions in terms of the ergodic sum and minimum rate especially when the number of users is large. We also demonstrate that the proposed solution significantly reduces the performance gap from non-linear solutions in terms of the uncoded bit error rate at a fraction of the computational complexity., Comment: Under second review round in IEEE TVT

The narrowband and far-field assumption in conventional wireless system design leads to a mismatch with the optimal beamforming required for wideband and near-field systems. This discrepancy is exacerbated for larger apertures and bandwidths. To characterize the behavior of near-field and wideband systems, we derive the beamforming gain expression achieved by a frequency-flat phased array designed for plane-wave propagation. To determine the far-field to near-field boundary for a wideband system, we propose a frequency-selective distance metric. The proposed far-field threshold increases for frequencies away from the center frequency. The analysis results in a fundamental upper bound on the product of the array aperture and the system bandwidth. We present numerical results to illustrate how the gain threshold affects the maximum usable bandwidth for the n260 and n261 5G NR bands.

Millimeter wave (MmWave) systems are vulnerable to blockages, which cause signal drop and link outage. One solution is to deploy reconfigurable intelligent surfaces (RISs) to add a strong non-line-of-sight path from the transmitter to receiver. To achieve the best performance, the location of the deployed RIS should be optimized for a given site, considering the distribution of potential users and possible blockers. In this paper, we find the optimal location, height and downtilt of RIS working in a realistic vehicular scenario. Because of the proximity between the RIS and the vehicles, and the large electrical size of the RIS, we consider a 3D geometry including the elevation angle and near-field beamforming. We provide results on RIS configuration in terms of both coverage ratio and area-averaged rate. We find that the optimized RIS improves the average averaged rate fifty percent over the case without a RIS, as well as further improvements in the coverage ratio., Comment: 6 pages, 5 figures, submitted to Globecom 2022

Beam codebooks are a new feature of massive multiple-input multiple-output (M-MIMO) in 5G new radio (NR). Codebooks comprised of beamforming vectors are used to transmit reference signals and obtain limited channel state information (CSI) from receivers via the codeword index. This enables large arrays that cannot otherwise obtain sufficient CSI. The performance, however, is limited by the codebook design. In this paper, we show that machine learning can be used to train site-specific codebooks for initial access. We design a neural network based on an autoencoder architecture that uses a beamspace observation in combination with RF environment characteristics to improve the synchronization signal (SS) burst codebook. We test our algorithm using a flexible dataset of channels generated from QuaDRiGa. The results show that our model outperforms the industry standard (DFT beams) and approaches the optimal performance (perfect CSI and singular value decomposition (SVD)-based beamforming), using only a few bits of feedback., Comment: Accepted at IEEE VTC 2022

Motivated by control with communication constraints, in this work we develop a time-invariant data compression architecture for linear-quadratic-Gaussian (LQG) control with minimum bitrate prefix-free feedback. For any fixed control performance, the approach we propose nearly achieves known directed information (DI) lower bounds on the time-average expected codeword length. We refine the analysis of a classical achievability approach, which required quantized plant measurements to be encoded via a time-varying lossless source code. We prove that the sequence of random variables describing the quantizations has a limiting distribution and that the quantizations may be encoded with a fixed source code optimized for this distribution without added time-asymptotic redundancy. Our result follows from analyzing the long-term stochastic behavior of the system, and permits us to additionally guarantee that the time-average codeword length (as opposed to expected length) is almost surely within a few bits of the minimum DI. To our knowledge, this time-invariant achievability result is the first in the literature. The originally published version of the supplementary material included a proof that contained an error that turned out to be inconsequential. This updated preprint corrects this error, which originally appeared under Lemma A.7., Comment: Version as accepted to the IEEE Journal on Selected Areas in Information Theory (Special Issue on Modern Compression), modulo an additional correction to the proof of Lemma A.7. Official version: https://ieeexplore.ieee.org/document/10002900. 14 page main paper, 4 pages appendix, 3 figures

Clock asynchronism is a critical issue in integrating radar sensing into communication networks. It can cause ranging ambiguity and prevent coherent processing of dis-continuous measurements in integration with asynchronous transceivers. Should it be resolved, sensing can be efficiently realized in communication networks, requiring little network infrastructure and hardware changes. This article provides a systematic overview of existing and potential new techniques for tackling this fundamental problem. We first review existing solutions, including using a fine-tuned global reference clock, and single-node-based and network-based techniques. We then examine open problems and research opportunities, offering insights into what may be better realized in each of the three solution areas., Comment: 7, 3 figures, 3 tables

In this letter, we consider a Linear Quadratic Gaussian (LQG) control system where feedback occurs over a noiseless binary channel and derive lower bounds on the minimum communication cost (quantified via the channel bitrate) required to attain a given control performance. We assume that at every time step an encoder can convey a packet containing a variable number of bits over the channel to a decoder at the controller. Our system model provides for the possibility that the encoder and decoder have shared randomness, as is the case in systems using dithered quantizers. We define two extremal prefix-free requirements that may be imposed on the message packets; such constraints are useful in that they allow the decoder, and potentially other agents to uniquely identify the end of a transmission in an online fashion. We then derive a lower bound on the rate of prefix-free coding in terms of directed information; in particular we show that a previously known bound still holds in the case with shared randomness. We generalize the bound for when prefix constraints are relaxed, and conclude with a rate-distortion formulation., Comment: To appear in the IEEE Control Systems Letters. Version as finally accepted. Copyright 2022 IEEE

Establishing and maintaining millimeter-wave (mmWave) links is challenging due to the changing environment and the high sensibility of mmWave signal to user mobility and channel conditions. MmWave link configuration problems often involve a search for optimal system parameter under environmental uncertainties, from a finite set of alternatives that are supported by the system hardware and protocol. For example, beam sweeping aims at identifying the optimal beam(s) for data transmission from a discrete codebook. Selecting parameters such as the beam sweeping period and the beamwidth are crucial to achieving high overall system throughput. In this article, we motivate the use of the multi-armed bandit (MAB) framework to intelligently search out the optimal configuration when establishing the mmWave links. MAB is a reinforcement learning framework that guides a decision-maker to sequentially select one action from a set of actions. As an example, we show that within the MAB framework, the optimal beam sweeping period, beamwidth, and beam directions could be dynamically learned with sample-computational-efficient bandit algorithms. We conclude by highlighting some future research directions on enhancing mmWave link configuration design with MAB.

Today, various machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of a wireless network. Distributed real-time ML solutions are highly sensitive to the so-called straggler effect caused by resource heterogeneity and alleviated by various computation offloading mechanisms that seriously challenge the communication efficiency, especially in large-scale scenarios. To decrease the communication overhead, we rely on device-to-device (D2D) connectivity that improves spectrum utilization and allows efficient data exchange between devices in proximity. In particular, we design a novel D2D-aided coded federated learning method (D2D-CFL) for efficient load balancing across devices. The proposed solution captures system dynamics, including data (time-dependent learning model, varied intensity of data arrivals), device (diverse computational resources and volume of training data), and deployment (varied locations and D2D graph connectivity). To minimize the number of communication rounds, we derive an optimal compression rate for achieving minimum processing time and establish its connection with the convergence time. The resulting optimization problem provides suboptimal compression parameters, which improve the total training time. Our proposed method is beneficial for real-time collaborative applications, where the users continuously generate training data resulting in the model drift., Comment: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

An urban tactical wireless network is considered wherein the base stations are situated on unmanned aerial vehicles (UAVs) that provide connectivity to ground assets such as vehicles located on city streets. The UAVs are assumed to be randomly deployed at a fixed height according to a two-dimensional point process. Millimeter-wave (mmWave) frequencies are used to avail of large available bandwidths and spatial isolation due to beamforming. In urban environments, mmWave signals are prone to blocking of the line-of-sight (LoS) by buildings. While reflections are possible, the desire for consistent connectivity places a strong preference on the existence of an unblocked LoS path. As such, the key performance metric considered in this paper is the connectivity probability, which is the probability of an unblocked LoS path to at least one UAV within some maximum transmission distance. By leveraging tools from stochastic geometry, the connectivity probability is characterized as a function of the city type (e.g., urban, dense urban, suburban), density of UAVs (average number of UAVs per square km), and height of the UAVs. The city streets are modeled as a Manhattan Poisson Line Process (MPLP) and the building heights are randomly distributed. The analysis first finds the connectivity probability conditioned on a particular network realization (location of the UAVs) and then removes the conditioning to uncover the distribution of the connectivity; i.e., the fraction of network realizations that will fail to meet an outage threshold. While related work has applied an MPLP to networks with a single UAV, the contributions of this paper are that it (1) considers networks of multiple UAVs, (2) characterizes the performance by a connectivity distribution, and (3) identifies the optimal altitude for the UAVs.

Millimeter wave (mmWave) technology can achieve high-speed communication due to the large available spectrum. Furthermore, the use of directional beams in mmWave system provides a natural defense against physical layer security attacks. In practice, however, the beams are imperfect due to mmWave hardware limitations such as the low-resolution of the phase shifters. These imperfections in the beam pattern introduce an energy leakage that can be exploited by an eavesdropper. To defend against such eavesdropping attacks, we propose a directional modulation-based defense technique where the transmitter applies random circulant shifts of a beamformer. We show that the use of random circulant shifts together with appropriate phase adjustment induces artificial phase noise (APN) in the directions different from that of the target receiver. Our method corrupts the phase at the eavesdropper without affecting the communication link of the target receiver. We also experimentally verify the APN induced due to circulant shifts, using channel measurements from a 2-bit mmWave phased array testbed. Using simulations, we study the performance of the proposed defense technique against a greedy eavesdropping strategy in a vehicle-to-infrastructure scenario. The proposed technique achieves better defense than the antenna subset modulation, without compromising on the communication link with the target receiver.

The detection and estimation of sinusoids is a fundamental signal processing task for many applications related to sensing and communications. While algorithms have been proposed for this setting, quantization is a critical, but often ignored modeling effect. In wireless communications, estimation with low resolution data converters is relevant for reduced power consumption in wideband receivers. Similarly, low resolution sampling in imaging and spectrum sensing allows for efficient data collection. In this work, we propose SignalNet, a neural network architecture that detects the number of sinusoids and estimates their parameters from quantized in-phase and quadrature samples. We incorporate signal reconstruction internally as domain knowledge within the network to enhance learning and surpass traditional algorithms in mean squared error and Chamfer error. We introduce a worst-case learning threshold for comparing the results of our network relative to the underlying data distributions. This threshold provides insight into why neural networks tend to outperform traditional methods and into the learned relationships between the input and output distributions. In simulation, we find that our algorithm is always able to surpass the threshold for three-bit data but often cannot exceed the threshold for one-bit data. We use the learning threshold to explain, in the one-bit case, how our estimators learn to minimize the distributional loss, rather than learn features from the data., Comment: Submitted to IEEE Transactions on Signal Processing

The increasing complexity of configuring cellular networks suggests that machine learning (ML) can effectively improve 5G technologies. Deep learning has proven successful in ML tasks such as speech processing and computational vision, with a performance that scales with the amount of available data. The lack of large datasets inhibits the flourish of deep learning applications in wireless communications. This paper presents a methodology that combines a vehicle traffic simulator with a raytracing simulator, to generate channel realizations representing 5G scenarios with mobility of both transceivers and objects. The paper then describes a specific dataset for investigating beams-election techniques on vehicle-to-infrastructure using millimeter waves. Experiments using deep learning in classification, regression and reinforcement learning problems illustrate the use of datasets generated with the proposed methodology

Millimeter wave vehicular channels exhibit structure that can be exploited for beam alignment with fewer channel measurements compared to exhaustive beam search. With fixed layouts of roadside buildings and regular vehicular moving trajectory, the dominant path directions of channels will likely be among a subset of beam directions instead of distributing randomly over the whole beamspace. In this paper, we propose a deep learning-based technique to design a structured compressed sensing (CS) matrix that is well suited to the underlying channel distribution for mmWave vehicular beam alignment. The proposed approach leverages both sparsity and the particular spatial structure that appears in vehicular channels. We model the compressive channel acquisition by a two-dimensional (2D) convolutional layer followed by dropout. We design fully-connected layers to optimize channel acquisition and beam alignment. We incorporate the low-resolution phase shifter constraint during neural network training by using projected gradient descent for weight updates. Furthermore, we exploit channel spectral structure to optimize the power allocated for different subcarriers. Simulations indicate that our deep learning-based approach achieves better beam alignment than standard CS techniques which use random phase shift-based design. Numerical experiments also show that one single subcarrier is sufficient to provide necessary information for beam alignment., Comment: Submitted to the IEEE Transactions on Wireless Communications. Copyright may be transferred without notice, after which this version may no longer be accessible

Joint communication and radar sensing (JCR) represents an emerging research field aiming to integrate the above two functionalities into a single system, sharing a majority of hardware and signal processing modules and, in a typical case, sharing a single transmitted signal. It is recognised as a key approach in significantly improving spectrum efficiency, reducing device size, cost and power consumption, and improving performance thanks to potential close cooperation of the two functions. Advanced signal processing techniques are critical for making the integration efficient, from transmission signal design to receiver processing. This paper provides a comprehensive overview of JCR systems from the signal processing perspective, with a focus on state-of-the-art. A balanced coverage on both transmitter and receiver is provided for three types of JCR systems, communication-centric, radar-centric, and joint design and optimization., Comment: 18 pages, 3 figures, journal

We consider wireless communication systems with compact planar arrays having densely spaced antenna elements in conjunction with one-bit analog-to-digital and digital-to-analog converters (ADCs/DACs). We provide closed-form expressions for the achievable rates with simple linear processing techniques for the uplink as well as the downlink scenarios while taking into account the effects of antenna mutual coupling. In the downlink case, we introduce the concept of non-radiating dithering to combat correlations of the quantization errors. Under higher antenna element density, we show that the performance of the quantized system can be made close to the ideal performance regardless of the operating signal-to-noise ratio., Comment: 9 pages

Nonlinear precoding and pulse shaping are jointly considered in multi-user massive multiple-input multiple-output (MIMO) systems with low-resolution D/A-converters (DACs) in terms of algorithmic approach as well as large system performance. Two design criteria are investigated: the mean {squared} error (MSE) with active constellation extension (ACE) and the symbol error rate (SER). Both formulations are solved based on a modified version of the generalized approximate message passing (GAMP) algorithm. Furthermore, theoretical performance results are derived based on the state evolution analysis of the GAMP algorithm. The MSE based technique is extended to jointly perform over-the-air (OTA) spectral shaping and precoding for frequency-selective channels, in which the spectral performance is characterized at the transmitter and at the receiver. Simulation and analytical results demonstrate that the MSE based approach yields the same performance as the SER based formulation in terms of uncoded SER. The analytical results provide good performance predictions up to medium SNR. Substantial improvements in detection, as well as spectral performance, are obtained from the proposed combined pulse shaping and precoding approach compared to standard linear methods., Comment: 30 pages, 14 figures, submitted to IEEE Transactions on Wireless Communications

Frequency-hopping (FH) MIMO radar-based dual-function radar communication (FH-MIMO DFRC) enables communication symbol rate to exceed radar pulse repetition frequency, which requires accurate estimations of timing offset and channel parameters. The estimations, however, are challenging due to unknown, fast-changing hopping frequencies and the multiplicative coupling between timing offset and channel parameters. In this paper, we develop accurate methods for a single-antenna communication receiver to estimate timing offset and channel for FH-MIMO DFRC. First, we design a novel FH-MIMO radar waveform, which enables a communication receiver to estimate the hopping frequency sequence (HFS) used by radar, instead of acquiring it from radar. Importantly, the novel waveform incurs no degradation to radar ranging performance. Then, via capturing distinct HFS features, we develop two estimators for timing offset and derive mean squared error lower bound of each estimator. Using the bounds, we design an HFS that renders both estimators applicable. Furthermore, we develop an accurate channel estimation method, reusing the single hop for timing offset estimation. Validated by simulations, the accurate channel estimates attained by the proposed methods enable the communication performance of DFRC to approach that achieved based on perfect timing and ideal knowledge of channel., Comment: 14 pages, 10 figures, submitted to IEEE journal

Millimeter-wave (mmWave) joint communication-radar (JCR) will enable high data rate communication and high-resolution radar sensing for applications such as autonomous driving. Prior JCR systems that are based on the mmWave communications hardware, however, suffer from a limited angular field-of-view and low estimation accuracy for radars due to the employed directional communication beam. In this paper, we propose an adaptive and fast combined waveform-beamforming design for the mmWave automotive JCR with a phased-array architecture that permits a trade-off between communication and radar performances. To rapidly estimate the mmWave automotive radar channel in the Doppler-angle domain with a wide field-of-view, our JCR design employs a few circulant shifts of the transmit beamformer and apply two-dimensional partial Fourier compressed sensing technique. We optimize these circulant shifts to achieve minimum coherence in compressed sensing. We evaluate the JCR performance trade-offs using a normalized mean square error (MSE) metric for radar estimation and a distortion MSE metric for data communication, which is analogous to the distortion metric in the rate distortion theory. Additionally, we develop a MSE-based weighted average optimization problem for the adaptive JCR combined waveform-beamforming design. Numerical results demonstrate that our proposed JCR design enables the estimation of short- and medium-range radar channels in the Doppler-angle domain with a low normalized MSE, at the expense of a small degradation in the communication distortion MSE., Comment: Submitted to the IEEE Journal on Selected Topics in Signal Processing. Copyright may be transferred without notice, after which this version may no longer be accessible

On-demand deployments of millimeter-wave (mmWave) access points (APs) carried by unmanned aerial vehicles (UAVs) are considered today as a potential solution to enhance the performance of 5G+ networks. The battery lifetime of modern UAVs, though, limits the flight times in such systems. In this letter, we evaluate a feasible deployment alternative for temporary capacity boost in the areas with highly fluctuating user demands. The approach is to land UAV-based mmWave APs on the nearby buildings instead of hovering over the area. Within the developed mathematical framework, we compare the system-level performance of airborne and landed deployments by taking into account the full operation cycle of the employed drones. Our numerical results demonstrate that the choice of the UAV deployment option is determined by an interplay of the separation distance between the service area and the UAV charging station, drone battery lifetime, and the number of aerial APs in use. The presented methodology and results can support efficient on-demand deployments of UAV-based mmWave APs in prospective 5G+ networks., Comment: Accepted to IEEE Wireless Communications Letters on July 20, 2020. Copyright may be transferred without further notice after which this version may become non-available

A fully-digital wideband joint communication-radar (JCR) with a multiple-input-multiple-output (MIMO) architecture at the millimeter-wave (mmWave) band will enable high joint communication and radar performance with enhanced design flexibility. A quantized receiver with few-bit analog-to-digital converters (ADCs) will enable a practical JCR solution with reduced power consumption for futuristic portable devices and autonomous vehicles. In this paper, we present a joint communication-radar proof-of-concept platform, named JCR70, to evaluate and demonstrate the performance of these JCR systems using real channel measurements in the 71-76 GHz band. We develop this platform by extending a mmWave communication set-up with an additional full-duplex radar receiver and by capturing the MIMO JCR channel using a moving antenna on a sliding rail. To characterize the JCR performance of our developed tested, we conduct several indoor and outdoor experiments and apply traditional as well as advanced processing algorithms on the measured data. Additionally, we compare the performance of our JCR70 platform with the INRAS Radarbook, which is a state-of-the-art automotive radar evaluation platform at 77 GHz. The results demonstrate that a quantized receiver with 2-4 bit ADCs generally performed quite close to the high-resolution ADC for a signal-to-noise ratio of up to 5 dB. Our JCR70 platform with a fully digital JCR waveform at 73 GHz and 2 GHz bandwidth achieved higher resolution capability than the Radarbook due to higher bandwidth and larger synthesized antenna aperture., Comment: 14 pages

Phased arrays, commonly used in IEEE 802.11ad and 5G radios, are capable of focusing radio frequency signals in a specific direction or a spatial region. Beamforming achieves such directional or spatial concentration of signals and enables phased array-based radios to achieve high data rates. Designing beams for millimeter wave and terahertz communication using massive phased arrays, however, is challenging due to hardware constraints and the wide bandwidth in these systems. For example, beams which are optimal at the center frequency may perform poor in wideband communication systems where the radio frequencies differ substantially from the center frequency. The poor performance in such systems is due to differences in the optimal beamformers corresponding to distinct radio frequencies within the wide bandwidth. Such a mismatch leads to a misfocus effect in near field systems and the beam squint effect in far field systems. In this paper, we investigate the misfocus effect and propose InFocus, a low complexity technique to construct beams that are well suited for massive wideband phased arrays. The beams are constructed using a carefully designed frequency modulated waveform in the spatial dimension. For the special case of beamforming along the boresight of an array, this waveform is analogous to the frequency modulated continuous wave (FMCW) chirp signal in radar. InFocus mitigates beam misfocus and beam squint when applied to near field and far field systems. Simulation results indicate that InFocus enables massive wideband phased array-based radios to achieve higher data rates than comparable beamforming solutions., Comment: Submitted to the IEEE Transactions on Wireless Communications. Copyright may be transferred without notice, after which this version may no longer be accessible

Millimeter wave (mmWave) communication is one viable solution to support Gbps sensor data sharing in vehicular networks. The use of large antenna arrays at mmWave and high mobility in vehicular communication make it challenging to design fast beam alignment solutions. In this paper, we propose a novel framework that learns the channel angle-of-departure (AoD) statistics at a base station (BS) and uses this information to efficiently acquire channel measurements. Our framework integrates online learning for compressive sensing (CS) codebook learning and the optimized codebook is used for CS-based beam alignment. We formulate a CS matrix optimization problem based on the AoD statistics available at the BS. Furthermore, based on the CS channel measurements, we develop techniques to update and learn such channel AoD statistics at the BS. We use the upper confidence bound (UCB) algorithm to learn the AoD statistics and the CS matrix. Numerical results show that the CS matrix in the proposed framework provides faster beam alignment than standard CS matrix designs. Simulation results indicate that the proposed beam training technique can reduce overhead by 80% compared to exhaustive beam search, and 70% compared to standard CS solutions that do not exploit any AoD statistics., Comment: 30 pages, 10 figures

Two arrays form a periodic complementary pair if the sum of their periodic autocorrelations is a delta function. Finding such pairs, however, is challenging for large arrays whose entries are constrained to a small alphabet. One such alphabet is the quaternary set which contains the complex fourth roots of unity. In this paper, we propose a technique to construct periodic complementary pairs defined over the quaternary set using perfect quaternion arrays. We show how new pairs of quaternary sequences, matrices, and four-dimensional arrays that satisfy a periodic complementary property can be constructed with our method., Comment: 4 pages, 1 figure