Search

We propose a method to generate the multi-mode entangled catalysis squeezed vacuum states (MECSVS) by embedding the cross-Kerr nonlinear medium into the Mach-Zehnder interferometer. This method realizes the exchange of quantum states between different modes based on Fredkin gate. In addition, we study the MECSVS as the probe state of multi-arm optical interferometer to realize multi-phase simultaneous estimation. The results show that the quantum Cramer-Rao bound (QCRB) of phase estimation can be improved by increasing the number of catalytic photons or decreasing the transmissivity of the optical beam splitter using for photon catalysis. In addition, we also show that even if there is photon loss, the QCRB of our photon catalysis scheme is lower than that of the ideal entangled squeezed vacuum states (ESVS), which shows that by performing the photon catalytic operation is more robust against photon loss than that without the catalytic operation. The results here can find important applications in quantum metrology for multiparatmeter estimation.

Lipschitz constants are connected to many properties of neural networks, such as robustness, fairness, and generalization. Existing methods for computing Lipschitz constants either produce relatively loose upper bounds or are limited to small networks. In this paper, we develop an efficient framework for computing the $\ell_\infty$ local Lipschitz constant of a neural network by tightly upper bounding the norm of Clarke Jacobian via linear bound propagation. We formulate the computation of local Lipschitz constants with a linear bound propagation process on a high-order backward graph induced by the chain rule of Clarke Jacobian. To enable linear bound propagation, we derive tight linear relaxations for specific nonlinearities in Clarke Jacobian. This formulate unifies existing ad-hoc approaches such as RecurJac, which can be seen as a special case of ours with weaker relaxations. The bound propagation framework also allows us to easily borrow the popular Branch-and-Bound (BaB) approach from neural network verification to further tighten Lipschitz constants. Experiments show that on tiny models, our method produces comparable bounds compared to exact methods that cannot scale to slightly larger models; on larger models, our method efficiently produces tighter results than existing relaxed or naive methods, and our method scales to much larger practical models that previous works could not handle. We also demonstrate an application on provable monotonicity analysis. Code is available at https://github.com/shizhouxing/Local-Lipschitz-Constants., Comment: NeurIPS 2022

Vehicle-to-vehicle (V2V) communications under dense urban environments usually experience severe keyhole fading effect, especially for multi-input multi-output (MIMO) channels, which degrades the capacity and outage performance due to the rank deficiency. To avoid these, the integration of MIMO and Type-I hybrid automatic repeat request (HARQ) is proposed to assist V2V communications in this paper. By using the Meijer G-function, the outage probability of the proposed V2V communications system is derived in closed form. With the result, meaningful insights are gained by conducting the asymptotic outage analysis. Specifically, it is revealed that full-time diversity order can be achieved, while full spatial diversity order is unreachable as compared to Type-I HARQ aided MIMO systems without keyhole effect. Moreover, we prove that the asymptotic outage probability is a monotonically increasing and convex function of the transmission rate. Finally, the analytical results are validated through extensive numerical experiments., Comment: arXiv admin note: substantial text overlap with arXiv:2209.12783

The outage performance of multiple-input multiple-output (MIMO) technique has received intensive attention to meet the stringent requirement of reliable communications for 5G applications, e.g., mission-critical machine-type communication (cMTC). To account for spatial correlation effects at both transmit and receive sides, the full-correlated Rayleigh MIMO fading channels are modeled according to Kronecker correlation structure in this paper. The outage probability is expressed as a weighted sum of the generalized Fox's H functions. The simple analytical result empowers asymptotic outage analysis at high signal-to-noise ratio (SNR), which not only reveal helpful insights into understanding the behavior of fading effects, but also offer useful design guideline for MIMO configurations. Particularly, the negative impact of the spatial correlation on the outage probability is revealed by using the concept of majorization, and the asymptotic outage probability is proved to be a monotonically increasing and convex function of the transmission rate. In the end, the analytical results are validated through extensive numerical experiments., Comment: arXiv admin note: substantial text overlap with arXiv:1904.06872

This paper thoroughly investigates the performance of variable-rate hybrid automatic repeat request with incremental redundancy (HARQ-IR) over Beckmann fading channels, where Beckmann channel model is used to characterize the impacts of line-of-sight (LOS) path, time correlation between fading channels and unequal means & variances between the in-phase and the quadrature components. The intricate channel model and variable-rate transmission strategy significantly complicate the performance analysis. The complex form of the joint distribution of channel coefficients makes the exact analysis rather difficult. Hence, the asymptotic analysis of HARQ-IR is conducted to obtain tractable results. The outage probability and the long term average throughput (LTAT) are then derived in closed-form with clear insights. Furthermore, the simplicity of the obtained expressions enables the maximization of the LTAT given an outage constraint through choosing appropriate transmission rates. Particularly, the increasing monotonicity and the convexity of outage probability with respect to transmission rates allow us to solve the problem suboptimally by combining together alternately iterating optimization and concave fractional programming, and the proposed suboptimal algorithm has a lower computational complexity than the exhaustive search algorithm.

Vehicle-to-vehicle (V2V) communications under dense urban environments usually experience severe keyhole fading effect especially for multi-input multi-output (MIMO) channels, which degrades the capacity and outage performance due to the rank deficiency. To avoid these, the integration of MIMO and hybrid automatic repeat request (HARQ) is proposed to assist V2V communications in this paper. By using the methods of integral transforms, the outage probabilities are derived in closed-form for different HARQ-assisted schemes, including Type I-HARQ, HARQ with chase combining (HARQ-CC), and HARQ with incremental redundancy (HARQ-IR). With the results, meaningful insights are gained by conducting the asymptotic outage analysis. Specifically, it is revealed that full time diversity order can be achieved, while full spatial diversity order is unreachable as compared to MIMO-HARQ systems without keyhole effect. Moreover, we prove that the asymptotic outage probability is a monotonically increasing and convex function of the transmission rate. More importantly, although HARQ-IR performs better than HARQ-CC owing to its higher coding complexity, this advantage becomes negligible in the large-scale array regime. Finally, the numerical results are verified by Monte-Carlo simulations along with some in-depth discussions.

Reconfigurable intelligent surface (RIS) has recently attracted a spurt of interest due to its innate advantages over Massive MIMO on power consumption. In this paper, we study the outage performance of multi-RIS system with the help of hybrid automatic repeat request (HARQ) to improve the RIS system reliability, where the destination received channels are modeled by Rician fading and the phase shift setting only depends on the line-of-sight (LoS) component. Both the exact and asymptotic outage probabilities under Type-I HARQ and HARQ with chase combining (HARQ-CC) schemes are derived. Particulary, the tractable asymptotic results empower us to derive meaningful insights for HARQ-aided multi-RIS system. On the one hand, we find that both the Type-I and the HARQ-CC schemes can achieve full diversity that is equal to the maximal number of HARQ rounds. On the other hand, the closed-form expression of the optimal phase shift setting with respect to outage probability minimization is obtained. The optimal solution indicates that the reflecting link direction should be consistent with direct link LoS component. Finally, the analytical results are validated by Monte-Carlo simulations.

Quantum metrology has an important role in the fields of quantum optics and quantum information processing. Here we introduce a kind of non-Gaussian state, Laguerre excitation squeezed state as input of traditional Mach-Zehnder interferometer to examine phase estimation in realistic case. We consider the effects of both internal and external losses on phase estimation by using quantum Fisher information and parity detection. It is shown that the external loss presents a bigger effect than the internal one. The phase sensitivity and the quantum Fisher information can be improved by increasing the photon number and even surpass the ideal phase sensitivity by two-mode squeezed vacuum in a certain region of phase shift for realistic case., Comment: 13 pages, 12 Fifures

Bound propagation methods, when combined with branch and bound, are among the most effective methods to formally verify properties of deep neural networks such as correctness, robustness, and safety. However, existing works cannot handle the general form of cutting plane constraints widely accepted in traditional solvers, which are crucial for strengthening verifiers with tightened convex relaxations. In this paper, we generalize the bound propagation procedure to allow the addition of arbitrary cutting plane constraints, including those involving relaxed integer variables that do not appear in existing bound propagation formulations. Our generalized bound propagation method, GCP-CROWN, opens up the opportunity to apply general cutting plane methods for neural network verification while benefiting from the efficiency and GPU acceleration of bound propagation methods. As a case study, we investigate the use of cutting planes generated by off-the-shelf mixed integer programming (MIP) solver. We find that MIP solvers can generate high-quality cutting planes for strengthening bound-propagation-based verifiers using our new formulation. Since the branching-focused bound propagation procedure and the cutting-plane-focused MIP solver can run in parallel utilizing different types of hardware (GPUs and CPUs), their combination can quickly explore a large number of branches with strong cutting planes, leading to strong verification performance. Experiments demonstrate that our method is the first verifier that can completely solve the oval20 benchmark and verify twice as many instances on the oval21 benchmark compared to the best tool in VNN-COMP 2021, and also noticeably outperforms state-of-the-art verifiers on a wide range of benchmarks. GCP-CROWN is part of the $\alpha,\!\beta$-CROWN verifier, the VNN-COMP 2022 winner. Code is available at http://PaperCode.cc/GCP-CROWN, Comment: Accepted by NeurIPS 2022. GCP-CROWN is part of the alpha-beta-CROWN verifier, the VNN-COMP 2022 winner

We study the Faraday patterns generated by spin-orbit-coupling induced parametric resonance in a spinor Bose-Einstein condensate with repulsive interaction. The collective elementary excitations of the Bose-Einstein condensate, including density waves and spin waves, are coupled as the result of the Raman-induced spin-orbit coupling and a quench of the relative phase of two Raman lasers without the modulation of any of the system's parameters. We observed several higher parametric resonance tongues at integer multiples of the driving frequency and investigated the interplay between Faraday instabilities and modulation instabilities when we quench the spin-orbit-coupled Bose-Einstein condensate from zero-momentum phase to plane-wave phase. If the detuning is equal to zero, the wave number of combination resonance barely changes as the strength of spin-orbit coupling increases. If the detuning is not equal to zero after a quench, a single combination resonance tongue will split into two parts.

Certifiable robustness is a highly desirable property for adopting deep neural networks (DNNs) in safety-critical scenarios, but often demands tedious computations to establish. The main hurdle lies in the massive amount of non-linearity in large DNNs. To trade off the DNN expressiveness (which calls for more non-linearity) and robustness certification scalability (which prefers more linearity), we propose a novel solution to strategically manipulate neurons, by "grafting" appropriate levels of linearity. The core of our proposal is to first linearize insignificant ReLU neurons, to eliminate the non-linear components that are both redundant for DNN performance and harmful to its certification. We then optimize the associated slopes and intercepts of the replaced linear activations for restoring model performance while maintaining certifiability. Hence, typical neuron pruning could be viewed as a special case of grafting a linear function of the fixed zero slopes and intercept, that might overly restrict the network flexibility and sacrifice its performance. Extensive experiments on multiple datasets and network backbones show that our linearity grafting can (1) effectively tighten certified bounds; (2) achieve competitive certifiable robustness without certified robust training (i.e., over 30% improvements on CIFAR-10 models); and (3) scale up complete verification to large adversarially trained models with 17M parameters. Codes are available at https://github.com/VITA-Group/Linearity-Grafting., Comment: Accepted by ICML 2022

Safe reinforcement learning (RL) trains a policy to maximize the task reward while satisfying safety constraints. While prior works focus on the performance optimality, we find that the optimal solutions of many safe RL problems are not robust and safe against carefully designed observational perturbations. We formally analyze the unique properties of designing effective observational adversarial attackers in the safe RL setting. We show that baseline adversarial attack techniques for standard RL tasks are not always effective for safe RL and propose two new approaches - one maximizes the cost and the other maximizes the reward. One interesting and counter-intuitive finding is that the maximum reward attack is strong, as it can both induce unsafe behaviors and make the attack stealthy by maintaining the reward. We further propose a robust training framework for safe RL and evaluate it via comprehensive experiments. This paper provides a pioneer work to investigate the safety and robustness of RL under observational attacks for future safe RL studies. Code is available at: \url{https://github.com/liuzuxin/safe-rl-robustness}, Comment: Published at the 11th International Conference on Learning Representations (ICLR 2023). 30 pages, 5 figures, 8 tables

CT-based bronchial tree analysis plays an important role in the computer-aided diagnosis for respiratory diseases, as it could provide structured information for clinicians. The basis of airway analysis is bronchial tree reconstruction, which consists of bronchus segmentation and classification. However, there remains a challenge for accurate bronchial analysis due to the individual variations and the severe class imbalance. In this paper, we propose a region and structure prior embedded framework named BronchusNet to achieve accurate segmentation and classification of bronchial regions in CT images. For bronchus segmentation, we propose an adaptive hard region-aware UNet that incorporates multi-level prior guidance of hard pixel-wise samples in the general Unet segmentation network to achieve better hierarchical feature learning. For the classification of bronchial branches, we propose a hybrid point-voxel graph learning module to fully exploit bronchial structure priors and to support simultaneous feature interactions across different branches. To facilitate the study of bronchial analysis, we contribute~\textbf{BRSC}: an open-access benchmark of \textbf{BR}onchus imaging analysis with high-quality pixel-wise \textbf{S}egmentation masks and the \textbf{C}lass of bronchial segments. Experimental results on BRSC show that our proposed method not only achieves the state-of-the-art performance for binary segmentation of bronchial region but also exceeds the best existing method on bronchial branches classification by 6.9\%.

In the highly non-Gaussian regime, the quantum Ziv-Zakai bound (QZZB) provides a lower bound on the available precision, demonstrating the better performance compared with the quantum Cram\'er-Rao bound. However, evaluating the impact of a noisy environment on the QZZB without applying certain approximations proposed by Tsang [Phys. Rev. Lett. 108, 230401 (2012)] remains a difficult challenge. In this paper, we not only derive the general form of the QZZB with the photon loss and the phase diffusion by invoking the technique of integration within an ordered product of operators, but also show its estimation performance for several different Gaussian resources, such as a coherent state (CS), a single-mode squeezed vacuum state (SMSVS) and a two-mode squeezed vacuum state (TMSVS). Our results indicate that compared with the SMSVS and the TMSVS, the QZZB for the CS always shows the better estimation performance under the photon-loss environment. More interestingly, for the phase-diffusion environment, the estimation performance of the QZZB for the TMSVS can be better than that for the CS throughout a wide range of phase-diffusion strength. Our findings will provide a useful guidance for investigating the noisy quantum parameter estimation., Comment: 10 pages, 4 figures

As reinforcement learning (RL) has achieved near human-level performance in a variety of tasks, its robustness has raised great attention. While a vast body of research has explored test-time (evasion) attacks in RL and corresponding defenses, its robustness against training-time (poisoning) attacks remains largely unanswered. In this work, we focus on certifying the robustness of offline RL in the presence of poisoning attacks, where a subset of training trajectories could be arbitrarily manipulated. We propose the first certification framework, COPA, to certify the number of poisoning trajectories that can be tolerated regarding different certification criteria. Given the complex structure of RL, we propose two certification criteria: per-state action stability and cumulative reward bound. To further improve the certification, we propose new partition and aggregation protocols to train robust policies. We further prove that some of the proposed certification methods are theoretically tight and some are NP-Complete problems. We leverage COPA to certify three RL environments trained with different algorithms and conclude: (1) The proposed robust aggregation protocols such as temporal aggregation can significantly improve the certifications; (2) Our certification for both per-state action stability and cumulative reward bound are efficient and tight; (3) The certification for different training algorithms and environments are different, implying their intrinsic robustness properties. All experimental results are available at https://copa-leaderboard.github.io., Comment: Published as a conference paper at ICLR 2022