Search

Absorption is a crucial parameter in shaping wave propagation dynamics, yet achieving ultra-broadband absorption remains highly challenging, particularly in balancing low-frequency and broad bandwidth. Here, we present a metamaterial absorber (MMA) capable of achieving simultaneous spectral coverage across a seven-octave range of near-perfect absorption from 100 Hz to 12,800 Hz by engineering the quality-factor-weighted (Q-weighted) mode density. The Q-weighted mode density considers mode density, resonant frequencies, radiative loss, and intrinsic loss of multiple resonant modes, providing a comprehensive approach to govern broadband absorption properties. By optimizing the number of resonant modes and managing intrinsic losses, our approach achieves an intensive Q-weighted mode density across an ultra-wide bandwidth, enabling ultra-broadband absorption with high efficiency. These findings significantly advance the bandwidth capabilities of state-of-the-art MMAs and pave the way for the development of ultra-broadband metamaterial devices across various wave systems.

Text-to-image diffusion has attracted vast attention due to its impressive image-generation capabilities. However, when it comes to human-centric text-to-image generation, particularly in the context of faces and hands, the results often fall short of naturalness due to insufficient training priors. We alleviate the issue in this work from two perspectives. 1) From the data aspect, we carefully collect a human-centric dataset comprising over one million high-quality human-in-the-scene images and two specific sets of close-up images of faces and hands. These datasets collectively provide a rich prior knowledge base to enhance the human-centric image generation capabilities of the diffusion model. 2) On the methodological front, we propose a simple yet effective method called Mixture of Low-rank Experts (MoLE) by considering low-rank modules trained on close-up hand and face images respectively as experts. This concept draws inspiration from our observation of low-rank refinement, where a low-rank module trained by a customized close-up dataset has the potential to enhance the corresponding image part when applied at an appropriate scale. To validate the superiority of MoLE in the context of human-centric image generation compared to state-of-the-art, we construct two benchmarks and perform evaluations with diverse metrics and human studies. Datasets, model, and code are released at https://sites.google.com/view/mole4diffuser/., Comment: Published at NeurIPS 2024

We identify the leading term in the asymptotics of the quadratic Wasserstein distance between the invariant measure and empirical measures for diffusion processes on closed weighted four-dimensional Riemannian manifolds. Unlike results in lower dimensions, our analysis shows that this term depends solely on the Riemannian volume of the manifold, remaining unaffected by the potential and vector field in the diffusion generator.

Utility-scale off-grid renewable power-to-hydrogen systems (OReP2HSs) typically include photovoltaic plants, wind turbines, electrolyzers (ELs), and energy storage systems. As an island system, OReP2HS requires at least one component, generally the battery energy storage system (BESS), that operates for grid-forming control to provide frequency and voltage references and regulate them through transient power support and short-term energy balance regulation. While larger BESS capacity increases this ability, it also raises investment costs. This paper proposes a framework of layered multi-timescale energy management system (EMS) and evaluates the most cost-effective size of the grid-forming BESS in the OReP2HS. The proposed EMS covers the timescales ranging from those for power system transient behaviors to intra-day scheduling, coordinating renewable power, BESS, and ELs. Then, an iterative search procedure based on high-fidelity simulation is employed to determine the size of the BESS with minimal levelized cost of hydrogen (LCOH). Simulations over a reference year, based on the data from a planned OReP2HS project in Inner Mongolia, China, show that with the proposed EMS, the base-case optimal LCOH is 33.212 CNY/kg (4.581 USD/kg). The capital expenditure of the BESS accounts for 17.83% of the total, and the optimal BESS size accounts for 13.6% of the rated hourly energy output of power sources. Sensitivity analysis reveals that by reducing the electrolytic load adjustment time step from 90 to 5 s and increasing its ramping limit from 1% to 10% rated power per second, the BESS size decreases by 53.57%, and the LCOH decreases to 25.458 CNY/kg (3.511 USD/kg). Considering the cost of designing and manufacturing utility-scale ELs with fast load regulation capability, a load adjustment time step of 5-10 s and a ramping limit of 4-6% rated power per second are recommended.

For a class of (non-symmetric) diffusion processes on a length space, which in particular include the (reflecting) diffusion processes on a connected compact Riemannian manifold, the exact convergence rate is derived for $({\mathbb E} [{\mathbb W}_p^q(\mu_T,\mu)])^{\frac{1}{q}} (T \to \infty)$ uniformly in $(p,q)\in [1,\infty) \times (0,\infty)$, where $\mu_T$ is the empirical measure of the diffusion process, $\mu$ is the unique invariant probability measure, and ${\mathbb W}_p$ is the $p$-Wasserstein distance. Moreover, when the dimension parameter is less than $4$, we prove that ${\mathbb E} |T {\mathbb W}_2^2(\mu_T,\mu)-\Xi(T)|^q \to 0$ as $T\to\infty$ for any $q\ge 1$, where $\Xi(T)$ is explicitly given by eigenvalues and eigenfunctions for the symmetric part of the generator.

Off-grid renewable power to ammonia (ReP2A) systems present a promising pathway toward carbon neutrality in both the energy and chemical industries. However, due to chemical safety requirements, the limited flexibility of ammonia synthesis poses a challenge when attempting to align with the variable hydrogen flow produced from renewable power. This necessitates the optimal sizing of equipment capacity for effective and coordinated production across the system. Additionally, an ReP2A system may involve multiple stakeholders with varying degrees of operational flexibility, complicating the planning problem. This paper first examines the multistakeholder sizing equilibrium (MSSE) of the ReP2A system. First, we propose an MSSE model that accounts for individual planning decisions and the competing economic interests of the stakeholders of power generation, hydrogen production, and ammonia synthesis. We then construct an equivalent optimization problem based on Karush--Kuhn--Tucker (KKT) conditions to determine the equilibrium. Following this, we decompose the problem in the temporal dimension and solve it via multicut generalized Benders decomposition (GBD) to address long-term balancing issues. Case studies based on a realistic project reveal that the equilibrium does not naturally balance the interests of all stakeholders due to their heterogeneous characteristics. Our findings suggest that benefit transfer agreements ensure mutual benefits and the successful implementation of ReP2A projects.

We have implemented the 3+1 dimensional CLVisc hydrodynamics model with TRENTO-3D initial conditions to investigate the spin polarization of $\Lambda$ hyperons along the beam direction in p+Pb collisions at $\sqrt{s_{NN}} = 8.16$ TeV. Following our previous theoretical framework based on quantum kinetic theory, we consider three different scenarios: $\Lambda$ equilibrium, $s$ quark equilibrium, and iso-thermal equilibrium scenarios. We have computed the second Fourier sine coefficients of spin polarization along the beam direction, denoted as $\left\langle P_{z} \sin 2(\phi_{p} - \Psi_{2}) \right\rangle$, with $\phi_{p} - \Psi_{2}$ being the azimuthal angle relative to the second-order event plane $\Psi_{2}$, as functions of multiplicity, transverse momentum and pseudo-rapidity in the three scenarios. Additionally, we have also computed the spin polarization along the beam direction, $P_{z}$, as a function of the azimuthal angle. We find that the spin polarization induced by thermal vorticity always provides an opposite contribution compared to the shear-induced polarization in p+Pb collisions. The total spin polarization computed by the current hydrodynamic model disagrees with the data measured by LHC-CMS experiments. Our findings imply that other non-flow effects may play a crucial role in p+Pb collisions., Comment: 8 pages, 5 figures and 1 table. A new figure for local polarization as a function of pseudo-rapidity is added. submitted to PRC

In this paper, we shall show that the vector-scalar potential ($\mathbf{A}$-$\Phi$) formulation, for many problems, can be further simplified by ignoring the scalar potential contribution and setting it to zero.

In light of recent breakthroughs in large language models (LLMs) that have revolutionized natural language processing (NLP), there is an urgent need for new benchmarks to keep pace with the fast development of LLMs. In this paper, we propose CFLUE, the Chinese Financial Language Understanding Evaluation benchmark, designed to assess the capability of LLMs across various dimensions. Specifically, CFLUE provides datasets tailored for both knowledge assessment and application assessment. In knowledge assessment, it consists of 38K+ multiple-choice questions with associated solution explanations. These questions serve dual purposes: answer prediction and question reasoning. In application assessment, CFLUE features 16K+ test instances across distinct groups of NLP tasks such as text classification, machine translation, relation extraction, reading comprehension, and text generation. Upon CFLUE, we conduct a thorough evaluation of representative LLMs. The results reveal that only GPT-4 and GPT-4-turbo achieve an accuracy exceeding 60\% in answer prediction for knowledge assessment, suggesting that there is still substantial room for improvement in current LLMs. In application assessment, although GPT-4 and GPT-4-turbo are the top two performers, their considerable advantage over lightweight LLMs is noticeably diminished. The datasets and scripts associated with CFLUE are openly accessible at https://github.com/aliyun/cflue., Comment: Accepted by ACL 2024

The transformation of urban environments to accommodate growing populations has profoundly impacted public health and well-being. This paper addresses the critical challenge of estimating the impact of urban design interventions on diverse populations. Traditional approaches, reliant on questionnaires and stated preference techniques, are limited by recall bias and capturing the complex dynamics between environmental attributes and individual characteristics. To address these challenges, we integrate Virtual Reality (VR) with observational causal inference methods to estimate heterogeneous treatment effects, specifically employing Targeted Maximum Likelihood Estimation (TMLE) for its robustness against model misspecification. Our innovative approach leverages VR-based experiment to collect data that reflects perceptual and experiential factors. The result shows the heterogeneous impacts of urban design elements on public health and underscore the necessity for personalized urban design interventions. This study not only extends the application of TMLE to built environment research but also informs public health policy by illuminating the nuanced effects of urban design on mental well-being and advocating for tailored strategies that foster equitable, health-promoting urban spaces.

Self-supervised learning shows promise in harnessing extensive unlabeled data, but it also confronts significant privacy concerns, especially in vision. In this paper, we aim to perform membership inference on visual self-supervised models in a more realistic setting: self-supervised training method and details are unknown for an adversary when attacking as he usually faces a black-box system in practice. In this setting, considering that self-supervised model could be trained by completely different self-supervised paradigms, e.g., masked image modeling and contrastive learning, with complex training details, we propose a unified membership inference method called PartCrop. It is motivated by the shared part-aware capability among models and stronger part response on the training data. Specifically, PartCrop crops parts of objects in an image to query responses with the image in representation space. We conduct extensive attacks on self-supervised models with different training protocols and structures using three widely used image datasets. The results verify the effectiveness and generalization of PartCrop. Moreover, to defend against PartCrop, we evaluate two common approaches, i.e., early stop and differential privacy, and propose a tailored method called shrinking crop scale range. The defense experiments indicate that all of them are effective. Our code is available at https://github.com/JiePKU/PartCrop., Comment: Accepted by ACM CCS2024, Full version

We study the transverse momentum ($p_T$) differential anisotropic flow and flow fluctuation in Pb+Pb collisions at $\sqrt{s_{NN}}$=5.02 TeV at the LHC. A (3+1)-dimensional CLVisc hydrodynamics framework with fluctuating TRENTO (or AMPT) initial conditions is utilized to simulate the space-time evolution of the quark-gluon plasma (QGP) medium. The effects of shear viscosity and the sub-nucleon structure on anisotropic flow and flow fluctuation are analyzed. Our result shows that shear viscosity tends to suppress both flow coefficients (${v_2\{2}\}$, ${v_2\{4\}}$, ${\langle v_2\rangle}$) and flow fluctuation (${\sigma_{v_2}}$) due to its smearing effect on local density fluctuation. The flow coefficients appear to be insensitive to the sub-nucleon structure, whereas for flow fluctuation ${\sigma_{v_2}}$, it tends to be suppressed by the sub-nucleon structure in central collisions but enhanced in peripheral collisions. After taking into account the sub-nucleon structure effect, our numerical result can quantitatively describe the relative flow fluctuations (${v_2\{4\}/v_2\{2\}}$, $F({v_2})$) measured by the ALICE Collaboration at the LHC. We further investigate the effects of shear viscosity, sub-nucleon structure and initial condition model on the flow angle and flow magnitude decorrelations (${A_2^f}$, ${M_2^f}$) using the four-particle correlation method. We find that the flow decorrelation effect is typically stronger in central collisions than in peripheral collisions. The flow angle decorrelation is found to be insensitive to the shear viscosity and sub-nucleon structure, whereas the flow magnitude decorrelation shows quite different behavior when using TRENTO or AMPT initial condition model. Our study sheds light on the anisotropic flow, transport properties and initial structure of the QGP created in high-energy nuclear collisions., Comment: 11 pages, 6 figures

Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and further modify the complex spectrum to suppress the residual noise and recover the speech phase in the second stage. The above whole process is performed in the short-time Fourier transform (STFT) spectrum domain. In this paper, we re-implement the above second sub-process in the short-time discrete cosine transform (STDCT) spectrum domain. The reason is that we have found STDCT performs greater noise suppression capability than STFT. Additionally, the implicit phase of STDCT ensures simpler and more efficient phase recovery, which is challenging and computationally expensive in the STFT-based methods. Therefore, we propose a novel two-stage framework called the STFT-STDCT spectrum fusion network (FDFNet) for speech enhancement in cross-spectrum domain. Experimental results demonstrate that the proposed FDFNet outperforms the previous two-stage methods and also exhibits superior performance compared to other advanced systems., Comment: Accepted by ICASSP 2024

Hydrogen plays an important role in the context of global carbon reduction. For an off-grid renewable power to hydrogen system (OReP2HS), a grid-forming (GFM) source is essential to provide frequency and voltage references. Here, we take battery works as a GFM source, and the OReP2HS we focus on is comprised of solar photovoltaic, wind turbines, and alkaline electrolyzers for hydrogen generation. An elaborative full-time scale energy management strategy (EMS) covers GFM control to system scheduling (from milliseconds to hours) and is proposed to support high-precision production simulations. Loads of electrolysers are designed to track the renewable power closely to partly replace the energy balancing requirement of the battery. A continuous operation strategy during an emergency like a unit drop is also included in the presented EMS. An off-line simulation-based iterative searching algorithm is developed to find the most suitable size of the battery with the minimum levelized cost of hydrogen (LCOH). A practical OReP2H project located in Inner Mongolian, China is taken as a case study. Simulation results demonstrate the feasibility of the proposed method, and the optimized capacity of the battery (3.4MWh) only accounts for 13.6% of the total installed capacity of the sources with the proposed EMS. Sensitivity analysis shows that LOCH rises from 28.829 CYN/kg to 37.814 CYN/kg, with the time-step for fast power regulation of electrolysers changing from 4s to 1 min with a ramp rate of 0.05MW/s.

The size of deep learning models in artificial intelligence (AI) software is increasing rapidly, hindering the large-scale deployment on resource-restricted devices (e.g., smartphones). To mitigate this issue, AI software compression plays a crucial role, which aims to compress model size while keeping high performance. However, the intrinsic defects in a big model may be inherited by the compressed one. Such defects may be easily leveraged by adversaries, since a compressed model is usually deployed in a large number of devices without adequate protection. In this article, we aim to address the safe model compression problem from the perspective of safety-performance co-optimization. Specifically, inspired by the test-driven development (TDD) paradigm in software engineering, we propose a test-driven sparse training framework called SafeCompress. By simulating the attack mechanism as safety testing, SafeCompress can automatically compress a big model to a small one following the dynamic sparse training paradigm. Then, considering two kinds of representative and heterogeneous attack mechanisms, i.e., black-box membership inference attack and white-box membership inference attack, we develop two concrete instances called BMIA-SafeCompress and WMIA-SafeCompress. Further, we implement another instance called MMIA-SafeCompress by extending SafeCompress to defend against the occasion when adversaries conduct black-box and white-box membership inference attacks simultaneously. We conduct extensive experiments on five datasets for both computer vision and natural language processing tasks. The results show the effectiveness and generalizability of our framework. We also discuss how to adapt SafeCompress to other attacks besides membership inference attack, demonstrating the flexibility of SafeCompress., Comment: Accepted by IEEE Transactions on Software Engineering (TSE). Camera-ready Version. arXiv admin note: substantial text overlap with arXiv:2208.05969

Utility-scale renewable power-to-hydrogen (ReP2H) production typically uses thyristor rectifiers (TRs) to supply power to multiple electrolyzers (ELZs). They exhibit a nonlinear and non-decouplable relation between active and reactive power. The on-off scheduling and load allocation of multiple ELZs simultaneously impact energy conversion efficiency and AC-side active and reactive power flow. Improper scheduling may result in excessive reactive power demand, causing voltage violations and increased network losses, compromising safety and economy. To address these challenges, this paper first explores trade-offs between the efficiency and the reactive load of the electrolyzers. Subsequently, we propose a coordinated approach for scheduling the active and reactive power in the ReP2H system. A mixed-integer second-order cone programming (MISOCP) is established to jointly optimize active and reactive power by coordinating the ELZs, renewable energy sources, energy storage (ES), and var compensations. Case studies demonstrate that the proposed method reduces losses by 3.06% in an off-grid ReP2H system while increasing hydrogen production by 5.27% in average.

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly reduce the computational load and storage requirements associated with matrix inversion without losing accuracy. To demonstrate the versatility and applicability of our method, we apply it to address two crucial uncertainty quantification problems: stochastic elliptic equations and optimal control problems governed by stochastic elliptic PDE constraints. Based on varying dimension reduction ratios, our algorithm exhibits the capability to yield a high precision numerical solution for stochastic partial differential equations, or provides a rough representation of the exact solutions as a pre-processing phase. Meanwhile, our algorithm for solving stochastic optimal control problems allows a diverse range of gradient-based unconstrained optimization methods, rendering it particularly appealing for computationally intensive large-scale problems. Numerical experiments are conducted and the results provide strong validation of the feasibility and effectiveness of our algorithm.

In speech enhancement (SE), phase estimation is important for perceptual quality, so many methods take clean speech's complex short-time Fourier transform (STFT) spectrum or the complex ideal ratio mask (cIRM) as the learning target. To predict these complex targets, the common solution is to design a complex neural network, or use a real network to separately predict the real and imaginary parts of the target. But in this paper, we propose to use a real network to estimate the magnitude mask and normalized cIRM, which not only avoids the significant increase of the model complexity caused by complex networks, but also shows better performance than previous phase estimation methods. Meanwhile, we devise a parallel sequence modeling (PSM) block to improve the RNN block in the convolutional recurrent network (CRN)-based SE model. We name our method as magnitude-and-phase-aware and PSM-based CRN (MPCRN). The experimental results illustrate that our MPCRN has superior SE performance., Comment: Accepted by ASRU 2023

The deep learning-based speech enhancement (SE) methods always take the clean speech's waveform or time-frequency spectrum feature as the learning target, and train the deep neural network (DNN) by reducing the error loss between the DNN's output and the target. This is a conventional single-task learning paradigm, which has been proven to be effective, but we find that the multi-task learning framework can improve SE performance. Specifically, we design a framework containing a SE module and a voice activity detection (VAD) module, both of which share the same encoder, and the whole network is optimized by the weighted loss of the two modules. Moreover, we design a causal spatial attention (CSA) block to promote the representation capability of DNN. Combining the VAD aided multi-task learning framework and CSA block, our SE network is named VSANet. The experimental results prove the benefits of multi-task learning and the CSA block, which give VSANet an excellent SE performance., Comment: Accepted by ASRU 2023

The High Energy Stereoscopic System (H.E.S.S) Collaboration reported the discovery of a novel radiation component from the Vela pulsar by their Cherenkov telescopes. It is of great importance that gamma rays with energies of at least 20~TeV are recorded unexpectedly. The H.E.S.S Collaboration argued that such results may challenge the state-of-the-art models for the high-energy emission of pulsars. We point out in this work that these results also provide a unique opportunity to constrain certain Lorentz invariance violation parameters, leading to the realization of studying Lorentz invariance violation by using gamma-ray pulsars. The Lorentz invariance violation scale is constrained at the level of $E_{\mathrm{LV,}1}> 1.66\times 10^{17} \rm GeV$ for the linear scenario, and $E_{\mathrm{LV,}2}>3.53\times 10^{10} \rm GeV$ for the quadratic scenario. We anticipate that digging into the detailed features of the data of the Vela pulsar and analyzing potentially more very-high-energy photon data from pulsars in the future would improve the constraints on Lorentz invariance violation., Comment: 3 pages, no figure

This paper focuses on the research of micro-expression recognition (MER) and proposes a flexible and reliable deep learning method called learning to rank onset-occurring-offset representations (LTR3O). The LTR3O method introduces a dynamic and reduced-size sequence structure known as 3O, which consists of onset, occurring, and offset frames, for representing micro-expressions (MEs). This structure facilitates the subsequent learning of ME-discriminative features. A noteworthy advantage of the 3O structure is its flexibility, as the occurring frame is randomly extracted from the original ME sequence without the need for accurate frame spotting methods. Based on the 3O structures, LTR3O generates multiple 3O representation candidates for each ME sample and incorporates well-designed modules to measure and calibrate their emotional expressiveness. This calibration process ensures that the distribution of these candidates aligns with that of macro-expressions (MaMs) over time. Consequently, the visibility of MEs can be implicitly enhanced, facilitating the reliable learning of more discriminative features for MER. Extensive experiments were conducted to evaluate the performance of LTR3O using three widely-used ME databases: CASME II, SMIC, and SAMM. The experimental results demonstrate the effectiveness and superior performance of LTR3O, particularly in terms of its flexibility and reliability, when compared to recent state-of-the-art MER methods.

The correlation of $\alpha\alpha$ was probed via measuring the transverse momentum $p_{T}$ and width $\delta p_{T}$ of one $\alpha$, for the first time, which represents the spatial and dynamical essentialities of the initial coupling state in $^{8}$Be nucleus. The weighted interaction vertex of 3$\alpha$ reflected by the magnitudes of their relative momentums and relative emission angles proves the isosceles triangle configuration for 3$\alpha$ at the high excited energy analogous Hoyle states., Comment: 8 pages, 9 figures

The enhancement of $J^{\pi}(T)$=3$^{+}$(0) state with isospin $T=0$ excited by the tensor force in the free $^{6}$Li nucleus has been observed, for the first time, relative to a shrinkable excitation in the $^{6}$Li cluster component inside its host nucleus. Comparatively, the excitation of $J^{\pi}(T)$=0$^{+}$(1) state with isospin $T=1$ for these two $^{6}$Li formations take on an approximately equal excitation strength. The mechanism of such tensor force effect was proposed due to the intensive nuclear medium role on isospin $T$=0 state., Comment: 6 pages, 4 figures

Let $(X_t)_{t \geq 0}$ be a diffusion process defined on a compact Riemannian manifold, and for $\alpha > 0$, let $$ \mu_t^{(\alpha)} = \frac{\alpha}{t^\alpha} \int_{0}^{t} \delta_{X_s} \, s^{\alpha - 1} \mathrm{d} s $$ be the associated weighted empirical measure. We investigate asymptotic behavior of $\mathbb{E}^\nu \big[ \mathrm{W}_2^2(\mu_t^{(\alpha)}, \mu) \big]$ for sufficient large $t$, where $\mathrm{W}_2$ is the quadratic Wasserstein distance and $\mu$ is the invariant measure of the process. In the particular case $\alpha = 1$, our result sharpens the limit theorem achieved in [26]. The proof is based on the PDE and mass transportation approach developed by L. Ambrosio, F. Stra and D. Trevisan.