Search

We introduce "Generative Fusion Decoding" (GFD), a novel shallow fusion framework, utilized to integrate Large Language Models (LLMs) into multi-modal text recognition systems such as automatic speech recognition (ASR) and optical character recognition (OCR). We derive the formulas necessary to enable GFD to operate across mismatched token spaces of different models by mapping text token space to byte token space, enabling seamless fusion during the decoding process. The framework is plug-and-play, compatible with various auto-regressive models, and does not require re-training for feature alignment, thus overcoming limitations of previous fusion techniques. We highlight three main advantages of GFD: First, by simplifying the complexity of aligning different model sample spaces, GFD allows LLMs to correct errors in tandem with the recognition model, reducing computation latencies. Second, the in-context learning ability of LLMs is fully capitalized by GFD, increasing robustness in long-form speech recognition and instruction aware speech recognition. Third, GFD enables fusing recognition models deficient in Chinese text recognition with LLMs extensively trained on Chinese. Our evaluation demonstrates that GFD significantly improves performance in ASR and OCR tasks, with ASR reaching state-of-the-art in the NTUML2021 benchmark. GFD provides a significant step forward in model integration, offering a unified solution that could be widely applicable to leveraging existing pre-trained models through step by step fusion.

Area metrics and area metric backgrounds provide a unified framework for quantum gravity. They encode physical degrees of freedom beyond those of a metric. These non-metric degrees of freedom must be suppressed by a potential at sufficiently high energy scales to ensure that in the infrared regime classical gravity is recovered. On this basis, we first study necessary and sufficient algebraic conditions for an area metric to be induced by a metric. Second, we consider candidate potentials for the area metric and point out a possible connection between the reduction of area metric geometry to metric geometry on the one hand, and the smallness of the cosmological constant on the other. Finally, we consider modifications of the Nambu-Goto action for a string, from a metric background to an area metric background. We demonstrate that area metric perturbations introduce an interaction corresponding to a singular vertex operator in the classically equivalent Polyakov action. The implications of these types of vertex operators for the quantum theory remain to be understood., Comment: v1: 17 pages; v2: minor modifications, matches version published in PRD

We study the implications of the stringy space-time uncertainty relation (STUR) for inflationary cosmology. By demanding that no fluctuation modes that exit the Hubble radius are affected by the nonlocality resulting from the STUR, we find an upper bound on the number of e-foldings of inflation. The bound is a factor of 2 weaker than what results from the Trans-Planckian Censorship Criterion (TCC). By demanding that the inflationary phase is simultaneously consistent with STUR and sufficiently long for inflation to provide a causal explanation of structure on the scale of the current Hubble radius, we find an upper bound on the energy scale of inflation. The bound is less restrictive than what follows from the TCC, but it remains in conflict with canonical single-field inflation models., Comment: 7 pages, 1 figure

In string theories, interactions are exponentially suppressed for trans-Planckian space-like external momenta. We study a class of quantum field theories that exhibit this feature modeled after Witten's bosonic open string field theory, and discover a Lorentz-invariant UV/IR relation that leads to the spacetime uncertainty principle proposed by Yoneya. Application to a dynamical black hole background suggests that Hawking radiation is turned off around the scrambling time., Comment: 27 pages, 1 figure; references and comments added, updated to match the published version

The generalized uncertainty relation is expected to be an essential element in a theory of quantum gravity. In this work, we examine its effect on the Hawking radiation of a Schwarzschild black hole formed from collapse by incorporating a minimal uncertainty length scale into the radial coordinate of the background. This is implemented in both the ingoing Vaidya coordinates and a family of freely falling coordinates. We find that, regardless of the choice of the coordinate system, Hawking radiation is turned off at around the scrambling time. Interestingly, this phenomenon occurs while the Hawking temperature remains largely unmodified., Comment: 23 pages, 1 figure; v2: references added; v3: published version with more references and added clarifications

We revisit the connection between Hawking radiation and high-frequency dispersions for a Schwarzschild black hole following the work of Brout et al.. After confirming the robustness of Hawking radiation for monotonic dispersion relations, we consider non-monotonic dispersion relations that deviate from the standard relation only in the trans-Planckian domain. Contrary to the common belief that Hawking radiation is insensitive to UV physics, it turns out that Hawking radiation is subject to significant modifications after the scrambling time. Depending on the UV physics at the singularity, the amplitude of Hawking radiation could diminish after the scrambling time, while the Hawking temperature remains the same. Our finding is thus not contradictory to earlier works regarding the robustness of Hawking temperature., Comment: 24 pages, 8 figures; v2: minor changes, references added; v3: relation to Parikh-Wilczek tunneling clarified, factors of 2 corrected

We study the interior metric of 4D spherically symmetric static black holes by using the semi-classical Einstein equation and find a consistent class of geometries with large curvatures. We approximate the matter fields by conformal fields and consider the contribution of the 4D Weyl anomaly, giving a state-independent constraint. Combining this with an equation of state yields an equation that determines the interior geometry completely. We explore the solution space of the equation in a non-perturbative manner for $\hbar$. First, we find four types of asymptotic behaviors and examine the general features of the solutions. Then, by imposing physical conditions, we obtain approximately a general class of interior geometries: various combinations of dilute and dense structures without a horizon or singularity. This represents the diversity of the interior structure. Finally, we show that the number of possible patterns of such interior geometries corresponds to the Bekenstein-Hawking entropy., Comment: 32 pages, many figures

We study the time-dependence of Hawking radiation for a black hole in the Unruh vacuum, and find that it is not robust against certain UV and IR effects. If there is a UV cutoff at the Planck scale, Hawking radiation is turned off after the scrambling time. In the absence of a UV cutoff, Hawking radiation is sensitive to the IR cutoff through a UV/IR connection due to higher-derivative interactions in the effective theory. Furthermore, higher-derivative interactions with the background contribute to a large amplitude of particle creation that changes Hawking radiation. This unexpected large effect is related to a peculiar feature of the Hawking particle wave packets., Comment: 35 pages, 5 figures, references added, minor modification

In the background of a gravitational collapse, we compute the transition amplitudes for the creation of particles for distant observers due to higher-derivative interactions in addition to Hawking radiation. The amplitudes grow exponentially with time and become of order 1 when the collapsing matter is about a Planck length outside the horizon. As a result, the effective theory breaks down at the scrambling time, invalidating its prediction of Hawking radiation. Planckian physics comes into play to decide the fate of black-hole evaporation., Comment: 24 pages, no figure, reference added, minor modification

Unitarity demands that the black-hole final state (what remains inside the event horizon at complete evaporation) must be unique. Assuming a UV theory with infinitely many fields, we propose that the uniqueness of the final state can be achieved via a mechanism analogous to the quantum-mechanical description of dissipation., Comment: 12 pages, LaTeX, 1 figure

We report results of a muon spin relaxation study of slow magnetic fluctuations in the pseudogap phase of underdoped single-crystalline YBa$_{2}$Cu$_{3}$O$_{y}$, $y = 6.77$ and 6.83. The dependence of the dynamic muon spin relaxation rate on applied magnetic field yields the rms magnitude~$B\mathrm{_{loc}^{rms}}$ and correlation time~$\tau_c$ of fluctuating local fields at muon sites. The observed relaxation rates do not decrease with decreasing temperature~$T$ below the pseudogap onset at $T^\ast$, as would be expected for a conventional magnetic transition; both $B\mathrm{_{loc}^{rms}}$ and $\tau_c$ are roughly constant in the pseudogap phase down to the superconducting transition. Corresponding NMR relaxation rates are estimated to be too small to be observable. Our results put strong constraints on theories of the anomalous pseudogap magnetism in YBa$_{2}$Cu$_{3}$O$_{y}$.

In the matrix model approaches of string/M theories, one starts from a generic symmetry $gl(\infty)$ to reproduce the space-time manifold. In this paper, we consider the generalization in which the space-time manifold emerges from a gauge symmetry algebra which is not necessarily $gl(\infty)$. We focus on the second nontrivial example after the toroidal compactification, the coset space $G/H$, and propose a specific infinite-dimensional symmetry which realizes the geometry. It consists of the gauge-algebra valued functions on the coset and Lorentzian generator pairs associated with the isometry. We show that the $0$-dimensional gauge theory with the mass and Chern-Simons terms gives the gauge theory on the coset with scalar fields associated with $H$., Comment: 29 pages

Assuming the standard effective-field-theoretic formulation of Hawking radiation, we show explicitly how a generic effective theory predicts a firewall from an initially uneventful horizon for a spherically symmetric, uncharged black hole in $D$ dimensions for $D \geq 4$. The firewall is created via higher-derivative interactions within the scrambling time after the collapsing matter enters the trapping horizon. This result manifests the trans-Planckian problem of Hawking radiation and demonstrates the incompatibility between Hawking radiation and the uneventful horizon., Comment: 14 pages, 1 figure

For an effective field theory in the background of an evaporating black hole with spherical symmetry, we consider non-renormalizable interactions and their relevance to physical effects. The background geometry is determined by the semi-classical Einstein equation for an uneventful horizon where the vacuum energy-momentum tensor is small for freely falling observers. Surprisingly, after Hawking radiation appears, the transition amplitude from the Unruh vacuum to certain multi-particle states grows exponentially with time for a class of higher-derivative operators after the collapsing matter enters the near-horizon region, despite the absence of large curvature invariants. Within the scrambling time, the uneventful horizon transitions towards a firewall, and eventually the effective field theory breaks down., Comment: 37 pages, 2 figures

Assuming that the vacuum energy-momentum tensor is not exceptionally large, we consider 4D evaporating black holes with spherical symmetry and evaluate the proper distance $\Delta L$ between the time-like apparent horizon and the surface of the collapsing matter after it has entered the apparent horizon. We show that $\Delta L$ can never be larger than $\mathcal{O}(n^{3/2}\ell_p)$ when the black hole is evaporated to $1/n$ of its initial mass, as long as $n \ll a^{2/3}/\ell_p^{2/3}$ (where $a$ is the Schwarzschild radius and $\ell_p$ is the Planck length). For example, the distance between the matter and the apparent horizon must be Planckian at the Page time., Comment: 16 pages

We study analytically the spacetime geometry of the black-hole formation and evaporation. As a simplest model of the collapse, we consider a spherical thin shell, and take the back-reaction from the negative energy of the quantum vacuum state. For definiteness, we will focus on quantum effects of s-waves. We obtain an analytic solution of the semi-classical Einstein equation for this model, that provides an overall description of the black hole geometry form the formation to evaporation. As an application of this result, we find its interesting implication that, after the collapsing shell enters the apparent horizon, the proper distance between the shell and the horizon remains as small as the Planck length even when the difference in their areal radii is of the same order as the Schwarzschild radius. The position of the shell would be regarded as the same place to the apparent horizon in the semi-classical regime of gravity., Comment: 42 pages, 8 figures, minor modification

Assuming spherical symmetry and the semi-classical Einstein equation, we prove that, for the observers on top of the trapping horizon, the vacuum energy-momentum tensor is always that of an ingoing negative energy flux at the speed of light with a universal energy density ${\cal E} \simeq - 1/(2\kappa a^2)$, (where $a$ is the areal radius of the trapping horizon), which is responsible for the decrease in the black hole's mass over time. This result is independent of the composition of the collapsing matter and the details of the vacuum energy-momentum tensor. The physics behind the universality of this quantity ${\cal E}$ and its surprisingly large magnitude will be discussed., Comment: 17 pages, 3 figures

For a black hole of Schwarzschild radius $a$, we argue that the back-reaction of the vacuum energy-momentum tensor is in general important at the apparent horizon when the time scale of a process is larger than order $a$. In particular, in a double-shell model, we show that the ignorance of the back-reaction leads to a divergence in the outgoing vacuum energy flux. The main result of this paper is that, once the back-reaction is included, the vacuum energy density for observers on top of the trapping horizon in vacuum is given by ${\cal E} \simeq -1/2\ell_p^2 a^2$, which is of the same order of magnitude as the classical matter but opposite in sign. Remarkably, this formula is independent of both the details about the collapsing matter and the vacuum energy-momentum tensor., Comment: latex,17 pages, 6 figures

We report a muon spin rotation ($\mu$SR) study of the cuprate-analog nickelate La$_4$Ni$_3$O$_8$, which undergoes a transition at 105 K to a low-temperature phase with charge-stripe and antiferromagnetic (AFM) order on square planar NiO$_2$ layers. Zero-field $\mu$SR shows that this transition is abrupt and that the AFM configuration is commensurate. Comparison of observed muon precession frequencies with Ni dipolar field calculations yields Ni moments $\lesssim 0.5\mu_B$. Dynamic muon spin relaxation above 105 K suggests critical slowing of Ni spin fluctuations, but is inconsistent with corresponding $^{139}$La NMR results. Critical slowing and an abrupt transition are also observed in the planar cuprate AFM La$_2$CuO$_{4+\delta}$, where they are evidence for weakly interplanar-coupled two-dimensional AFM spin fluctuations, but our $\mu$SR data do not agree quantitatively with theoretical predictions for this scenario., Comment: 17 pages, 25 figures, 49 references; under review by PRB

Following the work of Kawai, Matsuo, and Yokokura, we study the dynamical collapsing process with spherical symmetry in the time-dependent space-time background including the back reaction of Hawking radiation. We show that in this model there are two classes of asymptotic solutions. One of the two classes is known previously. These states have the slope $\partial a/\partial r$ approximately equal to 1. The other class of asymptotic solutions is that of shells with a small thickness. We emphasize that these thin shells should be properly understood as configurations in the low-energy effective theory. They behave characteristically differently from the singular states of ideal thin shells of zero thickness., Comment: 34 pages, latex, minor modification