Search

We propose a method based on the discrete truncated Wigner approximation (DTWA) for computing out-of-time-order correlators. This method is applied to long-range interacting quantum spin systems where the interactions decay as a power law with distance. As a demonstration, we use a squared commutator of local operators and its higher-order extensions that describe quantum information scrambling under Hamilton dynamics. Our results reveal that the DTWA method accurately reproduces the exact dynamics of the average spreading of quantum information (i.e., the squared commutator) across all time regimes in strongly long-range interacting systems. We also identify limitations in the DTWA method when capturing dynamics in weakly long-range interacting systems and the fastest spreading of quantum information. This work provides a new technique to study scrambling dynamics in long-range interacting quantum spin systems., Comment: 8 pages, 3 captioned figures

It has recently been established that open quantum systems may exhibit a strong spectral sensitivity to boundary conditions, known as the non-Hermitian/Liouvillian skin effect (NHSE/LSE), making the topological properties of the system boundary-condition sensitive. In this Letter, we ask the query: Can topological phase transitions of open quantum systems, captured by open boundary conditioned invariants, be observed in the dynamics of a system in a periodic boundary condition, even in the presence of NHSE/LSE? We affirmatively respond to this question, by considering the quench dynamics of entanglement spectrum in a periodic open quantum fermionic system. We demonstrate that the entanglement spectrum exhibits zero-crossings only when this periodic system is quenched from a topologically trivial to non-trivial phase, defined from the spectrum in open boundary conditions, even in systems featuring LSE. Our results reveal that non-Hermitian topological phases leave a distinctive imprint on the unconditional dynamics within a subsystem of fermionic systems., Comment: 5 pages, 3 figures, Supplemental Materials 3 pages, 1 supplemental figure

Stochastic gradient descent (SGD) is a frequently used optimization technique in classical machine learning and Variational Quantum Eigensolver (VQE). For the implementation of VQE on quantum hardware, the results are always affected by measurement shot noise. However, there are many unknowns about the structure and properties of the measurement noise in VQE and how it contributes to the optimization. In this work, we analyze the effect of measurement noise to the optimization dynamics. Especially, we focus on escaping from saddle points in the loss landscape, which is crucial in the minimization of the non-convex loss function. We find that the escape time (1) decreases as the measurement noise increases in a power-law fashion and (2) is expressed as a function of $\eta/N_s$ where $\eta$ is the learning rate and $N_s$ is the number of measurements. The latter means that the escape time is approximately constant when we vary $\eta$ and $N_s$ with the ratio $\eta/N_s$ held fixed. This scaling behavior is well explained by the stochastic differential equation (SDE) that is obtained by the continuous-time approximation of the discrete-time SGD. According to the SDE, $\eta/N_s$ is interpreted as the variance of measurement shot noise. This result tells us that we can learn about the optimization dynamics in VQE from the analysis based on the continuous-time SDE, which is theoretically simpler than the original discrete-time SGD., Comment: 10pages, 8figures

The local Gorini-Kossakowski-Sudarshan-Lindblad (GKSL) quantum master equation is a powerful tool for the study of open quantum many-body systems. However, its microscopic derivation applicable to many-body systems is available only in limited cases of weak internal couplings, and it has yet to be fully understood under what microscopic conditions the local GKSL equation is valid. We derive the local GKSL equation on the basis of the Lieb-Robinson bound, which provides an upper bound of the propagation of information in quantum many-body systems. We numerically test the validity of the derived local GKSL equation for a one-dimensional tight-binding fermion chain., Comment: 16 pages, 7 figures

The Lindblad equation, which describes Markovian quantum dynamics under dissipation, is usually derived under the weak system-bath coupling assumption. Strong system-bath coupling often leads to non-Markov evolution. The singular-coupling limit is known as an exception: it yields a Lindblad equation with an arbitrary strength of dissipation. However, the singular-coupling limit requires high-temperature limit of the bath, and hence the system ends up in a trivial infinite-temperature state, which is not desirable in the context of quantum control. In this work, it is shown that we can derive a Markovian Lindblad equation for an arbitrary strength of the system-bath coupling by considering a new scaling limit that is called the singular-driving limit, which combines the singular-coupling limit and fast periodic driving. In contrast to the standard singular-coupling limit, an interplay between dissipation and periodic driving results in a nontrivial steady state., Comment: 17 pages

Recent experiments have reported that novel physics emerge in open quantum many-body sys- tems due to an interplay of interactions and dissipation, which stimulate theoretical studies of the many-body Lindblad equation. Although the strong dissipation regime receives considerable in- terest in this context, this work focuses on the weak bulk dissipation. By examining the spectral property of the many-body Lindblad generator for specific models, we find that its spectral gap shows singularity in the weak dissipation limit when the thermodynamic limit is taken first. Based on analytical arguments and numerical calculations, we conjecture that such a singularity is generic in bulk-dissipated quantum many-body systems and is related to the concept of the Ruelle-Pollicott resonance in chaos theory, which determines the timescale of thermalization of an isolated system. This conjecture suggests that the many-body Lindblad equation in the weak dissipation regime contains nontrivial information on intrinsic properties of a quantum many-body system., Comment: 11 pages

Markovian open many-body quantum systems display complicated relaxation dynamics. The spectral gap of the Liouvillian characterizes the asymptotic decay rate towards the stationary state, but it has recently been pointed out that the spectral gap does not necessarily determine the overall relaxation time. Our understanding on the relaxation process before the asymptotically long-time regime is still limited. We here present a collective relaxation dynamics of autocorrelation functions in the stationary state. As a key quantity in the analysis, we introduce the instantaneous decay rate, which characterizes the transient relaxation and converges to the conventional asymptotic decay rate in the long-time limit. Our theory predicts that a bulk-dissipated system generically shows an accelerated decay before the asymptotic regime due to the scrambling of quantum information associated with the operator spreading., Comment: 5 pages, 3 figures (Supplemental Material 3 pages, 3 figures)

Dynamical many-body freezing occurs in periodic transverse field-driven integrable quantum spin systems. Under freezing conditions, quantum dynamics causes practically infinite hysteresis in the drive response, maintaining its starting value. We find similar resonant freezing in the Lipkin-Meshkov-Glick (LMG) model. In the LMG, the freezing conditions in the driving field suppresses the heating postulated by the eigenstate thermalization hypothesis (ETH) by inducing dynamical many-body localization, or DMBL. This is in contrast to Many Body Localization (MBL), which requires disorder to suppress ETH. DMBL has been validated by the inverse participation ratio (IPR) of the quasistationary Floquet modes. Similarly to the TFIM, the LMG exhibits high-frequency localization only at freezing points. IPR localization in the LMG deteriorates with an inverse system size law at lower frequencies, which indicates heating to infinite temperature. Furthermore, adiabatically increasing frequency and amplitude from low values raises the Floquet state IPR in the LMG from nearly zero to unity, indicating a phase crossover. This occurrence enables a future technique to construct an MBL engine in clean systems that can be cycled by adjusting drive parameters only., Comment: Published in PRB after review

Markovian open quantum systems display complicated relaxation dynamics. The spectral gap of the Liouvillian characterizes the asymptotic decay rate towards the steady state, but it does not necessarily give a correct estimate of the relaxation time because the crossover time to the asymptotic regime may be too long. We here give a rigorous upper bound on the transient decay of auto-correlation functions in the steady state by introducing the symmetrized Liouvillian gap. The standard Liouvillian gap and the symmetrized one are identical in an equilibrium situation but differ from each other in the absence of the detailed balance condition. It is numerically shown that the symmetrized Liouvillian gap always give a correct upper bound on the decay of the auto-correlation function, but the standard Liouvillian gap does not., Comment: 6 pages, 3 figures

Time-periodic (Floquet) driving is a powerful way to control the dynamics of complex systems, which can be used to induce a plethora of new physical phenomena. However, when applied to many-body systems, Floquet driving can also cause heating, and lead to a featureless infinite-temperature state, hindering most useful applications. It is therefore important to find mechanisms to suppress such effects. Floquet prethermalization refers to the phenomenon where many-body systems subject to a high-frequency periodic drive avoid heating for very long times, instead tending to transient states that can host interesting physics. Its key signature is a strong parametric suppression of the heating rate as a function of the driving frequency. Here, we review our present understanding of this phenomenon in both quantum and classical systems, and across various models and methods. In particular, we present rigorous theorems underpinning Floquet prethermalization in quantum spin and fermionic lattice systems, extensions to systems with degrees of freedom that have unbounded local dimension. Further, we briefly describe applications to novel nonequilibrium phases of matter, and recent experiments probing prethermalization with quantum simulators. We close by describing the frontiers of Floquet prethermalization beyond strictly time-periodic drives, including time-quasiperiodic driving and long-lived quasi-conserved quantities enabled by large separation of energy scales., Comment: review paper, 15 pages, comments are welcome

In Floquet engineering, periodic driving is used to realize novel phases of matter which are inaccessible in thermal equilibrium. For this purpose, the Floquet theory provides us a recipe of obtaining a static effective Hamiltonian. Although many existing works have treated closed systems, it is important to consider the effect of dissipation, which is ubiquitous in nature. Understanding interplay of periodic driving and dissipation is not only a fundamental problem of nonequilibrium statistical physics, but also receiving growing interest because of the fact that experimental advances have allowed us to engineer dissipation in a controllable manner. In this review, we give a detailed exposition on the formalism of quantum master equations for open Floquet systems and highlight recent works investigating whether equilibrium statistical mechanics applies to Floquet states., Comment: Review article

It has been recognized that heavily overparameterized deep neural networks (DNNs) exhibit surprisingly good generalization performance in various machine-learning tasks. Although benefits of depth have been investigated from different perspectives such as the approximation theory and the statistical learning theory, existing theories do not adequately explain the empirical success of overparameterized DNNs. In this work, we report a remarkable interplay between depth and locality of a target function. We introduce $k$-local and $k$-global functions, and find that depth is beneficial for learning local functions but detrimental to learning global functions. This interplay is not properly captured by the neural tangent kernel, which describes an infinitely wide neural network within the lazy learning regime., Comment: 15 pages. This paper is a revised version of arXiv:2005.12488

We study quantum double dark-solitons by constructing corresponding quantum states in the Lieb-Liniger model for the one-dimensional Bose gas. Here we expect that the Gross-Pitaevskii (GP) equation should play a central role in the long distance mean-field behavior of the 1D Bose gas. We first introduce novel quantum states of a single dark soliton with a nonzero winding number. We show them by exactly evaluating not only the density profile but also the profiles of the square amplitude and phase of the matrix element of the field operator between the $N$-particle and $(N-1)$-particle states. For elliptic double dark-solitons, the density and phase profiles of the corresponding states almost perfectly agree with those of the classical solutions, respectively, in the weak coupling regime. We then show that the scheme of the mean-field product state is quite effective for the quantum states of double dark solitons. Assigning the ideal Gaussian weights to a sum of the excited states with two particle-hole excitations we obtain double dark-solitons of distinct narrow notches with different depths. We suggest that the mean-field product state should be well approximated by the ideal Gaussian weighted sum of the low excited states with a pair of particle-hole excitations. The results of double dark-solitons should be fundamental and useful for constructing quantum multiple dark-solitons., Comment: 36 pages, 16 figures

Heating under periodic driving is a generic nonequilibrium phenomenon, and it is a challenging problem in nonequilibrium statistical physics to derive a quantitatively accurate heating rate. In this work, we provide a simple formula on the heating rate under fast and strong periodic driving in classical and quantum many-body systems. The key idea behind the formula is constructing a time-dependent dressed Hamiltonian by moving to a rotating frame, which is found by a truncation of the high-frequency expansion of the micromotion operator, and applying the linear-response theory. It is confirmed for specific classical and quantum models that the second-order truncation of the high-frequency expansion yields quantitatively accurate heating rates beyond the linear-response regime. Our result implies that the information on heating dynamics is encoded in the first few terms of the high-frequency expansion, although heating is often associated with an asymptotically divergent behavior of the high-frequency expansion., Comment: 6+7 pages. To appear in Phys. Rev. Lett

Stochastic gradient descent (SGD) undergoes complicated multiplicative noise for the mean-square loss. We use this property of SGD noise to derive a stochastic differential equation (SDE) with simpler additive noise by performing a random time change. Using this formalism, we show that the log loss barrier $\Delta\log L=\log[L(\theta^s)/L(\theta^*)]$ between a local minimum $\theta^*$ and a saddle $\theta^s$ determines the escape rate of SGD from the local minimum, contrary to the previous results borrowing from physics that the linear loss barrier $\Delta L=L(\theta^s)-L(\theta^*)$ decides the escape rate. Our escape-rate formula strongly depends on the typical magnitude $h^*$ and the number $n$ of the outlier eigenvalues of the Hessian. This result explains an empirical fact that SGD prefers flat minima with low effective dimensions, giving an insight into implicit biases of SGD., Comment: 17+8 pages

Metastable states in stochastic systems are often characterized by the presence of small eigenvalues in the generator of the stochastic dynamics. We here show that metastability in many-body systems is not necessarily associated with small eigenvalues. Instead, many-body explosion of eigenmode expansion coefficients characterizes slow relaxation, which is demonstrated for two models, interacting particles in a double-well potential and the Fredrickson-Andersen model, the latter of which is a prototypical example of kinetically constrained models studied in glass and jamming transitions. Our results provide new insights into slow relaxation and metastability in many-body stochastic systems., Comment: 7 pages

The noise in stochastic gradient descent (SGD), caused by minibatch sampling, is poorly understood despite its practical importance in deep learning. This work presents the first systematic study of the SGD noise and fluctuations close to a local minimum. We first analyze the SGD noise in linear regression in detail and then derive a general formula for approximating SGD noise in different types of minima. For application, our results (1) provide insight into the stability of training a neural network, (2) suggest that a large learning rate can help generalization by introducing an implicit regularization, (3) explain why the linear learning rate-batchsize scaling law fails at a large learning rate or at a small batchsize and (4) can provide an understanding of how discrete-time nature of SGD affects the recently discovered power-law phenomenon of SGD., Comment: ICLR 2022 spotlight

The nonequilibrium quantum dynamics of closed many-body systems is a rich yet challenging field. While recent progress for periodically driven (Floquet) systems has yielded a number of rigorous results, our understanding on quantum many-body systems driven by rapidly varying but a- and quasi-periodic driving is still limited. Here, we derive rigorous, non-perturbative, bounds on the heating rate in quantum many-body systems under Thue-Morse quasi-periodic driving and under random multipolar driving, the latter being a tunably randomized variant of the former. In the process, we derive a static effective Hamiltonian that describes the transient prethermal state, including the dynamics of local observables. Our bound for Thue-Morse quasi-periodic driving suggests that the heating time scales like $(\omega/g)^{-C\ln(\omega/g)}$ with a positive constant $C$ and a typical energy scale $g$ of the Hamiltonian, in agreement with our numerical simulations., Comment: 5+6 pages, 2 figures

We investigate the relaxation dynamics of open non-integrable quantum many-body systems in the thermodynamic limit by using a tensor-network formalism. We simulate the Lindblad quantum master equation (LQME) of infinite systems by making use of the uniform matrix product operators (MPO) as the ansatz of their density matrices. Furthermore, we establish a method to measure the thermodynamic equivalence between two states described by the uniform MPOs. We numerically show that when an initial state of the LQME is a thermal Gibbs state, a time evolved state is always indistinguishable from a Gibbs state with a time-dependent effective temperature in the weak-dissipation and thermodynamic limit.

Recent studies have demonstrated that noise in stochastic gradient descent (SGD) is closely related to generalization: A larger SGD noise, if not too large, results in better generalization. Since the covariance of the SGD noise is proportional to $\eta^2/B$, where $\eta$ is the learning rate and $B$ is the minibatch size of SGD, the SGD noise has so far been controlled by changing $\eta$ and/or $B$. However, too large $\eta$ results in instability in the training dynamics and a small $B$ prevents scalable parallel computation. It is thus desirable to develop a method of controlling the SGD noise without changing $\eta$ and $B$. In this paper, we propose a method that achieves this goal using ``noise enhancement'', which is easily implemented in practice. We expound the underlying theoretical idea and demonstrate that the noise enhancement actually improves generalization for real datasets. It turns out that large-batch training with the noise enhancement even shows better generalization compared with small-batch training., Comment: 9 pages

The gap of the Liouvillian spectrum gives the asymptotic decay rate of a quantum dissipative system, and therefore its inverse has been identified as the slowest relaxation time. In contrary to this common belief, we show that the relaxation time due to diffusive transports in a boundary dissipated many-body quantum system is determined not by the gap or low-lying eigenvalues of the Liouvillian but by superexponentially large expansion coefficients for Liouvillian eigenvectors with non-small eigenvalues at an initial state. This finding resolves an apparent discrepancy reported in the literature between the inverse of the Liouvillian gap and the relaxation time in dissipative many-body quantum systems., Comment: 5+7 pages

It has been recognized that a heavily overparameterized artificial neural network exhibits surprisingly good generalization performance in various machine-learning tasks. Recent theoretical studies have made attempts to unveil the mystery of the overparameterization. In most of those previous works, the overparameterization is achieved by increasing the width of the network, while the effect of increasing the depth has remained less well understood. In this work, we investigate the effect of increasing the depth within an overparameterized regime. To gain an insight into the advantage of depth, we introduce local and global labels as abstract but simple classification rules. It turns out that the locality of the relevant feature for a given classification rule plays a key role; our experimental results suggest that deeper is better for local labels, whereas shallower is better for global labels. We also compare the results of finite networks with those of the neural tangent kernel (NTK), which is equivalent to an infinitely wide network with a proper initialization and an infinitesimal learning rate. It is shown that the NTK does not correctly capture the depth dependence of the generalization performance, which indicates the importance of the feature learning rather than the lazy learning., Comment: 13+4 pages

We investigate steady states of macroscopic quantum systems under dissipation not obeying the detailed balance condition. We argue that the Gibbs state at an effective temperature gives a good description of the steady state provided that the system Hamiltonian obeys the eigenstate thermalization hypothesis (ETH) and the perturbation theory in the weak system-environment coupling is valid in the thermodynamic limit. We derive a criterion to guarantee the validity of the perturbation theory, which is satisfied in the thermodynamic limit for sufficiently weak dissipation when the Liouvillian is gapped for bulk-dissipated systems, while the perturbation theory breaks down in boundary-dissipated chaotic systems due to the presence of diffusive transports. We numerically confirm these theoretical predictions. This work suggests a connection between steady states of macroscopic open quantum systems and the ETH., Comment: 11 pages, 7 figures

Quantum systems exhibit recurrence phenomena after equilibration, but it is a difficult task to evaluate the recurrence time of a quantum system because it drastically increases as the system size increases (usually double-exponential in the number of particles) and strongly depends on the initial state. Here, we analytically derive the recurrence times of the Lieb-Liniger model with relatively small particle numbers for the weak and strong coupling regimes. It turns out that these recurrence times are independent of the initial state and increases only polynomially in the system size., Comment: 8 pages, 2 figures

Dark soliton solutions in the one-dimensional classical nonlinear Schr\"odinger equation has been considered to be related to the yrast states corresponding to the type-II excitations in the Lieb-Liniger model. However, the relation is nontrivial and remains unclear because a dark soliton localized in space breaks the translation symmetry, while yrast states are translationally invariant. In this work, we construct a symmetry-broken quantum soliton state and investigate the relation to the yrast states. By interpreting a quantum dark soliton as a Bose-Einstein condensation to the wave function of a classical dark soliton, we find that the quantum soliton state has a large weight only on the yrast states, which is analytically proved in the free-boson limit and numerically verified in the weak-coupling regime. By extending these results, we derive a parameter-free expression of a quantum soliton state that is written as a superposition of yrast states with Gaussian weights. The density profile of this quantum soliton state excellently agrees to that of the classical dark soliton. The dynamics of a quantum dark soliton is also studied, and it turns out that the density profile of a dark soliton decays, but the decay time increases as the inverse of the coupling constant in the weak-coupling limit., Comment: 5 pages, 3 figures

Nonequilibrium dynamics of an isolated quantum spin chain with long-range Ising interactions that decay as $1/r^\alpha$ ($0<\alpha<1$) with the distance $r$ is studied. It turns out that long-range interactions give rise to a big timescale separation, which causes prethermalization for all $\alpha\in(0,1)$. This conclusion is deduced by comparing two important timescales relevant for relaxation dynamics; one is the relaxation time of local permutation operators, which are quasi-conserved quantities in this system, and the other is the timescale of the initial relaxation due to the growth of quantum fluctuations. We also explore the entire nonequilibrium dynamics by using the discrete truncated Wigner approximation, which is consistent with the result mentioned above., Comment: 24 pages, 5 figures

Integrable systems do not obey the strong eigenstate thermalization hypothesis (ETH), which has been proposed as a mechanism of thermalization in isolated quantum systems. It has been suggested that an integrable system reaches a steady state described by a generalized Gibbs ensemble (GGE) instead of thermal equilibrium. We prove that a generalized version of the strong ETH holds for noninteracting integrable systems with translation invariance. Our generalized ETH states that any pair of energy eigenstates with similar values of local conserved quantities looks similar with respect to local observables, such as local correlations. This result tells us that an integrable system relaxes to a GGE for any initial state that has subextensive fluctuations of macroscopic local conserved quantities. Contrary to the previous derivations of the GGE, it is not necessary to assume the cluster decomposition property for an initial state., Comment: 6 pages

We propose a simple construction of shortcuts to adiabaticity tracking instantaneous stationary states in classical spin systems without knowing tracked stationary states. In our construction, control fields of counter-diabatic driving are constituted by state-dependent magnetic fields, which can be easily determined with an aid of numerical calculations. Easiness of our construction is a remarkable feature since it is usually a hard task to determine explicit form of required counter-diabatic terms in many-body systems. We also argue that our method can be applied to solve combinatorial optimization problems by considering classical spin dynamics under a time-dependent Hamiltonian, which mimics the procedure of quantum annealing., Comment: Accepted for publication in PRE

It is proved that the energy absorption in a periodically driven classical spin system is exponentially slow in frequency, which results in a two-step relaxation called the Floquet prethermalization. This result is shown by establishing the classical limit of the quantum spin dynamics. The Floquet prethermal state is well described by the Gibbs ensemble with respect to the static effective Hamiltonian obtained by a truncation of the Floquet-Magnus expansion. On the other hand, the same effective Hamiltonian does not reproduce the local dynamics for an exponentially long time. This is due to the chaoticity of classical dynamics, and in stark contrast to quantum spin systems, in which the effective Hamiltonian well reproduces the exact quantum dynamics up to an exponentially long time., Comment: 14 pages, 3 figures; Updated to remove a fundamental flaw