Search

Independent learning (IL), despite being a popular approach in practice to achieve scalability in large-scale multi-agent systems, usually lacks global convergence guarantees. In this paper, we study two representative algorithms, independent $Q$-learning and independent natural actor-critic, within value-based and policy-based frameworks, and provide the first finite-sample analysis for approximate global convergence. The results imply a sample complexity of $\tilde{\mathcal{O}}(\epsilon^{-2})$ up to an error term that captures the dependence among agents and characterizes the fundamental limit of IL in achieving global convergence. To establish the result, we develop a novel approach for analyzing IL by constructing a separable Markov decision process (MDP) for convergence analysis and then bounding the gap due to model difference between the separable MDP and the original one. Moreover, we conduct numerical experiments using a synthetic MDP and an electric vehicle charging example to verify our theoretical findings and to demonstrate the practical applicability of IL.

Quantum friction, a quantum analog of classical friction, reduces the performance of quantum machines, such as heat engines, and makes them less energy efficient. We here report the experimental realization of an energy efficient quantum engine coupled to a quantum battery that stores the produced work, using a single ion in a linear Paul trap. We first establish the quantum nature of the device by observing nonclassical work oscillations with the number of cycles as verified by energy measurements of the battery. We moreover successfully apply shortcut-to-adiabaticity techniques to suppress quantum friction and improve work production. While the average energy cost of the shortcut protocol is only about $3\%$, the work output is enhanced by up to approximately 33$\%$, making the machine significantly more energy efficient. In addition, we show that the quantum engine consistently outperforms its classical counterpart in this regime. Our results pave the way for energy efficient machines with quantum-enhanced performance.

We study online policy optimization in nonlinear time-varying dynamical systems where the true dynamical models are unknown to the controller. This problem is challenging because, unlike in linear systems, the controller cannot obtain globally accurate estimations of the ground-truth dynamics using local exploration. We propose a meta-framework that combines a general online policy optimization algorithm ($\texttt{ALG}$) with a general online estimator of the dynamical system's model parameters ($\texttt{EST}$). We show that if the hypothetical joint dynamics induced by $\texttt{ALG}$ with known parameters satisfies several desired properties, the joint dynamics under inexact parameters from $\texttt{EST}$ will be robust to errors. Importantly, the final policy regret only depends on $\texttt{EST}$'s predictions on the visited trajectory, which relaxes a bottleneck on identifying the true parameters globally. To demonstrate our framework, we develop a computationally efficient variant of Gradient-based Adaptive Policy Selection, called Memoryless GAPS (M-GAPS), and use it to instantiate $\texttt{ALG}$. Combining M-GAPS with online gradient descent to instantiate $\texttt{EST}$ yields (to our knowledge) the first local regret bound for online policy optimization in nonlinear time-varying systems with unknown dynamics.

This paper presents a closed-form notion of controllability and observability for systems with communication delays, actuation delays, and locality constraints. The formulation reduces to classical notions of controllability and observability in the unconstrained setting. As a consequence of our formulation, we show that the addition of locality and communication constraints may not affect the controllability and observability of the system, and we provide an efficient sufficient condition under which this phenomenon occurs. This contrasts with actuation and sensing delays, which cause a gradual loss of controllability and observability as the delays increase. We illustrate our results using linearized swing equations for the power grid, showing how actuation delay and locality constraints affect controllability.

Squeezing a quantum state along a specific direction has long been recognized as a crucial technique for enhancing the precision of quantum metrology by reducing parameter uncertainty. However, practical quantum metrology often involves the simultaneous estimation of multiple parameters, necessitating the use of high-quality squeezed states along multiple orthogonal axes to surpass the standard quantum limit for all relevant parameters. In addition, a temporally stabilized squeezed state can provide an event-ready probe for parameters, regardless of the initial state, and robust to the timing of the state preparation process once stabilized. In this work, we generate and stabilize a two-mode squeezed state along two secular motional modes in a vibrating trapped ion with reservoir engineering, despite starting from a thermal state of the motion. Leveraging this resource, we demonstrate an estimation of two simultaneous collective displacements along the squeezed axes, achieving improvements surpassing the classical limit by up to 6.9(3) and 7.0(3) decibels (dB), respectively. Our demonstration can be readily scaled to squeezed states with even more modes. The practical implications of our findings span a wide range of applications, including quantum sensing, quantum imaging, and various fields that demand precise measurements of multiple parameters.

We aim to leverage diffusion to address the challenging image matting task. However, the presence of high computational overhead and the inconsistency of noise sampling between the training and inference processes pose significant obstacles to achieving this goal. In this paper, we present DiffMatte, a solution designed to effectively overcome these challenges. First, DiffMatte decouples the decoder from the intricately coupled matting network design, involving only one lightweight decoder in the iterations of the diffusion process. With such a strategy, DiffMatte mitigates the growth of computational overhead as the number of samples increases. Second, we employ a self-aligned training strategy with uniform time intervals, ensuring a consistent noise sampling between training and inference across the entire time domain. Our DiffMatte is designed with flexibility in mind and can seamlessly integrate into various modern matting architectures. Extensive experimental results demonstrate that DiffMatte not only reaches the state-of-the-art level on the Composition-1k test set, surpassing the best methods in the past by 5% and 15% in the SAD metric and MSE metric respectively, but also show stronger generalization ability in other benchmarks.

Zeros of partition functions, in particular Lee-Yang zeros, in a complex plane provide important information for understanding phase transitions. A recent discovery on the equivalence between the coherence of a central quantum system and the partition function of the environment in the complex plane enabled the experimental study of Lee-Yang zeros, with several pioneering experiments on spin systems. Lee-Yang zeros have not been observed in Bosonic systems. Here we propose an experimental scheme to demonstrate Lee-Yang zeros in Bosonic systems associated with a single trapped ion by introducing strong coupling between the spin and motion degrees of freedom, i.e. beyond the weak coupling Lamb-Dicke regime. Our scheme provides new possibilities for quantum simulation of the thermodynamics of Bosonic systems in the complex plane., Comment: 6 pages,6 figures

We study the tradeoff between consistency and robustness in the context of a single-trajectory time-varying Markov Decision Process (MDP) with untrusted machine-learned advice. Our work departs from the typical approach of treating advice as coming from black-box sources by instead considering a setting where additional information about how the advice is generated is available. We prove a first-of-its-kind consistency and robustness tradeoff given Q-value advice under a general MDP model that includes both continuous and discrete state/action spaces. Our results highlight that utilizing Q-value advice enables dynamic pursuit of the better of machine-learned advice and a robust baseline, thus result in near-optimal performance guarantees, which provably improves what can be obtained solely with black-box advice., Comment: 32 pages, NeurIPS 2023

We introduce a class of networked Markov potential games in which agents are associated with nodes in a network. Each agent has its own local potential function, and the reward of each agent depends only on the states and actions of the agents within a neighborhood. In this context, we propose a localized actor-critic algorithm. The algorithm is scalable since each agent uses only local information and does not need access to the global state. Further, the algorithm overcomes the curse of dimensionality through the use of function approximation. Our main results provide finite-sample guarantees up to a localization error and a function approximation error. Specifically, we achieve an $\tilde{\mathcal{O}}(\tilde{\epsilon}^{-4})$ sample complexity measured by the averaged Nash regret. This is the first finite-sample bound for multi-agent competitive games that does not depend on the number of agents.

This paper considers online switching control with a finite candidate controller pool, an unknown dynamical system, and unknown cost functions. The candidate controllers can be unstabilizing policies. We only require at least one candidate controller to satisfy certain stability properties, but we do not know which one is stabilizing. We design an online algorithm that guarantees finite-gain stability throughout the duration of its execution. We also provide a sublinear policy regret guarantee compared with the optimal stabilizing candidate controller. Lastly, we numerically test our algorithm on quadrotor planar flights and compare it with a classical switching control algorithm, falsification-based switching, and a classical multi-armed bandit algorithm, Exp3 with batches.

We study a multi-agent reinforcement learning (MARL) problem where the agents interact over a given network. The goal of the agents is to cooperatively maximize the average of their entropy-regularized long-term rewards. To overcome the curse of dimensionality and to reduce communication, we propose a Localized Policy Iteration (LPI) algorithm that provably learns a near-globally-optimal policy using only local information. In particular, we show that, despite restricting each agent's attention to only its $\kappa$-hop neighborhood, the agents are able to learn a policy with an optimality gap that decays polynomially in $\kappa$. In addition, we show the finite-sample convergence of LPI to the global optimal policy, which explicitly captures the trade-off between optimality and computational complexity in choosing $\kappa$. Numerical simulations demonstrate the effectiveness of LPI.

We study online adaptive policy selection in systems with time-varying costs and dynamics. We develop the Gradient-based Adaptive Policy Selection (GAPS) algorithm together with a general analytical framework for online policy selection via online optimization. Under our proposed notion of contractive policy classes, we show that GAPS approximates the behavior of an ideal online gradient descent algorithm on the policy parameters while requiring less information and computation. When convexity holds, our algorithm is the first to achieve optimal policy regret. When convexity does not hold, we provide the first local regret bound for online policy selection. Our numerical experiments show that GAPS can adapt to changing environments more quickly than existing benchmarks.

We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound is used to bound the per-step error of MPC, which leads to a bound on the dynamic regret. Thus, our pipeline reduces the study of MPC to the well-studied problem of perturbation analysis, enabling the derivation of regret bounds of MPC under a variety of settings. To demonstrate the power of our pipeline, we use it to generalize existing regret bounds on MPC in linear time-varying (LTV) systems to incorporate prediction errors on costs, dynamics, and disturbances. Further, our pipeline leads to regret bounds on MPC in systems with nonlinear dynamics and constraints.

We present a robust quantum optimal control framework for implementing fast entangling gates on ion-trap quantum processors. The framework leverages tailored laser pulses to drive the multiple vibrational sidebands of the ions to create phonon-mediated entangling gates and, unlike the state of the art, requires neither weak-coupling Lamb-Dicke approximation nor perturbation treatment. With the application of gradient-based optimal control, it enables finding amplitude- and phase-modulated laser control protocols that work beyond the Lamb-Dicke regime, promising gate speed at the order of microseconds comparable to the characteristic trap frequencies. Also, robustness requirements on the temperature of the ions and initial optical phase can be conveniently included to pursue high-quality fast gates against experimental imperfections. Our approach represents a step in speeding up quantum gates to achieve larger quantum circuits for quantum computation and simulation, and thus can find applications in near-future experiments., Comment: 9 pages, 3 figures

Non-Hermitian skin effect (NHSE) describes the exponential localization of all eigenstates toward boundaries in non-Hermitian systems, and has attracted intense research interest of late. Here we theoretically propose a scheme in which the NHSE significantly impacts the external motion of a single trapped ion through complex spin-motion dynamics. On the one hand, we show the competition between the NHSE and the coherent Bloch dynamics. On the other hand, since the NHSE manifests as a non-reciprocal flow in occupied phonon modes, we demonstrate that such dynamics can have potential applications in cooling and sensing. Our proposal can be readily implemented using existing experimental techniques, and offers a scalable (in terms of the available ions and phonon modes) simulation platform for relevant non-Hermitian physics., Comment: 9 pages, 8 figures

We study the problem of networked online convex optimization, where each agent individually decides on an action at every time step and agents cooperatively seek to minimize the total global cost over a finite horizon. The global cost is made up of three types of local costs: convex node costs, temporal interaction costs, and spatial interaction costs. In deciding their individual action at each time, an agent has access to predictions of local cost functions for the next $k$ time steps in an $r$-hop neighborhood. Our work proposes a novel online algorithm, Localized Predictive Control (LPC), which generalizes predictive control to multi-agent systems. We show that LPC achieves a competitive ratio of $1 + \tilde{O}(\rho_T^k) + \tilde{O}(\rho_S^r)$ in an adversarial setting, where $\rho_T$ and $\rho_S$ are constants in $(0, 1)$ that increase with the relative strength of temporal and spatial interaction costs, respectively. This is the first competitive ratio bound on decentralized predictive control for networked online convex optimization. Further, we show that the dependence on $k$ and $r$ in our results is near optimal by lower bounding the competitive ratio of any decentralized online algorithm.

Machine-learned black-box policies are ubiquitous for nonlinear control problems. Meanwhile, crude model information is often available for these problems from, e.g., linear approximations of nonlinear dynamics. We study the problem of equipping a black-box control policy with model-based advice for nonlinear control on a single trajectory. We first show a general negative result that a naive convex combination of a black-box policy and a linear model-based policy can lead to instability, even if the two policies are both stabilizing. We then propose an adaptive $\lambda$-confident policy, with a coefficient $\lambda$ indicating the confidence in a black-box policy, and prove its stability. With bounded nonlinearity, in addition, we show that the adaptive $\lambda$-confident policy achieves a bounded competitive ratio when a black-box policy is near-optimal. Finally, we propose an online learning approach to implement the adaptive $\lambda$-confident policy and verify its efficacy in case studies about the CartPole problem and a real-world electric vehicle (EV) charging problem with data bias due to COVID-19., Comment: 33 pages, 7 figures

This paper studies the trade-off between the degree of decentralization and the performance of a distributed controller in a linear-quadratic control setting. We study a system of interconnected agents over a graph and a distributed controller, called $\kappa$-distributed control, which lets the agents make control decisions based on the state information within distance $\kappa$ on the underlying graph. This controller can tune its degree of decentralization using the parameter $\kappa$ and thus allows a characterization of the relationship between decentralization and performance. We show that under mild assumptions, including stabilizability, detectability, and a subexponentially growing graph condition, the performance difference between $\kappa$-distributed control and centralized optimal control becomes exponentially small in $\kappa$. This result reveals that distributed control can achieve near-optimal performance with a moderate degree of decentralization, and thus it is an effective controller architecture for large-scale networked systems.

Quantum information processing with multi-level systems (qudits) provides additional features and applications than the two-level systems. However, qudits are more prone to dephasing and dynamical decoupling for qudits has never been experimentally demonstrated. Here, as a proof-of-principle demonstration, we experimentally apply dynamical decoupling to protect superpositions with three levels of a trapped $^9\rm{Be}^+$ ion from ambient noisy magnetic field, prolonging coherence by up to approximately an order of magnitude. Our demonstration, straightforwardly scalable to more levels, may open up a path toward long coherence quantum memory, metrology and information processing with qudits., Comment: 6 pages, 7 figures

Triply degenerate points (TDPs), which correspond to new types of topological semimetals, can support novel quasiparticles possessing effective integer spins while preserving Fermi statistics. Here by mapping the momentum space to the parameter space of a three-level system in a trapped ion, we experimentally explore the transitions between different types of TDPs driven by spin-tensor--momentum couplings. We observe the phase transitions between TDPs with different topological charges by measuring the Berry flux on a loop surrounding the gap-closing lines, and the jump of the Berry flux gives the jump of the topological charge (up to a $2\pi$ factor) across the transitions. For the Berry flux measurement, we employ a new method by examining the geometric rotations of both spin vectors and tensors, which lead to a generalized solid angle equal to the Berry flux. The controllability of multi-level ion offers a versatile platform to study high-spin physics and our work paves the way to explore novel topological phenomena therein., Comment: 9 pages, 10 figures

Along with the scaling of dimensions in quantum systems, transitions between the system's energy levels would become close in frequency, which are conventionally resolved by weak and lengthy pulses. Here, we extend and experimentally demonstrate analytically based swift quantum control techniques on a four-level trapped ion system, where we perform individual or simultaneous control over two pairs of spectrally nearby transitions with tailored time-varied drive, achieving operational fidelities ranging from 99.2(3)\% to 99.6(3)\%. Remarkably, we achieve approximately an order of magnitude speed up comparing with the case of weak square pulse for a general control. Therefore, our demonstration may be beneficial to a broad range of quantum systems with crowded spectrum, for spectroscopy, quantum information processing and quantum simulation., Comment: 9 pages, 5 figures

We study a variant of online optimization in which the learner receives $k$-round $\textit{delayed feedback}$ about hitting cost and there is a multi-step nonlinear switching cost, i.e., costs depend on multiple previous actions in a nonlinear manner. Our main result shows that a novel Iterative Regularized Online Balanced Descent (iROBD) algorithm has a constant, dimension-free competitive ratio that is $O(L^{2k})$, where $L$ is the Lipschitz constant of the switching cost. Additionally, we provide lower bounds that illustrate the Lipschitz condition is required and the dependencies on $k$ and $L$ are tight. Finally, via reductions, we show that this setting is closely related to online control problems with delay, nonlinear dynamics, and adversarial disturbances, where iROBD directly offers constant-competitive online policies.

We study predictive control in a setting where the dynamics are time-varying and linear, and the costs are time-varying and well-conditioned. At each time step, the controller receives the exact predictions of costs, dynamics, and disturbances for the future $k$ time steps. We show that when the prediction window $k$ is sufficiently large, predictive control is input-to-state stable and achieves a dynamic regret of $O(\lambda^k T)$, where $\lambda < 1$ is a positive constant. This is the first dynamic regret bound on the predictive control of linear time-varying systems. Under more assumptions on the terminal costs, we also show that predictive control obtains the first competitive bound for the control of linear time-varying systems: $1 + O(\lambda^k)$. Our results are derived using a novel proof framework based on a perturbation bound that characterizes how a small change to the system parameters impacts the optimal trajectory.

High fidelity single-shot readout of qubits is a crucial component for fault-tolerant quantum computing and scalable quantum networks. In recent years, the nitrogen-vacancy (NV) center in diamond has risen as a leading platform for the above applications. The current single-shot readout of the NV electron spin relies on resonance fluorescence method at cryogenic temperature. However, the the spin-flip process interrupts the optical cycling transition, therefore, limits the readout fidelity. Here, we introduce a spin-to-charge conversion method assisted by near-infrared (NIR) light to suppress the spin-flip error. This method leverages high spin-selectivity of cryogenic resonance excitation and high flexibility of photonionization. We achieve an overall fidelity $>$ 95% for the single-shot readout of an NV center electron spin in the presence of high strain and fast spin-flip process. With further improvements, this technique has the potential to achieve spin readout fidelity exceeding the fault-tolerant threshold, and may also find applications on integrated optoelectronic devices.

A general bound on the Lyapunov exponent of a quantum system is given by $\lambda_L\leq2\pi\,T/\hbar$, where $T$ is the system temperature, as established by Maldacena, Shenker, and Stanford (MSS). This upper bound is saturated when the system under consideration is the exact holographic dual of a black hole. It has also been shown that an inverted harmonic oscillator (IHO) may exhibit the behavior of thermal energy emission, in close analogy to the Hawking radiation emitted by black holes. We demonstrate that the Lyapunov exponent of the IHO indeed saturates the MSS bound, with an effective temperature equal to the analogue black hole radiation temperature, and propose using a trapped ion as a physical implementation of the IHO. We derive the corresponding out-of-time-ordered correlation function (OTOC) diagnosing quantum chaos, and theoretically show, for an experimentally realizable setup, that the effective temperature of the trapped-ion-IHO matches the upper MSS bound for the speed of scrambling., Comment: 7 pages of RevTex4-1, 3 figures

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we identify a rich class of networked MARL problems where the model exhibits a local dependence structure that allows it to be solved in a scalable manner. Specifically, we propose a Scalable Actor-Critic (SAC) method that can learn a near optimal localized policy for optimizing the average reward with complexity scaling with the state-action space size of local neighborhoods, as opposed to the entire network. Our result centers around identifying and exploiting an exponential decay property that ensures the effect of agents on each other decays exponentially fast in their graph distance.

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because the size of the global state/action space can be exponential in the number of agents. Scalable algorithms are only known in cases where dependencies are static, fixed and local, e.g., between neighbors in a fixed, time-invariant underlying graph. In this work, we propose a Scalable Actor Critic framework that applies in settings where the dependencies can be non-local and stochastic, and provide a finite-time error bound that shows how the convergence rate depends on the speed of information spread in the network. Additionally, as a byproduct of our analysis, we obtain novel finite-time convergence results for a general stochastic approximation scheme and for temporal difference learning with state aggregation, which apply beyond the setting of MARL in networked systems.

This paper presents competitive algorithms for a novel class of online optimization problems with memory. We consider a setting where the learner seeks to minimize the sum of a hitting cost and a switching cost that depends on the previous $p$ decisions. This setting generalizes Smoothed Online Convex Optimization. The proposed approach, Optimistic Regularized Online Balanced Descent, achieves a constant, dimension-free competitive ratio. Further, we show a connection between online optimization with memory and online control with adversarial disturbances. This connection, in turn, leads to a new constant-competitive policy for a rich class of online control problems., Comment: Neural Information Processing Systems (NeurIPS 2020)

Conventional information processors freely convert information between different physical carriers to process, store, or transmit information. It seems plausible that quantum information will also be held by different physical carriers in applications such as tests of fundamental physics, quantum-enhanced sensors, and quantum information processing. Quantum-controlled molecules in particular could transduce quantum information across a wide range of quantum-bit (qubit) frequencies, from a few kHz for transitions within the same rotational manifold, a few GHz for hyperfine transitions, up to a few THz for rotational transitions, to hundreds of THz for fundamental and overtone vibrational and electronic transitions, possibly all within the same molecule. Here, we report the first demonstration of entanglement between states of the rotation of a $\rm^{40}CaH^+$ molecular ion and internal states of a $\rm^{40}Ca^+$ atomic ion. The qubit addressed in the molecule has a frequency of either 13.4 kHz or 855 GHz, highlighting the versatility of molecular qubits. This work demonstrates how molecules can transduce quantum information between qubits with different frequencies to enable hybrid quantum systems. We anticipate that quantum control and measurement of molecules as demonstrated here will create opportunities for quantum information science, quantum sensors, fundamental and applied physics, and controlled quantum chemistry., Comment: 19 pages, 3 figures

Spectroscopy is a powerful tool for studying molecules and is commonly performed on large thermal molecular ensembles that are perturbed by motional shifts and interactions with the environment and one another, resulting in convoluted spectra and limited resolution. Here, we use generally applicable quantum-logic techniques to prepare a trapped molecular ion in a single quantum state, drive terahertz rotational transitions with an optical frequency comb, and read out the final state non-destructively, leaving the molecule ready for further manipulation. We resolve rotational transitions to 11 significant digits and derive the rotational constant of CaH+ to be B_R = 142501777.9(1.7) kHz. Our approach suits a wide range of molecular ions, including polyatomics and species relevant for tests of fundamental physics, chemistry, and astrophysics., Comment: 25 pages, 4 figures, 6 tables

We study online optimization in a setting where an online learner seeks to optimize a per-round hitting cost, which may be non-convex, while incurring a movement cost when changing actions between rounds. We ask: \textit{under what general conditions is it possible for an online learner to leverage predictions of future cost functions in order to achieve near-optimal costs?} Prior work has provided near-optimal online algorithms for specific combinations of assumptions about hitting and switching costs, but no general results are known. In this work, we give two general sufficient conditions that specify a relationship between the hitting and movement costs which guarantees that a new algorithm, Synchronized Fixed Horizon Control (SFHC), provides a $1+O(1/w)$ competitive ratio, where $w$ is the number of predictions available to the learner. Our conditions do not require the cost functions to be convex, and we also derive competitive ratio results for non-convex hitting and movement costs. Our results provide the first constant, dimension-free competitive ratio for online non-convex optimization with movement costs. Further, we give an example of a natural instance, Convex Body Chasing (CBC), where the sufficient conditions are not satisfied and we can prove that no online algorithm can have a competitive ratio that converges to 1.

We study online convex optimization in a setting where the learner seeks to minimize the sum of a per-round hitting cost and a movement cost which is incurred when changing decisions between rounds. We prove a new lower bound on the competitive ratio of any online algorithm in the setting where the costs are $m$-strongly convex and the movement costs are the squared $\ell_2$ norm. This lower bound shows that no algorithm can achieve a competitive ratio that is $o(m^{-1/2})$ as $m$ tends to zero. No existing algorithms have competitive ratios matching this bound, and we show that the state-of-the-art algorithm, Online Balanced Decent (OBD), has a competitive ratio that is $\Omega(m^{-2/3})$. We additionally propose two new algorithms, Greedy OBD (G-OBD) and Regularized OBD (R-OBD) and prove that both algorithms have an $O(m^{-1/2})$ competitive ratio. The result for G-OBD holds when the hitting costs are quasiconvex and the movement costs are the squared $\ell_2$ norm, while the result for R-OBD holds when the hitting costs are $m$-strongly convex and the movement costs are Bregman Divergences. Further, we show that R-OBD simultaneously achieves constant, dimension-free competitive ratio and sublinear regret when hitting costs are strongly convex.

We explore the prospects and benefits of combining the techniques of cavity optomechanics with efforts to image spins using magnetic resonance force microscopy (MRFM). In particular, we focus on a common mechanical resonator used in cavity optomechanics -- high-stress stoichiometric silicon nitride (Si$_3$N$_4$) membranes. We present experimental work with a trampoline membrane resonator that has a quality factor above $10^6$ and an order of magnitude lower mass than a comparable standard membrane resonators. Such high-stress resonators are on a trajectory to reach 0.1 $\rm{aN}/\sqrt{\rm{Hz}}$ force sensitivities at MHz frequencies by using techniques such as soft clamping and phononic-crystal control of acoustic radiation in combination with cryogenic cooling. We present a demonstration of force-detected electron spin resonance of an ensemble at room temperature using the trampoline resonators functionalized with a magnetic grain. We discuss prospects for combining such a resonator with an integrated Fabry-Perot cavity readout at cryogenic temperatures, and provide ideas for future impacts of membrane cavity optomechanical devices on MRFM of nuclear spins., Comment: 19 pages, 8 figures, 3 tables

Entanglement generation can be robust against noise in approaches that deliberately incorporate dissipation into the system dynamics. The presence of additional dissipation channels may, however, limit fidelity and speed of the process. Here we show how quantum optimal control techniques can be used to both speed up the entanglement generation and increase the fidelity in a realistic setup, whilst respecting typical experimental limitations. For the example of entangling two trapped ion qubits [Lin et al., Nature 504, 415 (2013)], we find an improved fidelity by simply optimizing the polarization of the laser beams utilized in the experiment. More significantly, an alternate combination of transitions between internal states of the ions, when combined with optimized polarization, enables faster entanglement and decreases the error by an order of magnitude., Comment: 16 pages, 8 figures

Atomic magnetometry is one of the most sensitive ways to measure magnetic fields. We present a method for converting a naturally scalar atomic magnetometer into a vector magnetometer by exploiting the polarization dependence of hyperfine transitions in rubidium atoms. First, we fully determine the polarization ellipse of an applied microwave field using a self-calibrating method, i.e. a method in which the light-atom interaction provides everything required to know the field in an orthogonal laboratory frame. We then measure the direction of an applied static field using the polarization ellipse as a three-dimensional reference defined by Maxwell's equations. Although demonstrated with trapped atoms, this technique could be applied to atomic vapors, or a variety of atom-like systems., Comment: 5 pages, 3 figures + supplementary 11 pages, 5 figure

We demonstrate the ability to extract a spin-entangled state of two neutral atoms via postselection based on a measurement of their spatial configuration. Typically, entangled states of neutral atoms are engineered via atom-atom interactions. In contrast, in our work we use Hong-Ou-Mandel interference to postselect a spin-singlet state after overlapping two atoms in distinct spin states on an effective beam splitter. We verify the presence of entanglement and determine a bound on the postselected fidelity of a spin-singlet state of $\left(0.62 \pm 0.03\right)$. The experiment has direct analogy to creating polarization entanglement with single photons and hence demonstrates the potential to use protocols developed for photons to create complex quantum states with noninteracting atoms., Comment: 11 pages, 4 figures

We examine theoretically how dipole-dipole interactions arising from multiple photon scattering lead to a modified distribution of ground state populations in a driven, ordered 1D array of multilevel atoms. Specifically, we devise a level configuration in which a ground-state population accumulated due solely to dipole-dipole interactions can be up to 20\% in regimes accessible to current experiments with neutral atom arrays. For much larger systems, the steady state can consist of an equal distribution of population across the ground state manifold. Our results illustrate how dipole-dipole interactions can be accentuated through interference, and regulated by the geometry of ordered atom arrays. More generally, control techniques for multilevel atoms that can be degraded by multiple scattering, such as optical pumping, will benefit from an improved understanding and control of dipole-dipole interactions available in ordered arrays., Comment: paper is now identical to published version

High quality AlxGa1-xAs distributed Bragg reflectors (DBRs) were successfully monolithically grown on on-axis Si (100) substrates via a Ge layer formed by aspect ratio trapping (ART) technique. The GaAs/ART-Ge/Si-based DBRs have reflectivity spectra comparable to those grown on conventional bulk off-cut GaAs substrates and have smooth morphology, and good periodicity and uniformity. Anitphase domain formation is significantly reduced in GaAs on ART-Ge/Si substrates, and etch pit density of the GaAs base layer on the ART-Ge substrates ranges from 10^5 to 6 x 10^6 cm^(-2). These results paved the way for future VCSEL growth and fabrication on these ART-Ge substrates and also confirm that virtual Ge substrates via ART technique are effective Si platforms for optoelectronic integrated circuits.

Micro-Raman spectroscopy was employed to study the near-surface stress distributions and origins in Si around through silicon vias (TSVs) at both room temperature and elevated temperatures for Cu-filled and CNT-filled TSV samples. From the observations, we proved that the stresses near TSVs are mainly from two sources: 1) pre-existing stress before via filling, and 2) coefficients of thermal expansion (CTE) mismatch-induced stress. CTE-mismatch-induced stress is shown to dominate the compressive regime of the near-surface stress distribution around Cu-filled TSV structures, while pre-existing stress dominates the full range of the stress distribution in the CNT-filled TSV structures. Once the pre-existing stress is minimized, the total stress around CNT-filled TSVs can be minimized accordingly. Therefore, compared to Cu-filled TSVs, CNT-filled TSVs hold the potential to circumvent the hassle of stress-aware circuit layout and to solve the stress-related reliability issues.

A protocol is discussed for preparing a spin chain in a generic many-body state in the asymptotic limit of tailored non-unitary dynamics. The dynamics require the spectral resolution of the target state, optimized coherent pulses, engineered dissipation, and feedback. As an example, we discuss the preparation of an entangled antiferromagnetic state, and argue that the procedure can be applied to chains of trapped ions or Rydberg atoms., Comment: 5 pages, 4 figures