Search

We present Bloom Library, a linguistically diverse set of multimodal and multilingual datasets for language modeling, image captioning, visual storytelling, and speech synthesis/recognition. These datasets represent either the most, or among the most, multilingual datasets for each of the included downstream tasks. In total, the initial release of the Bloom Library datasets covers 363 languages across 32 language families. We train downstream task models for various languages represented in the data, showing the viability of the data for future work in low-resource, multimodal NLP and establishing the first known baselines for these downstream tasks in certain languages (e.g., Bisu [bzi], with an estimated population of 700 users). Some of these first-of-their-kind baselines are comparable to state-of-the-art performance for higher-resourced languages. The Bloom Library datasets are released under Creative Commons licenses on the Hugging Face datasets hub to catalyze more linguistically diverse research in the included downstream tasks., Comment: 14 pages, 1 figure, 3 tables, accepted to and presented at EMNLP 2022

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition on edge devices. This approach uses both language identification and accent identification to select one of multiple monolingual ASR models on-the-fly, each fine-tuned for a particular accent. Initial results for both recognition performance and resource usage are promising with our approach using less than 1/12th of the memory consumed by other solutions., Comment: Accepted to IEEE WF-IOT 2021

Research in NLP lacks geographic diversity, and the question of how NLP can be scaled to low-resourced languages has not yet been adequately solved. "Low-resourced"-ness is a complex problem going beyond data availability and reflects systemic problems in society. In this paper, we focus on the task of Machine Translation (MT), that plays a crucial role for information accessibility and communication worldwide. Despite immense improvements in MT over the past decade, MT is centered around a few high-resourced languages. As MT researchers cannot solve the problem of low-resourcedness alone, we propose participatory research as a means to involve all necessary agents required in the MT development process. We demonstrate the feasibility and scalability of participatory research with a case study on MT for African languages. Its implementation leads to a collection of novel translation datasets, MT benchmarks for over 30 languages, with human evaluations for a third of them, and enables participants without formal training to make a unique scientific contribution. Benchmarks, models, data, code, and evaluation results are released under https://github.com/masakhane-io/masakhane-mt., Comment: Findings of EMNLP 2020; updated benchmarks

Africa has over 2000 languages. Despite this, African languages account for a small portion of available resources and publications in Natural Language Processing (NLP). This is due to multiple factors, including: a lack of focus from government and funding, discoverability, a lack of community, sheer language complexity, difficulty in reproducing papers and no benchmarks to compare techniques. To begin to address the identified problems, MASAKHANE, an open-source, continent-wide, distributed, online research effort for machine translation for African languages, was founded. In this paper, we discuss our methodology for building the community and spurring research from the African continent, as well as outline the success of the community in terms of addressing the identified problems affecting African NLP., Comment: Accepted for the AfricaNLP Workshop, ICLR 2020

We introduce a modular system that can be deployed on any Kubernetes cluster for question answering via REST API. This system, called Katecheo, includes three configurable modules that collectively enable identification of questions, classification of those questions into topics, document search, and reading comprehension. We demonstrate the system using publicly available knowledge base articles extracted from Stack Exchange sites. However, users can extend the system to any number of topics, or domains, without the need to modify any of the model serving code or train their own models. All components of the system are open source and available under a permissive Apache 2 License., Comment: ACL 2020 system demo submission, 7 pages, 3 figures, 3 tables

We show that the energetics and lifetimes of resonances of finite systems under an external electric field can be captured by Kohn--Sham density functional theory (DFT) within the formalism of uniform complex scaling. Properties of resonances are calculated self-consistently in terms of complex densities, potentials and wavefunctions using adapted versions of the known algorithms from DFT. We illustrate this new formalism by calculating ionization rates using the complex-scaled local density approximation and exact exchange. We consider a variety of atoms (H, He, Li and Be) as well as the hydrogen molecule. Extensions are briefly discussed., Comment: 5 pages, 5 figures. This document is the unedited Author's version of a Submitted Work that was subsequently accepted for publication in J.Phys.Chem.Lett., copyright (c) American Chemical Society after peer review. To access the final edited and published work see http://pubs.acs.org/doi/abs/10.1021/jz401110h

This paper has been withdrawn by the authors; the main conclusion is incorrect, as some of the crucial calculations were not properly converged., Comment: This paper has been withdrawn

The s-wave interaction is usually the dominant form of interactions in atomic Bose-Einstein condensates (BECs). Recently, Feshbach resonances have been employed to reduce the strength of the s-wave interaction in many atomic speicies. This opens the possibilities to study magnetic dipole-dipole interactions (MDDI) in BECs, where the novel physics resulting from long-range and anisotropic dipolar interactions can be explored. Using a variational method, we study the effect of MDDI on the statics and dynamics of atomic BECs with tunable s-wave interactions. We benchmark our calculation against previously observed MDDI effects in $^{52}$Cr with excellent agreement, and predict new effects that should be promising to observe experimentally. A parameter of magnetic Feshbach resonances, $\epsilon_{dd,\text{max}}$, is used to quantitatively indicate the feasibility of experimentally observing MDDI effects in different atomic species. We find that strong MDDI effects should be observable in both in-trap and time-of-flight behaviors for the alkali BECs of $^{7}$Li, $^{39}$K, and $^{133}$Cs. Our results provide a helpful guide for experimentalists to realize and study atomic dipolar quantum gases., Comment: 10 pages, 10 figures, 3 tables

Aspects of Density Functional Resonance Theory (DFRT) [Phys. Rev. Lett. \textbf{107}, 163002 (2011)], a recently developed complex-scaled version of ground-state Density Functional Theory (DFT), are studied in detail. The asymptotic behavior of the complex density function is related to the complex resonance energy and system's threshold energy, and the function's local oscillatory behavior is connected with preferential directions of electron decay. Practical considerations for implementation of the theory are addressed including sensitivity to the complex-scaling parameter, $\theta$. In Kohn-Sham DFRT, it is shown that almost all $\theta$-dependence in the calculated energies and lifetimes can be extinguished via use of a proper basis set or fine grid. The highest occupied Kohn-Sham orbital energy and lifetime are related to a physical affinity and width, and the threshold energy of the Kohn-Sham system is shown to be equal to the threshold energy of the interacting system shifted by a well-defined functional. Finally, various complex-scaling conditions are derived which relate the functionals of ground-state DFT to those of DFRT via proper scaling factors and a non-Hermitian coupling constant system., Comment: 20 pages, 3 figures

The derivative discontinuity in the exact exchange-correlation potential of ensemble Density Functional Theory (DFT) is investigated at the specific integer number that corresponds to the maximum number of bound electrons, $J_{max}$. A recently developed complex-scaled analog of DFT is extended to fractional particle numbers and used to study ensembles of both bound and metastable states. It is found that the exact exchange-correlation potential experiences discontinuous jumps at integer particle numbers including $J_{max}$. For integers below $J_{max}$ the jump is purely real because of the real shift in the chemical potential. At $J_{max}$, the jump has a non-zero imaginary component reflecting the finite lifetime of the $(J_{max}+1)$ state., Comment: 8 pages, 6 figures

Density Functional Resonance Theory (DFRT) is a complex-scaled version of ground-state Density Functional Theory (DFT) that allows one to calculate the resonance energies and lifetimes of metastable anions. In this formalism, the exact energy and lifetime of the lowest-energy resonance of unbound systems is encoded into a complex "density" that can be obtained via complex-coordinate scaling. This complex density is used as the primary variable in a DFRT calculation just as the ground-state density would be used as the primary variable in DFT. As in DFT, there exists a mapping of the N-electron interacting system to a Kohn-Sham system of N non-interacting particles in DFRT. This mapping facilitates self consistent calculations with an initial guess for the complex density, as illustrated with an exactly-solvable model system. Whereas DFRT yields in principle the exact resonance energy and lifetime of the interacting system, we find that neglecting the complex-correlation contribution leads to errors of similar magnitude to those of standard scattering close-coupling calculations under the bound-state approximation., Comment: 5 pages, 4 figures

The ab-initio calculation of resonance lifetimes of metastable anions challenges modern quantum-chemical methods. The exact lifetime of the lowest-energy resonance is encoded into a complex "density" that can be obtained via complex-coordinate scaling. We illustrate this with one-electron examples and show how the lifetime can be extracted from the complex density in much the same way as the ground-state energy of bound systems is extracted from its ground-state density.