Search

Most of the world's languages and dialects are low-resource, and lack support in mainstream machine translation (MT) models. However, many of them have a closely-related high-resource language (HRL) neighbor, and differ in linguistically regular ways from it. This underscores the importance of model robustness to dialectical variation and cross-lingual generalization to the HRL dialect continuum. We present DialUp, consisting of a training-time technique for adapting a pretrained model to dialectical data (M->D), and an inference-time intervention adapting dialectical data to the model expertise (D->M). M->D induces model robustness to potentially unseen and unknown dialects by exposure to synthetic data exemplifying linguistic mechanisms of dialectical variation, whereas D->M treats dialectical divergence for known target dialects. These methods show considerable performance gains for several dialects from four language families, and modest gains for two other language families. We also conduct feature and error analyses, which show that language varieties with low baseline MT performance are more likely to benefit from these approaches., Comment: 9 pages, 46 incl. appendix

Historical linguists have long written "programs" that convert reconstructed words in an ancestor language into their attested descendants via ordered string rewrite functions (called sound laws) However, writing these programs is time-consuming, motivating the development of automated Sound Law Induction (SLI) which we formulate as Programming by Examples (PBE) with Large Language Models (LLMs) in this paper. While LLMs have been effective for code generation, recent work has shown that PBE is challenging but improvable by fine-tuning, especially with training data drawn from the same distribution as evaluation data. In this paper, we create a conceptual framework of what constitutes a "similar distribution" for SLI and propose four kinds of synthetic data generation methods with varying amounts of inductive bias to investigate what leads to the best performance. Based on the results we create a SOTA open-source model for SLI as PBE (+6% pass rate with a third of the parameters of the second-best LLM) and also highlight exciting future directions for PBE research.

Purpose: This commentary introduces how artificial intelligence (AI) can be leveraged to advance cross-language intelligibility assessment of dysarthric speech. Method: We propose a dual-component framework consisting of a universal module that generates language-independent speech representations and a language-specific intelligibility model that incorporates linguistic nuances. Additionally, we identify key barriers to cross-language intelligibility assessment, including data scarcity, annotation complexity, and limited linguistic insights, and present AI-driven solutions to overcome these challenges. Conclusion: Advances in AI offer transformative opportunities to enhance cross-language intelligibility assessment for dysarthric speech by balancing scalability across languages and adaptability by languages., Comment: 10 pages, 1 figure, 2 tables

This paper explores the application of quantum-hydrodynamic models to study two-dimensional electron gases, with a focus on nonlocal plasmonics and nonlinear optics. We begin by reviewing the derivation of the Madelung equations from the Wigner distribution function. Using the Madelung equations in conjunction with Poisson's equation, we calculate the spectrum of magnetoplasmons and the magneto-optical conductivity in the electrostatic regime, incorporating nonlocal corrections due to the Fermi pressure. In the absence of a magnetic field, we analyze nonlinear and nonlocal second-harmonic generation, demonstrating how plasmon excitation enhances this process. We further discuss the emergence of self-modulation phenomena driven by nonlinearity, leading to the renormalization of the plasmon dispersion. Notably, we show that nonlinearity amplifies nonlocal effects and, leveraging the hydrodynamic formalism, derive a simple analytic expression for the renormalized spectra. Additionally, we examine the role of the quantum potential, interpreted as a gradient correction to the Thomas--Fermi kinetic energy. Our results provide new insights into quantum effects in plasmonic systems, with significant implications for future advances in nanophotonics through the lens of hydrodynamic theory., Comment: 14 pages and 4 figures

Plasmonic gap structures are among the few configurations capable of generating extreme light confinement, finding applications in surface-enhanced spectroscopy, ultrasensitive detection, photocatalysis and more. Their plasmonic response undergoes a dramatic, quantum effect-driven transition as the gap size approaches zero. Modal analysis can reveal insights into the mechanisms governing this process, which are otherwise obscured by nonlocal damping effects. Here, we offer a fresh modal perspective on the transition of the plasmonic response using quantum hydrodynamic theory (QHT)-based quasinormal mode (QNM) analysis. Focusing on the bonding dipolar and charge-transfer plasmons of a nanosphere dimer, we examine the detailed mode transition through the touching regime as well as the asymptotic behavior compared with the classical results as the constituent nanoparticles either separate or overlap. The complex eigenfrequency particularly provides accurate information on the linewidth and quality factor of the plasmon modes. We introduce an index to characterize charge-transfer efficiency, especially for the charge-transfer plasmon. The significant role of nonlocal damping in the mode evolution is elucidated by our mode-resolved QHT-QNM analysis. The insights from our theoretical study provide an integrated understanding of mode evolution in plasmonic gap structures, which can further advance gap structure-based applications.

As global life expectancy increases, so does the burden of chronic diseases, yet individuals exhibit considerable variability in the rate at which they age. Identifying biomarkers that distinguish fast from slow ageing is crucial for understanding the biology of ageing, enabling early disease detection, and improving prevention strategies. Using contrastive deep learning, we show that skin biopsy images alone are sufficient to determine an individual's age. We then use visual features in histopathology slides of the skin biopsies to construct a novel biomarker of ageing. By linking with comprehensive health registers in Denmark, we demonstrate that visual features in histopathology slides of skin biopsies predict mortality and the prevalence of chronic age-related diseases. Our work highlights how routinely collected health data can provide additional value when used together with deep learning, by creating a new biomarker for ageing which can be actively used to determine mortality over time., Comment: 20 pages, 5 tables, 5 figures Under review: npj Digital Medicine

Cathodoluminescence (CL) microscopy has emerged as a powerful tool for investigating the optical properties of materials at the nanoscale, offering unique insights into the behavior of photonic and plasmonic materials under electron excitation. We introduce an atlas of bulk CL spectra for a range of materials widely used in photonics and plasmonics. Through a combination of experimental CL spectroscopy and Monte Carlo simulations, we characterize electron penetration depth and energy deposition, offering a foundational reference for interpreting CL spectra and understanding material behavior under electron excitation. By capturing CL signal from a diverse range of materials, this atlas provides insights into the intrinsic emission properties essential for material selection and design in photonic and plasmonic device engineering.

What mechanisms underlie linguistic generalization in large language models (LLMs)? This question has attracted considerable attention, with most studies analyzing the extent to which the language skills of LLMs resemble rules. As of yet, it is not known whether linguistic generalization in LLMs could equally well be explained as the result of analogical processes, which can be formalized as similarity operations on stored exemplars. A key shortcoming of prior research is its focus on linguistic phenomena with a high degree of regularity, for which rule-based and analogical approaches make the same predictions. Here, we instead examine derivational morphology, specifically English adjective nominalization, which displays notable variability. We introduce a new method for investigating linguistic generalization in LLMs: focusing on GPT-J, we fit cognitive models that instantiate rule-based and analogical learning to the LLM training data and compare their predictions on a set of nonce adjectives with those of the LLM, allowing us to draw direct conclusions regarding underlying mechanisms. As expected, rule-based and analogical models explain the predictions of GPT-J equally well for adjectives with regular nominalization patterns. However, for adjectives with variable nominalization patterns, the analogical model provides a much better match. Furthermore, GPT-J's behavior is sensitive to the individual word frequencies, even for regular forms, a behavior that is consistent with an analogical account of regular forms but not a rule-based one. These findings refute the hypothesis that GPT-J's linguistic generalization on adjective nominalization involves rules, suggesting similarity operations on stored exemplars as the underlying mechanism. Overall, our study suggests that analogical processes play a bigger role in the linguistic generalization of LLMs than previously thought.

Common techniques for measuring refractive indices, such as ellipsometry and goniometry, are ineffective for van der Waals crystal flakes because of their high anisotropy and small, micron-scale, lateral size. To address this, we employ near-field optical microscopy to analyze the guided optical modes within these crystals. By probing these modes in MoS$_2$ flakes with subwavelength spatial resolution at a wavelength of $1570\,\mathrm{nm}$, we determine both the in-plane and out-of-plane permittivity components of MoS$_2$ as $16.11$ and $6.25$, respectively, with a relative uncertainty below $1\%$, while overcoming the limitations of traditional methods.

This paper describes a fast algorithm for transforming Legendre coefficients into Chebyshev coefficients, and vice versa. The algorithm is based on the fast multipole method and is similar to the approach described by Alpert and Rokhlin [SIAM J. Sci. Comput., 12 (1991)]. The main difference is that we utilise a modal Galerkin approach with Chebyshev basis functions instead of a nodal approach with a Lagrange basis. Part of the algorithm is a novel method that facilitates faster spreading of intermediate results through neighbouring levels of hierarchical matrices. This enhancement leads to a method that is approximately 20% faster to execute, due to less floating point operations. We also describe an efficient initialization algorithm that for the Lagrange basis is roughly 5 times faster than the original method for large input arrays. The described method has both a planning and execution stage that asymptotically require O(N) flops. The algorithm is simple enough that it can be implemented in 100 lines of vectorized Python code. Moreover, its efficiency is such that a single-threaded C implementation can transform 1000,000 coefficients in approximately 20 milliseconds on a new MacBook Pro M3, representing about 3 times the execution time of a well-planned (single-threaded) type 2 discrete cosine transform from FFTW (www.fftw.org). Planning for the 1000,000 coefficients requires approximately 50 milliseconds.

We investigate how the near-field enhancement of self-similar nanolenses, made of three plasmonic nanospheres with decreasing sizes and separations, is affected by quantum corrections in the optical response of the metal, and by fabrication imperfections related to the positioning of the spheres in the nanolens. In particular, we integrate mesoscopic phenomena, such as electron spill-in and -out and surface-enabled Landau damping, via the surface response formalism, focusing particularly on the role of spill-out in alkali metals. In addition, we take realistic imperfections in the nanofabrication process into account, through numerical averaging of both far- and near-field spectra for large collections of nanolenses. Statistical analysis of hundreds of trimers shows that inevitable deviations from the perfectly aligned chain only slightly, if at all, impair the field enhancement, as long as the average misplacement is kept within 1 nm from the ideal situation. Wishing to explore whether such imperfections can be harvested for practical applications, we probe the potential for triggering chiral response. Our results verify that imperfect nanolenses can display considerable circular dichroism, while providing a means to manipulate the optical chirality density. Nonetheless, we emphasize that quantification of chiral light-matter interactions can be largely affected by mesoscopic phenomena, which cannot be ignored when near-field quantities like optical chirality density are investigated.

Social networks shape individuals' lives, influencing everything from career paths to health. This paper presents a registry-based, multi-layer and temporal network of the entire Danish population in the years 2008-2021 (roughly 7.2 mill. individuals). Our network maps the relationships formed through family, households, neighborhoods, colleagues and classmates. We outline key properties of this multiplex network, introducing both an individual-focused perspective as well as a bipartite representation. We show how to aggregate and combine the layers, and how to efficiently compute network measures such as shortest paths in large administrative networks. Our analysis reveals how past connections reappear later in other layers, that the number of relationships aggregated over time reflects the position in the income distribution, and that we can recover canonical shortest path length distributions when appropriately weighting connections. Along with the network data, we release a Python package that uses the bipartite network representation for efficient analysis.

The baryon cycle is crucial for understanding galaxy formation, as gas inflows and outflows vary throughout a galaxy's lifetime and affect its star formation rate. Despite the necessity of accretion for galaxy growth at high redshifts, direct observations of inflowing gas have proven elusive especially at $z\gtrsim2$. We present spectroscopic analysis of a galaxy at redshift $z=2.45$ which exhibits signs of inflow in several ultraviolet interstellar absorption lines, with no clear outflow signatures. The absorption lines are redshifted by $\sim$250 km sec$^{-1}$ with respect to the systemic redshift, and C IV shows a prominent inverse P-Cygni profile. Simple stellar population models suggest that this galaxy has a low metallicity ($\sim$5% solar), with a very young starburst of age $\sim$4 Myr dominating the ultraviolet luminosity. The gas inflow velocity and nebular velocity dispersion suggest an approximate halo mass of order $\sim 10^{11}M_{\odot}$, a regime in which simulations predict that bursty star formation is common at this redshift. We conclude that this system is likely in the beginning of a cycle of bursty star formation, where inflow and star formation rates are high, but where supernovae and other feedback processes have not yet launched strong outflows. In this scenario, we expect the inflow-dominated phase to be observable (e.g., with net redshifted ISM absorption) for only a short timescale after a starburst onset. This result represents a promising avenue for probing the full baryon cycle, including inflows, during the formative phases of low-mass galaxies at high redshifts., Comment: Accepted for publication in ApJL, 12 pages, 4 figures

Underperformance of ASR systems for speakers of African American Vernacular English (AAVE) and other marginalized language varieties is a well-documented phenomenon, and one that reinforces the stigmatization of these varieties. We investigate whether or not the recent wave of Self-Supervised Learning (SSL) speech models can close the gap in ASR performance between AAVE and Mainstream American English (MAE). We evaluate four SSL models (wav2vec 2.0, HuBERT, WavLM, and XLS-R) on zero-shot Automatic Speech Recognition (ASR) for these two varieties and find that these models perpetuate the bias in performance against AAVE. Additionally, the models have higher word error rates on utterances with more phonological and morphosyntactic features of AAVE. Despite the success of SSL speech models in improving ASR for low resource varieties, SSL pre-training alone may not bridge the gap between AAVE and MAE. Our code is publicly available at https://github.com/cmu-llab/s3m-aave., Comment: INTERSPEECH 2024

Integral field spectroscopy (IFS) is a powerful tool for understanding the formation of galaxies across cosmic history. We present the observing strategy and first results of MSA-3D, a novel JWST program using multi-object spectroscopy in a slit-stepping strategy to produce IFS data cubes. The program observed 43 normal star-forming galaxies at redshifts $0.5 \lesssim z \lesssim 1.5$, corresponding to the epoch when spiral thin-disk galaxies of the modern Hubble sequence are thought to emerge, obtaining kpc-scale maps of rest-frame optical nebular emission lines with spectral resolution $R\simeq2700$. Here we describe the multiplexed slit-stepping method which is $>15$ times more efficient than the NIRSpec IFS mode for our program. As an example of the data quality, we present a case study of an individual galaxy at $z=1.104$ (stellar mass $M_{*} = 10^{10.3}~M_{\odot}$, star formation rate~$=3~M_{\odot}$ yr$^{-1}$) with prominent face-on spiral structure. We show that the galaxy exhibits a rotationally supported disk with moderate velocity dispersion ($\sigma = 36^{+5}_{-4}$~\kms), a negative radial metallicity gradient ($-0.020\pm0.002$~dex\,kpc$^{-1}$), a dust attenuation gradient, and an exponential star formation rate density profile which closely matches the stellar continuum. These properties are characteristic of local spirals, indicating that mature galaxies are in place at $z\sim1$. We also describe the customized data reduction and original cube-building software pipelines which we have developed to exploit the powerful slit-stepping technique. Our results demonstrate the ability of JWST slit-stepping to study galaxy populations at intermediate to high redshifts, with data quality similar to current surveys of the $z\sim0.1$ universe., Comment: 24 pages, 12 figures, 1 table; submitted to ApJ, comments welcome. Our custom designed data reduction pipeline (MSA3D) and example processed data-cube will be publicly released before the JWST Cycle 4 deadline. MSA3D package on GitHub: https://github.com/barisiciv/msa3d.git

Quantum simulation of materials is a promising application area of quantum computers. In order to realize this promise, finding ways to reduce quantum resources while maintaining the accuracy of results will be necessary. In electronic structure calculations on classical computer the reduction of resources has been achieved by using the projector augmented-wave method (PAW) and plane wave basis sets. In this work, we present an implementation of the PAW with plane waves for quantum computation of the energy. We first generalize the approach to many-body wavefunctions and develop the unitary version of the PAW which preserves the orthonormality of orbitals. Then, we provide a linear-combination-of-unitaries decomposition which explicitly accounts for the atomic two-body PAW correction and provide the corresponding block encodings of the Hamiltonian used in qubitized quantum phase estimation. We then estimate quantum resources for crystalline solids using down-sampling to estimate the energy within chemical accuracy with respect to the full basis set limit, and also consider a supercell approach which is more suitable for calculations of defect states. We provide the quantum resources for energy estimation of a nitrogen-vacancy defect centre in diamond which is a challenging system for classical algorithms and a quintessential problem in the studies of quantum point defects.

Deep reinforcement learning (DRL) has found application in numerous use-cases pertaining to flow control. Multi-agent RL (MARL), a variant of DRL, has shown to be more effective than single-agent RL in controlling flows exhibiting locality and translational invariance. We present, for the first time, an implementation of MARL-based control of three-dimensional Rayleigh-B\'enard convection (RBC). Control is executed by modifying the temperature distribution along the bottom wall divided into multiple control segments, each of which acts as an independent agent. Two regimes of RBC are considered at Rayleigh numbers $\mathrm{Ra}=500$ and $750$. Evaluation of the learned control policy reveals a reduction in convection intensity by $23.5\%$ and $8.7\%$ at $\mathrm{Ra}=500$ and $750$, respectively. The MARL controller converts irregularly shaped convective patterns to regular straight rolls with lower convection that resemble flow in a relatively more stable regime. We draw comparisons with proportional control at both $\mathrm{Ra}$ and show that MARL is able to outperform the proportional controller. The learned control strategy is complex, featuring different non-linear segment-wise actuator delays and actuation magnitudes. We also perform successful evaluations on a larger domain than used for training, demonstrating that the invariant property of MARL allows direct transfer of the learnt policy., Comment: Submitted to the special issue titled 'Machine Learning for Fluid Dynamics' in the journal Flow, Turbulence and Combusion. 39 pages and 20 figures

We introduce the Emergent Language Corpus Collection (ELCC): a collection of corpora generated from open source implementations of emergent communication systems across the literature. These systems include a variety of signalling game environments as well as more complex environments like a social deduction game and embodied navigation. Each corpus is annotated with metadata describing the characteristics of the source system as well as a suite of analyses of the corpus (e.g., size, entropy, average message length, performance as transfer learning data). Currently, research studying emergent languages requires directly running different systems which takes time away from actual analyses of such languages, makes studies which compare diverse emergent languages rare, and presents a barrier to entry for researchers without a background in deep learning. The availability of a substantial collection of well-documented emergent language corpora, then, will enable research which can analyze a wider variety of emergent languages, which more effectively uncovers general principles in emergent communication rather than artifacts of particular environments. We provide some quantitative and qualitative analyses with ELCC to demonstrate potential use cases of the resource in this vein., Comment: 21 pages, 8 figures; added analyses

Emergent communication, or emergent language, is the field of research which studies how human language-like communication systems emerge de novo in deep multi-agent reinforcement learning environments. The possibilities of replicating the emergence of a complex behavior like language have strong intuitive appeal, yet it is necessary to complement this with clear notions of how such research can be applicable to other fields of science, technology, and engineering. This paper comprehensively reviews the applications of emergent communication research across machine learning, natural language processing, linguistics, and cognitive science. Each application is illustrated with a description of its scope, an explication of emergent communication's unique role in addressing it, a summary of the extant literature working towards the application, and brief recommendations for near-term research directions., Comment: 49 pages, 15 figures

In this paper, we introduce a benchmark for evaluating the overall quality of emergent languages using data-driven methods. Specifically, we interpret the notion of the "quality" of an emergent language as its similarity to human language within a deep learning framework. We measure this by using the emergent language as pretraining data for a downstream NLP tasks in human language -- the better the downstream performance, the better the emergent language. We implement this benchmark as an easy-to-use Python package that only requires a text file of utterances from the emergent language to be evaluated. Finally, we empirically test the benchmark's validity using human, synthetic, and emergent language baselines., Comment: 15 pages, 5 figures

Positive thinking is thought to be an important component of self-motivation in various practical fields such as education and the workplace. Previous work, including sentiment transfer and positive reframing, has focused on the positive side of language. However, self-motivation that drives people to reach their goals has not yet been studied from a computational perspective. Moreover, negative feedback has not yet been explored, even though positive and negative feedback are both necessary to grow self-motivation. To facilitate self-motivation, we propose CArrot and STICk (CASTIC) dataset, consisting of 12,590 sentences with 5 different strategies for enhancing self-motivation. Our data and code are publicly available at here., Comment: 10 pages, 8 figures

Existing zero-shot cross-lingual NER approaches require substantial prior knowledge of the target language, which is impractical for low-resource languages. In this paper, we propose a novel approach to NER using phonemic representation based on the International Phonetic Alphabet (IPA) to bridge the gap between representations of different languages. Our experiments show that our method significantly outperforms baseline models in extremely low-resource languages, with the highest average F1 score (46.38%) and lowest standard deviation (12.67), particularly demonstrating its robustness with non-Latin scripts. Our codes are available at https://github.com/Gabriel819/zeroshot_ner.git, Comment: Accepted to EMNLP 2024 Main Conference

Historical linguists have long written a kind of incompletely formalized ''program'' that converts reconstructed words in an ancestor language into words in one of its attested descendants that consist of a series of ordered string rewrite functions (called sound laws). They do this by observing pairs of words in the reconstructed language (protoforms) and the descendent language (reflexes) and constructing a program that transforms protoforms into reflexes. However, writing these programs is error-prone and time-consuming. Prior work has successfully scaffolded this process computationally, but fewer researchers have tackled Sound Law Induction (SLI), which we approach in this paper by casting it as Programming by Examples. We propose a language-agnostic solution that utilizes the programming ability of Large Language Models (LLMs) by generating Python sound law programs from sound change examples. We evaluate the effectiveness of our approach for various LLMs, propose effective methods to generate additional language-agnostic synthetic data to fine-tune LLMs for SLI, and compare our method with existing automated SLI methods showing that while LLMs lag behind them they can complement some of their weaknesses.

Existing work implementing comparative reconstruction of ancestral languages (proto-languages) has usually required full supervision. However, historical reconstruction models are only of practical value if they can be trained with a limited amount of labeled data. We propose a semisupervised historical reconstruction task in which the model is trained on only a small amount of labeled data (cognate sets with proto-forms) and a large amount of unlabeled data (cognate sets without proto-forms). We propose a neural architecture for comparative reconstruction (DPD-BiReconstructor) incorporating an essential insight from linguists' comparative method: that reconstructed words should not only be reconstructable from their daughter words, but also deterministically transformable back into their daughter words. We show that this architecture is able to leverage unlabeled cognate sets to outperform strong semisupervised baselines on this novel task., Comment: Accepted to ACL 2024; v2: correct typo

In this paper we study the topology of the bands of a plasmonic crystal composed of graphene and of a metallic grating. Firstly, we derive a Kronig-Penney type of equation for the plasmonic bands as function of the Bloch wavevector and discuss the propagation of the surface plasmon polaritons on the polaritonic crystal using a transfer-matrix approach considering a finite relaxation time. Second, we reformulate the problem as a tight-binding model that resembles the Su-Schrieffer-Heeger (SSH) Hamiltonian, one difference being that the hopping amplitudes are, in this case, energy dependent. In possession of the tight-binding equations it is a simple task to determine the topology (value of the winding number) of the bands. This allows to determine the existense or absence of topological end modes in the system. Similarly to the SSH model, we show that there is a tunable parameter that induces topological phase transitions from trivial to non-trivial. In our case, it is the distance d between the graphene sheet and the metallic grating. We note that d is a parameter that can be easily tuned experimentally simply by controlling the thickness of the spacer between the grating and the graphene sheet. It is then experimentally feasible to engineer devices with the required topological properties. Finally, we suggest a scattering experiment allowing the observation of the topological states., Comment: 17 pages; significant changes in the presentation of the results (unchanged)

We utilize extreme-learning machines for the prediction of partial differential equations (PDEs). Our method splits the state space into multiple windows that are predicted individually using a single model. Despite requiring only few data points (in some cases, our method can learn from a single full-state snapshot), it still achieves high accuracy and can predict the flow of PDEs over long time horizons. Moreover, we show how additional symmetries can be exploited to increase sample efficiency and to enforce equivariance.

Proto-form reconstruction has been a painstaking process for linguists. Recently, computational models such as RNN and Transformers have been proposed to automate this process. We take three different approaches to improve upon previous methods, including data augmentation to recover missing reflexes, adding a VAE structure to the Transformer model for proto-to-language prediction, and using a neural machine translation model for the reconstruction task. We find that with the additional VAE structure, the Transformer model has a better performance on the WikiHan dataset, and the data augmentation step stabilizes the training.

Protolanguage reconstruction is central to historical linguistics. The comparative method, one of the most influential theoretical and methodological frameworks in the history of the language sciences, allows linguists to infer protoforms (reconstructed ancestral words) from their reflexes (related modern words) based on the assumption of regular sound change. Not surprisingly, numerous computational linguists have attempted to operationalize comparative reconstruction through various computational models, the most successful of which have been supervised encoder-decoder models, which treat the problem of predicting protoforms given sets of reflexes as a sequence-to-sequence problem. We argue that this framework ignores one of the most important aspects of the comparative method: not only should protoforms be inferable from cognate sets (sets of related reflexes) but the reflexes should also be inferable from the protoforms. Leveraging another line of research -- reflex prediction -- we propose a system in which candidate protoforms from a reconstruction model are reranked by a reflex prediction model. We show that this more complete implementation of the comparative method allows us to surpass state-of-the-art protoform reconstruction methods on three of four Chinese and Romance datasets., Comment: Accepted to LREC-COLING 2024

Lexical-syntactic flexibility, in the form of conversion (or zero-derivation) is a hallmark of English morphology. In conversion, a word with one part of speech is placed in a non-prototypical context, where it is coerced to behave as if it had a different part of speech. However, while this process affects a large part of the English lexicon, little work has been done to establish the degree to which language models capture this type of generalization. This paper reports the first study on the behavior of large language models with reference to conversion. We design a task for testing lexical-syntactic flexibility -- the degree to which models can generalize over words in a construction with a non-prototypical part of speech. This task is situated within a natural language inference paradigm. We test the abilities of five language models -- two proprietary models (GPT-3.5 and GPT-4), three open-source models (Mistral 7B, Falcon 40B, and Llama 2 70B). We find that GPT-4 performs best on the task, followed by GPT-3.5, but that the open source language models are also able to perform it and that the 7B parameter Mistral displays as little difference between its baseline performance on the natural language inference task and the non-prototypical syntactic category task, as the massive GPT-4., Comment: LREC-COLING 2024

In this paper, we make a contribution that can be understood from two perspectives: from an NLP perspective, we introduce a small challenge dataset for NLI with large lexical overlap, which minimises the possibility of models discerning entailment solely based on token distinctions, and show that GPT-4 and Llama 2 fail it with strong bias. We then create further challenging sub-tasks in an effort to explain this failure. From a Computational Linguistics perspective, we identify a group of constructions with three classes of adjectives which cannot be distinguished by surface features. This enables us to probe for LLM's understanding of these constructions in various ways, and we find that they fail in a variety of ways to distinguish between them, suggesting that they don't adequately represent their meaning or capture the lexical properties of phrasal heads., Comment: LREC-COLING 2024

Thousands of the world's languages are in danger of extinction--a tremendous threat to cultural identities and human language diversity. Interlinear Glossed Text (IGT) is a form of linguistic annotation that can support documentation and resource creation for these languages' communities. IGT typically consists of (1) transcriptions, (2) morphological segmentation, (3) glosses, and (4) free translations to a majority language. We propose Wav2Gloss: a task in which these four annotation components are extracted automatically from speech, and introduce the first dataset to this end, Fieldwork: a corpus of speech with all these annotations, derived from the work of field linguists, covering 37 languages, with standard formatting, and train/dev/test splits. We provide various baselines to lay the groundwork for future research on IGT generation from speech, such as end-to-end versus cascaded, monolingual versus multilingual, and single-task versus multi-task approaches., Comment: ACL 2024 camera ready version

Scattering-type scanning near-field optical microscope (s-SNOM) has become an essential tool to study polaritons - quasiparticles of light coupled to collective charge oscillations - via direct probing of their near field with a spatial resolution far beyond the diffraction limit. However, extraction of the polariton complex propagation constant from the near-field images requires subtle considerations that have not received necessary attention so far. In this study, we discuss important yet overlooked aspects of the near-field analysis. First, we experimentally demonstrate that the sample orientation inside the s-SNOM may significantly affect the near-field interference pattern of mid-infrared polaritons, leading to an error in momentum measurement up to 7.7% even for the modes with effective index of 12.5. Second, we establish a methodology to correctly extract the polariton damping rate from the interference fringes depending on their origin - the s-SNOM nano-tip or the material edge. Overall, our work provides a unified framework for the accurate extraction of the polariton momentum and damping from the near-field interference fringes., Comment: 15 pages, 4 figures

Approaches to improving multilingual language understanding often struggle with significant performance gaps between high-resource and low-resource languages. While there are efforts to align the languages in a single latent space to mitigate such gaps, how different input-level representations influence such gaps has not been investigated, particularly with phonemic inputs. We hypothesize that the performance gaps are affected by representation discrepancies between these languages, and revisit the use of phonemic representations as a means to mitigate these discrepancies. To demonstrate the effectiveness of phonemic representations, we present experiments on three representative cross-lingual tasks on 12 languages in total. The results show that phonemic representations exhibit higher similarities between languages compared to orthographic representations, and it consistently outperforms grapheme-based baseline model on languages that are relatively low-resourced. We present quantitative evidence from three cross-lingual tasks that demonstrate the effectiveness of phonemic representations, and it is further justified by a theoretical analysis of the cross-lingual performance gap., Comment: Accepted to the 4th Multilingual Representation Learning (MRL) Workshop (co-located with EMNLP 2024)

Received wisdom in linguistic typology holds that if the structure of a language becomes more complex in one dimension, it will simplify in another, building on the assumption that all languages are equally complex (Joseph and Newmeyer, 2012). We study this claim on a micro-level, using a tightly-controlled sample of Dutch dialects (across 366 collection sites) and Min dialects (across 60 sites), which enables a more fair comparison across varieties. Even at the dialect level, we find empirical evidence for a tradeoff between word length and a computational measure of phonotactic complexity from a LSTM-based phone-level language model-a result previously documented only at the language level. A generalized additive model (GAM) shows that dialects with low phonotactic complexity concentrate around the capital regions, which we hypothesize to correspond to prior hypotheses that language varieties of greater or more diverse populations show reduced phonotactic complexity. We also experiment with incorporating the auxiliary task of predicting syllable constituency, but do not find an increase in the negative correlation observed., Comment: Accepted to COLING-LREC 2024

Surface plasmon polaritons (SPPs) carry transverse optical spin within the evanescent field, which has enabled the demonstration of various chiral light-matter interactions in classical and quantum systems. To achieve high spin selectivity in the interactions, the elliptical polarization of the evanescent field should be made circular, but the engineering principle of the degree of circular polarization (DOCP) of SPPs has been lacking. In this study, we theoretically and numerically investigate the scaling behavior of the DOCP of the SPP field with respect to the modal effective refractive index (neff). The DOCP of the SPP field exhibits power-law scalability to the effective refractive index in the 1D layered system, regardless of the material, structural geometry, and excitation wavelength. The power-law scalability is also confirmed in 2D waveguide structures for in-plane and out-of-plane SPP fields, but the scaling exponents vary depending on the distance from the waveguide boundaries by the reduced symmetry of the given system. Due to Lorentz reciprocity, the power-law scalability can be extended to the coupling directionality of chiral emitters towards the plasmonic waveguide. To this end, we propose a chiral photonic platform for enhanced light-valley interaction, which utilizes simultaneous enhancement of the DOCP and coupling directionality. An incident SPP can excite a chiral emitter with high spin selectivity that unidirectionally couples the emitted light into the plasmonic waveguide depending on the valley polarization of excitons in 2D material. Our work provides a ground rule for designing chiral nanophotonic systems and paves the way for the exploration of scale-free phenomena of electromagnetic waves.

We describe a set of new methods to partially automate linguistic phylogenetic inference given (1) cognate sets with their respective protoforms and sound laws, (2) a mapping from phones to their articulatory features and (3) a typological database of sound changes. We train a neural network on these sound change data to weight articulatory distances between phones and predict intermediate sound change steps between historical protoforms and their modern descendants, replacing a linguistic expert in part of a parsimony-based phylogenetic inference algorithm. In our best experiments on Tukanoan languages, this method produces trees with a Generalized Quartet Distance of 0.12 from a tree that used expert annotations, a significant improvement over other semi-automated baselines. We discuss potential benefits and drawbacks to our neural approach and parsimony-based tree prediction. We also experiment with a minimal generalization learner for automatic sound law induction, finding it comparably effective to sound laws from expert annotation. Our code is publicly available at https://github.com/cmu-llab/aiscp., Comment: Accepted to LChange 2023

We study the spatially resolved outflow properties of CSWA13, an intermediate mass ($M_*=10^{9}~\mathrm{M}_{\odot}$), gravitationally lensed star-forming galaxy at $z=1.87$. We use Keck/KCWI to map outflows in multiple rest-frame ultraviolet ISM absorption lines, along with fluorescent Si II$^*$ emission, and nebular emission from C III] tracing the local systemic velocity. The spatial structure of outflow velocity mirrors that of the nebular kinematics, which we interpret to be a signature of a young galactic wind that is pressurizing the ISM of the galaxy but is yet to burst out. From the radial extent of Si II$^*$ emission, we estimate that the outflow is largely encapsulated within $3.5$ kpc. We explore the geometry (e.g., patchiness) of the outflow by measuring the covering fraction at different velocities, finding that the maximum covering fraction is at velocities $v\simeq-150$ km$\,$s$^{-1}$. Using the outflow velocity ($v_{out}$), radius ($R$), column density ($N$), and solid angle ($\Omega$) based on the covering fraction, we measure the mass loss rate $\log\dot{m}_{out}/(\mathrm{M}_{\odot}\text{yr}^{-1}) = 1.73\pm0.23$ and mass loading factor $\log\eta = 0.04\pm0.34$ for the low-ionization outflowing gas in this galaxy. These values are relatively large and the bulk of the outflowing gas is moving with speeds less than the escape velocity of the galaxy halo, suggesting that the majority of outflowing mass will remain in the circumgalactic medium and/or recycle back into the galaxy. The results support a picture of high outflow rates transporting mass and metals into the inner circumgalactic medium, providing the gas reservoir for future star formation., Comment: Accepted for publication, ApJ (17 pages, 10 figures, 1 table)

The Open Databases Integration for Materials Design (OPTIMADE) application programming interface (API) empowers users with holistic access to a growing federation of databases, enhancing the accessibility and discoverability of materials and chemical data. Since the first release of the OPTIMADE specification (v1.0), the API has undergone significant development, leading to the upcoming v1.2 release, and has underpinned multiple scientific studies. In this work, we highlight the latest features of the API format, accompanying software tools, and provide an update on the implementation of OPTIMADE in contributing materials databases. We end by providing several use cases that demonstrate the utility of the OPTIMADE API in materials research that continue to drive its ongoing development.

The increasing capability of Large Language Models to act as human-like social agents raises two important questions in the area of opinion dynamics. First, whether these agents can generate effective arguments that could be injected into the online discourse to steer the public opinion. Second, whether artificial agents can interact with each other to reproduce dynamics of persuasion typical of human social systems, opening up opportunities for studying synthetic social systems as faithful proxies for opinion dynamics in human populations. To address these questions, we designed a synthetic persuasion dialogue scenario on the topic of climate change, where a 'convincer' agent generates a persuasive argument for a 'skeptic' agent, who subsequently assesses whether the argument changed its internal opinion state. Different types of arguments were generated to incorporate different linguistic dimensions underpinning psycho-linguistic theories of opinion change. We then asked human judges to evaluate the persuasiveness of machine-generated arguments. Arguments that included factual knowledge, markers of trust, expressions of support, and conveyed status were deemed most effective according to both humans and agents, with humans reporting a marked preference for knowledge-based arguments. Our experimental framework lays the groundwork for future in-silico studies of opinion dynamics, and our findings suggest that artificial agents have the potential of playing an important role in collective processes of opinion formation in online social media., Comment: 9 pages, 6 figures, 3 tables, 1 page in appendix

We demonstrate the existence of previously unreported magnetic modes with record-high magnetic Purcell factors in topological-insulator nanospheres. Focusing on bismuth selenide (Bi$_{2}$Se$_{3}$), and based on full electromagnetic Mie theory, we find magnetic modes arising from both displacement current loops in the bulk, and surface currents due to delocalized surface states, induced by electronic transitions between topologically protected states within the Dirac cone and discretized due to the sphere finite size. Furthermore, we discuss how Dirac plasmon polaritons, resulting from the interaction between THz photons and Dirac electrons, dramatically influence both the magnetic and the electric transitions of quantum emitters placed near Bi$_2$Se$_3$ nanospheres, significantly enhancing the corresponding Purcell factors. These findings position Bi$_{2}$Se$_{3}$ nanospheres, whose optical response is related to a richness of physical mechanisms, among the most promising candidates for enhancing light--matter interactions in nanophotonics and THz technologies.

We show that hexagonal boron nitride (hBN), a two-dimensional insulator, when subjected to an external superlattice potential forms a new paradigm for electrostatically tunable excitons in the near- and mid-ultraviolet (UV). The imposed potential has three consequences: (i) it renormalizes the effective mass tensor, leading to anisotropic effective masses; (ii) it renormalizes the band gap, eventually reducing it; (iii) it reduces the exciton binding energies. All these consequences depend on a single dimensionless parameter, which includes the product of strength of the external potential with its period. In addition to the excitonic energy levels, we compute the optical conductivity along two orthogonal directions, and from it the absorption spectrum. The results for the latter show that our system is able to mimic a grid polarizer. These characteristics make one-dimensional hBN superlattices a viable and unexplored platform for fine-tuned polaritonics in the UV to visible spectral range.

We discuss the possibility of self-hybridisation in high-index dielectric nanoparticles, where Mie modes of electric or magnetic type can couple to the interband transitions of the material, leading to spectral anticrossings. Starting with an idealised system described by moderately high constant permittivity with a narrow Lorentzian, in which self-hybridisation is visible for both plane-wave and electron-beam excitation, we embark on a quest for realistic systems where this effect should be visible. We explore a variety of spherical particles made of traditional semiconductors such as Si, GaAs, and GaP. With the effect hardly discernible, we identify two major causes hindering observation of self-hybridisation: the very broad spectral fingerprints of interband transitions in most candidate materials, and the significant overlap between electric and magnetic Mie modes in nanospheres. We thus depart from the spherical shape, and show that interband--Mie hybridisation is indeed feasible in the example of GaAs cylinders, even with a simple plane-wave source. This so-far unreported kind of polariton has to be considered when interpreting experimental spectra of Mie-resonant nanoparticles and assigning modal characters to specific features. On the other hand, it has the potential to be useful for the characterisation of the optical properties of dielectric materials, through control of the hybridisation strength via nanoparticle size and shape.

Social media has become a very popular source of information. With this popularity comes an interest in systems that can classify the information produced. This study tries to create such a system detecting irony in Twitter users. Recent work emphasize the importance of lexical features, sentiment features and the contrast herein along with TF-IDF and topic models. Based on a thorough feature selection process, the resulting model contains specific sub-features from these areas. Our model reaches an F1-score of 0.84, which is above the baseline. We find that lexical features, especially TF-IDF, contribute the most to our models while sentiment and topic modeling features contribute less to overall performance. Lastly, we highlight multiple interesting and important paths for further exploration.

Topological insulators generally have dielectric bulk and conductive surface states. Consequently, some of these materials have been shown to support polaritonic modes at visible and THz frequencies. At the same time, the optical properties of topological insulators in the mid-infrared (IR) remain poorly investigated. We employ near-field imaging to probe the mid-IR response from the exfoliated flakes of bismuth (Bi) / selenide (Se) / telluride (Te) / antimony (Sb) crystals with varying stoichiometry - Bi2Se3, Bi2Te2Se, and Bi1.5Sb0.5Te1.7Se1.3 - in pristine form as well as covered by thin flakes of hexagonal boron nitride (hBN). Contrary to theoretical expectations, all three materials exhibit a dielectric response with a high refractive index and with a loss below the experimental detection limit. Particularly, the near-field mapping of propagating phonon-polaritons in hBN demonstrates that these van der Waals crystals act as a practically lossless dielectric substrate with an ultra-high refractive index of up to 7.5 in Bi2Te2Se. Such a unique dielectric crystal would be of great advantage for numerous nanophotonic applications in the mid-IR.

Ultra-fine entity typing plays a crucial role in information extraction by predicting fine-grained semantic types for entity mentions in text. However, this task poses significant challenges due to the massive number of entity types in the output space. The current state-of-the-art approaches, based on standard multi-label classifiers or cross-encoder models, suffer from poor generalization performance or inefficient inference. In this paper, we present CASENT, a seq2seq model designed for ultra-fine entity typing that predicts ultra-fine types with calibrated confidence scores. Our model takes an entity mention as input and employs constrained beam search to generate multiple types autoregressively. The raw sequence probabilities associated with the predicted types are then transformed into confidence scores using a novel calibration method. We conduct extensive experiments on the UFET dataset which contains over 10k types. Our method outperforms the previous state-of-the-art in terms of F1 score and calibration error, while achieving an inference speedup of over 50 times. Additionally, we demonstrate the generalization capabilities of our model by evaluating it in zero-shot and few-shot settings on five specialized domain entity typing datasets that are unseen during training. Remarkably, our model outperforms large language models with 10 times more parameters in the zero-shot setting, and when fine-tuned on 50 examples, it significantly outperforms ChatGPT on all datasets. Our code, models and demo are available at https://github.com/yanlinf/CASENT.

We review the GPAW open-source Python package for electronic structure calculations. GPAW is based on the projector-augmented wave method and can solve the self-consistent density functional theory (DFT) equations using three different wave-function representations, namely real-space grids, plane waves, and numerical atomic orbitals. The three representations are complementary and mutually independent and can be connected by transformations via the real-space grid. This multi-basis feature renders GPAW highly versatile and unique among similar codes. By virtue of its modular structure, the GPAW code constitutes an ideal platform for implementation of new features and methodologies. Moreover, it is well integrated with the Atomic Simulation Environment (ASE) providing a flexible and dynamic user interface. In addition to ground-state DFT calculations, GPAW supports many-body GW band structures, optical excitations from the Bethe-Salpeter Equation (BSE), variational calculations of excited states in molecules and solids via direct optimization, and real-time propagation of the Kohn-Sham equations within time-dependent DFT. A range of more advanced methods to describe magnetic excitations and non-collinear magnetism in solids are also now available. In addition, GPAW can calculate non-linear optical tensors of solids, charged crystal point defects, and much more. Recently, support of GPU acceleration has been achieved with minor modifications of the GPAW code thanks to the CuPy library. We end the review with an outlook describing some future plans for GPAW.

Large language models (LLMs) have recently reached an impressive level of linguistic capability, prompting comparisons with human language skills. However, there have been relatively few systematic inquiries into the linguistic capabilities of the latest generation of LLMs, and those studies that do exist (i) ignore the remarkable ability of humans to generalize, (ii) focus only on English, and (iii) investigate syntax or semantics and overlook other capabilities that lie at the heart of human language, like morphology. Here, we close these gaps by conducting the first rigorous analysis of the morphological capabilities of ChatGPT in four typologically varied languages (specifically, English, German, Tamil, and Turkish). We apply a version of Berko's (1958) wug test to ChatGPT, using novel, uncontaminated datasets for the four examined languages. We find that ChatGPT massively underperforms purpose-built systems, particularly in English. Overall, our results -- through the lens of morphology -- cast a new light on the linguistic capabilities of ChatGPT, suggesting that claims of human-like language skills are premature and misleading., Comment: EMNLP 2023