Search

The demand for sophisticated natural language processing (NLP) methods, particularly Named Entity Recognition (NER), has increased due to the exponential growth of Marathi-language digital content. In particular, NER is essential for recognizing distant entities and for arranging and understanding unstructured Marathi text data. With an emphasis on managing long-range entities, this paper offers a comprehensive analysis of current NER techniques designed for Marathi documents. It dives into current practices and investigates the BERT transformer model's potential for long-range Marathi NER. Along with analyzing the effectiveness of earlier methods, the report draws comparisons between NER in English literature and suggests adaptation strategies for Marathi literature. The paper discusses the difficulties caused by Marathi's particular linguistic traits and contextual subtleties while acknowledging NER's critical role in NLP. To conclude, this project is a major step forward in improving Marathi NER techniques, with potential wider applications across a range of NLP tasks and domains.

We present the MahaSUM dataset, a large-scale collection of diverse news articles in Marathi, designed to facilitate the training and evaluation of models for abstractive summarization tasks in Indic languages. The dataset, containing 25k samples, was created by scraping articles from a wide range of online news sources and manually verifying the abstract summaries. Additionally, we train an IndicBART model, a variant of the BART model tailored for Indic languages, using the MahaSUM dataset. We evaluate the performance of our trained models on the task of abstractive summarization and demonstrate their effectiveness in producing high-quality summaries in Marathi. Our work contributes to the advancement of natural language processing research in Indic languages and provides a valuable resource for future research in this area using state-of-the-art models. The dataset and models are shared publicly at https://github.com/l3cube-pune/MarathiNLP

In the past few years, the improved sensitivity and cadence of wide-field optical surveys have enabled the discovery of several afterglows without associated detected gamma-ray bursts (GRBs). We present the identification, observations, and multiwavelength modeling of a recent such afterglow (AT2023lcr), and model three literature events (AT2020blt, AT2021any, and AT2021lfa) in a consistent fashion. For each event, we consider the following possibilities as to why a GRB was not observed: 1) the jet was off-axis; 2) the jet had a low initial Lorentz factor; and 3) the afterglow was the result of an on-axis classical GRB (on-axis jet with physical parameters typical of the GRB population), but the emission was undetected by gamma-ray satellites. We estimate all physical parameters using afterglowpy and Markov Chain Monte Carlo methods from emcee. We find that AT2023lcr, AT2020blt, and AT2021any are consistent with on-axis classical GRBs, and AT2021lfa is consistent with both on-axis low Lorentz factor ($\Gamma_0 \approx 5 - 13$) and off-axis ($\theta_\text{obs}=2\theta_\text{jet}$) high Lorentz factor ($\Gamma_0 \approx 100$) jets., Comment: 40 pages, 18 figures, 20 tables

A key obstacle to accurate models of the first stars and galaxies is the vast range of distance scales that must be considered. While star formation occurs on sub-parsec scales within dark matter (DM) minihalos, it is influenced by large-scale baryon-dark matter streaming velocities ($v_{\rm bc}$) and Lyman-Werner (LW) radiative feedback which vary significantly on scales of $\sim$100 Mpc. We present a novel approach to this issue in which we utilize artificial neural networks (NNs) to emulate the Population III (PopIII) and Population II (PopII) star formation histories of many small-scale cells given by a more complex semi-analytic framework based on DM halo merger trees. Within each simulation cell, the NN takes a set of input parameters that depend on the surrounding large-scale environment, such as the cosmic overdensity, $\delta(\vec{x})$, and $v_{\rm bc}$ of the cell, then outputs the resulting star formation far more efficiently than is possible with the semi-analytic model. This rapid emulation allows us to self-consistently determine the LW background intensity on $\sim$100 Mpc scales, while simultaneously including the detailed merger histories (and corresponding star formation histories) of the low-mass minihalos that host the first stars. Comparing with the full semi-analytic framework utilizing DM halo merger trees, our NN emulators yield star formation histories with redshift-averaged errors of $\sim$10.2\% and $\sim$9.2\% for PopII and PopIII, respectively. When compared to a simpler sub-grid star formation prescription reliant on halo mass function integration, we find that the diversity of halo merger histories in our simulation leads to enhanced spatial fluctuations, an earlier transition from PopIII to PopII dominated star formation, and more scatter in star formation histories overall., Comment: Submitted to JCAP -- 28 Pages -- 11 Figures

Video geolocalization is a crucial problem in current times. Given just a video, ascertaining where it was captured from can have a plethora of advantages. The problem of worldwide geolocalization has been tackled before, but only using the image modality. Its video counterpart remains relatively unexplored. Meanwhile, video geolocalization has also garnered some attention in the recent past, but the existing methods are all restricted to specific regions. This motivates us to explore the problem of video geolocalization at a global scale. Hence, we propose a novel problem of worldwide video geolocalization with the objective of hierarchically predicting the correct city, state/province, country, and continent, given a video. However, no large scale video datasets that have extensive worldwide coverage exist, to train models for solving this problem. To this end, we introduce a new dataset, CityGuessr68k comprising of 68,269 videos from 166 cities all over the world. We also propose a novel baseline approach to this problem, by designing a transformer-based architecture comprising of an elegant Self-Cross Attention module for incorporating scenes as well as a TextLabel Alignment strategy for distilling knowledge from textlabels in feature space. To further enhance our location prediction, we also utilize soft-scene labels. Finally we demonstrate the performance of our method on our new dataset as well as Mapillary(MSLS). Our code and datasets are available at: https://github.com/ParthPK/CityGuessr, Comment: Accepted to ECVA Eurpoean Conference on Computer Vision(ECCV) 2024

Rare-earth diantimonides display intriguing ground states often associated with structural order, which can be manipulated in thin film geometries. In this study, we report epitaxial synthesis of one such compound, YbSb$_{2}$, on III-V substrates using molecular-beam epitaxy. The synthesized thin films exhibit large, non-saturating, linear magnetoresistance across a wide magnetic field range. Additionally, they demonstrate superconducting properties, with a critical temperature of $\approx$ 1.025 K and a critical field of $\approx$ 83.85 Oe, consistent with the reports in bulk single crystals. While YbSb$_{2}$ has been classified as a Type-I superconductor in its bulk form, our findings provide evidence of a mixed state in the epitaxial thin films. This work paves the way for controlling the electronic ground state in this class of materials through thin film engineering., Comment: 8 pages, 6 figures

Large language models (LLMs) have shown remarkable progress in encoding clinical knowledge and responding to complex medical queries with appropriate clinical reasoning. However, their applicability in subspecialist or complex medical settings remains underexplored. In this work, we probe the performance of AMIE, a research conversational diagnostic AI system, in the subspecialist domain of breast oncology care without specific fine-tuning to this challenging domain. To perform this evaluation, we curated a set of 50 synthetic breast cancer vignettes representing a range of treatment-naive and treatment-refractory cases and mirroring the key information available to a multidisciplinary tumor board for decision-making (openly released with this work). We developed a detailed clinical rubric for evaluating management plans, including axes such as the quality of case summarization, safety of the proposed care plan, and recommendations for chemotherapy, radiotherapy, surgery and hormonal therapy. To improve performance, we enhanced AMIE with the inference-time ability to perform web search retrieval to gather relevant and up-to-date clinical knowledge and refine its responses with a multi-stage self-critique pipeline. We compare response quality of AMIE with internal medicine trainees, oncology fellows, and general oncology attendings under both automated and specialist clinician evaluations. In our evaluations, AMIE outperformed trainees and fellows demonstrating the potential of the system in this challenging and important domain. We further demonstrate through qualitative examples, how systems such as AMIE might facilitate conversational interactions to assist clinicians in their decision making. However, AMIE's performance was overall inferior to attending oncologists suggesting that further research is needed prior to consideration of prospective uses.

In a study of 107 male Y Combinator founders, a surprising correlation between age-normalized testosterone and company stage was uncovered. Testosterone, a hormone associated with confidence, dominance, and drive, increased by 55.7% from pre-seed to seed funding, peaking at the Series B stage, where levels were 99.6% higher than pre-seed. After series B funding, testosterone was observed to drop by 42.2%, coinciding with a spike in cortisol levels. This age-normalized biomarker analysis supports the dual-hormone hypothesis, illustrating that early startup success fosters feelings of dominance and confidence, while later-stage pressures and stresses erode these feelings. An alternative interpretation of the data, which suggests the opportunity for a longitudinal study, is that male founders with higher testosterone are more likely to raise larger rounds of funding., Comment: 9 pages, 4 figures

Applying strain to epitaxial thin films has proven to be an effective approach for controlling material properties, paving the way for "materials by design". In this study, we explore this concept in the context of topological Kagome antiferromagnets, which can exhibit a range of exotic magnetic states. One such material, Mn$_{3}$Sn, features a non-collinear yet coplanar inverse triangular spin order that lacks scalar spin chirality. By applying anisotropic strain to reduce the point group symmetry of the Kagome triangles from $C_{3v}$ to $C_{1}$, and utilizing the Dzyaloshinskii-Moriya interaction in epitaxial Mn$_{3}$Sn heterostructures, we achieve a canting of the manganese spins out of the Kagome plane. This newly induced magnetic state introduces a finite scalar spin chirality and results in a significant Berry phase in momentum space. Consequently, a large anomalous Hall effect emerges in the Kagome plane at room temperature, which can be fully controlled by charge current, enabling the realization of multiple-stable antiferromagnetic memory states., Comment: 13 pages, 5 figures

Symmetry of non-Hermitian matrices underpins many physical phenomena. In particular, chaotic open quantum systems exhibit universal bulk spectral correlations classified on the basis of time-reversal symmetry$^{\dagger}$ (TRS$^{\dagger}$), coinciding with those of non-Hermitian random matrices in the same symmetry class. Here, we analytically study the spectral correlations of non-Hermitian random matrices in the presence of TRS$^{\dagger}$ with signs $+1$ and $-1$, corresponding to symmetry classes AI$^{\dagger}$ and AII$^{\dagger}$, respectively. Using the fermionic replica non-linear sigma model approach, we derive $n$-fold integral expressions for the $n$th moment of the one-point and two-point characteristic polynomials. Performing the replica limit $n\to 0$, we qualitatively reproduce the density of states and level-level correlations of non-Hermitian random matrices with TRS$^{\dagger}$., Comment: 21 pages, 9 figures

Current quantum devices face challenges when dealing with large circuits due to error rates as circuit size and the number of qubits increase. The circuit wire-cutting technique addresses this issue by breaking down a large circuit into smaller, more manageable subcircuits. However, the exponential increase in the number of subcircuits and the complexity of reconstruction as more cuts are made poses a great practical challenge. Inspired by ancilla-assisted quantum process tomography and the MUBs-based grouping technique for simultaneous measurement, we propose a new approach that can reduce subcircuit running overhead. The approach first uses ancillary qubits to transform all quantum input initializations into quantum output measurements. These output measurements are then organized into commuting groups for the purpose of simultaneous measurement, based on MUBs-based grouping. This approach significantly reduces the number of necessary subcircuits as well as the total number of shots. Lastly, we provide numerical experiments to demonstrate the complexity reduction., Comment: Accepted in IEEE International Conference on Quantum Computing and Engineering - QCE24

In recent years, Large Language Models (LLMs) have become fundamental to a broad spectrum of artificial intelligence applications. As the use of LLMs expands, precisely estimating the uncertainty in their predictions has become crucial. Current methods often struggle to accurately identify, measure, and address the true uncertainty, with many focusing primarily on estimating model confidence. This discrepancy is largely due to an incomplete understanding of where, when, and how uncertainties are injected into models. This paper introduces a comprehensive framework specifically designed to identify and understand the types and sources of uncertainty, aligned with the unique characteristics of LLMs. Our framework enhances the understanding of the diverse landscape of uncertainties by systematically categorizing and defining each type, establishing a solid foundation for developing targeted methods that can precisely quantify these uncertainties. We also provide a detailed introduction to key related concepts and examine the limitations of current methods in mission-critical and safety-sensitive applications. The paper concludes with a perspective on future directions aimed at enhancing the reliability and practical adoption of these methods in real-world scenarios.

Let $K=\mathbb{Q}[\iota]$ and $N=K[\sqrt[4]{\alpha}]$, $\alpha\in\mathbb{Z}[\iota]$, $alpha=fg^2h^3$, $f$, $g$, $h\in \mathbb{Z}[\iota]$ are pairwise coprime and square free. Let $\mathcal{O}_N$ be the ring of integers of $N$. In this article we construct normalised integral basis for $\mathcal{O}_N$ over $\mathbb{Z}[\iota]$, that is an integral basis of the form \[ \left\{1,\frac{f_1(\alpha)}{d_1},\frac{f_2(\alpha)}{d_2},\frac{f_{3}(\alpha)}{d_3}\right\} \] where $d_i \in \mathbb{Z}[i]$ and $f_i(X)$, $\leq i\leq 3$ are monic polynomials of degree $i$ over $\mathbb{Z}[\iota]$. We explicitly determine what $d_i$, $1\leq i\leq n-1$ are in terms of $f$, $g$ and $h$., Comment: 29 pages

Recent studies have shown that capillary waves generated by bursting of an oil drop at the water-air interface produces a daughter droplet inside the bath while part of it floats above it. Successive bursting events produce next generations of daughter droplets, gradually diminishing in size until the entire volume of oil rests atop the water-air interface. In this work, we demonstrate two different ways to modulate this process by modifying the constitution of the drop. Firstly, we introduce hydrophilic clay particles inside the parent oil drop and show that it arrests the cascade of daughter droplet generation preventing it from floating over the water-air interface. Secondly, we show that bursting behavior can be modified by a compound water-oil-air interface made of a film of oil with finite thickness and design a regime map which displays each of these outcomes. We underpin both of these demonstrations by theoretical arguments providing criteria to predict outcomes resulting therein. Lastly, all our scenarios have a direct relation to control of oil-water separation and stability of emulsified solutions in a wide variety of applications which include drug delivery, enhanced oil recovery, oil spills and food processing where a dispersed oil phase tries to separate from a continuous phase.

We present the results of a search for gravitational-wave transients associated with core-collapse supernova SN 2023ixf, which was observed in the galaxy Messier 101 via optical emission on 2023 May 19th, during the LIGO-Virgo-KAGRA 15th Engineering Run. We define a five-day on-source window during which an accompanying gravitational-wave signal may have occurred. No gravitational waves have been identified in data when at least two gravitational-wave observatories were operating, which covered $\sim 14\%$ of this five-day window. We report the search detection efficiency for various possible gravitational-wave emission models. Considering the distance to M101 (6.7 Mpc), we derive constraints on the gravitational-wave emission mechanism of core-collapse supernovae across a broad frequency spectrum, ranging from 50 Hz to 2 kHz where we assume the GW emission occurred when coincident data are available in the on-source window. Considering an ellipsoid model for a rotating proto-neutron star, our search is sensitive to gravitational-wave energy $1 \times 10^{-5} M_{\odot} c^2$ and luminosity $4 \times 10^{-5} M_{\odot} c^2/\text{s}$ for a source emitting at 50 Hz. These constraints are around an order of magnitude more stringent than those obtained so far with gravitational-wave data. The constraint on the ellipticity of the proto-neutron star that is formed is as low as $1.04$, at frequencies above $1200$ Hz, surpassing results from SN 2019ejj., Comment: Main paper: 6 pages, 4 figures and 1 table. Total with appendices: 20 pages, 4 figures, and 1 table

This paper addresses the problem of detecting changes when only unnormalized pre- and post-change distributions are accessible. This situation happens in many scenarios in physics such as in ferromagnetism, crystallography, magneto-hydrodynamics, and thermodynamics, where the energy models are difficult to normalize. Our approach is based on the estimation of the Cumulative Sum (CUSUM) statistics, which is known to produce optimal performance. We first present an intuitively appealing approximation method. Unfortunately, this produces a biased estimator of the CUSUM statistics and may cause performance degradation. We then propose the Log-Partition Approximation Cumulative Sum (LPA-CUSUM) algorithm based on thermodynamic integration (TI) in order to estimate the log-ratio of normalizing constants of pre- and post-change distributions. It is proved that this approach gives an unbiased estimate of the log-partition function and the CUSUM statistics, and leads to an asymptotically optimal performance. Moreover, we derive a relationship between the required sample size for thermodynamic integration and the desired detection delay performance, offering guidelines for practical parameter selection. Numerical studies are provided demonstrating the efficacy of our approach.

Quantum simulation in its current state faces experimental overhead in terms of physical space and cooling. We propose boson sampling as an alternative compact synthetic platform performing at room temperature. Identifying the capability of estimating matrix permanents, we explore the applicability of boson sampling for tackling the dynamics of quantum systems without having access to information about the full state vector. By mapping the time-evolution unitary of a Hamiltonian onto an interferometer via continuous-variable gate decompositions, we present proof-of-principle results of localization characteristics of a single particle. We study the dynamics of one-dimensional tight-binding systems in the clean and quasiperiodic-disordered limits to observe Bloch oscillations and dynamical localization, and the delocalization-to-localization phase transition in the Aubry- Andre-Harper model respectively. Our computational results obtained using boson sampling are in complete agreement with the dynamical and static results of non-interacting tight-binding systems obtained using conventional numerical calculations. Additionally, our study highlights the role of number of sampling measurements or shots for simulation accuracy., Comment: 14 pages, 10 figures

The recently discovered Pa 30 nebula, the putative type Iax supernova remnant associated with the historical supernova of 1181 AD, shows puzzling characteristics that make it unique among known supernova remnants. In particular, Pa 30 exhibits a complex morphology, with a unique radial and filamentary structure, and it hosts a hot stellar remnant at its center, which displays oxygen-dominated, ultra-fast winds. Because of the surviving stellar remnant and the lack of hydrogen and helium in its filaments, it has been suggested that Pa 30 is the product of a failed thermonuclear explosion in a near- or super-Chandrasekhar white dwarf, which created a sub-luminous transient, a rare sub-type of the Ia class of supernovae called type Iax. We here present a detailed study of the 3D structure and velocities of a full radial section of the remnant. The Integral Field Unit (IFU) observations, obtained with the new red channel of the Keck Cosmic Web Imager spectrograph, reveal that the ejecta are consistent with being ballistic, with velocities close to the free-expansion velocity. Additionally, we detect a large cavity inside the supernova remnant and a sharp inner edge to the filamentary structure, which coincides with the outer edge of a bright ring detected in infrared images. Finally, we detect a strong asymmetry in the amount of ejecta along the line of sight, which might hint to an asymmetric explosion. Our analysis provides strong confirmation that the explosion originated from SN 1181., Comment: 13 pages, 8 figures. Accepted for publication in ApJL

Wave dynamics in disordered open media is an intriguing topic, and has lately attracted a lot of attention in non-Hermitian physics, especially in photonics. In fact, spatial distributions of gain and loss elements are physically possible in the context of integrated photonic waveguide arrays. In particular, in these type of lattices, counter-intuitive quantized jumps along the propagation direction appear in the strong disorder limit (where all eigenstates are localized) and they have also been recently experimentally observed. We systematically study the non-Hermitian quasiperiodic Aubry-Andr\'e-Harper model with on-site gain and loss distribution (NHAAH), with an emphasis on the spectral sensitivity based on pseudospectra analysis. Moreover, diffraction dynamics and the quantized jumps, as well as, the effect of saturable nonlinearity, are investigated in detail. Our study reveals the intricate relation between the nonlinearity and non-Hermiticity., Comment: 11 pages, 10 figures

The magnetar SGR 1935+2154 is the only known Galactic source of fast radio bursts (FRBs). FRBs from SGR 1935+2154 were first detected by CHIME/FRB and STARE2 in 2020 April, after the conclusion of the LIGO, Virgo, and KAGRA Collaborations' O3 observing run. Here we analyze four periods of gravitational wave (GW) data from the GEO600 detector coincident with four periods of FRB activity detected by CHIME/FRB, as well as X-ray glitches and X-ray bursts detected by NICER and NuSTAR close to the time of one of the FRBs. We do not detect any significant GW emission from any of the events. Instead, using a short-duration GW search (for bursts $\leq$ 1 s) we derive 50\% (90\%) upper limits of $10^{48}$ ($10^{49}$) erg for GWs at 300 Hz and $10^{49}$ ($10^{50}$) erg at 2 kHz, and constrain the GW-to-radio energy ratio to $\leq 10^{14} - 10^{16}$. We also derive upper limits from a long-duration search for bursts with durations between 1 and 10 s. These represent the strictest upper limits on concurrent GW emission from FRBs., Comment: 15 pages of text including references, 4 figures, 5 tables

Understanding open quantum systems using information encoded in its complex eigenvalues has been a subject of growing interest. In this paper, we study higher-order gap ratios of the singular values of generic open quantum systems. We show that $k$-th order gap ratio of the singular values of an open quantum system can be connected to the nearest-neighbor spacing ratio of positions of classical particles of a harmonically confined log-gas with inverse temperature $\beta'(k)$ where $\beta'(k)$ is an analytical function that depends on $k$ and the Dyson's index $\beta=1,2,$ and $4$ that characterizes the properties of the associated Hermitized matrix. Our findings are crucial not only for understanding long-range correlations between the eigenvalues but also provide an excellent way of distinguishing different symmetry classes in an open quantum system. To highlight the universality of our findings, we demonstrate the higher-order gap ratios using different platforms such as non-Hermitian random matrices, random dissipative Liouvillians, Hamiltonians coupled to a Markovian bath, and Hamiltonians with in-built non-Hermiticity., Comment: 12 pages, 12 figures

Mixed Integer Linear Programming (MILP) is essential for modeling complex decision-making problems but faces challenges in computational tractability and requires expert formulation. Current deep learning approaches for MILP focus on specific problem classes and do not generalize to unseen classes. To address this shortcoming, we take a foundation model training approach, where we train a single deep learning model on a diverse set of MILP problems to generalize across problem classes. As existing datasets for MILP lack diversity and volume, we introduce MILP-Evolve, a novel LLM-based evolutionary framework that is capable of generating a large set of diverse MILP classes with an unlimited amount of instances. We study our methodology on three key learning tasks that capture diverse aspects of MILP: (1) integrality gap prediction, (2) learning to branch, and (3) a new task of aligning MILP instances with natural language descriptions. Our empirical results show that models trained on the data generated by MILP-Evolve achieve significant improvements on unseen problems, including MIPLIB benchmarks. Our work highlights the potential of moving towards a foundation model approach for MILP that can generalize to a broad range of MILP applications. We are committed to fully open-sourcing our work to advance further research.

This paper presents research on enhancements to Large Language Models (LLMs) through the addition of diversity in its generated outputs. Our study introduces a configuration of multiple LLMs which demonstrates the diversities capable with a single LLM. By developing multiple customised instances of a GPT model, each reflecting biases in specific demographic characteristics including gender, age, and race, we propose, develop and evaluate a framework for a more nuanced and representative AI dialogue which we call BiasGPT. The customised GPT models will ultimately collaborate, merging their diverse perspectives on a topic into an integrated response that captures a broad spectrum of human experiences and viewpoints. In this paper, through experiments, we demonstrate the capabilities of a GPT model to embed different biases which, when combined, can open the possibilities of more inclusive AI technologies., Comment: 2nd International Conference on Foundation and Large Language Models (FLLM2024), 26-29 November, 2024 | Dubai, UAE

Toxicity text detectors can be vulnerable to adversarial examples - small perturbations to input text that fool the systems into wrong detection. Existing attack algorithms are time-consuming and often produce invalid or ambiguous adversarial examples, making them less useful for evaluating or improving real-world toxicity content moderators. This paper proposes an annotation pipeline for quality control of generated toxic adversarial examples (TAE). We design model-based automated annotation and human-based quality verification to assess the quality requirements of TAE. Successful TAE should fool a target toxicity model into making benign predictions, be grammatically reasonable, appear natural like human-generated text, and exhibit semantic toxicity. When applying these requirements to more than 20 state-of-the-art (SOTA) TAE attack recipes, we find many invalid samples from a total of 940k raw TAE attack generations. We then utilize the proposed pipeline to filter and curate a high-quality TAE dataset we call TaeBench (of size 264k). Empirically, we demonstrate that TaeBench can effectively transfer-attack SOTA toxicity content moderation models and services. Our experiments also show that TaeBench with adversarial training achieve significant improvements of the robustness of two toxicity detectors.

The ability to efficiently characterize the spatial correlations of entangled states of light is critical for applications of many quantum technologies such as quantum imaging. Here, we demonstrate highly efficient theoretical and experimental characterization of the spatial Schmidt modes and the Schmidt spectrum of bright multiphoton entangled states of light produced from high-gain parametric down-conversion. In contrast to previous studies, we exploit the approximate quasihomogeneity and isotropy of the signal field and dramatically reduce the numerical computations involved in the experimental and theoretical characterization procedures. In our particular case where our experimental data sets consist of 5000 single-shot images of 256*256 pixels each, our method reduced the overall computation time by 2 orders of magnitude. This speed-up would be even more dramatic for larger input sizes. Consequently, we are able to rapidly characterize the Schmidt modes and Schmidt spectrum for a range of pump amplitudes and study their variation with increasing gain. Our results clearly reveal the broadening of the Schmidt modes and narrowing of the Schmidt spectrum for increasing gain with good agreement between theory and experiment., Comment: 8 pages, 4 figures

Long-tailed problems in healthcare emerge from data imbalance due to variability in the prevalence and representation of different medical conditions, warranting the requirement of precise and dependable classification methods. Traditional loss functions such as cross-entropy and binary cross-entropy are often inadequate due to their inability to address the imbalances between the classes with high representation and the classes with low representation found in medical image datasets. We introduce a novel polynomial loss function based on Pade approximation, designed specifically to overcome the challenges associated with long-tailed classification. This approach incorporates asymmetric sampling techniques to better classify under-represented classes. We conducted extensive evaluations on three publicly available medical datasets and a proprietary medical dataset. Our implementation of the proposed loss function is open-sourced in the public repository:https://github.com/ipankhi/ALPA., Comment: 13 pages, 1 figures. Accepted in The 35th British Machine Vision Conference (BMVC24)

In this study, we introduce ANGST, a novel, first-of-its kind benchmark for depression-anxiety comorbidity classification from social media posts. Unlike contemporary datasets that often oversimplify the intricate interplay between different mental health disorders by treating them as isolated conditions, ANGST enables multi-label classification, allowing each post to be simultaneously identified as indicating depression and/or anxiety. Comprising 2876 meticulously annotated posts by expert psychologists and an additional 7667 silver-labeled posts, ANGST posits a more representative sample of online mental health discourse. Moreover, we benchmark ANGST using various state-of-the-art language models, ranging from Mental-BERT to GPT-4. Our results provide significant insights into the capabilities and limitations of these models in complex diagnostic scenarios. While GPT-4 generally outperforms other models, none achieve an F1 score exceeding 72% in multi-class comorbid classification, underscoring the ongoing challenges in applying language models to mental health diagnostics., Comment: 24 Pages

Over the past several decades, time-series photometry of CSPNe has yielded significant results including, but not limited to, discoveries of nearly 100 binary systems, insights into pulsations and winds in young white dwarfs, and studies of stars undergoing very late thermal pulses. We have undertaken a systematic study of optical photometric variability of cataloged CSPNe, using the epochal photometric data from the Zwicky Transient Facility (ZTF). By applying appropriate variability metrics, we arrive at a list of 94 significantly variable CSPNe. Based on the timescales of the light-curve activity, we classify the variables broadly into short- and long-timescale variables. In this first paper in this series, we focus on the former, which is the majority class comprising 83 objects. We infer periods for six sources for the first time, and recover several known periodic variables. Among the aperiodic sources, most exhibit a jitter around a median flux with a stable amplitude, and a few show outbursts. We draw attention to WeSb 1, which shows a different kind of variability: prominent deep and aperiodic dips, resembling transits from a dust/debris disk. We find strong evidence for a binary nature of WeSb 1 (possibly an A- to G-type companion). The compactness of the emission lines and inferred high electron densities make WeSb 1 a candidate for either an EGB 6-type planetary nucleus, or a symbiotic system inside an evolved planetary nebula, both of which are rare objects. To demonstrate further promise with ZTF, we report three additional newly identified periodic sources that do not appear in the list of highly variable sources. Finally, we also introduce a two-dimensional metric space defined by the von Neumann statistics and Pearson Skew and demonstrate its effectiveness in identifying unique variables of astrophysical interest, like WeSb 1., Comment: 19 pages + 8 pages appendix, 5 tables, 17 figures; Submitted to PASP; Comments are welcome!

The rapid advancement of deepfake technology poses a significant threat to digital media integrity. Deepfakes, synthetic media created using AI, can convincingly alter videos and audio to misrepresent reality. This creates risks of misinformation, fraud, and severe implications for personal privacy and security. Our research addresses the critical issue of deepfakes through an innovative multimodal approach, targeting both visual and auditory elements. This comprehensive strategy recognizes that human perception integrates multiple sensory inputs, particularly visual and auditory information, to form a complete understanding of media content. For visual analysis, a model that employs advanced feature extraction techniques was developed, extracting nine distinct facial characteristics and then applying various machine learning and deep learning models. For auditory analysis, our model leverages mel-spectrogram analysis for feature extraction and then applies various machine learning and deep learningmodels. To achieve a combined analysis, real and deepfake audio in the original dataset were swapped for testing purposes and ensured balanced samples. Using our proposed models for video and audio classification i.e. Artificial Neural Network and VGG19, the overall sample is classified as deepfake if either component is identified as such. Our multimodal framework combines visual and auditory analyses, yielding an accuracy of 94%., Comment: 22 pages, 14 figures, Accepted in Journal of Electrical Systems

This paper explores modifications to General Relativity (GR) by considering higher-order curvature terms in the gravitational action, specifically focusing on the quadratic Ricci scalar and a particular cubic contraction of the Riemann tensor. These modifications introduce new interactions at short distances, potentially altering the dynamics of compact objects. We calculate the effective two-body binding potential energy for these modified theories to quantify these effects using the worldline effective field theory (WEFT) formalism. This approach allows us to systematically integrate out short-distance gravitational effects, capturing the modifications to the binding potential. Our results demonstrate how the quadratic Ricci scalar and cubic Riemann tensor terms contribute to the two-body interaction at the leading order, highlighting deviations from classical GR predictions. These findings provide insight into the possible observational signatures of such modified gravity theories in binary systems and other astrophysical settings., Comment: 22 pages

The scarcity of subspecialist medical expertise, particularly in rare, complex and life-threatening diseases, poses a significant challenge for healthcare delivery. This issue is particularly acute in cardiology where timely, accurate management determines outcomes. We explored the potential of AMIE (Articulate Medical Intelligence Explorer), a large language model (LLM)-based experimental AI system optimized for diagnostic dialogue, to potentially augment and support clinical decision-making in this challenging context. We curated a real-world dataset of 204 complex cases from a subspecialist cardiology practice, including results for electrocardiograms, echocardiograms, cardiac MRI, genetic tests, and cardiopulmonary stress tests. We developed a ten-domain evaluation rubric used by subspecialists to evaluate the quality of diagnosis and clinical management plans produced by general cardiologists or AMIE, the latter enhanced with web-search and self-critique capabilities. AMIE was rated superior to general cardiologists for 5 of the 10 domains (with preference ranging from 9% to 20%), and equivalent for the rest. Access to AMIE's response improved cardiologists' overall response quality in 63.7% of cases while lowering quality in just 3.4%. Cardiologists' responses with access to AMIE were superior to cardiologist responses without access to AMIE for all 10 domains. Qualitative examinations suggest AMIE and general cardiologist could complement each other, with AMIE thorough and sensitive, while general cardiologist concise and specific. Overall, our results suggest that specialized medical LLMs have the potential to augment general cardiologists' capabilities by bridging gaps in subspecialty expertise, though further research and validation are essential for wide clinical utility.

Medical time series datasets feature missing values that need data imputation methods, however, conventional machine learning models fall short due to a lack of uncertainty quantification in predictions. Among these models, the CATSI (Context-Aware Time Series Imputation) stands out for its effectiveness by incorporating a context vector into the imputation process, capturing the global dependencies of each patient. In this paper, we propose a Bayesian Context-Aware Time Series Imputation (Bayes-CATSI) framework which leverages uncertainty quantification offered by variational inference. We consider the time series derived from electroencephalography (EEG), electrooculography (EOG), electromyography (EMG), electrocardiology (EKG). Variational Inference assumes the shape of the posterior distribution and through minimization of the Kullback-Leibler(KL) divergence it finds variational densities that are closest to the true posterior distribution. Thus , we integrate the variational Bayesian deep learning layers into the CATSI model. Our results show that Bayes-CATSI not only provides uncertainty quantification but also achieves superior imputation performance compared to the CATSI model. Specifically, an instance of Bayes-CATSI outperforms CATSI by 9.57 %. We provide an open-source code implementation for applying Bayes-CATSI to other medical data imputation problems.

Deep multimodal learning has shown remarkable success by leveraging contrastive learning to capture explicit one-to-one relations across modalities. However, real-world data often exhibits shared relations beyond simple pairwise associations. We propose M3CoL, a Multimodal Mixup Contrastive Learning approach to capture nuanced shared relations inherent in multimodal data. Our key contribution is a Mixup-based contrastive loss that learns robust representations by aligning mixed samples from one modality with their corresponding samples from other modalities thereby capturing shared relations between them. For multimodal classification tasks, we introduce a framework that integrates a fusion module with unimodal prediction modules for auxiliary supervision during training, complemented by our proposed Mixup-based contrastive loss. Through extensive experiments on diverse datasets (N24News, ROSMAP, BRCA, and Food-101), we demonstrate that M3CoL effectively captures shared multimodal relations and generalizes across domains. It outperforms state-of-the-art methods on N24News, ROSMAP, and BRCA, while achieving comparable performance on Food-101. Our work highlights the significance of learning shared relations for robust multimodal learning, opening up promising avenues for future research., Comment: RK and RS contributed equally to this work, 20 Pages, 8 Figures, 9 Tables. Another version of the paper accepted at NeurIPS 2024 Workshop on Unifying Representations in Neural Models (UniReps)

In the domain of education, the integration of,technology has led to a transformative era, reshaping traditional,learning paradigms. Central to this evolution is the automation,of grading processes, particularly within the STEM domain encompassing Science, Technology, Engineering, and Mathematics.,While efforts to automate grading have been made in subjects,like Literature, the multifaceted nature of STEM assessments,presents unique challenges, ranging from quantitative analysis,to the interpretation of handwritten diagrams. To address these,challenges, this research endeavors to develop efficient and reliable grading methods through the implementation of automated,assessment techniques using Artificial Intelligence (AI). Our,contributions lie in two key areas: firstly, the development of a,robust system for evaluating textual answers in STEM, leveraging,sample answers for precise comparison and grading, enabled by,advanced algorithms and natural language processing techniques.,Secondly, a focus on enhancing diagram evaluation, particularly,flowcharts, within the STEM context, by transforming diagrams,into textual representations for nuanced assessment using a,Large Language Model (LLM). By bridging the gap between,visual representation and semantic meaning, our approach ensures accurate evaluation while minimizing manual intervention.,Through the integration of models such as CRAFT for text,extraction and YoloV5 for object detection, coupled with LLMs,like Mistral-7B for textual evaluation, our methodology facilitates,comprehensive assessment of multimodal answer sheets. This,paper provides a detailed account of our methodology, challenges,encountered, results, and implications, emphasizing the potential,of AI-driven approaches in revolutionizing grading practices in,STEM education.

The relative contribution of emission from stellar sources and accretion onto supermassive black holes to reionization has been brought into focus again by the apparent high abundance of faint AGN at $4\lesssim z\lesssim11$ uncovered by JWST. We investigate the contribution of these faint AGN to hydrogen and the early stages of helium reionization using the GPU-based radiative transfer code ATON-HE by post-processing a cosmological hydrodynamical simulation from the SHERWOOD-RELICS suite of simulations. We study four models of reionization: two previously studied galaxy-only late-end reionization models and two new models -- a QSO-assisted model and a QSO-only model. In the QSO-assisted model, 1\% of the haloes host AGN with a 10~Myr lifetime, and the AGN luminosities are scaled such that the AGN contribution to the hydrogen-ionizing emissivity is 20\% of that contributed by galaxies. In the QSO-only model, quasars account for all the hydrogen-ionizing emissivity, with 10\% of the haloes hosting AGN, each with a 10 Myr lifetime. All models are calibrated to the observed mean Lyman-$\alpha$ forest transmission at $5\lesssim z\lesssim6.2$. We find that the QSO-assisted model requires an emissivity factor of $1.8$ lower than the galaxy-only models towards the end of reionization and fits the observed distribution of the Lyman-$\alpha$ optical depths well. Our QSO-only model is inconsistent with the observed Lyman-$\alpha$ optical depths distribution. It also results in too high IGM temperatures at $z\lesssim 5$ due to an early onset of HeII reionization unless the escape fraction of HeII-ionizing photons is assumed to be low. Our results suggest that a modest contribution to reionization by faint AGN is in good agreement with the Lyman-$\alpha$ forest data. In contrast, a scenario dominated by faint AGN appears difficult to reconcile with these observations., Comment: 19 pages, 11 figures

We propose a novel and low-cost test-time adversarial defense by devising interpretability-guided neuron importance ranking methods to identify neurons important to the output classes. Our method is a training-free approach that can significantly improve the robustness-accuracy tradeoff while incurring minimal computational overhead. While being among the most efficient test-time defenses (4x faster), our method is also robust to a wide range of black-box, white-box, and adaptive attacks that break previous test-time defenses. We demonstrate the efficacy of our method for CIFAR10, CIFAR100, and ImageNet-1k on the standard RobustBench benchmark (with average gains of 2.6%, 4.9%, and 2.8% respectively). We also show improvements (average 1.5%) over the state-of-the-art test-time defenses even under strong adaptive attacks., Comment: ECCV 2024. Project Page: https://lilywenglab.github.io/Interpretability-Guided-Defense/

We present ImPoster, a novel algorithm for generating a target image of a 'source' subject performing a 'driving' action. The inputs to our algorithm are a single pair of a source image with the subject that we wish to edit and a driving image with a subject of an arbitrary class performing the driving action, along with the text descriptions of the two images. Our approach is completely unsupervised and does not require any access to additional annotations like keypoints or pose. Our approach builds on a pretrained text-to-image latent diffusion model and learns the characteristics of the source and the driving image by finetuning the diffusion model for a small number of iterations. At inference time, ImPoster performs step-wise text prompting i.e. it denoises by first moving in the direction of the image manifold corresponding to the driving image followed by the direction of the image manifold corresponding to the text description of the desired target image. We propose a novel diffusion guidance formulation, image frequency guidance, to steer the generation towards the manifold of the source subject and the driving action at every step of the inference denoising. Our frequency guidance formulations are derived from the frequency domain properties of images. We extensively evaluate ImPoster on a diverse set of source-driving image pairs to demonstrate improvements over baselines. To the best of our knowledge, ImPoster is the first approach towards achieving both subject-driven as well as action-driven image personalization. Code and data is available at https://github.com/divyakraman/ImPosterDiffusion2024.

Recent advancements in Large Language Models(LLMs) have been notable, yet widespread enterprise adoption remains limited due to various constraints. This paper examines bias in LLMs-a crucial issue affecting their usability, reliability, and fairness. Researchers are developing strategies to mitigate bias, including debiasing layers, specialized reference datasets like Winogender and Winobias, and reinforcement learning with human feedback (RLHF). These techniques have been integrated into the latest LLMs. Our study evaluates gender bias in occupational scenarios and gender, age, and racial bias in crime scenarios across four leading LLMs released in 2024: Gemini 1.5 Pro, Llama 3 70B, Claude 3 Opus, and GPT-4o. Findings reveal that LLMs often depict female characters more frequently than male ones in various occupations, showing a 37% deviation from US BLS data. In crime scenarios, deviations from US FBI data are 54% for gender, 28% for race, and 17% for age. We observe that efforts to reduce gender and racial bias often lead to outcomes that may over-index one sub-class, potentially exacerbating the issue. These results highlight the limitations of current bias mitigation techniques and underscore the need for more effective approaches., Comment: 11 pages, 17 figures

We employed sodium mesitylene sulfonate crystals to investigate angle-dependent phonon resonance and thickness-dependent splitting in THz time-domain polarimetry. This crystal possesses a C2 space group, leading to a repetition pattern after 180deg rotations. Our experimental observations revealed intriguing behaviour: We observed a non-linear response when varying the angle from 10deg to 360deg in both 0.182mm and 1.266mm thick crystals. specifically, at 90deg and 270deg, dip resonance occurred, while at 180deg and 360deg, no phonon resonance was observed. For thick crystals, we observed the splitting of phonon modes. Our findings offer valuable insights into the phononic properties of this crystal as the angle varies., Comment: 9 pages, 9 figures

In this paper, we explore the feasibility of developing a novel flexible pedicle screw (FPS) for enhanced spinal fixation of osteoporotic vertebrae. Vital for spinal fracture treatment, pedicle screws have been around since the early 20th century and have undergone multiple iterations to enhance internal spinal fixation. However, spinal fixation treatments tend to be problematic for osteoporotic patients due to multiple inopportune variables. The inherent rigid nature of the pedicle screw, along with the forced linear trajectory of the screw path, frequently leads to the placement of these screws in highly osteoporotic regions of the bone. This results in eventual screw slippage and causing neurological and respiratory problems for the patient. To address this problem, we focus on developing a novel FPS that is structurally capable of safely bending to fit curved trajectories drilled by a steerable drilling robot and bypass highly osteoporotic regions of the vertebral body. Afterwards, we simulate its morphability capabilities using finite element analysis (FEA). We then additively manufacture the FPS using stainless steel (SS) 316L alloy through direct metal laser sintering (DMLS). Finally, the fabricated FPS is experimentally evaluated for its bending performance and compared with the FEA results for verification. Results demonstrate the feasibility of additive manufacturing of FPS using DMLS approach and agreement of the developed FEA with the experiments.

The public goods game describes a social dilemma in which a large proportion of agents act as conditional cooperators (CC): they only act cooperatively if they see others acting cooperatively because they satisfice with the social norm to be in line with what others are doing instead of optimizing cooperation. CCs are guided by aspiration-based reinforcement learning guided by past experiences of interactions with others and satisficing aspirations. In many real-world settings, reinforcing social norms do not emerge. In this paper, we propose that an optimizing reinforcement agent can facilitate cooperation through nudges, i.e. indirect mechanisms for cooperation to happen. The agent's goal is to motivate CCs into cooperation through its own actions to create social norms that signal that others are cooperating. We introduce a multi-agent reinforcement learning model for public goods games, with 3 CC learning agents using aspirational reinforcement learning and 1 nudging agent using deep reinforcement learning to learn nudges that optimize cooperation. For our nudging agent, we model two distinct reward functions, one maximizing the total game return (sum DRL) and one maximizing the number of cooperative contributions contributions higher than a proportional threshold (prop DRL). Our results show that our aspiration-based RL model for CC agents is consistent with empirically observed CC behavior. Games combining 3 CC RL agents and one nudging RL agent outperform the baseline consisting of 4 CC RL agents only. The sum DRL nudging agent increases the total sum of contributions by 8.22% and the total proportion of cooperative contributions by 12.42%, while the prop nudging DRL increases the total sum of contributions by 8.85% and the total proportion of cooperative contributions by 14.87%. Our findings advance the literature on public goods games and reinforcement learning.

This article provides a first-hand account of the 1982 Arecibo observations that led to the discovery of PSR B1937+21, the first-known millisecond pulsar. It is a companion paper to Demorest & Goss (2024) and Readhead (2024)., Comment: 7 pages. Accepted by Journal of Astronomical History & Heritage

Investigating Li$^+$ transport within the amorphous lithium phosphorous oxynitride (LiPON) framework, especially across a Li||LiPON interface, has proven challenging due to its amorphous nature and varying stoichiometry, necessitating large supercells and long timescales for computational models. Notably, machine learned interatomic potentials (MLIPs) can combine the computational speed of classical force fields with the accuracy of density functional theory (DFT), making them the ideal tool for modelling such amorphous materials. Thus, in this work, we train and validate the neural equivariant Interatomic potential (NequIP) framework on a comprehensive DFT-based dataset consisting of 13,454 chemically relevant structures to describe LiPON. With an optimized training (validation) energy and force mean absolute errors of 5.5 (6.1) meV/atom and 13.6 (13.2) meV/{\AA}, respectively, we employ the trained potential in model Li-transport in both bulk LiPON and across a Li||LiPON interface. Amorphous LiPON structures generated by the optimized potential do resemble those generated by ab initio molecular dynamics, with N being incorporated on non-bridging apical and bridging sites. Subsequent analysis of Li$^+$ diffusivity in the bulk LiPON structures indicates broad agreement with computational and experimental literature so far. Further, we investigate the anisotropy in Li$^+$ transport across the Li(110)||LiPON interface, where we observe Li-transport across the interface to be one order-of-magnitude slower than Li-motion within the bulk Li and LiPON phases. Nevertheless, we note that this anisotropy of Li-transport across the interface is minor and do not expect it to cause any significant impedance buildup. Finally, our work highlights the efficiency of MLIPs in enabling high-fidelity modelling of complex non-crystalline systems over large length and time scales.

The design and production of VLSI chips is a multilevel heirarchical process. As the demand for reduced die-area and technology nodes becomes prevalent, it gets increasingly challenging to optimize Power, Performance and Area (PPA) parameters to accommodate for the ever-increasing core logic on a chip. A well defined heirarchical flow is thus quintessential when it comes to VLSI design process. A robust heirarchical flow should encompass all stages, right from Gate-level RTL Synthesis (Front End Design) to Logic Placement and Verification (Back End Physical Design) and finally culminating with tapeout / production. Physical Design in this aforementioned flow is the process of translating logical circuit description into physically realizable GDSII form. This involves defining the best possible placement and routing for standard cells, macros and I/Os in the design to optimize PPA for any given netlist. This paper helps capture the nitty-gritty of methodologies and algorithms that are pertinent to the building and optimization of an efficient and robust physical design flow in VLSI chip-designing process.

Type Ia supernovae (SNe Ia) constitute an historical probe to derive cosmological parameters through the fit of the Hubble-Lema\^itre diagram, i.e. SN Ia distance modulus versus their redshift. In the era of precision cosmology, realistic simulation of SNe Ia for any survey entering in an Hubble-Lema\^itre diagram is a key tool to address observational systematics, like Malmquist bias. As the distance modulus of SNe Ia is derived from the fit of their light-curves, a robust simulation framework is required. In this paper, we present the performances of the simulation framework skysurvey to reproduce the the Zwicky Transient Facility (ZTF) SN Ia DR2 covering the first phase of ZTF running from April 2018 up to December 2020. The ZTF SN Ia DR2 sample correspond to almost 3000 classified SNe Ia of cosmological quality. First, a targeted simulation of the ZTF SN Ia DR2 was carried on to check the validity of the framework after some fine tuning of the observing conditions and instrument performance. Then, a realistic simulation has been run using observing ZTF logs and ZTF SN Ia DR2 selection criteria on simulated light-curves to demonstrate the ability of the simulation framework to match the ZTF SN Ia DR2 sample. Furthermore a redshift dependency of SALT2 light-curve parameters (stretch and colour) was conducted to deduce a volume limited sample, i.e. an unbiased SNe Ia sample, characterized with $z_{lim} \leq 0.06$. This volume limited sample of about 1000 SNe Ia is unique to carry on new analysis on standardization procedure with a precision never reached (those analysis are presented in companion papers)., Comment: 10 pages, 10 figures. Submitted to A & A

Evaluating models and datasets in computer vision remains a challenging task, with most leaderboards relying solely on accuracy. While accuracy is a popular metric for model evaluation, it provides only a coarse assessment by considering a single model's score on all dataset items. This paper explores Item Response Theory (IRT), a framework that infers interpretable latent parameters for an ensemble of models and each dataset item, enabling richer evaluation and analysis beyond the single accuracy number. Leveraging IRT, we assess model calibration, select informative data subsets, and demonstrate the usefulness of its latent parameters for analyzing and comparing models and datasets in computer vision.