Search

LLM-as-a-Judge has been widely utilized as an evaluation method in various benchmarks and served as supervised rewards in model training. However, despite their excellence in many domains, potential issues are under-explored, undermining their reliability and the scope of their utility. Therefore, we identify 12 key potential biases and propose a new automated bias quantification framework-CALM-which systematically quantifies and analyzes each type of bias in LLM-as-a-Judge by using automated and principle-guided modification. Our experiments cover multiple popular language models, and the results indicate that while advanced models have achieved commendable overall performance, significant biases persist in certain specific tasks. Empirical results suggest that there remains room for improvement in the reliability of LLM-as-a-Judge. Moreover, we also discuss the explicit and implicit influence of these biases and give some suggestions for the reliable application of LLM-as-a-Judge. Our work highlights the need for stakeholders to address these issues and remind users to exercise caution in LLM-as-a-Judge applications.

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly used as evaluators to filter training data, evaluate model performance or assist human evaluators with detailed assessments. To support this process, effective front-end tools are critical for evaluation. Two common approaches for using LLMs as evaluators are direct assessment and pairwise comparison. In our study with machine learning practitioners (n=15), each completing 6 tasks yielding 131 evaluations, we explore how task-related factors and assessment strategies influence criteria refinement and user perceptions. Findings show that users performed more evaluations with direct assessment by making criteria task-specific, modifying judgments, and changing the evaluator model. We conclude with recommendations for how systems can better support interactions in LLM-assisted evaluations.

In this paper, we investigate the impact of hallucinations and cognitive forcing functions in human-AI collaborative text generation tasks, focusing on the use of Large Language Models (LLMs) to assist in generating high-quality conversational data. LLMs require data for fine-tuning, a crucial step in enhancing their performance. In the context of conversational customer support, the data takes the form of a conversation between a human customer and an agent and can be generated with an AI assistant. In our inquiry, involving 11 users who each completed 8 tasks, resulting in a total of 88 tasks, we found that the presence of hallucinations negatively impacts the quality of data. We also find that, although the cognitive forcing function does not always mitigate the detrimental effects of hallucinations on data quality, the presence of cognitive forcing functions and hallucinations together impacts data quality and influences how users leverage the AI responses presented to them. Our analysis of user behavior reveals distinct patterns of reliance on AI-generated responses, highlighting the importance of managing hallucinations in AI-generated content within conversational AI contexts.

The Large Magellanic Cloud (LMC) presents a unique environment for pulsar population studies due to its distinct star formation characteristics and proximity to the Milky Way. As part of the TRAPUM (TRAnsients and PUlsars with MeerKAT) Large Survey Project, we are using the core array of the MeerKAT radio telescope (MeerKAT) to conduct a targeted search of the LMC for radio pulsars at L-band frequencies, 856-1712$\,$MHz. The excellent sensitivity of MeerKAT, coupled with a 2-hour integration time, makes the survey 3 times more sensitive than previous LMC radio pulsar surveys. We report the results from the initial four survey pointings which has resulted in the discovery of seven new radio pulsars, increasing the LMC radio pulsar population by 30 per cent. The pulse periods of these new pulsars range from 278 to 1690$\,$ms, and the highest dispersion measure is 254.20$\,$pc$\,$cm$^{-3}$. We searched for, but did not find any significant pulsed radio emission in a beam centred on the SN$\,$1987A remnant, establishing an upper limit of 6.3$\,{\mu}$Jy on its minimum flux density at 1400$\,$MHz., Comment: 12 pages, 4 figures, 4 tables. Accepted for publication in Monthly Notices of the Royal Astronomical Society

The eclipses seen in the radio emission of some pulsars can be invaluable to study the properties of the material from the companion stripped away by the pulsar. We present a study of six consecutive eclipses of PSR J0024-7204O in the globular cluster 47 Tucanae as seen by the MeerKAT radio telescope in the UHF (544-1088 MHz) band. A high scintillation state boosted the signal during one of the orbits and allowed a detailed study of the eclipse properties. We measure significant dispersion measure (DM) variations and detect strong scattering that seems to be the dominating mechanism of the eclipses at these frequencies. A complete drop in the linear polarization together with a small increase in the rotation measure suggests the presence of a magnetic field of $\sim 2$ mG. The study of multiple eclipses allowed us to measure difference in the lengths of the eclipses and DM differences of $\sim 0.01$ pc cm$^{-3}$ in consecutive orbits. One orbit in particular shows a delay in recovery of the linear polarization and a visible delay in the arrival of the pulses caused by a stronger scattering event. We suggest that these are caused by a higher variance of density fluctuations during the event., Comment: 14 pages, 8 figures, 9 tables. Accepted for publication on Monthly Notices of the Royal Astronomical Society

In unsupervised representation learning, models aim to distill essential features from high-dimensional data into lower-dimensional learned representations, guided by inductive biases. Understanding the characteristics that make a good representation remains a topic of ongoing research. Disentanglement of independent generative processes has long been credited with producing high-quality representations. However, focusing solely on representations that adhere to the stringent requirements of most disentanglement metrics, may result in overlooking many high-quality representations, well suited for various downstream tasks. These metrics often demand that generative factors be encoded in distinct, single dimensions aligned with the canonical basis of the representation space. Motivated by these observations, we propose two novel metrics: Importance-Weighted Orthogonality (IWO) and Importance-Weighted Rank (IWR). These metrics evaluate the mutual orthogonality and rank of generative factor subspaces. Throughout extensive experiments on common downstream tasks, over several benchmark datasets and models, IWO and IWR consistently show stronger correlations with downstream task performance than traditional disentanglement metrics. Our findings suggest that representation quality is closer related to the orthogonality of independent generative processes rather than their disentanglement, offering a new direction for evaluating and improving unsupervised learning models.

Millisecond pulsars are subject to accelerations in globular clusters (GCs) that manifest themselves in both the first and second spin period time derivatives, and can be used to explore the mass distribution of the potentials they inhabit. Here we report on over 20 yr of pulsar timing observations of five millisecond radio pulsars in the core of the core-collapse GC NGC 6752 with the Parkes (Murriyang) and MeerKAT radio telescopes, which have allowed us to measure the proper motions, positions, and first and second time derivatives of the pulsars. The pulsar timing parameters indicate that all the pulsars in the core experience accelerations and jerks that can be explained only if an amount of nonluminous mass of at least 2.56x10^3 M_SUN is present in the core of NGC 6752. On the other hand, our studies highly disfavor the presence of an intermediate-mass black hole at the center of the cluster, with a mass equal to or greater than ~3000M_SUN., Comment: Published in ApJ. Replaced with the final published version

Traditional reference-based metrics, such as BLEU and ROUGE, are less effective for assessing outputs from Large Language Models (LLMs) that produce highly creative or superior-quality text, or in situations where reference outputs are unavailable. While human evaluation remains an option, it is costly and difficult to scale. Recent work using LLMs as evaluators (LLM-as-a-judge) is promising, but trust and reliability remain a significant concern. Integrating human input is crucial to ensure criteria used to evaluate are aligned with the human's intent, and evaluations are robust and consistent. This paper presents a user study of a design exploration called EvaluLLM, that enables users to leverage LLMs as customizable judges, promoting human involvement to balance trust and cost-saving potential with caution. Through interviews with eight domain experts, we identified the need for assistance in developing effective evaluation criteria aligning the LLM-as-a-judge with practitioners' preferences and expectations. We offer findings and design recommendations to optimize human-assisted LLM-as-judge systems., Comment: 14 pages, 6 figures, Accepted for publication in ACL 2024 Workshop HuCLLM

Context: There are currently three pulsars firmly detected by imaging atmospheric Cherenkov telescopes (IACTs), two of them reaching TeV energies, challenging models of very-high-energy (VHE) emission in pulsars. More precise observations are needed to better characterize pulsar emission at these energies. The LST-1 is the prototype of the Large-Sized Telescope, that will be part of the Cherenkov Telescope Array Observatory (CTAO). Its improved performance over previous IACTs makes it well suited for studying pulsars. Aims: To study the Crab pulsar emission with the LST-1, improving and complementing the results from other telescopes. These observations can also be used to characterize the potential of the LST-1 to study other pulsars and detect new ones. Methods: We analyzed a total of $\sim$103 hours of gamma-ray observations of the Crab pulsar conducted with the LST-1 in the period from September 2020 to January 2023. The observations were carried out at zenith angles less than 50 degrees. A new analysis of the Fermi-LAT data was also performed, including $\sim$14 years of observations. Results: The Crab pulsar phaseogram, long-term light-curve, and phase-resolved spectra are reconstructed with the LST-1 from 20 GeV to 450 GeV for P1 and up to 700 GeV for P2. The pulsed emission is detected with a significance of 15.2$\sigma$. The two characteristic emission peaks of the Crab pulsar are clearly detected (>10$\sigma$), as well as the so-called bridge emission (5.7$\sigma$). We find that both peaks are well described by power laws, with spectral indices of $\sim$3.44 and $\sim$3.03 respectively. The joint analysis of Fermi-LAT and LST-1 data shows a good agreement between both instruments in the overlapping energy range. The detailed results obtained in the first observations of the Crab pulsar with LST-1 show the potential that CTAO will have to study this type of sources., Comment: Accepted by A&A

Digitalisation in education and its influence on teaching methods is the focus of this study, which examines the use of ChatGPT in a role-playing game used in the Cloud Computing Engineering Master's programme at the University of Applied Sciences Burgenland. The aim of the study was to analyse the impact of AI-based simulations on students' learning experience. Based on Vygotsky's sociocultural theory, ChatGPT was used to give students a deeper understanding of strategic decision-making processes in simulated business scenarios. The methodological approach included role-playing and qualitative content analysis of 20 student reflections. The findings suggest that ChatGPT enhances students' engagement, critical thinking, and communication skills, in addition to contributing to the effective application of theoretical knowledge. Furthermore, simulations can contribute to the effective application of theoretical knowledge. The results underscore the significance of adaptive teaching approaches in promoting digital literacy and equipping learners for the digital workplace. The integration of AI into curricula and the need for ongoing innovation in higher education are also emphasised as a means of guaranteeing excellent, future-focused instruction. The findings highlight the potential of AI and ChatGPT in particular, as an innovative cutting-edge educational tool that can both enhance the learning experience and help achieve the Sustainable Development Goals (SDGs) through education., Comment: Received 23-02-2024; Accepted 20-05-2024; Published 27-05-2024

We report on the results of an image-based search for pulsar candidates toward the Galactic bulge. We used mosaic images from the MeerKAT radio telescope, that were taken as part of a 173 deg**2 survey of the bulge and Galactic center of our Galaxy at L band (856-1712 MHz) in all four Stokes I, Q, U and V. The image root-mean-square noise levels of 12-17 uJy/ba represent a significant increase in sensitivity over past image-based pulsar searches. Our primary search criterion was circular polarization, but we used other criteria including linear polarization, in-band spectral index, compactness, variability and multi-wavelength counterparts to select pulsar candidates. We first demonstrate the efficacy of this technique by searching for polarized emission from known pulsars, and comparing our results with measurements from the literature. Our search resulted in a sample of 75 polarized pulsar candidates. Bright stars or young stellar objects were associated with 28 of these sources, including a small sample of highly polarized dwarf stars with pulsar-like steep spectra. Comparing the properties of this sample with the known pulsars, we identified 30 compelling candidates for pulsation follow-up, including two sources with both strong circular and linear polarization. The remaining 17 sources are either pulsars or stars, but we cannot rule out an extragalactic origin or image artifacts among the brighter, flat spectrum objects., Comment: 28 pages, 10 figures, 6 tables. ApJ, in press

While humans increasingly rely on large language models (LLMs), they are susceptible to generating inaccurate or false information, also known as "hallucinations". Technical advancements have been made in algorithms that detect hallucinated content by assessing the factuality of the model's responses and attributing sections of those responses to specific source documents. However, there is limited research on how to effectively communicate this information to users in ways that will help them appropriately calibrate their trust toward LLMs. To address this issue, we conducted a scenario-based study (N=104) to systematically compare the impact of various design strategies for communicating factuality and source attribution on participants' ratings of trust, preferences, and ease in validating response accuracy. Our findings reveal that participants preferred a design in which phrases within a response were color-coded based on the computed factuality scores. Additionally, participants increased their trust ratings when relevant sections of the source material were highlighted or responses were annotated with reference numbers corresponding to those sources, compared to when they received no annotation in the source material. Our study offers practical design guidelines to facilitate human-LLM collaboration and it promotes a new human role to carefully evaluate and take responsibility for their use of LLM outputs., Comment: Submitted to the Trust and Reliance in Evolving Human-AI Workflows (TREW) Workshop at CHI 2024

One of the fundamental distinctions in McMullen and Sullivan's description of the Teichm\"uller space of a complex dynamical system is between discrete and indiscrete grand orbit relations. We investigate these on the Fatou set of transcendental entire maps and provide criteria to distinguish between the two types. Furthermore, we show that discrete and indiscrete grand orbit relations may coexist non-trivially in a wandering domain, a phenomenon which does not occur for any other type of Fatou component. One of the tools used is a novel quasiconformal surgery technique of independent interest., Comment: 29 pages, 3 figures

Background & Purpose: FLASH or ultra-high dose rate (UHDR) radiation therapy (RT) has gained attention in recent years for its ability to spare normal tissues relative to conventional dose rate (CDR) RT in various preclinical trials. However, clinical implementation of this promising treatment option has been limited because of the lack of availability of accelerators capable of delivering UHDR RT. We established a framework for the acceptance, commissioning, and periodic quality assurance (QA) of electron FLASH units and present an example of commissioning. Methods: A protocol for acceptance, commissioning, and QA of UHDR linear accelerators was established by combining and adapting standards and professional recommendations for standard linear accelerators based on the experience with UHDR at four clinical centers that use different UHDR devices. Non-standard dosimetric beam parameters considered included pulse width, pulse repetition frequency, dose per pulse, and instantaneous dose rate, together with recommendations on how to acquire these measurements. Results: The 6 and 9 MeV beams of an UHDR electron device were commissioned by using this developed protocol. Measurements were acquired with a combination of ion chambers, beam current transformers (BCTs), and dose rate independent passive dosimeters. The unit was calibrated according to the concept of redundant dosimetry using a reference setup. Conclusions: This study provides detailed recommendations for the acceptance testing, commissioning, and routine QA of low-energy electron UHDR linear accelerators. The proposed framework is not limited to any specific unit, making it applicable to all existing eFLASH units in the market. Through practical insights and theoretical discourse, this document establishes a benchmark for the commissioning of UHDR devices for clinical use., Comment: 22 Pages, 8 Figures

The sensitivity of the MeerKAT radio interferometer is an opportunity to probe deeper into the population of rare and faint extragalactic pulsars. The TRAPUM (TRAnsients and PUlsars with MeerKAT) collaboration has conducted a radio-domain search for accelerated pulsars and transients in the Small Magellanic Cloud (SMC). This partially targeted survey, performed at L-band (856-1712 MHz) with the core array of the MeerKAT telescope in 2-h integrations, is twice as sensitive as the latest SMC radio pulsar survey. We report the discovery of seven new SMC pulsars, doubling this galaxy's radio pulsar population and increasing the total extragalactic population by nearly a quarter. We also carried out a search for accelerated millisecond pulsars in the SMC Globular Cluster NGC 121 using the full array of MeerKAT. This improved the previous upper limit on pulsed radio emission from this cluster by a factor of six. Our discoveries reveal the first radio pulsar-PWN systems in the SMC, with only one such system previously known outside our galaxy (the "Crab pulsar twin" in the Large Magellanic Cloud, PSR J0540$-$6919). We associate the 59 ms pulsar discovery PSR J0040$-$7337, now the fastest spinning radio pulsar in the SMC, with the bow-shock Pulsar Wind Nebula (PWN) of Supernova Remnant DEM S5. We also present a new young pulsar with a 79 ms period, PSR J0048$-$7317, in a PWN recently discovered in a MeerKAT radio continuum image. Using the multi-beam capability of MeerKAT, we localised our pulsar discoveries, and two previous Murriyang discoveries, to a positional uncertainty of a few arcseconds., Comment: 32 pages, 14 figures, 10 tables. Accepted for publication in Monthly Notices of the Royal Astronomical Society

We optimize hierarchies of Time-to-Live (TTL) caches under random network delays. A TTL cache assigns individual eviction timers to cached objects that are usually refreshed upon a hit where upon a miss the object requires a random time to be fetched from a parent cache. Due to their object decoupling property, TTL caches are of particular interest since the optimization of a per-object utility enables service differentiation. However, state-of-the-art exact TTL cache optimization does not extend beyond single TTL caches, especially under network delays. In this paper, we leverage the object decoupling effect to formulate the non-linear utility maximization problem for TTL cache hierarchies in terms of the exact object hit probability under random network delays. We iteratively solve the utility maximization problem to find the optimal per-object TTLs. Further, we show that the exact model suffers from tractability issues for large hierarchies and propose a machine learning approach to estimate the optimal TTL values for large systems. Finally, we provide numerical and data center trace-based evaluations for both methods showing the significant offloading improvement due to TTL optimization considering the network delays.

Gravitational waves from black-hole merging events have revealed a population of extra-galactic BHs residing in short-period binaries with masses that are higher than expected based on most stellar evolution models - and also higher than known stellar-origin black holes in our Galaxy. It has been proposed that those high-mass BHs are the remnants of massive metal-poor stars. Gaia astrometry is expected to uncover many Galactic wide-binary systems containing dormant BHs, which may not have been detected before. The study of this population will provide new information on the BH-mass distribution in binaries and shed light on their formation mechanisms and progenitors. As part of the validation efforts in preparation for the fourth Gaia data release (DR4), we analysed the preliminary astrometric binary solutions, obtained by the Gaia Non-Single Star pipeline, to verify their significance and to minimise false-detection rates in high-mass-function orbital solutions. The astrometric binary solution of one source, Gaia BH3, implies the presence of a 32.70 \pm 0.82 M\odot BH in a binary system with a period of 11.6 yr. Gaia radial velocities independently validate the astrometric orbit. Broad-band photometric and spectroscopic data show that the visible component is an old, very metal-poor giant of the Galactic halo, at a distance of 590 pc. The BH in the Gaia BH3 system is more massive than any other Galactic stellar-origin BH known thus far. The low metallicity of the star companion supports the scenario that metal-poor massive stars are progenitors of the high-mass BHs detected by gravitational-wave telescopes. The Galactic orbit of the system and its metallicity indicate that it might belong to the Sequoia halo substructure. Alternatively, and more plausibly, it could belong to the ED-2 stream, which likely originated from a globular cluster that had been disrupted by the Milky Way., Comment: 23 pages, accepted fro publication in A&A Letters. New version with small fixes

There are a number of hypotheses underlying the existence of adversarial examples for classification problems. These include the high-dimensionality of the data, high codimension in the ambient space of the data manifolds of interest, and that the structure of machine learning models may encourage classifiers to develop decision boundaries close to data points. This article proposes a new framework for studying adversarial examples that does not depend directly on the distance to the decision boundary. Similarly to the smoothed classifier literature, we define a (natural or adversarial) data point to be $(\gamma,\sigma)$-stable if the probability of the same classification is at least $\gamma$ for points sampled in a Gaussian neighborhood of the point with a given standard deviation $\sigma$. We focus on studying the differences between persistence metrics along interpolants of natural and adversarial points. We show that adversarial examples have significantly lower persistence than natural examples for large neural networks in the context of the MNIST and ImageNet datasets. We connect this lack of persistence with decision boundary geometry by measuring angles of interpolants with respect to decision boundaries. Finally, we connect this approach with robustness by developing a manifold alignment gradient metric and demonstrating the increase in robustness that can be achieved when training with the addition of this metric.

We report the discovery of ten new pulsars in the globular cluster Terzan 5 as part of the Transients and Pulsars with MeerKAT (TRAPUM) Large Survey Project. We observed Terzan 5 at L-band (856--1712 MHz) with the MeerKAT radio telescope for four hours on two epochs, and performed acceleration searches of 45 out of 288 tied-array beams covering the core of the cluster. We obtained phase-connected timing solutions for nine discoveries, covering nearly two decades of archival observations from the Green Bank Telescope for all but one. Highlights include PSR J1748$-$2446ao which is an eccentric ($e = 0.32$) wide-orbit (orbital period $P_{\rm b} = 57.55$ d) system. We were able to measure the rate of advance of periastron ($\dot{\omega}$) for this system allowing us to determine a total mass of $3.17 \pm \, 0.02\, \rm M_{\odot}$. With a minimum companion mass ($M_{\rm c}$) of $\sim 0.8\, \rm M_{\odot}$, PSR J1748$-$2446ao is a candidate double neutron star (DNS) system. If confirmed to be a DNS, it would be the fastest spinning pulsar ($P = 2.27$ ms) and the longest orbital period measured for any known DNS system. PSR J1748$-$2446ap has the second highest eccentricity for any recycled pulsar ($e \sim 0.905$) and for this system we can measure the total mass ($1.997 \pm 0.006\, \rm M_{\odot}$) and also estimate the individual pulsar and companion masses. PSR J1748$-$2446ar is an eclipsing redback (minimum $M_{\rm c} \sim 0.34\, \rm M_{\odot}$) system whose properties confirm it to be the counterpart to a previously published source identified in radio and X-ray imaging. With these discoveries, the total number of confirmed pulsars in Terzan 5 is 49, the highest for any globular cluster so far. These discoveries further enhance the rich set of pulsars known in Terzan 5 and provide scope for a deeper understanding of binary stellar evolution, cluster dynamics and ensemble population studies., Comment: 23 pages, 11 figures, 5 tables, published in A&A

Perturbation-based explanation methods such as LIME and SHAP are commonly applied to text classification. This work focuses on their extension to generative language models. To address the challenges of text as output and long text inputs, we propose a general framework called MExGen that can be instantiated with different attribution algorithms. To handle text output, we introduce the notion of scalarizers for mapping text to real numbers and investigate multiple possibilities. To handle long inputs, we take a multi-level approach, proceeding from coarser levels of granularity to finer ones, and focus on algorithms with linear scaling in model queries. We conduct a systematic evaluation, both automated and human, of perturbation-based attribution methods for summarization and context-grounded question answering. The results show that our framework can provide more locally faithful explanations of generated outputs.

Since the COVID-19 pandemic, educational institutions have embarked on digital transformation projects. The success of these projects depends on integrating new technologies and understanding the needs of digitally literate students. The "learning by doing" approach suggests that real success in learning new skills is achieved when students can try out and practise these skills. In this article, we demonstrate how Large Language Models (LLMs) can enhance the quality of teaching by using ChatGPT in a role-playing simulation game scenario to promote active learning. Moreover, we discuss how LLMs can boost students' interest in learning by allowing them to practice real-life scenarios using ChatGPT., Comment: Link to online article: https://ercim-news.ercim.eu/en136/special/role-playing-simulation-games-using-chatgpt

We report on strong field ionization of S- and R-propylene oxide in circularly polarized two-color laser fields. We find that the relative helicity of the two single color laser fields affects the photoelectron circular dichroism (PECD). Further, we observe that PECD is modulated as a function of the sub-cycle release time of the electron. Our experimental observations are successfully described by a heuristic model based on electrons in chiral initial states, which are selectively liberated by the laser field and, after tunneling, interact with an achiral Coulomb potential.

Generative AI applications present unique design challenges. As generative AI technologies are increasingly being incorporated into mainstream applications, there is an urgent need for guidance on how to design user experiences that foster effective and safe use. We present six principles for the design of generative AI applications that address unique characteristics of generative AI UX and offer new interpretations and extensions of known issues in the design of AI applications. Each principle is coupled with a set of design strategies for implementing that principle via UX capabilities or through the design process. The principles and strategies were developed through an iterative process involving literature review, feedback from design practitioners, validation against real-world generative AI applications, and incorporation into the design process of two generative AI applications. We anticipate the principles to usefully inform the design of generative AI applications by driving actionable design recommendations., Comment: 34 pages, 4 figures. To be published in CHI 2024

In this study, we propose to adopt a novel framework, Knowledge-integrated Machine Learning, for advancing Proton Exchange Membrane Water Electrolysis (PEMWE) development. Given the significance of PEMWE in green hydrogen production and the inherent challenges in optimizing its performance, our framework aims to meld data-driven models with domain-specific insights systematically to address the domain challenges. We first identify the uncertainties originating from data acquisition conditions, data-driven model mechanisms, and domain expertise, highlighting their complementary characteristics in carrying information from different perspectives. Building upon this foundation, we showcase how to adeptly decompose knowledge and extract unique information to contribute to the data augmentation, modeling process, and knowledge discovery. We demonstrate a hierarchical three-level framework, termed the "Ladder of Knowledge-integrated Machine Learning", in the PEMWE context, applying it to three case studies within a context of cell degradation analysis to affirm its efficacy in interpolation, extrapolation, and information representation. This research lays the groundwork for more knowledge-informed enhancements in ML applications in engineering., Comment: 21 pages, 7 figures

We present new radio continuum images and a source catalogue from the MeerKAT survey in the direction of the Small Magellanic Cloud (SMC). The observations, at a central frequency of 1.3 GHz across a bandwidth of 0.8 GHz, encompass a field of view ~7 x 7 degrees and result in images with resolution of 8 arcsec. The median broad-band Stokes I image Root Mean Squared noise value is ~11 microJy/beam. The catalogue produced from these images contains 108,330 point sources and 517 compact extended sources. We also describe a UHF (544-1088 MHz) single pointing observation. We report the detection of a new confirmed Supernova Remnant (SNR) (MCSNR J0100-7211) with an X-ray magnetar at its centre and 10 new SNR candidates. This is in addition to the detection of 21 previously confirmed SNRs and two previously noted SNR candidates. Our new SNR candidates have typical surface brightness an order of magnitude below those previously known, and on the whole they are larger. The high sensitivity of the MeerKAT survey also enabled us to detect the bright end of the SMC Planetary Nebulae (PNe) sample - point-like radio emission is associated with 38 of 102 optically known PNe, of which 19 are new detections. Lastly, we present the detection of three foreground radio stars amidst 11 circularly polarised sources, and a few examples of morphologically interesting background radio galaxies from which the radio ring galaxy ESO 029-G034 may represent a new type of radio object., Comment: 31 pages, 27 figures

Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that training samples and test samples are drawn from the same distribution breaks down. In this work, by leveraging tools from causal inference we attempt to increase the resilience of anomaly detection models to different kinds of distribution shifts. We begin by elucidating a simple yet necessary statistical property that ensures invariant representations, which is critical for robust AD under both domain and covariate shifts. From this property, we derive a regularization term which, when minimized, leads to partial distribution invariance across environments. Through extensive experimental evaluation on both synthetic and real-world tasks, covering a range of six different AD methods, we demonstrated significant improvements in out-of-distribution performance. Under both covariate and domain shift, models regularized with our proposed term showed marked increased robustness. Code is available at: https://github.com/JoaoCarv/invariant-anomaly-detection.

This multi-disciplinary case study details how a public web application combines information and game design to visualize effects of user-defined policies intended to reduce plastic waste. Contextualizing this open source software within a broader lineage of digital media research, this user experience exploration outlines potential directions for facilitating conversation between artificial intelligence, scientists, and decision makers during an iterative policy building process. Furthermore, this system dissection reveals how this interactive science effort considers the practicalities of a treaty's shifting priorities and proposals in its designs. Specifically, this historically situated investigation of the tool's approach highlights options for centering human decision making where artificial intelligence helps reason about interventions but does not prescribe them. Finally, analysis summarizes this application's specific game design-inspired mechanics and their efforts to: enable users' agency to explore solution possibilities freely, invite deep engagement with scientific findings, and simultaneously serve multiple audiences with divergent objectives and expertise., Comment: 29 pages of which 8 are citations, 4 figures, latex generated from markdown via Pandoc (https://pandoc.org/) for Arxiv

Advances in wireless localization techniques aiming to exploit context-dependent data has been leading to a growing interest in services able of localizing or tracking targets inside buildings with high accuracy and precision. Hence, the demand for indoor localization services has become a key prerequisite in some markets, such as in the aviation sector. In this context, we propose a system to passively localize and track passenger movements inside the cabin of an aircraft in a privacy preserving way using existing communication networks such as Wi-Fi or 5G. The estimated passenger positions can be used for various automation tasks such as measurement of passenger behavior during boarding. The paper describes a novel wireless localization system, based on Artificial Neural Networks, which passively senses the location of passengers. The position estimation is based on the observation of wireless communication signals that are already present in the environment. In this context, "passive" means that no additional devices are needed for the passengers. Experimental results show that the proposed system is able to achieve an average accuracy of 12 cm in a challenging environment like an aircraft cabin. This accuracy seems sufficient to control passenger separation.

We present the SARAO MeerKAT Galactic Plane Survey (SMGPS), a 1.3 GHz continuum survey of almost half of the Galactic Plane (251\deg $\le l \le$ 358\deg and 2\deg $\le l \le$ 61\deg at $|b| \le 1.5\deg $). SMGPS is the largest, most sensitive and highest angular resolution 1 GHz survey of the Plane yet carried out, with an angular resolution of 8" and a broadband RMS sensitivity of $\sim$10--20 $\mu$ Jy/beam. Here we describe the first publicly available data release from SMGPS which comprises data cubes of frequency-resolved images over 908--1656 MHz, power law fits to the images, and broadband zeroth moment integrated intensity images. A thorough assessment of the data quality and guidance for future usage of the data products are given. Finally, we discuss the tremendous potential of SMGPS by showcasing highlights of the Galactic and extragalactic science that it permits. These highlights include the discovery of a new population of non-thermal radio filaments; identification of new candidate supernova remnants, pulsar wind nebulae and planetary nebulae; improved radio/mid-IR classification of rare Luminous Blue Variables and discovery of associated extended radio nebulae; new radio stars identified by Bayesian cross-matching techniques; the realisation that many of the largest radio-quiet WISE HII region candidates are not true HII regions; and a large sample of previously undiscovered background HI galaxies in the Zone of Avoidance., Comment: Accepted for publication in MNRAS. The data release is live and links can be found in the Data Availability Statement in the paper

Past work proposed an extension to finite control set model predictive control to track both a current reference and a switching frequency reference, simultaneously. Such an objective can jeopardize the current tracking performance, and this can potentially be alleviated by instead limiting the switching frequency. To this end, we propose to limit the switching frequency in finite control set model predictive control. The switching frequency is captured with an infinite impulse response filter and bounded by an inequality constraint; its corresponding slack variable is penalized in the cost function. To solve the resulting problem efficiently, a sphere decoder with a computational speed-up is presented.

We report on MoSi-based superconducting nanowire single-photon detectors on a gallium arsenide substrate. MoSi deposited on a passivated GaAs surface has the same critical temperature as MoSi deposited on silicon. The critical temperature decreases slightly on depositing MoSi directly on the native oxide of GaAs. Hence, MoSi works well as a thin-film superconductor on GaAs. We propose that the amorphous structure of MoSi ensures compatibility with the GaAs matrix. Superconducting nanowire single-photon detectors (SNSPDs) are fabricated with MoSi on GaAs using a meander-wire design. The SNSPD metrics are very similar to those of devices fabricated with the same procedure on a silicon substrate. We observe a plateau in the response-versus-bias curve signalling a saturated internal quantum efficiency. The plateau remains even at an elevated temperature, 2.2 K, at a wavelength of 980 nm. We achieve a timing jitter of 50 ps and a recovery time of 29 ns. These results point to the promise of integrating MoSi SNSPDs with GaAs photonic circuits.

The double pulsar system, PSR J0737$-$3039A/B, consists of two neutron stars bound together in a highly relativistic orbit that is viewed nearly edge-on from the Earth. This alignment results in brief radio eclipses of the fast-rotating pulsar A when it passes behind the toroidal magnetosphere of the slow-rotating pulsar B. The morphology of these eclipses is strongly dependent on the geometric orientation and rotation phase of pulsar B, and their time-evolution can be used to constrain the geodetic precession rate of the pulsar. We demonstrate a Bayesian inference framework for modelling eclipse light-curves obtained with MeerKAT between 2019-2023. Using a hierarchical inference approach, we obtained a precession rate of $\Omega_{\rm SO}^{\rm B} = {5.16^{\circ}}^{+0.32^{\circ}}_{-0.34^{\circ}}$ yr$^{-1}$ for pulsar B, consistent with predictions from General Relativity to a relative uncertainty of 6.5%. This updated measurement provides a 6.1% test of relativistic spin-orbit coupling in the strong-field regime. We show that a simultaneous fit to all of our observed eclipses can in principle return a $\sim$1.5% test of spin-orbit coupling. However, systematic effects introduced by the current geometric orientation of pulsar B along with inconsistencies between the observed and predicted eclipse light curves result in difficult to quantify uncertainties. Assuming the validity of General Relativity, we definitively show that the spin-axis of pulsar B is misaligned from the total angular momentum vector by $40.6^{\circ} \pm 0.1^{\circ}$ and that the orbit of the system is inclined by approximately $90.5^{\circ}$ from the direction of our line of sight. Our measured geometry for pulsar B suggests the largely empty emission cone contains an elongated horseshoe shaped beam centered on the magnetic axis, and that it may not be re-detected as a radio pulsar until early-2035., Comment: Abridged abstract. 13 pages, 9 figures and 2 tables

Gaia's readout window strategy is challenged by very dense fields in the sky. Therefore, in addition to standard Gaia observations, full Sky Mapper (SM) images were recorded for nine selected regions in the sky. A new software pipeline exploits these Service Interface Function (SIF) images of crowded fields (CFs), making use of the availability of the full two-dimensional (2D) information. This new pipeline produced half a million additional Gaia sources in the region of the omega Centauri ($\omega$ Cen) cluster, which are published with this Focused Product Release. We discuss the dedicated SIF CF data reduction pipeline, validate its data products, and introduce their Gaia archive table. Our aim is to improve the completeness of the {\it Gaia} source inventory in a very dense region in the sky, $\omega$ Cen. An adapted version of {\it Gaia}'s Source Detection and Image Parameter Determination software located sources in the 2D SIF CF images. We validated the results by comparing them to the public {\it Gaia} DR3 catalogue and external Hubble Space Telescope data. With this Focused Product Release, 526\,587 new sources have been added to the {\it Gaia} catalogue in $\omega$ Cen. Apart from positions and brightnesses, the additional catalogue contains parallaxes and proper motions, but no meaningful colour information. While SIF CF source parameters generally have a lower precision than nominal {\it Gaia} sources, in the cluster centre they increase the depth of the combined catalogue by three magnitudes and improve the source density by a factor of ten. This first SIF CF data publication already adds great value to the {\it Gaia} catalogue. It demonstrates what to expect for the fourth {\it Gaia} catalogue, which will contain additional sources for all nine SIF CF regions.

Context. Strongly lensed quasars are fundamental sources for cosmology. The Gaia space mission covers the entire sky with the unprecedented resolution of $0.18$" in the optical, making it an ideal instrument to search for gravitational lenses down to the limiting magnitude of 21. Nevertheless, the previous Gaia Data Releases are known to be incomplete for small angular separations such as those expected for most lenses. Aims. We present the Data Processing and Analysis Consortium GravLens pipeline, which was built to analyse all Gaia detections around quasars and to cluster them into sources, thus producing a catalogue of secondary sources around each quasar. We analysed the resulting catalogue to produce scores that indicate source configurations that are compatible with strongly lensed quasars. Methods. GravLens uses the DBSCAN unsupervised clustering algorithm to detect sources around quasars. The resulting catalogue of multiplets is then analysed with several methods to identify potential gravitational lenses. We developed and applied an outlier scoring method, a comparison between the average BP and RP spectra of the components, and we also used an extremely randomised tree algorithm. These methods produce scores to identify the most probable configurations and to establish a list of lens candidates. Results. We analysed the environment of 3 760 032 quasars. A total of 4 760 920 sources, including the quasars, were found within 6" of the quasar positions. This list is given in the Gaia archive. In 87\% of cases, the quasar remains a single source, and in 501 385 cases neighbouring sources were detected. We propose a list of 381 lensed candidates, of which we identified 49 as the most promising. Beyond these candidates, the associate tables in this Focused Product Release allow the entire community to explore the unique Gaia data for strong lensing studies further., Comment: 35 pages, 60 figures, accepted for publication by Astronomy and Astrophysics

The third Gaia Data Release (DR3) provided photometric time series of more than 2 million long-period variable (LPV) candidates. Anticipating the publication of full radial-velocity (RV) in DR4, this Focused Product Release (FPR) provides RV time series for a selection of LPVs with high-quality observations. We describe the production and content of the Gaia catalog of LPV RV time series, and the methods used to compute variability parameters published in the Gaia FPR. Starting from the DR3 LPVs catalog, we applied filters to construct a sample of sources with high-quality RV measurements. We modeled their RV and photometric time series to derive their periods and amplitudes, and further refined the sample by requiring compatibility between the RV period and at least one of the $G$, $G_{\rm BP}$, or $G_{\rm RP}$ photometric periods. The catalog includes RV time series and variability parameters for 9\,614 sources in the magnitude range $6\lesssim G/{\rm mag}\lesssim 14$, including a flagged top-quality subsample of 6\,093 stars whose RV periods are fully compatible with the values derived from the $G$, $G_{\rm BP}$, and $G_{\rm RP}$ photometric time series. The RV time series contain a mean of 24 measurements per source taken unevenly over a duration of about three years. We identify the great most sources (88%) as genuine LPVs, with about half of them showing a pulsation period and the other half displaying a long secondary period. The remaining 12% consists of candidate ellipsoidal binaries. Quality checks against RVs available in the literature show excellent agreement. We provide illustrative examples and cautionary remarks. The publication of RV time series for almost 10\,000 LPVs constitutes, by far, the largest such database available to date in the literature. The availability of simultaneous photometric measurements gives a unique added value to the Gaia catalog (abridged), Comment: 36 pages, 38 figures

Aims. LST-1, the prototype of the Large-Sized Telescope for the upcoming Cherenkov Telescope Array Observatory, is concluding its commissioning in Observatorio del Roque de los Muchachos on the island of La Palma. The proximity of LST-1 (Large-Sized Telescope 1) to the two MAGIC (Major Atmospheric Gamma Imaging Cherenkov) telescopes permits observations of the same gamma-ray events with both systems. Methods. We describe the joint LST-1+MAGIC analysis pipeline and use simultaneous Crab Nebula observations and Monte Carlo simulations to assess the performance of the three-telescope system. The addition of the LST-1 telescope allows the recovery of events in which one of the MAGIC images is too dim to survive analysis quality cuts. Results. Thanks to the resulting increase in the collection area and stronger background rejection, we find a significant improvement in sensitivity, allowing the detection of 30% weaker fluxes in the energy range between 200 GeV and 3 TeV. The spectrum of the Crab Nebula, reconstructed in the energy range ~60 GeV to ~10 TeV, is in agreement with previous measurements., Comment: Accepted for publication in Astronomy & Astrophysics

The decision-making process in real-world implementations has been affected by a growing reliance on data-driven models. We investigated the synergetic pattern between the data-driven methods, empirical domain knowledge, and first-principles simulations. We showed the potential risk of biased results when using data-driven models without causal analysis. Using a case study assessing the implication of several design solutions on the energy consumption of a building, we proved the necessity of causal analysis during the data-driven modeling process. We concluded that: (a) Data-driven models' accuracy assessment or domain knowledge screening may not rule out biased and spurious results; (b) Data-driven models' feature selection should involve careful consideration of causal relationships, especially colliders; (c) Causal analysis results can be used as an aid to first-principles simulation design and parameter checking to avoid cognitive biases. We proved the benefits of causal analysis when applied to data-driven models in building engineering., Comment: 16 pages,6 figures

We explore the equivalence between neural networks and kernel methods by deriving the first exact representation of any finite-size parametric classification model trained with gradient descent as a kernel machine. We compare our exact representation to the well-known Neural Tangent Kernel (NTK) and discuss approximation error relative to the NTK and other non-exact path kernel formulations. We experimentally demonstrate that the kernel can be computed for realistic networks up to machine precision. We use this exact kernel to show that our theoretical contribution can provide useful insights into the predictions made by neural networks, particularly the way in which they generalize., Comment: TAG-ML at ICML 2023 in Proceedings. 8 pages, 6 figures, proofs in Appendix