Search

In this paper, we give closed form expressions of the Frobenius number for the triple of the $2$-step star numbers $an(n-2) + 1$ for an integer $a \geq 4$. These numbers have been studied from different aspects for some $a$'s. These numbers can also be considered as variations of the well known star numbers of the form $6n(n-1) + 1$. We also give closed form expressions of the Sylvester number (genus) for the triple of the $2$-step star numbers.

In this paper, we propose an extension of the Hawkes process by incorporating a kernel based on the tempered Mittag-Leffler distribution. This is the generalization of the work presented in [10]. We derive analytical results for the expectation of the conditional intensity and the expected number of events in the counting process. Additionally, we investigate the limiting behavior of the expectation of the conditional intensity. Finally, we present an empirical comparison of the studied process with its limiting special cases., Comment: 9 pages, 5 figures

Research in Responsible AI has developed a range of principles and practices to ensure that machine learning systems are used in a manner that is ethical and aligned with human values. However, a critical yet often neglected aspect of ethical ML is the ethical implications that appear when designing evaluations of ML systems. For instance, teams may have to balance a trade-off between highly informative tests to ensure downstream product safety, with potential fairness harms inherent to the implemented testing procedures. We conceptualize ethics-related concerns in standard ML evaluation techniques. Specifically, we present a utility framework, characterizing the key trade-off in ethical evaluation as balancing information gain against potential ethical harms. The framework is then a tool for characterizing challenges teams face, and systematically disentangling competing considerations that teams seek to balance. Differentiating between different types of issues encountered in evaluation allows us to highlight best practices from analogous domains, such as clinical trials and automotive crash testing, which navigate these issues in ways that can offer inspiration to improve evaluation processes in ML. Our analysis underscores the critical need for development teams to deliberately assess and manage ethical complexities that arise during the evaluation of ML systems, and for the industry to move towards designing institutional policies to support ethical evaluations.

Cascades and speculative decoding are two common approaches to improving language models' inference efficiency. Both approaches involve interleaving models of different sizes, but via fundamentally distinct mechanisms: cascades employ a deferral rule that invokes the larger model only for "hard" inputs, while speculative decoding uses speculative execution to primarily invoke the larger model in parallel verification mode. These mechanisms offer different benefits: empirically, cascades offer better cost-quality trade-offs, often even outperforming the large model, while theoretically, speculative decoding offers a guarantee of quality-neutrality. In this paper, we leverage the best of both these approaches by designing new speculative cascading techniques that implement their deferral rule through speculative execution. We characterize the optimal deferral rule for our speculative cascades, and employ a plug-in approximation to the optimal rule. Experiments with Gemma and T5 models on a range of language benchmarks show that our approach yields better cost quality trade-offs than cascading and speculative decoding baselines.

Hawkes process (HP) is a point process with a conditionally dependent intensity function. This paper defines the tempered fractional Hawkes process (TFHP) by time-changing the HP with an inverse tempered stable subordinator. We obtained results that generalize the fractional Hawkes process defined in Hainaut (2020) to a tempered version which has \textit{semi-heavy tailed} decay. We derive the mean, the variance, covariance and the governing fractional difference-differential equations of the TFHP. Additionally, we introduce the generalized fractional Hawkes process (GFHP) by time-changing the HP with the inverse L\'evy subordinator. This definition encompasses all potential (inverse L\'evy) time changes as specific instances. We also explore the distributional characteristics and the governing difference-differential equation of the one-dimensional distribution for the GFHP., Comment: 15 papages

Recent advances in language models (LMs) have led to significant improvements in quality on complex NLP tasks, but at the expense of increased inference costs. Cascading offers a simple strategy to achieve more favorable cost-quality tradeoffs: here, a small model is invoked for most "easy" instances, while a few "hard" instances are deferred to the large model. While the principles underpinning cascading are well-studied for classification tasks - with deferral based on predicted class uncertainty favored theoretically and practically - a similar understanding is lacking for generative LM tasks. In this work, we initiate a systematic study of deferral rules for LM cascades. We begin by examining the natural extension of predicted class uncertainty to generative LM tasks, namely, the predicted sequence uncertainty. We show that this measure suffers from the length bias problem, either over- or under-emphasizing outputs based on their lengths. This is because LMs produce a sequence of uncertainty values, one for each output token; and moreover, the number of output tokens is variable across examples. To mitigate this issue, we propose to exploit the richer token-level uncertainty information implicit in generative LMs. We argue that naive predicted sequence uncertainty corresponds to a simple aggregation of these uncertainties. By contrast, we show that incorporating token-level uncertainty through learned post-hoc deferral rules can significantly outperform such simple aggregation strategies, via experiments on a range of natural language benchmarks with FLAN-T5 models. We further show that incorporating embeddings from the smaller model and intermediate layers of the larger model can give an additional boost in the overall cost-quality tradeoff.

A neural code on $ n $ neurons is a collection of subsets of the set $ [n]=\{1,2,\dots,n\} $. Curto et al. \cite{curto2013neural} associated a ring $\mathcal{R}_{\mathcal{C}}$ (neural ring) to a neural code $\mathcal{C}$. A special class of ring homomorphisms between two neural rings, called neural ring homomorphism, was introduced by Curto and Youngs \cite{curto2020neural}. The main work in this paper comprises constructing two categories. First is the $\mathfrak{C}$ category, a subcategory of SETS consisting of neural codes and code maps. Second is the neural category $\mathfrak{N}$, a subcategory of \textit{Rngs} consisting of neural rings and neural ring homomorphisms. Then, the rest of the paper characterizes the properties of these two categories like initial and final objects, products, coproducts, limits, etc. Also, we show that these two categories are in dual equivalence.

A neural code on $ n $ neurons is a collection of subsets of the set $ [n]=\{1,2,\dots,n\} $. In this paper, we study some properties of graphs of neural codes. In particular, we study codeword containment graph (CCG) given by Chan et al. (SIAM J. on Dis. Math., 37(1):114-145,2017) and general relationship graph (GRG) given by Gross et al. (Adv. in App. Math., 95:65-95, 2018). We provide a sufficient condition for CCG to be connected. We also show that the connectedness and completeness of CCG are preserved under surjective morphisms between neural codes defined by A. Jeffs (SIAM J. on App. Alg. and Geo., 4(1):99-122,2020). Further, we show that if CCG of any neural code $\mathcal{C}$ is complete with $|\mathcal{C}|=m$, then $\mathcal{C} \cong \{\emptyset,1,12,\dots,123\cdots m\}$ as neural codes. We also prove that a code whose CCG is complete is open convex. Later, we show that if a code $\mathcal{C}$ with $|\mathcal{C}|>3$ has its CCG to be connected 2-regular then $|\mathcal{C}| $ is even. The GRG was defined only for degree two neural codes using the canonical forms of its neural ideal. We first define GRG for any neural code. Then, we show the behaviour of GRGs under the various elementary code maps. At last, we compare these two graphs for certain classes of codes and see their properties.

We give an explicit formula for the $p$-Frobenius number of triples associated with Diophantine equations $x^2+y^2=z^r$, that is, the largest positive integer that can only be represented in $p$ ways by combining the three integers of the solutions of Diophantine equations $x^2+y^2=z^r$. When $r=2$, the Frobenius number has already been given.

It has been studied by Curto et al. (SIAM J. on App. Alg. and Geom., 1(1) : 222 $\unicode{x2013}$ 238, 2017) that a neural code that has an open convex realization does not have any local obstruction relative to the neural code. Further, a neural code $ \mathcal{C} $ has no local obstructions if and only if it contains the set of mandatory codewords, $ \mathcal{C}_{\min}(\Delta),$ which depends only on the simplicial complex $\Delta=\Delta(\mathcal{C})$. Thus if $\mathcal{C} \not \supseteq \mathcal{C}_{\min}(\Delta)$, then $\mathcal{C}$ cannot be open convex. However, the problem of constructing $ \mathcal{C}_{\min}(\Delta) $ for any given code $ \mathcal{C} $ is undecidable. There is yet another way to capture the local obstructions via the homological mandatory set, $ \mathcal{M}_H(\Delta). $ The significance of $ \mathcal{M}_H(\Delta) $ for a given code $ \mathcal{C} $ is that $ \mathcal{M}_H(\Delta) \subseteq \mathcal{C}_{\min}(\Delta)$ and so $ \mathcal{C} $ will have local obstructions if $ \mathcal{C}\not\supseteq\mathcal{M}_H(\Delta). $ In this paper we study the affect on the sets $\mathcal{C}_{\min}(\Delta) $ and $\mathcal{M}_H(\Delta)$ under the action of various surjective elementary code maps. Further, we study the relationship between Stanley-Reisner rings of the simplicial complexes associated with neural codes of the elementary code maps. Moreover, using this relationship, we give an alternative proof to show that $ \mathcal{M}_H(\Delta) $ is preserved under the elementary code maps.

This paper introduces the Generalized Fractional Compound Poisson Process (GFCPP), which claims to be a unified fractional version of the compound Poisson process (CPP) that encompasses existing variations as special cases. We derive its distributional properties, generalized fractional differential equations, and martingale properties. Some results related to the governing differential equation about the special cases of jump distributions, including exponential, Mittag-Leffler, Bernst\'ein, discrete uniform, truncated geometric, and discrete logarithm. Some of processes in the literature such as the fractional Poisson process of order $k$, P\'olya-Aeppli process of order $k$, and fractional negative binomial process becomes the special case of the GFCPP. Classification based on arrivals by time-changing the compound Poisson process by the inverse tempered and the inverse of inverse Gaussian subordinators are studied. Finally, we present the simulation of the sample paths of the above-mentioned processes., Comment: 20 pages, 12 figures

Cascades are a classical strategy to enable inference cost to vary adaptively across samples, wherein a sequence of classifiers are invoked in turn. A deferral rule determines whether to invoke the next classifier in the sequence, or to terminate prediction. One simple deferral rule employs the confidence of the current classifier, e.g., based on the maximum predicted softmax probability. Despite being oblivious to the structure of the cascade -- e.g., not modelling the errors of downstream models -- such confidence-based deferral often works remarkably well in practice. In this paper, we seek to better understand the conditions under which confidence-based deferral may fail, and when alternate deferral strategies can perform better. We first present a theoretical characterisation of the optimal deferral rule, which precisely characterises settings under which confidence-based deferral may suffer. We then study post-hoc deferral mechanisms, and demonstrate they can significantly improve upon confidence-based deferral in settings where (i) downstream models are specialists that only work well on a subset of inputs, (ii) samples are subject to label noise, and (iii) there is distribution shift between the train and test set., Comment: NeurIPS 2023

Interfaces in FeCoB/MgO/FeCoB magnetic tunnel junction play a vital role in controlling their magnetic and transport properties for various applications in spintronics and magnetic recording media. In this work, interface structures of a few nm thick FeCoB layers in FeCoB/MgO and MgO/FeCoB bilayers are comprehensively studied using x-ray standing waves (XSW) generated by depositing bilayers between Pt waveguide structures. High interface selectivity of nuclear resonance scattering (NRS) under the XSW technique allowed measuring structure and magnetism at the two interfaces, namely FeCoB-on-MgO and MgO-on-FeCoB, yielding an interesting result that electron density and hyperfine fields are not symmetric at both interfaces. The formation of a high-density FeCoB layer at the MgO/FeCoB (FeCoB-on-MgO) interface with an increased hyperfine field (~34.65 T) is attributed to the increasing volume of FeCo at the interface due to boron diffusion from 57FeCoB to the MgO layer. Furthermore, it caused unusual angular-dependent magnetic properties in MgO/FeCoB bilayer, whereas FeCoB/MgO is magnetically isotropic. In contrast to the literature, where the unusual angular dependent in FeCoB based system is explained in terms of in-plane magnetic anisotropy, present findings attributed the same to the interlayer exchange coupling between bulk and interface layer within the FeCoB layer.

Ensembles are a straightforward, remarkably effective method for improving the accuracy,calibration, and robustness of models on classification tasks; yet, the reasons that underlie their success remain an active area of research. We build upon the extension to the bias-variance decomposition by Pfau (2013) in order to gain crucial insights into the behavior of ensembles of classifiers. Introducing a dual reparameterization of the bias-variance tradeoff, we first derive generalized laws of total expectation and variance for nonsymmetric losses typical of classification tasks. Comparing conditional and bootstrap bias/variance estimates, we then show that conditional estimates necessarily incur an irreducible error. Next, we show that ensembling in dual space reduces the variance and leaves the bias unchanged, whereas standard ensembling can arbitrarily affect the bias. Empirically, standard ensembling reducesthe bias, leading us to hypothesize that ensembles of classifiers may perform well in part because of this unexpected reduction.We conclude by an empirical analysis of recent deep learning methods that ensemble over hyperparameters, revealing that these techniques indeed favor bias reduction. This suggests that, contrary to classical wisdom, targeting bias reduction may be a promising direction for classifier ensembles.