Search

This paper develops the geometry of rational functions on non-singular real algebraic varieties that are locally bounded. First various basic geometric and algebraic results regarding these functions are established in any dimension, culminating with a version of {\L}ojasiewicz's inequality. The geometry is further developed for the case of dimension 2, where it can be shown that there exist many of the usual correspondences between the algebra and geometry of these functions that one expects from complex algebraic geometry and from other classes of functions in real algebraic geometry such as regulous functions., Comment: 24 pages

Centralized training for decentralized execution paradigm emerged as the state-of-the-art approach to epsilon-optimally solving decentralized partially observable Markov decision processes. However, scalability remains a significant issue. This paper presents a novel and more scalable alternative, namely sequential-move centralized training for decentralized execution. This paradigm further pushes the applicability of Bellman's principle of optimality, raising three new properties. First, it allows a central planner to reason upon sufficient sequential-move statistics instead of prior simultaneous-move ones. Next, it proves that epsilon-optimal value functions are piecewise linear and convex in sufficient sequential-move statistics. Finally, it drops the complexity of the backup operators from double exponential to polynomial at the expense of longer planning horizons. Besides, it makes it easy to use single-agent methods, e.g., SARSA algorithm enhanced with these findings applies while still preserving convergence guarantees. Experiments on two- as well as many-agent domains from the literature against epsilon-optimal simultaneous-move solvers confirm the superiority of the novel approach. This paradigm opens the door for efficient planning and reinforcement learning methods for multi-agent systems.

Soil properties, such as wetting collapse behavior and permeability, are strongly correlated to the soil microstructure. To date, several techniques including mercury intrusion porosimetry (MIP), can be used to characterize the microstructure of soil, but all techniques have their own limitations. In this study, the features of mercury that penetrated and has been entrapped in the pore network of the specimens through MIP testing were investigated by X-Ray microtomography (X-$\mu$CT), in order to give an insight into the geometry of macropores and possible ink-bottle geometry. Two conditions of water content and density were selected for the compacted Maryland clay. The distribution and geometry features of mercury entrapped in the microstructure after MIP were characterized and pore size distributions were also reconstructed. The results suggest that, for the two conditions studied in this paper, macropores were evenly distributed within the specimens, and most of them with a non-spherical shape, and with aspect ratio (ratio between the maximum and minimum thickness along a given segment) smaller than three. Different dominant entrance pore size of macropore was obtained from MIP and X-$\mu$CT, due to the specific experimental protocol used in tests and the effect of ink-bottle geometry. Only the large pore bodies with high aspect ratio were imaged in X-$\mu$CT, due to the extrusion of mercury during the process of depressurization and subsequent sample preparation for X- $\mu$CT. But entire pore space was accessible in MIP. The difference in dominant entrance pore size was more significant for specimens with lower void ratio due to a more pronounced aspect ratio.

The field of Contextual Optimization (CO) integrates machine learning and optimization to solve decision making problems under uncertainty. Recently, a risk sensitive variant of CO, known as Conditional Robust Optimization (CRO), combines uncertainty quantification with robust optimization in order to promote safety and reliability in high stake applications. Exploiting modern differentiable optimization methods, we propose a novel end-to-end approach to train a CRO model in a way that accounts for both the empirical risk of the prescribed decisions and the quality of conditional coverage of the contextual uncertainty set that supports them. While guarantees of success for the latter objective are impossible to obtain from the point of view of conformal prediction theory, high quality conditional coverage is achieved empirically by ingeniously employing a logistic regression differentiable layer within the calculation of coverage quality in our training loss. We show that the proposed training algorithms produce decisions that outperform the traditional estimate then optimize approaches.

A recent theory shows that a multi-player decentralized partially observable Markov decision process can be transformed into an equivalent single-player game, enabling the application of \citeauthor{bellman}'s principle of optimality to solve the single-player game by breaking it down into single-stage subgames. However, this approach entangles the decision variables of all players at each single-stage subgame, resulting in backups with a double-exponential complexity. This paper demonstrates how to disentangle these decision variables while maintaining optimality under hierarchical information sharing, a prominent management style in our society. To achieve this, we apply the principle of optimality to solve any single-stage subgame by breaking it down further into smaller subgames, enabling us to make single-player decisions at a time. Our approach reveals that extensive-form games always exist with solutions to a single-stage subgame, significantly reducing time complexity. Our experimental results show that the algorithms leveraging these findings can scale up to much larger multi-player games without compromising optimality.

Inverse optimization has been increasingly used to estimate unknown parameters in an optimization model based on decision data. We show that such a point estimation is insufficient in a prescriptive setting where the estimated parameters are used to prescribe new decisions. The prescribed decisions may be low-quality and misaligned with human intuition and thus are unlikely to be adopted. To tackle this challenge, we propose conformal inverse optimization, which seeks to learn an uncertainty set for the unknown parameters and then solve a robust optimization model to prescribe new decisions. Under mild assumptions, we show that our method enjoys provable guarantees on solution quality, as evaluated using both the ground-truth parameters and the decision maker's perception of the unknown parameters. Our method demonstrates strong empirical performance compared to classic inverse optimization.

Recently there has been a surge of interest in operations research (OR) and the machine learning (ML) community in combining prediction algorithms and optimization techniques to solve decision-making problems in the face of uncertainty. This gave rise to the field of contextual optimization, under which data-driven procedures are developed to prescribe actions to the decision-maker that make the best use of the most recently updated information. A large variety of models and methods have been presented in both OR and ML literature under a variety of names, including data-driven optimization, prescriptive optimization, predictive stochastic programming, policy optimization, (smart) predict/estimate-then-optimize, decision-focused learning, (task-based) end-to-end learning/forecasting/optimization, etc. Focusing on single and two-stage stochastic programming problems, this review article identifies three main frameworks for learning policies from data and discusses their strengths and limitations. We present the existing models and methods under a uniform notation and terminology and classify them according to the three main frameworks identified. Our objective with this survey is to both strengthen the general understanding of this active field of research and stimulate further theoretical and algorithmic advancements in integrating ML and stochastic programming.

The abundance of data has led to the emergence of a variety of optimization techniques that attempt to leverage available side information to provide more anticipative decisions. The wide range of methods and contexts of application have motivated the design of a universal unitless measure of performance known as the coefficient of prescriptiveness. This coefficient was designed to quantify both the quality of contextual decisions compared to a reference one and the prescriptive power of side information. To identify policies that maximize the former in a data-driven context, this paper introduces a distributionally robust contextual optimization model where the coefficient of prescriptiveness substitutes for the classical empirical risk minimization objective. We present a bisection algorithm to solve this model, which relies on solving a series of linear programs when the distributional ambiguity set has an appropriate nested form and polyhedral structure. Studying a contextual shortest path problem, we evaluate the robustness of the resulting policies against alternative methods when the out-of-sample dataset is subject to varying amounts of distribution shift.

Plasma ignition is critical in various scientific and industrial applications, demanding an efficient and robust execution mechanism. In this work, we present an innovative approach to plasma ignition by incorporating the analysis of fundamental aspects of light scattering in the complex frequency plane. For the first time, we demonstrate the high-power virtual perfect absorption (VPA) regime, a groundbreaking method for perfectly capturing light within a resonator. By carefully designing the temporal profile of the incident wave, we effectively minimize reflections during the ignition stages, thereby significantly enhancing the efficiency and resilience of the process. Through comprehensive experimental investigations, we validate the viability of this approach, establishing VPA as a powerful tool for reflectionless excitation and optimal control of plasma discharge. By addressing the limitations of conventional plasma ignition methods, this research represents a pivotal step towards transformative advancements in plasma technology, with promising implications for improving the performance and sustainability of numerous applications.

Optimizing static risk-averse objectives in Markov decision processes is difficult because they do not admit standard dynamic programming equations common in Reinforcement Learning (RL) algorithms. Dynamic programming decompositions that augment the state space with discrete risk levels have recently gained popularity in the RL community. Prior work has shown that these decompositions are optimal when the risk level is discretized sufficiently. However, we show that these popular decompositions for Conditional-Value-at-Risk (CVaR) and Entropic-Value-at-Risk (EVaR) are inherently suboptimal regardless of the discretization level. In particular, we show that a saddle point property assumed to hold in prior literature may be violated. However, a decomposition does hold for Value-at-Risk and our proof demonstrates how this risk measure differs from CVaR and EVaR. Our findings are significant because risk-averse algorithms are used in high-stake environments, making their correctness much more critical.

[Abridged] Aims. We provide an important step toward a better understanding of the magnetorotational instability (MRI)-dust coevolution in protoplanetary disks by presenting a proof of concept that dust evolution ultimately plays a crucial role in the MRI activity. Methods. First, we study how a fixed power-law dust size distribution with varying parameters impacts the MRI activity, especially the steady-state MRI-driven accretion, by employing and improving our previous 1+1D MRI-driven turbulence model. Second, we relax the steady-state accretion assumption in this disk accretion model, and partially couple it to a dust evolution model in order to investigate how the evolution of dust (dynamics and grain growth processes combined) and MRI-driven accretion are intertwined on million-year timescales. Results. Dust coagulation and settling lead to a higher gas ionization degree in the protoplanetary disk, resulting in stronger MRI-driven turbulence as well as a more compact dead zone. On the other hand, fragmentation has an opposite effect because it replenishes the disk in small dust particles. Since the dust content of the disk decreases over million years of evolution due to radial drift, the MRI-driven turbulence overall becomes stronger and the dead zone more compact until the disk dust-gas mixture eventually behaves as a grain-free plasma. Furthermore, our results show that dust evolution alone does not lead to a complete reactivation of the dead zone. Conclusions. The MRI activity evolution (hence the temporal evolution of the MRI-induced $\alpha$-parameter) is controlled by dust evolution and occurs on a timescale of local dust growth, as long as there is enough dust particles in the disk to dominate the recombination process for the ionization chemistry. Once it is no longer the case, it is expected to be controlled by gas evolution and occurs on a viscous evolution timescale., Comment: 23 pages, 13 figures, Accepted for publication in A&A

Earth-sized exoplanets that transit nearby, late spectral type red dwarfs will be prime targets for atmospheric characterization in the coming decade. Such systems, however, are difficult to find via wide-field transit surveys like Kepler or TESS. Consequently, the presence of such transiting planets is unexplored and the occurrence rates of short-period Earth-sized planets around late M dwarfs remain poorly constrained. Here, we present the deepest photometric monitoring campaign of 22 nearby late M dwarf stars, using data from over 500 nights on seven 1-2 meter class telescopes. Our survey includes all known single quiescent northern late M dwarfs within 15 pc. We use transit-injection-and-recovery tests to quantify the completeness of our survey, successfully identify most ($>80\%$) transiting short-period (0.5-1 d) super-Earths ($R > 1.9 R_\oplus$), and are sensitive ($\sim50\%$) to transiting Earth-sized planets ($1.0-1.2 R_\oplus$). Our high sensitivity to transits with a near-zero false positive rate demonstrates an efficient survey strategy. Our survey does not yield a transiting planet detection, yet it provides the most sensitive upper limits on transiting planets orbiting our target stars. Finally, we explore multiple hypotheses about the occurrence rates of short-period planets (from Earth-sized planets to giant planets) around late M dwarfs. We show, for example, that giant planets at short periods ($<1$ day) are uncommon around our target stars. Our dataset provides some insight into occurrence rates of short-period planets around TRAPPIST-1-like stars, and our results can help test planetary formation and system evolution models, as well as guide future observations of nearby late M dwarfs., Comment: 27 pages, 11 figures

We compute the deformation of the spinor fields of the super-Polyakov action leading to the so-called tensionless super-string theory. This allows us to obtain a satisfying Majorana condition in the tensionless limit, which is the main result of this paper. Our tensionless limit is shown to possess previously computed features of tensionless super-string theory., Comment: 18 pages

This research focuses on the bid optimization problem in the real-time bidding setting for online display advertisements, where an advertiser, or the advertiser's agent, has access to the features of the website visitor and the type of ad slots, to decide the optimal bid prices given a predetermined total advertisement budget. We propose a risk-aware data-driven bid optimization model that maximizes the expected profit for the advertiser by exploiting historical data to design upfront a bidding policy, mapping the type of advertisement opportunity to a bid price, and accounting for the risk of violating the budget constraint during a given period of time. After employing a Lagrangian relaxation, we derive a parametrized closed-form expression for the optimal bidding strategy. Using a real-world dataset, we demonstrate that our risk-averse method can effectively control the risk of overspending the budget while achieving a competitive level of profit compared with the risk-neutral model and a state-of-the-art data-driven risk-aware bidding approach., Comment: Accepted for CIKM '22

State-of-the-art methods for solving 2-player zero-sum imperfect information games rely on linear programming or regret minimization, though not on dynamic programming (DP) or heuristic search (HS), while the latter are often at the core of state-of-the-art solvers for other sequential decision-making problems. In partially observable or collaborative settings (e.g., POMDPs and Dec- POMDPs), DP and HS require introducing an appropriate statistic that induces a fully observable problem as well as bounding (convex) approximators of the optimal value function. This approach has succeeded in some subclasses of 2-player zero-sum partially observable stochastic games (zs- POSGs) as well, but how to apply it in the general case still remains an open question. We answer it by (i) rigorously defining an equivalent game to work with, (ii) proving mathematical properties of the optimal value function that allow deriving bounds that come with solution strategies, (iii) proposing for the first time an HSVI-like solver that provably converges to an $\epsilon$-optimal solution in finite time, and (iv) empirically analyzing it. This opens the door to a novel family of promising approaches complementing those relying on linear programming or iterative methods., Comment: 42 pages, 2 algorithms. arXiv admin note: substantial text overlap with arXiv:2110.14529

We propose a novel approach to solve K-adaptability problems with convex objective and constraints and integer first-stage decisions. A logic-based Benders decomposition is applied to handle the first-stage decisions in a master problem, thus the sub-problem becomes a min-max-min robust combinatorial optimization problem that is solved via a double-oracle algorithm that iteratively generates adverse scenarios and recourse decisions and assigns scenarios to K subsets of the decisions by solving p-center problems. Extensions of the proposed approach to handle parameter uncertainty in both the first-stage objective and the second-stage constraints are also provided. We show that the proposed algorithm converges to an optimal solution and terminates in finite number of iterations. Numerical results obtained from experiments on benchmark instances of the adaptive shortest path problem, the regular knapsack problem, and a generic K-adaptability problem demonstrate the performance advantage of the proposed approach when compared to state-of-the-art methods in the literature., Comment: 29 pages, 7 figures

Complex coupled thermo-hydromechanical (THM) loading paths are expected to occur in clay rocks which serve as host formations for geological radioactive waste repositories. Exothermic waste packages heat the rock, causing thermal strains and temperature induced pore pressure build-up. The drifts are designed in such a way as to limit these effects. One has to anticipate failure and fracturing of the material, should pore pressures exceed the tensile resistance of the rock. To characterise the behaviour of the Callovo-Oxfordian claystone (COx) under effective tension and to quantify the tensile failure criterion, a laboratory program is carried out in this work. THM loading paths which correspond to the expected in situ conditions are recreated in the laboratory. To this end, a special triaxial system was developed, which allows the independent control of radial and axial stresses, as well as of pore pressure and temperature of rock specimens. More importantly, the device allows one to maintain axial effective tension on a specimen. Saturated cylindrical claystone specimens were tested in undrained conditions under constrained lateral deformation and under nearly constant axial stress. The specimens were heated until the induced pore pressures created effective tensile stresses and ultimately fractured the material. The failure happened at average axial effective tensile stresses around 3.0 MPa. Fracturing under different lateral total stresses allows one to describe the failure with a Hoek-Brown or Fairhurst's generalized Griffith criterion. Measured axial extension strains are analysed based on a transversely isotropic thermo-poroelastic constitutive model, which is able to satisfactorily reproduce the observed behaviour.

The NASA InSight Lander on Mars includes the Heat Flow and Physical Properties Package HP$^3$ to measure the surface heat flow of the planet. The package uses temperature sensors that would have been brought to the target depth of 3--5 m by a small penetrator, nicknamed the mole. The mole requiring friction on its hull to balance remaining recoil from its hammer mechanism did not penetrate to the targeted depth. Instead, by precessing about a point midway along its hull, it carved a 7 cm deep and 5-6 cm wide pit and reached a depth of initially 31 cm. The root cause of the failure - as was determined through an extensive, almost two years long campaign - was a lack of friction in an unexpectedly thick cohesive duricrust. During the campaign -- described in detail in this paper -- the mole penetrated further aided by friction applied using the scoop at the end of the robotic Instrument Deployment Arm and by direct support by the latter. The mole finally reached a depth of 40 cm, bringing the mole body 1--2 cm below the surface. The penetration record of the mole and its thermal sensors were used to measure thermal and mechanical soil parameters such as the thermal conductivity and the penetration resistance of the duricrust and its cohesion. The hammerings of the mole were recorded by the seismometer SEIS and the signals could be used to derive a P-wave velocity and a S-wave velocity and elastic moduli representative of the topmost tens of cm of the regolith. The combined data were used to derive a model of the regolith that has an about 20 cm thick duricrust underneath a 1 cm thick unconsolidated layer of sand mixed with dust and above another 10 cm of unconsolidated sand. Underneath the latter, a layer more resistant to penetration and possibly consisting of debris from a small impact crater is inferred., Comment: 78 pages 22 figures, , submitted to Space Science Reviews

Dynamic programming and heuristic search are at the core of state-of-the-art solvers for sequential decision-making problems. In partially observable or collaborative settings (\eg, POMDPs and Dec-POMDPs), this requires introducing an appropriate statistic that induces a fully observable problem as well as bounding (convex) approximators of the optimal value function. This approach has succeeded in some subclasses of 2-player zero-sum partially observable stochastic games (zs-POSGs) as well, but failed in the general case despite known concavity and convexity properties, which only led to heuristic algorithms with poor convergence guarantees. We overcome this issue, leveraging on these properties to derive bounding approximators and efficient update and selection operators, before deriving a prototypical solver inspired by HSVI that provably converges to an $\epsilon$-optimal solution in finite time, and which we empirically evaluate. This opens the door to a novel family of promising approaches complementing those relying on linear programming or iterative methods., Comment: 37 pages, 4 figures, 4 tables, 3 algorithms

Observations of young stars hosting transition disks show that several of them have high accretion rates, despite their disks presenting extended cavities in their dust component. This represents a challenge for theoretical models, which struggle to reproduce both features. We explore if a disk evolution model, including a dead zone and disk dispersal by X-ray photoevaporation, can explain the high accretion rates and large gaps (or cavities) measured in transition disks. We implement a dead zone turbulence profile and a photoevaporative mass loss profile into numerical simulations of gas and dust. We perform a population synthesis study of the gas component, and obtain synthetic images and SED of the dust component through radiative transfer calculations. This model results in long lived inner disks and fast dispersing outer disks, that can reproduce both the accretion rates and gap sizes observed in transition disks. For a dead zone of turbulence $\alpha_{dz} = 10^{-4}$ and extent $r_{dz}$ = 10 AU, our population synthesis study shows that $63\%$ of our transition disks are accreting with $\dot{M}_g > 10^{-11} M_\odot/yr$ after opening a gap. Among those accreting transition disks, half display accretion rates higher than $5\times10^{-10} M_\odot/yr$ . The dust component in these disks is distributed in two regions: in a compact inner disk inside the dead zone, and in a ring at the outer edge of the photoevaporative gap, which can be located between 20 AU and 100 AU. Our radiative transfer calculations show that the disk displays an inner disk and an outer ring in the millimeter continuum, a feature observed in some transition disks. A disk model considering X-ray photoevaporative dispersal in combination with dead zones can explain several of the observed properties in transition disks including: the high accretion rates, the large gaps, and long-lived inner disks at mm-emission., Comment: 16 pages, 15 figures. Accepted in A&A

[abridged] We present a 1+1D global magnetically-driven disk accretion model that captures the essence of the MRI-driven accretion, without resorting to 3D global non-ideal MHD simulations. The gas dynamics is assumed to be solely controlled by the MRI and hydrodynamic instabilities. For given stellar and disk parameters, the Shakura-Sunyaev viscosity parameter $\alpha$ is determined self-consistently under the framework of viscously-driven accretion from detailed considerations of the MRI with non-ideal MHD effects (Ohmic resistivity and ambipolar diffusion), accounting for disk heating by stellar irradiation, non-thermal sources of ionization, and dust effects on the ionization chemistry. Additionally, the magnetic field strength is constrained and adopted to maximize the MRI activity. We demonstrate the use of our framework by investigating steady-state MRI-driven accretion in a fiducial protoplanetary disk model around a solar-type star. We find that the equilibrium solution displays no pressure maximum at the dead zone outer edge, except if a sufficient amount of dust particles have accumulated there before the disk reaches a steady-state accretion regime. Furthermore, the steady-state accretion solution describes a disk that displays a spatially extended long-lived inner disk gas reservoir (the dead zone) accreting a few $10^{-9}\, M_{\odot}.\rm{yr}^{-1}$. By conducting a detailed parameter study, we find that the extend to which the MRI can drive efficient accretion is primarily determined by the total disk gas mass, the representative grain size, the vertically-integrated dust-to-gas mass ratio, and the stellar X-ray luminosity. A self-consistent time-dependent coupling between gas, dust, stellar evolution models and our general framework on million-year timescales is required to fully understand the formation of dead zones and their potential to trap dust particles., Comment: Accepted for publication in A&A

Context. The protoplanetary disk around the star HD 100546 displays prominent substructures in the form of two concentric rings. Recent observations with the Atacama Large Millimeter/sub-millimeter Array (ALMA) have revealed these features with high angular resolution and have resolved the faint outer ring well. This allows us to study the nature of the system further. Aims. Our aim is to constrain some of the properties of potential planets embedded in the disk, assuming that they induce the observed rings and gaps. Methods. We present the self-calibrated $0.9\,$mm ALMA observations of the dust continuum emission from the circumstellar disk around HD 100546. These observations reveal substructures in the disk that are consistent with two rings, the outer ring being much fainter than the inner one. We reproduced this appearance closely with a numerical model that assumes two embedded planets. We varied planet and disk parameters in the framework of the planet-disk interaction code FARGO3D and used the outputs for the gas and dust distribution to generate synthetic observations with the code RADMC-3D. Results. From this comparison, we find that an inner planet located at $r_1 = 13\,$au with a mass $M_1 = 8 M_{\rm{Jup}}$ and an outer planet located at $r_2 = 143\,$au with a mass $M_2 = 3 M_{\rm{Jup}}$ leads to the best agreement between synthetic and ALMA observations (deviation less than $3\sigma$ for the normalized radial profiles). To match the very low brightness of the outer structure relative to the inner ring, the initial disk gas surface density profile needs to follow an exponentially tapered power law (self-similar solution), rather than a simple power-law profile., Comment: Accepted for publication in A&A

The problem of portfolio management represents an important and challenging class of dynamic decision making problems, where rebalancing decisions need to be made over time with the consideration of many factors such as investors preferences, trading environments, and market conditions. In this paper, we present a new portfolio policy network architecture for deep reinforcement learning (DRL)that can exploit more effectively cross-asset dependency information and achieve better performance than state-of-the-art architectures. In particular, we introduce a new property, referred to as \textit{asset permutation invariance}, for portfolio policy networks that exploit multi-asset time series data, and design the first portfolio policy network, named WaveCorr, that preserves this invariance property when treating asset correlation information. At the core of our design is an innovative permutation invariant correlation processing layer. An extensive set of experiments are conducted using data from both Canadian (TSX) and American stock markets (S&P 500), and WaveCorr consistently outperforms other architectures with an impressive 3%-25% absolute improvement in terms of average annual return, and up to more than 200% relative improvement in average Sharpe ratio. We also measured an improvement of a factor of up to 5 in the stability of performance under random choices of initial asset ordering and weights. The stability of the network has been found as particularly valuable by our industrial partner.

Recently equal risk pricing, a framework for fair derivative pricing, was extended to consider dynamic risk measures. However, all current implementations either employ a static risk measure that violates time consistency, or are based on traditional dynamic programming solution schemes that are impracticable in problems with a large number of underlying assets (due to the curse of dimensionality) or with incomplete asset dynamics information. In this paper, we extend for the first time a famous off-policy deterministic actor-critic deep reinforcement learning (ACRL) algorithm to the problem of solving a risk averse Markov decision process that models risk using a time consistent recursive expectile risk measure. This new ACRL algorithm allows us to identify high quality time consistent hedging policies (and equal risk prices) for options, such as basket options, that cannot be handled using traditional methods, or in context where only historical trajectories of the underlying assets are available. Our numerical experiments, which involve both a simple vanilla option and a more exotic basket option, confirm that the new ACRL algorithm can produce 1) in simple environments, nearly optimal hedging policies, and highly accurate prices, simultaneously for a range of maturities 2) in complex environments, good quality policies and prices using reasonable amount of computing resources; and 3) overall, hedging strategies that actually outperform the strategies produced using static risk measures when the risk is evaluated at later points of time.

We construct a gauge theory based in the supergroup $G=SU(2,2|2)$ that generalizes MacDowell-Mansouri supergravity. This is done introducing an extended notion of Hodge operator in the form of an outer automorphism of $su(2,2|2)$-valued 2-form tensors. The model closely resembles a Yang-Mills theory -- including the action principle, equations of motion and gauge transformations -- which avoids the use of the otherwise complicated component formalism. The theory enjoys $H=SO(3,1)\times \mathbb{R} \times U(1)\times SU(2)$ off-shell symmetry whilst the broken symmetries $G/H$, translation-type symmetries and supersymmetry, can be recovered on surface of integrability conditions of the equations of motion, for which it suffices the Rarita-Schwinger equation and torsion-like constraints to hold. Using the \textit{matter ansatz} -- projecting the $1 \otimes 1/2$ reducible representation into the spin-$1/2$ irreducible sector -- we obtain (chiral) fermion models with gauge and gravity interactions., Comment: 34 pages. References added in the second version. Published

Optimal stopping is the problem of deciding the right time at which to take a particular action in a stochastic system, in order to maximize an expected reward. It has many applications in areas such as finance, healthcare, and statistics. In this paper, we employ deep Reinforcement Learning (RL) to learn optimal stopping policies in two financial engineering applications: namely option pricing, and optimal option exercise. We present for the first time a comprehensive empirical evaluation of the quality of optimal stopping policies identified by three state of the art deep RL algorithms: double deep Q-learning (DDQN), categorical distributional RL (C51), and Implicit Quantile Networks (IQN). In the case of option pricing, our findings indicate that in a theoretical Black-Schole environment, IQN successfully identifies nearly optimal prices. On the other hand, it is slightly outperformed by C51 when confronted to real stock data movements in a put option exercise problem that involves assets from the S&P500 index. More importantly, the C51 algorithm is able to identify an optimal stopping policy that achieves 8% more out-of-sample returns than the best of four natural benchmark policies. We conclude with a discussion of our findings which should pave the way for relevant future research.

In supersymmetric extensions of the Standard Model, the observed particles come in fermion-boson pairs necessary for the realization of supersymmetry (SUSY). In spite of the expected abundance of super-partners for all the known particles, not a single supersymmetric pair has been reported to date. Although a hypothetical SUSY breaking mechanism, operating at high energy inaccessible to current experiments cannot be ruled out, this reduces SUSY's predictive power and it is unclear whether SUSY, in its standard form, can help reducing the remaining puzzles of the standard model (SM). Here we argue that SUSY can be realized in a different way, connecting spacetime and internal bosonic symmetries, combining bosonic gauge fields and fermionic matter particles in a single gauge field, a Lie superalgebra-valued connection. In this unconventional representation, states do not come in SUSY pairs, avoiding the doubling of particles and fields and SUSY is not a fully off-shell invariance of the action. The resulting systems are remarkably simple, closely resembling a standard quantum field theory and SUSY still emerges as a contingent symmetry that depends on the features of the vacuum/ground state. We illustrate the general construction with two examples: i) A 2+1 dimensional system based on the $osp(2,2|2)$ superalgebra, including Lorentz and $u(1)$ generators that describes graphene; ii) A supersymmetric extension of 3+1 conformal gravity with an $SU(2,2|2)$ connection that describes a gauge theory with an emergent chiral symmetry breaking, coupled to gravity. The extensions to higher odd and even dimensions, as well as the extensions to accommodate more general internal symmetries are also outlined., Comment: 19 pages. Review

We propose a data-driven portfolio selection model that integrates side information, conditional estimation and robustness using the framework of distributionally robust optimization. Conditioning on the observed side information, the portfolio manager solves an allocation problem that minimizes the worst-case conditional risk-return trade-off, subject to all possible perturbations of the covariate-return probability distribution in an optimal transport ambiguity set. Despite the non-linearity of the objective function in the probability measure, we show that the distributionally robust portfolio allocation with side information problem can be reformulated as a finite-dimensional optimization problem. If portfolio decisions are made based on either the mean-variance or the mean-Conditional Value-at-Risk criterion, the resulting reformulation can be further simplified to second-order or semi-definite cone programs. Empirical studies in the US equity market demonstrate the advantage of our integrative framework against other benchmarks., Comment: 1 figure

Conditional estimation given specific covariate values (i.e., local conditional estimation or functional estimation) is ubiquitously useful with applications in engineering, social and natural sciences. Existing data-driven non-parametric estimators mostly focus on structured homogeneous data (e.g., weakly independent and stationary data), thus they are sensitive to adversarial noise and may perform poorly under a low sample size. To alleviate these issues, we propose a new distributionally robust estimator that generates non-parametric local estimates by minimizing the worst-case conditional expected loss over all adversarial distributions in a Wasserstein ambiguity set. We show that despite being generally intractable, the local estimator can be efficiently found via convex optimization under broadly applicable settings, and it is robust to the corruption and heterogeneity of the data. Experiments with synthetic and MNIST datasets show the competitive performance of this new class of estimators.

Many non-trivial sequential decision-making problems are efficiently solved by relying on Bellman's optimality principle, i.e., exploiting the fact that sub-problems are nested recursively within the original problem. Here we show how it can apply to (infinite horizon) 2-player zero-sum partially observable stochastic games (zs-POSGs) by (i) taking a central planner's viewpoint, which can only reason on a sufficient statistic called occupancy state, and (ii) turning such problems into zero-sum occupancy Markov games (zs-OMGs). Then, exploiting the Lipschitz-continuity of the value function in occupancy space, one can derive a version of the HSVI algorithm (Heuristic Search Value Iteration) that provably finds an $\epsilon$-Nash equilibrium in finite time., Comment: 18 pages, 0 figures, 1 algorithm

The Callovo-Oxfordian (COx) claystone is considered as a candidate host rock for a deep geological radioactive waste repository in France. Due to the exothermic waste packages, the rock is expected to be submitted to temperatures up to 90 {\deg}C. The temperature rise induces deformations of the host rock, together with an increase in pore pressures, involving complex thermo-hydro-mechanical (THM) couplings. This study aims to better characterize the THM response of the COx claystone to temperature changes in the laboratory. To this end, claystone specimens were tested in a temperature controlled, high pressure isotropic compression cell, under stress conditions close to the in-situ ones. Thermal loads were applied on the specimens along different heating and cooling paths. A temperature corrected strain gage system provided precise measurements of the anisotropic strain response of the specimens. Drained and undrained thermal expansion coefficients in both transversely isotropic directions were determined. The measurement of pore pressure changes in undrained condition yielded the thermal pressurization coefficient. All parameters were analysed for their compatibility within the thermo-poro-elastic framework, and their stress and temperature dependency was identified., Comment: accepted manuscript

In the framework of a deep geological radioactive waste disposal in France, the hydromechanical properties of the designated host rock, the Callovo-Oxfordian claystone (COx), are investigated in laboratory tests. Experiments presented in this study are carried out to determine several coefficients required within a transversely isotropic material model. They include isotropic compression tests, pore pressure tests, and deviatoric loading tests parallel and perpendicular to the bedding plane. We emphasize the adapted experimental devices and testing procedures, necessary to detect small strains under high pressures, on a material, which is sensitive to water and has a very low permeability. In particular, we discovered a significant decrease of elastic stiffness with decreasing effective stress, which was observed to be reversible. In both isotropic and deviatoric tests, a notable anisotropic strain response was found. The Young modulus parallel to bedding was about 1.8 times higher than the one perpendicular to the bedding plane. A notably low Poisson ratio perpendicular to the bedding plane with values between 0.1 and 0.2 was evidenced. While the anisotropy of the back-calculated Biot coefficient was found to be low, a significant anisotropy of the Skempton coefficient was computed. The performed experiments provide an overdetermined set of material parameters at different stress levels. Using all determined parameters in a least square error regression scheme, seven independent elastic coefficients and their effective stress dependency are characterized. Parameters measured under isotropic loading are well represented by this set of coefficients, while the poroelastic framework with isotropic stress dependency is not sufficient to describe laboratory findings from triaxial loading., Comment: accepted manuscript

Conditional Value at Risk (CVaR) is widely used to account for the preferences of a risk-averse agent in the extreme loss scenarios. To study the effectiveness of randomization in interdiction games with an interdictor that is both risk and ambiguity averse, we introduce a distributionally robust network interdiction game where the interdictor randomizes over the feasible interdiction plans in order to minimize the worst-case CVaR of the flow with respect to both the unknown distribution of the capacity of the arcs and his mixed strategy over interdicted arcs. The flow player, on the contrary, maximizes the total flow in the network. By using the budgeted uncertainty set, we control the degree of conservatism in the model and reformulate the interdictor's non-linear problem as a bi-convex optimization problem. For solving this problem to any given optimality level, we devise a spatial branch and bound algorithm that uses the McCormick inequalities and reduced reformulation linearization technique (RRLT) to obtain convex relaxation of the problem. We also develop a column generation algorithm to identify the optimal support of the convex relaxation which is then used in the coordinate descent algorithm to determine the upper bounds. The efficiency and convergence of the spatial branch and bound algorithm is established in the numerical experiments. Further, our numerical experiments show that randomized strategies can have significantly better in-sample and out-of-sample performance than optimal deterministic ones.

In this paper, we consider the problem of equal risk pricing and hedging in which the fair price of an option is the price that exposes both sides of the contract to the same level of risk. Focusing for the first time on the context where risk is measured according to convex risk measures, we establish that the problem reduces to solving independently the writer and the buyer's hedging problem with zero initial capital. By further imposing that the risk measures decompose in a way that satisfies a Markovian property, we provide dynamic programming equations that can be used to solve the hedging problems for both the case of European and American options. All of our results are general enough to accommodate situations where the risk is measured according to a worst-case risk measure as is typically done in robust optimization. Our numerical study illustrates the advantages of equal risk pricing over schemes that only account for a single party, pricing based on quadratic hedging (i.e. $\epsilon$-arbitrage pricing), or pricing based on a fixed equivalent martingale measure (i.e. Black-Scholes pricing). In particular, the numerical results confirm that when employing an equal risk price both the writer and the buyer end up being exposed to risks that are more similar and on average smaller than what they would experience with the other approaches., Comment: Submitted to Quantitative Finance Journal, typos corrected, some minor issues resolved

Recent studies have proposed that adding quinine to water while performing Cherenkov volumetric dosimetry improves the skewed percent depth dose measurement. The aim of this study was to quantify the ability of quinine to convert directional Cherenkov emission to isotropic fluorescence and evaluate its contribution to the total emitted light. Aqueous solutions of quinine were prepared with distilled water at various concentrations (0.01 to 1.2 g/L). The solutions were irradiated with photon beams at 6 and 23 MV. The dependence of the light produced as a function of sample concentration was studied using a spectrometer with a fixed integration time. Spectral measurements of the luminescent solution and the blank solution (distilled water only) were taken to deconvolve the Cherenkov and quinine contribution to the overall emission spectrum. Using a CCD camera, intensity profiles were obtained for the blank and the 1.00 g/L solutions to compare them with the dose predicted by a treatment planning system. The luminescent intensity of the samples was found to follow a logarithmic trend as a function of the quinine concentration. Based on the spectral deconvolution of the 1.00 g/L solution, 52.4% and 52.7% of the signal in the visible range results from the quinine emission at 6 and 23 MV, respectively. The remaining fraction of the spectrum is due to the Cherenkov light that has not been converted. The fraction of the Cherenkov emission produced between 250 nm and 380 nm in the water and that was absorbed by the fluorophore reached 24.8% and 9.4% respectively at 6 and 23 MV. X-ray stimulated fluorescence of the quinine was then proven to be the principal cause to the increased total light output compared to the water-only signal. This new information reinforces the direct correlation of the solution intensity to the dose deposition.

Present and future high-precision radial-velocity spectrometers dedicated to the discovery of low-mass planets orbiting low-mass dwarfs need to focus on the best selected stars to make an efficient use of telescope time. In the framework of the preparation of the SPIRou Input Catalog, the CoolSnap program aims at screening M dwarfs in the solar neighborhood against binarity, rapid rotation, activity, ... To optimize the selection, the present paper describes the methods used to compute effective temperature, metallicity, projected rotation velocity of a large sample of 440 M dwarfs observed in the visible with the high-resolution spectro-polarimeter ESPaDOnS at CFHT. It also summarizes known and newly-discovered spectroscopic binaries, and stars known to belong to visual multiple systems. A calibration of the projected rotation velocity versus measured line widths for M dwarfs observed by the ESPaDOnS spectro-polarimeter is derived, and the resulting values are compared to equatorial rotation velocities deduced from rotation periods and radii. A comparison of the derived effective temperatures and metallicities with literature values is also conducted. Finally, the radial velocity uncertainty of each star in the sample is estimated, to narrow down the selection of stars to be included into the SPIRou Input Catalogue (SPIC)., Comment: 34 pages, 12 figures, 13 tables, MNRAS in press December 11, 2017

In-situ NMR spin-lattice relaxation measurements were performed on several vapor deposited ices. The measurements, which span more than 6 orders of magnitude in relaxation times, show a complex spin-lattice relaxation pattern that is strongly dependent on the growth conditions of the sample. The relaxation patterns change from multi-timescale relaxation for samples grown at temperatures below the amorphous-crystalline transition temperature to single exponential recovery for samples grown above the transition temperature. The slow-relaxation contribution seen in cold-grown samples exhibits a temperature dependence, and becomes even slower after the sample is annealed at 200K. The fast-relaxation contribution seen in these samples, does not seem to change or disappear even when heating to temperatures where the sample is evaporated. The possibility that the fast relaxation component is linked to the microporous structures in amorphous ice samples is further examined using an environmental electron scanning microscope. The images reveal complex meso-scale microporous structures which maintain their morphology up to their desorption temperatures. These findings, support the possibility that water molecules at pore surfaces might be responsible for the fast-relaxation contribution. Furthermore, the results of this study indicate that the pore-collapse dynamics observed in the past in amorphous ices using other experimental techniques, might be effectively inhibited in samples which are grown by relatively fast vapor deposition.

In this paper, we present perturbed law-based sensitivity indices and how to adapt them for quantile-oriented sensitivity analysis. We exhibit a simple way to compute these indices in practice using an importance sampling estimator for quantiles. Some useful asymptotic results about this estimator are also provided. Finally, we apply this method to the study of a numerical model which simulates the behaviour of a component in a hydraulic system in case of severe transient solicitations. The sensitivity analysis is used to assess the impact of epistemic uncertainties about some physical parameters on the output of the model.

The radiological characterization of contaminated elements (walls, grounds, objects) from nuclear facilities often suffers from a too small number of measurements. In order to determine risk prediction bounds on the level of contamination, some classic statistical methods may then reveal unsuited as they rely upon strong assumptions (e.g. that the underlying distribution is Gaussian) which cannot be checked. Considering that a set of measurements or their average value arise from a Gaussian distribution can sometimes lead to erroneous conclusion, possibly underconservative. This paper presents several alternative statistical approaches which are based on much weaker hypotheses than Gaussianity. They result from general probabilistic inequalities and order-statistics based formula. Given a data sample, these inequalities make it possible to derive prediction intervals for a random variable, which can be directly interpreted as probabilistic risk bounds. For the sake of validation, they are first applied to synthetic data samples generated from several known theoretical distributions. In a second time, the proposed methods are applied to two data sets obtained from real radiological contamination measurements.

We study combinatorial Dyson Schwinger equations, expressed in the Hopf algebra of words with a quasi shuffle product. We map them into an algebra of polynomials in one indeterminate L and show that the leading log expansion one obtains with such a mapping are simple power law like expression, Comment: 17 pages

The existence or non-existence of positive orthogonal functions for subspaces of almost periodic functions has important applications in studying the oscillatory behavior of vibrations. Cazenave, Haraux and Komornik have obtained a number of theorems of this type. The purpose of this paper is to answer an open question formulated in the 1980's, and to completely clarify the situation for subspaces defined by three periods., Comment: 18 pages

Given a gene expression data array of a list of bladder cancer patients with their tumor states, it may be difficult to determine which genes can operate as disease markers when the array is large and possibly contains outliers and missing data. An additional difficulty is that observations (tumor states) in the regression problem are discrete ones. In this article, we solve these problems on concrete data using first a clustering approach, followed by Least Absolute Shrinkage and Selection Operator (LASSO) estimators in a nonlinear regression problem involving discrete variables, as described in the brand-new research work of Plan and Vershynin. Gene markers of the most severe tumor state are finally provided using the proposed approach., Comment: submitted to CIBB 2015

To extract the relevant features in a given dataset is a difficult task, recently resolved in the non-negative data case with the Non-negative Matrix factorization (NMF) method. The objective of this research work is to extend this method to the case of missing and/or corrupted data due to outliers. To do so, data are denoised, missing values are imputed, and outliers are detected while performing a low-rank non-negative matrix factorization of the recovered matrix. To achieve this goal, a mixture of Bregman proximal methods and of the Augmented Lagrangian scheme are used, in a similar way to the so-called Alternating Direction of Multipliers method. An application to the analysis of gene expression data of patients with bladder cancer is finally proposed.

Clays and claystones are considered in some countries (including Belgium, France and Switzerland) as a potential host rock for high activity long lived radioactive waste disposal at great depth. One of the aspects to deal with in performance assessment is related to the effects on the host rock of the temperature elevation due to the placement of exothermic wastes. The potential effects of the thermal impact on the excavated damaged zone in the close field are another important issue that was the goal of the TIMODAZ European research project. In this paper, some principles of waste disposal in clayey host rocks at great depth are first presented and a series of experimental investigations carried out on specific equipment specially developed to face the problem are presented. Both drained and undrained tests have been developed to investigate the drained thermal volume changes of clays and claystone and the thermal pressurization occurring around the galleries. This importance of proper initial saturation (under in-situ stresses) and of satisfactory drainage conditions (in spite of the significantly low permeability of claystones) is emphasized, leading to the development of a new hollow cylinder apparatus. It is observed that claystones cannot be considered as overconsolidated clays given that they can exhibit, as the Callovo-Oxfordian claystone does, a thermoplastic contraction. Mechanical and thermal hardening are however observed, extending to claystones the knowledge already gained on clays. A new method of determining in the laboratory the thermal pressurization coefficient is described and the data obtained allow completing existing data in the field. Finally, the hollow cylinder apparatus makes it possible to demonstrate that the good self-sealing properties of clays and claystones can be extended to temperature effects, an important conclusion in terms of performance assessment.

In thermally enhanced recovery processes like cyclic steam stimulation (CSS) or steam assisted gravity drainage (SAGD), continuous steam injection entails changes in pore fluid, pore pressure and temperature in the rock reservoir, that are most often unconsolidated or weakly consolidated sandstones. This in turn increases or decreases the effective stresses and changes the elastic properties of the rocks. Thermally enhanced recovery processes give rise to complex couplings. Numerical simulations have been carried out on a case study so as to provide an estimation of the evolution of pressure, temperature, pore fluid saturation, stress and strain in any zone located around the injector and producer wells. The approach of Ciz and Shapiro (2007) - an extension of the poroelastic theory of Biot-Gassmann applied to rock filled elastic material - has been used to model the velocity dispersion in the oil sand mass under different conditions of temperature and stress. A good agreement has been found between these predictions and some laboratory velocity measurements carried out on samples of Canadian oil sand. Results appear to be useful to better interpret 4D seismic data in order to locate the steam chamber.

To provide a complete local monitoring of the state of an unsaturated soil sample during triaxial testing, a local water content measurement device was adapted to a triaxial device comprising the measurement of local displacements (Hall effect transducers) and suction (High capacity transducer). Water content was locally monitored by means of a resistivity probe. The water content/resistivity calibration curves of an intact natural unsaturated loess from Northern France extracted by block sampling at two depths (1 and 3.3 m) were carefully determined, showing good accuracy and repeatability. The validity of two models giving the resistivity of unsaturated soils with respect to their water content was examined.

Non-destructive methods of measuring water content in soils have been extensively developed in the last decades, especially in soil science. Among these methods, the measurements based on the electrical resistivity are simple and reliable thanks to the clear relationship between the water content and the electrical resistivity of soils. In this work, a new electrical resistivity probe was developed to monitor the change in local water content in the triaxial apparatus. The probe is composed of two-pair of electrodes, and an electrical current is induced through the soil at the vicinity of the contact between the probe and the specimen. Some experimental data on the changes in resistivity with the degree of saturation were obtained in specimens of a natural unsaturated loess from Northern France. Two theoretical models of resistivity were also used to analyze the obtained data. Results are finally discussed with respect to the loess's water retention properties.

In the framework of research into radioactive waste disposal, it was decided to investigate the thermally induce pore pressure occurring in the Callovo-Oxfordian claystone, a possible host rock in which the ANDRA underground laboratory of Bure (East of France) has been excavated. Thermal pore pressures appear in low permeability soils and rocks because the thermal expansion coefficient of water is significantly higher than that of the solid grains (Campanella and Mitchell; 1968 [1], Ghabezloo and Sulem; 2009 [2]). This phenomenon has clearly been observed in various in-situ heating tests conducted in Opalinus claystone in the Mont-Terri Underground Research Laboratory (URL) in Switzerland (HE-D test) and in Callovo-Oxfordian (COx) claystone in the Bure URL in France (TER test, Wileveau and Su; 2007 [3]) The processes of coring, transportation, storage and specimen trimming induce some desaturation in the sample. Due to the very low permeability (10-20 m2) of the COx claystone, a long period of time is necessary to properly resaturate the sample, a mandatory condition to satisfactorily investigate thermal pressurisation. Particular emphasis was hence put on the previous saturation procedure that was carried out under in-situ effective stress condition. Thermal pressurization has been investigated by performing undrained heating tests while measuring pore pressures changes in a specially adapted thermal isotropic compression cell. Special care was devoted to calibration procedures to account for the effects of the system on the pore pressure measurements. The thermal pressurization coefficient measured appeared to change with temperature, mainly because of the changes with temperature of both the water thermal expansion coefficient of water and the drained compression coefficient of the claystone.

The upper critical field Hc2 is a fundamental measure of the pairing strength, yet there is no agreement on its magnitude and doping dependence in cuprate superconductors. We have used thermal conductivity as a direct probe of Hc2 in the cuprates YBa2Cu3Oy and YBa2Cu4O8 to show that there is no vortex liquid at T = 0, allowing us to use high-field resistivity measurements to map out the doping dependence of Hc2 across the phase diagram. Hc2(p) exhibits two peaks, each located at a critical point where the Fermi surface undergoes a transformation. The condensation energy obtained directly from Hc2, and previous Hc1 data, undergoes a 20-fold collapse below the higher critical point. These data provide quantitative information on the impact of competing phases in suppressing superconductivity in cuprates., Comment: to appear in Nature Communications; Supplementary Information file available upon request

The pairing mechanism in iron-based superconductors is the subject of ongoing debate. Proximity to an antiferromagnetic phase suggests that pairing is mediated by spin fluctuations, but orbital fluctuations have also been invoked. The former typically favour a pairing state of extended s-wave symmetry with a gap that changes sign between electron and hole Fermi surfaces (s+-), while the latter yield a standard s-wave state without sign change (s++). Here we show that applying pressure to KFe2As2 induces a change of pairing state. The critical temperature Tc decreases with pressure initially, and then suddenly increases, above a critical pressure Pc. The constancy of the Hall coefficient through Pc rules out a change in the Fermi surface. There is compelling evidence that the pairing state below Pc is d-wave, from bulk measurements at ambient pressure. Above Pc, the high sensitivity to disorder argues for a particular kind of s+- state. The change from d-wave to s-wave is likely to proceed via an unusual s + id state that breaks time-reversal symmetry. The proximity of two distinct pairing states found here experimentally is natural given the near degeneracy of d-wave and s+- states found theoretically. These findings make a compelling case for spin-fluctuation-mediated superconductivity in this key iron-arsenide material., Comment: 8 pages, 7 figures, including SI, published in Nature Physics