Search

In 1981, Foias, Guillop\'e and Temam proved a priori estimates for arbitrary-order space derivatives of solutions to the Navier-Stokes equation. Such bounds are instructive in the numerical investigation of intermittency often observed in simulations, e.g., numerical study of vorticity moments by Donzis et al. (2013) revealed depletion of nonlinearity that may be responsible for smoothness of solutions to the Navier-Stokes equation. We employ an original method to derive analogous estimates for space derivatives of three-dimensional space-periodic weak solutions to the evolutionary equations of diffusive magnetohydrodynamics. Construction relies on space analyticity of the solutions at almost all times. An auxiliary problem is introduced, and a Sobolev norm of its solutions bounds from below the size in $C^3$ of the region of space analyticity of the solutions to the original problem. We recover the exponents obtained earlier for the hydrodynamic problem. The same approach is also followed here to derive and prove similar a priori bounds for arbitrary-order space derivatives of the first-order time derivative of the weak MHD solutions. This paper is dedicated to Professor Uriel Frisch on the occasion of his 80th anniversary as a sign of appreciation of the Scientist and the Teacher., Comment: 29 pages, 1 figure. The definitive version of the paper (formatting faults and some misprints in the published version corrected); more misprints corrected in version 2

In this article, we provide necessary and sufficient conditions for the existence of non-norm-attaining operators in $\mathcal {L}(E, F)$ . By using a theorem due to Pfitzner on James boundaries, we show that if there exists a relatively compact set K of $\mathcal {L}(E, F)$ (in the weak operator topology) such that $0$ is an element of its closure (in the weak operator topology) but it is not in its norm-closed convex hull, then we can guarantee the existence of an operator that does not attain its norm. This allows us to provide the following generalisation of results due to Holub and Mujica. If E is a reflexive space, F is an arbitrary Banach space and the pair $(E, F)$ has the (pointwise-)bounded compact approximation property, then the following are equivalent: (i) $\mathcal {K}(E, F) = \mathcal {L}(E, F)$ ;(ii)Every operator from E into F attains its norm;(iii) $(\mathcal {L}(E,F), \tau _c)^* = (\mathcal {L}(E, F), \left \Vert \cdot \right \Vert )^*$ ,where $\tau _c$ denotes the topology of compact convergence. We conclude the article by presenting a characterisation of the Schur property in terms of norm-attaining operators.

The remarkable practical success of deep learning has revealed some major surprises from a theoretical perspective. In particular, simple gradient methods easily find near-optimal solutions to non-convex optimization problems, and despite giving a near-perfect fit to training data without any explicit effort to control model complexity, these methods exhibit excellent predictive accuracy. We conjecture that specific principles underlie these phenomena: that overparametrization allows gradient methods to find interpolating solutions, that these methods implicitly impose regularization, and that overparametrization leads to benign overfitting, that is, accurate predictions despite overfitting training data. In this article, we survey recent progress in statistical learning theory that provides examples illustrating these principles in simpler settings. We first review classical uniform convergence results and why they fall short of explaining aspects of the behaviour of deep learning methods. We give examples of implicit regularization in simple settings, where gradient methods lead to minimal norm functions that perfectly fit the training data. Then we review prediction methods that exhibit benign overfitting, focusing on regression problems with quadratic loss. For these methods, we can decompose the prediction rule into a simple component that is useful for prediction and a spiky component that is useful for overfitting but, in a favourable setting, does not harm prediction accuracy. We focus specifically on the linear regime for neural networks, where the network can be approximated by a linear model. In this regime, we demonstrate the success of gradient flow, and we consider benign overfitting with two-layer networks, giving an exact asymptotic analysis that precisely demonstrates the impact of overparametrization. We conclude by highlighting the key challenges that arise in extending these insights to realistic deep learning settings.

We survey some classical norm inequalities of Hardy, Kallman, Kato, Kolmogorov, Landau, Littlewood, and Rota of the type \[ \|A f\|_{\mathcal{X}}^2 \leq C \|f\|_{\mathcal{X}} \big\|A^2 f\big\|_{\mathcal{X}}, \quad f \in dom\big(A^2\big), \] and recall that under exceedingly stronger hypotheses on the operator $A$ and/or the Banach space $\mathcal{X}$, the optimal constant $C$ in these inequalities diminishes from $4$ (e.g., when $A$ is the generator of a $C_0$ contraction semigroup on a Banach space $\mathcal{X}$) all the way down to $1$ (e.g., when $A$ is a symmetric operator on a Hilbert space $\mathcal{H}$). We also survey some results in connection with an extension of the Hardy-Littlewood inequality involving quadratic forms as initiated by Everitt., Comment: 28 pages, some updates added

In this work, an adaptive edge element method is developed for an H(curl)-elliptic constrained optimal control problem. We use the lowest-order Nedelec's edge elements of first family and the piecewise (element-wise) constant functions to approximate the state and the control, respectively, and propose a new adaptive algorithm with error estimators involving both residual-type error estimators and lower-order data oscillations. By using a local regular decomposition for H(curl)-functions and the standard bubble function techniques, we derive the a posteriori error estimates for the proposed error estimators. Then we exploit the convergence properties of the orthogonal $L^2$-projections and the mesh-size functions to demonstrate that the sequences of the discrete states and controls generated by the adaptive algorithm converge strongly to the exact solutions of the state and control in the energy-norm and $L^2$-norm, respectively, by first achieving the strong convergence towards the solution to a limiting control problem. Three-dimensional numerical experiments are also presented to confirm our theoretical results and the quasi-optimality of the adaptive edge element method., Comment: submitted

Herein, we address the expectations of frame potentials of three types of determinantal point processes(DPPs) on the d-dimensional unit sphere: (i) spherical ensembles on the 2-dimensional unit sphere; (ii) harmonic ensembles on the d-dimensional unit sphere and (iii) jittered sampling point processes on the d-dimensional unit sphere. The random point configurations generated by such DPPs converge more rapidly towards finite unit norm tight frames(FUNTFs) than the Poisson point processes on the unit sphere.

In this paper, we advance an ideal-theoretic analogue of a "finite factorization domain" (FFD), giving such a domain the moniker "finite molecularization domain" (FMD). We characterize FMD's as those factorable domains (termed "molecular domains" in the paper) for which every nonzero ideal is divisible by only finitely many nonfactorable ideals (termed "molecules" in the paper) and the monoid of nonzero ideals of the domain is unit-cancellative, in the language of Fan, Geroldinger, Kainrath, and Tringali. We develop a number of connections, particularly at the local level, amongst the concepts of "FMD", "FFD", and the "finite superideal domains" (FSD's) of Hetzel and Lawson. Characterizations of when $k[X^2, X^3]$, where $k$ is a field, and the classical $D+M$ construction are FMD's are provided. We also demonstrate that if $R$ is a Dedekind domain with the finite norm property, then $R[X]$ is an FMD.

Two approaches to spectral theory of order unit spaces are compared: the spectral duality of Alfsen and Shultz and the spectral compression bases due to Foulis. While the former approach uses the geometric properties of an order unit space in duality with a base norm space, the latter notion is purely algebraic. It is shown that the Foulis approach is strictly more general and contains the Alfsen-Shultz approach as a special case. This is demonstrated on two types of examples: the JB-algebras which are Foulis spectral if and only if they are Rickart, and the centrally symmetric state spaces, which may be Foulis spectral while not necessarily Alfsen-Shultz spectral., Comment: 34 pages, comments welcome

Very recently, motivated by the result of Bhatia and \v{S}emrl which characterizes the Birkhoff-James orthogonality of operators on a finite dimensional Hilbert space in terms of norm attaining points, the Bhatia-\v{S}emrl property was introduced. The main purpose of this article is to study the denseness of the set of multilinear maps with the Bhatia-\v{S}emrl property which is contained in the set of norm attaining ones. Contrary to the most of previous results which were shown for operators on real Banach spaces, we prove the denseness for multilinear maps on some complex Banach spaces. We also show that the denseness of operators does not hold when the domain space is $c_0$ for arbitrary range. Moreover, we find plenty of Banach spaces $Y$ such that only the zero operator has the Bhatia-\v{S}emrl property in the space of operators from $c_0$ to $Y$., Comment: 13 pages

It is a challenging task to remove heavy and mixed types of noise from Hyperspectral images (HSIs). In this paper, we propose a novel nonconvex approach to RPCA for HSI denoising, which adopts the log-determinant rank approximation and a novel $\ell_{2,\log}$ norm, to restrict the low-rank or column-wise sparse properties for the component matrices, respectively.For the $\ell_{2,\log}$-regularized shrinkage problem, we develop an efficient, closed-form solution, which is named $\ell_{2,\log}$-shrinkage operator, which can be generally used in other problems. Extensive experiments on both simulated and real HSIs demonstrate the effectiveness of the proposed method in denoising HSIs.

We consider the problem of linear classification under general loss functions in the limited-data setting. Overfitting is a common problem here. The standard approaches to prevent overfitting are dimensionality reduction and regularization. But dimensionality reduction loses information, while regularization requires the user to choose a norm, or a prior, or a distance metric. We propose an algorithm called RoLin that needs no user choice and applies to a large class of loss functions. RoLin combines reliable information from the top principal components with a robust optimization to extract any useful information from unreliable subspaces. It also includes a new robust cross-validation that is better than existing cross-validation methods in the limited-data setting. Experiments on $25$ real-world datasets and three standard loss functions show that RoLin broadly outperforms both dimensionality reduction and regularization. Dimensionality reduction has $14\%-40\%$ worse test loss on average as compared to RoLin. Against $L_1$ and $L_2$ regularization, RoLin can be up to 3x better for logistic loss and 12x better for squared hinge loss. The differences are greatest for small sample sizes, where RoLin achieves the best loss on 2x to 3x more datasets than any competing method. For some datasets, RoLin with $15$ training samples is better than the best norm-based regularization with $1500$ samples., Comment: 31 pages, published in the Machine Learning Journal

In this paper, on 4-spheres equipped with Riemannian metrics we study some integral conformal invariants, the sign and size of which under Ricci flow characterize the standard 4-sphere. We obtain a conformal gap theorem, and for Yamabe metrics of positive scalar curvature with $L^2$ norm of the Weyl tensor of the metric suitably small, we establish the monotonic decay of the $L^p$ norm for certain $p>2$ of the reduced curvature tensor along the normalized Ricci flow, with the metric converging exponentially to the standard 4-sphere., To appear in the Vaughan Jones Memorial Volume of the NZJM

Weaving frames in separable Hilbert spaces have been recently introduced by Bemrose et al. to deal with some problems in distributed signal processing and wireless sensor networks. In this paper, we study the notion of excess for woven frames and prove that any two frames in a separable Hilbert space that are woven have the same excess. We also show that every frame with a large class of duals is woven provided that its redundant elements have small enough norm. Also, we try to transfer the woven property from frames to their duals and vise versa. Finally, we look at which perturbations of dual frames preserve the woven property, moreover it is shown that under some conditions the canonical Pareseval frame of two woven frames are also woven., Comment: This article is containing 16 pages and it is published in journal of Bulletin of the Malaysian

Although quantum channels underlie the dynamics of quantum states, maps which are not physical channels -- that is, not completely positive -- can often be encountered in settings such as entanglement detection, non-Markovian quantum dynamics, or error mitigation. We introduce an operational approach to the quantitative study of the non-physicality of linear maps based on different ways to approximate a given linear map with quantum channels. Our first measure directly quantifies the cost of simulating a given map using physically implementable quantum channels, shifting the difficulty in simulating unphysical dynamics onto the task of simulating linear combinations of quantum states. Our second measure benchmarks the quantitative advantages that a non-completely-positive map can provide in discrimination-based quantum games. Notably, we show that for any trace-preserving map, the quantities both reduce to a fundamental distance measure: the diamond norm, thus endowing this norm with new operational meanings in the characterisation of linear maps. We discuss applications of our results to structural physical approximations of positive maps, quantification of non-Markovianity, and bounding the cost of error mitigation., Comment: 25 pages. v3: published version

Deep convolutional neural networks for semantic segmentation achieve outstanding accuracy, however they also have a couple of major drawbacks: first, they do not generalize well to distributions slightly different from the one of the training data; second, they require a huge amount of labeled data for their optimization. In this paper, we introduce feature-level space-shaping regularization strategies to reduce the domain discrepancy in semantic segmentation. In particular, for this purpose we jointly enforce a clustering objective, a perpendicularity constraint and a norm alignment goal on the feature vectors corresponding to source and target samples. Additionally, we propose a novel measure able to capture the relative efficacy of an adaptation strategy compared to supervised training. We verify the effectiveness of such methods in the autonomous driving setting achieving state-of-the-art results in multiple synthetic-to-real road scenes benchmarks., Comment: Accepted at CVPR-WAD 2021, 11 pages, 7 figures, 1 tables

This paper is concerned with the asymptotic behaviors of global strong solutions to the incompressible non-resistive viscous magnetohydrodynamic (MHD) equations with large initial perturbations in two-dimensional periodic domains in Lagrangian coordinates. First, motivated by the odevity conditions imposed in [Arch. Ration. Mech. Anal. 227 (2018), 637--662], we prove the existence and uniqueness of strong solutions under some class of large initial perturbations, where the strength of impressive magnetic fields depends increasingly on the $H^2$-norm of the initial perturbation values of both velocity and magnetic field. Then, we establish time-decay rates of strong solutions. Moreover, we find that $H^2$-norm of the velocity decays faster than the perturbed magnetic field. Finally, by developing some new analysis techniques, we show that the strong solution convergence in a rate of the field strength to the solution of the corresponding linearized problem as the strength of the impressive magnetic field goes to infinity. In addition, an extension of similar results to the corresponding inviscid case with damping is presented., Comment: 65 pages

A path-following collision-avoidance model predictive control (MPC) method is proposed which approximates obstacle shapes as convex polygons. Collision-avoidance is ensured by means of the signed distance function which is calculated efficiently as part of the MPC problem by making use of a dual formulation. The overall MPC problem can be solved by standard nonlinear programming (NLP) solvers. The dual signed distance formulation yields, besides the (dual) collision-avoidance constraints, norm, and consistency constraints. A novel approach is presented that combines the arising norm equality with the dual collision-avoidance inequality constraints to yield an alternative formulation reduced in complexity. Moving obstacles are considered using separate convex sets of linearly predicted obstacle positions in the dual problem. The theoretical findings and simplifications are compared with the often-used ellipsoidal obstacle formulation and are analyzed with regard to efficiency by the example of a simulated path-following autonomous surface vessel during a realistic maneuver and AIS obstacle data from the Kiel bay area., Comment: To be published in the American Control Conference 2021 New Orleans; fix margin for conference requirements; added missing quantity in third footnote

The scientific value of the next generation of large continuum surveys would be greatly increased if the redshifts of the newly detected sources could be rapidly and reliably estimated. Given the observational expense of obtaining spectroscopic redshifts for the large number of new detections expected, there has been substantial recent work on using machine learning techniques to obtain photometric redshifts. Here we compare the accuracy of the predicted photometric redshifts obtained from Deep Learning(DL) with the k-Nearest Neighbour (kNN) and the Decision Tree Regression (DTR) algorithms. We find using a combination of near-infrared, visible and ultraviolet magnitudes, trained upon a sample of SDSS QSOs, that the kNN and DL algorithms produce the best self-validation result with a standard deviation of {\sigma} = 0.24. Testing on various sub-samples, we find that the DL algorithm generally has lower values of {\sigma}, in addition to exhibiting a better performance in other measures. Our DL method, which uses an easy to implement off-the-shelf algorithm with no filtering nor removal of outliers, performs similarly to other, more complex, algorithms, resulting in an accuracy of {\Delta}z < 0.1$ up to z ~ 2.5. Applying the DL algorithm trained on our 70,000 strong sample to other independent (radio-selected) datasets, we find {\sigma} < 0.36 over a wide range of radio flux densities. This indicates much potential in using this method to determine photometric redshifts of quasars detected with the Square Kilometre Array., Comment: Accepted by MNRAS

We present useful connections between the finite difference and the finite element methods for a model boundary value problem. We start from the observation that, in the finite element context, the interpolant of the solution in one dimension coincides with the finite element approximation of the solution. This result can be viewed as an extension of the Green function formula for the solution at the continuous level. We write the finite difference and the finite element systems such that the two corresponding linear systems have the same stiffness matrices and compare the right hand side load vectors for the two methods. Using evaluation of the Green function, a formula for the inverse of the stiffness matrix is extended to the case of non-uniformly distributed mesh points. We provide an error analysis based on the connection between the two methods, and estimate the energy norm of the difference of the two solutions. Interesting extensions to the 2D case are provided., Comment: Submitted to Applicable Analysis Journal on July 2, 2021

In the last ten years, full-waveform inversion has emerged as a robust and efficient high-resolution velocity model-building tool for seismic imaging, with the unique ability to recover complex subsurface structures. Originally based on a data fitting process using a least-squares cost function, it suffered from high sensitivity to cycle-skipping and was therefore of poor efficiency in handling large time shifts between observed and modelled seismic events. To tackle this problem, a common practice is to start the inversion using the low temporal frequencies of the data and selecting diving wave events. Complementary to this, the use of other cost functions has been investigated. Among these, cost functions based on optimal transport appeared appealing to possibly handle large time shifts between seismic events. Several strategies inspired by optimal transport have been proposed, taking into account the specificities of seismic data. Among them, the approach based on the Kantorovich-Rubinstein norm offers the possibility of the direct use of seismic data and an efficient numerical implementation allowing for a multidimensional (data coordinate space) application. We present here an analysis of the Kantorovich-Rubinstein norm, discussing its theoretical and practical aspects. A key component of our analysis is the back-propagated adjoint-source. We highlight its piecewise linearity, analyze its frequency content and amplitude balancing. We also emphasize the benefit of having a multidimensional implementation. Furthermore, we give practical rules for setting the tuning parameters of the numerical implementation. Our set of synthetic and field data examples demonstrate the improvements brought by the use of the Kantorovich-Rubinstein norm over least-squares full-waveform inversion, and highlight the improvements brought by the multidimensional approach over the one-dimensional one.

Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural networks, have attracted great attentions from researchers and industry. The most efficient way to train deep SNNs is through ANN-SNN conversion. However, the conversion usually suffers from accuracy loss and long inference time, which impede the practical application of SNN. In this paper, we theoretically analyze ANN-SNN conversion and derive sufficient conditions of the optimal conversion. To better correlate ANN-SNN and get greater accuracy, we propose Rate Norm Layer to replace the ReLU activation function in source ANN training, enabling direct conversion from a trained ANN to an SNN. Moreover, we propose an optimal fit curve to quantify the fit between the activation value of source ANN and the actual firing rate of target SNN. We show that the inference time can be reduced by optimizing the upper bound of the fit curve in the revised ANN to achieve fast inference. Our theory can explain the existing work on fast reasoning and get better results. The experimental results show that the proposed method achieves near loss less conversion with VGG-16, PreActResNet-18, and deeper structures. Moreover, it can reach 8.6x faster reasoning performance under 0.265x energy consumption of the typical method. The code is available at https://github.com/DingJianhao/OptSNNConvertion-RNL-RIL., Comment: 9 pages, 7 figures, 2 tables. To appear in the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021)

We report on a time scaling technique to enhance the performances of quantum protocols in non-Hermitian systems. The considered time scaling involves no extra-couplings and yields a significant enhancement of the quantum fidelity for a comparable amount of resources. We discuss the application of this technique to quantum state transfers in 2 and 3-level open quantum systems. We derive the quantum speed limit in a system governed by a non-Hermitian Hamiltonian. Interestingly, we show that, with an appropriate driving, the time-scaling technique preserves the optimality of the quantum speed with respect to the quantum speed limit while reducing significantly the damping of the quantum state norm.

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar to the training data, which may be impractical. This demands robust methods that can quantify uncertainty in the prediction for making informed decisions, especially for critical areas such as medical imaging. Recent works that employ conditional generative adversarial networks (GANs) have shown improved performance in learning photo-realistic image-to-image mappings between the source and the target images. However, these methods do not focus on (i)~robustness of the models to out-of-distribution (OOD)-noisy data and (ii)~uncertainty quantification. This paper proposes a GAN-based framework that (i)~models an adaptive loss function for robustness to OOD-noisy data that automatically tunes the spatially varying norm for penalizing the residuals and (ii)~estimates the per-voxel uncertainty in the predictions. We demonstrate our method on two key applications in medical imaging: (i)~undersampled magnetic resonance imaging (MRI) reconstruction (ii)~MRI modality propagation. Our experiments with two different real-world datasets show that the proposed method (i)~is robust to OOD-noisy test data and provides improved accuracy and (ii)~quantifies voxel-level uncertainty in the predictions., Comment: Accepted at IEEE ICCV-2021 workshop on Computer Vision for Automated Medical Diagnosis

The tensor rank decomposition is a useful tool for the geometric interpretation of the tensors in the canonical tensor model (CTM) of quantum gravity. In order to understand the stability of this interpretation, it is important to be able to estimate how many tensor rank decompositions can approximate a given tensor. More precisely, finding an approximate symmetric tensor rank decomposition of a symmetric tensor $Q$ with an error allowance $\Delta$ is to find vectors $\phi^i$ satisfying $\|Q-\sum_{i=1}^R \phi^i\otimes \phi^i\cdots \otimes \phi^i\|^2 \leq \Delta$. The volume of all possible such $\phi^i$ is an interesting quantity which measures the amount of possible decompositions for a tensor $Q$ within an allowance. While it would be difficult to evaluate this quantity for each $Q$, we find an explicit formula for a similar quantity by integrating over all $Q$ of unit norm. The expression as a function of $\Delta$ is given by the product of a hypergeometric function and a power function. We also extend the formula to generic decompositions of non-symmetric tensors. The derivation depends on the existence (convergence) of the partition function of a matrix model which appeared in the context of the CTM., Comment: 29 pages, 7 figures, 1 table

This article is concerned with the unique continuation property of a forward differential inequality abstracted from parabolic equations proposed on a convex domain $\Omega$ prescribed with some regularity and growth conditions. Our result shows that the value of the solutions can be determined uniquely by its value on an arbitrary open subset $\omega$ in $\Omega$ at any given positive time $T$. We also derive the quantitative nature of this unique continuation, that is, the estimate of a $L^2({\Omega})$ norm of the initial data on $\Omega$, which is majorized by that of solution on the bounded open subset $\omega$ at terminal moment $t = T$., Comment: 14 pages

In this paper we develop an approach for detecting entanglement, which is based on measuring quantum correlations and constructing a correlation matrix. The correlation matrix is then used for defining a family of parameters, named Correlation Minor Norms, which allow one to detect entanglement. This approach generalizes the computable cross-norm or realignment (CCNR) criterion, and moreover requires measuring a state-independent set of operators. Furthermore, we illustrate a scheme which yields for each Correlation Minor Norm a separable state that maximizes it. The proposed entanglement detection scheme is believed to be advantageous in comparison to other methods because correlations have a simple, intuitive meaning and in addition they can be directly measured in experiment. Moreover, it is demonstrated to be stronger than the CCNR criterion. We also illustrate the relation between the Correlation Minor Norm and entanglement entropy for pure states. Finally, we discuss the relation between the Correlation Minor Norm and quantum discord. We demonstrate that the CMN may be used to define a new measure for quantum discord., Comment: 5+8 pages, 2 figures. Comments are most welcome

In this paper we will establish some necessary condition and sufficient condition respectively for a set-valued mapping to have the Lipschitz-like property relative to a closed set by employing regular normal cone and limiting normal cone of a restricted graph of the set-valued mapping. We will obtain a complete characterization for a set-valued mapping to have the Lipschitz-property relative to a closed and convex set by virtue of the projection of the coderivative onto a tangent cone. Furthermore, by introducing a projectional coderivative of set-valued mappings, we establish a verifiable generalized Mordukhovich criterion for the Lipschitz-like property relative to a closed and convex set. We will study the representation of the graphical modulus of a set-valued mapping relative to a closed and convex set by using the outer norm of the corresponding projectional coderivative value. For an extended real-valued function, we will apply the obtained results to investigate its Lipschitz continuity relative to a closed and convex set and the Lipschitz-like property of a level-set mapping relative to a half line.

Deep learning-based object detection and instance segmentation have achieved unprecedented progress. In this paper, we propose Complete-IoU (CIoU) loss and Cluster-NMS for enhancing geometric factors in both bounding box regression and Non-Maximum Suppression (NMS), leading to notable gains of average precision (AP) and average recall (AR), without the sacrifice of inference efficiency. In particular, we consider three geometric factors, i.e., overlap area, normalized central point distance and aspect ratio, which are crucial for measuring bounding box regression in object detection and instance segmentation. The three geometric factors are then incorporated into CIoU loss for better distinguishing difficult regression cases. The training of deep models using CIoU loss results in consistent AP and AR improvements in comparison to widely adopted $\ell_n$-norm loss and IoU-based loss. Furthermore, we propose Cluster-NMS, where NMS during inference is done by implicitly clustering detected boxes and usually requires less iterations. Cluster-NMS is very efficient due to its pure GPU implementation, and geometric factors can be incorporated to improve both AP and AR. In the experiments, CIoU loss and Cluster-NMS have been applied to state-of-the-art instance segmentation (e.g., YOLACT and BlendMask-RT), and object detection (e.g., YOLO v3, SSD and Faster R-CNN) models. Taking YOLACT on MS COCO as an example, our method achieves performance gains as +1.7 AP and +6.2 AR$_{100}$ for object detection, and +0.9 AP and +3.5 AR$_{100}$ for instance segmentation, with 27.1 FPS on one NVIDIA GTX 1080Ti GPU. All the source code and trained models are available at https://github.com/Zzh-tju/CIoU, Comment: This work has been accepted to IEEE Transactions on Cybernetics. The source codes are available at https://github.com/Zzh-tju/CIoU

We analyze pseudospectra of the generator of the damped wave equation with unbounded damping. We show that the resolvent norm diverges as $\Re z \to - \infty$. The highly non-normal character of the operator is a robust effect preserved even when a strong potential is added. Consequently, spectral instabilities and other related pseudospectral effects are present., Comment: 18 pages, 1 figure

We compare the convergence behavior of best polynomial approximations and Legendre and Chebyshev projections and derive optimal rates of convergence of Legendre projections for analytic and differentiable functions in the maximum norm. For analytic functions, we show that the best polynomial approximation of degree $n$ is better than the Legendre projection of the same degree by a factor of $n^{1/2}$. For differentiable functions such as piecewise analytic functions and functions of fractional smoothness, however, we show that the best approximation is better than the Legendre projection by only some constant factors. Our results provide some new insights into the approximation power of Legendre projections., Comment: 23 pages, 5 figures. Numer. Math., to appear

One of the fundamental differences between classical and quantum mechanics is in the ways correlations can be distributed among the many parties that compose a system. While classical correlations can be shared among many subsystems, in general quantum correlations cannot be freely shared. This unique property is known as monogamy of quantum correlations. In this work, we study the monogamy properties of the correlated coherence for the l 1 -norm and relative entropy measures of coherence. For the l 1 -norm the correlated coherence is monogamous for a particular class of quantum states. For the relative entropy of coherence, and using maximally mixed state as the reference incoherent state, we show that the correlated coherence is monogamous for tripartite pure quantum systems., Comment: 9 pages, 2 figures

The M-P (Moore-Penrose) pseudoinverse has as a key application the computation of least-squares solutions of inconsistent systems of linear equations. Irrespective of whether a given input matrix is sparse, its M-P pseudoinverse can be dense, potentially leading to high computational burden, especially when we are dealing with high-dimensional matrices. The M-P pseudoinverse is uniquely characterized by four properties, but only two of them need to be satisfied for the computation of least-squares solutions. Fampa and Lee (2018) and Xu, Fampa, Lee, and Ponte (2019) propose local-search procedures to construct sparse block-structured generalized inverses that satisfy the two key M-P properties, plus one more (the so-called reflexive property). That additional M-P property is equivalent to imposing a minimum-rank condition on the generalized inverse. (Vector) 1-norm minimization is used to induce sparsity and, importantly, to keep the magnitudes of entries under control for the generalized-inverses constructed. Here, we investigate the trade-off between low 1-norm and low rank for generalized inverses that can be used in the computation of least-squares solutions. We propose several algorithmic approaches that start from a $1$-norm minimizing generalized inverse that satisfies the two key M-P properties, and gradually decrease its rank, by iteratively imposing the reflexive property. The algorithms iterate until the generalized inverse has the least possible rank. During the iterations, we produce intermediate solutions, trading off low 1-norm (and typically high sparsity) against low rank.

We study the generalization error of functions that interpolate prescribed data points and are selected by minimizing a weighted norm. Under natural and general conditions, we prove that both the interpolants and their generalization errors converge as the number of parameters grow, and the limiting interpolant belongs to a reproducing kernel Hilbert space. This rigorously establishes an implicit bias of minimum weighted norm interpolation and explains why norm minimization may either benefit or suffer from over-parameterization. As special cases of this theory, we study interpolation by trigonometric polynomials and spherical harmonics. Our approach is from a deterministic and approximation theory viewpoint, as opposed to a statistical or random matrix one., Comment: 31 pages, 2 figures. To appear in SIAM Journal on Mathematics of Data Science

We study the Davis-Wielandt shell and the Davis-Wielandt radius of an operator on a normed linear space $$\mathcal {X}$$ . We show that after a suitable modification, the modified Davis-Wielandt radius defines a norm on $$\mathcal {L}(\mathcal {X})$$ which is equivalent to the usual operator norm on $$\mathcal {L}(\mathcal {X})$$ . We introduce the Davis-Wielandt index of a normed linear space and compute its value explicitly in case of some particular polyhedral Banach spaces. We also present a general method to estimate the Davis-Wielandt index of any polyhedral finite-dimensional Banach space.

We study a system of semi-linear elliptic partial differential equations with a lower order cubic nonlinear term, and inhomogeneous Dirichlet boundary conditions, relevant for two-dimensional bistable liquid crystal devices, within a reduced Landau-de Gennes framework. The main results are (i) a priori error estimates for the energy norm, within the Nitsche's and discontinuous Galerkin frameworks under milder regularity assumptions on the exact solution and (ii) a reliable and efficient {\it a posteriori} analysis for a sufficiently large penalization parameter and a sufficiently fine triangulation in both cases. Numerical examples that validate the theoretical results, are presented separately., Comment: 27 pages, 20 figures. This article has been accepted for publication

A classical regularity result is that non-negative solutions to the Dirichlet problem Δ u = f in a bounded domain Ω, where f ∈ L q ( Ω ) , q > n 2 , satisfy ‖ u ‖ L ∞ ( Ω ) ≤ C ‖ f ‖ L q ( Ω ) . We extend this result in three ways: we replace the Laplacian with a degenerate elliptic operator; we show that we can take the data f in an Orlicz space L A ( Ω ) that lies strictly between L n 2 ( Ω ) and L q ( Ω ) , q > n 2 ; and we show that we can replace the L A norm in the right-hand side by a smaller expression involving the logarithm of the “entropy bump” ‖ f ‖ L A ( Ω ) / ‖ f ‖ L n 2 ( Ω ) , generalizing a result due to Xu.

There are representations of the type-A Hecke algebra on spaces of polynomials in anti-commuting variables. Luque and the author [Sém. Lothar. Combin. 66 (2012), Art. B66b, 68 pages, arXiv:1106.0875] constructed nonsymmetric Macdonald polynomials taking values in arbitrary modules of the Hecke algebra. In this paper the two ideas are combined to define and study nonsymmetric Macdonald polynomials taking values in the aforementioned anti-commuting polynomials, in other words, superpolynomials. The modules, their orthogonal bases and their properties are first derived. In terms of the standard Young tableau approach to representations these modules correspond to hook tableaux. The details of the Dunkl-Luque theory and the particular application are presented. There is an inner product on the polynomials for which the Macdonald polynomials are mutually orthogonal. The squared norms for this product are determined. By using techniques of Baker and Forrester [Ann. Comb. 3 (1999), 159-170, arXiv:q-alg/9707001] symmetric Macdonald polynomials are built up from the nonsymmetric theory. Here ''symmetric'' means in the Hecke algebra sense, not in the classical group sense. There is a concise formula for the squared norm of the minimal symmetric polynomial, and some formulas for anti-symmetric polynomials. For both symmetric and anti-symmetric polynomials there is a factorization when the polynomials are evaluated at special points.

This work uses adversarial perturbations to enhance deepfake images and fool common deepfake detectors. We created adversarial perturbations using the Fast Gradient Sign Method and the Carlini and Wagner L2 norm attack in both blackbox and whitebox settings. Detectors achieved over 95% accuracy on unperturbed deepfakes, but less than 27% accuracy on perturbed deepfakes. We also explore two improvements to deepfake detectors: (i) Lipschitz regularization, and (ii) Deep Image Prior (DIP). Lipschitz regularization constrains the gradient of the detector with respect to the input in order to increase robustness to input perturbations. The DIP defense removes perturbations using generative convolutional neural networks in an unsupervised manner. Regularization improved the detection of perturbed deepfakes on average, including a 10% accuracy boost in the blackbox case. The DIP defense achieved 95% accuracy on perturbed deepfakes that fooled the original detector, while retaining 98% accuracy in other cases on a 100 image subsample., Comment: To appear in the proceedings of the International Joint Conference on Neural Networks (IJCNN 2020)

This paper is concerned with a robust instability analysis for the single-input-single-output unstable linear time-invariant (LTI) system under dynamic perturbations. The nominal system itself is possibly perturbed by the static gain of the uncertainty, which would be the case when a nonlinear uncertain system is linearized around an equilibrium point. We define the robust instability radius as the smallest H ∞ norm of the stable linear perturbation that stabilizes the nominal system. There are two main theoretical results: one is on a partial characterization of unperturbed nominal systems for which the robust instability radius can be calculated exactly, and the other is a numerically tractable procedure for calculating the exact robust instability radius for nominal systems parametrized by a perturbation parameter. The results are applied to the repressilator in synthetic biology , where hyperbolic instability of a unique equilibrium guarantees the persistence of oscillation phenomena in the global sense, and the effectiveness of our linear robust instability analysis is confirmed by numerical simulations.

We study the problem of testing whether a matrix $\mathbf{A} \in \mathbb{R}^{n \times n}$ with bounded entries ($\|\mathbf{A}\|_\infty \leq 1$) is positive semi-definite (PSD), or $\epsilon$-far in Euclidean distance from the PSD cone, meaning that $\min_{\mathbf{B} \succeq 0} \|\mathbf{A} - \mathbf{B}\|_F^2 > \epsilon n^2$, where $\mathbf{B} \succeq 0$ denotes that $\mathbf{B}$ is PSD. Our main algorithmic contribution is a non-adaptive tester which distinguishes between these cases using only $\tilde{O}(1/\epsilon^4)$ queries to the entries of $\mathbf{A}$. If instead of the Euclidean norm we considered the distance in spectral norm, we obtain the "$\ell_\infty$-gap problem", where $\mathbf{A}$ is either PSD or satisfies $\min_{\mathbf{B}\succeq 0} \|\mathbf{A}- \mathbf{B}\|_2 > \epsilon n$. For this related problem, we give a $\tilde{O}(1/\epsilon^2)$ query tester, which we show is optimal up to $\log(1/\epsilon)$ factors. Our testers randomly sample a collection of principal submatrices and check whether these submatrices are PSD. Consequentially, our algorithms achieve one-sided error: whenever they output that $\mathbf{A}$ is not PSD, they return a certificate that $\mathbf{A}$ has negative eigenvalues. We complement our upper bound for PSD testing with Euclidean norm distance by giving a $\tilde{\Omega}(1/\epsilon^2)$ lower bound for any non-adaptive algorithm. Our lower bound construction is general, and can be used to derive lower bounds for a number of spectral testing problems. As an example of the applicability of our construction, we obtain a new $\tilde{\Omega}(1/\epsilon^4)$ sampling lower bound for testing the Schatten-$1$ norm with a $\epsilon n^{1.5}$ gap, extending a result of Balcan, Li, Woodruff, and Zhang [SODA'19]. In addition, it yields new sampling lower bounds for estimating the Ky-Fan Norm, and the cost of the best rank-$k$ approximation., Comment: Minor Edits, highlighted connection between \ell_\infty gap and spectral norm gap

Motivated by biochemical reaction networks, a generalization of the classical secant condition for the stability analysis of cyclic interconnected commensurate fractional-order systems is provided. The main result presents a sufficient condition for stability of networks of cyclic interconnection of fractional-order systems when the digraph describing the network conforms to a single circuit. The condition becomes necessary under a special situation where coupling weights are uniform. We then investigate the robustness of fractional-order linear networks. Robustness performance of a fractional-order linear network is quantified using the $\mathcal{H}_2$-norm of the dynamical system. Finally, the theoretical results are confirmed via some numerical illustrations.

We establish a family of inequalities that allow one to estimate the L q -norm of a matrix-valued field by the L q -norm of an elliptic part and the L p -norm of the matrix-valued curl. This particularly extends previous work by Neff et al. and, as a main novelty, is applicable in the regime p = 1 .

In this article, we present weighted norm inequality for a fractional one-sided minimal function. We prove weighted weak and strong type norm inequalities for the one-sided minimal function on $\mathbb{R}.$ We construct two weight classes to ensure the sufficient and necessary part of the weak and strong type estimates. Later, we establish an equivalence relation between these two weight classes., Comment: 16 pages

We examine the spatial modeling of the outbreak of COVID-19 in two regions: the autonomous community of Andalusia in Spain and the mainland of Greece. We start with a 0D compartmental epidemiological model consisting of Susceptible, Exposed, Asymptomatic, (symptomatically) Infected, Hospitalized, Recovered, and deceased populations. We emphasize the importance of the viral latent period and the key role of an asymptomatic population. We optimize model parameters for both regions by comparing predictions to the cumulative number of infected and total number of deaths via minimizing the $\ell^2$ norm of the difference between predictions and observed data. We consider the sensitivity of model predictions on reasonable variations of model parameters and initial conditions, addressing issues of parameter identifiability. We model both pre-quarantine and post-quarantine evolution of the epidemic by a time-dependent change of the viral transmission rates that arises in response to containment measures. Subsequently, a spatially distributed version of the 0D model in the form of reaction-diffusion equations is developed. We consider that, after an initial localized seeding of the infection, its spread is governed by the diffusion (and 0D model "reactions") of the asymptomatic and symptomatically infected populations, which decrease with the imposed restrictive measures. We inserted the maps of the two regions, and we imported population-density data into COMSOL, which was subsequently used to solve numerically the model PDEs. Upon discussing how to adapt the 0D model to this spatial setting, we show that these models bear significant potential towards capturing both the well-mixed, 0D description and the spatial expansion of the pandemic in the two regions. Veins of potential refinement of the model assumptions towards future work are also explored., Comment: 28 pages, 16 figures and 2 movies

We study critical surfaces for a surface energy which contains the squared $L^2$ norm of the difference of the mean curvature $H$ and the spontaneous curvature $c_o$, coupled to the elastic energy of the boundary curve. We investigate the existence of equilibria with $H\equiv -c_o$. When $c_o \ge 0$ we characterize those cases where the infimum of this energy is finite for topological annuli and we find the minimizer in the cases that it exists. Results for topological discs are also given., Comment: To appear in Journal of Nonlinear Science

This paper presents a new data-driven controller synthesis based on the Koopman operator and the extended $\mathcal{H}_2$ norm characterization of discrete-time linear systems. We model dynamical systems as polytope sets which are derived from multiple data-driven linear models obtained by the finite approximation of the Koopman operator and then used to design robust feedback controllers combined with the $\mathcal{H}_2$ norm characterization. The use of the $\mathcal{H}_2$ norm characterization is aimed to deal with the model uncertainty that arises due to the nature of the data-driven setting of the problem. The effectiveness of the proposed controller synthesis is investigated through numerical simulations., Comment: 6 pages, 6 figures

Bondi-like (single-null) characteristic formulations of general relativity are used for numerical work in both asymptotically flat and anti-de Sitter spacetimes. Well-posedness of the resulting systems of partial differential equations, however, remains an open question. The answer to this question affects accuracy, and potentially the reliability of conclusions drawn from numerical studies based on such formulations. A numerical approximation can converge to the continuum limit only for well-posed systems; for the initial value problem in the $L^2$ norm this is characterized by strong hyperbolicity. We find that, due to a shared pathological structure, the systems arising from the aforementioned formulations are however only weakly hyperbolic. We present numerical tests for toy models that demonstrate the consequence of this shortcoming in practice for the characteristic initial boundary value problem. Working with alternative norms in which our model problems may be well-posed we show that convergence may be recovered. Finally we examine well-posedness of a model for Cauchy-Characteristic-Matching in which model symmetric and weakly hyperbolic systems communicate through an interface, with the latter playing the role of GR in Bondi gauge on characteristic slices. We find that, due to the incompatibility of the norms associated with the two systems, the composite problem does not naturally admit energy estimates., Comment: 19 pages, 7 figures, updated to match published version

We study residual polynomials, $R_{x_0,n}^{(\mathfrak{e})}$, $\mathfrak{e}\subset\mathbb{R}$, $x_0\in\mathbb{R}\setminus\mathfrak{e}$, which are the degree at most $n$ polynomials with $R(x_0)=1$ that minimize the $\sup$ norm on $\mathfrak{e}$. New are upper bounds on their norms (that are optimal in some cases) and Szeg\H{o}--Widom asymptotics under fairly general circumstances. We also discuss several illuminating examples and some results in the complex case., Comment: 30 pages

This paper introduces a framework for learning a minimum-norm stabilizing controller for a system with unknown dynamics using model-free policy optimization methods. The approach begins by first designing a Control Lyapunov Function (CLF) for a (possibly inaccurate) dynamics model for the system, along with a function which specifies a minimum acceptable rate of energy dissipation for the CLF at different points in the state-space. Treating the energy dissipation condition as a constraint on the desired closed-loop behavior of the real-world system, we use penalty methods to formulate an unconstrained optimization problem over the parameters of a learned controller, which can be solved using model-free policy optimization algorithms using data collected from the plant. We discuss when the optimization learns a stabilizing controller for the real world system and derive conditions on the structure of the learned controller which ensure that the optimization is strongly convex, meaning the globally optimal solution can be found reliably. We validate the approach in simulation, first for a double pendulum, and then generalize the framework to learn stable walking controllers for underactuated bipedal robots using the Hybrid Zero Dynamics framework. By encoding a large amount of structure into the learning problem, we are able to learn stabilizing controllers for both systems with only minutes or even seconds of training data.

We introduce a new method for constructing solenoidal extensions of fairly general boundary data in (2d or 3d) cubes that contain an obstacle. This method allows us to provide explicit bounds for the Dirichlet norm of the extensions. It runs as follows: by inverting the trace operator, we first determine suitable extensions, not necessarily solenoidal, of the data; then we analyze the Bogovskii problem with the resulting divergence to obtain a solenoidal extension; finally, by solving a variational problem involving the infinity-Laplacian and using ad hoc cutoff functions, we find explicit bounds in terms of the geometric parameters of the obstacle. The natural applications of our results lie in the analysis of inflow–outflow problems, in which an explicit bound on the inflow velocity is needed to estimate the threshold for uniqueness in the stationary Navier–Stokes equations and, in case of symmetry, the stability of the obstacle immersed in the fluid flow.