Search

We consider the estimation of a density at a fixed point under a local differential privacy constraint, where the observations are anonymised before being available for statistical inference. We propose both a privatised version of a projection density estimator as well as a kernel density estimator and derive their minimax rates under a privacy constraint. There is a twofold deterioration of the minimax rates due to the anonymisation, which we show to be unavoidable by providing lower bounds. In both estimation procedures a tuning parameter has to be chosen. We suggest a variant of the classical Goldenshluger-Lepski method for choosing the bandwidth and the cut-off dimension, respectively, and analyse its performance. It provides adaptive minimax-optimal (up to log-factors) estimators. We discuss in detail how the lower and upper bound depend on the privacy constraints, which in turn is reflected by a modification of the adaptive method.

In a circular deconvolution model we consider the fully data driven density estimation of a circular random variable where the density of the additive independent measurement error is unknown. We have at hand two independent iid samples, one of the contaminated version of the variable of interest, and the other of the additive noise. We show optimality,in an oracle and minimax sense, of a fully data-driven weighted sum of orthogonal series density estimators. Two shapes of random weights are considered, one motivated by a Bayesian approach and the other by a well known model selection method. We derive non-asymptotic upper bounds for the quadratic risk and the maximal quadratic risk over Sobolev-like ellipsoids of the fully data-driven estimator. We compute rates which can be obtained in different configurations for the smoothness of the density of interest and the error density. The rates (strictly) match the optimal oracle or minimax rates for a large variety of cases, and feature otherwise at most a deterioration by a logarithmic factor. We illustrate the performance of the fully data-driven weighted sum of orthogonal series estimators by a simulation study., 19 pages, 4 figures, 27 appendix pages

We study the non-parametric estimation of the value ${\theta}(f )$ of a linear functional evaluated at an unknown density function f with support on $R_+$ based on an i.i.d. sample with multiplicative measurement errors. The proposed estimation procedure combines the estimation of the Mellin transform of the density $f$ and a regularisation of the inverse of the Mellin transform by a spectral cut-off. In order to bound the mean squared error we distinguish several scenarios characterised through different decays of the upcoming Mellin transforms and the smoothnes of the linear functional. In fact, we identify scenarios, where a non-trivial choice of the upcoming tuning parameter is necessary and propose a data-driven choice based on a Goldenshluger-Lepski method. Additionally, we show minimax-optimality over Mellin-Sobolev spaces of the estimator., Comment: 25 pages

In the inverse Gaussian sequence space model with additional noisy observations of the operator, we derive nonasymptotic minimax radii of testing for ellipsoid-type alternatives simultaneously for both the signal detection problem (testing against zero) and the goodness-of-fit testing problem (testing against a prescribed sequence) without any regularity assumption on the null hypothesis. The radii are the maximum of two terms, each of which only depends on one of the noise levels. Interestingly, the term involving the noise level of the operator explicitly depends on the null hypothesis and vanishes in the signal detection case. The minimax radii are established by first showing a lower bound for arbitrary null hypotheses and noise levels. For the upper bound we consider two testing procedures, a direct test based on estimating the energy in the image space and an indirect test. Under mild assumptions, we prove that the testing radius of the indirect test achieves the lower bound, which shows the minimax optimality of the radius and the test. We highlight the assumptions under which the direct test also performs optimally. Furthermore, we apply a classical Bonferroni method for making both the indirect and the direct test adaptive with respect to the regularity of the alternative. The radii of the adaptive tests are deteriorated by an additional log-factor, which we show to be unavoidable. The results are illustrated considering Sobolev spaces and mildly or severely ill-posed inverse problems.

We study non-parametric estimation of an unknown density with support in R (respectively R+). The proposed estimation procedure is based on the projection on finite dimensional subspaces spanned by the Hermite (respectively the Laguerre) functions. The focus of this paper is to introduce a data-driven aggregation approach in order to deal with the upcoming bias-variance trade-off. Our novel procedure integrates the usual model selection method as a limit case. We show the oracle- and the minimax-optimality of the data-driven aggregated density estimator and hence its adaptivity. We present results of a simulation study which allow to compare the finite sample performance of the data-driven estimators using model selection compared to the new aggregation.

In a circular convolution model, we aim to infer on the density of a circular random variable using observations contaminated by an additive measurement error. We highlight the interplay of the two problems: optimal testing and quadratic functional estimation. Under general regularity assumptions, we determine an upper bound for the minimax risk of estimation for the quadratic functional. The upper bound consists of two terms, one that mimics a classical bias-variance trade-off and a second that causes the typical elbow effect in quadratic functional estimation. Using a minimax optimal estimator of the quadratic functional as a test statistic, we derive an upper bound for the nonasymptotic minimax radius of testing for nonparametric alternatives. Interestingly, the term causing the elbow effect in the estimation case vanishes in the radius of testing. We provide a matching lower bound for the testing problem. By showing that any lower bound for the testing problem also yields a lower bound for the quadratic functional estimation problem, we obtain a lower bound for the risk of estimation. Lastly, we prove a matching lower bound for the term causing the elbow effect in the estimation problem. The results are illustrated considering Sobolev spaces and ordinary or super smooth error densities.

We consider the problem of estimating the slope parameter in functional linear instrumental regression, where in the presence of an instrument W, i.e., an exogenous random function, a scalar response Y is modeled in dependence of an endogenous random function X. Assuming second order stationarity jointly for X and W a nonparametric estimator of the functional slope parameter and its derivatives is proposed based on an n-sample of (Y,X,W). In this paper the minimax optimal rate of convergence of the estimator is derived assuming that the slope parameter belongs to the well-known Sobolev space of periodic functions. We discuss the cases that the cross-covariance operator associated to the random functions X and W is finitely, infinitely or in some general form smoothing., Comment: arXiv admin note: text overlap with arXiv:0901.4266

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension reduction. The minimax optimal rate of convergence of the estimator is derived assuming a sufficiently weak dependence characterized by fast decreasing mixing coefficients. We illustrate these results by considering classical smoothness assumptions. However, the proposed estimator requires an optimal choice of a dimension parameter depending on certain characteristics of the function of interest, which are not known in practice. The main issue addressed in our work is an adaptive choice of this dimension parameter combining model selection and Lepski's method. It is inspired by the recent work of Goldenshluger and Lepski (2011). We show that this data-driven estimator can attain the lower risk bound up to a constant provided a fast decay of the mixing coefficients., Comment: 39 pages, 4 figures

In an indirect Gaussian sequence space model lower and upper bounds are derived for the concentration rate of the posterior distribution of the parameter of interest shrinking to the parameter value $\theta^\circ$ that generates the data. While this establishes posterior consistency, however, the concentration rate depends on both $\theta^\circ$ and a tuning parameter which enters the prior distribution. We first provide an oracle optimal choice of the tuning parameter, i.e., optimized for each $\theta^\circ$ separately. The optimal choice of the prior distribution allows us to derive an oracle optimal concentration rate of the associated posterior distribution. Moreover, for a given class of parameters and a suitable choice of the tuning parameter, we show that the resulting uniform concentration rate over the given class is optimal in a minimax sense. Finally, we construct a hierarchical prior that is adaptive. This means that, given a parameter $\theta^\circ$ or a class of parameters, respectively, the posterior distribution contracts at the oracle rate or at the minimax rate over the class. Notably, the hierarchical prior does not depend neither on $\theta^\circ$ nor on the given class. Moreover, convergence of the fully data-driven Bayes estimator at the oracle or at the minimax rate is established.

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed estimator is based on dimension reduction and additional thresholding. The minimax optimal rate of convergence of the estimator is derived assuming that the structural function belongs to some ellipsoids which are in a certain sense linked to the conditional expectation operator of Z given W. We illustrate these results by considering classical smoothness assumptions. However, the proposed estimator requires an optimal choice of a dimension parameter depending on certain characteristics of the unknown structural function and the conditional expectation operator of Z given W, which are not known in practice. The main issue addressed in our work is an adaptive choice of this dimension parameter using a model selection approach under the restriction that the conditional expectation operator of Z given W is smoothing in a certain sense. In this situation we develop a penalized minimum contrast estimator with randomized penalty and collection of models. We show that this data-driven estimator can attain the lower risk bound up to a constant over a wide range of smoothness classes for the structural function.

We consider the problem of estimating the value of a linear functional in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed estimator is based on dimension reduction and additional thresholding. The minimax optimal rate of convergence of the estimator is derived assuming that the structural function and the representer of the linear functional belong to some ellipsoids which are in a certain sense linked to the conditional expectation operator of Z given W. We illustrate these results by considering classical smoothness assumptions.

We consider the problem of estimating the slope parameter in functional linear regression, where scalar responses Y1,...,Yn are modeled in dependence of second order stationary random functions X1,...,Xn. An orthogonal series estimator of the functional slope parameter with additional thresholding in the Fourier domain is proposed and its performance is measured with respect to a wide range of weighted risks covering as examples the mean squared prediction error and the mean integrated squared error for derivative estimation. In this paper the minimax optimal rate of convergence of the estimator is derived over a large class of different regularity spaces for the slope parameter and of different link conditions for the covariance operator. These general results are illustrated by the particular example of the well-known Sobolev space of periodic functions as regularity space for the slope parameter and the case of finitely or infinitely smoothing covariance operator.

In this paper we consider nonparametric estimation for dependent data, where the observations do not necessarily come from a linear process. We study density estimation and also discuss associated problems in nonparametric regression using the 2-mixing dependence measure. We compare the results under 2-mixing with those derived under the assumption that the process is linear. In the context of panel time series where one observes data from several individuals, it is often too strong to assume the joint linearity of processes. Instead the methods developed in this paper enable us to quantify the dependence through 2-mixing which allows for nonlinearity. We propose an estimator of the panel mean function and obtain its rate of convergence. We show that under certain conditions the rate of convergence can be improved by allowing the number of individuals in the panel to increase with time.