1,677 results on '"Stoica, Petre"'
Search Results
2. Stoica, Petre: Das lyrische Werk
- Author
-
Cistelecan, Alexandru, primary
- Published
- 2020
- Full Text
- View/download PDF
3. Certified Inventory Control of Critical Resources
- Author
-
Hult, Ludvig, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
Inventory control is subject to service-level requirements, in which sufficient stock levels must be maintained despite an unknown demand. We propose a data-driven order policy that certifies any prescribed service level under minimal assumptions on the unknown demand process. The policy achieves this using any online learning method along with integral action. We further propose an inference method that is valid in finite samples. The properties and theoretical guarantees of the method are illustrated using both synthetic and real-world data.
- Published
- 2024
4. Two new algorithms for maximum likelihood estimation of sparse covariance matrices with applications to graphical modeling
- Author
-
Fatima, Ghania, Babu, Prabhu, and Stoica, Petre
- Subjects
Statistics - Methodology ,Electrical Engineering and Systems Science - Signal Processing - Abstract
In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first stage, we determine the sparsity pattern of the target covariance matrix (in other words the marginal independence in the covariance graph under a Gaussian graphical model) using the multiple hypothesis testing method of false discovery rate (FDR), and in the second stage we use either a block coordinate descent approach to estimate the non-zero values or a proximal distance approach that penalizes the distance between the estimated covariance graph and the target covariance matrix. Doing so gives rise to two different methods, each with its own advantage: the coordinate descent approach does not require tuning of any hyper-parameters, whereas the proximal distance approach is computationally fast but requires a careful tuning of the penalty parameter. Both methods are effective even in cases where the number of observed samples is less than the dimension of the data. For performance evaluation, we test the proposed methods on both simulated and real-world data and show that they provide more accurate estimates of the sparse covariance matrix than two state-of-the-art methods.
- Published
- 2023
5. Pearson-Matthews correlation coefficients for binary and multinary classification and hypothesis testing
- Author
-
Stoica, Petre and Babu, Prabhu
- Subjects
Electrical Engineering and Systems Science - Signal Processing ,Statistics - Machine Learning - Abstract
The Pearson-Matthews correlation coefficient (usually abbreviated MCC) is considered to be one of the most useful metrics for the performance of a binary classification or hypothesis testing method (for the sake of conciseness we will use the classification terminology throughout, but the concepts and methods discussed in the paper apply verbatim to hypothesis testing as well). For multinary classification tasks (with more than two classes) the existing extension of MCC, commonly called the $\text{R}_{\text{K}}$ metric, has also been successfully used in many applications. The present paper begins with an introductory discussion on certain aspects of MCC. Then we go on to discuss the topic of multinary classification that is the main focus of this paper and which, despite its practical and theoretical importance, appears to be less developed than the topic of binary classification. Our discussion of the $\text{R}_{\text{K}}$ is followed by the introduction of two other metrics for multinary classification derived from the multivariate Pearson correlation (MPC) coefficients. We show that both $\text{R}_{\text{K}}$ and the MPC metrics suffer from the problem of not decisively indicating poor classification results when they should, and introduce three new enhanced metrics that do not suffer from this problem. We also present an additional new metric for multinary classification which can be viewed as a direct extension of MCC.
- Published
- 2023
6. Fair principal component analysis (PCA): minorization-maximization algorithms for Fair PCA, Fair Robust PCA and Fair Sparse PCA
- Author
-
Babu, Prabhu and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Electrical Engineering and Systems Science - Signal Processing - Abstract
In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the minorization-maximization (MM) approach. The proposed algorithm relies on the relaxation of a semi-orthogonality constraint which is proved to be tight at every iteration of the algorithm. The vanilla version of the proposed algorithm requires solving a semi-definite program (SDP) at every iteration, which can be further simplified to a quadratic program by formulating the dual of the surrogate maximization problem. We also propose two important reformulations of the fair PCA problem: a) fair robust PCA -- which can handle outliers in the data, and b) fair sparse PCA -- which can enforce sparsity on the estimated fair principal components. The proposed algorithms are computationally efficient and monotonically increase their respective design objectives at every iteration. An added feature of the proposed algorithms is that they do not require the selection of any hyperparameter (except for the fair sparse PCA case where a penalty parameter that controls the sparsity has to be chosen by the user). We numerically compare the performance of the proposed methods with two of the state-of-the-art approaches on synthetic data sets and a real-life data set.
- Published
- 2023
7. Low-rank covariance matrix estimation for factor analysis in anisotropic noise: application to array processing and portfolio selection
- Author
-
Stoica, Petre and Babu, Prabhu
- Subjects
Statistics - Methodology ,Electrical Engineering and Systems Science - Signal Processing - Abstract
Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + {\Sigma}, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and {\Sigma} is the diagonal matrix of the noise. When the noise is anisotropic (aka nonuniform in the signal processing literature and heteroscedastic in the statistical literature), the diagonal elements of {\Sigma} cannot be assumed to be identical and they must be estimated jointly with the elements of SS'. The problem of estimating SS' and {\Sigma} in the above covariance model is the central theme of the present paper. After stating this problem in a more formal way, we review the main existing algorithms for solving it. We then go on to show that these algorithms have reliability issues (such as lack of convergence or convergence to infeasible solutions) and therefore they may not be the best possible choice for practical applications. Next we explain how to modify one of these algorithms to improve its convergence properties and we also introduce a new method that we call FAAN (Factor Analysis for Anisotropic Noise). FAAN is a coordinate descent algorithm that iteratively maximizes the normal likelihood function, which is easy to implement in a numerically efficient manner and has excellent convergence properties as illustrated by the numerical examples presented in the paper. Out of the many possible applications of FAAN we focus on the following two: direction-of-arrival (DOA) estimation using array signal processing techniques and portfolio selection for financial asset management.
- Published
- 2023
- Full Text
- View/download PDF
8. Off-Policy Evaluation with Out-of-Sample Guarantees
- Author
-
Ek, Sofia, Zachariah, Dave, Johansson, Fredrik D., and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
We consider the problem of evaluating the performance of a decision policy using past observational data. The outcome of a policy is measured in terms of a loss (aka. disutility or negative reward) and the main problem is making valid inferences about its out-of-sample loss when the past data was observed under a different and possibly unknown policy. Using a sample-splitting method, we show that it is possible to draw such inferences with finite-sample coverage guarantees about the entire loss distribution, rather than just its mean. Importantly, the method takes into account model misspecifications of the past policy - including unmeasured confounding. The evaluation method can be used to certify the performance of a policy using observational data under a specified range of credible model assumptions.
- Published
- 2023
9. Monte-Carlo Sampling Approach to Model Selection: A Primer
- Author
-
Stoica, Petre, Shang, Xiaolei, and Cheng, Yuanbo
- Subjects
Statistics - Methodology ,Electrical Engineering and Systems Science - Signal Processing - Abstract
Any data modeling exercise has two main components: parameter estimation and model selection. The latter will be the topic of this lecture note. More concretely we will introduce several Monte-Carlo sampling-based rules for model selection using the maximum a posteriori (MAP) approach. Model selection problems are omnipresent in signal processing applications: examples include selecting the order of an autoregressive predictor, the length of the impulse response of a communication channel, the number of source signals impinging on an array of sensors, the order of a polynomial trend, the number of components of a NMR signal, and so on.
- Published
- 2022
- Full Text
- View/download PDF
10. The Cramer-Rao Bound for Signal Parameter Estimation from Quantized Data
- Author
-
Stoica, Petre, Shang, Xiaolei, and Cheng, Yuanbo
- Subjects
Electrical Engineering and Systems Science - Signal Processing - Abstract
Several current ultra-wide band applications, such as millimeter wave radar and communication systems, require high sampling rates and therefore expensive and energy-hungry analogto-digital converters (ADCs). In applications where cost and power constraints exist, the use of high-precision ADCs is not feasible and the designer must resort to ADCs with coarse quantization. Consequently the interest in the topic of signal parameter estimation from quantized data has increased significantly in recent years. The Cramer-Rao bound (CRB) is an important yardstick in any parameter estimation problem. Indeed it lower bounds the variance of any unbiased parameter estimator. Moreover, the CRB is an achievable limit, for instance it is asymptotically attained by the maximum likelihood estimator (under regularity conditions), and thus it is a useful benchmark to which the accuracy of any parameter estimator can and should be compared. A formula for the CRB for signal parameter estimation from real-valued quantized data has been presented in but its derivation was somewhat sketchy. The said CRB formula has been extended for instance in to complex-valued quantized data, but again its derivation was rather sketchy. The special case of binary (1-bit) ADCs and a signal consisting of one sinusoid has been thoroughly analyzed in . The CRB formula for a binary ADC and a general real-valued signal has been derived.
- Published
- 2022
- Full Text
- View/download PDF
11. MIMO Multifunction RF Systems: Detection Performance and Waveform Design
- Author
-
Tang, Bo and Stoica, Petre
- Subjects
Computer Science - Information Theory ,Electrical Engineering and Systems Science - Signal Processing - Abstract
This paper studies the detection performance of a multiple-input-multiple-output (MIMO) multifunction radio frequency (MFRF) system, which simultaneously supports radar, communication, and jamming. We show that the detection performance of the MIMO MFRF system improves as the transmit signal-to-interference-plus-noise-ratio (SINR) increases. To analyze the achievable SINR of the system, we formulate an SINR maximization problem under the communication and jamming functionality constraint as well as a transmit energy constraint. We derive a closed-form solution of this optimization problem for energy-constrained waveforms and present a detailed analysis of the achievable SINR. Moreover, we analyze the SINR for systems transmitting constant-modulus waveforms, which are often used in practice. We propose an efficient constant-modulus waveform design algorithm to maximize the SINR. Numerical results demonstrate the capability of a MIMO array to provide multiple functions, and also show the tradeoff between radar detection and the communication/jamming functionality.
- Published
- 2022
- Full Text
- View/download PDF
12. Diagnostic Tool for Out-of-Sample Model Evaluation
- Author
-
Hult, Ludvig, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
Assessment of model fitness is a key part of machine learning. The standard paradigm is to learn models by minimizing a chosen loss function averaged over training data, with the aim of achieving small losses on future data. In this paper, we consider the use of a finite calibration data set to characterize the future, out-of-sample losses of a model. We propose a simple model diagnostic tool that provides finite-sample guarantees under weak assumptions. The tool is simple to compute and to interpret. Several numerical experiments are presented to show how the proposed method quantifies the impact of distribution shifts, aids the analysis of regression, and enables model selection as well as hyper-parameter tuning., Comment: updates mainly for readability. some more experimental details in appendix. some connection to VaR added in discussion
- Published
- 2022
13. Pearson–Matthews correlation coefficients for binary and multinary classification
- Author
-
Stoica, Petre and Babu, Prabhu
- Published
- 2024
- Full Text
- View/download PDF
14. Learning Sparse Graphs via Majorization-Minimization for Smooth Node Signals
- Author
-
Fatima, Ghania, Arora, Aakash, Babu, Prabhu, and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing ,Computer Science - Machine Learning - Abstract
In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the principle of majorization-minimization (MM), wherein we first obtain a tight surrogate function for the graph learning objective and then solve the resultant surrogate problem which has a simple closed form solution. The proposed algorithm does not require tuning of any hyperparameter and it has the desirable feature of eliminating the inactive variables in the course of the iterations - which can help speeding up the algorithm. The numerical simulations conducted using both synthetic and real world (brain-network) data show that the proposed algorithm converges faster, in terms of the average number of iterations, than several existing methods in the literature.
- Published
- 2022
- Full Text
- View/download PDF
15. Tuned Regularized Estimators for Linear Regression via Covariance Fitting
- Author
-
Mattsson, Per, Zachariah, Dave, and Stoica, Petre
- Subjects
Mathematics - Statistics Theory ,Statistics - Machine Learning - Abstract
We consider the problem of finding tuned regularized parameter estimators for linear models. We start by showing that three known optimal linear estimators belong to a wider class of estimators that can be formulated as a solution to a weighted and constrained minimization problem. The optimal weights, however, are typically unknown in many applications. This begs the question, how should we choose the weights using only the data? We propose using the covariance fitting SPICE-methodology to obtain data-adaptive weights and show that the resulting class of estimators yields tuned versions of known regularized estimators - such as ridge regression, LASSO, and regularized least absolute deviation. These theoretical results unify several important estimators under a common umbrella. The resulting tuned estimators are also shown to be practically relevant by means of a number of numerical examples.
- Published
- 2022
- Full Text
- View/download PDF
16. Stoica, Petre: Das lyrische Werk
- Author
-
Alexandru Cistelecan
- Subjects
media_common.quotation_subject ,Art ,media_common - Published
- 2020
17. Stoica, Petre
- Author
-
Alexandru Cistelecan
- Published
- 2020
18. Learning Pareto-Efficient Decisions with Confidence
- Author
-
Ek, Sofia, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
The paper considers the problem of multi-objective decision support when outcomes are uncertain. We extend the concept of Pareto-efficient decisions to take into account the uncertainty of decision outcomes across varying contexts. This enables quantifying trade-offs between decisions in terms of tail outcomes that are relevant in safety-critical applications. We propose a method for learning efficient decisions with statistical confidence, building on results from the conformal prediction literature. The method adapts to weak or nonexistent context covariate overlap and its statistical guarantees are evaluated using both synthetic and real data.
- Published
- 2021
19. Robust Learning in Heterogeneous Contexts
- Author
-
Osama, Muhammad, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of the context distribution. Unlike the conventional and overly conservative minimax approach, we focus on excess risks and construct distribution sets with statistical coverage to achieve an appropriate trade-off between performance and robustness. The proposed method is computationally scalable and shown to interpolate between empirical risk minimization and minimax regret objectives. Using both real and synthetic data, we demonstrate its ability to provide robustness in worst-case scenarios without harming performance in the nominal scenario., Comment: Paper under SPL review
- Published
- 2021
20. Weighted SPICE Algorithms for Range-Doppler Imaging Using One-Bit Automotive Radar
- Author
-
Shang, Xiaolei, Li, Jian, and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing - Abstract
We consider the problem of range-Doppler imaging using one-bit automotive LFMCW1 or PMCW radar that utilizes one-bit ADC sampling with time-varying thresholds at the receiver. The one-bit sampling technique can significantly reduce the cost as well as the power consumption of automotive radar systems. We formulate the one-bit LFMCW/PMCW radar rangeDoppler imaging problem as one-bit sparse parameter estimation. The recently proposed hyperparameter-free (and hence user friendly) weighted SPICE algorithms, including SPICE, LIKES, SLIM and IAA, achieve excellent parameter estimation performance for data sampled with high precision. However, these algorithms cannot be used directly for one-bit data. In this paper we first present a regularized minimization algorithm, referred to as 1bSLIM, for accurate range-Doppler imaging using onebit radar systems. Then, we describe how to extend the SPICE, LIKES and IAA algorithms to the one-bit data case, and refer to these extensions as 1bSPICE, 1bLIKES and 1bIAA. These onebit hyperparameter-free algorithms are unified within the one-bit weighted SPICE framework. Moreover, efficient implementations of the aforementioned algorithms are investigated that rely heavily on the use of FFTs. Finally, both simulated and experimental examples are provided to demonstrate the effectiveness of the proposed algorithms for range-Doppler imaging using one-bit automotive radar systems.
- Published
- 2021
- Full Text
- View/download PDF
21. Sinusoidal Parameter Estimation from Signed Measurements via Majorization-Minimization Based RELAX
- Author
-
Ren, Jiaying, Zhang, Tianyi, Li, Jian, and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing - Abstract
We consider the problem of sinusoidal parameter estimation using signed observations obtained via one-bit sampling with fixed as well as time-varying thresholds. In a previous paper, a relaxation-based algorithm, referred to as 1bRELAX, has been proposed to iteratively maximize the likelihood function. However, the exhaustive search procedure used in each iteration of 1bRELAX is time-consuming. In this paper, we present a majorization-minimization (MM) based 1bRELAX algorithm, referred to as 1bMMRELAX, to enhance the computational efficiency of 1bRELAX. Using the MM technique, 1bMMRELAX maximizes the likelihood function iteratively using simple FFT operations instead of the more computationally intensive search used by 1bRELAX. Both simulated and experimental results are presented to show that 1bMMRELAX can significantly reduce the computational cost of 1bRELAX while maintaining its excellent estimation accuracy.
- Published
- 2021
22. Joint RFI Mitigation and Radar Echo Recovery for One-Bit UWB Radar
- Author
-
Zhang, Tianyi, Ren, Jiaying, Li, Jian, Nguyen, Lam H., and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing - Abstract
Radio frequency interference (RFI) mitigation and radar echo recovery are critically important for the proper functioning of ultra-wideband (UWB) radar systems using one-bit sampling techniques. We recently introduced a technique for one-bit UWB radar, which first uses a majorization-minimization method for RFI parameter estimation followed by a sparse method for radar echo recovery. However, this technique suffers from high computational complexity due to the need to estimate the parameters of each RFI source separately and iteratively. In this paper, we present a computationally efficient joint RFI mitigation and radar echo recovery framework to greatly reduce the computational cost. Specifically, we exploit the sparsity of RFI in the fast-frequency domain and the sparsity of radar echoes in the fast-time domain to design a one-bit weighted SPICE (SParse Iterative Covariance-based Estimation) based framework for the joint RFI mitigation and radar echo recovery of one-bit UWB radar. Both simulated and experimental results are presented to show that the proposed one-bit weighted SPICE framework can not only reduce the computational cost but also outperform the existing approach for decoupled RFI mitigation and radar echo recovery of one-bit UWB radar., Comment: arXiv admin note: text overlap with arXiv:2102.08987
- Published
- 2021
23. RFI Mitigation for One-bit UWB Radar Systems
- Author
-
Zhang, Tianyi, Ren, Jiaying, Li, Jian, Nguyen, Lam H., and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing - Abstract
Radio frequency interference (RFI) mitigation is critical to the proper operation of ultra-wideband (UWB) radar systems since RFI can severely degrade the radar imaging capability and target detection performance. In this paper, we address the RFI mitigation problem for one-bit UWB radar systems. A one-bit UWB system obtains its signed measurements via a low-cost and high rate sampling scheme, referred to as the Continuous Time Binary Value (CTBV) technology. This sampling strategy compares the signal to a known threshold varying with slow-time and therefore can be used to achieve a rather high sampling rate and quantization resolution with rather simple and affordable hardware. This paper establishes a proper data model for the RFI sources and proposes a novel RFI mitigation method for the one-bit UWB radar system that uses the CTBV sampling technique. Specifically, we first model the RFI sources as a sum of sinusoids with frequencies fixed during the coherent processing interval (CPI) and we exploit the sparsity of the RFI spectrum. We extend a majorization-minimization based 1bRELAX algorithm, referred to as 1bMMRELAX, to estimate the RFI source parameters from the signed measurements obtained by using the CTBV sampling strategy. We also devise a new fast frequency initialization method based on the Alternating Direction Method of Multipliers (ADMM) methodology for the extended 1bMMRELAX algorithm to significantly improve its computational efficiency. Moreover, an ADMM-based sparse method is introduced to recover the desired radar echoes using the estimated RFI parameters. Both simulated and experimental results are presented to demonstrate that our proposed algorithm outperforms the existing digital integration method, especially for severe RFI cases.
- Published
- 2021
24. Robust Localization in Wireless Networks From Corrupted Signals
- Author
-
Osama, Muhammad, Zachariah, Dave, Dwivedi, Satyam, and Stoica, Petre
- Subjects
Computer Science - Information Theory ,Computer Science - Machine Learning ,Electrical Engineering and Systems Science - Signal Processing ,Statistics - Applications - Abstract
We address the problem of timing-based localization in wireless networks, when an unknown fraction of data is corrupted by nonideal signal conditions. While timing-based techniques enable accurate localization, they are also sensitive to such corrupted data. We develop a robust method that is applicable to a range of localization techniques, including time-of-arrival, time-difference-of-arrival and time-difference in schedule-based transmissions. The method is nonparametric and requires only an upper bound on the fraction of corrupted data, thus obviating distributional assumptions of the corrupting noise distribution. The robustness of the method is demonstrated in numerical experiments.
- Published
- 2020
- Full Text
- View/download PDF
25. Prediction of Spatial Point Processes: Regularized Method with Out-of-Sample Guarantees
- Author
-
Osama, Muhammad, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
A spatial point process can be characterized by an intensity function which predicts the number of events that occur across space. In this paper, we develop a method to infer predictive intensity intervals by learning a spatial model using a regularized criterion. We prove that the proposed method exhibits out-of-sample prediction performance guarantees which, unlike standard estimators, are valid even when the spatial model is misspecified. The method is demonstrated using synthetic as well as real spatial data.
- Published
- 2020
26. Robust Prediction when Features are Missing
- Author
-
Liu, Xiuming, Zachariah, Dave, and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing ,Computer Science - Machine Learning - Abstract
Predictors are learned using past training data which may contain features that are unavailable at the time of prediction. We develop an approach that is robust against outlying missing features, based on the optimality properties of an oracle predictor which observes them. The robustness properties of the approach are demonstrated on both real and synthetic data.
- Published
- 2019
- Full Text
- View/download PDF
27. Max-Min Fairness Design for MIMO Interference Channels: a Minorization-Maximization Approach
- Author
-
Naghsh, Mohammad Mahdi, Masjedi, Maryam, Adibi, Arman, and Stoica, Petre
- Subjects
Electrical Engineering and Systems Science - Signal Processing ,Computer Science - Social and Information Networks ,Electrical Engineering and Systems Science - Systems and Control ,Mathematics - Optimization and Control ,Statistics - Applications - Abstract
We address the problem of linear precoder (beamformer) design in a multiple-input multiple-output interference channel (MIMO-IC). The aim is to design the transmit covariance matrices in order to achieve max-min utility fairness for all users. The corresponding optimization problem is non-convex and NP-hard in general. We devise an efficient algorithm based on the minorization-maximization (MM) technique to obtain quality solutions to this problem. The proposed method solves a second-order cone convex program (SOCP) at each iteration. We prove that the devised method converges to stationary points of the problem. We also extend our algorithm to the case where there are uncertainties in the noise covariance matrices or channel state information (CSI). Simulation results show the effectiveness of the proposed method compared with its main competitor.
- Published
- 2019
- Full Text
- View/download PDF
28. Effect Inference from Two-Group Data with Sampling Bias
- Author
-
Zachariah, Dave and Stoica, Petre
- Subjects
Mathematics - Statistics Theory ,Statistics - Machine Learning - Abstract
In many applications, different populations are compared using data that are sampled in a biased manner. Under sampling biases, standard methods that estimate the difference between the population means yield unreliable inferences. Here we develop an inference method that is resilient to sampling biases and is able to control the false positive errors under moderate bias levels in contrast to the standard approach. We demonstrate the method using synthetic and real biomarker data.
- Published
- 2019
- Full Text
- View/download PDF
29. Data Consistency Approach to Model Validation
- Author
-
Svensson, Andreas, Zachariah, Dave, Stoica, Petre, and Schön, Thomas B.
- Subjects
Statistics - Methodology ,Electrical Engineering and Systems Science - Signal Processing ,Statistics - Computation ,Statistics - Machine Learning - Abstract
In scientific inference problems, the underlying statistical modeling assumptions have a crucial impact on the end results. There exist, however, only a few automatic means for validating these fundamental modelling assumptions. The contribution in this paper is a general criterion to evaluate the consistency of a set of statistical models with respect to observed data. This is achieved by automatically gauging the models' ability to generate data that is similar to the observed data. Importantly, the criterion follows from the model class itself and is therefore directly applicable to a broad range of inference problems with varying data types, ranging from independent univariate data to high-dimensional time-series. The proposed data consistency criterion is illustrated, evaluated and compared to several well-established methods using three synthetic and two real data sets.
- Published
- 2018
30. Joint RFI mitigation and radar echo recovery for one-bit UWB radar
- Author
-
Zhang, Tianyi, Ren, Jiaying, Li, Jian, Nguyen, Lam H., and Stoica, Petre
- Published
- 2022
- Full Text
- View/download PDF
31. Model-Robust Counterfactual Prediction Method
- Author
-
Zachariah, Dave and Stoica, Petre
- Subjects
Mathematics - Statistics Theory ,Statistics - Machine Learning - Abstract
We develop a novel method for counterfactual analysis based on observational data using prediction intervals for units under different exposures. Unlike methods that target heterogeneous or conditional average treatment effects of an exposure, the proposed approach aims to take into account the irreducible dispersions of counterfactual outcomes so as to quantify the relative impact of different exposures. The prediction intervals are constructed in a distribution-free and model-robust manner based on the conformal prediction approach. The computational obstacles to this approach are circumvented by leveraging properties of a tuning-free method that learns sparse additive predictor models for counterfactual outcomes. The method is illustrated using both real and synthetic data.
- Published
- 2017
32. Online Learning for Distribution-Free Prediction
- Author
-
Zachariah, Dave, Stoica, Petre, and Schön, Thomas B.
- Subjects
Computer Science - Learning ,Statistics - Computation ,Statistics - Machine Learning - Abstract
We develop an online learning method for prediction, which is important in problems with large and/or streaming data sets. We formulate the learning approach using a covariance-fitting methodology, and show that the resulting predictor has desirable computational and distribution-free properties: It is implemented online with a runtime that scales linearly in the number of samples; has a constant memory requirement; avoids local minima problems; and prunes away redundant feature dimensions without relying on restrictive assumptions on the data distribution. In conjunction with the split conformal approach, it also produces distribution-free prediction confidence intervals in a computationally efficient manner. The method is demonstrated on both real and synthetic datasets.
- Published
- 2017
33. PUMA criterion = MODE criterion
- Author
-
Zachariah, Dave, Stoica, Petre, and Jansson, Magnus
- Subjects
Statistics - Other Statistics - Abstract
We show that the recently proposed (enhanced) PUMA estimator for array processing minimizes the same criterion function as the well-established MODE estimator. (PUMA = principal-singular-vector utilization for modal analysis, MODE = method of direction estimation.)
- Published
- 2017
- Full Text
- View/download PDF
34. Pearson information-based lower bound on Fisher information
- Author
-
Zachariah, Dave and Stoica, Petre
- Subjects
Mathematics - Statistics Theory - Abstract
The Fisher information matrix (FIM) plays an important role in the analysis of parameter inference and system design problems. In a number of cases, however, the statistical data distribution and its associated information matrix are either unknown or intractable. For this reason, it is of interest to develop useful lower bounds on the FIM. In this lecture note, we derive such a bound based on moment constraints. We call this bound the Pearson information matrix (PIM) and relate it to properties of a misspecified data distribution. Finally, we show that the inverse PIM coincides with the asymptotic covariance matrix of the optimally weighted generalized method of moments.
- Published
- 2016
35. Sparse Methods for Direction-of-Arrival Estimation
- Author
-
Yang, Zai, Li, Jian, Stoica, Petre, and Xie, Lihua
- Subjects
Computer Science - Information Theory - Abstract
Direction-of-arrival (DOA) estimation refers to the process of retrieving the direction information of several electromagnetic waves/sources from the outputs of a number of receiving antennas that form a sensor array. DOA estimation is a major problem in array signal processing and has wide applications in radar, sonar, wireless communications, etc. With the development of sparse representation and compressed sensing, the last decade has witnessed a tremendous advance in this research topic. The purpose of this article is to provide an overview of these sparse methods for DOA estimation, with a particular highlight on the recently developed gridless sparse methods, e.g., those based on covariance fitting and the atomic norm. Several future research directions are also discussed., Comment: 65 pages, overview article
- Published
- 2016
36. Recursive nonlinear-system identification using latent variables
- Author
-
Mattsson, Per, Zachariah, Dave, and Stoica, Petre
- Subjects
Statistics - Machine Learning - Abstract
In this paper we develop a method for learning nonlinear systems with multiple outputs and inputs. We begin by modelling the errors of a nominal predictor of the system using a latent variable framework. Then using the maximum likelihood principle we derive a criterion for learning the model. The resulting optimization problem is tackled using a majorization-minimization approach. Finally, we develop a convex majorization technique and show that it enables a recursive identification method. The method learns parsimonious predictive models and is tested on both synthetic and real nonlinear systems., Comment: 10 pages, 4 figures
- Published
- 2016
37. Prediction performance after learning in Gaussian process regression
- Author
-
Wågberg, Johan, Zachariah, Dave, Schön, Thomas B., and Stoica, Petre
- Subjects
Statistics - Machine Learning - Abstract
This paper considers the quantification of the prediction performance in Gaussian process regression. The standard approach is to base the prediction error bars on the theoretical predictive variance, which is a lower bound on the mean square-error (MSE). This approach, however, does not take into account that the statistical model is learned from the data. We show that this omission leads to a systematic underestimation of the prediction errors. Starting from a generalization of the Cram\'er-Rao bound, we derive a more accurate MSE bound which provides a measure of uncertainty for prediction of Gaussian processes. The improved bound is easily computed and we illustrate it using synthetic and real data examples. of uncertainty for prediction of Gaussian processes and illustrate it using synthetic and real data examples., Comment: 14 pages, 8 figures
- Published
- 2016
38. Scalable and Passive Wireless Network Clock Synchronization
- Author
-
Zachariah, Dave, Dwivedi, Satyam, Händel, Peter, and Stoica, Petre
- Subjects
Computer Science - Networking and Internet Architecture - Abstract
Clock synchronization is ubiquitous in wireless systems for communication, sensing and control. In this paper we design a scalable system in which an indefinite number of passively receiving wireless units can synchronize to a single master clock at the level of discrete clock ticks. Accurate synchronization requires an estimate of the node positions. If such information is available the framework developed here takes position uncertainties into account. In the absence of such information we propose a mechanism which enables simultaneous synchronization and positioning. Furthermore we derive the Cramer-Rao bounds for the system which show that it enables synchronization accuracy at sub-nanosecond levels. Finally, we develop and evaluate an online estimation method which is statistically efficient.
- Published
- 2016
- Full Text
- View/download PDF
39. Information-theoretic waveform design for MIMO radar detection in range-spread clutter
- Author
-
Tang, Bo and Stoica, Petre
- Published
- 2021
- Full Text
- View/download PDF
40. Comparing Methods and Defining Practical Requirements for Extracting Harmonic Tidal Components from Groundwater Level Measurements
- Author
-
Schweizer, Daniel, Ried, Vincent, Rau, Gabriel C., Tuck, Jonathan E., and Stoica, Petre
- Published
- 2021
- Full Text
- View/download PDF
41. Two New Algorithms for Maximum Likelihood Estimation of Sparse Covariance Matrices With Applications to Graphical Modeling
- Author
-
Fatima, Ghania, Babu, Prabhu, Stoica, Petre, Fatima, Ghania, Babu, Prabhu, and Stoica, Petre
- Abstract
In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state-of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first stage, we determine the sparsity pattern of the target covariance matrix (in other words the marginal independence in the covariance graph under a Gaussian graphical model) using the multiple hypothesis testing method of false discovery rate (FDR), and in the second stage we use either a block coordinate descent approach to estimate the non-zero values or a proximal distance approach that penalizes the distance between the estimated covariance graph and the target covariance matrix. Doing so gives rise to two different methods, each with its own advantage: the coordinate descent approach does not require tuning of any hyper-parameters, whereas the proximal distance approach is computationally fast but requires a careful tuning of the penalty parameter. Both methods are effective even in cases where the number of observed samples is less than the dimension of the data. For performance evaluation, we test the proposed methods on both simulated and real-world data and show that they provide more accurate estimates of the sparse covariance matrix than the state-of-the-art methods.
- Published
- 2024
- Full Text
- View/download PDF
42. Vandermonde Decomposition of Multilevel Toeplitz Matrices with Application to Multidimensional Super-Resolution
- Author
-
Yang, Zai, Xie, Lihua, and Stoica, Petre
- Subjects
Computer Science - Information Theory - Abstract
The Vandermonde decomposition of Toeplitz matrices, discovered by Carath\'{e}odory and Fej\'{e}r in the 1910s and rediscovered by Pisarenko in the 1970s, forms the basis of modern subspace methods for 1D frequency estimation. Many related numerical tools have also been developed for multidimensional (MD), especially 2D, frequency estimation; however, a fundamental question has remained unresolved as to whether an analog of the Vandermonde decomposition holds for multilevel Toeplitz matrices in the MD case. In this paper, an affirmative answer to this question and a constructive method for finding the decomposition are provided when the matrix rank is lower than the dimension of each Toeplitz block. A numerical method for searching for a decomposition is also proposed when the matrix rank is higher. The new results are applied to studying MD frequency estimation within the recent super-resolution framework. A precise formulation of the atomic $\ell_0$ norm is derived using the Vandermonde decomposition. Practical algorithms for frequency estimation are proposed based on relaxation techniques. Extensive numerical simulations are provided to demonstrate the effectiveness of these algorithms compared to the existing atomic norm and subspace methods., Comment: 17 pages, double column, 5 figures, to appear in IEEE Transactions on Information Theory
- Published
- 2015
43. Online Hyperparameter-Free Sparse Estimation Method
- Author
-
Zachariah, Dave and Stoica, Petre
- Subjects
Mathematics - Statistics Theory - Abstract
In this paper we derive an online estimator for sparse parameter vectors which, unlike the LASSO approach, does not require the tuning of any hyperparameters. The algorithm is based on a covariance matching approach and is equivalent to a weighted version of the square-root LASSO. The computational complexity of the estimator is of the same order as that of the online versions of regularized least-squares (RLS) and LASSO. We provide a numerical comparison with feasible and infeasible implementations of the LASSO and RLS to illustrate the advantage of the proposed online hyperparameter-free estimator.
- Published
- 2015
- Full Text
- View/download PDF
44. Cramer-Rao bound analog of Bayes rule
- Author
-
Zachariah, Dave and Stoica, Petre
- Subjects
Mathematics - Statistics Theory - Abstract
In this lecture note, we show a general property of the Cramer-Rao bound (CRB) that quantifies the interdependencies between the parameters in a vector. The presented result is valid for more general models than the additive noise model and also generalizes previous results to vector parameters. The CRB analog to Bayes' rule will be illustrated via two examples.
- Published
- 2015
- Full Text
- View/download PDF
45. Two new algorithms for maximum likelihood estimation of sparse covariance matrices with applications to graphical modeling
- Author
-
Fatima, Ghania, primary, Babu, Prabhu, additional, and Stoica, Petre, additional
- Published
- 2024
- Full Text
- View/download PDF
46. Multiple-hypothesis testing rules for high-dimensional model selection and sparse-parameter estimation
- Author
-
Babu, Prabhu, primary and Stoica, Petre, additional
- Published
- 2023
- Full Text
- View/download PDF
47. Weighted SPICE: A Unifying Approach for Hyperparameter-Free Sparse Estimation
- Author
-
Stoica, Petre, Zachariah, Dave, and Li, Jian
- Subjects
Mathematics - Statistics Theory - Abstract
In this paper we present the SPICE approach for sparse parameter estimation in a framework that unifies it with other hyperparameter-free methods, namely LIKES, SLIM and IAA. Specifically, we show how the latter methods can be interpreted as variants of an adaptively reweighted SPICE method. Furthermore, we establish a connection between SPICE and the l1-penalized LAD estimator as well as the square-root LASSO method. We evaluate the four methods mentioned above in a generic sparse regression problem and in an array processing application.
- Published
- 2014
- Full Text
- View/download PDF
48. A Recursive Method for Enumeration of Costas Arrays
- Author
-
Soltanalian, Mojtaba and Stoica, Petre
- Subjects
Computer Science - Information Theory - Abstract
In this paper, we propose a recursive method for finding Costas arrays that relies on a particular formation of Costas arrays from similar patterns of smaller size. By using such an idea, the proposed algorithm is able to dramatically reduce the computational burden (when compared to the exhaustive search), and at the same time, still can find all possible Costas arrays of given size. Similar to exhaustive search, the proposed method can be conveniently implemented in parallel computing. The efficiency of the method is discussed based on theoretical and numerical results.
- Published
- 2014
49. Robust localization in wireless networks from corrupted signals
- Author
-
Osama, Muhammad, Zachariah, Dave, Dwivedi, Satyam, and Stoica, Petre
- Published
- 2021
- Full Text
- View/download PDF
50. Designing Unimodular Codes via Quadratic Optimization is not Always Hard
- Author
-
Soltanalian, Mojtaba and Stoica, Petre
- Subjects
Computer Science - Systems and Control ,Computer Science - Information Theory - Abstract
The NP-hard problem of optimizing a quadratic form over the unimodular vector set arises in radar code design scenarios as well as other active sensing and communication applications. To tackle this problem (which we call unimodular quadratic programming (UQP)), several computational approaches are devised and studied. A specialized local optimization scheme for UQP is introduced and shown to yield superior results compared to general local optimization methods. Furthermore, a \textbf{m}onotonically \textbf{er}ror-bound \textbf{i}mproving \textbf{t}echnique (MERIT) is proposed to obtain the global optimum or a local optimum of UQP with good sub-optimality guarantees. The provided sub-optimality guarantees are case-dependent and generally outperform the $\pi/4$ approximation guarantee of semi-definite relaxation. Several numerical examples are presented to illustrate the performance of the proposed method. The examples show that for cases including several matrix structures used in radar code design, MERIT can solve UQP efficiently in the sense of sub-optimality guarantee and computational time.
- Published
- 2013
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.