Back to Search Start Over

DESIGN BASED INCOMPLETE U-STATISTICS.

Authors :
Xiangshun Kong
Wei Zheng
Source :
Statistica Sinica; 2021, Vol. 31 Issue 3, p1593-1618, 33p, 1 Chart
Publication Year :
2021

Abstract

U-statistics are widely used in fields such as economics, machine learning, and statistics. However, while they enjoy desirable statistical properties, they have an obvious drawback in that the computation becomes impractical as the data size n increases. Specifically, the number of combinations, say m, that a U-statistic of order d has to evaluate is O(n<superscript>d</superscript>). Many efforts have been made to approximate the original U-statistic using a small subset of combinations since Blom (1976), who referred to such an approximation as an incomplete U-statistic. To the best of our knowledge, all existing methods require m to grow at least faster than n, albeit more slowly than n<superscript>d</superscript>, in order for the corresponding incomplete U-statistic to be asymptotically efficient in terms of the mean squared error. In this paper, we introduce a new type of incomplete U-statistic that can be asymptotically efficient, even when m grows more slowly than n. In some cases, m is only required to grow faster than √n. Our theoretical and empirical results both show significant improvements in the statistical efficiency of the new incomplete U-statistic. [ABSTRACT FROM AUTHOR]

Subjects

Subjects :
U-statistics
MACHINE learning

Details

Language :
English
ISSN :
10170405
Volume :
31
Issue :
3
Database :
Complementary Index
Journal :
Statistica Sinica
Publication Type :
Academic Journal
Accession number :
157547334
Full Text :
https://doi.org/10.5705/ss.202019.0098