Back to Search Start Over

TKAP: Efficiently processing top- k query on massive data by adaptive pruning.

Authors :
Han, Xixian
Liu, Xianmin
Li, Jianzhong
Gao, Hong
Source :
Knowledge & Information Systems; May2016, Vol. 47 Issue 2, p301-328, 28p
Publication Year :
2016

Abstract

In many applications, top- k query is an important operation to return a set of interesting points in a potentially huge data space. The existing algorithms, either maintaining too many candidates, or requiring assistant structures built on the specific attribute subset, or returning results with probabilistic guarantee, cannot process top- k query on massive data efficiently. This paper proposes a sorted-list-based TKAP algorithm, which utilizes some data structures of low space overhead, to efficiently compute top- k results on massive data. In round-robin retrieval on sorted lists, TKAP performs adaptive pruning operation and maintains the required candidates until the stop condition is satisfied. The adaptive pruning operation can be adjusted by the information obtained in round-robin retrieval to achieve a better pruning effect. The adaptive pruning rule is developed in this paper, along with its theoretical analysis. The extensive experimental results, conducted on synthetic and real-life data sets, show the significant advantage of TKAP over the existing algorithms. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
02191377
Volume :
47
Issue :
2
Database :
Complementary Index
Journal :
Knowledge & Information Systems
Publication Type :
Academic Journal
Accession number :
113880567
Full Text :
https://doi.org/10.1007/s10115-015-0836-5