Back to Search Start Over

A GPU-Aware Parallel Index for Processing High-Dimensional Big Data.

Authors :
Kim, Mincheol
Liu, Ling
Choi, Wonik
Source :
IEEE Transactions on Computers. Oct2018, Vol. 67 Issue 10, p1388-1402. 15p.
Publication Year :
2018

Abstract

The problem of the curse of dimensionality for processing large high-dimensional datasets has been an open challenge. Numerous research efforts have been proposed for improving query performance in high-dimensional space through hierarchical indexing using the R-tree or its variants and exploring parallel processing of the R-tree on GPUs. Despite these existing efforts, the curse of dimensionality remains to be a grand challenge since the existing methods deteriorate drastically as the dimensionality of datasets increases. To cope with this problem, we present a novel GPU-aware parallel indexing method called G-tree, which offers consistent and stable performance in high-dimensional space. The rationale of the G-tree is to combine the efficiency of the R-tree in low-dimensional space with the massive parallel processing potential of GPUs by introducing a new data structure and three new optimization techniques to better utilize the GPU memory structure for accelerating both index search and index node access on GPUs. The first two optimizations promote effective parallelism utilization in GPU memory access. We dedicate the third optimization to further speed up the G-tree index by conducting progressive filtering using our dimension filters. We evaluate the validity of the G-tree approach by extensive experiments on high-dimensional datasets, showing that the G-tree outperforms the existing state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00189340
Volume :
67
Issue :
10
Database :
Academic Search Index
Journal :
IEEE Transactions on Computers
Publication Type :
Academic Journal
Accession number :
131635138
Full Text :
https://doi.org/10.1109/TC.2018.2823760