Back to Search Start Over

Parallel query processing in a polystore.

Authors :
Kranas, Pavlos
Kolev, Boyan
Levchenko, Oleksandra
Pacitti, Esther
Valduriez, Patrick
Jiménez-Peris, Ricardo
Patiño-Martinez, Marta
Source :
Distributed & Parallel Databases; Dec2021, Vol. 39 Issue 4, p939-977, 39p
Publication Year :
2021

Abstract

The blooming of different data stores has made polystores a major topic in the cloud and big data landscape. As the amount of data grows rapidly, it becomes critical to exploit the inherent parallel processing capabilities of underlying data stores and data processing platforms. To fully achieve this, a polystore should: (i) preserve the expressivity of each data store's native query or scripting language and (ii) leverage a distributed architecture to enable parallel data integration, i.e. joins, on top of parallel retrieval of underlying partitioned datasets. In this paper, we address these points by: (i) using the polyglot approach of the CloudMdsQL query language that allows native queries to be expressed as inline scripts and combined with SQL statements for ad-hoc integration and (ii) incorporating the approach within the LeanXcale distributed query engine, thus allowing for native scripts to be processed in parallel at data store shards. In addition, (iii) efficient optimization techniques, such as bind join, can take place to improve the performance of selective joins. We evaluate the performance benefits of exploiting parallelism in combination with high expressivity and optimization through our experimental validation. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09268782
Volume :
39
Issue :
4
Database :
Complementary Index
Journal :
Distributed & Parallel Databases
Publication Type :
Academic Journal
Accession number :
153186490
Full Text :
https://doi.org/10.1007/s10619-021-07322-5