Back to Search Start Over

PaMeCo join: A parallel main memory compact hash join.

Authors :
Begley, Steven
He, Zhen
Chen, Yi-Ping Phoebe
Source :
Information Systems. Jun2016, Vol. 58, p105-125. 21p.
Publication Year :
2016

Abstract

This paper presents a memory-constrained hash join algorithm (PaMeCo Join) designed to operate with main-memory column-store database systems. Whilst RAM has become more affordable and the popularity of main-memory database systems continues to grow, we recognize that RAM is a finite resource and that database systems rarely have an excess of memory available to them. Therefore, we design PaMeCo to operate within an arbitrary memory limitation by processing the input relations by parts, and by using a compact hash table that represents the contained tuples in a compact format. Coupled with a radix-clustering system that lowers memory latencies, we find that PaMeCo can offer competitive performance levels to other contemporary hash join algorithms in an unconstrained environment, while being up to three times faster than a high-performing hash join when memory constraints are applied. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
03064379
Volume :
58
Database :
Academic Search Index
Journal :
Information Systems
Publication Type :
Academic Journal
Accession number :
114277412
Full Text :
https://doi.org/10.1016/j.is.2015.10.004