Improving distributed join efficiency with extended bloom filter operations


Loizos Michael* and Wolfgang Nejdl and Odysseas Papapetrou and Wolf Siberski
*Division of Engineering and Applied Sciences, Harvard University
L3S Research Center, University of Hannover
loizos-AT-eecs.harvard.edu,{nejdl, papapetrou, siberski}-AT-l3s.de



Abstract: Bloom filter based algorithms have proven successful as very efficient technique to reduce communication costs of database joins in a distributed setting. However, the full potential of bloom filters has not yet been exploited. Especially in the case of multi-joins, where the data is distributed among several sites, additional optimization opportunities arise, which require new bloom filter operations and computations. In this paper, we present these extensions and point out how they improve the performance of such distributed joins. While the paper focuses on efficient join computation, the described extensions are applicable to a wide range of usages, where bloom filters are facilitated for compressed set representation.
Keywords: Distributed Databases, Bloom filter Operations, Bloomfilters



@inproceedings{lmichael:aina07,
author = {Loizos Michael and Wolfgang Nejdl and Odysseas Papapetrou and Wolf Siberski},
title = {Improving distributed join efficiency with extended bloom filter operations},
booktitle = {21st International Advanced Information Networking and Applications (AINA-07)},
year = {2007},
publisher={IEEE},
publisher-url={http://www.ieee.com/},
abstract-url={http://wwww.l3s.de/~papapetrou/abstracts/aina07-blooms.html} }