Premium
Nimble join: A parallel star join for main memory column‐stores
Author(s) -
Sangat Prajwol,
Taniar David,
IndrawanSantiago Maria,
Messom Christopher
Publication year - 2019
Publication title -
concurrency and computation: practice and experience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.309
H-Index - 67
eISSN - 1532-0634
pISSN - 1532-0626
DOI - 10.1002/cpe.5616
Subject(s) - computer science , terabyte , column (typography) , join (topology) , table (database) , data warehouse , analytics , response time , process (computing) , parallel computing , database , operating system , computer network , mathematics , combinatorics , frame (networking)
Summary Column‐stores perform significantly better than row‐stores on analytical workloads such as those found in data warehouses, decision support, and business intelligence applications. As mainstream data warehouses are growing into multi‐terabyte range, decision support queries should be processed in parallel to achieve adequate performance. Researchers of the column‐oriented join queries assume an unlimited reserve of main memory and focus on minimising execution time. However, some analytics require a large amount of memory to calculate intermediate results, and some interactive analytics require a fast initial response time even though queries need to process a large amount of data. Motivated by these requirements, we present a new progressive parallel star algorithm for main memory column‐stores known as “Nimble Join.” Equipped with multi‐attribute array table and a novel progressive materialisation technique, Nimble Join requires half the memory space and has two times faster initial response whilst having comparable execution time to the existing algorithm.