Open AccessAdaptive indexing approach for main memory column store
Author(s) -
Liu Hui,
Liu Zhijing
Publication year - 2017
Publication title -
the journal of engineering
Language(s) - English
Resource type - Journals
ISSN - 2051-3305
DOI - 10.1049/joe.2016.0068
Subject(s) - computer science , column (typography) , search engine indexing , partition (number theory) , workload , key (lock) , sort , overhead (engineering) , disjoint sets , sargable , query optimization , parallel computing , database , web search query , search engine , operating system , information retrieval , computer network , mathematics , combinatorics , frame (networking)
Owing to efficient query processing for random workload, the hybrid crack sort (HCS) has become an important adaptive indexing approach in main‐memory column store. However, under sequential workload scenarios, the HCS does not obtain a good query execution performance, because of great reorganisation overhead imposed on the initial queries. The authors propose a hybrid radix crack sort (HRCS) approach to solve this problem. By the adoption of radix‐based partition strategy, it divides the unsorted column into disjoint key ranges and then conducts data reorganisation in at most two key ranges for each query. For HRCS, only a small portion of the whole column needs to be touched for the processing of each query, thus reducing the reorganisation cost and improving the query execution performance. The final experiments show that the novel HRCS approach can obtain a higher query execution performance for not only random workload but also sequential workload, as compared with HCS.