Open AccessCORRELATIONS AND QUERY PROCESSING
Author(s) -
Bhanu Shanker Prasad
Publication year - 2020
Publication title -
international journal of advanced research
Language(s) - English
Resource type - Journals
ISSN - 2320-5407
DOI - 10.21474/ijar01/11726
Subject(s) - query optimization , computer science , query plan , partition (number theory) , sargable , state (computer science) , join (topology) , routing (electronic design automation) , plan (archaeology) , data mining , theoretical computer science , information retrieval , web search query , search engine , algorithm , mathematics , history , computer network , archaeology , combinatorics
It is known that optimization of join queries based on average selectivities is sub-optimal in highly correlated databases. Relations are naturally divided into partitions , each partition having substantially different statistical characteristics in such databases. It is very compelling to discover such data partitions during query optimization and create multiple plans for a given query , one plan being optimal for a particular combination of data partitions. This scenario calls for the sharing of state among plans, so that common intermediate results are not recomputed. We study this problem in a setting with a routing-based query execution engine based on eddies. Eddies naturally encapsulate horizontal partitioning and maximal state sharing across multiple plan. The purpose of this paper is to present faster execution time over traditional optimization for high correlations, while maintaining the same performance for low correlations.