Open AccessEstimate the Performance of Cloudera Decision Support Queries
Author(s) -
Tahani M. Allam
Publication year - 2022
Publication title -
international journal of online and biomedical engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.184
H-Index - 8
ISSN - 2626-8493
DOI - 10.3991/ijoe.v18i01.27877
Subject(s) - computer science , sql , benchmark (surveying) , query optimization , in memory processing , query by example , database , spatial query , user defined function , query language
Hive and Impala queries are used to process a big amount of data. The overwriting amount of information requires an efficient data processing system. When we deal with a long-term batch query and analysis Hive will be more suitable for this query. Impala is the most powerful system suitable for real-time interactive Structured Query Language (SQL) query which are added a massive parallel processing to Hadoop distributed cluster. The data growth makes a problem with SQL Cluster because the execution processing time is increased. In this paper, a comparison is demonstrated between the performance time of Hive, Impala and SQL on two different data models with different queries chosen to test the performance. The results demonstrate that Impala outperforms Hive and SQL cluster when it comes to analyze data and processing tasks. Using two benchmark datasets, TPC-H and statistical computing, we compare the performance of Hive, Impala, and SQL clusters 2009 Statistical Graphics Data Expo.