A dynamic re-partitioning strategy based on the distribution of key in Spark
Author(s) -
Tianyu Zhang,
Xin Lian
Publication year - 2018
Publication title -
aip conference proceedings
Language(s) - English
Resource type - Conference proceedings
eISSN - 1551-7616
pISSN - 0094-243X
DOI - 10.1063/1.5039133
Subject(s) - computer science , partition (number theory) , hash function , spark (programming language) , tuple , big data , histogram , key (lock) , distributed computing , parallel computing , data mining , mathematics , computer security , programming language , discrete mathematics , combinatorics , artificial intelligence , image (mathematics)
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom