SharK: Enabling High-Performance Range Queries in Key-Value Store Through Vlog Resharding
Author(s) -
Naoto Sugiura,
Daichi Fujiki
Publication year - 2025
Publication title -
ieee access
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 0.587
H-Index - 127
eISSN - 2169-3536
DOI - 10.1109/access.2025.3638766
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
Modern key-value stores often utilize Log-Structured Merge Trees (LSM-trees) to achieve high write throughput. However, LSM-trees inherently suffer from high read and write amplification. Key-value separation, a technique that isolates large values from keys and stores them in a separate value log, has emerged as a promising solution to mitigate these issues. Despite its potential, existing key-value separation designs have struggled to simultaneously optimize for both update and range queries. To overcome this limitation, we introduce SharK, a new key-value store design that excels in both update and range query performance. SharK partitions the value log into shards and stores values based on their ranges, employing adaptive value management through resharding to maintain consistent performance even under varying key distributions. By performing garbage collection on a per-shard basis with dynamic resharding, SharK ensures efficient update performance. Range-based sharding also directly improves the performance of range queries. Through evaluations, SharK demonstrates superior query performance compared to RocksDB and other key-value separation designs while maintaining comparable update performance.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom