English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Tools annual

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Presents the access of premium content as premium feature

Premium Content

Global: Zendy Plus annual

Global: Zendy Free Plan

Deduplication has been largely employed in distributed storage systems toimprove space efficiency. Traditional deduplication research ignores the designspecifications of shared-nothing distributed storage systems such as no centralmetadata bottleneck, scalability, and storage rebalancing. Further,deduplication introduces transactional changes, which are prone to errors inthe event of a system failure, resulting in inconsistencies in data anddeduplication metadata. In this paper, we propose a robust, fault-tolerant andscalable cluster-wide deduplication that can eliminate duplicate copies acrossthe cluster. We design a distributed deduplication metadata shard whichguarantees performance scalability while preserving the design constraints ofshared- nothing storage systems. The placement of chunks and deduplicationmetadata is made cluster-wide based on the content fingerprint of chunks. Toensure transactional consistency and garbage identification, we employ aflag-based asynchronous consistency mechanism. We implement the proposeddeduplication on Ceph. The evaluation shows high disk-space savings withminimal performance degradation as well as high robustness in the event ofsudden server failure.

A Robust Fault-Tolerant and Scalable Cluster-wide Deduplication for Shared-Nothing Storage Systems