English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Responding to the "datacenter tax" and "killer microseconds" problems fordatacenter applications, diverse solutions including Smart NIC-based ones havebeen proposed. Nonetheless, they often suffer from high overhead ofcommunications over network and/or PCIe links. To tackle the limitations of thecurrent solutions, this paper proposes ORCA, a holistic network andarchitecture co-design solution that leverages current RDMA and emergingcache-coherent off-chip interconnect technologies. Specifically, ORCA consistsof four hardware and software components: (1) unified abstraction of inter- andintra-machine communications managed by one-sided RDMA write and cache-coherentmemory write; (2) efficient notification of requests to accelerators assistedby cache coherence; (3) cache-coherent accelerator architecture directlyprocessing requests received by NIC; and (4) adaptive device-to-host datatransfer for modern server memory systems consisting of both DRAM and NVMexploiting state-of-the-art features in CPUs and PCIe. We prototype ORCA with acommercial system and evaluate three popular datacenter applications: in-memorykey-value store, chain replication-based distributed transaction system, anddeep learning recommendation model inference. The evaluation shows that ORCAprovides 30.1~69.1% lower latency, up to 2.5x higher throughput, and 3x higherpower efficiency than the current state-of-the-art solutions.

ORCA: A Network and Architecture Co-design for Offloading us-scale Datacenter Applications