Open AccessData-Level Parallelism Oriented Memory Access and On-Chip Buffering Mechanisms for a Loop Accelerator
Author(s) -
Zhou Weikang,
Xianfeng Li,
Mingtao Chen,
Yang Li
Publication year - 2021
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1914/1/012047
Subject(s) - computer science , data access , uniform memory access , embedded system , latency (audio) , cas latency , registered memory , parallel computing , memory controller , computer architecture , operating system , semiconductor memory , memory management , telecommunications , programming language
Memory access latency is always a bottleneck for the performance improvement of data-intensive applications. Exploiting the memory access patterns of Data-Level Parallelism(DLP) is a promising way for loop accelerators to reduce the latency significantly. This paper proposes two DLP-oriented data provisioning mechanisms to alleviate memory access latency: 1) DLP-oriented memory access(DoMA) for efficiently utilizes the available memory bandwidth. 2) a data access patterns aware on-chip buffer(PABUF) for exploiting reuse in a user-transparent manner. Unlike those loop accelerators using traditional DMA to access global memory, DoMA efficiently reduces the transmission of useless data by adjusting the size of requests intelligently. In addition, PABUF, which manages data using DLP’s memory access patterns without software engineering efforts, allows the loop accelerators to access data in parallel. Experiments show that when our mechanisms are integrated into a loop accelerator based on Rocket Chip Coprocessor(RoCC), it can achieve 4.20x-10.65x(6.81x on average) speedups with negligible overhead of power and area compared to L1 Cache.