A perceptual and predictive batch-processing memory scheduling strategy for a CPU-GPU heterogeneous system

2023, Volume 24, Issue 7

Abstract

Keywords

Related Research

Frontiers of Information Technology & Electronic Engineering >> 2023, Volume 24, Issue 7 doi: 10.1631/FITEE.2200449

A perceptual and predictive batch-processing memory scheduling strategy for a CPU-GPU heterogeneous system

北京工业大学信息学部，中国北京市，100124

Received: 2022-10-11 Accepted: 2023-07-24 Available online: 2023-07-24

HTML11 PDF 31 Collect 0

Next Previous

Abstract

When multiple central processing unit (CPU) cores and integrated graphics processing units (GPUs) share off-chip main memory, CPU and GPU applications compete for the critical memory resource. This causes serious resource competition and has a negative impact on the overall performance of the system. We describe the competition for shared-memory resources in a architecture, and a shared-memory request scheduling strategy based on perceptual and predictive batch-processing is proposed. By sensing the CPU and GPU memory request conditions in the request buffer, the proposed scheduling strategy estimates the GPU latency tolerance and reduces mutual interference between CPU and GPU by processing CPU or GPU memory requests in batches. According to the simulation results, the scheduling strategy improves CPU performance by 8.53% and reduces mutual interference by 10.38% with low hardware complexity.

Keywords

CPU-GPU heterogeneous ; Multi-core ; Unified memory ; Access scheduling

Related Research