Software Pipelined Execution of Stream Programs on GPUs

—The StreamIt programming model has been proposed to exploit parallelism in streaming applications on general purpose multicore architectures. This model allows programmers to specify the structure of a program as a set of filters that act upon data, and a set of communication channels between them. The StreamIt graphs describe task, data and pipeline parallelism which can be exploited on modern Graphics Processing Units (GPUs), which support abundant parallelism in hardware. In this paper, we describe the challenges in mapping StreamIt to GPUs and propose an efficient technique to software pipeline the execution of stream programs on GPUs. We formulate this problem — both scheduling and assignment of filters to processors — as an efficient Integer Linear Program (ILP), which is then solved using ILP solvers. We also describe a novel buffer layout technique for GPUs which facilitates exploiting the high memory bandwidth available in GPUs. The proposed scheduling exploits both...

• Type: Conference
• Year: 2009
• Where: CGO
• Authors: Abhishek Udupa, R. Govindarajan, Matthew J. Thazhuthaveetil
• Keywords: CGO 2009, GPUs, Pipeline Parallelism, Software Engineering, StreamIt Programming Model