View in EDS

Optimizing Linpack Benchmark on GPU-Accelerated Petascale Supercomputer.

Saved in:
Bibliographic Details
Title: Optimizing Linpack Benchmark on GPU-Accelerated Petascale Supercomputer.
Authors: Wang, Feng1 fengwang@nudt.edu.cn, Yang, Can-Qun1 canqun@nudt.edu.cn, Du, Yun-Fei1 duyunfei@nudt.edu.cn, Chen, Juan1 juanchen@nudt.edu.cn, Yi, Hui-Zhan1 huizhanyi@nudt.edu.cn, Xu, Wei-Xia1 xuwx@nudt.edu.cn
Source: Journal of Computer Science & Technology (10009000). Sep2011, Vol. 26 Issue 5, p854-865. 12p.
Subjects: LINPACK (Computer system), Benchmarking (Management), Graphics processing units, Supercomputers, Program transformation, Heterogeneous computing
Geographic Terms: China
Abstract: In this paper we present the programming of the Linpack benchmark on TianHe-1 system, the first petascale supercomputer system of China, and the largest GPU-accelerated heterogeneous system ever attempted before. A hybrid programming model consisting of MPI, OpenMP and streaming computing is described to explore the task parallel, thread parallel and data parallel of the Linpack. We explain how we optimized the load distribution across the CPUs and GPUs using the two-level adaptive method and describe the implementation in details. To overcome the low-bandwidth between the CPU and GPU communication, we present a software pipelining technique to hide the communication overhead. Combined with other traditional optimizations, the Linpack we developed achieved 196 :7 GFLOPS on a single compute element of TianHe-1. This result is 70 :1% of the peak compute capability, 3 :3 times faster than the result by using the vendor's library. On the full configuration of TianHe-1 our optimizations resulted in a Linpack performance of 0 :563 PFLOPS, which made TianHe-1 the 5th fastest supercomputer on the Top500 list in November, 2009. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Computer Science & Technology (10009000) is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:In this paper we present the programming of the Linpack benchmark on TianHe-1 system, the first petascale supercomputer system of China, and the largest GPU-accelerated heterogeneous system ever attempted before. A hybrid programming model consisting of MPI, OpenMP and streaming computing is described to explore the task parallel, thread parallel and data parallel of the Linpack. We explain how we optimized the load distribution across the CPUs and GPUs using the two-level adaptive method and describe the implementation in details. To overcome the low-bandwidth between the CPU and GPU communication, we present a software pipelining technique to hide the communication overhead. Combined with other traditional optimizations, the Linpack we developed achieved 196 :7 GFLOPS on a single compute element of TianHe-1. This result is 70 :1% of the peak compute capability, 3 :3 times faster than the result by using the vendor's library. On the full configuration of TianHe-1 our optimizations resulted in a Linpack performance of 0 :563 PFLOPS, which made TianHe-1 the 5th fastest supercomputer on the Top500 list in November, 2009. [ABSTRACT FROM AUTHOR]
ISSN:10009000
DOI:10.1007/s11390-011-0184-1