Accelerating the LOBPCG method on GPUs using a blocked Sparse Matrix Vector Product

TitleAccelerating the LOBPCG method on GPUs using a blocked Sparse Matrix Vector Product
Publication TypeConference Paper
Year of Publication2015
AuthorsAnzt, H., S. Tomov, and J. Dongarra
Conference NameSpring Simulation Multi-Conference 2015 (SpringSim'15)
Date Published2015-04
PublisherSCS
Conference LocationAlexandria, VA
AbstractThis paper presents a heterogeneous CPU-GPU implementation for a sparse iterative eigensolver the Locally Optimal Block Preconditioned Conjugate Gradient (LOBPCG). For the key routine generating the Krylov search spaces via the product of a sparse matrix and a block of vectors, we propose a GPU kernel based on a modi ed sliced ELLPACK format. Blocking a set of vectors and processing them simultaneously accelerates the computation of a set of consecutive SpMVs significantly. Comparing the performance against similar routines from Intel's MKL and NVIDIA's cuSPARSE library we identify appealing performance improvements. We integrate it into the highly optimized LOBPCG implementation. Compared to the BLOBEX CPU implementation running on two eight-core Intel Xeon E5-2690s, we accelerate the computation of a small set of eigenvectors using NVIDIA's K40 GPU by typically more than an order of magnitude.
Project Tags: