This book presents the state of the art in parallel numerical algorithms, applications, architectures, and system software. discusses the latest issues in dense and sparse matrix computations for modern high-performance systems, multicores, manycores and GPUs, and several perspectives on the Spike family of algorithms for solving linear systems;