Introduction to Parallel Computing: Design and Analysis of Algorithms, by V. Kumar, A. Grama, A. Gupta, and G. Karypis, (c) 1994 Introduction to Algorithms, by T. Cormen, C. Leiserson, and R. Rivest, (c) 1990, MIT Press
Research Papers:
LogP: Towards A Realistic Model of Parallel Computation , David Culler, et. al.
Bulk Synchronous Parallel:
A Bridging Model for Parallel Computation, Leslie G. Valiant ; Communications of the ACM, August 1990, Volume 33, Number 8
Questions and answers about BSP
Message Passing Interface References:
Message Passing Interface home page at Argonne
MPI Chapter from Ian Fosters Book.