Introduction to parallel processing : Examples of parallel execution . Efficiency measures and scaling parallelism . Types , levels and grain parallel programming . Overview , categorization and classification of parallel architectures and computer . Languages relationship and parallel architectures. Particular emphasis is given to the design and development of MIMD Architectures ( Distributed memory , shared memory , multithreaded ) and their programming principles . Basic concepts metacomputing , Clusters, Computational Grids. Programming environments for MIMD systems , emphasis is placed on MPI and methodology development of distributed applications by Foster.