PARALLEL COMPUTING

ANNA UNIVERSITY TIRUCHIRAPPALLI
Tiruchirappalli - 620 024
Regulations 2007
Syllabus
B.E. COMPUTER SCIENCE AND ENGINEERING

SEMESTER VIII
(Common to CSE 8th Semester and IT 7th
Semester)

LIST OF ELECTIVES

ELECTIVE I

PARALLEL COMPUTING
(Common to CSE and IT)

L T P
3 0 0

UNIT I SCALABILITY AND CLUSTERING 9
Evolution of computer architecture − Dimensions of scalability − Parallel computer models − Basic
concepts of clustering − Scalable design principles − Parallel programming overview − Processes −
Tasks and threads − Parallelism issues − Interaction / communication Issues − Semantic issues in
parallel programs.

UNIT II ENABLING TECHNOLOGIES 9
System development trends − Principles of processor design − Microprocessor architecture families −
Hierarchical memory technology − Cache coherence protocols − Shared memory consistency −
Distributed cache memory architecture − Latency tolerance techniques − Multithreaded latency hiding.

UNIT III SYSTEM INTERCONNECTS 9
Basics of interconnection networks − Network topologies and properties − Buses − Crossbar and
multistage switches − Software multithreading − Synchronization mechanisms.

UNIT IV PARALLEL PROGRAMMING 9
Paradigms and programmability − Parallel programming models − Shared memory programming.

UNIT V MESSAGE PASSING PROGRAMMING 9
Message passing paradigm − Message passing interface − Parallel virtual machine.


Total: 45
TEXT BOOKS
1. Kai Hwang and Zhi.Wei Xu, “Scalable Parallel Computing”, Tata McGraw-Hill, 2003.
2. David E. Culler and Jaswinder Pal Singh, “Parallel Computing Architecture: A
Hardware/Software Approach”, Morgan Kaufman Publishers, 1999.

REFERENCES
1. Michael J. Quinn, “Parallel Programming in C with MPI and OpenMP”, Tata McGraw-Hill,
2003.
2. Kai Hwang, “Advanced Computer Architecture”, Tata McGraw-Hill, 2003.