Final Topic Review

The final exam is a take-home quiz. You can use this document as a guide to the reviewing of the book content. You may also use use this outline as a quick reference to find where to locate the book sections when working with on the midterm.

Topics

MPI programming

• Compilation mpicc
• Execution using mpiexec
• Environment setup
  • mpi init
  • comm size
  • comm rank
• Peer-to-peer communication
  • send
  • recv
• Collective communication
  • broadcast
  • reduce
  • gather
  • scatter
  • allreduce
  • allgather
• Synchronization
  • barrier
• Code writing

Pthreads programming

• Compilation flag -lpthreads
• APIs
  • pthread_create
  • pthread_join

Map-reduce

• Hadoop basics
• Word counting example

Parallel performance analysis

• Metric calculation
  • speedup
  • efficiency
• Strong/Weak scaling
  • how plots looks like
  • how to plot