CS 441/541 Introduction to Parallel Computing

Course Syllabus - Summer 2004

 

Course Instructor

Purushotham Bangalore

Email: puri@cis.uab.edu

Office: CH 130

Phone: 205-934-8604

Office Hours: Tuesday and Thursday  02:30 PM - 04:30 PM.

                      Other times by appointment only.

 

Anthony Skjellum

Email: tony@cis.uab.edu

Office: CH 116

Phone: 205-934-2213

Office Hours: By appointment only.

Course Session

Tuesday and Thursday 12:40 PM - 02:15 PM     Room CB15 111

Course Homepage

http://www.cis.uab.edu/cs541

Prerequisite

CS 440 Operating Systems or permission of instructor

Programming in C/C++ or Fortran

Teaching Assistant

Shih-Hsi Liu

Email: liush@cis.uab.edu

Office: CH 155

Description

Three hours lecture.

Introductory problem solving and computer programming using parallel computing techniques. Theoretical and practical aspects of parallel programming and problem solving.

Objectives

1.      To introduce principles and concepts of parallel and distributed techniques including POSIX threads, MPI, and hybrid approaches.

2.      Programming assignments illustrate all of these techniques and are developed/executed on the CIS cluster which has 32 nodes with dual-processors per node.

Textbook

Introduction to Parallel Computing 2nd Edition by Ananth Grama, Anshul Gupta, George Karypis, and Vipin Kumar. Publisher: Addison Wesley. 2003. ISBN 0-201-64865-2.

Grading Policy

                            Undergraduate        Graduate

Tests (2)                     30%                    20%

Homework (4-5)         50%                     50%

Final Exam                 20%                     20%

Term Paper                                            10%

 

Final Exam will be held on August 5th,  Thursday 10:45 am - 1:15 pm.

 

1.      There will be two major tests and a final exam. All tests and final exam are mandatory.

2.   There will be 4-5 programming assignments/homework with 10-15% credit each.

Class Conduct

1.      Students are expected to conduct themselves in a professional manner.

2.      Laptops will be allowed only for the purpose of the class. If a student uses the laptop for some other purposes and the misuse distracts other students, then that student's participation grade will greatly be affected.

3.      Students must turn their cell phones/pagers OFF during the class.

Class Attendance

1.      Attendance is mandatory for this course. If you know you will be absent for a legitimate reason, let the instructor know. If you are sick bring a doctor's excuse or a written university excuse to resolve the absences. An absence has to be resolved as soon as possible - otherwise it will not be treated as an excused absence.

2.      Students auditing this course are expected to attend the lectures. Auditing students with more than three unexcused absences will receive a failing grade.

3.      There will be NO make-ups for tests. A student anticipating an excused absence from a test should make arrangements in advance to sit for the exam at another time.

Academic Honesty

Students who plagiarize a computer program (or parts of a program), get others to write a program (or parts of a program), or are found cheating on a quiz/exam, will be reported for academic dishonesty. Anyone who is caught cheating will receive a 0 on a given test or assignment. If a second offense occurs, the student will receive an F in the class. This includes both the provider of the information as well as the receiver of the information. Any student who violates the university's academic honesty policy will be reported for academic discipline. All university and department policies related to students are included here by implication.

Add/Drop Policy

1.      A student can add the course through May 18, 2004.

2.      A student can drop the course without paying full tuition by May 17, 2004.

3.      A student can withdraw with a "W" by August 4, 2004. (Graduate only)

4.   A student can withdraw with a "W" by June 21, 2004. (Undergraduate only)

5.      For more details about add/drop policies check with Registration/Academic Records.

E-mail

Every student will be required to use his/her official email address that is blazerid@uab.edu. New students must login and configure their email addresses. For more details on obtaining blazerid and configuring email please see: http://www.uab.edu/blazerid. All email communications will be made using this address. Additional instructions or announcements will be sent by e-mail, so check your mail often - at least twice a day (once in the morning and once at night). Also check the course webpage for up-to-date information and announcements. Instructor will check email frequently, so e-mail is often the best way to contact the instructor.

Tentative Schedule
(Schedule will be updated regularly)

Date

Topics

Comments

May 11 Introduction - Part I  

May 13

Introduction - Part II

 Assign Homework-1

May 18

No Class

 

May 20

Parallel Computing Platforms (Chapter 2)
May 25 Parallel Algorithm Design (Chapter 3) - Part I  

May 27

Parallel Algorithm Design (Chapter 3) - Part II
Programming Shared Address Space Platforms (Chapter 7)
Homework-1 Due
Assign Homework-2
June 1 No Class Reading Assignment - POSIX Threads
June 3 Programming Shared Address Space Platforms (Chapter 7)  
June 8 Programming Shared Address Space Platforms (Chapter 7)  
June 10 Programming using the Message-Passing Paradigm (Chapter 6)
June 15 Programming using the Message-Passing Paradigm (Chapter 6) Homework-2 Due
Assign Homework-3
Instructions for accessing the cluster (PDF)
June 17 Using Message Passing Interface (Tutorial Slides MPI-Tutorial.pdf and Programs programs.tar.gz) Term Paper Topic Assignment (for graduate students)
June 22 Exam-1 (Topics)
June 24 Point-to-point Communication Primitives
June 29 Collective Communication Primitives (Chapter 4) Homework-3 Due
Assign Homework-4
July 1 Guest Lecture by Dr. Rob Bisseling on The Bulk Synchronous Parallel Model and its Application Slides
July 6 Dense Matrix Algorithms (Chapter 8) Data distribution functions (PDF)
July 8 Dense Matrix Algorithms (Chapter 8)
July 13 Matrix Multiplication Paper
July 15 Homework-4 Due
Assign Homework-5
July 20 Exam-2 (Topics)
July 22 Performance Modeling and Metrics (Chapter 5)
July 27 Parallel LU Factorization (Chapter 8)
July 29
August 3 Review for Finals
August 4  Homework-5 Due
August 5  Final Exam 10:45am to 1:15pm
August 15 Grades available on ACCESS

   

Last Updated: July 24, 2004
by Purushotham Bangalore
Course Homepage: http://www.cis.uab.edu/cs541