Distributed Systems (IDSS : 3-0-1)

 

SPRING 2018-19
(Wednesday 10:00 AM -11:00 AM)
(Thursday 11:15 AM - 1:15 PM)

Venue: Room-5155, CC3 Building

 

 

 

 

Course Outline:

 

Introduction : Defining Distributed Systems, Goals and Challenges, Representation, Models of Distributed Systems

Architecture Models of computation: Architecture Styles - Centralized and Decentralized architectural styles, Client-Server architecture - Application layering; Per to Peer Systems;

Middleware : Message passing systems, synchronous and asynchronous systems; Remote procedure calls, Remote Method Invokation;

Clock and Causal Ordering : Managing physical clocks in distributed systems; Logical clocks: Lamport's and vector clocks; Global state recording and Snapshot Algorithms; Clock synchronization, Leader election; Waves and Traversal;

OS concepts : Distributed mutual exclusion - permission based algorithms, token based algorithms; Handling deadlocks; Event driven systems for asynchronous Distributed Systems;

Resourse management : Distributed file systems; DFS examples: Hadoop; Distributed shared memory; Load distribution; Cloud computing, SOA;

Fault tolerance and recovery : Fault models, agreement problems and its applications; Commit protocols, voting protocols; Checkpointing and recovery, Multicast communication;

 

 

References:

 

1.      George Coulouris Jean Dollimore, and Tim Kindberg, Distributed Systems: Concepts and Design [Download]

2.      George Coulouris A.D. Kshemkalyani, M. Singhal, Distributed Computing: Principles, Algorithms, and Systems, ISBN: 9780521189842, paperback edition, Cambridge University Press, March 2011 [Download]

3.      Nancy Lynch; Distributed Algorithms, Morgan Kaufmann.

4.      Andrew S. Tanenbaum and Martan Van Steen, Distributed Systems, Principles and Paradigms

5.      Mukesh Singhal and Niranjan Shivaratri , Advanced Concepts in Operating Systems

6.      Jie Wu , Distributed Systems

 

 

Grading Policy:

o   1. Term examination : Mid-sem (30) and End-sem (75)

o   2. Project Assignment : The group assignments (max size - 4) will be uploaded on the website within the first week of commencement of classes

        


Project submission : Contact the TAs for the detailed problem statement of your project assignment and the milestones to be achieved during mid-sem and end-sem evaluation. Each group would be presenting their work in both mid-sem and end-sem and would be evaluated on the basis of the milestones assigned apriori.
If a student does not submit the assignments, his/her grade will remain as incomplete

Announcements:

1.      Project Topics for the Course IDS630E

2.      Project Groups for the Course

3. Assignments on Map and Reduce      
Assignment 1 : Facebook Friends
Assignment 2 : Sentiment Analysis in Twitter

         Mid-sem Solutions

 

 

 

Lectures:

The slides provided as lectures and additional resources have been compiled from different sources. I would like to thank the authors for their slides.
Some of the primary sources of the slides were :
1.https://www.cs.cmu.edu/~dga/15-440/F09/lectures
2. http://cse.iitkgp.ac.in/~agupta/distsys/index.html
3. https://www.cs.columbia.edu/~du/ds/schedule.html



Topic

Slides

Additional Resources

Introduction

DS course - Prof. A. Gupta, IIT KGP

Architecture Models

Models of Computation

Computational models

Middleware

RPC

Birrel's paper on RPC

Implementing RPC

Clock and Causal Ordering

DS course - Prof. A. Gupta, IIT KGP

Logical Time - Kshemkalyani and Singhal :

DS Computation Models

Global States of DS

Distributed Snapshots

Termination Condition

Chandy Lamport's paper

Distributed Mutual Exclusion

Distributed Mutual Exclusion

Distributed ME

Notes on DS ( Singhal)

Distributed File System

DFS: General Idea

Notes from the text book

Naming Service

Naming

Case Study 1

Google File System


Case Study 2

Hadoop