CS240: Advanced Topics in Operating Systems

Spring 2010 -- Dawson Engler


Announcements


Class Abstract

Students will study advanced operating system topics and be exposed to recent developments in operating systems research. This course involves readings and lectures on classic and new papers. Topics: virtual memory management, synchronization and communication, file systems, protection and security, operating system structure and extension techniques, fault tolerance, and history and experience of systems programming.

Class Times

TTh 4:15PM - 5:30PM in Skilling 193.

Course Staff

Contact

mailing list:
newsgroup: su.class.cs240

Instructor

Dawson Engler
E-mail:
Website: cs.stanford.edu/~engler
Telephone: (650) 723-0762
Office: Gates 314
Office hours: By appointment

TA

David Ramos
E-mail:
Office: Gates 326
Office hours: MW 2-3pm

Course Secretary

Mary Jane Swenson
E-mail:
Telephone: (650) 723-0748
Office: Gates 279

Prerequisites

The prerequisite for this class is CS 140 or the equivalent. It is necessary to have this background before taking the class, as we'll read a lot papers quickly without much time for catching up on the basics. The course assumes an understanding of topics in operating systems such as synchronization, virtual memory management, scheduling, and file systems.

The other requirement is that students be able to send and receive email, access the class newsgroup, access the class web page, and download and print postscript from the class web page. There will be very few handouts in the course, since most of the notes and other materials will be available only on the class web page.

Course Organization and Workload

The course consists of lectures, readings, and two exams. The two most important things to know about the class: (1) the main goal is to have interesting in-class discussions and (2) we recommend you read each paper at least three times: twice very carefully, the last time focusing on the hard parts. For any artifact the paper describes you should draw a picture. This should all be done more than a day in advance so that it sinks in.

Most of the work in this course consists of reading journal and conference papers. We will cover one paper for each class meeting. This class will be primarily discussion based (rather than organized around lectures). Active discussion will (hopefully) give you a non-trivial understanding of the material. The only way this approach can work is if you read the papers carefully. To encourage this, 40% of your class grade will come from class participation: this includes talking in class, as well as how you do on pop quizzes and (possibly) pop presentations. (Given the realities of geography remote SCPD students can get their entire grade from exams.) Class time will not be used to rehash the material in the papers. Instead, it will be used to highlight the important points and discuss some of the more interesting features. There will be as much as 10-15 hours of reading per week. Do not take this course unless you are willing and able to do a lot of reading.

Grading Policy

The class is graded on a rough curve. 40% of your grade will come from class participation, the other 60% will be based on scores on two in-class exams. SCPD students will be graded just on exams (and any homeworks).

Grading FAQ

Exams

There will be two exams. They will be open book (but not open laptop). The final exam is cumulative. Sample exams with solutions are available on sites from previous years.

Contacting the staff

For general questions please first post to the class newsgroup, su.class.cs240 --- if you have a question, other people probably have the same one (or should). All course announcements will be put on to the class web page. The news group is a good place to advertise for study groups, ask questions of other students, etc.

For more private matters please send email to . Announcements from the staff will be sent via the cs240-spr0910-students@lists.stanford.edu mailing list to which any registered student will automatically be added.

Course Outline

This course makes no attempt to cover all the interesting topics in operating systems. Instead, we will cover a few topics in depth. The course is divided into the following general topic areas:

Virtual memory management
Discussions of virtual memory management implementations and recent work in virtual memory for multiprocessors, NUMA machines, large virtual address spaces, and other topics.
Synchronization and communication
Discussions of synchronization with an emphasis on monitors. Communication using remote procedure call.
File systems
Discussions of file system interfaces and disk storage management techniques.
Protection and security
Discussions of data security and authentication.
Extensions and fault tolerance
Discussions of mechanisms for implementing OS services at user level, OS structure and performance, reliability and availability of OS services.
History and experience
Historically important papers and experience reports by senior researchers in the field.

Tentative Reading List

There is no textbook for this course. The course is based on a collection of journal and conference papers that describe the history and state of the art in operating systems. Papers will be discussed in class in approximately the order that they appear on the reading list below. You must read the papers before class.

Date Title Author(s)
(Tu 3/30) The Rise of "Worse is Better" Richard Gabriel
(Th 4/01) Eraser: A Dynamic Data Race Detector for Multithreaded Programs Savage, Burrows, Nelson, Sobalvarro, and Anderson
(Tu 4/06) Experience with Processes and Monitors in Mesa Butler Lampson
(Th 4/08) Threads cannot be implemented as a library Hans-J. Boehm
(Tu 4/13) Cooperative Task Management without Manual Stack Management
Why Threads Are A Bad Idea
Why Events Are A Bad Idea
Ousterhout, von Behren, and Adya
(Th 4/15) Practical, Transparent, Operating System Support for Superpages Navarro, Iyer, Druschel, and Cox
(Tu 4/20) Memory Resource Management in VMware ESX Server Waldspurger
(Th 4/22) Enhancing Server Availability and Security Through Failure-Oblivious Computing Rinard, Cadar, Dumitran, Roy, Leu, Beebee
(Tu 4/27) A Comparison of Software and Hardware Techniques for x86 Virtualization Adams and Agesen
(Th 4/29) MIDTERM -- in class
(Tu 5/04) The Design and Implementation of a Log-Structured File System Rosenblum and Ousterhout
(Th 5/06) Rethink the Sync (slides)
Nightingale, Veeraraghavan, Chen, Flinn
(Tu 5/11) Eliminating Receive Livelock in an Interrupt-Driven Kernel Mogul and Ramakrishnan
(Th 5/13) Design and Implementation of the SUN Network Filesystem
Leases: An Efficient Fault-Tolerant Mechanism for Distributed File Cache Consistency
Sandberg et al. / Gray and Cheriton
(Tu 5/18) A Low-Bandwidth Network File System Muthitacharoen, Chen, and Mazieres
(Th 5/20) MapReduce: Simplified Data Processing on Large Clusters
MapReduce: A major step backwards
Dean and Ghemawat / DeWitt and Stonebraker
(Tu 5/25) A Few Billion Lines of Code Later: Using Static Analysis to Find Bugs in the Real World Bessey, Block, Chelf, Chou, Fulton, Hallem, Henri-Gros, Kamsky, McPeak, and Engler
(Th 5/27) Native Client: A Sandbox for Portable, Untrusted x86 Native Code
Exploiting Native Client
Yee, Sehr, Dardyk, Chen, Muth, Ormandy, Okasaka, Narula, Fullagar / Ben Hawkes
(Tu 6/01) FINAL exam -- in class

Class Websites from Previous Quarters

Midterms from Previous Quarters

Finals from Previous Quarters