LEIBNIZ INFORMATION CENTRE
`FOR SCJENCE ANO TECHNOLOGY
`UNIVERSITY LIBRARY
`
`TIS II P.O. Box 60 80 // 30060 Hannover. Germany
`Orrick 1 Herrington & Sutcliffe LLP
`Bibliothek, Lars Woehning
`
`Heinrich-Heine-Allee 12
`40213 Dosseldorf
`
`We hereby confirm that reference:
`
`Proceedings of the 2nd Symposium on Networked Systems Design &
`Implementation (NSDI '05) held May 2 - 4, 2005, Boston, MA. USA, USENIX
`Association - PRINTED EDITION - ISBN 1-931971-30-7
`
`with its information carrier Uournal issue, conference proceedings, book, research
`report and such like in printed form or saved electronically)
`
`•
`
`was incorporated at our establishment on February 28, 2006, under the shelf mark
`RS 4601(2).
`
`From the day of accession , the public, and in particular the professional world , shall
`in princip1le be able to access the reference.
`
`Diana Fri·edrich
`TIB Customer Service
`
`Technische lnformationsbihliothek (TIBJ
`Team Graue Literatur
`Welfengmten 1 B // 30167 Hannover
`GERMANY
`
`I
`
`Hannover. 26. Apn1 2021
`
`Techn1sche
`lnformat1onsb1b1tothek (TIB)
`Welfengarten 1 B
`30167 Hannover, Germany
`T +49 511 762· 8989
`F +49 511 762. 8998
`customerservice@llb eu
`wwwt1b eu
`
`VAT Reg No·
`DE214931803
`Tax •NO 25/202/26441
`
`TIB
`Nord/LB Hannover
`IBAN· DE47 2505
`0000 0101 4287 53
`BIC. NOLADE2HXXX
`
`us
`Nord/LB Hannov r
`IBAN: DE57 2505
`0000 0106 0276 34
`BIC: NOLADE2HXXX
`
`Dre TIB Is a member of
`
`The TIB is the German National Library ror all areas of engineering as well as architecture. chemistry,
`information technology, mathematics and physics. The TIB is a foundation of pub 1c law
`
`Kopie für Lizenzkunden der TIB Hannover, geliefert und ausgedruckt für Orrick, Herrington & Sutcliffe LLP, 26.04.21 um 12:01
`
`Microsoft Ex. 1009, p. 1
`Microsoft v. Daedalus Blue
`IPR2021-00832
`
`

`

`USENIX Association
`
`Proceedings of the
`2nd Symposium on Networked
`Systems Design & Implementation
`(NSDI '05)
`
`May 2-4, 2005
`Boston, MA, USA
`
`Kopie für Lizenzkunden der TIB Hannover, geliefert und ausgedruckt für Orrick, Herrington & Sutcliffe LLP, 26.04.21 um 12:01
`
`Microsoft Ex. 1009, p. 2
`Microsoft v. Daedalus Blue
`IPR2021-00832
`
`

`

`Conf ere nee Organizers
`Steering Committee
`Thomas Anderson, University of Washington
`Peter Honeyman, CIT/, University of Michigan
`Mike Jones, Microsoft Research
`Robert Morris, Massachusetts Institute of Technology
`Mike Schroeder, Microsoft Research
`Amin Vahdat, University of California, San Diego
`Ellie Young, USENIX Association
`Poster Session Chairs
`Eddie Kohler, University of California, Los Angeles
`Michael Dahlin, University of Texas at Austin
`The USENIX Association Staff
`
`Program Chairs
`Amin Vahdat, University of California, San Diego
`David Wetherall, University of Washington
`Program Committee
`Miguel Castro, Microsoft Research
`Jon Crowcroft, University of Cambridge
`David Culler, University of California, Berkeley
`Michael Dahlin, University of Texas at Austin
`Peter Druschel, Rice University
`Paul Francis, Cornell University
`Ramesh Govindan, University of Southern California
`Joe Hellerstein, Intel Research and University of
`California, Berkeley
`Dina Katabi, Massachusetts Institute of Technology
`Eddie Kohler, University of California, Los Angeles
`Ed Lazowska, University of Washington
`Jeffrey Mogul, HP Labs
`Vern Paxson, /CS/ and Lawrence Berkeley National
`Laboratory
`Larry Peterson, Princeton University
`Stefan Savage, University of California, San Diego
`Srinivasan Seshan, Carnegie Mellon University
`Ellen Zegura, Georgia Institute of Technology
`
`External Reviewers
`
`Mukesh Agrawal
`Aditya Akella
`NazrulAlam
`David Andersen
`Thomas Anderson
`Remzi Arpaci-Dusseau
`Mary Baker
`Magdalena Balazinska
`Hitesh Ballani
`Andy Bavier
`Brian Bershad
`Ash win Bharambe
`Ken Birman
`Mike Burrows
`John Byers
`Yatin Chawathe
`Allen Clement
`Richard Cox
`Constantinos Dovrolis
`Richard Dunn
`Jeremy Elson
`Cristian Estan
`Nick Feamster
`
`Marc Fiuczynski
`Sally Floyd
`Paul Gauthier
`Steven Gribble
`Timothy Griffin
`Saikat Guha
`Krishna Gummadi
`Andreas Haeberlen
`Jeff Hoye
`Mark Huang
`Jaeyeon Jung
`Flavio Junqueira
`Frans Kaashoek
`Shrikanth Kandula
`Scott Karlin
`Sachin Katti
`Dejan Kostic
`David Kotz
`Boon Thau Loo
`David Lowenthal
`Ratul Mahajan
`Petros Maniatis
`Tudor Marian
`
`David Mazieres
`Alan Mislove
`Michael Mitzenmacher
`Steve Muir
`Aki Nakao
`Suman Nath
`David Oppenheimer
`Vivek Pai
`Jeff Pang
`Ruoming Pang
`Kurt Partridge
`Adrian Perrig
`Ansley Post
`Kostas Psounis
`Venugopalan
`Ramasubramanian
`Charles Reis
`Maya Rodrig
`Dan Sandler
`Stefan Saroiu
`Marianne Shaw
`Alan Shieh
`Atul Singh
`
`Manpreet Singh
`Alex Snoeren
`Yee Jiun Song
`Tammo Spalink
`Neil Spring
`Ion Stoica
`Michael Swift
`George Varghese
`Vidhyashankar
`Venkataraman
`Arun Venkataramani
`Vivek Vishnumurthy
`Geoffrey Voelker
`Kevin Walsh
`Matt Walsh
`Andrew Whitaker
`Dan Williams
`Bernard Wong
`Kenneth Yocum
`Haifeng Yu
`John Zahorjan
`Ming Zhang
`Xinyang Zhang
`
`Kopie für Lizenzkunden der TIB Hannover, geliefert und ausgedruckt für Orrick, Herrington & Sutcliffe LLP, 26.04.21 um 12:01
`
`Microsoft Ex. 1009, p. 3
`Microsoft v. Daedalus Blue
`IPR2021-00832
`
`

`

`Live Migration of Virtual Machines
`
`Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen t,
`Eric Jult, Christian Limpach, Ian Pratt, Andrew Warfield
`t Department of Computer Science
`University of Cambridge Computer Laboratory
`15 JJ Thomson Avenue, Cambridge, UK
`University of Copenhagen, Denmark
`firstname.lastname@cl.cam.ac.uk
`{jacobg,eric}@diku.dk
`
`Abstract
`Migrating operating system instances across distinct phys(cid:173)
`ical hosts is a useful tool for administrators of data centers
`and clusters: It allows a clean separation between hard(cid:173)
`ware and software, and facilitates fault management, load
`balancing, and low-level system maintenance.
`
`certain system calls or even memory accesses on behalf of
`migrated processes. With virtual machine migration, on
`the other hand, the original host may be decommissioned
`once migration has completed. This is particularly valuable
`when migration is occurring in order to allow maintenance
`of the original host.
`
`By carrying out the majority of migration while OSes con(cid:173)
`tinue to run, we achieve impressive performance with min(cid:173)
`imal service downtimes; we demonstrate the migration of
`entire OS instances on a commodity cluster, recording ser(cid:173)
`vice downtimes as low as 60ms. We show that that our
`performance is sufficient to make live migration a practical
`tool even for servers running interactive loads.
`
`In this paper we consider the design options for migrat(cid:173)
`ing· OSes running services with liveness constraints, fo(cid:173)
`cusing on data center and cluster environments. We intro(cid:173)
`duce and analyze the concept of writable working set, and
`present the design, implementation and evaluation of high(cid:173)
`performance OS migration built on top of the Xen VMM.
`
`1 Introduction
`
`Operating system virtualization has attracted considerable
`interest in recent years, particularly from the data center
`and cluster computing communities. It has previously been
`shown [ 1] that paravirtualization allows many OS instances
`to run concurrently on a single physical machine with high
`performance, providing better use of physical resources
`and isolating individual OS instances.
`
`In this paper we explore a further benefit allowed by vir(cid:173)
`tualization: that of live OS migration. Migrating an en(cid:173)
`tire OS and all of its applications as one unit allows us to
`avoid many of the difficulties faced by process-level mi(cid:173)
`gration approaches. In particular the narrow interface be(cid:173)
`tween a virtualized OS and the virtual machine monitor
`(VMM) makes it easy avoid the problem of 'residual de(cid:173)
`pendencies' [2] in which the original host machine must
`remain available and network-accessible in order to service
`
`Secondly, migrating at the level of an entire virtual ma(cid:173)
`chine means that in-memory state can be transferred in a
`consistent and (as will be shown) efficient fashion. This ap(cid:173)
`plies to kernel-internal state (e.g. the TCP control block for
`a currently active connection) as well as application-level
`state, even when this is shared between multiple cooperat(cid:173)
`ing processes. In practical terms, for example, this means
`that we can migrate an on-line game server or streaming
`media server without requiring clients to reconnect: some(cid:173)
`thing not possible with approaches which use application(cid:173)
`level restart and layer 7 redirection.
`
`Thirdly, live migration of virtual machines allows a sepa(cid:173)
`ration of concerns between the users and operator of a data
`center or cluster. Users have 'carte blanche' regarding the
`software and services they run within their virtual machine,
`and need not provide the operator with any OS-level access
`at all ( e.g. a root login to quiesce processes or I/0 prior to
`migration). Similarly the operator need not be concerned
`with the details of what is occurring within the virtual ma(cid:173)
`chine; instead they can simply migrate the entire operating
`system and its attendant processes as a single unit.
`
`Overall, live OS migration is a extremelely powerful tool
`for cluster administrators, allowing separation of hardware
`and software considerations, and consolidating clustered
`hardware into a single coherent management domain. If
`a physical machine needs to be removed from service an
`administrator may migrate OS instances including the ap(cid:173)
`plications that they are running to alternative machine(s),
`freeing the original machine for maintenance. Similarly,
`OS instances may be rearranged across machines in a clus(cid:173)
`ter to relieve load on congested hosts. In these situations the
`combination of virtualization and migration significantly
`improves manageability.
`
`USENIX Association
`
`NSDI '05: 2nd Symposium on Networked Systems Design & Implementation
`
`273
`
`Kopie für Lizenzkunden der TIB Hannover, geliefert und ausgedruckt für Orrick, Herrington & Sutcliffe LLP, 26.04.21 um 12:01
`
`Microsoft Ex. 1009, p. 4
`Microsoft v. Daedalus Blue
`IPR2021-00832
`
`