(12) United States Patent
`Sancheti et al.
`
`(lo) Patent No.:
`(45) Date of Patent:
`
`US 9,116,633 B2
`Aug. 25, 2015
`
`(54)
`
`INFORMATION MANAGEMENT OF
`VIRTUAL MACHINES HAVING MAPPED
`STORAGE DEVICES
`
`USPC
`
` 711/6, 203, 209; 707/640, 645, 649,
`707/653, 661, 667, 674; 718/1, 104
`See application file for complete search history.
`
`(71) Applicant: CommVault Systems, Inc., Oceanport,
`NJ (US)
`
`(56)
`
`References Cited
`
`(72)
`
`Inventors: Ashwin Gautamchand Sancheti, Ocean
`City, NJ (US); Rahul S. Pawar,
`Marlboro, NJ (US)
`
`(73) Assignee: Commvault Systems, Inc., Tinton Falls,
`NJ (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 264 days.
`
`EP
`EP
`
`U.S. PATENT DOCUMENTS
`
`4,686,620 A
`4,995,035 A
`
`8/1987 Ng
`2/1991 Cole et al.
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`3/1988
`0259912 Al
`1/1991
`0405926 A2
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21) Appl. No.: 13/790,226
`
`(22) Filed:
`
`Mar. 8, 2013
`
`(65)
`
`Prior Publication Data
`
`US 2013/0262801 Al
`
`Oct. 3, 2013
`
`Related U.S. Application Data
`
`(60) Provisional application No. 61/618,663, filed on Mar.
`30, 2012.
`
`(51) Int. Cl.
`G06F 12/00
`GO6F 3/06
`GO6F 9/455
`GO6F 12/12
`(52) U.S. Cl.
`CPC
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
` GO6F 3/065 (2013.01); GO6F 9/455
`(2013.01); G06F 9/45558 (2013.01); G06F
`12/12 (2013.01); GO6F 12/127 (2013.01);
`G06F 2009/45562 (2013.01)
`(58) Field of Classification Search
`CPC
`G06F 3/065; G06F 9/455; G06F 9/4558;
`G06F 12/12; G06F 12/127
`
`U.S. Appl. No. 13/765,389, filed Feb. 12, 2013, Kripalani.
`(Continued)
`
`Primary Examiner — Reba I Elmore
`(74) Attorney, Agent, or Firm — Perkins Coi LLP
`
`(57)
`
`ABSTRACT
`
`Software, finnware, and systems are described herein that
`create and use a non-production copy of a virtual machine for
`reverting or restoring the virtual machine. The virtual
`machine is associated with an external storage device via a
`logical mapping. A snapshot is taken of a virtual disk associ-
`ated with the virtual machine to create a snapshot copy of the
`virtual disk. A snapshot is taken of at least a portion of the
`mapped external storage device to create a snapshot copy of
`the mapped external storage device. The snapshot copy of the
`virtual disk is associated with the snapshot copy of the
`mapped external storage device. The snapshot copies can then
`be used to either revert or restore the virtual machine.
`
`20 Claims, 12 Drawing Sheets
`
`100
`
`105
`
`108 virtual machine host 105.
`virtual rtathld 1104
`0419
`
`vIrktert nand-.1100
`4000
`
`1154
`120.
`
`1166
`1206
`
`pec
`
`tutt
`
`185a
`
`102
`500.1001 maculae A
`
`MOP
`
`I
`
`1035
`
`107•
`
`I
`
`dare
`
`1016
`duet
`
`101
`dent
`
`101
`der!
`
`Onducloit
`Oat. store
`
`102
`final nuudine
`
`000
`
`C
`
`pro105601
`am .tore
`
`102
`oal rnsublne
`
`finducittn
`Cab Me
`
`1036
`
`1075
`
`101A
`
`DR dot
`
`mnalr
`
`1018
`
`103n
`
`107n
`
`virtual
`MANN
`=nectar
`
`1400
`
`1406
`
`1700
`120.
`
`1150
`1200
`
`1358
`
`1405
`
`Od
`
`NO 'Jed mottive 1100
`
`455
`
`rad Inachhe 1108
`
`dtk
`
`LvOltral meddle 646 110
`
`WIZ, Inc. EXHIBIT - 1020
`WIZ, Inc. v. Orca Security LTD.
`
`US009116633B2
`
`US 9,116,633 B2
`(10) Patent No.:
`a2) United States Patent
`Sancheti et al.
`(45) Date of Patent:
`Aug, 25, 2015
`
`
`(54) INFORMATION MANAGEMENT OF
`VIRTUAL MACHINES HAVING MAPPED
`STORAGE DEVICES
`
`USPC. vecccsceceee 711/6, 203, 209; 707/640, 645, 649,
`707/653, 661, 667, 674; 718/1, 104
`See application file for complete search history.
`
`(71)
`
`Applicant: CommVault Systems, Inc., Oceanport,
`NJ (US)
`
`(56)
`
`References Cited
`
`(72)
`
`Inventors:
`
`Ashwin Gautamchand Sancheti, Ocean
`City, NJ (US): Rahul S. Pawar,
`Marlboro, NJ (US)
`
`(73)
`
`Assignee: Commvault Systems, Inc., Tinton Falls,
`NI (US)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 264 days.
`
`EP
`EP
`
`U.S. PATENT DOCUMENTS
`
`4,686,620 A
`4,995,035 A
`
`8/1987
`2/1991
`
`Ng
`Cole etal.
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`0259912 Al
`0405926 A2
`
`3/1988
`1/1991
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`(21)
`
`Appl. No.: 13/790,226
`
`(22)
`
`Filed:
`
`Mar. 8, 2013
`
`(65)
`
`Prior Publication Data
`
`US 2013/0262801 Al
`
`Oct. 3, 2013
`
`Related U.S. Application Data
`
`(60)
`
`(51)
`
`(52)
`
`(58)
`
`Provisional application No. 61/618,663, filed on Mar.
`30, 2012.
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`Int. Cl.
`GO6F 12/00
`GO6F 3/06
`GO6F 9/455
`GOOF 12/12
`U.S.CL
`CPC .ee GO6F 3/065 (2013.01); GO6F 9/455
`(2013.01); GO6F 9/45558 (2013.01); GO6F
`12/12 (2013.01); GO6F 12/127 (2013.01);
`GO6F 2009/45562 (2013.01)
`Field of Classification Search
`CPC .…… GO6P 3/065; GO6E 9/455; GO6E 9/4558;
`GO6F 12/12; GO6F 12/127
`
`ee
`
`a ee
`
`physical machine A
`(sop H+ 1008
`1078
`
`
`<
`
`tos
`[ar
`
`401b
`
`
`er |
`
`production
`data store
`
`
`
`+1098
`
`US. Appl. No. 13/765,389, filed Feb. 12, 2013, Kripalani.
`(Continued)
`
`Primary Examiner — Reba | Elmore
`(74) Attorney, Agent, or Firm — Perkins Coi LLP
`
`(57)
`
`ABSTRACT
`
`Software, firmware, and systems are described herein that
`create and use a non-production copy of a virtual machine for
`reverting or restoring the
`virtual machine. The virtual
`machine is associated with an external storage device via a
`logical mapping. A snapshot is taken of a virtual disk associ-
`ated with the virtual machine to create a snapshot copy of the
`virtual disk. A snapshot is taken of at least a portion of the
`mapped external storage device to create a snapshot copy of
`the mapped external storage device. The snapshot copy of the
`virtual disk is associated with the snapshot copy of the
`mapped external storage device. The snapshot copies can then
`be used to either revert or restore the virtual machine.
`
`20 Claims, 12 Drawing Sheets
`
`[108
`
`109
`
`108) virtualmachinahost 1052 1
`
`1
`virtual machine 140a
`1
`1
`1
`1
`1)
`|
`
`T1158
`
`7 1200
`
`Tsb
`下 tb
`
`1
`1
`1
`
`
`mai
`
`i
`
`machine
`
`
`
`
`
`
`
`
`
`Lyra machine host 1050
`
`WIZ, Inc. EXHIBIT - 1020
`WIZ, Inc. v. Orca Security LTD. - IPR2024-00220
`
`
`
`
`WIZ, Inc. EXHIBIT - 1020
`WIZ, Inc. v. Orca Security LTD.
`
`

`

`US 9,116,633 B2
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,005,122 A
`5,093,912 A
`5,133,065 A
`5,193,154 A
`5,212,772 A
`5,226,157 A
`5,239,647 A
`5,241,668 A
`5,241,670 A
`5,276,860 A
`5,276,867 A
`5,287,500 A
`5,321,816 A
`5,333,315 A
`5,347,653 A
`5,410,700 A
`5,448,724 A
`5,491,810 A
`5,495,607 A
`5,504,873 A
`5,544,345 A
`5,544,347 A
`5,559,957 A
`5,619,644 A
`5,638,509 A
`5,673,381 A
`5,699,361 A
`5,729,743 A
`5,751,997 A
`5,758,359 A
`5,761,677 A
`5,764,972 A
`5,778,395 A
`5,812,398 A
`5,813,009 A
`5,813,017 A
`5,875,478 A
`5,887,134 A
`5,901,327 A
`5,924,102 A
`5,950,205 A
`5,974,563 A
`6,021,415 A
`6,026,414 A
`6,052,735 A
`6,076,148 A
`6,094,416 A
`6,131,095 A
`6,131,190 A
`6,148,412 A
`6,154,787 A
`6,161,111 A
`6,167,402 A
`6,212,512 B1
`6,260,069 B1
`6,269,431 B1
`6,275,953 B1
`6,301,592 B1
`6,324,581 B1
`6,328,766 B1
`6,330,570 B1
`6,330,642 B1
`6,343,324 B1
`RE37,601 E
`6,356,801 B1
`6,389,432 B1
`6,397,242 B1 *
`6,421,711 B1
`6,487,561 B1
`6,519,679 B2
`6,538,669 B1
`6,564,228 B1
`6,581,076 B1
`6,658,526 B2
`7,035,880 B1
`
`4/1991 Griffin et al.
`3/1992 Dong et al.
`7/1992 Cheffetz et al.
`3/1993 Kitajima et al.
`5/1993 Masters
`7/1993 Nakano et al.
`8/1993 Anglin et al.
`8/1993 Eastridge et al.
`8/1993 Eastridge et al.
`1/1994 Fortier et al.
`1/1994 Kenley et al.
`2/1994 Stoppani, Jr.
`6/1994 Rogan et al.
`7/1994 Saether et al.
`9/1994 Flynn et al.
`4/1995 Fecteau et al.
`9/1995 Hayashi
`2/1996 Allen
`2/1996
`Pisello et al.
`4/1996
`Martin et al.
`8/1996 Carpenter et al.
`8/1996 Yanai et al.
`9/1996 Balk
`4/1997 Crockett et al.
`6/1997
`Dunphy et al.
`9/1997
`Huai et al.
`12/1997 Ding et al.
`3/1998 Squibb
`5/1998 Kullick et al.
`5/1998 Saxon
`6/1998 Senator et al.
`6/1998 Crouse et al.
`7/1998 Whiting et al.
`9/1998 Nielsen
`9/1998 Johnson et al.
`9/1998 Morris
`2/1999 Blumenau
`3/1999 Ebrahim
`5/1999 Ofek
`7/1999 Perks
`9/1999 Aviani, Jr.
`10/1999 Beeler, Jr.
`2/2000 Cannon et al.
`2/2000 Anglin
`4/2000 Ulrich st al.
`6/2000 Kedem
`7/2000 Ying
`10/2000 Low et al.
`10/2000 Sidwell
`11/2000 Cannon et al.
`11/2000 Urevig et al.
`12/2000 Mutalik et al.
`12/2000 Yeager
`4/2001 Barney et al.
`7/2001 Anglin
`7/2001 Dunham
`8/2001 Vahalia et al.
`10/2001 Aoyama et al.
`11/2001
`Xu et al.
`12/2001
`Long
`12/2001 Crighton
`12/2001 Catteau
`1/2002 Hubis et al.
`3/2002 Eastridge et al.
`3/2002 Goodman et al.
`5/2002 Pothapragada et al.
`5/2002
`Devine et al.
`Blumenau et a.
`7/2002
`11/2002 Ofek et al.
`2/2003 Devireddy et al.
`3/2003 Lagueux, Jr. et al.
`5/2003 O'Connor
`6/2003 Ching et al.
`12/2003 Nguyen et al.
`4/2006 Crescenti et al.
`
` 711/114
`
` 719/324
`
` 711/201
` 707/1
` 711/4
` 707/1
`
` 717/126
` 711/6
` 711/114
` 710/68
`
` 707/204
` 707/10
`
` 709/224
` 711/162
` 711/161
`
` 718/1
` 709/247
`
` 707/649
`
`7/2006 Jaggers et al.
`7,076,270 B2
`5/2007 Donker et al.
`7,219,162 B2
`7/2007 Kottomtharayil et al.
`7,246,207 B2
`7/2008 Crescenti et al.
`7,395,282 B1
`11/2008 Tremain
`7,448,079 B2
`7,552,279 B1 * 6/2009 Gandler
`7,631,351 B2
`12/2009 Erofeev
`7,730,035 B2
`6/2010 Berger et al.
`'7,756,835 B2
`712010 rusn
`7,756,964 B2
`7/2010 Madison, Jr. et al.
`7,793,307 B2 * 9/2010 Gokhale et al.
`7,840,537 B2
`11/2010 Gokhale et al.
`7,882,077 B2
`2/2011 Gokhale et al.
`7,899,788 B2
`3/2011 Chandhok et al.
`7,937,421 B2
`5/2011 Mikesell et al.
`8,069,271 B2
`11/2011 Brunet et al.
`8,140,786 B2
`3/2012 Bunte et al.
`8,219,524 B2
`7/2012 Gokhale
`8,307,177 B2
`11/2012 Prahlad et al.
`8,578,126 B1 * 11/2013 Gaonkar et al.
`2004/0030668 Al *
`2./2004 Pawlowski et al.
`2004/0030822 Al * 2/2004 Rajan et al.
`2006/0224846 Al
`10/2006 Amarendran et al.
`5/2007 Lent et a.
`2007/0100792 Al *
`2007/0203938 Al
`8/2007 Prahlad et al.
`2007/0234302 Al * 10/2007 Suzuki et al.
`2008/0189468 Al * 8/2008 Sclunidt et al.
`2008/0244177 Al * 10/2008 Crescenti et al.
`2008/0313371 Al * 12/2008 Kedem et al.
`6/2009 Chatley et a.
`2009/0144416 Al
`2009/0222496 Al * 9/2009 Liu et al.
`2009/0300023 Al * 12/2009 Vaghani
`2009/0319534 Al
`12/2009 Gokhale
`2009/0327471 Al
`12/2009 Astete et al.
`2009/0327477 Al * 12/2009 Madison et al
`2010/0070725 Al * 3/2010 Prahlad et al.
`2010/0161919 Al * 6/2010 Dodgson et al.
`2010/0242096 Al
`9/2010 Varadharajan et al.
`2010/0332454 Al
`12./2010 Prahlad et al.
`2011/0087632 Al
`4/2011 Subramanian et al.
`2011/0093471 Al
`4/2011 Brockway et al.
`2011/0179414 Al * 7/2011 Goggin et al.
`2011/0219144 Al * 9/2011 Amit et al.
`2012/0084262 Al
`4/2012 Dwarampudi et al.
`2012/0254364 Al
`10/2012 Vijayan
`2013/0054533 Al * 2/2013 Hao et al.
`2013/0061014 Al
`3/2013 Prahlad et al.
`
`
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`EP
`WO
`WO
`
`0467546 A2
`0774715 Al
`0809184 Al
`0899662 Al
`0981090 Al
`WO-9513580 Al
`WO-9912098 Al
`
`1/1992
`5/1997
`11/1997
`3/1999
`2/2000
`5/1995
`3/1999
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 13/789,871, filed Mar. 8, 2013, Kumarasamy et al.
`U.S. Appl. No. 13/790,028, filed Mar. 8, 2013, Kumarasamy et al.
`U.S. Appl. No. 13/926,332, filed Jun. 25, 2013, Dwanunpudi et al.
`Armstead et al., "Implementation of a Campus-wide Distributed
`Mass Storage Service: The Dream vs. Reality," IFFF, Sep. 11-14,
`1995, pp. 190-199.
`Arneson, "Mass Storage Archiving in Network Environments,"
`Digest of Papers, Ninth IEEE Symposium on Mass Storage Systems,
`Oct. 31, 1988-Nov. 3, 1988, pp. 45-50, Monterey, CA.
`Brandon, J., "Virtualization Shakes Up Backup Strategy," <http://
`www.computerworld.com>, internet accessed on Mar. 6, 2008, 3
`pages.
`Cabrera et al., "ADSM: A Multi-Platform, Scalable, Backup and
`Archive Mass Storage System," Digest of Papers, Compcon '95,
`Proceedings of the 40th IEEE Computer Society International Con-
`ference, Mar. 5, 1995-Mar. 9, 1995, pp. 420-427, San Francisco, CA.
`CommVault Systems, Inc., "A CommVault White Paper: VMware
`
`718/1
`
`US 9,116,633 B2
`Page 2
`
`
`7,076,270 B2
`7,219,162 B2
`7,246,207 B2
`7,395,282 Bl
`7,448,079 B2
`7,552,279 BL*
`7,631,351 B2
`7,730,035 B2
`7,756,835 B2
`7,756,964 B2
`7,793,307 B2*
`7,840,537 B2
`7,882,077 B2
`7,899,788 B2
`7,937,421 B2
`8,069,271 B2
`8,140,786 B2
`8,219,524 B2
`8,307,177 B2
`8,578,126 BL*
`2004/0030668 Al*
`2004/0030822 Al*
`2006/0224846 Al
`2007/0100792 AL*
`2007/0203938 Al
`2007/0234302 Al*
`2008/0189468 Al*
`2008/0244177 Al*
`2008/0313371 Al*
`2009/0144416 Al
`2009/0222496 Al*
`2009/0300023 Al*
`2009/0319534 Al
`2009/0327471 Al
`2009/0327477 Al*
`2010/0070725 Al*
`2010/0161919 Al*
`2010/0242096 Al
`2010/0332454 Al
`2011/0087632 Al
`2011/0093471 Al
`2011/0179414 AL*
`2011/0219144 Al*
`2012/0084262 Al
`2012/0254364 Al
`2013/0054533 Al*
`2013/0061014 Al
`
`Jaggers et al.
`7/2006
`5/2007 Donker et al.
`7/2007
`Kottomtharayil et al.
`7/2008
`Crescenti et al.
`11/2008
`Tremain
`6/2009
`Gandler oo... 711/114
`“12/2009
`Erofeev
`6/2010
`Berger et al.
`7/2010
`Pugh
`7/2010
`Madison, Jr. et al.
`9/2010
`Gokhale etal. .............. 719/324
`11/2010
`Gokhale et al.
`2/2011
`Gokhale et al.
`3/2011
`Chandhok et al.
`5/2011
`Mikesell et al.
`11/2011
`Brunet et al.
`3/2012
`Bunte et al.
`7/2012
`Gokhale
`11/2012
`Prahlad et al.
`11/2013 Gaonkar et al 711/201
`2/2004 Pawlowski et al.
`. 707/1
`2/2004
`Rajanetal. wc
`ee 711/4
`10/2006 Amarendran et al.
`5/2007
`Lent et al. wee 707/1
`8/2007 Prahlad et al.
`10/2007
`Suzuki et al. oc. 717/126
`Schmidt et al. .... 711/6
`8/2008
`
`.711114
`10/2008
`Crescenti et al.
`..
`12/2008 Kedem etal. ..
`.. 710/68
`6/2009
`Chatley et al.
`9/2009
`Liu et al. woe 707/204
`12/2009
`Vaghani .pet 707/10
`12/2009
`Gokhale
`12/2009
`Astete et al.
`
`. 709/224
`12/2009
`Madison etal. ...
`. TLL/162
`3/2010
`Prahlad etal.
`.....
`6/2010 Dodgson et al 711161
`9/2010
`Varadharajan et al.
`12/2010 Prahlad et al.
`4/2011
`Subramanian et al.
`4/2011
`Brockway et al.
`7/2011
`Gogginetal. wee 718/1
`92011
`Amitetal. wo. 709/247
`4/2012 Dwarampudi et al.
`10/2012
`Vijayan
`2/2013
`再 ao et ae 707/649
`3/2013 Prahlad et al.
`
`
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`EP
`WO
`WO
`
`0467546 A2
`0774715 Al
`0809184 Al
`0899662 Al
`0981090 Al
`WO-9513580 Al
`WO-9912098 Al
`
`1/1992
`5/1997
`11/1997
`3/1999
`2/2000
`5/1995
`3/1999
`
`OTHER PUBLICATIONS
`
`U.S. Appl. No. 13/789,871, filed Mar. 8, 2013, Kumarasamy et al.
`US. Appl. No. 13/790,028, filed Mar. 8, 2013, Kumarasamy et al.
`USS. Appl. No. 13/926,332, filed Jun. 25, 2013, Dwarampudi et al.
`Armstead et
`al., “Implementation of a Campus-wide Distributed
`Mass Storage Service: The Dream vs. Reality,” JEEE, Sep. 11-14,
`1995, pp. 190-199.
`Arneson, “Mass Storage Archiving in Network Environments,”
`Digest of Papers, Ninth IEEE Symposium on Mass Storage Systems,
`Oct. 31, 1988-Nov. 3, 1988, pp. 45-50, Monterey, CA.
`Brandon, J., “Virtualization Shakes Up Backup Strategy,” <http://
`www.computerworld.com>, internet accessed on Mar. 6, 2008, 3
`pages.
`Cabrera et al., “ADSM: A Multi-Platform, Scalable, Backup and
`Archive Mass Storage System,” Digest of Papers, Compcon “95,
`Proceedings of the 40th IEEE Computer Society International Con-
`ference, Mar. 5, 1995-Mar. 9, 1995, pp. 420-427, San Francisco, CA.
`CommVault Systems, Inc., “A CommVault White Paper: VMware
`
`
`
`
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4/1991
`3/1992
`T1992
`3/1993
`5/1993
`7/1993
`8/1993
`8/1993
`8/1993
`1/1994
`1/1994
`2/1994
`6/1994
`7/1994
`9/1994
`4/1995
`9/1995
`2/1996
`2/1996
`4/1996
`8/1996
`8/1996
`9/1996
`4/1997
`6/1997
`9/1997
`12/1997
`3/1998
`5/1998
`5/1998
`6/1998
`6/1998
`7/1998
`9/1998
`9/1998
`9/1998
`2/1999
`3/1999
`5/1999
`7/1999
`9/1999
`10/1999
`2/2000
`2/2000
`4/2000
`6/2000
`7/2000
`10/2000
`10/2000
`11/2000
`11/2000
`12/2000
`12/2000
`4/2001
`7/2001
`7/2001
`8/2001
`10/2001
`11/2001
`12/2001
`12/2001
`12/2001
`1/2002
`3/2002
`3/2002
`5/2002
`5/2002
`7/2002
`11/2002
`2/2003
`3/2003
`§/2003
`6/2003
`“12/2003
`4/2006
`
`Griffin et al.
`Dong et al.
`Cheffetz et al.
`Kitajima et al.
`Masters
`Nakano et al.
`Anglin et al.
`Eastridge et al.
`Eastridge et al.
`Fortier et al.
`Kenley et al.
`Stoppani, Jr.
`Rogan et al.
`Saether et al.
`Flynn et al.
`Fecteau et al.
`Hayashi
`Allen
`Pisello et al.
`Martin et al.
`Carpenter et al.
`Yanai et al.
`Balk
`Crockett et al.
`Dunphy et al.
`Huai et al.
`Ding et al.
`Squibb
`Kullick et al.
`Saxon
`Senator et al.
`Crouse et al.
`Whiting et al.
`Nielsen
`Johnson et al.
`Mortis
`Blumenau
`Ebrahim
`Ofek
`Perks
`Aviani, Jr.
`Beeler, Jr.
`Cannon et al.
`Anglin
`Ulrich et al.
`Kedem
`Ying
`Low et al.
`Sidwell
`Cannon et al.
`Urevig et al.
`Mutalik et al.
`Yeager
`Barney et al.
`Anglin
`Dunham
`Vahalia et al.
`Aoyama et al.
`Xu et al.
`Long
`Crighton
`Carteau
`Hubis et al.
`Eastridge et al.
`Goodman et al.
`Pothapragada et al.
`Devine et al. wee 718/1
`Blumenau et al.
`Ofek et al.
`Devireddy et al.
`Lagueux, Jr. et al.
`O’Connor
`Ching et al.
`Nguyen et al.
`Crescenti et al.
`
`PRE EEE EES ESE EEE SESE ESE EEE EEE EEL EEE ES ES ESE EEE EEE EE EE ES
`
`Bl
`Bl
`Bl
`Bl
`B1
`B1
`B1
`Bl
`Bl
`Bl
`E
`Bl
`Bl
`
`Bl
`Bl
`B2
`Bl
`Bl
`Bl
`B2
`Bl
`
`5,005,122
`5,093,912
`5,133,065
`5,193,154
`5,212,772
`5,226,157
`5,239,647
`5,241,668
`5,241,670
`5,276,860
`5,276,867
`5,287,500
`5,321,816
`5,333,315
`5,347,653
`5,410,700
`5,448,724
`5,491,810
`5,495,607
`5,504,873
`5,544,345
`5,544,347
`5,559,957
`5,619,644
`5,638,509
`5,673,381
`5,699,361
`5,729,743
`5,751,997
`5,758,359
`5,761,677
`5,764,972
`5,778,395
`5,812,398
`5,813,009
`5,813,017
`5,875,478
`5,887,134
`5,901,327
`5,924,102
`5,950,205
`5,974,563
`6,021,415
`6,026,414
`6,052,735
`6,076,148
`6,094,416
`6,131,095
`6,131,190
`6,148,412
`6,154,787
`6,161,111
`6,167,402
`6,212,512
`6,260,069
`6,269,431
`6,275,953
`6,301,592
`6,324,581
`6,328,766
`6,330,570
`6,330,642
`6,343,324
`RE37,601
`6,356,801
`6,389,432
`6,397,242
`6,421,711
`6,487,561
`6,519,679
`6,538,669
`6,564,228
`6,581,076
`6,658,526
`7,035,880
`
`

`

`US 9,116,633 B2
`Page 3
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Consolidated Backup (VCB) Certification Information Kit," 2007,
`23 pages.
`CommVault Systems, Inc., "CommVault Solutions—VMware,"
`<http://www.commvault.com/solutions/vmware/>,
`internet
`accessed Mar. 24, 2008, 2 pages.
`CommVault Systems, Inc., "Enhanced Protection and Manageability
`of Virtual Servers," Partner Solution Brief, 2008, 6 pages.
`Davis, D., "3 VMware Consolidated Backup (VCB) Utilities You
`Should Know," Petri IT Knowlegebase, <http://wwvv.petri.co.i1/
`vmware-consolidated-backup-utilities.htm>, internet accessed on
`Jul. 14, 2008, 7 pages.
`Davis, D., "Understanding VMware VMX Configuration Files," Petri
`IT Knowledgebase, <http://vvww.petri.co.il/virtual_vmware_
`vmx_configuration_files.htm>, internet accessed on Jun. 19, 2008,
`6 pages.
`Davis, D., "VMware Server & Workstation Disk Files Explained,"
`Petri IT Knowledgebase, <http://www.petri.co.illvirtual_vmware_
`files_explained.htm>, internet accessed on Jun. 19, 2008, 5 pages.
`Davis, D., "VMware Versions Compared," Petri IT Knowledgebase,
`<http://www.petri.co.illvirtual_vmware_versions_compared.
`htm>, internet accessed on Apr. 28, 2008, 6 pages.
`Eitel, "Backup and Storage Management in Distributed Heteroge-
`neous Environments," IEEE, Jun. 12-16, 1994, pp. 124-126.
`International Preliminary Report on Patentability and Written Opin-
`ion for PCT/US2011/054374, dated Apr. 11, 2013, 6 pages.
`International Search Report and Written Opinion for PCT/US2011/
`054374, dated May 2, 2012, 9 pages.
`Jander, M., "Launching Storage-Area Net," Data Communications,
`US, McGraw Hill, NY, vol. 27, No. 4 (Mar. 21, 1998), pp. 64-72.
`Jason Gait, "The Optical File Cabinet: A Random-Access File Sys-
`tem for Write-Once Optical Disks," IEEE Computer, vol. 21, No. 6,
`pp. 11-22 (Jun. 1988).
`Microsoft Corporation, "How NTFS Works," Windows Server
`TechCenter, updated Mar. 28, 2003, internet accessed Mar. 26, 2008,
`26 pages.
`Rosenbhun et al., "The Design and Implementation of a Log-Struc-
`tured File System," Operating Systems Review SIGOPS, vol. 25, No.
`5, New York, US, pp. 1-15 (May 1991).
`Sanbarrow.com, "Disktype-table," <http://sanbarrow.corn/vmdlc/
`disIctypes.htrnl>, internet accessed on Jul. 22, 2008, 4 pages.
`Sanbarrow.com, "Files I 'sett by a VM," <http://sanbarrow.com/vmx/
`vmx-files-used-by-avm.html>, internet accessed on Jul. 22, 2008, 2
`pages.
`Sanbarrow.com, "Monolithic Versus Split Disks," <http://sanbarrow.
`com/vmdk/monolithicversusspllit.html>, internet accessed on Jul.
`14, 2008, 2 pages.
`VMware, Inc., "Open Virtual Machine Format," <http://vvvvw.
`vmware.corn/appliances/leam/ovfhtml>, internet accessed on May
`6, 2008, 2 pages.
`VMware, Inc., "OVF, Open Virtual Machine Format Specification,
`version 0.9," White Paper, <http://www.vmware.com>, 2007, 50
`pages.
`VMware, Inc., "The Open Virtual Machine Format Whitepaper for
`OVF Specification, version 0.9," White Paper, <http://www.vmware.
`corn>, 2007, 16 pages.
`VMware, Inc., "Understanding VMware Consolidated Backup,"
`White Paper, <http://www.vmware.com>, 2007, 11 pages.
`
`VMware, Inc., "Using VMware Infrastructure for Backup and
`Restorer Best Practices, <http://www.vmware.com>, 2006, 20
`pages.
`VMware, Inc., "Virtual Disk API Programming Guide," <http://
`www.vmware.com>, Revision Apr. 11, 2008, 2008, 44 pages.
`VMware, Inc., "Virtual Disk Format 1.1," VMware Technical Note,
`<http://www.vmware.com>, Revision Nov. 13, 2007, Version 1.1,
`2007, 18 pages.
`VMware, Inc., "Virtual Machine Backup Guide, ESX Server 3.0.1
`and VirtualCenter 2.0.1," <http://www.vmware.com>, updated Nov.
`21, 2007, 74 pages.
`VMware, Inc., "Virtual Machine Backup Guide, ESX Server 3.5,
`ESX Server 3i version 3.5, VirtualCenter 2.5," <http://www.vmware.
`com>, updated Feb. 21, 2008, 78 pages.
`VMware, Inc., "Vittualized iSCSI Sans: Flexible, Scalable Enter-
`prise Storage for Virtual Infrastructures," White Paper, <http://www.
`vmware.com>, Mar. 2008, 13 pages.
`VMware, Inc., "VMware Consolidated Backup, Improvements in
`Version 3.5," Information Guide, <http://www.vmware.com>, 2007,
`11 pages.
`VMware, Inc., "VMware Consolidated Backup," Product Datasheet,
`<http://www.vmware.com>, 2007, 2 pages.
`VMvvare, Inc., "VMware ESX 3.5," Product Datasheet, <http://vvvvw.
`vmware.com>, 2008, 4 pages.
`VMware, Inc., "VMware GSX Server 3.2, Disk Types: Virtual and
`Physical,"
`<http://www.vmware.com/support/gsx3/doc/disks_
`types_gsx.html>, internet accessed on Mar. 25, 2008, 2 pages.
`VMware, Inc., "VMware OVF Tool," Technical Note, <http://www.
`vmware.com>, 2007, 4 pages.
`VMware, Inc., "VMware Workstation 5.0, Snapshots in a Linear
`Process,"
`<http:/vvww.vmware.corn/support/ws5/doc/ws_pre-
`serve_sshot_linear.html>, internet accessed on Mar. 25, 2008, 1
`page.
`VMware, Inc., "VMware Workstation 5.0, Snapshots in a Process
`Tree," <http://wvvw.vmware.corn/support/ws5/doc/ws_preserve_
`sshot_tree.html>. internet accessed on Mar. 25, 2008, 1 page.
`VMware, Inc., "VMware Workstation 5.5, What Files Make Up a
`Virtual Machine?" <http://www.vmware.cona/support/ws55/doc/
`ws_leaming_files_in_a_vm.html>, internet accessed on Mar. 25,
`2008, 2 pages.
`Wikipedia, "Cluster (file system)," <http://en.wilcipedia.org/wili/
`Cluster_%28file_system%29>, internet accessed Jul. 25, 2008, 1
`page.
`Wikipedia, "Cylinder-head-sector," <http://en.wikipedia.org/wilci/
`Cylinder-head-sector>, internet accessed Jul. 22, 2008, 6 pages.
`Wikipedia, "File Allocation Table," <http://en.wilcipedia.org/wilci/
`File_Allocation_Table>, internet accessed on Jul. 25, 2008, 19
`pages.
`Wikipedia, "Logical Disk Manager," <http://en.wikipedia.org/wilci/
`Logical_Disk_Manager>, internet accessed Mar. 26, 2008, 3 pages.
`Wikipedia, "Logical vol. Management," <http://en.wikipedia.org/
`wilci/Logical_volume_management>, internet accessedon Mar. 26,
`2008, 5 pages.
`Wikipedia, "Storage Area Network," <http://en.wikipedia.org/wilci/
`Storage_area_network>, internet accessed on Oct. 24, 2008, 5
`pages.
`<http://en.wikipedia.org/wilci/
`"Virtualization,"
`Wikipedia,
`Vimialization>, internet accessed Mar. 18, 2008, 7 pages.
`
`* cited by examiner
`
`US 9,116,633 B2
`Page 3
`
`
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Consolidated Backup (VCB) Certification Information Kit,” 2007,
`23 pages.
`Inc., “CommVault Solutions—VMware,”
`CommVault Systems,
`<http://www.commvault.com/solutions/vmware/>,
`internet
`accessed Mar. 24, 2008, 2 pages.
`CommVault Systems, Inc., “Enhanced Protection and Manageability
`of Virtual Servers,” Partner Solution Brief, 2008, 6 pages.
`Davis, D., “3 VMware Consolidated Backup (VCB) Utilities You
`Should Know.” Petri
`IT Knowlegebase, <http://www.petri.co.il/
`vmware-consolidated-backup-utilities.htm>, internet accessed on
`Jul. 14, 2008, 7 pages.
`Davis, D., “Understanding VMware VMX Configuration Files,” Petri
`
`IT
`Knowledgebase, — <http:/www.petri.co.il/virtual_vmware_
`vmx_ configuration files.htm>, internet accessed on Jun. 19, 2008,
`6 pages.
`Davis, D., “WMware Server & Workstation Disk Files Explained,”
`Petri IT Knowledgebase, <http://www.petri.co.il/virtual_vmware_
`files_explained.htm>, internet accessed on Jun. 19, 2008, 5 pages.
`Davis, D., “VMware Versions
`Compared.” Petri IT Knowledgebase,
`<http://www.petri.co.il/virtual_vmware__versions__compared.
`htm>, internet accessed on Apr. 28, 2008, 6 pages.
`Eitel, “Backup and Storage Management in Distributed Heteroge-
`neous Environments,” JEEE, Jun. 12-16, 1994, pp. 124-126.
`International Preliminary Report on Patentability and Written Opin-
`ion for PCT/US2011/054374, dated Apr. 11, 2013, 6 pages.
`International Search Report and Written Opinion for PCT/US2011/
`054374, dated May 2, 2012, 9 pages.
`Jander, M., “Launching Storage-Area Net,’ Data Communications,
`US, McGraw Hill, NY, vol. 27, No. 4 (Mar. 21, 1998), pp. 64-72.
`Jason Gait, “The Optical File
`Cabinet:
`A Random-Access File Sys-
`tem for Write-Once Optical Disks,” JEEE Computer, vol. 21, No. 6,
`pp. 11-22 (Jun. 1988).
`Microsoft Corporation, “How NTFS Works,” Windows Server
`TechCenter, updated Mar. 28, 2003, internet accessed Mar. 26, 2008,
`26 pages.
`Rosenblum et al., “The Design and Implementation of a Log-Struc-
`tured File System,” Operating Systems Review SIGOPS, vol. 25, No.
`5, New York, US, pp. 1-15 (May 1991).
`Sanbarrow.com,
`“Disktype-table.”
`<http://sanbarrow.com/vmdk/
`disktypes.html>, internet accessed on Jul. 22, 2008, 4 pages.
`Sanbarrow.com, “Files Used by a VM,” <http://sanbarrow.com/vmx/
`vmx-files-used-by-avm.html>, internet accessed on Jul. 22, 2008, 2
`pages.
`Sanbarrow.com, “Monolithic Versus Split Disks,” <http://sanbarrow.
`com/vmdk/monolithicversusspllit-html>, internet accessed on Jul.
`14, 2008, 2 pages.
`VMware, Inc., “Open Virtual Machine Format,” <http://www.
`vmware.com/appliances/learn/ovf.html>, internet accessed on May
`6, 2008, 2 pages.
`VMware, Inc., “OVF, Open Virtual Machine Format Specification,
`version 0.9,” White Paper, <http://www.vmware.com>, 2007, 50
`pages.
`VMware, Inc., “The Open Virtual Machine Format Whitepaper for
`OVF Specification, version 0.9,” White Paper, <http:/‘www.vmware.
`com>, 2007, 16 pages.
`VMware, Inc., “Understanding VMware Consolidated Backup,”
`White Paper, <http://www.vmware.com>, 2007, 11 pages.
`
`VMware, Inc., “Using VMware Infrastructure for Backup and
`Restore.” Best
`Practices, <http://www.vmware.com>, 2006, 20
`pages.
`VMware, Inc., “Virtual Disk API Programming Guide,” <http://
`www.vmware.com>, Revision Apr. 11, 2008, 2008, 44 pages.
`VMware, Inc., “Virtual Disk Format 1.1,’ VMware Technical Note,
`<http://www.vmware.com>, Revision Nov. 13, 2007, Version 1.1,
`2007, 18 pages.
`VMware, Inc., “Virtual Machine Backup Guide, ESX Server 3.0.1
`and VirtualCenter 2.0.1,” <http://www.vmware.com>, updated Nov.
`21, 2007, 74 pages.
`VMware, Inc., “Virtual Machine Backup Guide, ESX Server 3.5,
`ESX Server 3i version 3.5, VirtualCenter 2.5,” <http://www.vmware.
`com>, updated Feb. 21, 2008, 78 pages.
`VMware, Inc., “Virtualized iSCSI Sans: Flexible, Scalable Enter-
`prise Storage for Virtual Infrastructures,” White Paper, <http://www.
`vmware.com>, Mar. 2008, 13 pages.
`VMware, Inc., “VMware Consolidated Backup, Improvements in
`Version 3.5,” Information Guide, <http://www.vmware.com>, 2007,
`11 pages.
`VMware, Inc., “WMware Consolidated Backup,” Product Datasheet,
`<http://www.vmware.com>, 2007, 2 pages.
`VMware, Inc.,““WMware ESX 3.5,” Product Datasheet, <http://www.
`vmware.com>, 2008, 4 pages.
`VMware, Inc., “VMware GSX Server 3.2, Disk Types: Virtual and
`Physical,”
`<http://www.vmware.com/support/gsx3/doc/disks
`types__gsx.html>, internet accessed on Mar. 25, 2008, 2 pages.
`VMware, Inc., “WMware OVF Tool,” Technical Note, <http://www.
`vmware.com>, 2007, 4 pages.
`a Linear
`VMware, Inc., “VMware Workstation 5.0, Snapshots in
`Process,”
`
`<http:/www.vmware.com/ support’ ws5/doc/ws__pre-
`serve_sshot_linear.html>, internet accessed on Mar. 25, 2008, 1
`page.
`VMware, Inc., “WMware Workstation 5.0, Snapshots in a Process
`Tree.”
`<http://www.vmware.com/support/ws5/doc/ws_preserve_
`sshot_tree.html>. internet accessed on Mar. 25, 2008, | page.
`VMware, Inc., “VMware Workstation 5.5, What Files Make Up a
`Virtual
`Machine?” <http:/‘www.vmware.com/support/ws55/doc/
`ws_learning _files_in_a_vm.html>, internet accessed on Mar. 25,
`2008, 2 pages.
`Wikipedia, “Cluster (file system),” <http://en.wikipedia.org/wiki/
`Cluster_°28file_system%29>, internet accessed Jul. 25, 2008, 1
`page.
`Wikipedia, “Cylinder-head-sector,” <http://en.wikipedia.org/ wiki!
`
`Cylinder-head-sector>, internet accessed Jul. 22, 2008, 6 pages.
`Wikipedia, “File Allocation Table,” <http://en.wikipedia.org/wiki!
`File_ Allocation
`Table>, internet accessed on Jul. 25, 2008, 19
`pages.
`Wikipedia, “Logical Disk Manager,” <http://en.wikipedia.org/wiki/
`Logical_Disk_Manager>, internet accessed Mar. 26, 2008, 3 pages.
`Wikipedia, “Logical vol. Management,” <http://en.wikipedia.org/
`wiki/Logical_volume_management>, internet accessed on Mar. 26,
`2008, 5 pages.
`Wikipedia, “Storage Area Network,” <http://en.wikipedia.org/ wiki’
`
`Storage_area_network>, internet accessed on Oct. 24, 2008, 5
`pages.
`<http://en.wikipedia.org/wiki/
`“Virtualization,”
`Wikipedia,
`Virtualization>, internet accessed Mar. 18, 2008, 7 pages.
`
`* cited by examiner
`
`

`

`lualed *S*11
`
`ifoz `gz Inv
`
`Zi Jo I laatIS
`
`ZH ££9`9IT`6 Sit
`
`1106
`
`108 virtual machine host 105a
`virtual machine 110a
`app
`
`101a
`
`client
`
`101b
`
`client
`
`101c
`
`client
`
`101d
`
`client
`
`101e
`
`client
`
`102a
`physical machine A
`
`app
`
`103a
`
`os Fr 107a
`
`production
`data store
`
`102b
`physical machine B
`
`app
`
`OS
`
`103b
`
`107b
`
`production .---109b
`data store
`
`. . .
`
`102n
`physical machine N
`
`app
`
`OS
`
`production
`data store
`
`103n
`
`107n
`
`109n
`
`104A
`
`111
`DR test
`module
`
`104B
`
`113
`migration
`module
`
`100
`
`115a
`120a
`
`115b
`120b
`
`135a
`
`140a
`
`1
`1
`
`150
`virtual
`machine
`manager
`
`OS
`
`virtual machine 110b
`app
`
`OS
`
`productior
`data store
`
`virtual disk
`
`virtual
`
`virtual machine 110c
`app
`
`OS
`
`virtual machine 110d
`
`aPP
`
`OS
`
`e---production
`ata store
`
`virtual disk
`
`115c
`
`120c
`
`115d
`120d
`
`135b
`
`140c
`
`FIG. lA
`
`virtual disk
`
`140d
`------
`
`virtual machine host 105
`
`yuayed Sn
`
`ST0Z'SZ “Sny
`
`ZL JO T199US
`
`7d cc99IT6Sr1
`
`|
`
`|
`
`|
`|
`
`|
`
`_
`
`135a |
`|
`—140a |
`
`
`Virtual
`machine
`
`manager |
`
`一 115c
`
`7
`
`120c
`
`115d
`一 120d
`
`|
`|
`|
`|
`|
`|
`|
`|
`|
`圖 |
`
`[ae
`[sms
`
`+
`+
`
`
`
`108) virtual machine host 105a
`virtual machine 110a
`Lapp 小 盖
`Luss hy
`
`
`100
`
`| J
`
`|
`
`|
`|
`
`|
`
`115a
`
`120a
`
`一 115b
`
`一 120b
`
`virtual machine 110b
`
`
`
`
`production
`data store
`
`
`
`106
`
`
`101a
`
`，
`client
`
`
`
`pp 一 个 103a
`
`[os
`Ho
`
`
`
`
`101b
`
`
`client
`
`
`
`
`
`109a
`
`production
`data store
`
`102b
`physical machine B
`
`[app i -+103»
`[os
`prov
`
`
`
`
`production
`
`data store
`
`
`101c
`
`
`client
`
`
`
`
`
`人 109b
`
`
`
`
`
`
`eee
`
`102n
`
`hysical machine N
`
`101d
`re
`
`client
`[app 十 直 03n
`Les hy pt07 |
`
`
`
`
`101e
`
`
`
`
`
`
`client
`
`
`
`production
`data store
`
`m10Sn
`
`[
`
`|
`|
`|
`
`|
`
`|
`|
`|
`|
`
`FIG. 1A
`
`
`
`104A
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`virtual machine 110d
`
`Ls 小 一
`
`
`
`
`
`
`
`
`
`

`

`lualed *S*11
`
`ifoz `gz Inv
`
`Zi to Z laatiS
`
`ZH ££9`9IT`6 Sit
`
`101a
`
`client
`
`101b
`
`client
`
`101c
`
`client
`
`101d
`
`client
`
`101e
`
`client
`
`102a
`physical machine A
`
`app
`
`OS
`
`103a
`
`107a
`
`production
`data store
`
`109a
`
`102b
`physical machine B
`
`app
`
`OS
`
`production
`data store
`
`103b
`
`107b
`
`109b
`
`• • •
`
`102n
`physical machine N
`
`app
`
`OS
`
`103n
`
`107n
`
`production -----109n
`data store
`
` 106
`
`150
`
`MI
`
`158
`160a
`