(12) United States Patent
`Hoese et a].
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,051,147 B2
`*May 23, 2006
`
`US007051147B2
`
`(54)
`
`(75)
`
`STORAGE ROUTER AND METHOD FOR
`PROVIDING VIRTUAL LOCAL STORAGE
`
`Inventors: Geo?rey B. Hoese, Austin, TX (US);
`Je?ry T. Russell, Cibolo, TX (US)
`
`(73)
`
`Assignee: Crossroads Systems, Inc., Austin, TX
`(Us)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis
`claimer.
`
`App1.No.: 10/658,163
`
`Filed:
`
`Sep. 9, 2003
`
`Prior Publication Data
`
`US 2004/0054838 A1
`
`Mar. 18, 2004
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`3/1963 Stevens
`3,082,406 A
`5/1978 Ouchi
`4,092,732 A
`4,415,970 A 11/1983 Swenson et a1.
`4,455,605 A
`6/1984 Cormier et a1.
`4,504,927 A
`3/1985 Callan
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`EP
`
`0810 530 A2 12/1997
`
`(Continued)
`OTHER PUBLICATIONS
`DIGITAL StorageWorks, Using Your HSZ70 Array Control
`ler in a SCSI Controller Shelf (DS-BA356-M Series), User ’s
`Guide, pp. 1-1 through A-5 With index, Jan. 1998.
`(Continued)
`Primary Examiner4Christopher Shin
`(74) Attorney, Agent, or F irmiSprinkle IP LaW Group
`
`(21)
`
`(22)
`
`(65)
`
`(63)
`
`(51)
`
`(52)
`(58)
`
`Related US. Application Data
`
`(57)
`
`ABSTRACT
`
`Continuation of application No. 10/081,110, ?led on
`Feb. 22, 2002, noW Pat. No. 6,789,152, Which is a
`continuation of application No. 09/354,682, ?led on
`Jul. 15, 1999, noW Pat. No. 6,421,753, Which is a
`continuation of application No. 09/001,799, ?led on
`Dec. 31, 1997, noW Pat. No. 5,941,972.
`
`Int. Cl.
`(2006.01)
`G06F 13/00
`US. Cl. ....................... .. 710/305; 710/11; 709/258
`Field of Classi?cation Search .............. .. 710/1*5,
`710/8*13, 22428, 1044105, 3054306, 325,
`710/250, 1264131, 36438; 709/250, 258;
`714/42; 711/112,113,110
`See application ?le for complete search history.
`
`A storage router and storage network provide virtual local
`storage on remote storage devices to Fiber Channel devices.
`A plurality of Fiber Channel devices, such as Workstations,
`are connected to a Fiber Channel transport medium, and a
`plurality of storage devices are connected to a second Fiber
`Channel transport medium. The storage router interfaces
`betWeen the Fiber Channel transport media. The storage
`router maps betWeen the Workstations and the storage
`devices and implements access controls for storage space on
`the storage devices. The storage router then alloWs access
`from the Workstations to the storage devices using native
`loW level, block protocol in accordance With the mapping
`and the access controls.
`
`39 Claims, 2 Drawing Sheets
`
`60
`
`STORAGE DEVICE
`GLOBAL
`
`65
`
`62
`
`53
`53
`5%
`WORKSTATION WORKSTATION WORKSTATION
`A
`B
`C
`
`1
`fFlBRE
`
`/
`
`}
`
`56
`\
`STORAGE
`ROUTER
`
`}
`
`I :
`t MANAGEMENT
`52 T N WORKSTATION : l
`CHANNEL
`
`
`
`
`WORKSDTA '0
`E
`L’ sTAT|0N ‘J
`/
`/
`/
`58
`76
`
`58
`
`/
`50
`
`STORAGE DEVICE
`WORKSTATION
`E STORAGE
`
`SCSI
`BUS
`\
`
`54
`
`STORAGE mm
`WORKSTATION
`56
`A STORAGE
`
`WORKSTATION B STORAGE
`
`WORKSTATION
`C STORAGE
`WORKsTATION
`D STORAGE
`
`70
`
`72
`
`NetApp Ex. 1001, pg. 1
`
`

`

`US 7,051,147 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`4,533,996
`4,573,152
`4,603,380
`4,620,295
`4,644,462
`4,695,948
`4,697,232
`4,751,635
`4,787,028
`4,807,180
`4,811,278
`4,821,179
`4,825,406
`4,827,411
`4,835,674
`4,864,532
`4,897,874
`4,947,367
`4,961,224
`5,072,378
`5,077,732
`5,077,736
`5,124,987
`5,155,845
`5,163,131
`5,185,876
`5,193,168
`5,193,184
`5,202,856
`5,210,866
`5,212,785
`5,214,778
`5,226,143
`5,239,632
`5,239,643
`5,239,654
`5,247,638
`5,247,692
`5,257,386
`5,297,262
`5,301,290
`5,315,657
`5,317,739
`5,331,673
`5,347,384
`5,361,347
`5,367,646
`5,379,385
`5,379,398
`5,388,243
`5,388,246
`5,394,526
`5,396,596
`5,403,639
`5,410,667
`5,410,697
`5,414,820
`5,416,915
`5,418,909
`5,420,988
`5,423,026
`5,423,044
`5,426,637
`5,430,855
`5,450,570
`5,452,421
`5,459,857
`5,463,754
`5,465,382
`5,469,576
`5,471,609
`
`8/1985
`2/1986
`7/1986
`10/1986
`2/1987
`9/1987
`9/1987
`6/1988
`11/1988
`2/1989
`3/1989
`4/1989
`4/1989
`5/1989
`5/1989
`9/1989
`1/1990
`8/1990
`10/1990
`12/1991
`12/1991
`12/1991
`6/1992
`10/1992
`11/1992
`2/1993
`3/1993
`3/1993
`4/1993
`5/1993
`5/1993
`5/1993
`7/1993
`8/1993
`8/1993
`8/1993
`9/1993
`9/1993
`10/1993
`3/1994
`4/1994
`5/1994
`5/1994
`7/1994
`9/1994
`11/1994
`11/1994
`1/1995
`1/1995
`2/1995
`2/1995
`2/1995
`3/1995
`4/1995
`4/1995
`4/1995
`5/1995
`5/1995
`5/1995
`5/1995
`6/1995
`6/1995
`6/1995
`7/1995
`9/1995
`9/1995
`10/1995
`10/1995
`11/1995
`11/1995
`11/1995
`
`Gartung et al.
`Greene et al.
`Easton et al.
`Aiden, Jr.
`Matsubara et al.
`Blevins et al.
`Brunelle et al.
`Kret
`Finforck et al.
`Takeuchi et al.
`Bean et al.
`Jensen et al.
`Bean et al.
`Arrowood et al.
`Collins et al.
`Reeve et al.
`Lidensky et al.
`Chang et al.
`Yung
`Manka
`Fischer et al.
`Dunphy, Jr. et al.
`Milligan et al.
`Beal et al.
`Row et al.
`Nguyen et al.
`Corrigan et al.
`Belsan et al.
`Glider et al.
`Milligan et al.
`Powers et al.
`Glider et al.
`Baird et al.
`Larner
`Blount et al.
`Ing-Simmons
`O’Brien et al.
`Fujimura
`Saito
`CoX et al.
`TetZlafI" et al.
`Abadi et al.
`Elko et al.
`Elko et al.
`McReynolds et al.
`Glider et al.
`Pardillos et al.
`Shomler
`Cohn et al.
`Glider et al.
`Kasai
`Crouse et al.
`Hashemi et al.
`Belsan et al.
`Belsan et al.
`Baird et al.
`McFarland et al.
`Mattson et al.
`JachoWski et al.
`Elliott
`Cook et al.
`Sutton et al.
`Derby et al.
`Wash et al.
`Richek et al.
`Beardsley et al.
`Ludlam et al.
`Beausoleil et al.
`Day, 111 et al.
`Dauerer et al.
`Yudenfriend
`
`5,487,077
`5,491,812
`5,495,474
`5,496,576
`5,504,857
`5,507,032
`5,511,169
`5,519,695
`5,530,845
`5,535,352
`5,537,585
`5,544,313
`5,548,791
`5,564,019
`5,568,648
`5,581,709
`5,581,714
`5,581,724
`5,596,562
`5,596,736
`5,598,541
`5,613,082
`5,621,902
`5,632,012
`5,634,111
`5,638,518
`5,642,515
`5,659,756
`5,664,107
`5,680,556
`5,701,491
`5,712,976
`5,727,218
`5,729,705
`5,743,847
`5,748,924
`5,751,975
`5,768,623
`5,774,683
`5,781,715
`5,802,278
`5,805,816
`5,809,328
`5,812,754
`5,835,496
`5,845,107
`5,848,251
`5,857,080
`5,860,137
`5,864,653
`5,867,648
`5,884,027
`5,889,952
`5,913,045
`5,923,557
`5,933,824
`5,935,260
`5,941,969
`5,941,972
`5,953,511
`5,959,994
`5,974,530
`5,978,379
`5,991,797
`6,000,020
`6,021,451
`6,041,381
`6,055,603
`6,065,087
`6,070,253
`6,073,209
`6,073,218
`6,075,863
`
`1/1996
`2/1996
`2/1996
`3/1996
`4/1996
`4/1996
`4/1996
`5/1996
`6/1996
`7/1996
`7/1996
`8/1996
`8/1996
`10/1996
`10/1996
`12/1996
`12/1996
`12/1996
`1/1997
`1/1997
`1/1997
`3/1997
`4/1997
`5/1997
`5/1997
`6/1997
`6/1997
`8/1997
`9/1997
`10/1997
`12/1997
`1/1998
`3/1998
`3/1998
`4/1998
`5/1998
`5/1998
`6/1998
`6/1998
`7/1998
`9/1998
`9/1998
`9/1998
`9/1998
`11/1998
`12/1998
`12/1998
`1/1999
`1/1999
`1/1999
`2/1999
`3/1999
`3/1999
`6/1999
`7/1999
`8/1999
`8/1999
`8/1999
`8/1999
`9/1999
`9/1999
`10/1999
`11/1999
`11/1999
`12/1999
`2/2000
`3/2000
`4/2000
`5/2000
`5/2000
`6/2000
`6/2000
`6/2000
`
`Hassner et al.
`Pisello et al.
`OlnoWich et al.
`Jeong
`Baird et al.
`Kimura
`Suda
`Purohit et al.
`Hiatt et al.
`Bridges et al.
`Blickersta?C et al.
`Shachnai et al.
`Casper et al.
`Beausoleil et al.
`Coscarella et al.
`Ito et al.
`Amini et al.
`Belsan et al.
`Chen
`Kerns
`Malladi
`Brewer et al.
`Cases et al.
`Belsan et al.
`Oeda et al.
`Malladi
`Jones et al.
`Helferon et al.
`ChatWani et al.
`Begun et al.
`Dunn et al.
`Falcon, Jr. et al.
`Hotchkin
`Weber
`Nakamura et al.
`Llorens et al.
`Gillespie et al.
`Judd et al.
`Gulick
`Sheu
`Isfeld et al.
`PicaZo, Jr. et al.
`Nogales et al.
`Lui et al.
`Yeung et al.
`Fisch et al.
`Lomelino et al.
`Jander et al.
`RaZ et al.
`Tavallaei et al.
`Foth et al.
`Garbus et al.
`Hunnicutt et al.
`Gillespie et al.
`Eidson
`DeKoning et al.
`Ofer
`Ram et al.
`Hoese et al. .............. .. 710/315
`Sescilia et al.
`Boggs et al.
`Young
`Chan et al. ............... .. 370/403
`Futral et al.
`Chin et al. ................ .. 711/162
`Bell et al.
`Hoese
`Ofer et al.
`Keaveny et al.
`Tavallaei et al.
`Bergsten
`DeKoning et al.
`Krishnan et al.
`
`NetApp Ex. 1001, pg. 2
`
`

`

`US 7,051,147 B2
`Page 3
`
`6/2000 Born et a1.
`6,081,849 A
`8/2000 Ofer et a1.
`6,098,149 A
`8/2000 DeKoning et al.
`6,108,684 A
`9/2000 Akers
`6,118,766 A
`6,131,119 A 10/2000 Fukui
`6,134,617 A 10/2000 Weber
`6,141,737 A 10/2000 Krantz et a1.
`6,145,006 A 11/2000 Vishlitsky et a1.
`6,148,004 A 11/2000 Nelson et al.
`6,185,203 B1* 2/2001 Berman .................... .. 370/351
`6,209,023 B1
`3/2001 Dimitroff et a1.
`6,219,771 B1
`4/2001 Kikuchi et a1.
`6,223,266 B1
`4/2001 Sartore
`6,230,218 B1
`5/2001 Casper et 31.
`6,260,120 B1
`7/2001 Blumenau et al.
`6,330,629 B1
`12/2001 Kondo et a1.
`6,341,315 B1
`1/2002 Arroyo et al.
`6,343,324 B1
`1/2002 Hubis et a1.
`6,363,462 B1
`3/2002 Bergsten
`6,421,753 B1* 7/2002 Hoese et a1. .............. .. 710/305
`6,425,035 B1* 7/2002 Hoese et a1. .............. .. 710/105
`6,425,036 B1
`7/2002 Hoese et al.
`6,484,245 B1
`11/2002 Sanada et a1.
`6,529,996 B1
`3/2003 Nguyen et 31.
`6,738,854 B1* 5/2004 Hoese et a1. .............. .. 710/305
`6,763,419 B1* 7/2004 Hoese et a1.
`709/250
`6,789,152 B1* 9/2004 Hoese et a1. .............. .. 710/305
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`GB
`GB
`GB
`JP
`JP
`W0
`W0
`
`0827059 A2
`2296798 A
`2297636 A
`2341715
`6301607
`8-230895
`WO 98/36357
`WO 99/34297 A1
`
`3/1998
`7/1996
`8/1996
`3/2000
`10/1994
`9/1996
`8/1998
`7/1999
`
`OTHER PUBLICATIONS
`
`DIGITAL StorageWorks, HSZ70 Array Controller HSOF
`Version 7.0 (EK-HSZ70-CG.A01), Con?guration Manual,
`pp. 1-2 through G15 With index, Jul. 1997.
`DIGITAL StorageWorks, HSZ70 Array Controller HSOF
`Version 7.0, CLI Reference Manual, pp. 1-156, Jul. 1997.
`Decision Returning Petition mailed Feb. 28, 2005.
`Block-Based Distributed File Systems, Anthony J.
`McGregor, Jul. 1997.
`Compaq StorageWorks HSG80 Array Controller ACS Ver
`sion 8.3 (Maintenance and Service Guide) Nov. 1998.
`Compaq StorageWorks HSG80 Array Controller ACS Ver
`sion 8.3 (Con?guration and CLI Reference Guide) Nov.
`1998.
`CRD-5500 SCSI RAID Controller User’s Manual CMD
`Technology, Inc. pp. 1-1 to 6-25, revised Nov. 21, 1996.
`DIGITAL Storage Works, HSZ70 Array Controller, HSOF
`Version 7.0 EK-HSZ70-CG. A01, Digital Equipment Cor
`poration, Maynard, Massachusetts.
`DIGITAL StorageWorks HSZ70 Array Controller HSOF
`Version 7.0 EK-HSZ270-RM. A01 CLI Reference Manual.
`DIGITAL StorageWorks HSZ70 Array Controller HSOF
`Version 7.0 EK-HSZ70-SV. A01, 1997.
`DIGITAL StorageWorks HSG80 Array Controller ACS Ver
`sion 8.0 (User’s Guide Jan. 1998).
`DP5380 Asynchronous SCSI Interface, National Semicon
`ductor Corporation, Arlington, TX, May 1989, pp. 1-32.
`Emerson, “Ancor Communications: Performance evaluation
`of sWitched ?bre channel I/O system usingiFCP for SCSI”
`Feb. 1, 1995, IEEE, pp. 479-484.
`
`Fibre Channel and ATM: The Physical Layers, Jerry Quam
`WESCON/94, published Sep. 27-29, 1994. pp. 648-652.
`Fiber Channel storage interface for video-on-demand serv
`ers by AnaZaloni, et al, Jun. 15, 1905.
`Gen5 S-Series XL System Guide Revision 1.01 by Chen,
`Jun. 18, 1905.
`Graphical User Interface for MAXSTRAT GenS/Gen-S
`Servers User’s guide 1.1, Jun. 11, 1996.
`High Performance Data transfers Using NetWork-Attached
`Peripherals at the national Storage Laboratory by Hyer, Feb.
`26, 1993.
`IFT-3000 SCSI to SCSI Disk array Controller Instruction
`Manual Revision 2.0 by Infotrend Technologies, Inc., 1995.
`Implementing a Fibre Channel SCSI transport by Snively,
`1994.
`“InfoServer l50ilnstallation and OWner’s Guide”, EK
`INFSV-OM-00l, Digital Equipment Corporation, Maynard,
`Massachusettes 1991, Chapters 1 and 2.
`InforServer 150VXT Photograph.
`Infoserver 100 System Operations Guide, First Edition
`Digital Equipment Corporation, 1990.
`Johnson, DB, et al., “The Peregrine High Performance
`RPC System”,
`Software-Practice and Experience,
`23(2):201-221, Feb. 1993.
`Local-Area networks for the IBM PC by Haugdahl.
`Misc. Reference Manual Pages, SunOS 5.09.
`NeW serial I/ Os speed storage subsystems by Bursky, Feb. 6,
`1995.
`Petal: Distributed Virtual Disks, EdWard K. Lee and
`Chandramohan A. Thekkath, ACM SIGPLAN Notices, vol.
`31, Issue 9, Sep. 1996, pp. 84-92.
`Pictures of internal components of the InfoServer 150, taken
`from
`http://bindarydinosaurs.couk/Museum/Digital/
`infoserver/infoserver.php in Nov. 2004.
`Raidtec FibreArray and Raidtec FlexArray UltraRAID Sys
`tems, Windows IT PRO Article, Oct. 1997.
`SP. Joshi, “Ethernet controller chip interfaces With variety
`of 16-bit processors,” electronic Design, Hayden Publishing
`Co., Inc., Rochelle Part, NJ, Oct. 14, 1982. pp. 193-200.
`Simplest Migration to Fibre Channel Technology Article,
`Digital Equipment Corporation, Nov. 10, 1997, published on
`PR NeWsWire.
`Systems Architectures Using Fibre Channel, Roger Cum
`mings, TWelfth IEEE Symposium on Mass Storage Systems,
`Copyright 1993 IEEE. pp. 251-256.
`Dot Hill’s Request to Exceed Page Limit in Motion for
`Summary Judgment ?led Jun. 29, 2005. Case No. A-03-CV
`754 (SS).
`Request for Ex Parte Reexamination for 6,425,035. Third
`Party Requester: William A. Blake.
`Request for Ex Parte Reexamination for 6,425,035. Third
`Party Requester: Natu J. Patel.
`Of?ce Action dated Jan. 21, 2003 for 10/ 174,720
`(CROSS1120-8).
`Of?ce Action dated Feb. 27, 2001 for 09/354,682
`(CROSS1120-1).
`Of?ce Action dated Aug. 11, 2000 for 09/354,682
`(CROSS1120-1).
`Of?ce Action dated Dec. 16, 1999 for 09/354,682
`(CROSS1120-1).
`Of?ce Action dated Nov. 6, 2002 for
`(CROSS1120-4).
`Of?ce Action dated Jan. 21, 2003 for 10/081,110
`(CROSS1120-5).
`
`10/023,786
`
`NetApp Ex. 1001, pg. 3
`
`

`

`US 7,051,147 B2
`Page 4
`
`Of?ce Action in Ex Parte Reexamination 90/007,127, mailed
`Feb. 7, 2005.
`Reply to Of?ce Action Under Ex Parte Reexamination Dated
`Feb. 2, 2007 for 90/007,127 ?led on Apr. 6, 2005.
`Reply to Of?ce Action Under Ex Parte Reexamination Dated
`Feb. 2, 2007 for 90/007,125 and 90/007,317 ?led on Apr. 6,
`2005.
`Of?ce Action in Ex Parte Reexamination 90/007,126, mailed
`Feb. 7, 2005.
`Reply to Of?ce Action Under Ex Parte Reexamination Dated
`Feb. 2, 2007 for 90/007,126 ?led on Apr. 6, 2005.
`Of?ce Action in Ex Parte Reexamination 90/007,124, mailed
`Feb. 7, 2005.
`Of?ce Action in Ex Parte Reexamination 90/007,123, mailed
`Feb. 7, 2005.
`Reply to Of?ce Action Under Ex Parte Reexamination Dated
`Feb. 2, 2007 for 90/007,123 ?led on Apr. 5, 2005.
`European Of?ce Action issued Apr. 1, 2004 in Application
`No. 98966104.6-2413.
`Fiber Channel (FCS)/ATM Interworking: A Design Solution
`by AnZaloni, et al.
`Copies of the following are on the attached CD-Rom.
`Defendant’s First Supplemental Trial Exhibit List, Cross
`roads Systems, Inc., V. Chaparral Network Storage, Inc.,
`CA. No. A-00CA-217-SS (W.D. Tex. 2001). (CD-Rom).
`Defendant’s Third Supplemental Trial Exhibit List, Cross
`roads Systems, Inc. V. Pathlight Technology, Inc., CA. No.
`A-00CA-248-SS (W.D. Tex. 2001) (CD-Rom).
`Defendant Chaparral Network Storage, Inc.’s First Supple
`mental Trial Exhibit List (D1 through D271) (CD-ROM
`Chaparral Exhibits ExListiDef), Sep. 2, 2001.
`Plainti?0 s Fourth Amended Trial Exhibit List, Crossroads
`Systems, Inc. V. Chaparral Network Storage, Inc, CA. No.
`A-00CA-217-SS (W.D. Tex. 2001) (CD-Rom), Sep. 11,
`2001.
`Trail Transcripts, Crossroads Systems, Inc. V. Chaparral
`Network Storage, Inc., CA. No. A-00CA-217-SS (W.D.
`Tex. 2001). (CD-Rom).
`Trail Transcripts, Crossroads Systems, Inc. V. Pathlight
`Technology, Inc., CA. No. A-00CA-248-SS (W.D. Tex.
`2001). (CD-Rom).
`Datasheet for CrossPoint 4100 Fibre Channel to SCSI
`Router (Dedek Ex 41 (ANCT 117-120)) (CD-ROM Chap
`arral Exhibits D012).
`Symbios Logic- Software Interface Speci?cation Series 3
`SCSI RAID Controller Software Release 02.xx (Engelbrecht
`Ex 2 (LSI 1421-1658)) (CD-ROM Chaparral Exhibits
`D013), Dec. 3, 1997.
`Press Release- Symbios Logic to Demonstrate Strong Sup
`port for Fibre Channel at Fall Comdex (Engelbrecht 12 (LSI
`2785-86)) (CD-ROM Chaparral Exhibits D016), NoV. 13,
`1996.
`OEM Datasheet on the 3701 Controller (Engelbrecht 13
`(LSI 01837-38)) (CD-ROM Chaparral Exhibits D017), Jun.
`17, 1905.
`Nondisclosure Agreement Between Adaptec and Crossroads
`Dated Oct. 17, 1996 (Quisenberry Ex 25 (CRDS 8196))
`(CD-ROM Chaparral Exhibits D020).
`Organizational Presentation on the External Storage Group
`(LaVan Ex 1 (CNS 182242-255)) (CD-ROM Chaparral
`Exhibits D021), Apr. 11, 1996.
`Bridge. C, Bridge Between SCSI-2 and SCSI-3 FCP (Fibre
`Channel Protocol) (CD-ROM Chaparral Exhibits P214).
`
`Bridge Phase II Architecture Presentation (LaVan Ex 2 (CNS
`182287-295)) (CD-ROM Chaparral Exhibits D022), Apr.
`12, 1996.
`Attendees/Action Items from Apr. 12, 1996 Meeting at BTC
`(LaVan Ex 3 (CNS 182241)) (CD-ROM Chaparral Exhibits
`D023), Apr. 12, 1996.
`Brooklyn Hardware Engineering Requirements Documents,
`ReVision 1.4 (LaVan Ex 4 (CNS 178188-211)) (CD-ROM
`Chaparral Exhibits D024) by Pecone, May 26, 1996.
`Brooklyn Single-Ended SCSI RAID Bridge Controller
`Hardware OEM Manual, ReVision 2.1 (LaVan EX 5 (CNS
`177169-191)) (CD-ROM Chaparral Exhibits D025), Mar.
`21, 1996.
`Coronado Hardware Engineering Requirements Document,
`ReVision 0.0 (LaVan Ex 7 (CNS 176917-932)) (CD-ROM
`Chaparral Exhibits D027) by O’Dell, Sep. 30, 1996.
`ESS/FPG Organization (LaVan Ex 8 (CNS 178639-652))
`(CD-ROM Chaparral Exhibits D028), Dec. 6, 1996.
`Adaptec MCS ESS Presents: Intelligent External I/O Raid
`Controllers “Bridge” Strategy (LaVan Ex 9 (CNS 178606
`638)). (CD-ROM Chaparral Exhibits D029), Feb. 6, 1996.
`AEC-7313 Fibre Channel Daughter Board (for Brooklyn)
`Engineering Speci?cation, ReVision 1.0 (LaVan Ex 10 (CNS
`176830-850)) (CD-ROM Chaparral Exhibits D030), Feb.
`27, 1997.
`Bill of Material (LaVan Ex 14 (CNS 177211-214)) (CD
`ROM Chaparral Exhibits D034), Jul. 24, 1997.
`AEC-. 4412B, AEC-7412/B2 External RAID Controller
`Hardware OEM Manual, ReVision 2.0 (LaVan Ex 15 (CNS
`177082-123)) (CD-ROM Chaparral Exhibits D035), Jun. 27,
`1997.
`Coronado II, AEC-7312A Fibre Channel Daughter (for
`Brooklyn) Hardware Speci?cation, ReVision 1.2 (LaVan Ex
`16 (CNS 177192-210)) (CD-ROM Chaparral Exhibits
`D036) by Tom Yang, Jul. 18, 1997.
`AEC-4412B, AEC7412/ 3B External RAID Controller Hard
`ware OEM Manual, ReVision 3.0. (LaVan Ex 17 (CNS
`177124-165)) (CD-ROM Chaparral Exhibits D037), Aug.
`25, 1997.
`Memo Dated Aug. 15, 1997 to AEC-7312A EValuation Unit
`Customers re: B001 Release Notes (LaVan Ex 18 (CNS
`182878-879)) (CD-ROM Chaparral Exhibits D038).
`Brooklyn Main Board (AES-0302) MES Schedule (LaVan
`Ex 19 (CNS 177759-763)) (CD-ROM Chaparral Exhibits
`D039), Feb. 11, 1997.
`News Release-Adaptec Adds Fibre Channel Option to its
`External RAID Controller Family (LaVan Ex 20 (CNS
`182932-934)) (CD-ROM Chaparral Exhibits D040), May 6,
`1997.
`AEC-4412B/7412B User’s Guide, ReV. A (LaVan Ex 21)
`(CD-ROM Chaparral Exhibits D041), Jun. 19, 1905.
`Data Book- AIC-7895 PCI Bus Master Single Chip SCSI
`Host Adapter (DaVies Ex 1 (CNS 182944-64)) (CD-ROM
`Chaparral Exhibits D046), May 21, 1996.
`Data Book- AIC-1160 Fibre Channel Host Adapter ASIC
`(DaVies Ex 2 (CNS 181800-825)) (CD-ROM Chaparral
`Exhibits D047), Jun. 18, 1905.
`Viking RAID Software (DaVies Ex 3 (CNS 180969
`181026)) (CD-ROM Chaparral Exhibits D048), Jun. 18,
`1905.
`Header File with Structure De?nitions (DaVies Ex 4 (CNS
`180009-018)) (CD-ROM Chaparral Exhibits D049), Aug. 8,
`1996.
`
`NetApp Ex. 1001, pg. 4
`
`

`

`US 7,051,147 B2
`Page 5
`
`C++ SourceCode for the SCSI Command Handler (Davies
`Ex 5 (CNS 179136-168)) (CD-ROM Chaparral Exhibits
`D050), Aug. 8, 1996.
`Header File Data Structure (Davies Ex 6 (CNS 179997
`180008)) (CD-ROM Chaparral Exhibits D051), Jan. 2,
`1997.
`SCSI Command Handler (Davies Ex 7 (CNS 179676-719))
`(CD-ROM Chaparral Exhibits D052), Jan. 2, 1997.
`Coronado: Fibre Channel to SCSI Intelligent RAID Con
`troller Product Brief (KalWitZ Ex I (CNS 182804-805))
`(CD-ROM Chaparral Exhibits D053).
`Bill of Material (KalWitZ Ex 2 (CNS 181632-633)) (CD
`ROM Chaparral Exhibits D054), Mar. 17, 1997.
`Emails Dated Jan. 13-Mar. 31, 1997 from P. Collins to Mo
`re: Status Reports (KalWitZ Ex 3 (CNS 182501-511)) (CD
`ROM Chaparral Exhibits D055).
`HardWare Schematics for the Fibre Channel Daughtercard
`Coronado (KalWitZ Ex 4 (CNS 181639-648)) (CD-ROM
`Chaparral Exhibits D056).
`Adaptec Schematics re AAC-340 (KalWitZ Ex 14 (CNS
`177215-251)) (CD-ROM Chaparral Exhibits D057).
`Bridge Product Line RevieW (ManZanares Ex 3 (CNS
`177307-336)) (CD-ROM Chaparral Exhibits D058).
`AEC Bridge Series Products-Adaptec External Controller
`RAID Products Pre-Release Draft, v.6 (ManZanares Ex 4
`(CNS 174632-653)). (CD-ROM Chaparral Exhibits D059),
`Oct. 28, 1997.
`HeWlett-Packard Roseville Site Property Pass for Brian
`Smith (Dunning Ex 14 (HP 489) (CD-ROM Chaparral
`Exhibits D078), Nov. 7, 1996.
`Distribution Agreement BetWeen HeWlett-Packard and
`Crossroads (Dunning Ex 15 (HP 326-33) (CD-ROM Chap
`arral Exhibits D079).
`HPFC-5000 Tachyon User’s Manuel, First Edition (PTI
`172419-839) (CD-ROM Chaparral Exhibits D084), May 1,
`1996.
`X3T10 994Di(Draft) Information Technology: SCSI-3
`Architecture Model, Rev. 1.8 (PTI 165977) (CD-ROM
`Chaparral Exhibits D087).
`X3T10 Project 1047D: Information Technology- SCSI-3
`Controller Commands (SCC), Rev, 6c (PTI 166400-546)
`(CD-ROM Chaparral Exhibits D088), Sep. 3, 1996.
`X3T10 995D- (Draft) SCSI-3 Primary Commands, Rev. 11
`(Wanamaker Ex 5 (PTI 166050-229)) (CD-ROM Chaparral
`Exhibits D089), Nov. 13, 1996.
`VBAR Volume Backup and Restore (CRDS 12200-202)
`(CD-ROM Chaparral Exhibits D099).
`Preliminary Product Literature for In?nity Commstor’s
`Fibre Channel to SCSI Protocol Bridge (Smith Ex 11;
`Quisenberry Ex 31 (SPLO 428-30) (CD-ROM Chaparral
`Exhibits D143), Aug. 19, 1996.
`Letter dated Jul. 12, 1996 from J. Boykin to B. Smith re:
`Purchase Order for Evaluation Units from Crossroads
`(Smith Ex 24) CRDS 8556-57) (CD-ROM Chaparral Exhib
`its D144), Jul. 12, 1996.
`CrossPoint 4100 Fibre Channel to SCSI Router Preliminary
`Datasheet (Hulsey Ex 9 (CRDS 16129-130)) (CD-ROM
`Chaparral Exhibits D145), Nov. 1, 1996.
`
`CrossPoint 4400 Fibre Channel to SCSI Router Preliminary
`Datasheet (Bardach Ex. 9 Quisenberry Ex 33 (CRDS 25606
`607)) (CD-ROM Chaparral Exhibits D153), Nov. 1, 1996.
`Fax Dated Jul. 22, 1996 from L. Petti to B. Smith re:
`Purchase Order from Data General for FC2S Fibre to
`Channel SCSI Protocol Bridge Model 11 (Smith Ex 25;
`Quisenberry Ex 23; Bardach Ex 11 (CRDS 8552-55;8558)
`(CD-ROM Chaparral Exhibits D155).
`Email Dated Dec. 20, 1996 from J. Boykin to B. Smith re:
`Purchase Order for Betas in Feb. and Mar. (Hoese Ex 16,
`Quisenberry Ex 25; Bardach Ex 12 (CRDS 13644-650)
`(CD-ROM Chaparral Exhibits D156).
`In?nitiy Commstor Fibre Channel Demo for Fall Comdex,
`1996 (Hoese Ex 15, Bardach Ex 13 (CRDS 27415) (CD
`ROM Chaparral Exhibits D157).
`Fax Dated Dec. 19, 1996 from B. Bardach to T. Rarich re:
`Purchase Order Information (Bardach Ex. 14; Smith Ex 16
`(CRDS 4460)) (CD-ROM Chaparral Exhibits D158).
`Miscellaneous Documents Regarding Comdex (Quisenberry
`Ex 2 (CRDS 27415-465)) (CD-ROM Chaparral Exhibits
`D165).
`CrossPoint 4100 Fibre Channel to SCSI Router Preliminary
`Datasheet (Quisenberry) Ex 3 (CRDS 4933-34) (CD-ROM
`Chaparral Exhibits D166) (CD-ROM Chaparral Exhibits
`D166).
`CrossPoint 4400 Fibre to Channel to SCSI Router Prelimi
`nary Datasheet; Crossroads Company and Product Over
`vieW (Quisenberry Ex 4 (CRDS 25606; 16136)) (CD-ROM
`Chaparral Exhibits D167).
`Crossroads Purchase Order Log (Quisenberry Ex 9 (CRDS
`14061-062)) (CD-ROM Chaparral Exhibits D172).
`RAID Manager 5 With RDAC 5 for UNIX V.4 User’s Guide
`(LSI-01854) (CD-ROM Chaparral Exhibits P062), Sep. 1,
`1996.
`Letter dated May 12, 1997 from Alan G. Leal to Barbara
`Bardach enclosing the original OEM License and Purchase
`Agreement betWeen HeWlett-Package Company and Cross
`roads Systems, Inc. (CRDS 02057) (CD-ROM Chaparral
`Exhibits P130).
`CR4x00 Product Speci?cation (CRDS 43929) (CD-ROM
`Chaparral Exhibits P267), Jun. 1, 1998.
`Symbios LogiciHardWare Function Speci?cation for the
`Symbios Logic Series 3 Fibre Channel Disk Array Control
`ler Model 3701 (Engelbrecht Ex 3 (LSI-1659-1733) (CD
`ROM Pathlight Exhibits D074).
`Report of the Working Group on Storage I/O for Large Scale
`Computing; Department of Computer Science Duke Uni
`versity: CS-1996-21 (PTI 173330-347). (CD-ROM
`Pathlight Exhibits D098).
`Brian Allison’s 1999 Third Quarter Sales Plan (PDX 38 )
`CNS 022120-132)) (CD-ROM Pathlight Exhibits D201),
`Jun. 5, 2001.
`Brooklyn SCSI-SCSI Intellegent External RAID Bridge
`De?nition Phase External Documentation (CD-ROM
`Pathlight Exhibits D129).
`* cited by examiner
`
`NetApp Ex. 1001, pg. 5
`
`

`

`U.S. Patent
`
`May 23, 2006
`
`Sheet 1 012
`
`US 7,051,147 B2
`
`12
`\
`WORKSTATION
`< O
`<2
`WORKSTATION
`/
`‘2
`
`12
`\
`WORKSTATION
`O
`G
`NETWORK SERVER
`/
`‘4
`
`12
`/
`WORKSTATION
`O
`
`>
`§6
`
`505‘ BUS
`
`2O
`
`10
`'/
`
`FIG 1
`
`18
`/
`
`2O
`
`2O
`
`42
`
`38
`
`35
`\
`WORKSTATION
`
`<
`FIBRE CHANNEL
`
`WORKSTATION
`
`3%
`
`35
`\
`WORKSTATION
`
`MANAGEMENT [45
`STATION
`
`/
`32
`
`STORAGE
`ROuTER
`\
`DISK \ 38 44
`
`FIG. 2
`
`SCSI BUS
`
`‘I
`WORKSTATION
`\
`4°
`
`‘\
`30
`
`34
`
`_ /_
`'
`
`42
`
`6O
`
`STORAGE DEVICE
`GLOBAL
`
`58
`58
`58
`\
`\
`\
`WORKSTATION WORKSTATION WORKSTATION
`A
`B
`C
`
`56
`\
`STORAGE 2
`‘
`ROuTER
`f
`}
`/
`*EIORE
`:
`:
`52
`CHANNEL
`WORKSTATION WORKSTATION ‘L, IIANAGEIIENT __}
`O
`E
`STATION
`/
`/
`/
`58
`58
`76
`
`SCSI
`BUS
`\
`54
`
`56‘
`
`Fla 3
`
`STORAGE DEVICE
`WORKSTATION
`E STORAGE
`
`62
`55
`(LL)
`STORAGE OEvIcE
`WORKSTATION 1,55
`A STORAGE
`WORKSTATION x68
`B STORAGE
`WORKSTATION
`c STORAGE “~70
`WORKSTATION
`O STORAGE \72
`V
`
`74
`
`NetApp Ex. 1001, pg. 6
`
`

`

`U.S. Patent
`
`May 23, 2006
`
`Sheet 2 0f 2
`
`US 7,051,147 B2
`
`Nw/
`
`
`
`mam Gum A?v
`
`E
`
`momgmmzw
`
`
`
`w 6E s 5/ “E3 ow \
`
`/ > \
`
`5:258 5% WV 5228
`
`m2 @255 gm:
`
`magma \ mm
`
`
`
`53528 5% $3528 $525 am:
`
`mm
`
`8
`
`
`
`Anmvmzzio am:
`
`. 5 @2258 m QNnN / \
`
`NE?
`
`gamma”: 3
`
`ma 1 i <3 <5 8 2
`
`685% w _ 3m 85%;. 65%? PA 686% mm
`
`
`
`
`
` mm a No ?e ‘ mm 1? TIA Aumvmzzéo am:
`
`8 21 \8
`
`NetApp Ex. 1001, pg. 7
`
`

`

`US 7,051,147 B2
`
`1
`STORAGE ROUTER AND METHOD FOR
`PROVIDING VIRTUAL LOCAL STORAGE
`
`RELATED APPLICATIONS
`
`This application is a continuation of and claims the bene?t
`of the ?ling dates of US. patent application Ser. No.
`10/081,110 by inventors Geoffrey B. Hoese and Jeffry T.
`Russell, entitled “Storage Router and Method for Providing
`Virtual Local Storage” ?led on Feb. 22, 2002, now US. Pat.
`No. 6,789,152 Which in turn is a continuation of US.
`application Ser. No. 09/354,682 by inventors Geoffrey B.
`Hoese and Jeffry T. Russell, entitled “Storage Router and
`Method for Providing Virtual Local Storage” ?led on Jul. 15,
`1999, now US. Pat. No. 6,421,753, Which in turn is a
`continuation of US. patent application Ser. No. 09/001,799,
`?led on Dec. 31, 1997, now US. Pat. No. 5,941,972, and
`hereby incorporates these applications by reference in their
`entireties as if they had been fully set forth herein.
`
`TECHNICAL FIELD OF THE INVENTION
`
`20
`
`This invention relates in general to netWork storage
`devices, and more particularly to a storage router and
`method for providing virtual local storage on remote SCSI
`storage devices to Fibre Channel devices.
`
`25
`
`BACKGROUND OF THE INVENTION
`
`Typical storage transport mediums provide for a relatively
`small number of devices to be attached over relatively short
`distances. One such transport medium is a Small Computer
`System Interface (SCSI) protocol, the structure and opera
`tion of Which is generally Well knoWn as is described, for
`example, in the SCSI-1, SCSI-2 and SCSI-3 speci?cations.
`High speed serial interconnects provide enhanced capability
`to attach a large number of high speed devices to a common
`storage transport medium over large distances. One such
`serial interconnect is Fibre Channel, the structure and opera
`tion of Which is described, for example, in Fibre Channel
`Physical and signaling Interface (FC-PH), ANSI X3.230
`Fibre Channel Arbitrated Loop (FC-AL), and ANSI X3.272
`Fibre Channel Private Loop Direct Attach (FC-PLDA).
`Conventional computing devices, such as computer Work
`stations, generally access storage locally or through netWork
`interconnects. Local storage typically consists of a disk
`drive, tape drive, CD-ROM drive or other storage device
`contained Within, or locally connected to the Workstation.
`The Workstation provides a ?le system structure, that
`includes security controls, With access to the local storage
`device through native loW level, block protocols. These
`protocols map directly to the mechanisms used by the
`storage device and consist of data requests Without security
`controls. Network interconnects typically provide access for
`a large number of computing devices to data storage on a
`remote netWork server. The remote netWork server provides
`?le system structure, access control, and other miscellaneous
`capabilities that include the netWork interface. Access to
`data through the netWork server is through netWork proto
`cols that the server must translate into loW level requests to
`the storage device. A Workstation With access to the server
`storage must translate its ?le system protocols into netWork
`protocols that are used to communicate With the server.
`Consequently, from the perspective of a Workstation, or
`other computing device, seeking to access such server data,
`the access is much sloWer than access to data on a local
`storage device.
`
`30
`
`35
`
`40
`
`50
`
`55
`
`60
`
`65
`
`2
`SUMMARY OF THE INVENTION
`
`In accordance With the present invention, a storage router
`and method for providing virtual local storage on remote
`SCSI storage devices to Fibre Channel devices are disclosed
`that provide advantages over conventional netWork storage
`devices and methods.
`According to one aspect of the present invention, a
`storage router and storage netWork provide virtual local
`storage on remote SCSI storage devices to Fibre Channel
`devices. A plurality of Fibre Channel devices, such as
`Workstations, are connected to a Fibre Channel transport
`medium, and a plurality of SCSI storage devices are con
`nected to a SCSI bus transport medium. The storage router
`interfaces betWeen the Fibre Channel transport medium and
`the SCSI bus transport medium. The storage router maps
`betWeen the Workstations and the SCSI storage devices and
`implements access controls for storage space on the SCSI
`storage devices. The storage router then alloWs access from
`the Workstations to the SCSI storage devices using native
`loW level, block protocol in accordance With the mapping
`and the access controls.
`According to another aspect of the present invention,
`virtual local storage on remote SCSI storage devices is
`provided to Fibre Channel devices. A Fibre Channel trans
`port medium and a SCSI bus transport medium are inter
`faced With. A con?guration is maintained for SCSI storage
`devices connected to the SCSI bus transport medium. The
`con?guration maps betWeen Fibre Channel devices and the
`SCSI storage devices and implements access controls for
`storage space on the SCSI storage devices. Access is then
`alloWed from Fibre Channel initiator devices to SCSI stor
`age devices using native loW level, block protocol in accor
`dance With the con?guration.
`A technical advantage of the present invention is the
`ability to centraliZe local storage for netWorked Workstations
`Without any cost of speed or overhead. Each Workstation
`access its virtual local storage as if it Work locally con
`nected. Further, the centraliZed storage devices can be
`located in a signi?cantly remote position even in excess of
`ten kilometers as de?ned by Fibre Channel standards.
`Another technical advantage of the present invention is
`the ability to centrally control and administer storage space
`for connected users Without limiting the speed With Which
`the users can access local data. In addition, global access to
`data, backups, virus scanning and redundancy can be more
`easily accomplished by centrally located storage devices.
`A further technical advantage of the present invention is
`providing support for SCSI storage devices as local storage
`for Fibre Channel hosts. In addition, the present invention
`helps to provide extended capabilities for Fibre Channel and
`for management of storage subsystems.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`A more complete understanding of the present invention
`and the advantages thereof may be acquired by referring to
`the folloWing description taken in conjunction With the
`accompanying draWings, in Which like reference numbers
`indicate like features, and Wherein