(12) United States Patent
`Hipp
`
`111111111111111111111111111111111111111111111111111111111111111111111111111
`US006757748Bl
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 6,757,748 BI
`Jun. 29,2004
`
`(54) MODULAR NETWORK INTERFACE
`SYSTEM AND METHOD
`
`(75)
`
`Inventor: Christopher G. Hipp, Dallas, TX (US)
`
`(73) Assignee: RLX Technologies, Inc., The
`Woodlands, TX (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.c. 154(b) bydays.days.
`
`(21) Appl. No.: 09/620,409
`
`(22) Filed:
`
`JuI. 20, 2000
`
`Int. CI?
`(51)
`(52) U.S. CI.
`
`(58) Field of Search
`
`G06F 3/00
`710/2; 710/62; 709/238;
`709/249; 370/419
`710/1, 2, 62, 300;
`709/218,238,249; 370/419
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,222,385 A
`4,511,950 A
`4,885,741 A
`4,918,572 A
`5,031,075 A
`5,034,915 A
`5,051,096 A
`5,214,567 A
`5,317,477 A
`5,504,638 A
`5,579,204 A
`5,603,044 A
`5,606,664 A *
`5,615,211 A *
`5,661,631 A
`5,682,298 A
`5,754,869 A
`
`9/1980
`4/1985
`* 12/1989
`4/1990
`7/1991
`7/1991
`9/1991
`5/1993
`5/1994
`4/1996
`11/1996
`2/1997
`2/1997
`3/1997
`8/1997
`10/1997
`5/1998
`
`Backhouse
`Bunner et al.
`Douskalis
`Tarver et al.
`Casanova et al.
`Styrna et al.
`Cooke et al.
`Feightner et al.
`Gillett
`Kinoshita et al.
`Nelson et al.
`Annapareddy et al.
`Brown et al.
`Santore et al.
`Crane, Jr
`Raynham
`Holzhammer et al.
`
`..
`
`128/419
`361/413
`370/362
`361/395
`361/415
`364/900
`439/61
`361/393
`361/683
`360/98.08
`361/685
`395/800
`709/224
`370/419
`361/683
`361/794
`. 395/750.01
`
`(List continued on next page.)
`
`FOREIGN PATENT DOCUMENTS
`
`wo
`
`WO 99/57639
`
`11/1999
`
`G06F/11/14
`
`OTHER PUBLICATIONS
`
`"Cabinet PC in 'book format' with one free combislot,"
`LS-ICIBASIC1 Brochure, XP-002202891, Leukhardt Sys(cid:173)
`temelektronik GmbH, 1999, 2 pages.
`Brochure,
`"Hardware
`Matchbox
`Webserver,"
`XP-002203094, Wearables Lab, Jan. 1999,4 pages.
`"SP2500 Series EtherFast 10/100 Mbps NICs," Brochure,
`Xp-002203092, Micronet® Communications Inc., Sep.
`1999, 2 pages.
`WebEngines Blazer Platform Version 1.0 Hardware Refer(cid:173)
`ence Guide, XP-002202892, NetWork Engines, Inc., Jun. 1,
`2000, 92 pages.
`"New Products," Electronic Design web site (http://www.el(cid:173)
`ecdesign.com), XP-002203093, Jun. 21, 2002, 1 page.
`PCT Invitation to Pay Additional Fees in International
`Application No. PCT/US 01/22289, Jul. 29, 2002, 9 pages.
`
`Primary Examiner-Jeffrey Gaffin
`Assistant Examiner~ron Sorrell
`(74) Attorney, Agent, or Firm-Baker Botts L.L.P.
`
`(57)
`
`ABSTRACT
`
`A network interface card including a printed circuit board is
`provided. First and second connectors may be coupled with
`the printed circuit board. A plurality of ethernet communi(cid:173)
`cation links form at least a portion of a coupling between the
`first and second connectors, wherein the first connector is
`configured to receive a third connector associated with a
`midplane. A chip may be coupled with the printed circuit
`board wherein the plurality of ethernet communication links
`couple the first connector with the chip. A second commu(cid:173)
`nication link may also be provided which couples the chip
`and the second connector. In accordance with one embodi(cid:173)
`ment of the present invention the chip consolidates data
`received through the first connector for distribution of the
`data to the second connector. In a particular embodiment, the
`chip may include a hub chip. In accordance with another
`aspect of the present invention,
`the chip may include a
`switch chip.
`
`EP
`
`0816977 A2
`
`1/1998
`
`G06F/1/18
`
`20 Claims, 9 Drawing Sheets
`
`

`
`US 6,757,748 BI
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,793,610 A
`5,850,562 A
`5,913,037 A *
`5,953,340 A *
`5,960,035 A
`6,046,912 A
`6,115,755 A
`6,115,788 A
`6,163,464 A
`6,175,490 B1
`6,192,399 B1 *
`6,208,522 B1
`6,243,756 B1 *
`6,260,155 B1
`6,313,988 B1
`
`8/1998
`12/1998
`6/1999
`9/1999
`9/1999
`4/2000
`9/2000
`9/2000
`12/2000
`1/2001
`2/2001
`3/2001
`6/2001
`7/2001
`11/2001
`
`Schmitt et al.
`Crump et al.
`Spofford et al.
`Scott et al.
`Sridhar et al.
`Leman
`Krishan
`Thowe
`Ishibashi et al.
`Papa et al.
`Goodman
`Manweiler et al.
`Whitmire et al.
`Dellacona
`Pham
`
`6,314,501 B1
`6,324,062 B1
`6,325,636 B1
`6,374,329 B1 *
`6,381,239 B1 *
`6,397,292 B1
`6,411,506 B1
`6,418,120 B1
`6,421,730 B1
`6,433,568 B1
`6,447,726 B1
`6,459,700 B1
`6,493,825 B1
`2001/0036191 A1
`
`11/2001
`11/2001
`12/2001
`4/2002
`4/2002
`5/2002
`6/2002
`7/2002
`7/2002
`8/2002
`9/2002
`10/2002
`12/2002
`11/2001
`
`Gulick et al.
`Treiber et al.
`Hipp et al.
`McKinney et al.
`Atkinson et al.
`Venkatesh et al.
`Hipp et al.
`Yona et al.
`Narad et al.
`Whipple et al.
`Delucas et al.
`Hoang
`Blumenau et al.
`Borchering
`
`* cited by examiner
`
`361/695
`395/800
`709/226
`370/401
`375/219
`361/784
`709/250
`711/114
`361/788
`361/686
`725/78
`361/752
`709/232
`714/4
`361/687
`
`711/153
`361/727
`439/61
`711/141
`370/362
`711/114
`361/686
`370/236
`709/236
`324/760
`422/99
`370/401
`713/168
`370/401
`
`

`
`u.s. Patent
`
`Jun. 29,2004
`
`Sheet 1 of 9
`
`US 6,757,748 BI
`
`42
`
`FIG.
`
`1
`
`

`
`u.s. Patent
`
`Jun. 29,2004
`
`Sheet 2 of 9
`
`US 6,757,748 BI
`
`o
`
`o IIl11iiiiiillliliiiiiiilllllllllllllliilIIiIIII"CH==--_--,
`
`om
`
`co
`co
`
`r-./)
`m
`
`0
`
`0
`
`r-
`m'B
`
`r-fi
`m
`
`0
`
`~I
`
`~I
`
`co
`m
`
`com
`
`o
`
`L.(") 1O
`00
`
`

`
`u.s. Patent
`
`Jun. 29,2004
`
`Sheet 3 of 9
`
`US 6,757,748 BI
`
`o
`
`0
`
`n
`
`aao
`0
`Ilaoo
`i
`tll
`DIal a tlltll
`
`~~°
`
`a.........al
`I
`al
`
`o
`
`o
`
`""""""
`
`tlltllllillaal
`aaaaa
`~
`Dlaa
`
`1 1 1 1
`a a a
`
`aau~
`
`00 ..............
`...........
`
`...
`
`...
`
`l.-l.-
`
`~3
`V
`
`~r
`
`

`
`u.s. Patent
`
`Jun. 29,2004
`
`Sheet 4 of 9
`
`US 6,757,748 BI
`
`144
`
`146
`
`43
`
`I
`116
`
`\.117
`
`40
`
`\.145
`
`,------J-.J...U..I...L......L.L.J..L.L.l....-....,~
`
`115
`
`FIG. 4
`
`115 / ' - - - - - - - I
`FIG. 5
`
`126
`
`124
`
`174
`
`176
`
`...-/49
`
`118
`
`FIG. 6
`
`FIG. 7
`
`

`
`d•
`'JJ.
`
`• ~
`
`~
`
`0
`
`·0
`00
`00
`
`o.
`
`0
`
`·0
`·0
`00
`·0
`
`0
`o.
`
`·0
`00
`·0
`00
`
`0
`
`0
`
`00
`00
`00
`00
`
`..
`..
`
`·0
`
`0
`
`00
`
`o.
`
`0
`
`·0
`
`0
`
`00
`00
`·0
`
`0
`
`00
`00
`00
`00
`
`0
`
`·0
`·0
`
`0
`
`·0
`
`·0
`
`0
`o.
`o.
`
`00
`
`0
`
`00
`
`00
`
`0
`
`·0
`
`0
`
`·0
`·0
`
`0
`o.
`
`00
`00
`
`0
`
`00
`00
`00
`00
`
`0
`o.
`o.
`
`0
`
`00
`00
`00
`00
`·0
`
`0
`o.
`o.
`o.
`o.
`
`·0
`·0
`·0
`·0
`00
`·0
`
`o.
`
`·0
`·0
`
`o.
`
`~
`
`~
`
`:~g
`'0·
`
`'0·
`
`00
`00
`00
`·0
`
`00
`
`o.
`
`00
`
`o.
`
`o.
`
`·0
`·0
`·0
`
`o.
`
`·0
`
`00
`
`00
`
`0
`o.
`o.
`g.
`o·
`o·
`
`00
`.0
`
`.0
`00
`00
`
`00
`
`o.
`o.
`o.
`
`·0
`00
`
`o.
`
`o•
`
`·0
`
`·0
`·0
`·0
`
`·0
`
`o.
`o.
`
`00
`00
`·0
`
`·0
`·0
`
`00
`
`o•
`o.
`o.
`
`00
`
`·0
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`
`o.
`
`·0
`·0
`
`·0
`·0
`·0
`·0
`
`·0
`
`00
`00
`·0
`·0
`·0
`00
`00
`
`00
`
`o.
`o.
`
`..
`
`·0
`
`·0
`·0
`·0
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`00
`00
`00
`
`o•
`
`0 1 ~
`.....
`=
`.....
`
`·0
`
`00
`
`·0
`·0
`·0
`
`gg:
`gg:
`
`·0'
`
`,..
`0
`..
`::~
`:i:
`..
`..
`..
`..
`..
`..
`..
`'..
`
`o~
`
`..
`..
`..
`..
`..
`..
`
`o.
`o.
`o.
`
`·0
`·0
`
`..
`..
`..
`..
`..
`..
`..
`..
`
`o.
`
`00_
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`o.
`o.
`
`00
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`·0
`
`o·
`og
`
`00
`.0
`00
`
`.0
`00
`
`o.
`o.
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`00
`00
`
`o.
`
`34
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`00
`00
`00
`00
`
`..
`..
`..
`..
`..
`..
`..
`..
`
`go
`o·
`o·
`o·
`og
`
`00
`00
`
`..
`..
`..
`..
`..
`..
`
`·0
`00
`00
`·0
`
`·0
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`00
`00
`
`o.
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`00
`·0
`·0
`00
`
`o.
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`o.
`o.
`o.
`o.
`o.
`o.
`
`..
`..
`..
`..
`..
`..
`..
`
`·0
`00
`00
`·0
`
`·0
`
`o•
`o.
`o.
`o.
`
`·0
`·0_
`
`..
`..
`..
`..
`..
`..
`..
`..
`
`00
`·0
`
`o.
`
`..
`..
`..'
`..'
`
`·0'
`0.'
`~g1
`
`I
`
`~
`
`..
`..
`..
`..
`..
`..
`..
`..
`
`o.
`
`·0
`
`00
`
`=?
`
`N~
`
`~
`N
`
`cc
`
`~
`
`'JJ.=(cid:173)~
`~....
`Ul
`o....,
`
`~
`
`e\
`
`Jl
`-..CJ\
`.....:I
`(I)
`.....:I
`':..1
`
`~0
`
`0 ~1
`
`-0"
`
`..
`..
`..
`..
`..
`..
`..
`..
`g.
`.-
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`276
`
`~276
`
`~276
`
`34
`
`278
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`
`282
`
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`..
`276/
`
`'-J
`
`276/
`
`275
`FIG. a
`
`276/
`
`276/
`
`I
`
`"--J
`
`0
`
`..
`
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`
`283 0
`
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`
`286
`
`284
`
`0
`
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`
`285
`
`277
`
`287
`
`278
`
`0
`
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`~
`
`~
`
`~
`~
`~
`~
`~
`~
`L
`
`00 00 DO 00 00 000000
`00 00 00 00 00 000000
`00 00 00 00 00 000000
`0000000000 000000
`
`ooooooaoOooo
`:g~gggg~gggg
`000000000000
`
`o~o~o~o~~~~~o~o~o~o~o~o~o~~~~~~~o~o~o~~~ .0 II ry~~~~~~~~~~~~~~~~~~~~~~~~~~~;~~~~~~~~o~~~' 0
`
`00 00 00 00 00 00
`000000000000
`0 0000 0000 000
`oooooaoooooo
`
`000000 ClO 00 00 00 00
`000000 00 00 000 00 0
`000000 00 00 000 00 0
`000000 00 000 0000 0
`
`FIG. 9
`
`

`
`d•
`'JJ.
`
`• ~~.
`
`....
`~=.....
`
`~~ N~
`
`~
`
`NCC~
`
`'JJ.=(cid:173)~
`~....
`0'1
`o....,
`
`~
`
`~270
`
`e\
`
`Jl
`-..CJ\
`......:I
`(I)
`......:I
`':..1
`
`~0
`
`0 ~1
`
`0-"
`
`J
`36
`
`,
`
`132
`1.33 134I
`135 32 I
`136 137(
`138 139(
`140 141
`
`.
`
`.
`
`38
`~
`
`FIG.
`
`10
`
`274
`
`268 269
`
`

`
`d•
`'JJ.
`
`• ~~.
`
`....
`~=.....
`
`~~ N~
`
`~
`
`NCC~
`
`'JJ.=(cid:173)~
`~....
`-..J
`o....,
`
`~
`
`e\
`
`Jl
`-..CJ\
`......:I
`(I)
`......:I
`':..1
`
`~0
`
`0 ~1
`
`-0"
`
`FIG.
`
`11
`
`38"" , .~ . .,.
`
`.~~.~.
`:~,:,~,t~~ ..
`~,,'d~i ~ ~
`:d ~d ~ .~. ~.
`~
`L-IV'-<t'-.l ~I~ ~
`
`. , d~~~ ~
`~
`tid ~
`~ ()
`..
`~
`~ It
`.V1 TY'~
`d ~
`~
`~
`
`.
`
`:d ~d
`- ~
`
`262
`
`264
`
`

`
`d•
`'JJ.
`
`• ~~.
`
`....
`~=.....
`
`~==
`
`N'
`
`0
`
`~
`
`NCC~
`
`'JJ.=-~
`~....
`0....,
`'0
`
`QIO
`
`280
`
`~
`
`~
`
`e\
`
`Jl
`-..CJ\
`......:I
`(I)
`......:I
`':..1
`
`~0
`
`0 ~1
`
`-0"
`
`135
`
`134
`
`~/"...."-
`
`133
`,
`
`132
`
`FIG. 12
`
`

`
`u.s. Patent
`
`Jun. 29,2004
`
`Sheet 9 of 9
`
`US 6,757,748 BI
`
`FIG. 13
`
`38
`
`38
`
`38
`
`~39
`
`

`
`US 6,757,748 Bl
`
`1
`MODULAR NETWORK INTERFACE
`SYSTEM AND METHOD
`
`RELATED APPLICATIONS
`
`The present application is related to co-pending U.S.
`patent applications: Ser. No. 09/620,105, entitled Single
`Board Web Server System and Method, filed Jul. 20, 2000;
`Ser. No. 09/620,106, entitled Web Server Network System
`and Method,
`filed Jul. 20, 2000; Ser. No. 09/625,002,
`entitled Passive Midplane System and Method, filed Jul. 20,
`2000, now U.S. Pat. No. 6,325,636; Ser. No. 09/620,107,
`entitled High Density Web Server Chassis System and
`Method, filed Jul. 20, 2000, now U.S. Pat. No. 6,411,506;
`and Ser. No. 09/620,108, entitled Data I/O Management 15
`System and Method, filed Jul. 20, 2000.
`
`5
`
`2
`time or the transaction count that occurred relative to that
`particular user, it is very difficult to arrive at an accurate
`assessment of that activity when the server hardware is
`shared by that user and many other users.
`In the past, it has been difficult to provide server capability
`close to the end user. This is in large part because the typical
`larger server architectures require special environmental
`conditions and special hardware environments to supply
`power and large bandwidth communication links. The envi-
`10 ronment of a telephone company's central office is typically
`very close to the end user, however, the space power and
`environmental constraints within these facilities make it
`completely impractical to co-locate large server platforms
`within these facilities.
`
`SUMMARY OF THE INVENTION
`
`TECHNICAL FIELD OF THE INVENTION
`
`The present invention relates generally to the field of
`network servers, and more particularly to a data input/output
`system and method.
`
`BACKGROUND OF THE INVENTION
`
`A critical component of both private intranets and the
`publicly accessible internet is what is commonly referred to 25
`as a web server. A web server is typically a computer which
`is capable of receiving requests for information and return(cid:173)
`ing data or performing specialized processing upon the
`receipt of a network request for such processing. Conven(cid:173)
`tional network architectures envision servers as large scale
`computing platforms. For example, large commercial enti(cid:173)
`ties may include very large systems acting as web servers
`fielding requests for processing. Alternatively, these entities
`might employ large parallel server operations where a mul(cid:173)
`titude of individual server computers all service requests for
`information and processing in parallel.
`In today's network architectures, smaller users such as
`individuals or small businesses that require server systems
`typically be forced to share part of the processing 40
`will
`capability of one of these large scale systems. In many cases
`this sharing of resources does not provide adequate process(cid:173)
`ing capability for the individual or small business user.
`Further, the sharing of a large processing system means that
`all parties utilizing that server processing capability are
`vulnerable to the failure of that system. These large pro(cid:173)
`cessing platforms are also more difficult to customize if one
`small user needs specific features or components that other
`small users do not need. Further, as Internet and intranet
`traffic have grown, it has become apparent that even the
`largest processing platforms reach a limit to their processing
`capability especially in light of the increased traffic in large
`multimedia content and the necessity for real time process(cid:173)
`ing of transactions.
`Another difficulty in providing server technology to indi(cid:173)
`vidual or small business users is associated with the diffi(cid:173)
`culties in maintaining provisioning and administrating the
`server technology. Conventional server systems are typically
`very complex to administer. Software development efforts
`have not focused on providing simple user
`interfaces
`because the typical personnel that are tasked with maintain(cid:173)
`ing servers are typically very sophisticated network techni(cid:173)
`CIans.
`Large scale servers that are shared by multiple small users
`present difficulties in monitoring and metering traffic for 65
`individual users. For example, if a server provider desired to
`bill a user of a large scale system according to the processing
`
`The present invention provides a data input/output system
`and method that substantially eliminates or reduces the
`20 problems and disadvantages associated with previous meth(cid:173)
`ods and systems. In particular, a network interface card is
`provided which consolidates network traffic between a plu(cid:173)
`rality of web server processing cards and one or more
`networks.
`In accordance with a particular embodiment of the present
`invention, a network interface card including a first printed
`circuit board is provided. First and second connectors may
`be coupled with the printed circuit board and a plurality of
`ethernet communications links may form at least a portion of
`30 a coupling between the first and second connectors. The first
`connector may be configured to receive a third connector
`associated with a midplane. In one embodiment a chip may
`be coupled with the first printed circuit board such that the
`plurality of ethernet communication links couple the first
`35 connector with the chip. A second communication link may
`also be provided coupling the chip and the second connector.
`invention may be operable to
`The chip of the present
`consolidate data received through the first connector for
`distribution of the data to the second connector.
`In accordance with another embodiment of the present
`invention, the chip may include a hub chip.
`In accordance with yet another embodiment of the present
`invention, the chip may include a switch chip.
`Technical advantages of the present invention include
`45 providing a network interface card operable to consolidate
`data received from a plurality of web server processing
`cards. The network interface card provides a single point of
`data communications, simplifying troubleshooting,
`operations, administration, management, provisioning and
`50 traffic metering and measurement regarding the associated
`web server processing cards.
`invention
`Another technical advantage of the present
`includes providing a network interface card which includes
`55 plug and play capability within a midplane.
`Yet another technical advantage of the present invention
`includes providing a network interface card which is hot
`swappable within a midplane.
`Other technical advantages will be readily apparent to one
`60 skilled in the art from the following figures, description, and
`claims.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`For a more complete understanding of the present inven(cid:173)
`tion and its advantages,
`reference is now made to the
`following description, taken in conjunction with the accom(cid:173)
`panying drawings, in which:
`
`

`
`US 6,757,748 Bl
`
`5
`
`10
`
`4
`used to indicate any switch, router, bridge, hub or other
`data/communication transfer point. Public switch 42 distrib(cid:173)
`utes data between web server processing cards 32 and public
`network 45. In a particular embodiment, public network 45
`may include the Internet. Public network 45 may include a
`variety of networks including, without limitation, local area
`networks (LANs), wide area networks (WANs), and/or
`Metropolitan Area Networks (MANs).
`A second network interface card 48 is coupled with
`passive midplane 34 and distributes data to a private net(cid:173)
`work switch 50 via communication link 52. A plurality of
`private network applications including a storage server 54,
`application server 56, database server 58, and legacy sys-
`tems 60 are coupled with private network switch 50 through
`communication links 62, 63, 64 and 65, respectively.
`A management network interface 49, which is illustrated
`in more detail in FIG. 7, distributes data between passive
`midplane 34 and remote management system 70 of man(cid:173)
`agement network 47, through communication link 71. One
`20 or more online/nearline memory storage devices, including
`non-volatile storage device 72 and secondary non-volatile
`storage device 74 communicate with management console
`70 using communication links 76 and 78, respectively.
`Memory storage devices 72 and 74 communicate with one
`another through communication link 80.
`
`3
`FIG. 1 is a schematic drawing illustrating a plurality of
`web server processing cards coupled with a public network,
`a private network, and a management network, in accor(cid:173)
`dance with one embodiment of the present invention;
`FIG. 2 is a plan view taken from above, with portions
`broken away, illustrating a web server processing card;
`FIG. 3 is a plan view taken from below, with portions
`broken away, illustrating the web server processing card of
`FIG. 2;
`FIG. 4 is a plan view taken from above, illustrating a
`network interface card in accordance with one embodiment
`of the present invention;
`FIG. 5 is a plan view taken from above with portions
`broken away,
`illustrating an alternative embodiment net- 15
`work interface;
`illustrating
`FIG. 6 is a plan view taken from above,
`another alternative embodiment network interface card;
`FIG. 7 is a plan view taken from above, illustrating yet
`another alternative embodiment network interface card;
`FIG. 8 is an elevation view illustrating a front portion of
`a passive midplane, in accordance with one embodiment of
`the present invention;
`FIG. 9 is an elevation view, illustrating a rear portion of 25
`the passive midplane of FIG. 8;
`FIG. 10 is an isometric view, with portions broken away,
`illustrating a server chassis, in accordance with one embodi(cid:173)
`ment of the present invention;
`FIG. 11 is an isometric view, with portions broken away, 30
`illustrating additional components of the web server chassis
`of FIG. 10;
`FIG. 12 is an isometric view, with portions broken away,
`illustrating additional components of the web server chassis
`of FIG. 10; and
`FIG. 13 is an isometric view, illustrating a web server
`rack, in accordance with one embodiment of the present
`invention.
`
`PUBLIC NETWORK
`In the illustrated embodiment public network switch 42
`includes a Cisco® Catalyst 5500, an industry standard
`Ethernet switch. Alternatively, a Black Diamond public
`switch, as manufactured by Extreme Networks® may be
`provided as public switch 42.
`A high density connector 43 may be coupled with public
`switch 42 to facilitate communication between public switch
`35 42 and communications link 44. In one embodiment, high
`density connector 43 may include an RJ-21 high density
`telco (telephone company) type connector for consolidating
`at least twelve 10/100/1000 megabits per second Ethernet
`connections through a single cable. The use of high density
`40 telco style connectors, like high density connector 43 allows
`the consolidation of twelve, twenty-four or forty-eight Eth(cid:173)
`ernet connections, at a twelve to one ratio, through a single
`cable.
`Communication link 44 is operable to provide gigabit
`45 Ethernet over fiber. In another embodiment, communication
`link 44 may include gigabit Ethernet over copper. The
`coupling between public switch 42 and network interface
`card 40 may be accomplished using a single communication
`link 44. However, in another embodiment a second com-
`50 munication link 44 may be provided to accomplish a redun(cid:173)
`dant configuration. This allows a back-up communication
`link between public switch 42 and network interface card 40,
`in case of failure of the primary communication link.
`Accordingly, redundant fiber connections to public switch
`55 42 or other high density data center switches capable of
`aggregating hundreds of gigabit connections in a single
`switch 42, are provided.
`Public switch 42 is coupled with public network 45 over
`communications link 51. In a particular embodiment, com-
`60 munication link 51 may include a high bandwidth transport,
`for example and without limitation T3 or OC48, in order to
`serve a plurality of servers on an internet service provider
`(ISP) or application service provider (ASP) network.
`
`DETAILED DESCRIPTION OF THE DRAWINGS
`
`Referring to FIG. 1, a high density, multiple server
`network of the present invention is illustrated and generally
`designated by the reference number 30. Network 30 includes
`a plurality of web server processing cards 32 and 132-135
`coupled with a public network 45, a private network 46 and
`a management network 47. Each web server processing card
`32 and 132-135 are configured and function similarly.
`Therefore, web server processing card 32 will be described
`in detail, for illustrative purposes. However, all web server
`processing cards described within this specification may
`include all components and functionality described with
`regard to web server processing card 32.
`Web server processing card 32 provides the functionality
`of a single board computer which may be employed as a rack
`mounted web server. Networks 45, 46 and 47 may be
`configured, maintained and operated independently of one
`another, and cooperate to provide distributed functionality of
`network 30.
`Each web server processing card 32 is coupled with a
`passive midplane 34 which is coupled with a base 36 of a
`server chassis 38. Additional components regarding web
`server chassis 38 are illustrated and described with respect
`to FIG. 10. A network interface card 40 couples passive
`midplane 34, and therefore web server processing cards 32 65
`with a public network switch 42, via communication links
`44. Throughout this specification, the term "switch" may be
`
`PRIVATE NETWORK
`Similar to public network switch 42, private network
`switch 50 may also include either a Catalyst 5500, as
`
`

`
`US 6,757,748 Bl
`
`5
`
`5
`manufactured by Cisco®, or a Black Diamond, as manu(cid:173)
`factured by Extreme Networks®. A high density connector
`53 may be provided to facilitate communication between
`private network switch 50 and communications link 52, and
`ultimately, network interface card 48.
`In a particular
`embodiment, high density connector 53 may include an
`RJ-21 high density telco type connector for consolidating at
`least
`twelve 10/100/1000 megabits per second Ethernet
`connections through a single cable. As previously described,
`the use of high density telco style connectors, like high 10
`density connector 53 allows the consolidation of twelve,
`twenty-four or forty-eight Ethernet connections at a twelve
`to one ratio, through a single cable.
`High density connectors, for example 43 and 53, facilitate
`the consolidation of 10/100/1000 megabits per second Eth- 15
`ernet cabling for large numbers of web server processing
`cards. Accordingly, private switch network switch 50 is
`cable of aggregating forty-eight or more 10/100/1000 mega(cid:173)
`bits per second Ethernet ports in a single network interface
`card, and seven hundred sixty-eight ports (web server pro- 20
`cessing cards) in a single private network switch.
`Private network switch 50 is coupled with a plurality of
`"back office" network applications including storage server
`54, applications server 56, database server 58 and legacy
`systems 60. Storage server 54 provides mass storage to 25
`support web server processing cards of various users. This is
`a private connection because server 54 is not linked directly
`to public network 45. Throughout this specification, "back
`office" will be used to indicate operations, management and
`support tasks used to support the operation of web server 30
`processing cards, which are accomplished at remote loca(cid:173)
`tions from server chassis 38. Communication links 62-65
`provide private 10/100/1000 megabits per second Ethernet
`supporting various high volume business transaction pro(cid:173)
`cessing systems (HVBTPS). Storage server 54 provides 35
`network attached storage (NAS). Application server 56 may
`be rented, or provided by an application service provider
`(ASP). Database server 58 provides transaction processing,
`and legacy systems 60 may include various database servers,
`~.
`
`~
`
`6
`server network 30. For example, an operator of a remote
`management system 70 can control all of the functions and
`operations of web server processing cards 32. In fact, remote
`management system 70 includes control software and other
`applications which accomplish these functions and opera(cid:173)
`tions automatically, without operator intervention. Many of
`the software and other applications which may reside upon
`remote management system 70 will be described later, in
`more detail.
`In a particular embodiment, remote management system
`70 performs metering, including without limitation packet
`level metering, and bandwidth monitoring of web server
`processing cards 32. Other characteristics and measurements
`which remote management system 70 collects, evaluates and
`stores include operating data and other information regard(cid:173)
`ing web server processing cards 32.
`Remote management system 70 identifies each web server
`processing card 32 according to at least two identifiers. For
`example, during start-up of each web server processing card
`32, remote management system 70 is informed of a hard(cid:173)
`ware address associated with each web server processing
`card 32. The hardware address is analogous to the IP address
`assigned by the server to each client,
`in a client/server
`network system. The hardware address of each web server
`processing card 32 may be referred to as the "logical"
`address of a particular web server processing card.
`Also during the startup of web server processing cards 32,
`remote management system 70 is informed of a chassis/slot
`address identifier unique to each web server processing card
`32. The chassis/slot address may also be referred to as the
`physical identifier, or physical address of a particular web
`server processing card. The physical address allows remote
`management system 70 to identify a particular web server
`processing card 32 in a manner which is more readily
`identifiable to an operator of remote management system 70
`or other user of server network 30.
`Remote management system 70, non-volatile storage
`device 72 and secondary non-volatile storage device 74 also
`provide in-line/near-line storage support for web server
`processing cards 32. Storage devices 72 and 74 may include
`high capacity redundant array of inexpensive disks (RAID)/
`optical/tape subsystem controlled by hierarchical storage
`management software which enables automatic back-up and
`restoration of user data from all servers via remote manage(cid:173)
`ment system 70.
`Remote management system 70 has the ability to provide
`a single point of management for thousands of servers. The
`servers under the control of remote management system 70
`may include thousands of web server processing cards 32.
`These servers may be configured to provide individual
`server capacity. In another embodiment, the servers may be
`"clustered." In other words a plurality of web server pro(cid:173)
`cessing cards 32 may be joined logically in order to provide
`a sealed level of service to a user.
`Accordingly, remote management system 70 provides
`management functionality over a private, back end network,
`which may include thousands of web servers. In a particular
`embodiment, software associated with remote management
`system 70 may be installed upon a high capacity Linux
`server or workstation with enough storage capacity to pro-
`vide back-up functionality to all servers on any particular
`network.
`Management software, applications and functionality
`65 associated with remote management system 70 typically
`reside on a server. However, remote management system 70
`may be accessed remotely by various electronic devices
`
`Private network 46 is considered "private," because there
`is no physical connection between private network 46 and
`public network 45. Accordingly, security is provided to data
`and communications of private network 46 because private 45
`network 46 is protected from a security breach initiated from
`public network 45.
`Private network 46 may be configured to provide a
`plurality of "back-end" network applications. For example,
`private network 46 may provide end users with secure 50
`internet voicemail, internet fax, a "personal" web server,
`electronic mail accounts, MP-3 servers and/or digital photo
`collection servers.
`In another embodiment, private network 46 may be con(cid:173)
`figured to provide groupware and other associated applica- 55
`tions. For example, private network 46 may include the
`necessary hardware and software to provide users of net(cid:173)
`work 30 with "chat rooms" and other on-line meeting
`applications. Wireless Application Protocols (WAPs) appli(cid:173)
`cations may also be provided. In fact, the WAP applications 60
`may be synchronized to groupware associated with the web
`server processing cards.
`
`MANAGEMENT NETWORK
`Remote management system 70 of management network
`47 includes the ability to monitor, manage, back-up, restore,
`activate and operate many of the components of high density
`
`

`
`US 6,757,748 Bl
`
`7
`including laptops, desktops and handheld personal digital
`assistants ("PDAs"). Devices used to access remote man(cid:173)
`agement system 70 may also include a secure web browser
`or other security applications.
`A web browser based, graphical user interface 69 asso(cid:173)
`ciated with remote management system 70 provides the
`operator of management network 47 with a user-friendly,
`easy to read overview of operational functions in graphical
`formats, suitable for "at a glance" monitoring and diagnosis.
`As will be described later in more detail, remote man(cid:173)
`agement system 70 includes various software, applications
`and functionality which simplify and improve the operation
`of associated web servers, including without limitation web
`server processing cards 32. For example, remote manage(cid:173)
`ment system 70 provides "automated preemptive failover"
`functionality. Automated preemptive failover includes an
`automated system which monitors and predicts component
`failures,
`issues notification to the network operator or
`administrator and initiates fail-over
`to a "warm spare"
`before catastrophic failures occur, without much, if any user
`intervention.
`Remote management system 70, along with storage
`devices 72 and 74 provide automated back-up of client data
`for automated restoration of a web server processing card, or
`a spare web server processing card to its original state, in the
`event of a failure.
`In a particular embodiment, a software agent residing
`upon remote management system 70 may be used to collect,
`store, and analyze measurements and data regarding
`hardware, software and bandwidth usage measurements for
`billing purposes. These measurements and data may be
`exported to a variety of applications including data mining
`and decision support systems.
`Remote management system 70 provides the functionality
`of a browser-based user administrative graphical user inter(cid:173)
`face. This includes an intuitive user interface for controlling
`basic functionality of servers on a single server level.
`Accordingly, a network operator or administrator may add,
`delete, configure or modify virtual servers and/or web server
`processing cards 32. Similarly, remote management system
`70 may be used to add, delete, configure and modify users
`who are granted access to web server processing cards 32 of
`public network 45. Remote management system 70 also
`provides operations, administration, management and pro(cid:173)
`visioning (OAM&P) functionality to the network adminis(cid:173)
`trator. Traffic metering and measurement (TM&M) and
`performance measurements are also collected, stored, ana(cid:173)
`lyzed and maintained by remote management system 70.
`Similar to private network 46, management network 47 is
`considered a "private" network. Since there is no physical
`connection between management network 47 and public
`network 45, management network 47 is protected from a
`security breach initiated from public network 45.
`
`WEB SERVER PROCESSING CARDS
`Referring now to FIGS. 1-3, web server processing card
`32 will be described in more detail. Web s