(12) United States Patent
`US 7,576,663 B2
`(10) Patent No.:
`
`Hoffert et al.
`(45) Date of Patent:
`Aug. 18, 2009
`
`USOO7576663B2
`
`(54)
`
`INLINE AUDIO/VISUAL CONVERSION
`
`(75)
`
`Inventors: Bradley W'. Hoffert, San Jose, CA (US);
`Susanna E- H0176”, San JOSE, CA (US);
`Steven L. Kelsey, Sunnyvale, CA OJS);
`James L. McPeak, Fremont, CA (US);
`Oscar l. Medina, San Jose, CA (US);
`Christopher E. Fitzpatrick, Morgan
`Hill, CA (US); Paul A. \Vilcox,
`Sunnyvale, CA (US)
`
`(73) Assignee: Locolabs, LLC, Sunnyvale, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(56)
`
`
`
`......................................... 341/51; 327/143
`(52) U.S. Cl.
`(58) Field of Classification Search ............. 341150790;
`710/55; 148/554, 844; 327/141
`See application fi e for complete search history.
`_
`References C'te‘i
`U S PATjNT DOCUNUENTS
`'
`'
`A
`'7
`6,914,637 B1
`7/2005 Wolf et 31,
`7,295,443 152 '1
`11/2007 Mambakkam et a1.
`2004/0027103 A1
`2/2004 Boylan
`
`2004/0080671 A1
`4/2004 Slemens
`2004/0239816 A1 ’1‘
`12/2004 Ando
`............... 348/705
`
`”(2005
`NOS/0098323 Al Pk
`,
`—
`' A '
`.............................
`Egg/323228: A} , 13/588: gamng
`”
`3
`/
`e
`
`...... 361/737
`
`386/37
`/
`439 607
`
`(21) Appl. No.: 11/788519
`.
`'
`(22) Flled'
`
`Apr. 20‘ 2007
`
`(65)
`
`Prior Publication Data
`US 2007/0252746 A1
`Nov. 1, 2007
`
`* Cited by examiner
`Primary HXHWIil’IPViI .am '|' Mai
`(74) Attorney, Agent, or FirmiBlakely, Sokoloff, Taylor &
`Z f
`LLP
`a man,
`(5 7)
`
`ABSTRACT
`
`Related U-S- Application Data
`(60) Provisional application No. 60/793 831 filed on Apr.
`21 2006.
`a
`‘
`’
`
`A system, method, and apparatus for inline audio/visual con—
`version are described. Power to an inline converter is pro-
`Vided over the A/V cable that couples the converter to a
`destination such as a selector.
`
`(5])
`
`Int. Cl.
`H03M 764
`
`(2006.01)
`
`13 Claims, 15 Drawing Sheets
`
`
`
`
`
`
`
`
`
`
`
`
`Remove
`
`Voltage from
`Pints)
`
`m
`
`
`
`Establish _
`Communication
`
`Enabla High-Currenl Voliags m
`
`
`
`mafia;infiggi'S’Q'nn’egnaVVVVVVVVVVVVVVVVVVVVVVVVVVVVV
`
`
`
`
`
`
`
`
`Response?
`m1
`ND
`ransrnl
`' isssnce
` :~ 'sssags 0 Ti "18
`
`Convener
`;
`
`
`
`-
`
`VES
`
`P322?
`
`MS_Biscotti_0061620
`
`Petitioner Microsoft - Ex. 1021, p. 1
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 1 of 15
`
`US 7,576,663 B2
`
`
`
`DVI
`
`ANALOG
`
`FIG. 1
`
`(PRIOR ART)
`
`MS_Biscotti_0061621
`
`Petitioner Microsoft - Ex. 1021, p. 2
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 2 of 15
`
`US 7,576,663 B2
`
`
`
`
`207
`
`HDMI OUT
`
`
`
`209
`
`FIG. 2
`
`(PRIOR ART)
`
`MS_Biscotti_0061622
`
`Petitioner Microsoft - Ex. 1021, p. 3
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 3 of 15
`
`US 7,576,663 B2
`
`
`
`305
`
`
`
`
`
`
`
`
`
`301
`POWER
`
`AV|N2 HDMI _| HDMI_2AVINI HDMIOUT
`
`
`
`
`
`
`
`
`FIG.3
`
`(PRIOR ART)
`
`MS_Biscotti_0061623
`
`Petitioner Microsoft - Ex. 1021, p. 4
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 4 of 15
`
`US 7,576,663 B2
`
`wZ_._Z_
`
`Kmkmm>200
`
`
`
`FmOav.25ECHOmAWWucmEma
`
`
`
`._.¢On.v.255‘5530n—
`
`mzmo
`
`zo:<z_5mo_v
`
`NnowuNawkmm>zoo
`
`NZ_._Z_
`
`zmhmmszoo
`
`mDMDOw
`
`hmOa
`
`mmEmsZoo
`
`.
`
`
`
`_.5vFmo_>m_n_>2
`
`mEvwmo_>mo>2
`
`EmEma
`
`223.8
`
`Lm>oEgonKO...mimm
`
`223mom30w
`
`.EOn.
`
`v.9".
`
`
`
`MS Biscotti 0061624
`
`Petitioner Microsoft - Ex. 1021, p. 5
`
`
`
`
`
`
`
`

`

`%mm>>0n_
`
`wUEDOm
`
`a.Eom
`
`
`
`7
`
`1|
`<I
`-
`
`AmcofigEEES
`mohomzzoo
`a$9005
`
`
`
`US. Patent
`
`Aug. 18, 2009
`
`Sheet 5 of 15
`
`US 7,576,663 B2
`
`.502:05
`
`-5EmE525%
`
`8826
`
`A|
`
`
`
`m.9".
`
`
`t1%
`
`I
`
`<55mmom
`
`@2553
`
`$583a89>.9858
`
`
`
`
`
`agaas.mm>momm58:80
`
`0.9.?
`
`
`
`
`
`2_
`
`MO00._<z<
`
`RES4<._._O_n_
`
`z.
`
`mo004<z<
`
`O_o:<2:05
`
`MS Biscotti 0061625
`
`Petitioner Microsoft - Ex. 1021, p. 6
`
`
`
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 6 of 15
`
`US 7,576,663 B2
`
`Em
`
`338.wasmamé
`
`
`
`
`
`
`
`womDOw
`
`mOHOmzzoo
`
`Hmoa
`
`slow
`
`%E26;
`
`
`
`a:2Io._._>>w
`
`g305.
`
`o.9...
`
`
`
`xza
`
`2982on
`
`E8
`
`3d
`
`x25
`
`NImO._.0mzzoo
`
`%HmOa
`
`328m555
`
`mussomEgo
`
`xz_w
`
`Zlmohomzzoo
`
`.EOQ
`
`25m
`
`21858555
`
`MS Biscotti 0061626
`
`Petitioner Microsoft - Ex. 1021, p. 7
`
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 7 of 15
`
`US 7,576,663 B2
`
`
`
`
`ODV0301-330.)
`
`_._‘_‘_.music“)
`
` iQ
`
`
`COOD‘ICDU‘l-FOJNA
`
`
`
`
`
`if_x 01
`709
`
`\IO')
`_x_\
`i
`__U L 8
`71 1
`701
`
`703
`
`FIG. 7
`
`MS_Biscotti_0061627
`
`Petitioner Microsoft - Ex. 1021, p. 8
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 8 0f 15
`
`US 7,576,663 B2
`
`Measure Voltage On Power Pin(s) fl E
`
`
`
`fl
`
`
`
`
`
`Apply Voltage to Power Pin(s) w
`
`l
`
`
`
`Voltage
`YES
`Present?
`
`
`
`
`
`
`
`
`
` Remove
`
`Receive
`
`
`Voltage from
`
`
`Message?
`
`Pin(s)
`
`fl
`
`593
`
`
` Message
`
`
`valid?
`m
`
`
`
`Establish
`Communication
`
`Enable High-Current Voltage m
`
`
`
`
`
`
`
`Presence
`Check —
`
`
`
`
`
`ransmit Presence Check Message to lnfine Conveter
`
`
`815
`
`
`
`
`Receive
`
`
`
`NO
`YES
`Response?
`
`
`m
`
`
`
`Transmit Presence Check Message to‘lfilme
`Converter 819
`
`Fig. 8
`
`MS_Biscotti_0061628
`
`Petitioner Microsoft - Ex. 1021, p. 9
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 9 of 15
`
`US 7,576,663 B2
`
`Receive Low-current Voltage via cable fl
`
`
`
`Transmit Presence Message over cable 9%
`
`
`
`
`
`
`
`
`
`
`Disable
`Receive High-
`Circuits
`current Voltage?
`
`
`%
`$1
`
`
`
`
`
`
`Enable conversion circuits fl
`
`
`
`
`
`Receive Presence Check Message M
`
`
`
`
`
`Transmit Response 11
`
`Fig. 9
`
`MS_Biscotti_0061629
`
`Petitioner Microsoft - Ex. 1021, p. 10
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 10 0f 15
`
`US 7,576,663 B2
`
`mmooozw
`
`05382838
`
`a|I!82£9
`
`2..0."—
`
`
`
`
`
`Q
`
`89>mz_._z_
`
`
`
`mmooozm-05368;85928
`
`625%::9w551|52558228a.m89>8880E8x25
`
`moOO._<2<
`
`
`
`H30._<._._o_n_
`
`F22
`
`052
`
`8982on
`
`wins—
`
`89>a
`
`.......................................
`
`898228
`
`
`
`
`
`z_._<._._0_n_
`
`MS Biscotti 0061630
`
`Petitioner Microsoft - Ex. 1021, p. 11
`
`
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 11 of 15
`
`US 7,576,663 B2
`
`RECEIVE
`VALID
`MESSAGE
`
`11M
`
`
`
`
`
`APPLY HIGH-CURRENT POWER 1L;
`
`
`
`
`1
`Y
`
`
`
`
`
`TRANSMIT PRESENCE MESSAGE 110
`
`
`
`
`RECEIVE
`RESPONSE?
`
`M
`
`
`
`APPLY LOW-CURRENT POWER fl
`
`
`
`
`FIG. 11
`
`MS_Biscotti_0061631
`
`Petitioner Microsoft - Ex. 1021, p. 12
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 12 of 15
`
`US 7,576,663 B2
`
`
`
`RECEIVE LOW-CURRENT POWER 1 01
`
`TURN ON AT LEAST PORTION OF MCU fl
`
`ESTABLISH COMMUNICATION
`
`120
`
`RECEIVE HIGH-CURRENT POWER 12 7
`
`TURN ON OTHER CONVERSION CIRCUITS
`
`fl
`
`
`
`ESTABLISH COMMUNICATION
`
`1.2.11
`
`FIG. 12
`
`MS_Biscotti_0061632
`
`Petitioner Microsoft - Ex. 1021, p. 13
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 13 of 15
`
`US 7,576,663 B2
`
`1301
`
`1303
`
`tHDMI
`
`KEY
`
`1305
`
`KEY
`
`HDMI
`
`1307
`
`
`
`SHIELD
`
`CABLE
`
`FIG. 13
`
`MS_Biscotti_0061633
`
`Petitioner Microsoft - Ex. 1021, p. 14
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 14 of 15
`
`US 7,576,663 B2
`
`1 403_1
`
`1 4D3_2
`
`
`
`
`
`. . C U
`
`HDMI_0UT
`14 7
`
`
`
`FIG. 14
`
`MS_Biscotti_0061634
`
`Petitioner Microsoft - Ex. 1021, p. 15
`
`

`

`US. Patent
`
`Aug. 18, 2009
`
`Sheet 15 of 15
`
`US 7,576,663 B2
`
`fl
`
`GRAPHICS
`
`DISPLAY
`
`PROCESSOR
`
`M
`
`M
`
` PROCESSOR(S)
`
`
`
`SYSTEM
`MEMORY
`
`
`m
`
`FIG. 15
`
`MS_Biscotti_0061635
`
`Petitioner Microsoft - Ex. 1021, p. 16
`
`

`

`1
`IN LINE AU DlO/VIS UAL COD VERSth
`
`2
`BREII’ DESCRIPTION OF TIIE DRAWINGS
`
`US 7,576,663 B2
`
`PRIORITY TO PROVISIONAL APPLICATION
`
`This application claims the benefit of US. Provisional
`Application No. 60/793,831, filed Apr. 21, 2006.
`FIELD OF INVENTION
`
`The field of invention relates generally to the audio/Visual
`(A/V) hardware, and, more specifically, to a converting ana-
`log or digital A/V streams into a single digital signal such as
`a High-Definition Multimedia Interface (HDMI) signal, con-
`verting a single digital signal into analog or digital A/V
`streams, and switching between multiple digital signals.
`BACKGROUND
`
`10
`
`15
`
`The present invention is illustrated by way of example, and
`not limitation. in the figures ofthe accompanying drawings in
`which like references indicate similar elements and in which:
`FIG. 1 illustrates an exemplary prior art analog to DVI
`converter;
`FIG. 2 illustrates an exemplary prior art HDMI switch;
`FIG. 3 illustrates an exemplary prior art A/V receiver;
`FIG. 4 illustrates an example ofusing a selector and one or
`more converters to provide a single digital A’V stream from
`multiple input signals to a destination;
`FIG. 5 illustrates an embodiment of circuitry of air inline
`source converter;
`FIG. 6 illustrates an embodiment ofa selector that provides
`power to a converter;
`FIG. 7 illustrates an embodiment of two I—IDMI connectors
`used as a sink and a source connector;
`FIG. 8 is an embodiment of a method of providing and
`maintaining power from a selector to source converter over a
`cable;
`FIG. 9 is air embodiment ofa method of a converter receiv-
`ing and maintaining power from a selector;
`FIG. 10 illustrates an embodiment of a digital A/V stream
`converter;
`FIG. 11 is an embodiment ofa method of providing and
`maintaining power from a selector to a digital A/V stream
`converter;
`FIG. 12 is an embodiment of a method of a digital A/V
`stream converter receiving and maintaining power from a
`selector;
`FIG. 13 illustrates an erribodirnent of an extended HDMI
`interface;
`FIG. 14 illustrates an embodiment of the external connece
`tions of an IIDMI switch that utilizes an extended IIDMI
`interface; and
`FIG. 15 shows an embodiment of a computing system.
`
`SI IMMARY
`
`A system, method. and apparatus for inline audio/visual
`conversion are described. Power to an inline converter is
`provided over the A/V cable that couples the converter to a
`destination such as a selector.
`
`
`
`DETAILED DESCRIPTION
`
`As described earlier, the prior art approaches to HDMI
`switch and analog to HDMI conversion all have their draw-
`backs and failings. For example, HDMI switches do not pro—
`vide the flexibility to use any type of connection that a user
`has and IIDMI converters require external power to convert
`analog signals or switch sources. An improved approach
`allows users to connect a number of older and newer forrriat
`devices to a single device with a selectable output to the
`digital display. The approach should be flexible enough to
`support
`today’s different
`input combinations and easily
`upgrade older devices or add new devices in the future.
`
`Modular Conversion
`
`FIG. 4 illustrates an example of using a selector and one or
`more converters to provide a single digital A/V stream from
`multiple input signals to a destination. In this example, there
`is a need to connect several differcntA/V devices 401, 402 to
`a single destination 407. These A/V source devices 401 may
`output any combination of analog video signals (such as
`
`MS_Biscotti_0061636
`
`Petitioner Microsoft - Ex. 1021, p. 17
`
`such High—Definition Television
`As digital displays
`(HDTV), Digital Television (DTV), and high resolution corri-
`puter displays are becoming more common place, IIDMI
`connections have become the desired way to bring A/V
`streams into digital displays as a HDMI cable carries both
`digital video and digital audio on a single cable.
`However, most end-users will not also update all of their .
`non—HDMI compatible legacy A/V devices (such as a set top
`box, video game console(s), VCR, DVR, DVD player, etc).
`Rather, these users may need or want to convert the outputs
`from these devices from older analog interfaces, including
`composite, component, S-video, VGA, etc.,
`to the newer
`IIDMI standard. Even when the digital display supports the
`older interfaces, the physical nature of the device (e.g., flat
`panel mounted on a wall) may not make iteasy or attractive to
`have multiple cables hanging from the display. Additionally,
`having multiple cables in close proximity can lead to the
`bleeding of signals from one cable to another causing inter-
`ference in either the picture or audio.
`MG. 1 illustrates an exemplary prior art analog-to-DVI
`converter 101. This converter 101 takes an analog video input
`105 (VGA or component) and converts that analog input into
`a Digital Visual Interface (DVI) output 107. Unfortunately,
`like all converters of this nature, converter 101 requires a
`direct extemal socket power source to supply the converter
`101 with the power necessary to drive its conversion circuitry
`through port 103. For example, the converter 101 may use a
`transfonnerplugged into a wall socket to provide DC voltage
`to it or include a transformer inside of the converter’s shell
`that is supplied an AC voltage from a wall socket.
`FIG. 2 illustrates an exemplary prior art HDMI switch 201.
`This particular switch takes intwo HDMI inputs 203. 205 and
`has one IIDMJ output 207 that is selected from one ofthe two
`inputs. Like the prior art converters, prior art HDMI switches
`require a direct external power source to provide power to a
`port 209 ofthe switch 201.
`FIG. 3 illustrates an exemplary prior art A/V receiver 301.
`This receiver 301 takes in multiple traditional A/V sources
`303_1 and 303_2, multiple HDMI sources 303_3 and303_4,
`and outputs a single HDMI output 307. A/V receivers with
`HDMI pass-through also have their drawbacks. Like the prior
`art converters and switches. prior art A/V receivers require a
`direct external power source to provide power to a port 305.
`A/Vreceivers are also bulky and expensive when compared to
`a simple switch or converter. While A/V receivers also likely
`have features that are never used and not enough of the fea-
`tures (inputs) that a user wants, the user is saddled with the
`capabilities of the A/V receiver that is neither flexible or
`“future proof.”
`
`4o
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`US 7,576,663 B2
`
`3
`composite, component, S-video, etc.), analog audio signals
`(left and right channel audio), digital video signals (such as
`DVI), and/or digital audio (optical or digital).
`While one of these devices 402 is in the format that the
`selector 405 accepts, two of these devices require an inline
`source converter 403 to convert their outputs (analog or digi—
`tal) into a digital format that is acceptable to the selector. for
`example, these outputs may be converted into a single digital
`A/V stream instead of the multiple signals that are typically
`associated with these devices, I11 an embodiment, these ana-
`log or digital outputs are converted into the HDMI format
`which is a single digital AW stream.
`An NxM HDMI selector 405 receives up to NA/V outputs
`from theseA/V devices 401, 402 and outputs M single digital
`A/V streams (N and M may be any number 1 or greater). The
`use of the inline converters 403 injunction with the selector
`405 allows for a more flexible approach than the traditional
`receiver or switch provides as all that is needed to connect a
`new device that cannot be accepted by the selector 405 is the
`appropriate converter cable 403. Because of this, a user is not
`tied to some set of pre—chosen selector inputs that may not
`fulfill his/her needs. The destination 407 may be anything that
`accepts single digital A/V stream as a source including a
`digital display such as an HDTV, DLP project, etc. or a
`conversion cable.
`In an effort to help make the following description easier to
`follow some terms are herein defined. The output from an
`inline converter cable comes from an “inline converter source
`port.“ This output is so named because it will be the source to
`an input ofthe selector 405. The selector 405 has N inputs that
`are called “selector sink ports” which receive data from the
`output the inline converter cables. The selector405 also has M
`outputs called “selector source ports” which provide an input
`for destination 407. Finally, destination 407 has an inline
`converter sink port that receives a single digital A/V stream
`from the selector’s 405 selector source port. For example,
`converter 1 403_1 may output an HDMI signal from its inline
`converter source port which is coupled to a selector sink port
`of selector 405 and selector 405 may output an HDMI signal
`from one of its selector source port’s to an inline converter
`sink port of destination 407.
`
`Conversion Circuitry
`
`Traditionally, single digital AW stream cables, such as
`HDMI cables. have been used almost exclusively for trans—
`mitting A/V data and not receiving data orpower (one excep-
`tion being that pin 19 of a Type A IIDM] connection is used
`for “hot plug” detection). For this reason, all of the prior art
`approaches to analog-to-DVI or HDMI conversion required a
`power source external to the conversion circuitry to power the
`conversion circuitry. This extra power source is often a cum-
`bersome apparatus and limits the flexibility where these con—
`verters are usable.
`FIG. 5 illustrates an embodiment of circuitry of an inline
`source converter. This converter 403 converts one or more
`analog and/or digital video and/or audio source signals into a
`single digital A/V stream such as HDMI. An input video
`connector 515 receives one or more Video signals. These
`signals are passed to a Video decoder circuit 503 to convert
`analog or digital Video ofdifferent formats (SDTV, HDTV,
`NTCS, PAL, etc) and standards (RGB, SCART, Composite,
`Component. S-Video, DVI. SDI. etc.) into digital signals of
`different color space (RGB, YCer, etc). Outputs from the
`video decoder 503 include a group of digital signals com-
`posed of 24 to 36 digital signals to support different color
`resolutions (8, 10 or 12 bits per color. either 4:222 or 4:44)
`
`10
`
`15
`
`4o
`
`45
`
`50
`
`55
`
`60
`
`65
`
`
`
`4
`and co or spaces (RGB or YCer). The video decoder 503
`may support several different analog and/or digital video
`standards or be specific to just one video standard. For
`examp e, the video decoder 503 may support one or more of
`the fol owing analog video standards: Composite (CVBS),
`Component (Pb, Pr, andY), S—Video (Y and C). and RGB (R,
`G, B, I s, & Vs); and digital video standards suchas DVl. The
`converted digital video signals are transmitted to either the
`optional video data mapping circuit 507 or to the encoder 511
`depencing upon the configuration of the inline converter.
`This circuit 503 also extracts timing information, embed-
`ded in he video stream. into dedicated output signals which
`are transmitted to the coupled encoder circuit 51 1. Exemplary
`timing information includes, but is not limited to, horizontal
`and vertical syncs, data enable (turn on) information, and
`pixel c ock information. Exemplary circuits that may be used
`for the video decoder circuit 503 include, but not limited to,
`Analog Devices’ ADV7403 and Philips’ SAV7118.
`An audio comiector 517 receives one or more analog or
`digital inputs depending upon which type of comlector (ana—
`log or digital) is used. These inputs are passed at audio
`receiver 505. If an analog audio input is received, the audio
`receiver 505 converts source analog audio signals into a serial
`digital stream including serial audio data, clock. and left/right
`chaimel select. For example, the audio receiver 505 may
`convert left and right audio channels into Inter-TC Sound
`(IZS) signals ofdifferent sampling rates. This digital stream is
`transmitted to the encoder circuit 51 1. Exemplary circuits that
`may be utilized as the audio ADC 505 include, but are not
`limited to, Asahi Kasei’s AK5357.
`Ifthe audio stream is digital. then this circuit 505 may be an
`optical or non-optical receiver to support digital audio in the
`form of AES-EBU or Sony/Philips Digital Interface Format
`(SPDIF). Exemplary circuits that may be utilized as the
`receiver 505 include, but are not
`limited to, Toshiba’s
`TORXl 4l .
`The encoder circuit511 is a specialized device that receives
`video data output from the video decoder circuit 503 (and
`optional video data mapping circuit 507) and audio data from
`audio receiver 505 and converts them from separate (parallel)
`streams into an encoded single digital serialA/V stream using
`timing signals from the video decoder circuit 503.
`In an embodiment, the single digital serial A/V stream is an
`HDMI stream and the encoder circuit 511 outputs two signal
`buses to the connector 513. The first signal bus is the “TMDS”
`bus which is a group of four pairs of signals containing the
`high-speed serial data, The second signal bus is the “BBC”
`bus which is a group of two signals used to support configu—
`ration and content protection.
`Exemplary circuits that may be utilized as the encoder
`circuit 511 are Silicon Image’s Sil9134 & Sil9030, andAna-
`log Devices’ AD9889.
`The microeontroller or processor (MCU) 509 is a general
`purpose controller that performs one or more ofthe following
`functions: configures the other circuits; maintains validation
`of communications over a reserved pin or pins of the cable
`carrying the single digital A/V stream from the converter;
`software upgrades; monitor conversion activities being per-
`formed; inspect signals; serially communicates With a con-
`nected device. etc. The MCU 509 provides and receives
`numerous control signals to the other circuits. For example,
`the MCU 509 receives interrupts from the video decoder 503,
`audio receiver 505, and encoder 511.
`The MCU 509 provides the video decoder 503 with control
`signals that are in the form of a low-rate serial interface, such
`as 12C (Inter-Integrated Circuit) or SPI (Serial Peripheral
`Interface). Other control signals provided to the video
`
`MS_Biscotti_0061637
`
`Petitioner Microsoft - Ex. 1021, p. 18
`
`

`

`US 7,576,663 B2
`
`5
`decoder503 include signals for reset, interrupts, and seleet(s).
`Control signals to the audio receiver 505 from the MCU 509
`range from discrete signals to a serial bus iii the form of l2C
`or SP1 and may include reset, interrupts. and select signals
`Exemplary circuits that may be utilized as the MCU 509
`include, but not limited to, are Atmel’ s AT91$AM7S, Micro—
`chip’s PlClBl’8722, and ()Kl’s MLG7Q4061.
`A source connector port 513 provides an interface for
`communicating with another device such as a selector. The
`single digital AA’ stream generated by the encoder circuit 51 1
`is transmitted through this connector port 513 over a single
`cable to another device such as a selector.
`The conversion circuitry also includes power circuitry 519.
`The power circuitry rcccives power (current and voltage)
`through the single digital A/V cable from an external device
`such as a selector and supplies power to the other conversion
`circuits 503, 505, 507, 509, and 511. Of course not every
`circuit has the same power requirements so voltage dividers,
`etc. may need to be utilized to provide each circuit with the
`proper power requirement. No prior art conversion system
`has its conversion circuitry powered in this manner
`each
`requires a direct connection to an external power source. For
`example, ifthe conversion circuitry is creating and outputting
`an HDMI stream, pin 18 of a TypeA HDMI connector carries
`power (+5V and approximately 50 mA or 500 mA current)
`that is used to power circuitry 519 of the inline converter
`through a coupled HDMI cable from an external device. In
`other words. the external device provides power to the con-
`verter over the cable and eliminates the need for the converter
`to have a direct external power source. Additionally, pin 14 of
`the HDMI connector (which is normally reserved) is used to
`communicate information from the MCU 509 to an outside
`device over the HDMI cable.
`In an embodiment,
`the conversion circuitry includes a
`video data mapping circuit 507 that is an active switch that
`arranges the bit ordering from the digital bus output of the
`video decoder 503 into the proper format for the encoder
`circuit 511. This ordering is performed to satisfy specific
`requirements of different video formats and resolutions, 'lhe
`re-ordering may only apply to a group ofbits or the entire bus
`of bits transmitted from the video decoder 503 to the video
`data mapping circuit 507. Any active analog switch, such as
`the On Semi MC14016 or equivalent, is suitable for the appli—
`cation. The control signals provided to the video data inap-
`ping circuit 507 depend 011 the specific implementation ofthe
`analog switch and could range from discrete signals to a serial
`bus in the form of 12C or SPl,
`In some embodiments, inputs to the conversion circuitry
`arc dedicatedA/V cables that are hardwired through the hous-
`ing and not simply ports/connectors. In other embodiments,
`only the cables or ports for a particular input are present.
`Similarly, the output may be a hardwired cable (such as an
`HDMI cable or variant).
`
`Selector
`
`FIG. 6 illustrates an embodiment ofa selector that provides
`power to a converter. The selector includes N sink connectors
`601_1 to 601_N. Only one cable may connect to a sink
`comrector 601 at a time. Through the existing power pin or
`pins of a sink connector 601 power (current and voltage) may
`be supplied to a source device such as converter 403. Addi—
`tionally, communications between the source device (con—
`verter 403) and selector may be transmitted through one or
`more reserved pins of the sink connector 601.
`In an embodiment, the selector is an HDMI selector and
`accepts multiple HDMI inputs and outputs HDMI streams. If
`
`10
`
`15
`
`'
`
`30
`
`4o
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`the standard 1 9-pin'1'ypeA llDMl connector isused, pin 18 of
`each HDMl sink connector 601 is used to sense if a “normal”
`HDMI cable is connected to the selector through the source
`connector 601 or if the cable that is attached is coupled to a
`device that requires power. If the voltage on pin 18 is +5V,
`then it is assumed that a normal HDMI cable is comiected and
`no power needs to be supplied. If the cable is coupled to a
`device that requires power such as the converter described
`earlier then no voltage will be on pin 18. Pin 14 of the HDMI
`connector (which is nonnally reserved) is used to connnuni-
`cate information between the MCU 509 of the converter and
`the MCU 605 of the selector.
`A NxM switch 603 is used to switch between the N sources
`so that M outputs are selected at a time. Typically, M is equal
`to 1 and N is greater than 1. An output of the switch 603 is
`supplied to a source connector port 607.
`In an embodiment, the source connector port 607 is a
`standard HDMl connector. Pins 18 and 14 of the HDMI
`source connector port 607 are used in similar marnier as pins
`18 and 14 ofthe l—lDMl sink connectors 601. The output ofthe
`source connector port 607 may be sent to a digital display,
`other selector, or to a digital converter. If the NxM switch 603
`is an IlDMl switch, then exemplary circuits that may be
`utilized as the switch 603 include, but not limited to, Tl’s
`TMDS341 and Pericom’s Pl3HDMl34lART.
`The MCU 605 is a general purpose controller that performs
`one or more of the following ftmctions: configures the other
`circuits; maintains communications over attached cables with
`an inline converter that requires power from the selector; and
`software upgrades. The MCU 605 provides and receives
`numerous control signals to the other circuits. The MCU 605
`provides the le HDMI switch 603 with a signal to select
`which ofthe N inputs to output and a transmit enable (turn on)
`signal.
`Additionally, one ormore ofthe powercircuits 609 provide
`a voltage and a current to one or more inline converters that
`require power (connections not shown). In one embodiment,
`the MCU 605 only provides this voltage and current to sink
`connectors 601 or source comrectors 607 that have a converter
`coupled to them through a cable.
`In an HDMI specific embodiment, a +5V reference and
`high- or low-current are supplied to pin 18 of HDMI sink
`connector ports 601 and/or source connector port 607. The
`circuitry of the HDMI selector may be power by an external
`power source.
`FIG. 7 illustrates an embodiment of two HDMI connectors
`used as a sink and a source connector. Both connectors have
`the Type A standard 19 pins. Pin 18 711, 705 is used to
`transfer high-current and low-current +5V references from
`the selector to a converter. Pin 14 709, 707 is used to transmit
`messages between the selector and converter.
`
`Power from Selector to Source Converter
`
`One or more of the circuits of the source conversion cir—
`cuitry is provided power (current and voltage) through the
`cable that is connected to the selector. 1’10, 8 is an embodi-
`ment of a method ofproviding and maintaining power from a
`selector to source converter over a cable.
`The selector 405 measures the voltage found on one or
`more of the sink connector power pins 601 at 801. For
`example, if using HDMl, the MCU 605 of the selector 405
`measures the voltage on pin 18 of one or more of the sink
`connector ports 601.
`If there is a voltage present, then it is assumed that the
`coupled device does not need power. For example, if a starr-
`dardHDMl source device is eonnectedto the port it wouldnot
`
`MS_Biscotti_0061638
`
`Petitioner Microsoft - Ex. 1021, p. 19
`
`

`

`US 7,576,663 B2
`
`7
`require power. The port is identified as having a device that
`does not require power at 803.
`If there is not a voltage present, a low-current reference
`voltage is provided on one or more of the power pins by the
`power circuit 609 selector 405 at 805. Typically, this low-
`current voltage is provided on the behest of the MCU 605.
`This low-current reference voltage will be carried by the
`cable coupling the selector 405 and converter 403. For
`example, ifusing IIDMI, a low—current +5V reference will be
`applied to pin 18 of the sink conrrectorport 601 and carried to
`pin 18 ofthe converter 403. According to an embodiment, the
`current is on the order of 50 mA.
`
`Once a low-current voltage has been provided to the cori-
`vertcr 403, a communications link should be established
`between the selector 405 and converter 403. This communi—
`cation may be used to determine if the converter 403 needs
`more current and if it is still alive. In an embodiment, the
`low—current voltage allows for at least a part of the MCU 509
`ofthe converter 403 to be turned on and generate one or more
`messages. In an embodiment, the converter 403 transmits a
`“presence” message over a reserved or unused pin of its
`connector port 513.
`If a message has not been received at 807, then the low—
`current reference voltage is removed from the power pin(s] at
`809. This removal serves two purposes. First, it saves power
`by not unnecessarily providing power to a device (or no
`device) that does not need or want the power. Second, it will
`not provide a false positive if or when the selector measures
`the voltage on the pin(s) at some later point in time.
`If a message is received at 807, the selector determines if
`the received message is a valid presence message at 811. for
`example, MCU 605 executes a software routine to determine
`if the message received is valid. IfHDMI is being utilized. all
`messages are received or transmitted on pin 14 of the respec-
`tive HDMI connectors.
`
`Ifthe message is not valid, the low-current reference volt-
`age is removed from the power pin of the appropriate con—
`nectors 601. For example. the MCU 605 orders the power
`circuit 609 to stop providing the low-current reference to the
`appropriate sink connector 601.
`If the message is valid, then appropriate power pin(s) is
`supplied with a high-current reference voltage. for example,
`if HDMI is being used, a high—current of around 500 mA is
`supplied with a +5V reference. This high-current reference
`allows the rest conversion circuitry of the converter 403 to be
`activated.
`
`Of course it should be understood that it is not overly
`important which device initiates the establishment of a com—
`munications between the devices. In an alternative embodi-
`ment, the selector 405 pings the converter with a presence
`message after it has provided low-current power to the con-
`verter 403.
`
`Because the converter 403 may be removed or stop func—
`tioning at a later point in time, periodic presence checks are
`performed. The selector 405 transmits a presence check mes-
`sage to the converter 403 at 815 and waits for a response
`message. If the selector 405 does not receive a response
`message at 817. one of two actions may be taken depending
`upon the configuration of the selector 405. Another presence
`check message may be transmitted at 819 or the voltage for
`the power pin may be removed. For example, if only one
`presence message was sent, it maybe that the converter is too
`busy to respond and should be given another chance to
`respond as removing the high-current voltage reference
`would shut off the conversion circuitry thereby causing an
`
`5
`
`10
`
`15
`
`'
`
`4o
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`interruption in the single digital A/V stream, Of course, it
`should be again understood that the converter 403 could also
`initiate the presence check.
`FIG. 9 is an embodiment ofa method of a converter receiv—
`ing and maintaining power from a selector. The converter 403
`receives a low-current reference voltage over a cable from the
`selector 405 at 901 . For example, a +5V reference voltage is
`applied to pin 18 if HDMI is used.
`The converter 403 transmits a presence message over one
`or more reserved or unused pins to the selector at 903. This is
`done over pin 14 if a Type A HDMI connector is used. For
`example, once the MCU 509 is turned on the by the low-
`current reference voltage, it prepares and transmits a presence
`message through pin 14 of the connector 513.
`Ifthe converter 403 receives a high—current reference volt—
`age at 905 it may transmit an acknowledgment message (de-
`pen