EXHIBIT 1003
`EXHIBIT 1003
`
`Ex. 1003 — TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE — IPR2023-00240
`Page 1 of 31
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 1 of 31
`
`

`

`
`
`
`
`I IIIII IIIIIIII IIIIII
`
`(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2004/0117858 Al
`Jun. 17, 2004
`Boudreau et al.
`(43) Pub. Date:
`
`(54) DATA ENHANCED MULTI-MEDIA SYSTEM
`FOR AN EXTERNAL DEVICE
`
`(22) Filed:
`
`Dec. 12, 2002
`
`(76)
`
`Inventors: Paul A. Boudreau, Marietta, GA (US);
`Samuel H. Russ, Lawrenceville, GA
`(US)
`
`Correspondence Address:
`SCIENTIFIC-ATLANTA, INC.
`INTELLECTUAL PROPERTY DEPARTMENT
`5030 SUGARLOAF PARKWAY
`LAWRENCEVILLE, GA 30044 (US)
`
`(21) Appl. No.:
`
`10/318,116
`
`Publication Classification
`
`(51) Int. C1.7
`(52) U.S. Cl.
`
`H04N 7/16; H04N 7/173
`725/144; 725/133; 725/153
`
`ABSTRACT
`(57)
`An apparatus provides multimedia content by receiving first
`content from a client device, the first content encoded in a
`digital stream, decoding the digital stream to produce
`decoded first content, and presenting the decoded first con-
`tent in addition to the presentation of second content pre-
`sented at a display device.
`
`200
`
`00101001011
`
`DHCT 16
`
`Let's
`Work
`Out!
`
`/
`
`741
`
`210
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 2 of 31
`
`

`

`Patent Application Publication
`
`Jun. 17, 2004 Sheet 1 of 11
`
`US 2004/0117858 Al
`
`. _
`S
`
`CD
`,-
`
`I-0
`I
`0
`
`8
`a)
`Z
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 3 of 31
`
`

`

`Patent Application Publication
`
`Jun. 17, 2004 Sheet 2 of 11
`
`US 2004/0117858 Al
`
`(.5 LL
`
`\
`
`, -: •
`
`1 . -
`
`0
`0
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 4 of 31
`
`

`

`Patent Application Publication
`
`Jun. 17, 2004 Sheet 3 of 11
`
`US 2004/0117858 Al
`
`CO
`CNI
`
`LL
`
`...Ai:::::::::::::::::::44444:::::::
`
`4::::::::::::::::::::::::::**
`
`:::•*: 4 4 4::::::::::::: : :::::* 14,...:444:40........4004;
`1OO***:::::::::::::::::*
`
`*:•:•:**:+:•:•:v..........
`.❖.❖.❖.❖.•.00❖.❖.❖.•.
`ove.v.v........400
`4444444444v...we....
`vo......0*40:444.,*
`44::••::+::::::::
`:4:44::::::::::::::**4
`t:•:e:*+*4,.;+*+*.*.*
`.00•.o❖.❖.❖.❖.❖.❖.o•.
`ooe.te+*o*+w *+*4,
`44.: 4•:+o,"...
`....smom
`.o❖.❖.•.00❖.❖.❖.❖.e•.
`44+:44+:4•:+:44.M44.
`:::::+:+:40:44****
`*:::::::::::::::::::::+:4444
`+:44+*:•::::::::::::::::::::
`::::::::::::::::**.***44
`•••:•:+:•:+:+:44.:+:444 ..
`:44+:•:•:•:•:+:+*:+:4
`:•:•:•:•:•:•:+:444444444
`0.***4400:44.0
`*********OO
`:*****:•:::::•:::::::::::::
`X•:+:4+:::::+:::+:4+:4
`444+:4444:•:444X;k::::
`X.:4•X•X40:•*:•.......
`.•..o❖.❖.❖.❖.❖.❖..o•.
`:,..NNANNPANNNNNNu......
`...........,........,,,,,,,,,,,,
`
`a)
`E O U)
`O
`
`C
`0
`
`01
`0
`a)
`E
`
`O
`
`a)
`a)
`
`O
`>,
`
`a)
`
`O
`U)
`
`a)
`
`U)
`Q
`
`U)
`0
`
`0
`C
`C
`
`2
`
`0
`0
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 5 of 31
`
`

`

`Patent Application Publication
`
`Jun. 17, 2004 Sheet 4 of 11
`
`US 2004/0117858 Al
`
`CO
`a
`LL
`
`0
`
`cp co co
`
`II
`c.i
`+
`
`: )
`
`DHCT 16
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 6 of 31
`
`

`

`Patent Application Publication
`
`Jun. 17, 2004 Sheet 5 of 11
`
`US 2004/0117858 Al
`
`4:r
`• a
`U
`
`<
`
`0
`
`..E
`ma
`'IA
`
`w
`mi
`0 NZ
`
`DHCT 16
`
`r o
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 7 of 31
`
`

`

`Patent Application Publication
`
`IT jo 9 1331IS
`
`IV 8SSLII0/1700Z Sfl
`
`508
`
`ANALOG
`SOURCE
`
`INPUT
`SOURCE
`
`MODULATOR
`527
`
`CNTR.
`598
`
`CLOCK
`599
`
`RECEIVER
`
`510-7
`514
`
`512
`
`518
`
`520
`
`VIDEO
`/ CAMERA
`
`ENCODER
`
`540
`
`Modulators
`
`528
`
`542
`
`542
`542
`
`11
`
`COMBINER
`546
`
`In-Band
`Delivery
`554
`
`18
`
`524(a)
`
`Multiplexer
`
`566
`
`MAC
`
`524(b)-
`
`MAC
`
`SWITCH
`
`566
`
`530
`
`Control
`System
`
`532
`
`522
`
`r 564
`
`ROUTER
`
`588
`
`SERVER
`516
`
`FIG. 5
`
`542
`
`550
`
`570
`
`QPSK MODEM 526
`
`Out-of-Band FDS 576 ,
`
`Out-of-Band
`RDS 580
`
`Out-of-Band
`Delivery 556
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 8 of 31
`
`

`

`Patent Application Publication
`
`IT JO L lamIS
`
`IV 8SSLII0/1700Z Sfl
`
`FIG. 6A
`
`ELEMENTARY STREAM 602
`
`MPEG PICTURE
`604
`
`MPEG PICTURE
`604
`
`PACKETIZED ELEMENTARY STREAM 606
`
`PES PACKET 608
`
`PES RACKET 608
`
`..
`
`PES HEADER
`610
`
`MPEG CONTENT
`612
`
`PES HEADER
`610
`
`MPEG CONTENT
`612
`
`Time Stamps 611
`
`SCR
`619
`
`MPEG APPLICATION STREAM 614
`
`618 622 620(a)
`
`618
`620
`616 _.)
`
`618
`
`620
`
`•
`
`•
`
`• 618 622 620(n)
`
`616 ..)
`
`616(n
`
`PCR 621
`
`616(a)
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 9 of 31
`
`

`

`Patent Application Publication
`
`II Jo 8 lamIS
`
`PAT (PID = 0)
`
`10
`
`PROGRAM
`PROGRAM 1
`PROGRAM 3
`PROGRAM 10
`
`PID
`22
`25
`250
`
`PMT (PID = 22),
`PROG, 1
`STREAM 1 VIDEO 54
`STREAM 2 AUDIO 48
`STREAM 3 AUDIO 49
`
`----
`66
`STREAM K DATA
`
`----
`
`612
`
`MPEG
`APPLICATION
`STREAM 614
`
`HEADER 618
`l
`PAYLOAD 620
`
` /
`
`HEADER 618
`
`PAYLOAD 620
`
`HEADER 618
`
`(
`PAYLOAD 620
`
`/
`
`HEADER 618
`
`PAYLOAD 620
`
`616A -)
`
`616B -)
`
`616C -}
`
`616D-/
`
`FIG. 6B
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 10 of 31
`
`

`

`Patent Application Publication
`
`II Jo 6 lamIS
`
`IV 8S8L110/1700Z Sfl
`
`DHCT 16
`
`COM
`PORT 774
`
`PROCESSOR
`744
`
`MEMORY 739
`
`PLATFORM 756
`WIN.
`SAM
`MGR 759
`757
`
`WATCHTV 762
`
`O.S. 753
`
`DRIVER
`712
`
`DRIVER
`711
`
`RES.
`MGR
`767
`
`BFS
`743
`
`NAVIGATOR 755
`
`IPG 191
`
`XPORT BUFFER
`735
`
`
`
`AUDIO BUFFER
`736
`
`VIDEO BUFFER
`737
`
`BROWSER
`766
`
`SAM DATABASE
`760
`
`PVR 777
`
`APP MEM 770
`
`USER REG 750
`
`XPORT
`709
`
`CLOCK/TIMER 14.-
`721
`
`COMP ENG
`717
`
`DECODE
`715
`
`SIGNAL PROC. 714
`
`DEMUX/PARS 718
`
`MEDIA ENGINE 729
`
`DEMOD 716
`
`MEM CONTROLLER 734
`
`VIDEO DECODER 733
`
`TUNER SYSTEM 745
`
`AUDIO DECODER 732
`
`A
`
`TV OUTPUT SYSTEM 731
`
` No'
`
`INTERFACE 775
`
`Transceiver
`771
`
`STORAGE DEV. 773
`controller
`DISK
`779
`701
`
`RECEIVER
`746
`
`COMM INTERFACE
`742
`
`18
`
`NETWORK
`
`HEADEND 11
`
`TV
`741
`
`Ext. Dev. 710
`
`Ext. Cktry. 700
`
`FIG. 7A
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 11 of 31
`
`

`

`Patent Application Publication
`
`Ti: .0 0I lamIS
`
`FIG. 7B
`
`Ext. Cktry. 700
`
`A
`
`AI
`
`•
`
`Processor
`703
`
`4
`
`Transceiver 702
`
`io
`
`USB
`707
`
`Speaker/microphone
`706
`
`I
`
`•
`
`4
`
`►
`
`yr
`
`Storage
`704
`
`Decoder
`705
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 12 of 31
`
`

`

`Patent Application Publication
`
`TI .0 TI lamIS
`
`IV 8SSLII0/1700Z Sfl
`
`ext
`device
`710
`
`transceiver
`771
`
`processor
`744
`
`driver 711
`
`R7O0T9
`
`p
`app
`
`WatchTV
`app 762
`
`demux/parse XPORT
`buffer
`718
`735
`
`signal
`
`801----9
`
`indication
`
`802
`
`pass control
`to driver
`
`;Ix
`
`804-9
`
`external device
`information
`
`il.
`
`806 -- 9
`
`
`instruction s for PID
`
`parsing an d routing
`
`-4
`
`channel to tune to
`extract content
`
`808
`
`\''.---- 810
`
`instr
`
`
`uctions for PID pars ng and routing
`
`I oad to cache of corn enunication port
`
`delivery
`
`i ll
`
`818
`
`812)
`
`buffer
`
`(
`814
`
`FIG. 8
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 13 of 31
`
`

`

`US 2004/0117858 Al
`
`Jun. 17, 2004
`
`1
`
`DATA ENHANCED MULTI-MEDIA SYSTEM FOR
`AN EXTERNAL DEVICE
`
`TECHNICAL FIELD
`[0001] This invention relates in general to the field of
`television systems, and more particularly, to the field of
`interactive television.
`
`BACKGROUND OF THE INVENTION
`
`[0002] With recent advances in digital transmission tech-
`nology, subscriber television systems are now capable of
`providing much more than the traditional analog broadcast
`video. In implementing enhanced programming, the home
`communication terminal ("HCT"), otherwise known as the
`set-top box, has become an important computing device for
`accessing content services (and content within those ser-
`vices) and navigating a user through a maze of available
`services. In addition to supporting traditional analog broad-
`cast video functionality, digital HCTs (or "DHCTs") now
`also support an increasing number of two-way digital ser-
`vices such as video-on-demand and personal video record-
`ing.
`
`[0003] Typically, a DHCT is connected to a cable or
`satellite, or generally, a subscriber television system, and
`includes hardware and software necessary to provide the
`functionality of the digital television system at the user's
`site. Some of the software executed by a DHCT can be
`downloaded and/or updated via the subscriber television
`system. Each DHCT also typically includes a processor,
`communication components, and memory, and is connected
`to a television or other display device, such as a personal
`computer. While many conventional DHCTs are stand-alone
`devices that are externally connected to a television, a
`DHCT and/or its functionality may be integrated into a
`television or personal computer or even an audio device
`such as a programmable radio, as will be appreciated by
`those of ordinary skill in the art.
`
`[0004] While subscriber television systems offer a variety
`of services, there remains a vast potential of untapped
`markets where the resources of the subscriber television
`system can be effectively employed. For example, visual
`media and merchandising have enjoyed a long history of
`effective and synergistic business promotion and increasing
`sales. Television shows and movies provide licensing oppor-
`tunities for toy manufacturers to sell merchandise. These
`sales are made directly through distributors or through third
`parties such as fast food chains that offer licensed merchan-
`dise and open new sources of revenue for retailers, cable
`operators, media production, and set-top box manufacturers.
`What is needed is a system that taps into this vast merchan-
`dising market using subscriber television technology.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`[0005] The invention can be better understood with refer-
`ence to the following drawings. The components in the
`drawings are not necessarily to scale, emphasis instead
`being placed upon clearly illustrating the principles of the
`present invention. Moreover, in the drawings, like reference
`numerals designate corresponding parts throughout the sev-
`eral views.
`
`[0006] FIG. 1 is a block diagram depicting a non-limiting
`example of a subscriber television system (STS), in accor-
`dance with one embodiment of the invention.
`
`[0007] FIGS. 2A-2B are schematics of example imple-
`mentations of a multi-media system implemented in the
`subscriber television system shown in FIG. 1, in accordance
`with one embodiment of the invention.
`
`[0008] FIGS. 3-4 are schematics of example implementa-
`tions of a multi-media system implemented in the subscriber
`television system shown in FIG. 1, in accordance with one
`embodiment of the invention.
`
`[0009] FIG. 5 is a block diagram depicting a non-limiting
`example of selected components of the headend as depicted
`in FIG. 1, in accordance with one embodiment of the
`invention.
`
`[0010] FIG. 6A is a block diagram that illustrates the
`mapping of a Motion Pictures Expert Group (MPEG)
`elementary stream into an MPEG application stream, in
`accordance with one embodiment of the invention.
`
`[0011] FIG. 6B is a block diagram of an exploded view of
`some of the content carried in the MPEG application stream
`depicted in FIG. 6A, in accordance with one embodiment of
`the invention.
`
`[0012] FIG. 7A is a block diagram illustration of an
`example digital home communication terminal (DHCT) as
`depicted in FIG. 1, which is coupled to a headend, a
`television, and an external device, in accordance with one
`embodiment of the invention.
`
`[0013] FIG. 7B is a block diagram of example external
`device circuitry of the external device shown in FIG. 7A, in
`accordance with one embodiment of the invention.
`
`[0014] FIG. 8 is a timing diagram of one example imple-
`mentation for detecting an external device and downloading
`content to the external device, in accordance with one
`embodiment of the invention.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`[0015] The preferred embodiments of the invention now
`will be described more fully hereinafter with reference to the
`accompanying drawings. The preferred embodiments of the
`invention include a multi-media system that coordinates the
`presentation of content in one device with the presentation
`of the same or related content in one or more other devices.
`The multimedia system can be implemented in many sys-
`tems, but will be described in the context of a subscriber
`television system. The multi-media system includes func-
`tionality that provides for the download of content (includ-
`ing video, audio, and/or data corresponding to television
`show episodes, movies, etc.) that is related to the content
`(e.g., programming) presented on a television, and its cor-
`responding presentation at an external device. Herein such
`content that is related (e.g., relatedness as to subject matter,
`message, theme, etc.) to programming presented on a tele-
`vision and is for download (or transmittal) to an external
`device will be referred to as related content. The related
`content can be transferred to the external device through a
`medium (e.g., cable or wiring) that physically connects a
`digital home communication terminal (DHCT) to the exter-
`nal device, or through air via radio frequency (RF) trans-
`mission and/or infrared (IR) transmission, among other
`mechanisms. Note that in other embodiments, the content
`can be unrelated content, such as external device software
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 14 of 31
`
`

`

`US 2004/0117858 Al
`
`Jun. 17, 2004
`
`2
`
`upgrades to improve interactivity to the multi-media system,
`among other unrelated content.
`
`[0016] The presentation of content displayed on the tele-
`vision set can be synchronized with the related content
`presentation at the external device. For example, the external
`device can be embodied in the form of an action figure
`corresponding to a like character on a television show. The
`action figure can include functionality for providing audio
`related to the show. In one implementation, whenever the
`character on the television show speaks during a particular
`episode, his or her voice is heard emanating from the action
`figure associated with the character, alone or in conjunction
`with the sound (i.e., the character's voice) emanating from
`the television set.
`
`In other implementations, the theme of the show
`[0017]
`(for example, "say no to drugs") can be reinforced in the user
`through the action figure in a non-synchronized, or partially
`synchronized manner (partially synchronized in the sense
`that the related content is presented sometime during the
`scheduled presentation for the content shown on the televi-
`sion set). For example, an action figure (or doll, among other
`devices) can include downloaded audio clips of phrases such
`as "don't do drugs" or "stay away from drug users," the
`verbatim phrases which may or may not have been presented
`during the television episode. This related content can be
`downloaded to the action figure at the start of, in advance of,
`during, and/or after the particular episode that presents this
`anti-drug theme. The audio clips can then be presented for
`playback through the action figure during the show, later on
`in the day, and/or until that content is overwritten with new
`content from another episode, among other examples, thus
`providing increased show awareness to the user and rein-
`forcing positive messages.
`
`is
`television system
`[0018] An example subscriber
`described initially, followed by some example implementa-
`tions using the example subscriber television system to
`provide an infrastructure for the multimedia system func-
`tionality. Following the example implementations is a
`description of an example headend and example mecha-
`nisms that can be employed by the headend for sending
`content to a DHCT for presentation on a television set and
`for downloading related content to an external device. Then,
`an example DHCT and example external device circuitry for
`an external device are described. Finally, one example
`implementation for detecting an external device and down-
`loading related content to the external device is described, in
`accordance with one embodiment of the invention.
`
`[0019] The invention may, however, be embodied in many
`different forms and should not be construed as limited to the
`embodiments set forth herein; rather, these embodiments are
`provided so that this disclosure will be thorough and com-
`plete, and will fully convey the scope of the invention to
`those of ordinary skill in
`the art. Furthermore, all
`"examples" given herein are intended to be non-limiting and
`among others not shown but understood to be within the
`scope of the invention.
`
`Example Subscriber Television System
`
`via a communications network 18. It will be understood that
`the STS 10 shown in FIG. 1 is merely illustrative and should
`not be construed as implying any limitations upon the scope
`of the preferred embodiments of the invention. For example,
`although single components (e.g., a headend and a DHCT)
`are illustrated in FIG. 1, the STS 10 can feature a plurality
`of any one of the illustrated components, or may be con-
`figured with alternative embodiments for any one of the
`individual components or with yet other additional compo-
`nents not enumerated above. Subscriber television systems
`also included within the scope of the preferred embodiments
`of the invention include systems not utilizing physical
`structured cabling for transmission, such as, but not limited
`to, satellite systems and terrestrial-broadcast systems (such
`as Multichannel Multipoint Distribution Service (MMDS)
`and local TV stations).
`
`[0021] A DHCT 16 is typically situated at the residence or
`place of business or recreation of a user and may be a
`stand-alone unit or integrated into another device such as,
`for example, a television set or a personal computer or other
`display devices, or an audio device, among other client
`devices. The DHCT 16 receives content (video, audio and/or
`other data) from the headend 11 through the network 18 and
`in some embodiments, provide reverse information to the
`headend 11 through the network 18.
`
`[0022] The headend 11 receives content from one or more
`content providers (not shown), including local providers.
`The content is processed and/or stored and then transmitted
`to client devices such as the DHCT 16 via the network 18.
`The headend 11 may include one or more server devices (not
`shown) for providing content to the DHCT 16. The headend
`11 and the DHCT 16 cooperate to provide a user with
`television services via a television set (not shown). The
`television services may include, for example, broadcast
`television services, cable television services, premium tele-
`vision services, video-on-demand (VOD) services, and/or
`pay-per-view (PPV) services, among others.
`
`Example Multimedia System Implementations
`
`[0023] FIGS. 2A-4 are schematic diagrams illustrating
`some example recreational and educational TV implemen-
`tations for the multi-media system as used in the example
`subscriber television system 10 (FIG. 1), in accordance with
`one embodiment of the invention. The multimedia system
`enables television show producers to license (and toy manu-
`facturers to offer) merchandise that can adapt to and reflect
`the content of the television production. The multimedia
`system can be used to continue the learning experience of a
`child throughout the day, and increase the level of interest in
`the show, since the child relates the show with both the
`viewing image and the interactive programming of a toy.
`The multi-media system in the example implementation
`shown in FIG. 2A includes an external device embodied as
`a doll 210 (which includes external device circuitry 200,
`preferably located internal to the doll 210), a DHCT 16, and
`a television set 741. In the example implementation shown,
`a child workout show is presented. The doll 210 the child is
`holding is made to the likeness of the host.
`
`[0020] FIG. 1 is a block diagram depicting a non-limiting
`example of a subscriber television system (STS) 10. In this
`example, the STS 10 includes a headend 11 and a digital
`home communication terminal (DHCT) 16 that are coupled
`
`[0024] The external device circuitry 200 (hardware and/or
`software) incorporated into the doll 210 receives content (as
`represented by the zigzag line that is digitally modulated, as
`represented by the 0 and 1's) from the DHCT 16. In the
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 15 of 31
`
`

`

`US 2004/0117858 Al
`
`Jun. 17, 2004
`
`3
`
`example implementation shown, the downloaded content is
`related to the child workout show, and includes the audio
`content representing the encoded voice signals of the host of
`this child workout show. The show host barks out, "Let's
`work out", and this audio is heard emanating from the
`television set 741 (or from remote speakers for the television
`set 741) and from the doll 210 (or from only the doll 210).
`The doll 210 preferably receives this audio content in
`real-time with the show presentation, but in other embodi-
`ments, the audio content can be downloaded to the doll 210
`ahead of time and presented in synchronization with the
`corresponding video for the show when "awakened" by
`trigger signals sent by the DHCT 16 or according to time
`stamps interpreted by the DHCT 16 and downloaded to the
`external device circuitry 200 (or interpreted at the doll 210).
`For example, the doll 210 can be equipped with a clock or
`other timer (not shown) which operates in synchronization
`with the DHCT 16 using normal play time (NPT) mecha-
`nisms, enabling the data stream to reference the internal
`clock of the doll 210 since it is in synchronization with the
`DHCT clock (not shown).
`[0025]
`In other embodiments, the related content down-
`loaded to the doll 210 can include audio clips that may or
`may not be the verbatim audio used in the television show
`episode presented on the television set 741. That is, the
`audio of the doll 210 does not necessarily have to be
`synchronized to the presentation of the show, nor does the
`audio presented through the doll 210 have to ever be heard
`emanating from the TV presentation (i.e., the voice from the
`doll 210 does not have to be the exact dialogue spoken by
`the host of the child workout show). For example, content
`related to the show, such as key words that mirror the theme
`of the last tuned show (e.g., "stay fit") can be programmed
`by the content provider and sent in an associated elementary
`stream for that show. This related content can be down-
`loaded to the external device circuitry 200 of the doll 210 at
`anytime before, during, and/or after the show presentation,
`and presented to the child at the press of a button (not
`shown) on the doll 210, after an elapsed time as configured
`by an internal timer (not shown) in the doll 210, and/or in
`response to certain environmental stimuli like light, sound,
`etc., via sensors (not shown) included in the doll 210, among
`other mechanisms.
`[0026] For example, as shown in the schematic of FIG.
`2B, upon the alarm 220 activating and emitting a buzzer
`sound or music (represented by the music notes), the doll
`210 begins to speak about something related to the prior
`show (e.g., the workout show) using audio content down-
`loaded to the doll 210 contemporaneously with the presen-
`tation of the prior show. In this example, the doll 210 urges
`the child, "OK. Time to get up and do some pushups like I
`showed you yesterday!" In other embodiments, the down-
`loaded content can include embedded instructions for the
`external device circuitry 200 that, when executed, cause the
`doll 210 (via internal actuators not shown) to begin doing
`sit-ups, or other physical acts at any particular time after a
`timed interval and/or in response to external stimuli. Con-
`versely, the child's stimulus, such as pressing a button, could
`evoke a pre-downloaded response. Note that both embodi-
`ments shown in FIGS. 2A and 2B can be implemented in
`the same doll 210 or different dolls. For example, each
`function described for these embodiments can be imple-
`mented through separately purchasable plug and play mod-
`ules that interface with the external device circuitry 200 (and
`
`thus are implemented in the same doll). As another example,
`there can be a doll for reinforcing the content or content
`theme (e.g., stay healthy) and a different doll for speaking
`the dialogue presented during the show in real-time, or these
`different functions can be achieved separately or combined
`through replaceable or programmable electronic chips or
`software modules.
`
`[0027] The above described functionality can be extended
`to handheld games, among other devices. For example,
`interactive features can be added to current TV program-
`ming, the content of which is mirrored in hand-held games,
`as one example. The functions of updating character func-
`tionality or adding additional characters can be achieved
`based on the user interaction with a particular episode. For
`example, new secondary characters can be included in the
`related content, which are added to the games while viewing
`a particular episode (e.g., as opposed to buying a new
`cartridge). In addition, new methods can be downloaded to
`the games and the clues to using these methods can be found
`(and/or downloaded) only by watching that particular epi-
`sode. Further, games can be controlled by the multi-media
`system based on synchronization signals with the episode
`(via the DHCT 16). As another example, preprogrammed
`game sequences can be enabled during the television media
`broadcast.
`
`[0028] FIG. 3 depicts a home schooling and/or remote
`schooling implementation, in accordance with one embodi-
`ment of the invention. In the example implementation
`depicted in FIG. 3, a child is shown at his desk taking notes
`and/or following instructions during an educational show
`presented on the television set 741. The example show is a
`tutorial on basic math principles. In this example, a printer
`310 is physically connected (with communication over a
`wiring medium 330) to the DHCT 16 via the communication
`port of the DHCT 16, and during the tutorial, the related
`content includes homework and/or practice sheets that are
`downloaded to the printer 310. Extensions to this imple-
`mentation include national or regional bible studies, or
`continuing education, among others. The external device
`could also include such devices that augment the program
`for physically disabled persons.
`
`[0029] Other embodiments can include bi-directional
`communication between the various types of external
`devices and the DHCT 16 to provide feedback to the DHCT
`16 (and subsequently to the content provider) to help tailor
`the content to be downloaded to external devices, or to be
`passed on to the program provider for purposes such as
`grading tests and ordering merchandise, among other tasks.
`For example, a user can use a remote control device that
`enables, in cooperation with the DHCT 16, user input
`capability. The remote control device could be a mouse,
`keyboard, touchscreen, infrared (IR) remote, personal com-
`puter (PC), laptop, or a scanner, among others or a combi-
`nation of these. For instance, a scanner could be hooked to
`a PC to perform optical character recognition (OCR) (or to
`perform functionality equivalent to a bubble-in/OPSCAN
`form) of test answers formulated by a user. The signals
`corresponding to the remote control input are received by
`the DHCT 16 and sent upstream (e.g., to the program
`provider) for grading and other related or unrelated tasks.
`
`[0030] The multimedia system can provide the opportu-
`nity for a wide array of television productions that include,
`
`Ex. 1003 – TCL Indus Holdings Co., Ltd.
`TCL Indus Holdings Co., Ltd. v. LGE – IPR2023-00240
`Page 16 of 31
`
`

`

`US 2004/0117858 Al
`
`Jun. 17, 2004
`
`4
`
`as one example, 30 minutes of visual content backed by
`portable products that extend the learning process beyond
`the scope of the show. These devices can provide an inter-
`active learning process for the user beyond a typical
`30-minute audio-visual show. External devices can range
`from simple "speak and spell" devices that aid in the
`learning of words, language, and/or grammar in multiple
`languages at all learning levels to "learn and test" devices
`that provide basic scientific measurement results. The "learn
`and test" devices can include simple temperature and force
`measuring devices and a simple flat panel screen. A televi-
`sion show can describe simple experiments while the "learn
`and test" device is loading experimental notes and prompts
`that will guide the user through learning experiences that are
`carried out after the show. This active link between the
`television show episode and the "learn and test" device
`provides for formats of the shows and device user interfaces
`that can be adapted to suit a wide variety of learning
`experiences.
`
`[0031] The multi-media system can also provide for
`extended content to day-care centers that are typically
`struggling to provide new activities for children. The inter-
`active use of the learning devices likely won't carry the
`stigma of excessive "TV watching", and can provide an
`extra activity beyond the 30-minute educational show, and
`can allow children to work on individual schedules.
`
`[0032] FIG. 4 is a schematic of another example imple-
`mentation, demonstrating how the multi-media system can
`provide tutorials in music education, in accordance with one
`embodiment of the invention. A music piece can be pre-
`sented on the television set 741 using one or more instru-
`ments (and even played using an orchestra). The aspect of
`the music piece the user is interested in playing is then
`presented on the television set 741. In this example, the user
`has indicated an interest in the piano part, and thus a
`keyboard is displayed on the television 741 with notes above
`the keys and a moving "dot" or other symbol corresponding
`to the current note that is to be played on the piano 410
`(connected to the DHCT 16) by the user according to the
`presented song. For example, the "dot" on the keyboard
`displayed on the television screen may not move until it
`receives feedback (via a bi-directional port at the DHCT 16,
`for example) indicating that the user has struck the proper
`key on his or her piano 410. The number and sizes of lessons
`to be downloaded to the DHCT 16 can be variable, based on
`the current level of interest and current skill level, and thus
`need not consume considerable amounts of memory.
`
`Example Headend
`
`[0033] Since the example implementations illustrated in
`FIGS. 2A-4 were described in the context of an example
`subscriber television system, the relevant components of the
`subscriber television system will now be described as one
`example infrastructure for providing the functionality of the
`multimedia system described above. FIG. 5 is an overview
`of an example headend 11, which provides the interface
`between the STS 10 (FIG. 1) and the service and content
`providers. The overview of FIG. 5 is equally applicable to
`an example hub (not shown), and the same elements and
`principles may be implemented at a hub instead of the
`headend 11 as described herein. It will be understood that the
`headend 11 shown in FIG. 5 is merely illustrative and
`should not be construed as implying any limitations upon the
`
`scope of the preferred embodiments of the invention. The
`headend 11 receives content from a variety of service and
`content providers, which can provide input in a variety of
`ways. The headend 11 combines the content from the
`various sources and distributes the content to subscribers via
`the distribution systems of the network 18.
`
`In a typical system, the programming, services and
`[0034]
`other information from content providers can be distributed
`according to a variety of mechanisms. The input signals may
`be transmitted from sources to the headend 11 via a variety
`of transmission paths, including satellites (not shown) and
`terrestrial broadcast transmitters and antennas (not shown).
`The headend 11 can also receive content from a direct f