(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2002/0087996 A1
`Bi et al.
`(43) Pub. Date: Jul. 4, 2002
`
`
`US 20020087996A1
`
`(54)
`
`INTERACTIVE REMOTE CONTROL OF
`AUDIO OR VIDEO PLAYBACK AND
`SELECTIONS
`
`(76)
`
`Inventors: Depeng Bi, Algonquin, IL (US);
`Stephen Christopher Gladwin,
`Chicago, IL (US); Troy Steven
`Denkinger, Chicago, IL (US); Jefl'rey
`Jonathan Spurgat, Madison, WI (US);
`Hoyet Harrison Andrews III, San
`Antonio, TX (US)
`
`Correspondence Address:
`KATTEN MUCHIN ZAVIS
`Attention: Patent Administrator
`Suite 1600
`525 West Monroe Street
`
`Chicago, IL 60661-3693 (US)
`
`(21) Appl. No.:
`
`09/994,011
`
`(22)
`
`Filed:
`
`Nov. 6, 2001
`
`Related US. Application Data
`
`(63) Non-provisional of provisional
`60/246,923, filed on Nov. 10, 2000.
`
`application No.
`
`Publication Classification
`
`Int. Cl.7 ..................................................... H04N 7/173
`(51)
`(52) U.S.Cl.
`............................ 725/89; 725/109; 725/123;
`725/134
`
`(57)
`
`ABSTRACT
`
`Asystem for an interactive remote control wired or wireless,
`of an audio or video playback application running on a
`personal computer or other computing platform. This inter-
`active control includes playback of current audio or video
`content or selection of new audio or video content or lists of
`
`content for playback. The wireless interactive remote con-
`trol device, or navigator, may contain an audio or video
`browser for simplifying interactive control by integrating
`control of a variety of content, for example, music, video,
`and Internet radio,
`independent of whether this content
`exists locally on the computing platform or is accessed over
`the Internet or some other computer network.
`
`Computing Platform
`
`
`151
`
` Data Server
`
`
`103
`Audio or Video Player
`lntemet or other
`
`
`
`
`
`103
`Digital Audio
`Application
`Computer Network
`or Video
`
`Digital Audio or
`
`Data
`\fideo Data
`
`
`
`
`
`Navigator
`270
`
`User
`inputs
`
`
`User
`Outputs
`
`
`
`Page 1 of 21
`
`LG EXHIBIT 1003
`
`Page 1 of 21
`
`LG EXHIBIT 1003
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 1 0f 13
`
`US 2002/0087996 A1
`
`
`Computing Platform
`
`Local
`1 51
`
`
`
` Data Sewer
`Storage
`
`
`103
`Audio or Video Player
`
`
`internet or other
`
`
`
`1 03
`Digital Audio
`
`
`Application
`
`Computer Network
`or Video
`
`Digital Audio or
`
`Data
`
`Video Data
`
`
`
`260
`Navigator
`
`
`
`
`270
`271
`
`
`User
`User
`
`Outputs
`inputs
`
`
`
`
`
`Figure 1
`
`Page 2 of 21
`
`Page 2 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 2 0f 13
`
`US 2002/0087996 A1
`
`rComputing Platform
`
`
`
`Local Storage 112
`Data Sewer
`
`
`
`
`117
`
`
`
`1 03
`
`
`-
`-
`‘
`Internet or other
`Network
`Digital Audio or
`
`
`
`
`\fideo Data
`
`Modem
`Computer Network
`Dlafiéggigor
`Interface 0.—
`
`
`
`Operating System.
`System Software,
`
`and Applications
`
`153
`152
`
`
`
`File System and
`
`Networking Drivers
`
`Storage Device Drivers
`
`
`Navigator
`
`
`151
`
`
`Audio or Video Player Application
`Operating System, System Software, and
`280
`
`
`Applications
` 281
`
`Interface and Control Handler
`
`
`
`
`T
`L —i
`
`156
`Wireless 155
`
`Wireless Data
`282
`283
`[
`Audio or Video
`
`Data Communications
`
`Input and Output Drivers
`Communications
`Drivers
`Playback Drivers
`Drivers
`
`
`
`
`269
`
`Wireless Data
`
`Communications
`interface
`
`
`
`
`
`
`
`124
`119 I
`
`Audio or Wdeo
`Wireless Data
`
`Communications
`Playback Hardware
`
`Interface
`
`
`
`
`
`
`
`Navigator 154
`Control Manager
`
`
`
`
`
`
`
`109
`
`Analog Audio or Video
`
`
`
`
`Figure 2
`
`Page 3 of 21
`
`Page 3 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 3 0f 13
`
`US 2002/0087996 A1
`
`Data Server
`
`103
`Digital Audio or
`Video Data
`
`
`
`Internet or other
`Computer Network
`
`
`
`Computing Platform
`x
`
`
`Local Storage 112 9‘s
`
`103
`
`
`Digital Audio or
`\fideo Data
`
`
`
`
`Operating System,
`System Software.
`and Applications
`
` 1 52
`1 53
`
`
`File System and
`Networking Drivers
`
`Storage Device Drivers
`
`
`
`Navigator
` 151
`
`
`
`Audio or Video Player Application
`
`
`Operating System, System Software. and
`280
`
`
`Applications
`
`
`Interface and Control Handler
`.
`154
`156
`
`
`
`
`C get/33W
`Audio or Video
`
`
`0 ro
`anager
`Playback Drivers
`
`
`283
`282
`
`
`
`\Mreless Data
`
`Wireless
`1 55
`1 57
`
`
`Communications
`Data Communications
`Peripheral Bus
`
`Input and Output Drivers
`
`
`
`Drivers
`Drivers Drivers
`
`
`
`
`
`
`
`
`
`Receiver Device
`
`111
`124
`269
`
`
`
`
`Viflreless Data
`Vifireless Data
`Peripheral Bus
`
`Communications
`
`Communications
`
`
`Interface
`interface
`
`
`
`
`
`109
`Analog Audio or Video
`
`Audio or Video
`
`Analog Transmitter Peripheral
`209
`206
`Analog Audio
`Audio or
`or Video
`Video Digital
`Transmitter
`to Analog
`Converter
`
`201
`Peripheral
`l nterface
`
`Figure 3
`
`Page 4 of 21
`
`Page 4 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 4 0f 13
`
`US 2002/0087996 A1
`
`
`
`internet or other Computer
`Network
`
`Computing Platform
`
`1 1 7
`Network Interface
`or Modem
`
`1 1 1
`
`
`V
`O
`Ideo
`utput
`
`(to monitor, TV, or LCD)
`
`1 13
`.
`Display Controller
`
`1 1 0
`Main Processor
`
`
`
`Local Storage
`
`1 13
`
`Persistent Storage
`
`1 19
`Audio and Video
`Playback Hardware
`
`System
`Bus and
`Peripheral
`Buses
`
`114
`
`Removable Storage
`
`1 00
`
`
`
`
`
`
`
`
`
`
`
`
` ROM or 116
`
`
`
`
`
`1 15
`
`RAM
`
`flash memory
`
`-
`User Input Devxoes
`(such as keyboard and
`
`123
`
` 260 K
`Navigator
`
`
`
`
`120
`
`User Input Interface
`
`124
`Wireless Data
`Communications
`Interface
`
`Figure 4
`
`Page 5 of 21
`
`Page 5 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 5 0f 13
`
`US 2002/0087996 A1
`
`100
`
`Computing
`
`Platform
`
`Navigator
`
` Vlfireless Data
`Communications interface
`
`Processor
`
`
`
`
`Flash Memory 263
`
`User Controls
`
`264
`
`
`
`IR Transmitter 265
`
`
`
`
`Power Handler 237
`and
`
`Battery Charger
`
`Figure 5
`
`Page 6 of 21
`
`Page 6 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 6 0f 13
`
`US 2002/0087996 A1
`
`
`160
`
`
`
`
`yes
`
`video file?
`
`166
`162
`
`
`
`Connect to data
`Read audio or
`sewer
`
`
`video file
`
`
`
`
`
`167
`
`163
`
` Connection
`
`no
`End of file?
`
`successful?
`
`
`
`
`
`1 64 .
`168
`Interpret audio or
`Read audio or
`
`video data
`video data over
`
`
` lnternet
`according to data
`format
`
`
`
`
`
`
`165
`
`
`
`Send audio or
`An1690r
`
`
`
`video data to
`dy {r19 e
`
`audio or video
`a a'
`playback driver
`
`
`
` 170
`interpret audio or
`
`video data
`according to data
`format
`
`
`Figure 6
`
` 171
`
`Send audio or
`video data to
`
`audio or video
`playback driver
`
`
`172
`
`
`End playing
`
`
`
`Page 7 of 21
`
`Page 7 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 7 0f 13
`
`US 2002/0087996 A1
`
`175
`
`179
`Send information to
`navigator. such as title,
`artist, and album name
`of this music file, for
`display
`
`183
`
`download the
`music fi|e(s)
`
`178
`Find address of
`the music file
`
`185
`Perform financial
`validations
`
`180
`Start audio
`playback for this
`music file
`
`187
`Download the
`purchased music
`file
`
`176
`read data sent
`from navigator
`
`177
`Is play a music
`file?
`
`ls download
`music file(s)?
`
`184
`is buy music
`file?
`
`188
`is browse
`music?
`(track. album, artist,
`genre, playlist,
`etc)
`
`navigator
`
`189
`Browse
`local music?
`
`190
`Search local
`database
`
`191
`Send results to
`
`193
`
`Request music infromation
`from data sewer
`
`194
`
`ls update
`software?
`
`196
`Is system
`start up?
`
`195
`Flash software on
`navigator
`
`1 97
`Send initialization
`settings to
`navigator
`
`Figure 7
`
`Page 8 of 21
`
`Page 8 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 8 0f 13
`
`US 2002/0087996 A1
`
` 291
`
`
`292
`
`Send user input
`to computing
`platform
`
` User inputs?
`
`293
`
`
`
`User outputs from
`platform?
`
`
`
`294
`
`
`
`
`update display
`
`Figure 8
`
`Page 9 of 21
`
`Page 9 of 21
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 9 0f 13
`
`US 2002/0087996 A1
`
`/>3.m§c=\
`.52.»55I.~822\fm
`
`a.as
`
`3an...
`
`are
`
`FEE:
`
`
`
`
`
`23me£5.«c.3953.5?
`
`\.
`
`ad:1wn5
`
`
`
`mm“wigs:
`
`£3382
`
`\taalowma _
`radium ’
`lDd.‘ 1m E
`Jun E
`,
`‘gifln ‘
`< a zmm’xn,
`EOJ I 43'!
`‘ CGA'
`. 934/3131
`~’ 2341mm ‘
`osazismxgoo-t 5
`
`._>
`
`.Ev.
`
`
`
`‘Invkv
`
`..aaa
`
`Engll
`.1..de
`
`3»:$9
`
`
`
`
`2339SS.5..'WC@
` :5:‘omoo>/:55:.2.
`
`mom..tasgmw
`
`kW?v
`
`a5.:
`
`Maud-Fv
`
`
`
`
`
`.332:53,2.,2:
`
`
`
`9vsv
`
`
`5%]{um-MIAllwmm‘
`
`:5.»ImH—.as.
`Ea...llwfi‘
`
`
`3.x.““anax
`
`
`mmhwur.._.»\\20EM.—omemI,1N.
`
`0cm”wowvow
`
`m3.
`
`5.
`
`g
`
`
`
`255.3IasIE5..:5itR<Ian558BEN?IE5:25IE.afiznn :20.$232.Eminh“fl$.55
`.,iYIam.“Mr—205%,
`
`TiIp5
`
`an.m»:<
`
`Ima muggymsns
`
`9v ; saw
`ourmm
`Wild”w; «M
`pm 66W
`1W:omw
`zw/ ”(1N ‘
`[mu mm
`GOANV
`5IV
`91V
`
`9L
`LL
`
`K!s?05l b
`(6
`I)5
`6ss
`66
`001
`
`R....avg:
`
`2w
`vw
`
`:<
`
`Page 10 of 21
`
`Page 10 of 21
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 10 0f 13
`
`US 2002/0087996 A1
`
`moo
`
`m"zcu
`
`tamGUS:1.25509ficoMrs—c».—_“”0
`
`
`
`,Imoo«8aaEmlwmo50%I80
`,Bin.228»?fi/o8]aim“wannaII.:833:52.mEfil2w...
`
`
`3.5..:5WM@asm35”,.a:m...
`
`«mms
`
`Aw?
`
`I.E.aWO:05:
`
`’
`
`
`52",.SH
`
`as
`
`9Ewe/“flue,“
`
`
`
`
`
`>A‘EZMunis,“28an}
`
`or0.59“.amlmW‘ES2::
`
`EVE
`
`“3293E
`x8.[@mo
`
`
`5252E23.Jenn.:,7:u.H.Ax:«Buuzzo‘v
`
`
`
`CE.Sm«xxfismzCL
`
`>53»;Zia)>mn
`
`
`
` NwLéhfl\‘mrvo\:5he
`
`mummum
`ago\VNO
`
`<332$5.
`
`Ez§€25:,
`
`Page 11 of 21
`
`Page 11 of 21
`
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 11 0f 13
`
`US 2002/0087996 A1
`
`2Q
`liiiiimiiilii
`
`52:9".
`
`n39|an.»:¢<.:QM;
`
`
`
`.,25;.33.33?Eciwmzeqwfim
`
`
`
`2_3.5555656;$51.12.:
`
`".29:L29:
`
`”8|\iK‘{Vivi}u!
`
`:030[New
`
`lmtmon«ix
`
`
`as2
`
` «$.09«vm«awa”3%amm3s(,mi,
`
`
`
`
`
`:3812$§§,a2m8.05%:ON.5.,,..£-
`
`Page 12 of 21
`
`Page 12 of 21
`
`
`
`
`
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 12 0f 13
`
`US 2002/0087996 A1
`
`maul-I.a
`
`
`
`
`
`22:9”.
`
`mz._:35:wa
`
`
`
`
`
`Page 13 of 21
`
`Page 13 of 21
`
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 13 0f 13
`
`US 2002/0087996 A1
`
`33.556ch
`
`D<O._-7
`
`>nhW—‘MW/
`
`mum
`
`2959".
`
`To
`
`
`
`E5:.2.
`
`mam7.un—
`
`Page 14 of 21
`
`Page 14 of 21
`
`
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`INTERACTIVE REMOTE CONTROL OF AUDIO
`OR VIDEO PLAYBACK AND SELECTIONS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application claims priority of US. patent
`application Ser. No. 60/246,923 filed on Nov. 10, 2000. This
`application is
`related to co-pending commonly-owned
`patent applications: Ser. No. 09/649,981, filed on Aug. 29,
`2001 and Ser. No. 09/709,772, filed on Nov. 8, 2000, both
`entitled: “Structure and Method for Selecting, Controlling
`and Sending Internet-Based or Local Digital Audio to an
`AM/FM Radio or Analog Amplifier”; “Digital Content Dis-
`tribution and Subscription File Subscription System,” filed
`on even date; and “Content Protection Through Audio and
`Video Decrypting and Decoding Device,” Ser. No. 09/883,
`173, filed on Apr. 11, 2001, all hereby incorporated by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`[0002]
`
`1. Field of the Invention
`
`[0003] The present invention relates to interactive control
`of audio or video playback and selection of digital content
`running on a personal computer or other computing plat-
`form.
`
`[0004]
`
`2. Description of the Prior Art
`
`[0005] There is an ever-increasing amount of digital con-
`tent available, for example, digital audio files, for example,
`in MP3 format, like those found at www.mp3.com or as
`streaming digital audio, such as using the streaming digital
`audio techniques described in US. Pat. No. 5,579,430.
`These new types of audio content can be played on a
`personal computer with a sound card, but cannot be played
`on a radio or stereo that is designed to receive and amplify
`analog audio signals.
`
`techniques are known for converting a
`[0006] Several
`digital audio source to an analog signal for use by an analog
`radio or amplifier. However, such techniques are known to
`interfere with the operation of a host PC and thus require use
`of the PC to select and control the audio, for example, on an
`analog radio. Thus, there is a need to provide a system which
`enables digital content, such as Internet-based or digital
`audio to be played, for example, on an analog radio without
`tying up a personal computer.
`
`content can be controlled from a location away from the
`computing platform running the digital content playback
`application.
`
`DESCRIPTION OF THE DRAWINGS
`
`[0008] These and other advantages of the present inven-
`tion will be readily apparent from the following description
`and attached drawing where:
`
`[0009] FIG. 1 is a block diagram that provides an over-
`view of a system for interactive remote control of audio or
`video playback and selection in accordance with the present
`invention.
`
`[0010] FIG. 2 is a block diagram of the system architec-
`ture for interactive remote control of audio or video play-
`back and selection using local playback of audio or video in
`accordance with the present invention.
`
`[0011] FIG. 3 is a block diagram of the system architec-
`ture for interactive remote control of audio or video play-
`back and selection using transmitted playback of audio or
`video in accordance with the present invention.
`
`[0012] FIG. 4 is a block diagram of a computing platform
`in accordance with the present invention.
`
`[0013] FIG. 5 is a block diagram of the architecture of a
`remote control device or navigator in accordance with the
`present invention.
`
`[0014] FIG. 6 is a software flow diagram for audio or
`video playback on the computing platform as part of a
`system for interactive remote control of audio or video
`playback and selection in accordance with the present inven-
`tion.
`
`[0015] FIG. 7 is a software flow diagram for navigator
`control management on the computing platform as part of a
`system for interactive remote control of audio or video
`playback and selection in accordance with the present inven-
`tion.
`
`[0016] FIG. 8 is a software flow diagram for interface and
`control handling on the navigator as part of a system for
`interactive remote control of audio or video playback and
`selection in accordance with the present invention.
`
`[0017] FIGS. 9-13 are schematic diagrams of the naviga-
`tor as part of a system for interactive remote control of audio
`or video playback and selection in accordance with the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`DETAILED DESCRIPTION
`
`[0007] Briefly, the present invention and method involves
`interactive remote control, either wired or wireless, of an
`audio or video playback application running on a personal
`computer or other computing platform. The interactive
`remote control provides various functions, such as playback
`of current digital audio or video content; selection of new
`audio or video content; and providing lists of content for
`playback. The wireless interactive control device may con-
`tain an audio or video browser for simplifying interactive
`control, by integrating control of a variety content, such as
`music, video, and Internet radio, independent of whether this
`content exists locally on the computing platform or is
`accessed over the Internet or some other computer network.
`An important aspect of this invention is that the digital
`
`System Overview
`
`[0018] The present invention relates to interactive control
`of digital content, such as digital audio or video content,
`running on a computing platform, such as a personal com-
`puter, set top box or other device, such as personal digital
`assistant. The interactive remote control device 260 (FIG.
`1), also referred to as the navigator 260, is described in more
`detail below in connection with FIG. 5. This device 260
`
`communicates with an audio or video player application 151
`(FIG. 1) running on a computing platform 100, such as a
`personal computer, set-top box, or Internet appliance. This
`communication can be handled in a conventional manner
`
`and may be either wired or wireless. The navigator 260 is
`
`Page 15 of 21
`
`Page 15 of 21
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`used to send user inputs 270 from user controls 264 (FIG.
`5) on the navigator 260, such as buttons, dials, a touch
`screen, and a keyboard, to the audio or video player appli-
`cation 151 (FIG. 1) running on the computing platform 100.
`The navigator 260 may be configured to display user outputs
`271, such as graphics and text for display on an LCD 266
`(FIG. 5) or control of LEDs, from the audio or video player
`application 151 running on the computing platform 100. The
`audio or video player application 151 (FIG. 1) is configured
`to receive digital audio or video data 103 from local storage
`device 112 on the computing platform 100 or from a data
`server 102 connected to the computing platform 100 by the
`Internet or other computer network 101.
`
`[0019] The interpretation and translation of the user inputs
`270 from the navigator 260 and user outputs 271 to the
`navigator 260 are handled primarily by a navigator control
`manager 154, described later in more detail below in con-
`nection with FIG. 7, that runs on the computing platform
`100. The navigator control manager 154 may be part of the
`audio or video player application 151 or exist independently.
`
`Local Playback System Architecture
`
`[0020] There are various configurations for remote control
`of audio or video playback and selection. An exemplary
`embodiment is illustrated in FIG. 2. In this embodiment, the
`audio or video player application 151,
`running on the
`computing platform 100, receives digital audio or video data
`103 from the local storage device 112 on the computing
`platform 100. Access to the local storage device 112 by the
`audio or video player application 151 is handled through the
`file system and the storage device drivers 153, convention-
`ally part of the operating system for the computing platform
`100. The audio or video player application 151 can also
`receive digital audio or video data 103 from a data server
`102 connected to the computing platform 100 through the
`Internet or other computer network 101. Access to the
`network interface or modem 117 by the audio or video
`player application 151 is handled though networking drivers
`152, also part of the operating system for the computing
`platform 100. The audio or video player application 151
`running on the computing platform 100 may interact with
`the navigator 260 through a wireless data communications
`interface 124 on the computing platform 100. This wireless
`data communications interface 124 can be, for example,
`Bluetooth, HomeRF, IEEE 802.11, or an infrared interface.
`Access to the wireless data communications interface 124 on
`
`the computing platform 100 may be handled through, for
`example, conventional wireless data communications driv-
`ers 155. On the computing platform 100,
`the navigator
`control manager 154, discussed in detail in connection with
`FIG. 7, interprets and translates the user inputs 270 from the
`navigator 260 into commands for control of the audio or
`video player application 151 running on the computing
`platform 100. The navigator control manager 154, running
`on the computing platform 100, takes information from the
`audio or video player application 151 and generates user
`outputs 271 for the navigator 260. On the navigator 260,
`communication with the navigator control manager 154
`running on the computing platform 100 is handled through
`a wireless data communications interface 269 on the navi-
`
`gator 260. This wireless data communications interface 269
`must be compatible with the wireless data communications
`interface 124 on the computing platform 100. Access to the
`wireless data communications interface 269 on the navigator
`
`260 is handled through wireless data communications driv-
`ers 283. The wireless communication interfaces 124 and 269
`
`may be standard interfaces, such as Home RF, IEEE 802.11
`or Bluetooth. The communication drivers 283 may be the
`standard drivers for the communication interfaces discussed
`above. Alternative embodiments of the wireless data com-
`munication interfaces 124 and 269 as well as the wireless
`
`communications driver 283 are disclosed in commonly-
`owned co-pending patent application Ser. No. 09/649,981,
`hereby incorporated by reference. The interface and control
`handler 281, discussed in detail in connection with FIG. 8,
`running on the navigator 260 takes user inputs 270 from user
`controls 264, such as buttons, dials, and touch screens, and
`passes these user inputs 270 through the wireless data
`communications interface 269 to the navigator control man-
`ager 154 running on the computing platform 100. As well,
`the interface and control handler 281 running on the navi-
`gator 260 receives user outputs 271 from the navigator
`control manager 154 running on the computing platform 100
`through the wireless data communications interface 269.
`The interface and control handler 281 then passes these user
`outputs 271 to the appropriate user output devices, such as
`a graphics display on an LCD 266 or the LEDs. Access to
`user inputs 270 and user outputs 271 is handled through
`input and output drivers 282 on the navigator 260.
`
`[0021] The audio or video player application 151 running
`on the computing platform 100 passes the digital audio or
`video data 103 to the audio or video playback hardware 119
`on the computing platform 100, using the audio or video
`playback drivers 156 to communication with the audio or
`video playback hardware 119. The audio or video playback
`hardware 119 converts the digital audio or video data 103 to
`analog audio or video 109, which can then be connected to
`a stereo or headphones for listening or to a TV for viewing.
`
`[0022] Software components running on the computing
`platform 100 are contained within the operating system,
`system software, and applications 150. Similarly, software
`and firmware components running on the navigator 260 are
`contained within the operating system, system software, and
`applications 280.
`
`Transmitted Playback System Architecture
`
`[0023] Various alternate embodiments of remote control
`of audio or video playback and selection are contemplated.
`One such embodiment is illustrated in FIG. 2 of commonly-
`
`owned co-pending patent application Ser. No.
`, filed
`on even date, entitled “Digital Audio and Video Distribution
`Transmission and Playback System,” (Attorney Docket No.
`11748/13 PCT), hereby incorporated by reference. Another
`embodiment is illustrated in FIG. 3. As in the previous
`configuration shown in FIG. 2, the audio or video player
`application 151 running on the computing platform 100 can
`receive digital audio or video data 103 from the local storage
`device 112 on the computing platform 100. Access to local
`storage 112 device by the audio or video player application
`151 is handled through file system and storage device
`drivers 153. The audio or video player application 151 can
`also receive digital audio or video data 103 from a data
`server 102 connected to the computing platform 100 through
`the Internet or other computer network 101. Access to the
`network interface or modem 117 by the audio or video
`player application 151 is handled though networking drivers
`152. The audio or video player application 151 running on
`
`Page 16 of 21
`
`Page 16 of 21
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`the computing platform 100 interacts with the navigator 260
`through a wireless data communications interface 124 on the
`computing platform 100. This wireless data communications
`interface can be, for example, Bluetooth, HomeRF, IEEE
`802.11, or an infrared interface. Access to the wireless data
`communications interface 124 on the computing platform
`100 is handled through the wireless data communications
`drivers 155. On the computing platform 100, the navigator
`control manager 154 interprets and translates the user inputs
`270 from the navigator 260 into commands for and control
`of the audio or video player application 151 running on the
`computing platform 100. The navigator control manager 154
`running on the computing platform 100 also takes informa-
`tion from the audio or video player application 151 and
`generates user outputs 271 for the navigator 260. On the
`navigator 260, communication with the navigator control
`manager 154 running on the computing platform 100 is
`handled through a wireless data communications interface
`269 on the navigator 260. This wireless data communica-
`tions interface 269 must be compatible with the wireless
`data communications interface 124 on the computing plat-
`form 100. Access to the wireless data communications
`
`interface 269 on the navigator 260 is handled through
`wireless data communications drivers 283. The interface and
`
`control handler 281 running on the navigator 260 takes user
`inputs 270 from user controls 264, such as buttons, dials, and
`touch screens, and passes these user inputs 270 through the
`wireless data communications interface 269 to the navigator
`control manager 154 running on the computing platform
`100. As well, the interface and control handler 281 running
`on the navigator 260 receives user outputs 271 from the
`navigator control manager 154 running on the computing
`platform 100 through the wireless data communications
`interface 269. The interface and control handler 281 then
`
`passes these user outputs 271 to the appropriate user output
`device, such as a graphics display on an LCD 266 or LEDs.
`Access to user inputs 270 and user outputs 271 is handled
`through input and output drivers 282 on the navigator 260.
`[0024] However,
`unlike
`the
`previous
`configuration
`described in FIG. 2, where the computing platform 100
`generates an analog audio or video data 109 for input to an
`analog device, in the configuration shown in FIG. 3, the
`digital audio or video data 103 is passed by the audio or
`video player application 151 running on the computing
`platform 100 to an analog transmitter peripheral 104. The
`audio or video player application 151 uses audio or video
`playback drivers 156 and peripheral bus drivers 157 to
`communicate with the analog transmitter peripheral 104
`through the peripheral bus 111 on the computing platform
`100. The analog transmitter peripheral 104 receives the
`digital audio or video data 103 through a peripheral interface
`201 on the analog transmitter peripheral 104. The digital
`audio or video data 103 is then converted to analog audio or
`video 109 by the audio or video digital to analog converter
`206 on the analog transmitter peripheral 104. The analog
`audio or video 109 is transmitted by an analog audio or
`video transmitter 209 on the analog transmitter peripheral
`104 to an audio or video receiver device 105 that makes the
`
`analog audio or video 109 available for listening, such as on
`a stereo or headphones, or viewing such as on a TV.
`[0025] Software components including the various drivers
`discussed above, running on the computing platform 100 are
`contained within the operating system, system software, and
`applications 150. Similarly, software and firmware compo-
`
`nents running on the navigator 260 are contained within the
`operating system, system software, and applications 280.
`
`It should be noted that the embodiments described
`[0026]
`(FIGS. 2 and 3) represent only two of a plethora of possible
`embodiments for configurations of a system for interactive
`remote control of audio or video playback and selection.
`
`Computing Platform
`
`[0027] FIG. 4 illustrates an exemplary system architecture
`for the computing platform 100, which can encompass
`anything from general-purpose devices, such as a personal
`computer, to open fixed function devices, such as a set-top
`box that connects to a television set. However, the comput-
`ing platform 100 is not restricted to these examples. In
`general, the computing platform 100 includes a main pro-
`cessor 110, for example, an Intel Pentium III or better, for
`executing various software components. The various soft-
`ware components are typically stored in read only memory,
`or ROM, or flash memory 116, or the local storage device
`112. The local storage device 112 can consist of persistent
`storage 113, such as hard drives or flash memory, or remov-
`able storage 114, such as floppy drives, CD-ROM drives, or
`DVD drives. The software components are executed by the
`main processor 110 directly from their storage location or
`may be loaded into random access memory or RAM 115, to
`be executed from RAM 115 by the main processor 110. The
`computing platform 100 uses a network interface or modem
`117 to access data server computers 102 on the Internet or
`other computer network 101, in order to download digital
`audio or video data 103. The network interface or modem
`
`117 is connected internally or externally to the computing
`platform 100 using a system bus or peripheral bus 111. The
`system bus and peripheral buses 111 are provided for
`connecting internal and external devices to the computing
`platform 100 in a standard manner. Typical system and
`peripheral buses 111 include Universal Serial Bus, com-
`monly referred to as USB, IEEE 1394, commonly referred
`to as FireWire, and Peripheral Connect Interface, commonly
`referred to as PCI. The computing platform 100 may also
`support connection through a user input interface 120 to
`external or integrated user input devices 123, such as a
`keyboard and mouse. For output to the user, the computing
`platform 100 may contain a display controller 118, for
`example, an NVIDIA model GeForce2, which stores graphi-
`cal data, such as windows, bitmaps and text. The display
`controller 118 outputs the graphical data as video output 121
`that is typically displayed to the user on a video monitor,
`television, or LCD panel. In addition to video output 121,
`the computing platform 100 may provide audio output 122,
`which is handled by the audio and video playback hardware
`119, which also provides support for video playback to the
`display controller 118. It should be noted that a client
`computing platform 100 is not limited to the capabilities and
`features listed in this description, but may contain a subset
`of the described features or may contain additional capa-
`bilities or features not listed.
`
`Navigator Architecture
`
`[0028] The navigator 260 (FIG. 5) acts as a remote control
`and allows the user to receive feedback from and provide
`input to an audio or video player application 151 running on
`a computing platform 100. In the embodiment shown, the
`computing platform 100 wirelessly transmits and receives
`
`Page 17 of 21
`
`Page 17 of 21
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`data communications with the navigator 260, giving the
`navigator 260 functionality within the range of the wireless
`communications. The navigator 260 receives and transmits
`the data communications using the wireless data communi-
`cations interface 269. This wireless data communications
`
`interface 269 may be, for example, a Bluetooth, HomeRF, or
`IEEE 802.11 interface. This wireless data communications
`
`interface 269 must match the technology chosen for use on
`the computing platform 100. The processor 261 handles the
`data communications with the wireless data communica-
`
`tions interface 269. The processor 261 also takes user inputs
`270 from the user controls 264, which are typically buttons
`and dials, and sends this information to the wireless data
`communications interface 269 for wireless transmission to
`
`the computing platform 100 and eventually back to the audio
`or video player application 151 running on the computing
`platform 100. The processor 261 receives update informa-
`tion from the audio or video player application 151 through
`the wireless data communications interface 269, which the
`processor 261 then makes available to the user by updating
`the graphic information on the liquid crystal display panel,
`or LCD 266. The processor 261 reads the code it runs from
`the flash memory 263, which is also used to store informa-
`tion that must survive power cycling of the navigator 260.
`The processor 261 uses random access memory, or RAM
`262, for executing code and storing volatile information, this
`is information that is subject to change or does not need to
`survive power cycling of the navigator 260.
`
`[0029] Additional functionality may be provided through
`the power handler and battery charger 267, controlled by the
`processor 261 and responsible for handling power manage-
`ment, conserving battery life, and charging of the battery
`268. There is also an infrared or IR transmitter 265 that
`
`allows the navigator 260 to control audio playback equip-
`ment, such as a stereo.
`
`Audio or Video Playback Handler
`
`[0030] FIG. 6 is a software flow diagram for audio or
`video playback on the computing platform 100, which in the
`example described henceforth, is called the audio or video
`playback handler. The audio or video playback handler is
`called as part of the audio or video player application 151 to
`playback the digital audio or video data 103. “Start” in step
`160 represents the beginning of the audio or video playback
`handler. The audio or video playback handler receives the
`audio or video playback selection when it is called. The
`audio or video playback handler checks if the audio or video
`playback selection is available locally on the computing
`platform 100 in step 161. If the file is available locally, the
`audio or video playback handler reads the digital audio or
`video data 103 from the audio or video file in step 162. Next,
`the audio or video playback handler checks