(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2002/0087996 A1
`(43) Pub. Date:
`Jul. 4, 2002
`Bi et al.
`
`US 20020087996A1
`
`(54)
`
`INTERACTIVE REMOTE CONTROL OF
`AUDIO OR VIDEO PLAYBACK AND
`SELECTIONS
`
`(76)
`
`Inventors: Depeng Bi, Algonquin, IL (US);
`Stephen Christopher Gladwin,
`Chicago, IL (US); Troy Steven
`Denkinger, Chicago, IL (US); Je?'rey
`Jonathan Spurgat, Madison, WI (US);
`Hoyet Harrison Andrews III, San
`Antonio, TX (US)
`
`Correspondence Address:
`KATTEN MUCHIN ZAVIS
`Attention: Patent Administrator
`Suite 1600
`525 West Monroe Street
`Chicago, IL 60661-3693 (US)
`
`(21)
`(22)
`
`Appl. No.:
`
`09/994,011
`
`Filed:
`
`Nov. 6, 2001
`
`Related US. Application Data
`
`(63) Non-provisional of provisional application No.
`60/246,923, ?led on Nov. 10, 2000.
`
`Publication Classi?cation
`
`(51)
`(52)
`
`(57)
`
`Int. C1.7 ................................................... .. H04N 7/173
`US. Cl. .......................... .. 725/89; 725/109; 725/123;
`725/134
`
`ABSTRACT
`
`Asystem for an interactive remote control Wired or Wireless,
`of an audio or video playback application running on a
`personal computer or other computing platform. This inter
`active control includes playback of current audio or video
`content or selection of neW audio or video content or lists of
`content for playback. The Wireless interactive remote con
`trol device, or navigator, may contain an audio or video
`broWser for simplifying interactive control by integrating
`control of a variety of content, for example, music, video,
`and Internet radio, independent of Whether this content
`exists locally on the computing platform or is accessed over
`the Internet or some other computer netWork.
`
`Data Server
`
`102
`
`103
`Digital Audio or
`\?deo Data
`
`Computing Platform
`
`151
`
`Local
`Storage
`
`112
`
`lntemet or other
`Computer Network
`
`Audio or Video Player
`Application
`
`103
`_
`_
`Digital Audio
`or Video
`Data
`
`Navigator
`270
`User
`inputs
`
`Yamaha Corporation of America Exhibit 1012 Page 1
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 1 0f 13
`
`US 2002/0087996 A1
`
`Data Sewer
`
`.
`
`102
`
`103
`Digital Audio or
`vldeo Data
`
`Computing Platform
`
`1 51
`
`Local
`Storage
`
`1 12
`
`Internet or other
`Computer Network
`
`Audio or Video Player
`Application
`
`10_3
`_
`_
`Dlglt?‘gludlo
`“Baa?
`
`Navigator
`270
`User
`Inputs
`
`Figure 1
`
`Yamaha Corporation of America Exhibit 1012 Page 2
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 2 0f 13
`
`US 2002/0087996 A1
`
`Daia Sewer
`
`102
`
`.
`
`.
`
`1 03
`Dlgrtal Audio or
`\ndeo Data
`
`i
`
`lntemet or other
`
`Computer Network
`
`Computing Platform
`
`117
`
`Network
`
`lnt?rggce or
`
`Operating System‘
`System Software,
`and Applications
`
`Local Storage 112 ’
`
`103
`
`.
`
`.
`
`i
`
`Dlgltal Audio or
`\Adeo Data
`
`150 ‘
`
`Navigator
`
`Operating System, System Software, and
`Applications
`
`Interface and Control Handler
`
`260
`
`280 r
`
`281
`
`T
`
`l
`
`282
`
`Input and Output Drivers
`
`I
`
`283
`Wireless Data
`Communications
`Drivers
`
`"
`
`152
`
`.
`l
`Networkmg Dnvsrs
`
`153
`File System and
`Storage Device Drivers
`
`l
`
`1
`
`Audio or Video Player Application
`
`151
`
`i
`Navigator 154
`Control Manager
`
`_ i
`Wireless 155
`Data Communications
`Drivers
`
`‘
`
`156
`Audio or Video
`Playback Drivers
`
`269
`
`124
`Wireless Data
`Communications
`Interface
`
`=
`
`119
`Audio or \?deo
`Playback Hardware
`
`109
`Analog Audio or Video
`
`Figure 2
`
`Yamaha Corporation of America Exhibit 1012 Page 3
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 3 0f 13
`
`US 2002/0087996 A1
`
`Data Server
`
`102
`
`103
`Digital Audio or
`Video Data
`
`Internet or other
`Computer Network
`
`Navigator
`
`Operating System, System Software, and
`Applications
`
`280 I
`
`Interface and Control Handler
`
`281
`
`282
`
`Input and Output Drivers
`
`283
`\Mreless Data
`Communications
`Drivers
`
`269
`Vi?reless Data
`Communications
`interface
`
`109
`Analog Audio or Video
`
`105
`Audio or Video
`Receiver Device
`
`Computing Platform
`
`1 03
`Digital Audio or
`\Adeo Data
`
`Operating System,
`System Software.
`and Applications
`
`r
`
`152
`.
`.
`Networking Drivers
`
`V
`g 53
`FI S
`ie ystem an
`Storage Device Drivers
`
`l
`
`l
`
`Audio or Video Player Application
`
`151
`
`.
`C nrzla‘lnlaator
`0 r0 anager
`
`154
`
`I
`
`Wireless 155
`Data Communications
`Drivers
`
`VWreless Data
`Communications
`Interface
`
`156
`Audio or Video
`Playback Drivers
`
`l
`
`1
`Peripheral Bus
`Drivers
`
`111
`
`Peripheral Bus
`
`Analog Transmitter Peripheral
`
`206
`209
`Audio or
`Analog Audio
`or Video 4- Video Digital
`Transmitter
`to Analog
`Converter
`
`104
`
`201
`
`Peripheral
`‘- Interface
`
`Figure 3
`
`Yamaha Corporation of America Exhibit 1012 Page 4
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 4 0f 13
`
`US 2002/0087996 A1
`
`Computing Platform
`
`Internet or other Computer
`Network
`
`1 1 0
`1 1 1
`1 1 7
`—> Network Interface 6 9 Main Processor
`or M Odem
`
`1 2
`\?deo Output
`(to monitor, TV, or LCD)
`
`1 18
`.
`D'sp'ay Controller
`+
`
`Local Storage
`
`1 1
`113
`(———} Persistent Storage
`
`1 19
`Audio and Video 6 System
`Playback Hardware
`Bus and
`Peripheral
`Buses {- Removable Storage
`
`114
`
`123 5
`-
`User Input Devices
`(such as keyboard and
`
`120
`—) User Input Interface 4-}
`
`260
`
`.
`Navigator
`
`D 124
`Wireless ata
`’ Communications
`Interface
`
`‘ ,
`
`1-)
`
`RAM
`
`1 15
`
`1 16
`
`‘
`
`ROM or
`?ash memory
`
`Figure 4
`
`Yamaha Corporation of America Exhibit 1012 Page 5
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 5 0f 13
`
`US 2002/0087996 A1
`
`100
`Computing
`Platform
`
`Navigator
`
`261
`
`269
`
`Vt?reless Data
`Communications interface
`
`Processor
`
`RAM
`
`262
`
`Flash Memory 263
`
`User Controls 264
`
`IR Transmitter 265
`
`Power Handler
`and
`Battery Charger
`
`267
`
`Figure 5
`
`Yamaha Corporation of America Exhibit 1012 Page 6
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 6 0f 13
`
`US 2002/0087996 A1
`
`160
`
`yes
`
`video ?le?
`
`V
`162
`Read audio or
`video ?le
`
`163
`End of ?le?
`
`yes
`
`1 64
`Interpret audio or
`video data
`according to data
`format
`
`i
`
`1 65
`Send audio or
`video data to
`audio or video
`playback driver
`
`___i
`
`166
`Connect to data
`sewer
`
`1 67
`Connection
`successful?
`
`yes <
`V
`1 68
`Read audio or
`video data over
`internet
`
`170
`interpret audio or
`video data
`according to data
`format
`
`i
`
`171
`Send audio or
`video data to
`audio or video
`playback driver
`
`l___
`
`Figure 6
`
`i
`
`V
`
`172
`End playing
`
`End
`
`Yamaha Corporation of America Exhibit 1012 Page 7
`
`

`

`Patent Appllcatlon Publlcatlon
`
`Jul. 4, 2002 Sheet 7 0f 13
`
`US 2002/0087 996 A1
`
`Start
`
`175
`
`l
`1 76
`read data sent
`from navigator
`
`1 77
`IS la a music
`p ‘2'' 7
`‘e’
`
`es
`y
`
`178
`Find address of
`the music ?le
`
`179
`Send information to
`navigator, such as title,
`' artist, and album name
`of this music ?le, for
`display
`
`180
`Start audio
`playback for this
`music ?le
`
`181
`'5 download
`music ?le(s)?
`
`as
`y
`
`183
`download the
`music ?lms)
`
`1 s4
`‘s bu music
`f)‘, ,,
`l e.
`
`yes
`
`18-5
`Perform ?nancial
`validations
`
`181
`Download the
`' purchased music
`?le
`
`188
`is browse
`music?
`(track, album, artist,
`genre, playlist,
`etc)
`
`189
`Browse
`‘
`l m in?
`oca Us '
`
`yes
`
`190
`Search local
`database
`
`191
`Send results to
`navigator
`
`194
`is update
`software?
`
`yes
`
`195
`Flash software on
`navigator
`
`196
`Is System
`start up?
`
`197
`Send initialization
`settings to
`navigator
`
`1 93
`
`Request music infromation
`from data sewer
`
`Figure 7
`
`'
`
`>
`
`'
`
`>
`
`7
`
`Yamaha Corporation of America Exhibit 1012 Page 8
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 8 0f 13
`
`US 2002/0087996 A1
`
`291
`.
`9
`User Inputs.
`
`292
`Send user input
`to computing
`platform
`
`293
`
`User outputs from
`platform?
`
`294
`update display
`
`Figure 8
`
`Yamaha Corporation of America Exhibit 1012 Page 9
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 9 0f 13
`
`US 2002/0087996 A1
`
`2 M
`PS3: 4
`
`EPCE:
`
`2
`
`/ in; 23:
`
`him 53M“?
`owe m5
`m5
`
`m 950E
`
`A $51 t
`
`MEEGEEE
`
`E5 Eula“
`
`wagv
`5.1g.
`
`:
`
`.vmasmum.
`25E
`
`8,5
`
`i
`
`lLLLUlllU
`l
`
`WWTWTTT
`
`Yamaha Corporation of America Exhibit 1012 Page 10
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 10 0f 13 US 2002/0087996 A1
`
`
`
`
`
`tam mugc 1.3:. 500
`
`
`
`2. 0.59"- an
`
`“2.
`
`32
`2:: on
`
`1 155: A
`
`_ o zzomtmm i Q m w
`
`
`
`
`
`l , l , 52cc: E
`
`1 \ a ,7: u .H. 33
`
`Yamaha Corporation of America Exhibit 1012 Page 11
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 11 0f 13 US 2002/0087996 A1
`
`3 222m
`
`Yamaha Corporation of America Exhibit 1012 Page 12
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 12 0f 13 US 2002/0087996 A1
`
`wan‘
`
`2 2:9".
`
`26
`
`an
`
`N
`00
`CO
`
`)9!
`
`Yamaha Corporation of America Exhibit 1012 Page 13
`
`

`

`Patent Application Publication
`
`Jul. 4, 2002 Sheet 13 0f 13 US 2002/0087996 A1
`
`mam
`
`.2 95E a
`
`3m 8“ D
`
`/ /
`
`3m 1
`
`5 0mm
`
`Yamaha Corporation of America Exhibit 1012 Page 14
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`INTERACTIVE REMOTE CONTROL OF AUDIO
`OR VIDEO PLAYBACK AND SELECTIONS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application claims priority of US. patent
`application Ser. No. 60/246,923 ?led on Nov. 10, 2000. This
`application is related to co-pending commonly-oWned
`patent applications: Ser. No. 09/649,981, ?led on Aug. 29,
`2001 and Ser. No. 09/709,772, ?led on Nov. 8, 2000, both
`entitled: “Structure and Method for Selecting, Controlling
`and Sending Internet-Based or Local Digital Audio to an
`AM/FM Radio or Analog Ampli?er”; “Digital Content Dis
`tribution and Subscription File Subscription System,” ?led
`on even date; and “Content Protection Through Audio and
`Video Decrypting and Decoding Device,” Ser. No. 09/883,
`173, ?led on Apr. 11, 2001, all hereby incorporated by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`[0002] 1. Field of the Invention
`
`[0003] The present invention relates to interactive control
`of audio or video playback and selection of digital content
`running on a personal computer or other computing plat
`form.
`
`[0004] 2. Description of the Prior Art
`
`[0005] There is an ever-increasing amount of digital con
`tent available, for eXample, digital audio ?les, for eXample,
`in MP3 format, like those found at WWW.mp3.com or as
`streaming digital audio, such as using the streaming digital
`audio techniques described in US. Pat. No. 5,579,430.
`These neW types of audio content can be played on a
`personal computer With a sound card, but cannot be played
`on a radio or stereo that is designed to receive and amplify
`analog audio signals.
`
`[0006] Several techniques are knoWn for converting a
`digital audio source to an analog signal for use by an analog
`radio or ampli?er. HoWever, such techniques are knoWn to
`interfere With the operation of a host PC and thus require use
`of the PC to select and control the audio, for eXample, on an
`analog radio. Thus, there is a need to provide a system Which
`enables digital content, such as Internet-based or digital
`audio to be played, for eXample, on an analog radio Without
`tying up a personal computer.
`
`content can be controlled from a location aWay from the
`computing platform running the digital content playback
`application.
`
`DESCRIPTION OF THE DRAWINGS
`
`[0008] These and other advantages of the present inven
`tion Will be readily apparent from the folloWing description
`and attached draWing Where:
`
`[0009] FIG. 1 is a block diagram that provides an over
`vieW of a system for interactive remote control of audio or
`video playback and selection in accordance With the present
`invention.
`
`[0010] FIG. 2 is a block diagram of the system architec
`ture for interactive remote control of audio or video play
`back and selection using local playback of audio or video in
`accordance With the present invention.
`
`[0011] FIG. 3 is a block diagram of the system architec
`ture for interactive remote control of audio or video play
`back and selection using transmitted playback of audio or
`video in accordance With the present invention.
`
`[0012] FIG. 4 is a block diagram of a computing platform
`in accordance With the present invention.
`
`[0013] FIG. 5 is a block diagram of the architecture of a
`remote control device or navigator in accordance With the
`present invention.
`
`[0014] FIG. 6 is a software How diagram for audio or
`video playback on the computing platform as part of a
`system for interactive remote control of audio or video
`playback and selection in accordance With the present inven
`tion.
`
`[0015] FIG. 7 is a software How diagram for navigator
`control management on the computing platform as part of a
`system for interactive remote control of audio or video
`playback and selection in accordance With the present inven
`tion.
`
`[0016] FIG. 8 is a software How diagram for interface and
`control handling on the navigator as part of a system for
`interactive remote control of audio or video playback and
`selection in accordance With the present invention.
`
`[0017] FIGS. 9-13 are schematic diagrams of the naviga
`tor as part of a system for interactive remote control of audio
`or video playback and selection in accordance With the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`DETAILED DESCRIPTION
`
`[0007] Brie?y, the present invention and method involves
`interactive remote control, either Wired or Wireless, of an
`audio or video playback application running on a personal
`computer or other computing platform. The interactive
`remote control provides various functions, such as playback
`of current digital audio or video content; selection of neW
`audio or video content; and providing lists of content for
`playback. The Wireless interactive control device may con
`tain an audio or video broWser for simplifying interactive
`control, by integrating control of a variety content, such as
`music, video, and Internet radio, independent of Whether this
`content exists locally on the computing platform or is
`accessed over the Internet or some other computer netWork.
`An important aspect of this invention is that the digital
`
`System OvervieW
`
`[0018] The present invention relates to interactive control
`of digital content, such as digital audio or video content,
`running on a computing platform, such as a personal com
`puter, set top boX or other device, such as personal digital
`assistant. The interactive remote control device 260 (FIG.
`1), also referred to as the navigator 260, is described in more
`detail beloW in connection With FIG. 5. This device 260
`communicates With an audio or video player application 151
`(FIG. 1) running on a computing platform 100, such as a
`personal computer, set-top boX, or Internet appliance. This
`communication can be handled in a conventional manner
`and may be either Wired or Wireless. The navigator 260 is
`
`Yamaha Corporation of America Exhibit 1012 Page 15
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`used to send user inputs 270 from user controls 264 (FIG.
`5) on the navigator 260, such as buttons, dials, a touch
`screen, and a keyboard, to the audio or video player appli
`cation 151 (FIG. 1) running on the computing platform 100.
`The navigator 260 may be con?gured to display user outputs
`271, such as graphics and teXt for display on an LCD 266
`(FIG. 5) or control of LEDs, from the audio or video player
`application 151 running on the computing platform 100. The
`audio or video player application 151 (FIG. 1) is con?gured
`to receive digital audio or video data 103 from local storage
`device 112 on the computing platform 100 or from a data
`server 102 connected to the computing platform 100 by the
`Internet or other computer netWork 101.
`
`[0019] The interpretation and translation of the user inputs
`270 from the navigator 260 and user outputs 271 to the
`navigator 260 are handled primarily by a navigator control
`manager 154, described later in more detail beloW in con
`nection With FIG. 7, that runs on the computing platform
`100. The navigator control manager 154 may be part of the
`audio or video player application 151 or eXist independently.
`
`Local Playback System Architecture
`[0020] There are various con?gurations for remote control
`of audio or video playback and selection. An exemplary
`embodiment is illustrated in FIG. 2. In this embodiment, the
`audio or video player application 151, running on the
`computing platform 100, receives digital audio or video data
`103 from the local storage device 112 on the computing
`platform 100. Access to the local storage device 112 by the
`audio or video player application 151 is handled through the
`?le system and the storage device drivers 153, convention
`ally part of the operating system for the computing platform
`100. The audio or video player application 151 can also
`receive digital audio or video data 103 from a data server
`102 connected to the computing platform 100 through the
`Internet or other computer netWork 101. Access to the
`netWork interface or modem 117 by the audio or video
`player application 151 is handled though netWorking drivers
`152, also part of the operating system for the computing
`platform 100. The audio or video player application 151
`running on the computing platform 100 may interact With
`the navigator 260 through a Wireless data communications
`interface 124 on the computing platform 100. This Wireless
`data communications interface 124 can be, for eXample,
`Bluetooth, HomeRF, IEEE 802.11, or an infrared interface.
`Access to the Wireless data communications interface 124 on
`the computing platform 100 may be handled through, for
`eXample, conventional Wireless data communications driv
`ers 155. On the computing platform 100, the navigator
`control manager 154, discussed in detail in connection With
`FIG. 7, interprets and translates the user inputs 270 from the
`navigator 260 into commands for control of the audio or
`video player application 151 running on the computing
`platform 100. The navigator control manager 154, running
`on the computing platform 100, takes information from the
`audio or video player application 151 and generates user
`outputs 271 for the navigator 260. On the navigator 260,
`communication With the navigator control manager 154
`running on the computing platform 100 is handled through
`a Wireless data communications interface 269 on the navi
`gator 260. This Wireless data communications interface 269
`must be compatible With the Wireless data communications
`interface 124 on the computing platform 100. Access to the
`Wireless data communications interface 269 on the navigator
`
`260 is handled through Wireless data communications driv
`ers 283. The Wireless communication interfaces 124 and 269
`may be standard interfaces, such as Home RF, IEEE 802.11
`or Bluetooth. The communication drivers 283 may be the
`standard drivers for the communication interfaces discussed
`above. Alternative embodiments of the Wireless data com
`munication interfaces 124 and 269 as Well as the Wireless
`communications driver 283 are disclosed in commonly
`oWned co-pending patent application Ser. No. 09/649,981,
`hereby incorporated by reference. The interface and control
`handler 281, discussed in detail in connection With FIG. 8,
`running on the navigator 260 takes user inputs 270 from user
`controls 264, such as buttons, dials, and touch screens, and
`passes these user inputs 270 through the Wireless data
`communications interface 269 to the navigator control man
`ager 154 running on the computing platform 100. As Well,
`the interface and control handler 281 running on the navi
`gator 260 receives user outputs 271 from the navigator
`control manager 154 running on the computing platform 100
`through the Wireless data communications interface 269.
`The interface and control handler 281 then passes these user
`outputs 271 to the appropriate user output devices, such as
`a graphics display on an LCD 266 or the LEDs. Access to
`user inputs 270 and user outputs 271 is handled through
`input and output drivers 282 on the navigator 260.
`[0021] The audio or video player application 151 running
`on the computing platform 100 passes the digital audio or
`video data 103 to the audio or video playback hardWare 119
`on the computing platform 100, using the audio or video
`playback drivers 156 to communication With the audio or
`video playback hardWare 119. The audio or video playback
`hardWare 119 converts the digital audio or video data 103 to
`analog audio or video 109, Which can then be connected to
`a stereo or headphones for listening or to a TV for vieWing.
`
`[0022] SoftWare components running on the computing
`platform 100 are contained Within the operating system,
`system softWare, and applications 150. Similarly, softWare
`and ?rmWare components running on the navigator 260 are
`contained Within the operating system, system softWare, and
`applications 280.
`
`Transmitted Playback System Architecture
`
`[0023] Various alternate embodiments of remote control
`of audio or video playback and selection are contemplated.
`One such embodiment is illustrated in FIG. 2 of commonly
`oWned co-pending patent application Ser. No.
`, ?led
`on even date, entitled “Digital Audio and Video Distribution
`Transmission and Playback System,” (Attorney Docket No.
`11748/ 13 PCT), hereby incorporated by reference. Another
`embodiment is illustrated in FIG. 3. As in the previous
`con?guration shoWn in FIG. 2, the audio or video player
`application 151 running on the computing platform 100 can
`receive digital audio or video data 103 from the local storage
`device 112 on the computing platform 100. Access to local
`storage 112 device by the audio or video player application
`151 is handled through ?le system and storage device
`drivers 153. The audio or video player application 151 can
`also receive digital audio or video data 103 from a data
`server 102 connected to the computing platform 100 through
`the Internet or other computer netWork 101. Access to the
`netWork interface or modem 117 by the audio or video
`player application 151 is handled though netWorking drivers
`152. The audio or video player application 151 running on
`
`Yamaha Corporation of America Exhibit 1012 Page 16
`
`

`

`US 2002/0087996 Al
`
`Jul. 4, 2002
`
`the computing platform 100 interacts With the navigator 260
`through a Wireless data communications interface 124 on the
`computing platform 100. This Wireless data communications
`interface can be, for example, Bluetooth, HomeRF, IEEE
`802.11, or an infrared interface. Access to the Wireless data
`communications interface 124 on the computing platform
`100 is handled through the Wireless data communications
`drivers 155. On the computing platform 100, the navigator
`control manager 154 interprets and translates the user inputs
`270 from the navigator 260 into commands for and control
`of the audio or video player application 151 running on the
`computing platform 100. The navigator control manager 154
`running on the computing platform 100 also takes informa
`tion from the audio or video player application 151 and
`generates user outputs 271 for the navigator 260. On the
`navigator 260, communication With the navigator control
`manager 154 running on the computing platform 100 is
`handled through a Wireless data communications interface
`269 on the navigator 260. This Wireless data communica
`tions interface 269 must be compatible With the Wireless
`data communications interface 124 on the computing plat
`form 100. Access to the Wireless data communications
`interface 269 on the navigator 260 is handled through
`Wireless data communications drivers 283. The interface and
`control handler 281 running on the navigator 260 takes user
`inputs 270 from user controls 264, such as buttons, dials, and
`touch screens, and passes these user inputs 270 through the
`Wireless data communications interface 269 to the navigator
`control manager 154 running on the computing platform
`100. As Well, the interface and control handler 281 running
`on the navigator 260 receives user outputs 271 from the
`navigator control manager 154 running on the computing
`platform 100 through the Wireless data communications
`interface 269. The interface and control handler 281 then
`passes these user outputs 271 to the appropriate user output
`device, such as a graphics display on an LCD 266 or LEDs.
`Access to user inputs 270 and user outputs 271 is handled
`through input and output drivers 282 on the navigator 260.
`[0024] HoWever, unlike the previous con?guration
`described in FIG. 2, Where the computing platform 100
`generates an analog audio or video data 109 for input to an
`analog device, in the con?guration shoWn in FIG. 3, the
`digital audio or video data 103 is passed by the audio or
`video player application 151 running on the computing
`platform 100 to an analog transmitter peripheral 104. The
`audio or video player application 151 uses audio or video
`playback drivers 156 and peripheral bus drivers 157 to
`communicate With the analog transmitter peripheral 104
`through the peripheral bus 111 on the computing platform
`100. The analog transmitter peripheral 104 receives the
`digital audio or video data 103 through a peripheral interface
`201 on the analog transmitter peripheral 104. The digital
`audio or video data 103 is then converted to analog audio or
`video 109 by the audio or video digital to analog converter
`206 on the analog transmitter peripheral 104. The analog
`audio or video 109 is transmitted by an analog audio or
`video transmitter 209 on the analog transmitter peripheral
`104 to an audio or video receiver device 105 that makes the
`analog audio or video 109 available for listening, such as on
`a stereo or headphones, or vieWing such as on a TV.
`[0025] SoftWare components including the various drivers
`discussed above, running on the computing platform 100 are
`contained Within the operating system, system softWare, and
`applications 150. Similarly, softWare and ?rmWare compo
`
`nents running on the navigator 260 are contained Within the
`operating system, system softWare, and applications 280.
`[0026] It should be noted that the embodiments described
`(FIGS. 2 and 3) represent only tWo of a plethora of possible
`embodiments for con?gurations of a system for interactive
`remote control of audio or video playback and selection.
`
`Computing Platform
`
`[0027] FIG. 4 illustrates an exemplary system architecture
`for the computing platform 100, Which can encompass
`anything from general-purpose devices, such as a personal
`computer, to open ?xed function devices, such as a set-top
`box that connects to a television set. HoWever, the comput
`ing platform 100 is not restricted to these examples. In
`general, the computing platform 100 includes a main pro
`cessor 110, for example, an Intel Pentium III or better, for
`executing various softWare components. The various soft
`Ware components are typically stored in read only memory,
`or ROM, or ?ash memory 116, or the local storage device
`112. The local storage device 112 can consist of persistent
`storage 113, such as hard drives or ?ash memory, or remov
`able storage 114, such as ?oppy drives, CD-ROM drives, or
`DVD drives. The softWare components are executed by the
`main processor 110 directly from their storage location or
`may be loaded into random access memory or RAM 115, to
`be executed from RAM 115 by the main processor 110. The
`computing platform 100 uses a netWork interface or modem
`117 to access data server computers 102 on the Internet or
`other computer netWork 101, in order to doWnload digital
`audio or video data 103. The netWork interface or modem
`117 is connected internally or externally to the computing
`platform 100 using a system bus or peripheral bus 111. The
`system bus and peripheral buses 111 are provided for
`connecting internal and external devices to the computing
`platform 100 in a standard manner. Typical system and
`peripheral buses 111 include Universal Serial Bus, com
`monly referred to as USB, IEEE 1394, commonly referred
`to as FireWire, and Peripheral Connect Interface, commonly
`referred to as PCI. The computing platform 100 may also
`support connection through a user input interface 120 to
`external or integrated user input devices 123, such as a
`keyboard and mouse. For output to the user, the computing
`platform 100 may contain a display controller 118, for
`example, an NVIDIA model GeForce2, Which stores graphi
`cal data, such as WindoWs, bitmaps and text. The display
`controller 118 outputs the graphical data as video output 121
`that is typically displayed to the user on a video monitor,
`television, or LCD panel. In addition to video output 121,
`the computing platform 100 may provide audio output 122,
`Which is handled by the audio and video playback hardWare
`119, Which also provides support for video playback to the
`display controller 118. It should be noted that a client
`computing platform 100 is not limited to the capabilities and
`features listed in this description, but may contain a subset
`of the described features or may contain additional capa
`bilities or features not listed.
`
`Navigator Architecture
`
`[0028] The navigator 260 (FIG. 5) acts as a remote control
`and alloWs the user to receive feedback from and provide
`input to an audio or video player application 151 running on
`a computing platform 100. In the embodiment shoWn, the
`computing platform 100 Wirelessly transmits and receives
`
`Yamaha Corporation of America Exhibit 1012 Page 17
`
`

`

`US 2002/0087996 A1
`
`Jul. 4, 2002
`
`data communications With the navigator 260, giving the
`navigator 260 functionality Within the range of the Wireless
`communications. The navigator 260 receives and transmits
`the data communications using the Wireless data communi
`cations interface 269. This Wireless data communications
`interface 269 may be, for example, a Bluetooth, HomeRF, or
`IEEE 802.11 interface. This Wireless data communications
`interface 269 must match the technology chosen for use on
`the computing platform 100. The processor 261 handles the
`data communications With the Wireless data communica
`tions interface 269. The processor 261 also takes user inputs
`270 from the user controls 264, Which are typically buttons
`and dials, and sends this information to the Wireless data
`communications interface 269 for Wireless transmission to
`the computing platform 100 and eventually back to the audio
`or video player application 151 running on the computing
`platform 100. The processor 261 receives update informa
`tion from the audio or video player application 151 through
`the Wireless data communications interface 269, Which the
`processor 261 then makes available to the user by updating
`the graphic information on the liquid crystal display panel,
`or LCD 266. The processor 261 reads the code it runs from
`the ?ash memory 263, Which is also used to store informa
`tion that must survive poWer cycling of the navigator 260.
`The processor 261 uses random access memory, or RAM
`262, for executing code and storing volatile information, this
`is information that is subject to change or does not need to
`survive poWer cycling of the navigator 260.
`[0029] Additional functionality may be provided through
`the poWer handler and battery charger 267, controlled by the
`processor 261 and responsible for handling poWer manage
`ment, conserving battery life, and charging of the battery
`268. There is also an infrared or IR transmitter 265 that
`alloWs the navigator 260 to control audio playback equip
`ment, such as a stereo.
`
`Audio or Video Playback Handler
`[0030] FIG. 6 is a software How diagram for audio or
`video playback on the computing platform 100, Which in the
`example described henceforth, is called the audio or video
`playback handler. The audio or video playback handler is
`called as part of the audio or video player application 151 to
`playback the digital audio or video data 103. “Start” in step
`160 represents the beginning of the audio or video playback
`handler. The audio or video playback handler receives the
`audio or video playback selection When it is called. The
`audio or video playback handler checks if the audio or video
`playback selection is available locally on the computing
`platform 100 in step 161. If the ?le is available locally, the
`audio or video playback handler reads the digital audio or
`video data 103 from the audio or video ?le in step 162. Next,
`the audio or video playback handler checks if it is at the end
`of the audio or video ?le to playback in step 163. If it is at
`the end of the audio or video ?le, then the audio or video
`playback handler ends playing of the audio or video ?l