I lllll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111
`US007 5 3 5465B2
`
`c12) United States Patent
`Morse et al.
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 7 ,535,465 B2
`May 19, 2009
`
`(54) METHOD AND SYSTEM TO DISPLAY MEDIA
`CONTENT DATA
`
`2003/0140343 Al
`
`7 /2003 Falvo et al.
`
`(75)
`
`Inventors: Lee Morse, Sunnyvale, CA (US); David
`Beauchesne, Scotts Valley, CA (US)
`
`(73) Assignee: Creative Technology Ltd., Singapore
`(SG)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 428 days.
`
`(21) Appl. No.: 10/654,122
`
`(22) Filed:
`
`Sep.2,2003
`
`(65)
`
`Prior Publication Data
`
`US 2005/0057538 Al
`
`Mar. 17, 2005
`
`(51)
`
`Int. Cl.
`G09G 5100
`(2006.01)
`(52) U.S. Cl. ...................................................... 345/204
`( 58) Field of Classification Search . ... ... ... ... .. ... 345/204
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,515,052 A *
`5,952,995 A *
`6,104,334 A
`6,157,377 A
`6,157,411 A
`6,463,465 Bl
`6,502,194 Bl
`6,826,283 Bl
`7,069,508 Bl*
`7,089,321 B2
`7,251,413 B2
`2001/0005201 Al*
`2002/0054028 Al*
`2002/0087996 Al
`2002/0147985 Al
`200210184625 Al
`
`5/1996
`9/1999
`8/2000
`12/2000
`12/2000
`10/2002
`12/2002
`1112004
`612006
`8/2006
`7/2007
`6/2001
`512002
`712002
`10/2002
`12/2002
`
`Darbee ....................... 341/176
`Barnes ....................... 345/157
`Allport
`Shah-Nazaroff et al.
`Williams et al.
`Nieuwejaar
`Berman
`Wheeler et al.
`Bever et al. ................. 715/234
`Hayashi
`Dow et al.
`Digiorgio et al . ........... 345/204
`Uchida et al. ............... 345/173
`Bi eta!.
`Miyajima et al.
`Allport
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`WO
`
`W0-02052540 Al
`
`712002
`
`OTHER PUBLICATIONS
`
`"International Search Report in PCT/SG2004/000246", (Oct. 26,
`2004), 4 pages.
`
`(Continued)
`
`Primary Examiner-Sumati Lefkowitz
`Assistant Examiner-Tammy Pham
`(74) Attorney, Agent, or Firm-Schwegman, Lundberg &
`Woessner, P.A.
`
`(57)
`
`ABSTRACT
`
`A method and system is provided to display media content
`data for playback on a playback device. The system may
`include a playback unit and a remote control device. The
`playback unit may include a media content data storage com(cid:173)
`munication interface to communicate with a media storage
`device thereby to receive the media content data. Further, the
`playback unit may include a display data processor to process
`the media content data and generate display metrics based on
`the media content data, and a bi-directional remote control
`communication interface. The remote control device may be
`used to select the digital media for playback on the playback
`device and include a complemental remote control commu(cid:173)
`nication interface communication with the communication
`interface of the playback unit. Further, the remote control
`device may include a display screen, and a display rendering
`module to display the media content data on the display
`screen based on the display metrics.
`
`15 Claims, 15 Drawing Sheets
`
`250 \
`
`268
`
`266
`
`PLAYBACK UNIT
`
`~
`
`PROCESSING
`UNIT
`
`DISPLAY
`DATA PROCESSOR
`
`REMOTE CONTROL DEVICE
`™
`
`DISH, Exh. 1004, p. 1
`
`

`
`US 7,535,465 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`2003/0158899 Al
`2004/0003398 Al
`2004/0030599 Al
`2004/0199654 Al
`2004/0224638 Al
`2004/0249915 Al
`2005/0005300 Al
`2005/0071278 Al
`2005/0076388 Al
`2005/0262535 Al*
`
`8/2003 Hughes
`112004 Donian et al.
`212004 Sie et al.
`10/2004 Juszkiewicz
`1112004 Fadell et al.
`12/2004 Russell
`112005 Putterman et al.
`3/2005 Simelius
`412005 Morse et al.
`1112005 Uchida et al. ................. 725/80
`
`OTHER PUBLICATIONS
`
`"Niveus Control (Pocket PC Remote)", web.archive.org/web/
`2004030215163 l/store.niveusmedia.corn/s.nl/c .304836/sc .2/cat(cid:173)
`egory.2/it.l/id.5/ .f. As archived Mar. 2, 2004, 2 pages.
`"Philips iPronto: Dashboard for the Digital Home", web.archive.org/
`web/20030624030854/www.remotecontrol.philips.com/library/
`ipronto/Whilepaper_iPronto.pdf. As archived on Jun. 24, 2003,
`(2002), 13 pages.
`"Salling Clicker v.2.0.l", web.archive.org/web/20030801113722/
`homepage.mac.corn/jonassalling/Shareware/Clicker, As archived on
`Aug. 1, 2003, 2 pages.
`Player", web.archive.org/web/
`"SLIMP3 Network MP3
`200307 l 6140634/slimdevices.corn/downloads/SLIMP3.pdf,
`As
`archived on Jul. 16, 2003, 2 pages.
`"TelCanto
`for SlimServer Features", http:www.telcanto.com/
`description_slimclient.htrn, 2 pages.
`
`"U.S. Appl. No. 10/654,338 Response to Final Office Action mailed
`May 23, 2007", 18 pgs.
`"U.S. Appl. No. 10/654338 Non-Final Office Action Mailed Oct. 15,
`2007", 16 pgs.
`"U.S. Appl. No. 10/654,338, Advisory Action mailed Jul. 26, 2006",
`7 pgs.
`"U.S. Appl. No. 10/654,338, Final Office Action mailed May 3,
`2006", 13 pgs.
`"U.S. Appl. No. 10/654,338, Final Office Action mailed May 23,
`2007", 13 pgs.
`"U.S.Appl. No. 10/654,338, Non Final Office Action mailed Oct. 23,
`2006", 11 pgs.
`"U.S.Appl. No. 10/654,338, Non-Final OfficeActionmailedApr. 30,
`2008", 16 Pgs.
`"U.S. Appl. No. 10/654,338, Response filed Sep. 2, 2003 to Advisory
`Action mailed Aug. 18, 2006", 22 pgs.
`"U.S. Appl. No. 10/654,338, Response filed Sep. 2, 2003 to Final
`Office Action mailed Jul. 14, 2006", 21 pgs.
`"U.S.Appl. No.10/654,338, Response filed Sep. 2, 2003toNonFinal
`Office Action mailed Feb. 13, 2008", 15 pgs.
`"U.S. Appl. No. 10/654338, Response filed Sep. 2, 2003 to non Final
`Office action mailed Feb. 21, 2007", 17 pgs.
`"U.S. Appl. No. 10/654338, Response to filed Sep. 2, 2003 to Non
`Final Office Action mailed Mar. 15, 2006", 15 pgs.
`U.S. Appl. No. 10/654,338 Final Office Action mailed on Oct. 17,
`2008, 22 Pgs.
`U.S. Appl. No. 10/654,338, Response filed Sep. 2, 2008 to Non-Final
`Office Action mailed Apr. 30, 2008, 19 pgs.
`* cited by examiner
`
`DISH, Exh. 1004, p. 2
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 1of15
`
`US 7,535,465 B2
`
`MEDIA CONTENT
`STORAGE DEVICE
`
`14
`
`MEDIA PLAYER/
`REPRODUCTION DEVICE
`INCLUDING D!SPLA Y
`(E.G. TV)
`12
`
`.... ,
`
`J
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`' I
`24
`/
`,~
`I
`I
`I
`I
`r
`I
`I
`I
`I
`
`' r
`r
`' ' ' t
`
`t
`I
`I
`I
`I
`t
`
`' I
`
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`22
`
`PLAYBACK CLIENT
`
`REMOTE CONTROL
`
`18
`
`FIG. 1
`{Prior Art)
`
`DISH, Exh. 1004, p. 3
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 2of15
`
`US 7,535,465 B2
`
`MEDIA CONTENT
`STORAGE DEVICE
`
`14
`
`MEDIA PLAYER/
`REPRODUCTION DEVICE
`OPTIONALLY INCLUDING
`DISPLAY (E.G. STEREO,
`TV, ETC.)
`
`31
`
`r------------- -------- --------------,
`
`PLAYBACK
`UNIT
`
`I
`I
`I
`I
`I
`I
`
`i
`:
`
`3L/
`
`DISPLAY
`SCREEN
`
`36
`
`REMOTE
`CONTROL
`DEVICE
`34
`
`FIG. 2
`
`DISH, Exh. 1004, p. 4
`
`

`
`REMOTE CONTROL DEVICE
`34
`
`. -
`
`PLAYBACK UNIT 32
`
`Bl-DIRECTIONAL
`COMMUNICATION
`RK)
`
`REMOTE CONTROL
`COMMUNICATION
`INTERFACE
`52
`
`Bl-DIRECTIONAL
`COMMUNICATION
`(E.G. RF/IR)
`
`CONTROLLER
`
`I
`- (MICROPROCESSOR)
`!
`
`54
`
`DISPLAY SCREEN
`
`36
`
`USER INTERFACE
`
`-
`
`56
`
`REMOTE CONTROL
`COMMUNICATION
`INTERFACE 38
`~
`PROCESSOR
`UNIT
`
`50
`
`/
`
`PLAYBACK DEVICE
`INTERFACE
`(E.G. D/A CONVERTER)
`42
`
`MEDIA STORAGE
`COMMUNICATION
`INTERFACE 40
`/
`
`-
`
`STORAGE/
`MEMORY
`44
`
`MEMORY
`BUFFER
`46
`
`POWER
`UNIT
`
`48
`
`rv
`COMMUNICATED TO
`MEDIA PLAYER
`
`FIG. 3
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~
`......
`~v::i
`N
`0
`0
`v::i
`
`1J1 =(cid:173)
`
`('D
`('D
`......
`(.H
`
`0 ......
`......
`Ul
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 5
`
`

`
`REMOTE WAITS FOR I
`
`USER INPUT
`
`•
`
`72
`-
`
`REMOTE RECEIVES
`USER INPUT
`
`74
`-
`
`70
`
`.)
`
`1
`
`r
`
`NO
`
`PROCESS INPUT
`OR SEND MESG TO
`PB UNIT?
`76
`
`YES
`
`PROCESS INPUT
`
`Ia
`
`NO
`
`NEED TO UPDATE
`DISPLAY?
`80
`-
`
`REMOTE UPDATES
`DISPLAY
`
`I
`
`§2
`
`NEED ~
`REMOTE SENDS MESG ~ES MORE INFO
`TO PLAYBACK UNIT
`84
`-
`
`FROM PB UNIT
`?
`88
`y
`
`I
`
`REMOTE RECEIVES I
`
`MESG FROM
`PLAYBACK UNIT
`
`~
`8
`
`FIG. 4
`
`~
`~
`:-c
`~
`~
`~ = ~
`
`i:::
`~
`~
`...,.
`'"v::i
`N
`0
`0
`
`v::i
`
`~
`~
`'.;.
`0 .....
`...,.
`
`ui
`
`d
`"'
`_.---l
`~
`~
`~
`~ = N
`
`DISH, Exh. 1004, p. 6
`
`

`
`PB UNIT WAITS
`FOR MESSAGE FROM
`REMOTE
`
`92
`
`PB UNIT RECEIVES
`MESG FROM REMOTE
`94
`
`PROCESS
`MESGORGOTO
`SERVER?
`96
`
`PROCESS MESG
`98
`
`PB UNIT SENDS
`MESSAGE
`TO SERVER
`
`I YES
`
`11.Q_
`
`PB UNIT RECEIVES
`REQUESTED DATA
`FROM SERVER ill.
`
`PB UNIT SENDS
`MESG TO REMOTE
`102
`
`YES
`
`NO
`
`)'90
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`
`~v::i
`N
`0
`0
`v::i
`
`('D
`('D
`
`1J1 =(cid:173)
`.....
`Ul
`0 .....
`....
`Ul
`
`PB UNIT SENDS DATA
`TORO
`
`106
`
`FIG. 5
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 7
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 6 of 15
`
`US 7,535,465 B2
`
`34
`
`__)
`
`0
`
`G80
`60 80~
`G G
`8
`8
`8
`8
`8 G
`8
`8
`8
`
`<Ja
`
`35
`
`FIG. 6
`
`DISH, Exh. 1004, p. 8
`
`

`
`TOP: SMART PLAYLIST,
`PLAYLIST, ARTIST, ALBUM,
`GENRE, ALL TRACKS
`
`I
`LIST OF SMART
`PLAYLISTS
`AVAILABLE
`I
`
`LIST OF
`TRACKS
`
`I
`LIST OF ALL
`PLAYLISTS
`
`I
`
`LIST OF
`TRACKS
`
`I
`LIST OF
`ALPHABETS
`FOR ARTISTS
`I
`
`LIST OF ARTISTS
`
`I
`LIST OF
`ALBUMS
`
`I
`
`LIST OF
`TRACKS
`
`I
`
`LIST OF
`ALPHABETS
`FOR ALBUM
`I
`
`UST OF
`ALBUMS
`
`I
`
`LIST OF
`TRACKS
`
`I
`LISTOF
`ALPHABETS
`FOR GENRES
`I
`LIST OF
`ALPHABETS
`FOR ARTISTS
`I
`
`LIST OF
`ARTISTS
`
`I
`
`LIST OF
`ALBUMS
`
`I
`
`LIST OF
`TRACKS
`
`I
`LIST OF
`ALPHABETS FOR
`ALL TRACKS
`I
`
`LIST OF
`TRACKS
`
`FIG. 7
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`
`~v::i
`N
`0
`0
`v::i
`
`('D
`('D
`
`1J1 =(cid:173)
`.....
`-....J
`0 .....
`....
`Ul
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 9
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 8of15
`
`US 7,535,465 B2
`
`Favorite Playlists
`Music Library
`Setup
`\
`Info
`"---122
`
`: 0 0 0 p
`
`(-------------Muslc-L1sRARv------------,:
`
`~------------------------------------------!
`Smart Playlists
`Playlist
`Artist
`Album
`
`: 0 0 0 p
`
`36
`
`)
`
`FIG. 8
`
`36
`
`)
`
`FIG. 9
`
`DISH, Exh. 1004, p. 10
`
`

`
`150 'l
`
`Server 1
`
`PLAYBACK UNIT 1
`160
`
`7_1RC1
`
`S1
`
`S2
`
`I 200 I I 202 I
`
`PLAYBACK UNIT2
`162
`
`Server 2 154
`
`Server 3 156
`
`----------------------: /:--
`~-
`Server n 158 i '~:--
`:
`:
`-=-1
`',
`:___________________
`'
`
`I
`
`I
`
`1
`
`' ' ' ' - ' -- ' -..,
`
`,_..-';:
`
`/
`
`I
`
`I
`
`I
`
`,---------------------------
`PLAYBACK UNITp
`164
`
`~
`
`J
`' , ,
`I
`' ,
`----- '-., I
`---~~
`
`172
`
`"',,
`', , ... ,
`'.J ',, ,.,.,
`
`174
`
`"
`
`, /
`,,_ -
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I ,:
`
`,--1
`I RC qi
`+--,
`I
`I
`/
`'---+1
`I
`I
`I
`I 176 I
`1_-:-_1
`FIG.10
`
`------;.:::-"'J
`
`- - /,•-'
`
`I
`
`, / ·
`
`J
`
`L___________________________
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`
`~v::i
`N
`0
`0
`v::i
`
`('D
`('D
`
`1J1 =(cid:173)
`.....
`v::i
`0 .....
`....
`Ul
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 11
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 10 of 15
`
`US 7,535,465 B2
`
`~
`~
`
`(!)
`LL
`
`<(
`v
`z
`v
`>-
`v
`N
`
`(/')
`
`~ w
`!::::
`c.o
`C"? +-N~
`
`en
`~ ~
`!::::
`>-
`
`I
`I
`I
`I
`I
`\
`I
`\
`\
`I
`\
`\
`I
`I
`\
`\
`\
`\
`I
`I
`I
`
`' I
`
`I
`I
`I
`I
`\
`
`(
`I
`I
`I
`I
`I
`(
`J
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`I
`
`I ,
`' '
`
`::::.:::
`
`~I-!
`co->-z
`<( :::>
`_J
`Q_
`
`c:r:
`L1J >
`c:r:
`LU
`U)
`
`~I
`
`(f)
`
`za5
`!:::
`
`~I
`
`\
`\
`\
`\
`
`\
`
`\
`\
`\
`
`\
`
`\
`\
`
`\
`\
`
`\
`
`' \
`
`\
`
`' \
`
`\
`\
`
`\
`
`' ' J
`
`I
`I
`J
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`~I
`
`en
`<aJ ~I
`
`1--
`
`)
`(
`
`\
`\
`\
`
`'
`
`\
`\
`
`' \
`'
`
`DISH, Exh. 1004, p. 12
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 11 of 15
`
`US 7,535,465 B2
`
`PLAYBACK DEVICEAPPLICATION CODE
`
`COMMON MIDDLEWARE
`
`16 0, 162, 164
`
`
`i---
`
`196
`
`194
`
`DP1
`
`DP2 DP3 ••• DPN
`
`184
`
`186 188
`
`HARDWARE LAYER
`
`PLAYBACK DEVICE
`
`COMMON
`DRIVERS
`
`192
`
`190
`
`FIG. 12
`160, 162, 164
`
`TABLE OF
`DISCOVERED
`SERVERS
`
`THREADS TO
`MANAGE
`SERVERS
`
`SERVER 1
`
`SERVER2
`
`SERVER3
`•
`•
`•
`SERVER n
`
`212
`
`THREAD 1
`
`THREAD 2
`
`THREAD3
`•
`•
`•
`THREAD n
`
`1
`
`SELECTED MERGED
`DATA FOR COMMS
`TO REMOTE
`
`216
`
`FIG.13
`
`DISH, Exh. 1004, p. 13
`
`

`
`250 \
`
`268
`(
`
`266 ;
`
`PLAYBACK UNIT
`252
`
`PROCESSING
`UNIT
`
`50
`
`DISPLAY
`DATA PROCESSOR
`
`256
`
`RENDERING -
`
`ENGINE/MODULE
`
`260 B
`
`USER
`INTERFACE
`56
`
`DISPLAY
`
`I
`
`FONT
`TABLE
`264
`
`DISPLAY
`CONTENT
`CACHE
`262
`
`REMOTE CONTROL DEVICE
`254
`
`FIG. 14
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`
`~v::i
`N
`0
`0
`v::i
`
`('D
`
`1J1 =-('D
`.....
`....
`N
`0 .....
`....
`Ul
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 14
`
`

`
`MEDIA CONTENT STORAGE
`DEVICE
`
`( SERVER (S) )
`
`PLAYBACK UNIT
`
`REMOTE CONTROL
`DEVICE
`
`REQUEST DATA
`
`~
`
`PROVIDE DATA
`
`\
`
`27 4
`
`276
`
`BUTTON I KEY PRESS
`\272
`
`~
`00 .
`
`~
`~
`~
`
`~ = ~
`
`~
`~ ....
`
`~v::i
`N
`0
`0
`v::i
`
`REQUEST GLYPH METRICS
`
`SEND GLYPH METRICS
`
`278
`
`280
`
`SEND DISPLAY DATA AND METRICS
`\282
`
`•
`
`ACKNOWLEDGE RECEIPT
`
`284
`
`FIG.15
`
`)
`270
`
`('D
`('D
`
`1J1 =(cid:173)
`.....
`....
`0 .....
`....
`Ul
`
`(.H
`
`d
`rJl
`-....l u. w
`
`tit
`~
`0--,
`
`tit = N
`
`DISH, Exh. 1004, p. 15
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 14 of 15
`
`US 7,535,465 B2
`
`~300
`
`PLAYBACK UNIT GETS DISPLAY DATA FOR
`DISPLAY ON REMOTE CONTROL
`DEVICE AND ANALYZES DATA
`
`l
`
`COMMUNICATE QUERY FOR
`GLYPH METRICS OF GLYPTHS TO
`BE DISPLA YEO
`
`l
`
`302
`
`304
`
`COMPUTE REQUIRED DISPLAYAREAUSING:
`GLYPH METRICS
`DISPLAY DATA
`
`306
`
`l
`
`GENERATE DISPLAY METRICS (E.G. SPACING
`BETWEEN GLYPHS TO ENHANCE
`)
`READABILITY
`
`I
`
`COMMUNICATE TO REMOTE:
`CODE FOR EACH GLYPH
`DISPLAY METRICS/ COORDINATES
`FOR EACH GLYPH
`
`1
`
`RETRIEVE GLYPHS FROM FONT TABLE
`AND MAP TO DISPLAY SCREEN USING
`COORDINATES/DISPLAY METRICS
`
`l
`
`SEND ACKNOWLEDGEMENT FROM
`REMOTE CONTROL DEVICE TO
`PLAYBACK UNIT
`
`310
`
`312
`
`314
`
`Fig. 16
`
`DISH, Exh. 1004, p. 16
`
`

`
`U.S. Patent
`
`May 19, 2009
`
`Sheet 15 of 15
`
`US 7,535,465 B2
`
`RECEIVE BUTION/KEY
`CODE
`352
`
`350
`~
`
`NO
`
`IDENTIFY
`FUNCTION AND
`EXECUTE 356
`
`COMMUNICATE
`DISPLAY DATA TO
`ADD TO BOTTOM
`OF DISPLAY LIST
`
`COMMUNICATE
`DISPLAY DATA TO
`ADD TO TOP OF
`DISPLAY LIST 358
`
`NO
`
`FURTHER DATA
`REQUIRED FOR
`SERVER(S)?
`
`OBTAIN FURTHER
`DATA FROM
`SERVER(S)
`
`364
`
`FIG. 17
`
`DISH, Exh. 1004, p. 17
`
`

`
`US 7,535,465 B2
`
`1
`METHOD AND SYSTEM TO DISPLAY MEDIA
`CONTENT DATA
`
`FIELD OF THE INVENTION
`
`The present invention relates generally to the field of digi(cid:173)
`tal media and, more specifically, to a method and a system to
`display media content data on a remote control device.
`
`BACKGROUND OF THE INVENTION
`
`10
`
`More and more homes are now being equipped with local
`area networks. These so-called "home networks" provide
`digital connectivity using either wired and/or wireless links.
`Examples of wired links are Ethernet and HPNA Phone Line 15
`networks. Examples of wireless links are 802.lla, 802.llb,
`802.llg and the like links that may provide digital wireless
`connectivity throughout the home.
`Further, an increasing amount of digital media (e.g., digital
`media such as audio and video) is being stored on personal
`computers or PCs. For example, in many homes music and/or
`video content is stored on a central PC and products are now
`available that allow a user to reproduce or play back this
`content on a different playback device (e.g. a TV set or ste(cid:173)
`reo). These products may use a home network to communi(cid:173)
`cate the digital content to a playback client that, in turn,
`communicates the digital content to a playback device such as
`a TV set.
`
`SUMMARY OF THE INVENTION
`
`2
`FIG. 2 shows a schematic block diagram of a system, in
`accordance with the invention, to control playback of digital
`media on a playback device;
`FIG. 3 shows a more detailed schematic block diagram of
`an exemplary remote control device and an exemplary play(cid:173)
`back unit of the system of FIG. 2;
`FIG. 4 shows a schematic flow diagram of a method, in
`accordance with the invention, to control playback of digital
`media using a remote control device;
`FIG. 5 shows a schematic flow diagram of a method, in
`accordance with the invention, to control playback of digital
`media using a playback unit;
`FIG. 6 a shows schematic view of an exemplary remote
`control device, in accordance with the invention;
`FIG. 7 shows an exemplary media content hierarchy of
`media content data for display on a display screen of the
`remote control device;
`FIG. 8 shows a schematic view of an exemplary user inter(cid:173)
`face presented to the user on the display screen of the remote
`20 control device;
`FIG. 9 shows a schematic view of an exemplary user inter(cid:173)
`face to present media content to the user on the display screen;
`FIG. 10 shows a schematic diagram of a further system,
`also in accordance with the invention, to control the playback
`25 of digital media residing on a plurality of media content
`storage devices in the exemplary form of digital media serv-
`ers;
`FIG. 11 shows a schematic diagram of sub-sets of media
`content data stored on a media content storage device, a
`30 playback unit, and a remote control device;
`FIG. 12 shows an exemplary configuration of a playback
`unit used in the system of FIG. 10 showing a plurality of
`driver protocols;
`FIG. 13 shows an exemplary table of discovered media
`35 storage devices and threads to manage the discovered media
`storage devices;
`FIG. 14 shows exemplary modules of a remote control
`device and a playback unit, both in accordance with the inven(cid:173)
`tion, in which a font table is provided on the remote control
`40 device and an application that uses the font table is provided
`on the playback unit;
`FIG. 15 shows a schematic functional diagram of interac(cid:173)
`tion between the playback unit and the remote control device
`when accessing the font table and communicating display
`45 metrics to the remote control device;
`FIG. 16 shows a schematic flow diagram of a method, in
`accordance with the invention, to control the display of data
`on a remote control device remotely from a playback unit; and
`FIG. 17 shows a schematic flow diagram of a method, in
`50 accordance with the invention, to provide data for display on
`a remote control device.
`
`A method and system is provided to display media content
`data for playback on a playback device. The system may
`include a playback unit and a remote control device. The
`playback unit may include a media content data storage com(cid:173)
`munication interface to communicate with a media storage
`device thereby to receive the media content data. Further, the
`playback unit may include a display data processor to process
`the media content data and generate display metrics based on
`the media content data, and a bi-directional remote control
`communication interface. The remote control device may be
`used to select the digital media for playback on the playback
`device and include a complemental remote control commu(cid:173)
`nication interface for bi-directional communication with the
`remote control communication interface of the playback unit.
`Further, the remote control device may include a display
`screen, and a display rendering module to display the media
`content data on the display screen based on the display met(cid:173)
`rics.
`The invention extends to a playback unit and to a remote
`control device. The invention also extends to a machine(cid:173)
`readable medium including a set of instructions that, when
`execute by a machine, cause the machine to execute any of the
`methods described herein.
`Other features of the present invention will be apparent
`from the accompanying drawings and from the detailed 55
`description that follows.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The invention is now described, by way of example and not
`limitation, with reference to the accompanying diagranmiatic
`drawings in which like reference numerals refer to the same
`or similar features unless otherwise indicated.
`In the drawings,
`FIG. 1 shows a schematic block diagram of a prior art
`system to control playback of digital media on a playback
`device;
`
`DETAILED DESCRIPTION
`
`A method a system to display media content data for play-
`back on a playback device is described. In the following
`description, for purposes of explanation, numerous specific
`details are set forth in order to provide a thorough understand(cid:173)
`ing of the present invention. It will be evident, however, to one
`60 skilled in the art that the present invention may be practiced
`without these specific details.
`Referring to the drawings, reference numeral 10 general
`indicates a system, in accordance with the prior art, to play
`back digital media on a playback or reproduction device 12.
`65 The system 12 includes a media content storage device 14, a
`playback client 16, and a remote control 18. The media con(cid:173)
`tent storage device 14 is typically in the form of a personal
`
`DISH, Exh. 1004, p. 18
`
`

`
`US 7,535,465 B2
`
`25
`
`3
`computer or PC on which audio files (e.g. music files) are
`stored. Audio data is typically communicated from the media
`content storage device 14 to the playback client 16 via a local
`area network 20 (e.g. a wired network connection, a wireless
`network connection (e.g., a wireless home network), or the
`like). The playback client 16 communicates selected audio
`files to the media player 12 via a hardwired connection 22.
`The media player 12 is typically a TV set or the like which has
`a display screen for displaying information to a user of the
`system 10. In use, the user may view the display screen of the 10
`TV set (see arrow 24) and, using the remote control 18,
`communicate with the playback client 16 to select audio for
`playback on the media player or playback device 12. In order
`to accomplish this, the playback client 16 receives the
`selected audio from the media content storage device 14 and 15
`communicates it to the media player or reproduction device
`12. Accordingly, in the system 10 of the prior art, the user
`views some separate or independent display screen such as a
`TV set and uses the remote control 18 to select audio content
`for playback based on what is displayed on the TV set. 20
`Accordingly, in the prior art, unidirectional communication
`from the remote control 18 to the playback client 16 takes
`place and the remote control 18 does not include a display that
`receives media content information from the playback client
`16.
`Referring in particular to FIG. 2, reference numeral 30
`generally indicates a system, in accordance with the inven(cid:173)
`tion, to control playback of digital media on a playback or
`reproduction device 31. The playback device 31 may be a
`television set, a stereo or any other playback device for play(cid:173)
`ing back media content (digital and/or analog). It should be
`noted that the playback device 31 may or may not include a
`display screen.
`The system 30 includes a playback unit 32, also in accor(cid:173)
`dance with the invention, and a remote control device 34, also
`in accordance with the invention (see also FIG. 6). As
`described in more detail below, the system 30 displays con(cid:173)
`tent data on a display screen 36 of the remote control device
`34. For example, the media content storage device 14 may
`store digital media in the form of music files, video files,
`photographs, or the like and the playback unit 32 may retrieve
`content data that identifies, or is associated with, the media
`files and communicate the content data to the remote control
`device 34 for display on the display screen 36. Further, as
`described in more detail below, the user may then select 45
`content (selected media) for reproduction or playback on the
`playback device 31 based on the information provided on the
`display screen 36. Thus, for example, the content data may
`include audio track titles, album names, video clip titles,
`photograph tiles, and so on that reside on the media content 50
`storage device 14. It will be appreciated that the media con(cid:173)
`tent storage device 14 may include any server (e.g., a personal
`computer) that may serve digital media content. In the system
`30 of FIG. 2, the network 20 may be a wired network (e.g.,
`using an IEEE 1394 connection or the like) or a wireless 55
`network (e.g., using 802.11 or any other wireless technol(cid:173)
`ogy).
`Referring in particular to FIG. 3, the exemplary playback
`unit 32 includes a remote control communication interface
`38, a media storage communication interface 40, and a play- 60
`back device interface 42. Further, the playback unit 32 may
`include other components such as storage/memory 44, a
`memory buffer 46, a power unit 48, and a processor unit 50 to
`control operation of the playback unit 32.
`The media storage communication interface 40 is typically 65
`a bi-directional communication interface such as a local area
`network (LAN) wireless device capable, for example, of
`
`4
`communicating via a local area network using 802.lla,
`802.11 b, 802.llg or the like communication protocols. It is,
`however, to be appreciated that the playback unit 32 may
`communicate using any communication link or links (both
`wired and/or wireless) with any one or more digital content
`servers, as described in more detail below. In one embodi(cid:173)
`ment, the media storage communication interface 40 is con(cid:173)
`figured to communicate with a standard wireless network
`such as a standard wireless home network. In one embodi-
`ment, the playback device interface 42 connects the playback
`unit 32 to the playback device 31 via a hardwired connection.
`Accordingly, the playback unit 32 may include RCA, SP/DIF
`audio outputs, or the like. In one embodiment, the playback
`device interface 42 includes a digital to analogue converter
`for converting digital media files (e.g., MP3, JPEG, WAY,
`AVI, or the like) received from the media content storage
`device 14 to a suitable form for playback on the playback
`device 31. The processor unit 50 is typically a microproces(cid:173)
`sor-based controller or the like to control operation of the
`playback unit 32. As described in more detail below, the
`remote control communication interface 38 is a bi-directional
`communication device to allow bi-directional communica(cid:173)
`tion between the remote control device 34 and the playback
`unit 32.
`The remote control device 34 includes a complemental
`remote control communication interface 52 to communicate
`in a bi-directional fashion with the remote control communi(cid:173)
`cation interface 38 of the playback unit 32. Further, the
`remote control device 34 includes a controller 54 (e.g. a
`30 microprocessor-based controller), the display screen 36 (e.g.,
`132x64-pixel LCD graphic display providing 5 lines of text
`display), and a user interface 56 (see also FIG. 6). The user
`interface 56 includes navigation buttons 58 as well as other
`functional buttons 60 to allow a user to select and play digital
`35 media stored on the media content storage device 14. The user
`interface 56 and the display screen 36 allow a user to browse
`(e.g., by artist, album, genre, all tracks, playlist or the like)
`and select media content stored on the media content storage
`device 14. In one embodiment, the remote control device 34
`40 includes a hand-held housing 35 which is shaped and dimen(cid:173)
`sioned to render the remote control device 34 portable.
`The remote control communication interfaces 38 and 52
`may be radio frequency interfaces, optical interfaces (e.g.
`infrared), or any other communication interface. For
`example, the communication interfaces 38, 52 may be low
`power devices having a range suitable for use within a domes-
`tic dwelling. The display screen 36 may be an LCD display or
`the like suitable for displaying data in the form of text to a user
`so that the user may select content for playback on the play(cid:173)
`back device 31. As described in more detail below, the display
`screen 36 may operate in conjunction with the user interface
`56 in a menu driven fashion so that media content available on
`the media content storage device 14 may be displayed to the
`user on the display screen 36 and, in response thereto, the user
`may then select one or more media files for playback on the
`playback device 31. Thus, unlike the prior art where the
`playback device 31 itself provides a display screen to display
`the media content available on the media content storage
`device 14 to the user, the remote control device 34, in accor(cid:173)
`dance with the present invention, includes the display screen
`36 for displaying media content to the user for selection.
`Referring in particular to FIG. 4, reference numeral 70
`generally indicates a method, in accordance with the inven(cid:173)
`tion, to display and control playback of digital media using a
`remote control device. The method 70 may be carried out on
`the exemplary remote control device 34. As shown at opera-
`tion 72, the remote control device 34 waits for user input via
`
`DISH, Exh. 1004, p. 19
`
`

`
`US 7,535,465 B2
`
`15
`
`5
`the user interface 56. When user activity or input is detected
`(see operation 74), the method 70 then identifies ifthe input
`from the user requires processing or if a message (e.g.,
`requesting media content data) must be sent to the playback
`unit 3 2 (see decision operation 7 6). If the input received from
`the user requires processing, then the method 70 processes the
`input or request (see operation 78) and, as shown at decision
`operation 80, decides whether or not the display screen 36 is
`to be updated (e.g., scroll through text available on the remote
`control device 34). If the display screen 36 does not require
`updating, then the method 70 returns to operation 72. If,
`however, the display screen 36 requires updating, then the
`method 70 updates the display screen 36 as shown at opera(cid:173)
`tion 82 and, thereafter, returns to operation 72 where it waits
`for further user input.
`Returning to decision operation 76, when the user input
`requires communication with the playback unit 32, the
`method 70 proceeds to operation 84 and sends a request or
`message to the playback unit 32 and awaits a return message
`as shown at operation 86. For example, when the remote
`control device 34 requests information from the media con(cid:173)
`tent storage device 14 (e.g. information on the content avail(cid:173)
`able for playback on the playback device 31), the playback
`unit 32 may then communicate a media data request to the
`media content storage device 14 via the local area network 20
`(see FIG. 2). In response to the media data request, the media
`content storage device 14 may then communicate content
`data to the playback unit 32 which, in turn, communicates the
`data to the remote control device 34 (see operation 86) for
`display on the display screen 36. As shown at decision opera- 30
`tion 88, the method 70 may identify whether or not further
`information or data is required from the playback unit 32
`(and/or media content storage device 14) and, if so, the
`method 70 returns to operation 84. If, however, no further
`information or data is required from the playback unit 32, 35
`then the method 70 proceeds to operation 78 where the data is
`processed.
`Referring in particular to FIG. 5, reference numeral 90
`generally indicates a method, in accordance to the invention,
`to control playback of media data using a playback unit. The 40
`method 90 may be carried out on the playback unit 32. As
`shown at operation 92, the playback unit 32 may await a
`message or data request from the remote control device 34.
`When a message or data request is received from the remote
`control device 34 (see operation 94), then a decision is made 45
`at decision operation 96 as to whether or not the playback unit
`32 can process the request or whether the request should be
`communicated to the media content storage device 14. The
`media content storage device 14 may act as a server that
`provides the digital media to any one or more playback units 50
`32.
`Returning to operation 96, if the playback unit 32 can
`process the message or data request received from the remote
`control unit 34, then, as shown at operation 98, the playback
`unit 32 processes the message. As shown at decision opera(cid:173)
`tion 100, a determination is then made as to whether or not the
`remote control device 34 (e.g., its display screen 36) requires
`updating. If the remote control device 34 requires updating,
`then as shown at operation 102, appropriate data is commu(cid:173)
`nicated by way of, for example, a message to the remote
`control device 34 and, thereafter, the method 90 returns to
`operation 92 where it waits for further user input. If, however,
`no updating of the remote control device 34 is required, then,
`as shown at decision operation 104, a determination is made
`as to whether or not data is to be communicated from the
`playback unit 32 to the reproduction or playbac