as) United States
`a2) Patent Application Publication (10) Pub. No.: US 2004/0268451 Al
`(43) Pub. Date: Dec. 30, 2004
`
`Robbin et al.
`
`US 20040268451A1
`
`(54) GRAPHICAL USER INTERFACE FOR
`BROWSING, SEARCHING AND
`PRESENTING MEDIA ITEMS
`
`(75)
`
`Inventors: Jeffrey L. Robbin, Los Altos, CA (US);
`David Heller, San Jose, CA (US);
`Peter K. Wagner, Redwood City, CA
`(US); Mike Wiese, Cupertino, CA (US)
`
`(60) Provisional application No. 60/465,410, filed on Apr.
`25, 2003. Provisional application No. 60/534,555,
`filed on Jan. 5, 2004.
`
`Publication Classification
`
`Ente C07 caccccsscsssssssssnsssssesnstsnssnsssevee G09G 5/00
`(SL)
`(52) US. Ch.
`cescsscssssssssstsnssesietistnntsnssstve 999/999,999
`
`Correspondence Address:
`BEYER WEAVER & THOMAS LLP
`P.O. BOX 778
`
`BERKELEY, CA 94704-0778 (US)
`
`(73) Assignee: Apple Computer, Inc.
`
`(21) Appl. No.:
`
`10/832,984
`
`(22)
`
`Filed:
`
`Apr. 26, 2004
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 10/776,652,
`filed on Feb. 10, 2004, now abandoned.
`
`(57)
`
`ABSTRACT
`
`Improved graphical user interfaces suitable for reviewing,
`browsing, previewing and/or purchasing media items are
`also disclosed. The graphical user interfaces are suitable for
`reviewing or browsing numerous media items. The graphi-
`cal user interfaces are also suitable for previewing or pur-
`chasing media items in an on-line manner. The graphical
`user interfaces are particularly useful for a system that
`provides purchase and distribution of media in a client-
`server environment.
`
`”\,
`
`
`
`
`. MEDIA
`
`COMMERCE
`SERVER
`
`
`
`
`MEDIA
`
`
`STORAGE
`102
`SERVER
`
`
`
`
`DATA
`NETWORK
`
`104
`
`108
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 1
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 1
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 1 of 26
`
`US 2004/0268451 Al
`
` we
`
`aE
`
`Q iv
`<
`
` .
`
`108
`
`=
`.
`
`O L
`
`L
`
`N
`-
`-
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 2
`
`COMMERCE
`
`SERVER
`
`MEDIA
`
`oO
`-
`-
`
`2O
`
`o-
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 2
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 2 of 26
`
`US 2004/0268451 Al
`
`J 200
`
`206
` WARNING
`ENABLED
`
`?
`DISPLAY WARNING
`DIALOG
`
`208
`
`222
`
`OBTAIN MEDIA ACCESS
`INFORMATION
`
`
`
`
`NO
`
`AUTH.
`REQUEST
`?
`
`216
`Yes
`ENTER AUTH.INFO.
`
`2
`
`
`
`YES
`
`NO
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 3
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 3
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 3 of 26
`
`US 2004/0268451 Al
`
`
`
`230
`
`DISPLAY UNAUTHORIZED
`MESSAGE
`
`
`
`MEDIA FILE FOR THE CEND)232
`
`RECEIVE ENCRYPTED
`
` SELECTED MEDIA ITEM
`
`
`
`STORE THE ENCRYPTED MEDIA
`ITEM TO CLIENT STORAGE
`
`SEND A COMPLETE NOTIFICATION
`
`FIG. 2B
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 4
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 4
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 4 of 26
`
`US 2004/0268451 Al
`
`300
`
`YES
`
`IDENTIFY ACCOUNTIDENTIFIER
`- FROM THE BUY REQUEST
`
`304
`
`
`
`306
`Is
`
`
`AUTH.
`REQUIREDa BUY
`REQUEST AUTHENTICATION
`
`
`
`?
`
`
`
`316
`
`INITIATE PAYMENT FOR
`THE SELECTED MEDIA ITEM
`
`
`
`
`OBTAIN MEDIA ACCESS
`INFORMATION
`
`
`SEND MEDIA ACCESS
`
`SEND UNAUTHORIZED
`INFORMATION
`USER CANNOT BUY
`
`
`MESSAGE
`
`
`MARK TRANSACTION
`
`AS "OPEN"
`
`
`
`314
`
`FIG. 3
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 5
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 5
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 5 of 26
`
`US 2004/0268451 Al
`
`402
`
`
`RECEIVE
`COMPLETE
`
`
`
`NOTIFICATION
`“y5
`
`
`? IDENTIFY CORRESPONDING
`
`404
`
` 406
` CLOSE THE IDENTIFIED
`
`
`
`"OPEN" TRANSACTION
`
`"OPEN" TRANSACTION
`
`FIG. 4
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 6
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 6
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 6 of 26
`
`US 2004/0268451 Al
`
`re
`
`Cornet)
`
`502
`IS
`
`
`THERE
`
`504
`AN OPEN
`
`PURCHASE
`CONTAINER
`
`OPEN PURCHASE
`
`CONTAINER
`
`
`
`506
`
`ADD THE SELECTED MEDIA ITEM
`TO THE PURCHASE CONTAINER
`
`
` HAS
`508
`
`
`PURCHASE
`
`DEFERAL
`
`LIMIT
`BEEN
`REACHED
`2.
`
`
`CLOSE PURCHASE CONTAINER
`
`
`
`CAUSE PAYMENT TRANSACTION
`TO OCCUR FOR COMBINED
`
`
`PURCHASE
`
`
`
`510
`
`512
`
`FIG. 5A
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 7
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 7
`
`

`

`<eiiiigSKCee,SS
`
`MOA1194PITOD§ELLWELT:arsniy22015iyEBFULLUEPUETSAOL
`
`UT]U}PURIS10Mt|*6u0spoo
`
`
`g2Oaiddy5)apsnwysewou,Eyageproegy
`
`
`MNUDHEqay
`
`AvyseGas
`
`wnty
`
`oqaBuodsfyway;ssaunrisuonewEp
`
`
`
`
`
`ypuswoogs,xeyy(ER
`
`
`
`oyinwyearsauap,Zp
`
`
`
`
`
`aSeydaNnganeremDySN¥gPaseysngfqA103Si#§
`
`
`
`
`
`
`
`
`
`aseyng159127asnwpareysZa
`
`
`
`Patent Application Publication Dec. 30,2004 Sheet 7 of 26
`
`US 2004/0268451 A1
`
`aor
`
`
`
`wond2UUE>aNI2¢&
`
`
`
`PyPOTOTEEO/e7/E0Fata
`
`
`
`COLEWBIPIO
`
`
`
`96°ESfeI0l1gAs
`
`wig
`
`Popenumog
`
`66°05
`
`
`
`WYOO:TTEO/CZ/E0
`
`66'05
`
`WYTOE£0/22/60
`
`66'°0$
`
`WY€0:1T£0fzz/E0
`
`66'0S
`
`
`
`WYSO-TTEO/ZZ/E0
`
`
`
`
`
`PESOSApaicwpsa)cep
`
`
`
`QSvsAparevysappers,
`
`
`
`
`
`WUNVIWCqay
`
`aHUDyyEqay
`
`|on
`
`uyvnosF}
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 8
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 8
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 8 of 26
`
`US 2004/0268451 Al
`
`SL 600 602
`
`
`
`ACCESS
`REQUEST
`?
`
` RECEIVE
`
`
`
`
`
`
`YES
`
`AUTHENTICATE THE ACCESS
`
`REQUEST RETURN ACCESS
`
`DENIED INDICATION
`
`
`RETRIEVE AN ENCRYPTED
`
`
`_VERSION OF THE SELECTED
` 610
`
`MEDIA ITEM BEING
`PURCHASED
`
`
`SEND THE ENCRYPTED
`
`
`VERSION OF THE SELECTED
`MEDIA ITEM TO THE
`REQUESTOR(CLIENT)
`
`
` 612
`
`
`FIG. 6
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 9
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 9
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 9 of 26
`
`US 2004/0268451 Al
`
`JS 700
`
`FIG. 7A
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 10
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 10
`
`

`

`pee
`
`!©Anuno>io?CEC|{©__Anunoy
`SoSeuare
`:@
`
` Anuno>|@Anune>}@Anuno)-@Anuno?©Anuno)©Anuno>1®
`purAwpeay|@punyAWpray©punnAWpeay|@Brnaceede
`
` PUINAWPEIY'@purwAwpeay|@BurnAWpray*@)
`PunAWpeasy|©PUIWAWPEIy©
`SNESAteeeLae
`2uUgHEGay,£75
`2212039W¥2gay{PO!P
`
`
`BsUZIWGRY,ETb
`aunugowgayigT:¢
`SUZeQay:S2£
`snugbqay25'€
`WRUDWCQay|HE-¢
`
`WRU_QIWegqay:IS€
`PunAwpeoy|:pooaWEAOAIHUGuyyrAsaag NOAHALPINODFEYYIM|wyywosraeeCOEeeee420yie]
`
` nspuy|UYOrSeDUIENSIHSNUIYLL2YS
`NOA9gCUURAS.UPiNOM||aaunyAjauo]¥SEMeaHUL:
`
`-
`sBuos
`
`
`
` awenGuos|ddSsiWvgaoaaBuedsassauypis
`‘dySNpyBO:
`
`iisincecasIRISISIE,ea
`
`
`
`d1sMyypaseyrind[y]
`
`B@O»—&)©©|
`
`
`
`Patent Appl
`
`Icat
`
`ion
`
`Publ
`
`icat
`
`ion
`
`Dec. 30
`
`’
`
`2004 Sheet 10 of 26
`
`US 2004/0268451 A1
`
`_—wL~*‘spraydon
`
`C271s6u0sdoy
`
`
`
`HAUTy5)uray941OLSE“AOA99EVENAUBINOMT|aunUypues:
`
`CohlAVEDea
`SPS+aaono7neath
`as“VLpino>ftyeusySAI
`£doyy|oTOWENStHSHUIULYS.|
`
`"comaevos
`
`
`|emo6'0s
`|9EL;
`
`OVIAOTHOAHLL
`
`
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 11
`
`uonoyy(A)
`
`
`
`
`
`pearsNsw,5,xeWy@,21snuz1uOp,&isnpareysTha
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 11
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 11 of 26
`
`US 2004/0268451 Al
`
`Comer
`
`DISPLAY SEARCH DIALOG BOX
`
`802
`
`ENTER SEARCH CRITERIA
`
`804
`
`?
`
`PERFORM
`SEARCH
`
`
`
` NO
`
`YES
`
`808
`
`SEND SEARCH REQUESTTO MEDIA SERVER
`
`810
`
`.
`
`RESPONSE
`
`RECEIVED
`?
`
`YES
`
`“yp
`
`RENDERFIRST WINDOW WITH ALBUM
`RELATED INFORMATION
`
`812
`
`
`
`RENDER SECOND WINDOW WITH MEDIA
`ITEM INFORMATION CORRESPONDING
`TO THE ALBUM RELATED INFORMATION
`
` 814
`
`FIG. 8
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 12
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 12
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 12 of 26
`
`US 2004/0268451 Al
`
`
`
`
`902
`
` BUY
`
`
`SELECTION
`?
`
` MEDIA
`
`PURCHASE
`
`PROCESSING
`906
`
` PREVIEW
`
` SELECTION
`
`REQUEST PREVIEW STREAM
`FOR SELECTED MEDIA ITEM
`
`
`FROM MEDIA SERVER
`
`
`
`914
`PLAY PREVIEW STREAM
`
`
`OTHER
`PROCESSING
`
`
`910°
`
`FIG. 9
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 13
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 13
`
`

`

`Patent Application Publication Dec. 30, 2004 Sheet 13 of 26
`
`US 2004/0268451 Al
`
`1000
`
`Lf
`
`1012
`
`Item 2
`Item 3
`
`Item 4
`
`Item 5
`
`FIG. 10
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 14
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 14
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 14 of 26
`
`US 2004/0268451 A1
`
`AOU]
`
`
`
`t
`
`paseyaung&Cesaretiareed aisnwy
`
`Ie
`JISS,URPHND
`uayodsPpsx00g
`yearsyuop,(EyHSWOOR$,xeW®girisnu
`
`
`
`2IsnWy
`
`paseys(EQal
`
`
`
`VLEOld
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 15
`
`aaneusaiy1B
`
`sanig
`
`feo1sse1D
`
`
`
`nNYesDpIA
`
`aoueg
`
`Anuno>
`
`
`
`qogabuads®ssauyoisuonow[f}
`
`Gey/dondiy
`
`DISNY24015{fyRj
`
`404
`
`g}D)250sewousBY
`
`awenyGuo
`
`jeuonridsu)
`
`ARpIOH
`
`
`
`s6uospoo)ml
`
`ayynosFi
`
`poy[Fi]
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 15
`
`

`

`s,xewEQ
`
`
`
`dey/dondin
`
`215NYy pooy&DSN20I5[Tv&4/2)
`
`
`sBuos
`
`yuoNDa;3
`
`aourg
`
`|
`
`
`
`Patent Application Publication Dec. 30,2004 Sheet 15 of 26
`
`US 2004/0268451 A1
`
`OZLL
`
`2DBj9S
`
`ISH
`
`+
`
`|pelenisinveg|66esgAyia
`
`Stusep{uotauungAon
`
`SHAagongBy,PuyyByaypay
`
`
`
`Gupeyquay
`
`BsUZWEQaY|
`
`|
`
`atl‘Sid
`
`wanswoog ,SewouLQaqogaGuodsQSSaUNISUONOW&1G)
`
`mj94
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 16
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 16
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 16 of 26
`
`US 2004/0268451 A1
`
`
`
`4
`
`paseyoung&
`
`|@Cri66°05©||EMDsvos|
`
`||@SROSARS)660s
`
`Ajuno)|@Anuna-@Anuno>|@~
`Anuno>@~
`Anuno>&
`Anuno>|@)
`“YDJOGujweaig|©“YD40Guweag©"YD40Guweasg|©“WDJOBuyweag'©YD40Gusweasg|©“YD30Bulweaig©
`
`ANYUEAIg|15.2
`yumuedg|6z:t
`
`DNYANURANg|ED:E
`anuwedsg|Z0:F
`
`ayaUeAIg|£E:7
`OUYANUeAUg|$7:
`
`uUMOLOfBujWo>5}sNe{DeIUeS|SEUNSUY
`SEWISHYD104BWOH39IL|
`
`ILL,WEARIUCD|uuyARpioH
`PUCPOPUDA\JaIUEA,
`
` ‘4PIS145158DUO|
`
`iE awenGuos feuonesydsu;7AepiioH
`
`.
`
`
`sBuospoopFal
`
`
`
`Olt‘Sls
`
`
`
`rb}
`
`
`
`SHAGangTYEPuyYbyAaq[ay
`
`
`
`aaua2aeqay
`
`uRyI0>EUY
`
`66e8ATE
`
`uungAoW
`
`sueyjuot
`
`
`
`Gupeyyyay
`
`2Ju0uDaIZ
`
`senig
`
` er1sser|DIS5,uasp}yD
`
`uayods954009Ig
`
`
`
`poseys(EY yonswoog5,xew®a1SnWW
`DISK
`
`dey/doyydiH1
`
`
`DSM)34096ITYBi]
`
`4105
`
`Bj)asnwsewou,(yqogeBueds@ssauxais
`uonow(EyB]
`
`ays[F]
`
`poyHF]
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 17
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 17
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 17 of 26
`
`US 2004/0268451 Al
`
`CSTART J 1200
`
`DISPLAY BROWSE WINDOW WITH}_4904
`LIST OF SELECTABLE GENRE
`
`HIGHLIGHT SELECTED GENRE
`
`1204
`
`
`
`REQUEST AVAILABLE ARTISTS WITHIN
`THE SELECTED GENRE FROM MEDIA
`SERVER
`
`
`DISPLAY LIST OF SELECTABLE ARTISTS
`
`WITHIN THE SELECTED GENRE
`1210
`
`(¢)
`
`FIG. 12A
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 18
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 18
`
`

`

`Patent Application Publication Dec. 30, 2004 Sheet 18 of 26
`
`US 2004/0268451 Al
`
`HIGHLIGHT SELECTED ARTIST
`
`REQUEST AVAILABLE ALBUMS
`FOR THE SELECTED ARTIST
`FROM MEDIA SERVER
`
`DISPLAY LIST OF SELECTABLE
`ALBUMSFORTHE SELECTEDARTIST
`
`REQUEST MEDIA ITEMS ON THE
`SELECTED ALBUM FROM MEDIA
`SERVER
`
`TO THE SELECTED ALBUM
`
`DISPLAY MEDIA ITEM WINDOW WITH
`MEDIA ITEM INFORMATION CORRESPONDING
`
`FIG. 12B
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 19
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 19
`
`

`

`
`CRT)6605|SONOS
`ETT6605
`AREZ)&6'OS
`
`m2]CANE2)
`
` dog”“osapareiyeAueg/9°Goo
`
` |dogosen/xiAuea|dog>onanismAue|Odog'o‘“osam/xingAte© “-osonixinsve’|Q“os
`
`
`
`dog1~osapeixiyyAueg
`dogQ“osaye/xiypAueg|
`dog0““osape/xipyAtty:
`
`dogG‘osape/xipyAtiey
`99€}voe
`ope/xiyyAueg|“osapnsxineAurea|‘OcorenovAueg|eMSeas
`USOT4)
`S2$-9MUL“ZUS
`525-8ML|voy
`75-8TUL|80'9
`SZS-BPULSOS
`S%S-9BL202
`S%S-9ULOEE
`SUS-9FULESE
`25-894195:2
`$25-8ML|vOE
`$25-8MLOTP
`S768UL1EEE
`STS-OMLOES
`
`Speypayeuaieg
`VelSls
`
`epUecarqueg
`
`purnansesqueg
`
`een
`
`
`
`
`
`
`
` sHHD75|Putlovyh3eet2u2Souta|
`
`Patent Application Publication Dec. 30,2004 Sheet 19 of 26
`
`US 2004/0268451 A1
`
`1
`
`L
`
`eres|podcidwon$2dor(Fl
`
`
`;wraspenpagnun[Fj
`
`
`
`AnuarayByspunog70inoAurey|pairydoyAw[6]
`
`pakeyg
`
`
`
`Bovdaup)ssnsews,Op
`
`wangsngaidsoa.Gp
`
`aise£09By
`
`
`
`G09aBueds(Cp
`
`og1uayisEp
`
`
`*OPSWOO"™
`
`6.xeyy@iwegppomFsanerown[Z}
`
`1yGinearesaipouy©asmpaseynng
`fF]
`
`
`
`asenyparesZa|
`
`
`
`
`
`auayj)0asposauous[Zp
`
`
`SLE!
`
` ‘Ne|Png9u3UF|we)BSequen9yiULEPARUMONEE«aytD|RyWwRQOdoOTayy
`
`|
`
`
`
` daysdaagipuryeaor
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 20
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 20
`
`

`

`
`
`ore=uayGnegoymsauansT=
`
`AqsirniuGuyseyrundAqaunyeay.”
`
`SHIAOFDINQIVOD03MEYDENDg:
`
`
`dog|CSNOTRATS)66"OSMnAUES©szs-8aul|
`
`
`
`GogCSNGEIART)GG'OS.“MENAMRSZ5-094|
`dog|CSSRAEN)66°0S|“XENAUE|&ses-9aus|
`
`
`dogcoomwhooREAAue|Leeau
`GGOS|“xnAug|¢>t7S-92dog|COMOyane)660$;~“xHGAureaoe525-9FUL
`dog|Coxaeina)
`dog|GETAED
`CSNGeARE66"OS|7xAueg|©s%s-9au
`GBKGSTRE™66'OS|“MEWAEGOSZ$-9Fay
`
`ae)
`
` 2BYU)SBOgWELLMOUgONGOUDEEGs|
`GEO«“REAudO575-9FUL
`spunogJoNOAurea“p:UaeAnogOnnse
`“armAuta|&t2$-87townAuraGO525-89qL|
`“ngAueYdrc$2S5-8FUL
`
`:"euerodosow/xinAurd
`
`
`e:$Z5-9FY€
`asspdoy166T@!
`
`,BD9ylUyagWRU,Ou,|
`
` suazs|punozyssapySiuaueg|
`eARy|UrANU190999890D|
`o1eaug|Spunog51n9Auta| Cyepr
`pngaynuy1dA|ayeD
`
`RnaeEdosayy
`63915daz0
`asm5,09B]Bi
`
`
`ys20409)DesApesewouL@mois
`reneaidsourBb
`
`
`
`
`
`asnyypaseys(Qa
`
`Patent Application Publication Dec. 30,2004 Sheet 20 of 26
`
`US 2004/0268451 A1
`
`J0999000000000
`—
`
`“guesia
`
`wyineq
`
`VSeh
`
`sounge:
`
`dea|
`
`
`
`boy‘2S
`
`“20%
`
`80:9
`
`9S:
`
`oO'8
`
`SOS
`
`DEE
`
`Is€
`
`SES
`
`c9El
`
`Or
`
`LEE
`
`|||||
`
`jzrjez
`
`;21OE
`
`jtUOe
`i295izUjes
`fraon
`iT§OU
`[TIOt
`
`Petgog
`i218
`tpt
`LTgOE
`
`22TOTL
`[ztjoot,296
`uel
`“TI8t
`TIOE
`
`[eTj07
`|||tolryor
`
`delSls
`
`1BINa7saypouy
`
`
`
`DISKpeseyqungtdCreetLioN
`
`5,xeyy@reTEpHOM9psusesoUN[Ey
`A2YSUIODG
`
`
`
`
`
`asayJjmssPoodasous[Zp
`
`
`
`Gogabuods(7)
`
`pattysoy§Zdoyey
`
`
`
`preigAnuaray&parrydonAw
`
`qogwaysEy
`
`PETAR
`
`
`
`asipeydpagumEF]
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 21
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 21
`
`
`
`

`

`
`
`
`
`
`
`CRESTED660s[iz0CFE66OSOPE
`
`UDITEScy](aie)
`
`
`.:av.:feos240)SgNSDY
`
`
`
`OS|DSte|esto
`20%|bore
`{$35
`[tee
`9UE
`sue
`||||
` eu|eu!@cu1GeumGew16mma.©xa|@1G'ntays001g|@
`
`GOOCHACECHOGOCOSGOOGOOCOOS
`rus|@rus
`cue&eur|cunt
`run©wn|OwaOSwld
`tun@tut|cue Geu|gy
`
`
`
`dey/dopyday|Gy"vorssasdegyearnou‘fiaaa]
`
`
`Seu/dorydag1°VLE[ssa20n8puoweg.
`dey/doycryQx30"
`dey/dondi|dey/dondH
`seyisonoH|Gdeu/doncn
`eysdoycit|OeycoryaH+&dey/doudi|dey/doydH|&dey/dondH|deyidondH
`
` deyfdasdiy|‘9deysdondiaeoarysdondH,&aeyfdoudin|&deu/dondideyidondi|©aeysdoydin
`|G
`GO}ss2Id9Q3999YL‘0LVL
`
`
`
`tavapuowed'POP]
`
`
`puowtia”S39HgPUOWIC‘S0rL
`
`sse2u}gpuoweg|fEorea}
`
`SsaoupagpuOWe|G|mea]
`$3330
`SIFYPUAWRIG|,
`
`sse2uudpuoweig:
`
`
`SsaWwildpuowTig.
`
`Ssariigpuowerg:
`s4d9ufyPuowrig|
`
`
`$sd9uLgPUOWEQ|
`Ssepuowrig
`
`
`STMAULiyPUWEY
`
`ssaougpuowrig*
`
`ssaIvygpuowrig-
`
`ss99uIlapUOWTIC
`
`sta2uugpuqweg
`£00MMOH|RIOELLEN|OLPLsenueaon
`ateICLPUY|HVADIOL
`BOUMIUIOS-OF1U]|iaonCups
`
`BOWWOS-Os3u}”
`
`Aavoyts1y119
`oNrun|BuUuaepeHOS}
`UaondAseN
`
`
`aspapddys>)aisneysewourGh
`
`MondISN22005BUI[Eh
`
`paeng1s0rySzdoy[Sy
`
`Patent Application Publication Dec. 30,2004 Sheet 21 of 26
`
`US 2004/0268451 A1
`
`‘osfete
`
`£08
`
`PER|Asit
`
`tue|Bez
`
`Osis|ote‘60:E|6UE
`
`xOOT
`
`
`
`Supsny
`
`lz-zoybbunsdon
`
`
`“pegtryspuymey
`:arousesORO
`
`“apneFNLID
`
`“arouuas-O7u]
`~UnasQArey
`
`
`“UNSpassng.|
`SeputgON
`
`.“gori"ipodox
`
`waa
`
`~onND>daveWEATIOAOC
`auouswOS
`
`MTSoypey*
`
`ppuey
`
`xoot'
`
`Z0pbsuadou|
`2150pareypindwffP
`
`
`
`
`
`TEINae]ayoary
`
`
`
`aisnypoveusha
`
`SxeyyQdeagppom9sunescusg[Ey
`WHSWOOE
`
`
`
`
`
`aa3qjyMaspooGwowEy
`
`gog1a}95{Cy
`
`
`
`G09a6ucds(Fh
`
`
`
`
`
`aismy5,970(EY
`
`
`
`Guinsay»
`
`ASparsing+
`
`Gyws
`
`eR-
`
`paleAwarayicpartydorAn
`
`
`
`Isepaymun(FF)
`
`
`
`aon.09
`
`i2.oes)CDees|ste
`
`CETTE66°05|os:z
`
`
`
`CORSE6HOS|75:0
`
`mLIe
`desdonedna1g
`dryfdondi
`
`
`
`puowelg|Genea)ssaoupypuoweg’(iase}ssaraqig
`
`VelSls
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 22
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 22
`
`
`

`

`US 2004/0268451 A1
`
`“O9bL..Ne
`
`
`
`0°
`
`poo
`
`oco000000000
`
`Patent Application Publication Dec. 30,2004 Sheet 22 of 26
`
`ai
`
`
`
`SurseupindAgainaeyy.nase‘:sayyw_isgueFAeneMAAPs-o'9,Qwk!YBNa1e7sainouy&sryAqoetiwpaseyungERSyOv“"CSPLvs
`
`
`
`
`anquiuoDOFisi341.98ee.:pres||olpey&,
`
`
`1330005|magnoneae2a=aaaaaa_=90ga6u0ds
`
`
`aisniy§“OHGH|CSRESTED66°05|DAL|S[ets0ziaans(oops|ésin5.09
`
`
`
`
`
`
`"OHGI:aS)6E'0S|TIEDALG‘9g:ig|222/G0p)215Asewous[Cp
`"Ondip||CSTD66°03EMDALeeLEIOEOreos
`
`
`GE'STIEDALNWOPED|LATOST|PULIG2gAINODNAA|ondin'€:"eMLOMNOaAbag t“OHCiH|CENTERED66°0$|RADIW,OMNOSS9TLUOLT‘aaaOsano,20)TINGY|“OHIH|CARREGEOTEDULOxWo|wrctorGasaAlaU.|OHCI.CENTAGE
`
`
`
`
`“RUDMLOUSTMNOCED=etOEBuppogywswage|OnnH|CEMED6605IED@ xNOlore|ztseorROASSI|“OnCIM>66°F
`
`
`
`
`
`
`
`
`
`
`
`
`“OHO}PZ0LLU}OBT=115)RCONIMS|"0HiH|CSREESE60IDAWXWO-£0°5ews:GERADEoseNO=xWalIzo|=[ctor||GanaatyortGueg081s)onne|“OHOMCONOTARE™)66°0$““TEUHaUEODXWOSzpLLESOTE¢THaaquinn|
`“SNOTToaaU:[21400
`.ee,2rianpreysQa
`IHLAartLETges970H1YGneaM:"OS:IMDaL©xnOTzeretsog£uaqweg|,IRDULMNO2TSato:quungepreyAUOYS|reputGNO|St7et09woutvyDUNDOOE|:7ea09
`
`
`
`
`FOnwend|pareydo,Avy[Gl]
`:padergAiwaray[8]
`
`
`i
`
`i‘'
`
`1
`
`S0rL
`
`avL
`‘Sls
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 23
`
`WIgHLOM>suNesOWNGoOamy5,909Gy
`
`sayprispooGaiow(Ey
`
`
`
`wnswoogsxew(Z)
`
`qogwarsDy
`
`Aan(g
`
`
`
`pahejdssoye$2deyB]
`
`
`
`asyeydpajyiun[F}
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 23
`
`
`

`

`Patent Application Publication Dec. 30, 2004 Sheet 23 of 26
`
`US 2004/0268451 Al
`
`1500
`
`||_|
`
`ITEM 1
`
`ITEM 2
`
`ITEM 3
`
`1504-3
`
`1506
`
`1504-1
`
`1504-2
`
`FIG. 15A
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 24
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 24
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 24 of 26
`
`US 2004/0268451 Al
`
`1526
`
`1522
`
`FIG. 15B
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 25
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 25
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 25 of 26
`
`US 2004/0268451 A1
`
`OSS}
`
`nsepareysea
`
`
`
`“ShCUNO,SULID1Sdeyons,
`
`BOpea,SEY,
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 26
`
`pisawpeasvop,Zp
`
`
`
`apnsuicogsmernyZR
`
`
`
`qngaGueds&ssauynsuoponyFy
`
`
`
`Faisnyysewou(Ey
`
`
`
`apsnyga0rslvEY
`
`
`
`sfluospoor[8]
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 26
`
`

`

`Patent Application Publication Dec. 30,2004 Sheet 26 of 26
`
`US 2004/0268451 A1
`
` YES
`
`DISPLAY THE BASE PAGE
`
`
`
`
`
`NEXT
`CONTROL
`
`SELECTION
`
`
`
`?
`
`
`PREVIEW
`
`REQUEST
`
` REQUEST NEXT SET OF
`
`MEDIA DATA FOR
`
`ASSOCIATED SUB-WINDOW
`
`
`
`
`PRESENT THE NEXT
`SET OF MEDIA DATA
`
`
` YES
`IN THE ASSOCIATED
`
`
`SUB-WINDOW
` PRESENT THE PREVIEW
`
`
`
`CONTENT
`
`FIG. 16
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 27
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 27
`
`

`

`US 2004/0268451 Al
`
`Dec. 30, 2004
`
`GRAPHICAL USER INTERFACE FOR BROWSING,
`SEARCHING AND PRESENTING MEDIA ITEMS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application is a Continuation-In-Part of U.S.
`patent application Ser. No. 10/776,652,filed Feb. 10, 2004,
`and entitled “GRAPHICAL USER INTERFACE FOR
`BROWSING, SEARCHING AND PRESENTING MEDIA
`ITEMS”, which is hereby incorporated by reference herein,
`and which claimsthe benefit of: (i) U.S. Provisional Patent
`Application No. 60/465,410,filed Apr. 25, 2003, and entitled
`“METHOD AND SYSTEM FOR SECURE NETWORK-
`
`BASED DISTRIBUTION OF MEDIA”, which is hereby
`incorporated by reference herein; and (ii) U.S. Provisional
`Patent Application No. 60/534,555, filed Jan. 5, 2004, and
`entitled “GRAPHICAL USER INTERFACE FOR BROWS-
`ING, SEARCHING AND PRESENTING MEDIA ITEMS”,
`which is hereby incorporated by reference herein.
`
`In addition, this application claims priority benefit
`[0002]
`of: (i) U.S. Provisional Patent Application No. 60/465,410,
`filed Apr. 25, 2003, and entitled “METHOD AND SYSTEM
`FOR SECURE NETWORK-BASED DISTRIBUTION OF
`
`MEDIA”, whichis hereby incorporated by reference herein;
`and (ii) U.S. Provisional Patent Application No. 60/534,555,
`filed Jan. 5, 2004, and entitled “GRAPHICAL USER
`INTERFACE FOR BROWSING, SEARCHING AND PRE-
`SENTING MEDIAITEMS”, which is hereby incorporated
`by reference herein.
`
`[0003] This application is also related to: (i) U.S. patent
`application Ser. No.
`,
`filed concurrently, and
`entitled “METHOD AND SYSTEM FOR NETWORK-
`BASED PURCHASE ANDDISTRIBUTION OF MEDIA”,
`which is hereby incorporated by reference herein; and (ii)
`U.S. patent application Ser. No.
`, filed concur-
`rently, and entitled “METHOD AND SYSTEM FOR
`SECURE NETWORK-BASEDDISTRIBUTION OF CON-
`
`TENT”, which is hereby incorporated by reference herein.
`
`BACKGROUND OF THE INVENTION
`
`[0004]
`
`1. Field of the Invention
`
`[0005] The present invention relates to media purchase
`and distribution and, more particularly, to media purchase
`and distribution in a client-server environment.
`
`[0006]
`
`2. Description of the Related Art
`
`[0007] Traditionally, music has been purchased at music
`stores or music departments of larger stores. A consumer
`will visit
`the music store or department and manually
`browsefor albums or compactdiscs (CDs) ofinterest. Often,
`the music in the music store or departmentis categorized by
`genre, and then indexed byartist. For example, genre can
`include rock, country, pop, soul, jazz, etc. After the con-
`sumer selects an album or CD of interest, the consumer
`proceeds to a check-out register to pay for the album or CD
`being purchased.
`
`In recent years music delivery or distribution over
`[0008]
`the Internet has become popular. Due to the advances in
`efficient file formats, such as MP3 and MPEG4,the size of
`media files have become small enough to make their down-
`load via the Internet practical. Also, technological advances
`
`haveled to higher-speed Internet connections and lowercost
`of memory. The combination of these advances make down-
`loading mediafiles, such as for music and videos, manage-
`able and not too time consuming.
`
`[0009] One popular approach to music distribution was
`mp3.com which uses a centralized server for storage of the
`numerous songs that are available for download. Another
`popular approach to music distribution was Napster in which
`peer-to-peer sharing was utilized. With peer-to-peer sharing,
`the numeroussongsreside on the user machinesof the many
`users, not on a centralized server.
`
`[0010] However, unrestricted use and distribution of
`music files can lead to copyright violations. It is, therefore,
`desirable for companies to be endorsed by the music indus-
`try. However,
`to obtain endorsement, companies must
`charge users for access to the songs. Some companies charge
`a monthly subscription fee and permit subscribers to play
`songs by streaming such to the subscriber’s machine where
`the songs are played. Streaming does not store the music
`files on the subscriber’s machine, and thus is less of a
`concern for the music industry. However, such a system
`requires a network connection and network availability in
`order for subscribers to play songs.
`
`[0011] As a result, there is a need to permit songs to be
`purchased and then made available locally to purchasers so
`that the purchaser is not dependent and constrained by the
`availability of a network connection for playback of the
`songs. However, the music industry requires its songs be
`secured against unauthorized copying or other copyright
`violations. Thus, there is also the need to incorporate secu-
`rity measures to restrain the susceptibility to unauthorized
`use or distribution of the songs.
`
`SUMMARYOF THE INVENTION
`
`[0012] Broadly speaking, the invention relates a graphical
`user interface suitable for reviewing, browsing, previewing
`and/or purchasing media items. The graphical user interface
`can be presented to a userat a client (client machine). In one
`embodiment, the graphical user interface is presented to the
`user by an application program that runs on the client.
`
`[0013] The graphical user interface is also suitable for
`previewing or purchasing media items in an on-line manner.
`The graphical user interface can be presented to a user at a
`client (client machine). In one embodiment, the graphical
`user interface is presented to the user by an application
`program that runs on the client.
`
`[0014] The graphical user interface is particularly useful
`for a system that provides purchase and distribution of
`media in a client-server environment. The purchase and
`distribution of media can not only be secure but also
`controlled. The controlled distribution can use encryption
`and user accountsto not only restrict unauthorized access to
`the media but also to limit usage rights to the media by
`authorized users. The security restricts access to media
`within media files during downloads as well as while stored
`at a server and/or client. The graphical user interface can
`assist users in locating media to be purchased. The media
`can, for example, be audio, video, or image data.
`
`[0015] The invention can be implemented in numerous
`ways, including as a method, system, device, apparatus,
`SPACETIME3D
`EXHIBIT 2009 - PAGE 28
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 28
`
`

`

`US 2004/0268451 Al
`
`Dec. 30, 2004
`
`graphical user interface, or computer readable medium.
`Several embodiments of the invention are discussed below.
`
`Asa graphical user interface produced by an appli-
`[0016]
`cation program, one embodiment of the invention includes
`at least an application program window generated by the
`application program. The application program window con-
`currently includesat least a first sub-window and a second
`sub-window. The first sub-window displays first content in
`a network browser-like manner, and the second sub-window
`displays second content in an application-like manner. The
`first and second content are received by the application
`program from a remote server over the network.
`
`currently includes at least a sub-window and a next control.
`The sub-window displays media informationfora first set of
`media items. The media informationfor the first set of media
`items is received by the application program from a remote
`server over a network. When the next control is activated,
`the sub-window displays media information for a second set
`of media items. The media information for the second set of
`
`media items is also received by the application program
`from the remote server over the network.
`
`[0020] As a method for reviewing information on a plu-
`rality of media items, one embodiment of the invention
`includesat least the acts of: displaying a window having at
`least one sub-window and at least one next control, the at
`[0017] As a method for browsing through a plurality of
`least one sub-window displaying first media data pertaining
`media items, one embodimentof the invention includes at
`to a first set of the media items, the first media data being
`least the acts of: requesting first selectable items forafirst
`provided by a remote server; determining whether a user
`list from a remote server; displaying a browse window with
`selects the at least one next control; requesting next media
`the first list of the first selectable items; receivinga first user
`data pertaining to a next set of the media items from the
`selection of one of the first selectable items in the first list;
`remote server when it
`is determined that
`the user has
`distinctively displaying the one of the first selectable items
`in the first list that the user has selected; requesting second
`selectable items for a secondlist from the remote server, the
`second selectable items being dependent on the one of the
`first selectable itemsin thefirst list that the user has selected;
`displaying the browse window with thefirst list of the first
`selectable items and the secondlist of the second selectable
`
`selected the at least one next control; subsequently receiving
`the next media data pertaining to the next set of the media
`items; and displaying the next media data in the at least one
`sub-window of the window.
`
`[0021] Other aspects and advantages of the invention will
`become apparent from the following detailed description
`taken in conjunction with the accompanying drawings which
`illustrate, by way of example, the principles of the invention.
`
`items; receiving a second userselection of one of the second
`selectable items in the second list; distinctively displaying
`the one of the second selectable items in the second list that
`
`the user has selected; requesting third selectable items for a
`third list from the remote server, the third selectable items
`being dependent on the one of the second selectable items in
`the second list that the user has selected; and displaying the
`browse window withthe firstlist of the first selectable items,
`the second list of the second selectable items, and the third
`list of the third selectable items.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0022] The invention will be readily understood by the
`following detailed description in conjunction with the
`accompanying drawings, wherein like reference numerals
`designate like structural elements, and in which:
`
`[0023] FIG. 1 is a block diagram of a media purchase
`system according to one embodimentof the invention.
`
`[0024] FIGS. 2A and 2B are flow diagrams of media
`purchase processing according to one embodiment of the
`invention.
`
`[0025] FIG. 3 is flow diagram of media commerce pro-
`cessing according to one embodimentof the invention.
`
`[0026] FIG. 4 is a flow diagram of transaction completion
`processing according to one embodiment of the invention.
`
`[0027] FIG. 5A is a flow diagram of payment processing
`according to one embodimentof the invention.
`
`Asa graphical user interface produced by an appli-
`[0018]
`cation program, one embodiment of the invention includes
`at
`least a browse window generated by the application
`program. The browse window enables a user of the appli-
`cation program to browse through a plurality of media items.
`The browse window includes at least: a first list of first
`selectable items, with at least one of the first selectable items
`being capable of being selected by the user; a secondlist of
`second selectable items, with at least one of the second
`selectable items being capable of being selected by the user;
`and a third list of third selectable items, with at least one of
`the third selectable items being capable of being selected by
`the user. The second selectable items of the second list are
`dependent onafirst selection by the user of at least one of
`[0028] FIG. 5B is a screen shot of a representative appli-
`the first selectable items from thefirst list. The second listis
`cation program windowthat displays purchase history infor-
`displayed along with the first list after the user has selected
`mation corresponding to a user’s account.
`at least one ofthefirst selectable items from thefirst list. The
`
`third selectable items of the third list is dependent on a
`second selection by the user of at least one of the second
`selectable items from the second list, and the third list is
`displayed along with thefirst list and the secondlist after the
`user has selected at least one of the second selectable items
`from the secondlist.
`
`[0019] Asa graphical user interface produced by an appli-
`cation program, one embodiment of the invention includes
`at least an application program window generated by the
`application program. The application program window con-
`
`[0029] FIG. 6 is a flow diagram of media delivery pro-
`cessing according to one embodimentof the invention.
`
`[0030] FIG. 7A is a diagram of an application program
`window according to one embodimentof the invention.
`
`[0031] FIG. 7B is a screen shot of a representative appli-
`cation program window according to one embodimentof the
`invention.
`
`FIG.8 is a flow diagram of media search process-
`[0032]
`ing according to one embodimentof the invention.
`SPACETIME3D
`EXHIBIT 2009 - PAGE 29
`
`SPACETIME3D
`EXHIBIT 2009 - PAGE 29
`
`

`

`US 2004/0268451 Al
`
`Dec. 30, 2004
`
`[0033] FIG. 9 is a flow diagram of additional processing
`according to one embodimentof the invention.
`
`[0034] FIG. 10 is a diagram of an application program
`window according to one embodimentof the invention.
`
`[0035] FIGS. 11A-11C are screen shots illustrating suc-
`cessive views of a browse feature according to one embodi-
`mentof the invention.
`
`[0036] FIGS. 12A and 12Bare flow diagrams of media
`browse processing according to one embodiment of the
`invention.
`
`[0037] FIGS. 13A-13B are screen shots illustrating addi-
`tional features of a graphical user interface according to
`other embodiments of the invention.
`
`[0038] FIGS. 14A and 14Bare screen shots illustrating
`explicit content notification features according to one
`embodimentof the invention.
`
`[0039] FIG. 15A is a diagram of an application program
`window according to one embodimentof the invention.
`
`[0040] FIG. 15B is a diagram of a window according to
`one embodimentof the invention.
`
`[0041] FIG. 15C is a screen shot of an application pro-
`gram window according to one embodimentof the inven-
`tion.
`
`[0042] FIG. 16 is a flow diagram of media page process-
`ing according to one embodimentof the invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`[0043] The invention relates a graphical user interface
`suitable for reviewing, browsing, previewing and/or pur-
`chasing media items. The graphical user interface can be
`presented to a user at a client (client machine). In one
`embodiment, the graphical user interface is presented to the
`user by an application program that runs on the client.
`
`[0044] The graphical user interface is particularly useful
`for a system that provides purchase and distribution of
`media in a client-server environment. The purchase and
`distribution of media can not only be secure but also
`controlled. The controlled distribution can use encryption
`and user accounts to not only restrict unauthorized access to
`the media but also to limit usage rights to the media by
`authorized users. The security restricts access to media
`within media files during downloads as well as while stored
`at a server and/or client. The graphical user interface can
`assist users in locating media to be purchased. The media
`can, for example, be audio, video, or imagedata.
`
`[0045] Embodiments of various aspects of the invention
`are discussed below with reference to FIGS. 1-16. However,
`those skilled in the art will readily appreciate that
`the
`detailed description given herein with respect to these fig-
`ures is for explanatory purposes as the invention extends
`beyond these limited