1111111111111111 IIIIII IIIII 11111 1111111111 11111 111111111111111 lllll 111111111111111 11111111
`US 20080062141Al
`
`c19) United States
`c12) Patent Application Publication
`Chandhri
`
`c10) Pub. No.: US 2008/0062141 Al
`Mar. 13, 2008
`(43) Pub. Date:
`
`(54) MEDIA PLAYER WITH IMAGED BASED
`BROWSING
`
`(76)
`
`Inventor:
`
`Imran Chandhri, San Francisco,
`CA (US)
`
`Correspondence Address:
`TECHNOLOGY & INNOVATION LAW GROUP,
`PC
`ATTN: 101, 19200 STEVENS CREEK BLVD.,
`SUITE 240
`CUPERTINO, CA 95014
`
`(21) Appl. No.:
`
`11/767,409
`
`(22) Filed:
`
`Jun.22, 2007
`
`1000~
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/843,832, filed on Sep.
`11, 2006, provisional application No. 60/878,746,
`filed on Jan. 5, 2007.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`G06F 3/041
`(2006.01)
`(52) U.S. Cl. ....................................................... 345/173
`
`(57)
`
`ABSTRACT
`
`Methods and systems that improve the way media is played,
`sorted, modified, stored and cataloged on a portable media
`player are disclosed. One aspect relates to an image based
`browser that allows a user to navigate through and select
`images that are related to media items.
`
`STORE IMAGE DATA
`
`1002
`_)
`
`, '
`
`1004
`RECEIVE DISPLAY COMMAND _)
`
`~ '
`1006
`RETRIEVE DESIGNATED _)
`IMAGES
`
`~ '
`1008
`OUTPUT ONE OR MORE OF _)
`RETRIEVED IMAGES
`
`EX-1011
`Microsoft Inc. v. LiTL LLC
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 1 of 32
`
`US 2008/0062141 Al
`
`3
`
`llI] ....-----.-~ 6
`
`..---,.-..J.__..,, 8
`._ _______ ....
`
`FIG.1
`
`10~
`
`3
`
`6
`
`llI]
`
`MENU
`
`4
`
`16
`
`20 - - - - - - -1 < <
`
`>>_..f--1-----18
`
`14
`
`>II
`
`22
`
`FIG. 2
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 2 of 32
`
`US 2008/0062141 Al
`
`5
`
`21
`
`~
`
`23
`
`\
`
`I
`
`j
`
`I
`
`~--__., 4
`
`. .
`
`5
`
`5
`
`FIG. 3
`
`27
`
`5
`
`25
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 3 of 32
`
`US 2008/0062141 Al
`
`SPEAKER
`
`MEDIA
`CONTROLLER
`
`58A
`
`DISPLAY
`
`. 60
`
`MEDIA
`DATABASE
`64
`
`MEDIA FILES
`56
`
`FIG. 4
`
`80A\
`
`94
`'
`I
`
`94
`'
`
`92
`'
`I
`
`94
`'
`I
`
`94
`'
`I
`
`82
`
`FIG. 5
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 4 of 32
`
`US 2008/0062141 Al
`
`BOB\ 7 94 94 94
`
`92
`
`94 94 94 94
`
`I
`
`I
`
`82
`
`86 86 86 86
`
`86
`
`86 86 86
`
`!!§.
`
`i
`
`87
`
`I
`
`87
`
`BOC\
`
`FIG. 6
`
`949494
`I
`I
`I
`I
`
`I
`
`I
`
`86
`86
`86
`
`94
`
`92
`
`94
`
`949494
`
`I
`
`I
`
`82
`
`86
`
`.. ·.· .......... :-.• ..
`. .,_,_ --.....r,,-...,.r---.1
`:::1:::::::::1:::::::::::::::•:•:::::::::::::::::::::::•::::::::::::::::::::::::::::::
`I.--.'----,...-.,,..-..,..-; . . ·.-:-:-:.:-:-:-:.:-:.:-:-·-:-:-:.:-:.:-:.:-:-.::-,-·
`..........
`. . • . . . . . . .
`
`82
`
`FIG. 7
`
`92
`
`FIG. 8
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 5 of 32
`
`US 2008/0062141 Al
`
`100 \
`
`102
`
`PRESENT IMAGE BROWSER
`WINDOW
`
`PERFORM ACTION
`ASSOCIATED WITH-~
`IMAGE
`
`106
`
`110\
`
`Yes
`
`114
`
`TRANSITION THROUGH
`IMAGES IN
`ACCORDANCE WITH
`NAVIGATION COMMAND
`
`REMOVE IMAGE
`BASED
`BROWSER
`WINDOW
`
`FIG. 9
`
`

`

`Portable Media Player
`
`Music
`
`Extras
`Settings
`Shuffle Songs
`Now Playing
`I
`
`,
`
`121
`
`-V~,
`
`120
`~
`
`)
`>
`Album Art
`
`p...\'o\l('(\
`
`Playlists
`Artists
`Albums
`f'~.}.ltftim'JA'►fil
`-, • ,_
`-, ' rt%
`Genres
`Alburn
`Composers
`Album
`Audio books
`IA
`llllt>-~ I ~rt
`~ - - - - - . . - - -_ J ~ Album title 4
`::=:::: :(::/: :: :=;;~~:~:~~:s:~i: _S_o_n_g_n_a_m_e.:.....:.:.=..:1:.:..:..:....:::::~---__J
`
`122
`
`Artist name • Song name 2
`Song name 3
`4
`
`123
`
`Song name 6
`Song name 7
`
`Now Playing
`
`[I] Album title 4
`
`Art• t
`IS
`Song name 5
`
`124
`
`FIG. 10
`
`125
`
`(')
`
`~ .....
`
`""O
`~ .....
`('D = .....
`t "e -....
`.... 0 =
`""O = O" -....
`.... 0 =
`
`(')
`
`~ .....
`
`~
`~ :-: ....
`
`~
`
`~
`
`N
`0
`0
`QO
`
`('D
`('D
`
`rJJ =(cid:173)
`.....
`O'I
`0 ....
`
`~
`N
`
`c
`rJJ
`N
`0
`0
`
`0
`O'I
`
`.i;...
`
`QO ---0
`N ....
`....
`> ....
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 7 of 32
`
`US 2008/0062141 Al
`
`Portable Media Player
`
`130
`~
`
`Music
`Photos
`Videos
`Extras
`Settings
`Shuffle Songs
`Now Playing
`
`131
`
`>
`
`Videos
`
`>
`
`Video Settings
`
`Playlists
`Movies
`Music Videos
`TV Shows
`Video Pod cast • • .. • • • • • • • • •
`Vd S tt'
`............ .
`1 eo e in s Browse Mode
`
`>
`Browse Mode
`
`132
`
`List
`Ima e
`
`133
`
`Portable Media Player
`
`134
`
`Music
`Photos
`Videos
`Extras
`Settings
`
`Videos
`
`>
`Playlists
`>
`Movies
`Shuffle Songs i...;,M.:..;.u=.s:.:.ic=-.:;:..,Vc--id,.....e_o_s-r------;M:-;o-v-.ie~s-----i
`Now Playing TV Shows 1 - - - - - - - - - - - - - -1
`..__ __ )..-------1 Video Podcas r-r--i-r--_,....----,--1-il-nll
`Movie Movie
`(
`Video Setting!
`[ \']lo>Jie
`131
`Art
`
`Now Playing
`
`(
`132
`
`:•:::-·-:-:•:-·.· ...
`Movie
`
`MOVIE
`
`(
`135
`
`FIG. 11
`
`"-136
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 8 of 32
`
`US 2008/0062141 Al
`
`ADDRESS BOOK
`
`140
`
`..... ' ..... .
`
`•
`
`•
`
`•
`
`•
`
`•
`
`+ • • • •
`
`142
`
`FIG. 12A
`
`144
`
`ADDRESS BOOK
`
`140
`
`Joe Smith
`346 Emerald Ave
`Mesa, AZ. 94037
`602-345-9876
`
`. . . . . . . . . .
`........ ' ...
`
`146
`
`FIG. 128
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 9 of 32
`
`US 2008/0062141 Al
`
`150
`
`APPLICATIONS
`
`WORD
`PROCESSING
`
`ABC
`
`... ' ....... .
`. . . . . . . . . .
`
`152
`
`FIG. 13
`
`170
`~
`
`PHOTOS
`
`0
`
`:·:·: :·:·:·:·:·
`
`...
`. . . . . . . . . . . . . .
`. -~~~~i~~~~i~~~~i~~~::~:~~~~!~i~:~::::::::::::::::::::
`.............
`. . . . . . . . . . . .
`
`172
`
`FIG. 15
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 10 of 32 US 2008/0062141 Al
`
`CALENDAR
`~161
`1 - - - - - - - - - - - - - - - - i
`
`160
`
`,)
`
`/
`
`165 FIG. 14A
`
`CALENDAR
`
`162
`~
`
`6
`
`7
`
`/
`
`166 FIG. 148
`~----C-A-L-EN_D_A_R ____ ._,W63
`
`11-12 12-1
`
`1- 2
`DD □
`,),, ,;;, '"/'' ,,, ; ':; ""':' ,;;,; ,,;:,:,, """" ,,,
`
`/
`
`167 FIG. 14C
`
`CALENDAR
`
`164
`
`12:00
`
`12:15
`
`12:30
`
`12:45
`
`FIG. 140
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 11 of 32
`
`US 2008/0062141 Al
`
`r'\
`MODE
`1 - - - - - - - - - - - - - - - .1 '-180
`
`I
`182
`
`FIG.16
`
`DATA ENTRY
`
`190A
`
`A
`
`5
`
`6
`
`. . . . . . . . . . .
`. . . ' ..... .
`
`555-555-5555
`
`192A
`
`FIG. 17 A
`
`194
`
`190B
`~ - - - - - - - - - - - - - - - - - - ,~
`DATA ENTRY
`
`F
`
`G
`
`19{s
`
`FIG. 178 \194
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 12 of 32 US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER _)
`
`202
`
`WINDOW
`
`p
`
`DETECT OBJECT OVER A SENSING _)
`
`204
`
`SURFACE
`
`RECOGNIZE NAVIGATIONAL INPUT BASED _)
`
`1 '
`
`206
`
`ON OBJECT ACTION
`
`, '
`TRANSITION THROUGH IMAGES OF
`IMAGE BASED BROWSER IN
`ACCORDANCE WITH NAVIGATIONAL
`INPUT
`
`208
`
`l)
`
`FIG. 18
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 13 of 32 US 2008/0062141 Al
`
`..
`
`◄
`
`..
`
`◄
`
`.
`
`.-.: :,•:•:•.• . ·2.1°4
`.·.,-,•,•·.
`~
`/
`.. c:S'
`-u _____ ~
`FIG. 19A
`
`Ci'"•"""'''''''''''[" ••• • ·
`' - - - - lo \ ~216
`
`· FIG. 198
`..
`
`~
`
`~ ~
`~ ~
`
`214
`
`FIG. 19D
`
`FIG. 19E
`
`FIG. 19C
`
`FIG. 19F
`214
`
`FIG. 19G
`
`FIG. 19H
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 14 of 32 US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER u
`
`WINDOW
`
`252
`
`'
`
`1'
`
`254
`
`DETECT OBJECT OVER A SENSING LJ
`
`SURFACE
`
`RECOGNIZE SELECTION INPUT BASED ON
`OBJECT ACTION
`
`256
`
`L)
`
`,,
`
`1 •
`
`INITIATE ACTION ASSOCIATED WITH L)
`
`IMAGE BEING SELECTED
`
`258
`
`FIG. 20
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 15 of 32 US 2008/0062141 Al
`
`274
`
`278
`
`FIG. 218
`
`274
`\
`
`J '
`
`FIG. 21A
`
`274
`
`274
`
`274
`
`274
`
`FIG. 21C
`
`FIG. 21D
`
`...............
`. -.-:-:-:-:-:-:-•-•,•,•,•,·,•. -·-·-:-:-:-:-:-:-.-:
`
`FIG. 21E
`
`277
`
`illI.ll]]
`
`279
`
`FIG. 21F
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 16 of 32 US 2008/0062141 Al
`
`300\
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`DETECT OBJECT OVER A SENDING
`SURFACE
`
`302
`
`304
`
`No
`
`306
`
`Yes
`
`Yes
`
`TRANSITION THROUGH
`IMAGES OF IMAGE
`BASED BROWSER IN
`ACCORDANCE WITH
`FIRST INPUT
`
`312
`
`PRESENT SELECT ABLE
`DATA ASSOCIATED WITH
`IMAGE
`
`314
`
`308
`
`316
`
`FIG. 22
`
`318
`
`Yes
`
`INITIATE ACTION
`ASSOC IA TED WITH
`SELECTABLE DATA
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 17 of 32 US 2008/0062141 Al
`
`ALBUM ALBUM ALBUM
`6
`7
`8
`·:'::~:":::~0:;: :: : : ::: ::: : ::: :::T::?:"::-7:::":,
`
`Song 1
`Song 2
`Song 3
`Song4
`~::T~::;Tt::::"::::::::::::::::::::s:::::::::"::7':·
`
`FIG. 23A
`
`FIG. 23E
`
`ALBUM ALBUM ALBUM
`6
`?
`8
`
`r ◄
`,_____,,\__)I\.--------'
`
`FIG. 238
`
`FIG. 23F
`
`◄
`
`!ALBUM ALBUM ALBUM
`13
`14
`15
`.';:' ."'.':-':-! ::8: : : : : : : : : : : : : : : : : : : : : : : : : : : : : ' : ' : . : . ' ..
`
`,_____,OIi ___ ___ .
`
`. . . . . . . . .
`. •:-:-:-:-:,:-:-· '·.·
`
`.... ' . ' ....
`,•.· •,•,:,:-:-:-:,:-:,
`
`FIG. 23C
`
`FIG. 23G
`
`ALBUM AL UM ALBUM
`13
`15
`
`Now Playinq
`
`□ Album title 14
`Artist
`Song name 2
`
`FIG. 23D
`
`FIG. 23H
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 18 of 32 US 2008/0062141 Al
`
`!
`
`0
`"'-f"
`N
`(9
`LL
`
`()
`"'-f"
`N
`(9
`LL
`
`co
`"'-f"
`N .
`(9
`LL
`
`<(
`"'-f"
`N
`(9
`LL
`
`@
`
`~ w
`
`0)
`
`Q@)~
`CD J: 'I'
`~t:~
`..J::':!:'
`<i!cn~
`u
`co
`
`.c (0 0) E
`,.._ co 0
`.E
`,.._
`co
`0
`., J,
`rn 0) (0 0
`I
`Ill
`'St E
`0
`-, 'St C")
`I{) @
`C")
`I
`I
`N N
`(I)
`0
`0
`.Q,
`(0
`(0
`
`E
`.c (0
`""
`,.._
`,.._
`8
`E oo
`I 0
`Cl) 0)
`~ J,
`Ill
`'St
`E
`-, 'St
`,@
`C")
`I
`N N
`<I>
`0
`.Q,
`(0
`
`I
`
`. c©mE
`'" ,-._
`00 0
`E oo
`,-.. o
`<D o
`rn a>
`(tJ
`Q,)
`I
`~ ~ ;:!; E
`I{) @
`N N (L)
`o
`0
`0
`<D
`<D -~
`
`C")
`
`@
`
`@
`
`I
`"'-f"
`N
`(9
`LL
`
`(9
`"'-f"
`N
`(9
`LL
`
`LL
`"'-f"
`N
`(9
`LL
`
`w
`"'-f"
`N
`(9
`LL
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 19 of 32 US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER LJ
`
`WINDOW
`
`352
`
`1 ,
`
`DETECT FLIP INPUT
`
`354
`
`LJ
`
`1 '
`
`356
`
`IMAGES AT PRIMARY POSITION WHEN LJ
`
`FLIP BETWEEN FIRST AND SECOND
`
`FLIP INPUT IS DETECTED
`
`FIG. 25
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 20 of 32 US 2008/0062141 Al
`
`. ' ...... ' ....... '
`. . . . . . . . . . . . . '
`......... ' ...
`................
`
`FIG. 26A
`
`"
`\
`I
`·----~-- U--·-·-·-·
`I
`I\. -
`I
`I
`. ' ........ ' ... .
`. . . . . . ' ..... .
`................
`:-············· :,•.·.
`
`. ........... .
`. .. • . . •,· ·-·
`. .... ' .... '
`
`FIG. 268
`
`,,,.
`-· . ·-·- -· ·-·---/ ~====·-·-·-·-· . ·-·-·-· ·-
`,,
`11
`/ I
`I \.
`I
`I
`I
`:::::::::::::::i:::::::::i:::;:f.::::
`I
`I
`·.·.--:------.·.····· -
`I
`
`FIG. 26C
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 21 of 32 US 2008/0062141 Al
`
`............. '
`.............
`
`FIG. 26D
`
`iii :l ii:: :l! :: l: ??JTIT\j<f wi: l: :\: 1 :: : : : : : : l:: :l::: :: l: i: i: l:: li: l ll: l :i: :: ;; :! : : :
`1, _11
`1
`I
`I
`I
`
`FIG. 26E
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 22 of 32 US 2008/0062141 Al
`
`WINDOW
`
`'
`
`402
`
`404
`
`DISPLAY IMAGE BASED BROWSER u
`RECOGNIZE SELECTION INPUT OVER u
`
`ONE OF SECONDARY IMAGES
`
`, '
`TRANSITION THROUGH IMAGES IN
`ORDER TO PLACE SELECTED
`SECONDARY IMAGE AT PRIMARY
`POSITION
`
`406
`
`l)
`
`FIG. 27
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 23 of 32 US 2008/0062141 Al
`
`FIG. 28A
`
`FIG. 288
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 24 of 32 US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER l)
`
`422
`
`WINDOW
`
`1'
`
`424
`
`DISPLAY ALPHABET UNDERNEATH l)
`
`BROWSER
`
`DETECT OBJECT OVER LETTER l)
`
`426
`
`,,
`
`1 '
`
`TRANSITION THROUGH IMAGES IN
`
`ORDER TO PLACE FIRST IMAGE _)
`
`ASSOCIATED WITH LETTER IN PRIMARY
`POSITION
`
`428
`
`FIG. 29
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 25 of 32 US 2008/0062141 Al
`
`ABCDEFGHIJKLMNO
`
`STUVWXYZ
`
`FIG. 30A
`
`. . . ' ......... .
`. . . . . . . . ' .. .
`. . . ' ...... .
`.
`. .
`. .
`.
`
`..............
`. .. ' ........ .
`
`ABCDEFGHIJKLMNOPQRSTUVWXYZ
`
`FIG. 30B
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 26 of 32 US 2008/0062141 Al
`
`450~
`
`WINDOW
`
`1 I
`
`SECOND SECONDARY POSITIONS
`
`,.
`
`452
`
`454
`
`456
`
`DISPLAY IMAGE BASED BROWSER u
`DETECT OBJECT OVER A FIRST OR u
`OVER SECONDARY IMAGE AS u
`
`RECOGNIZE PRESENCE OF OBJECT
`
`NAVIGATION INPUT
`
`, '
`TRANSITION THROUGH IMAGES OF
`
`458
`
`IMAGE BASED BROWSER IN u
`
`ACCORDANCE WITH NAVIGATIONAL
`INPUT
`
`FIG. 31
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 27 of 32 US 2008/0062141 Al
`
`CREATE FILE FOLDER
`
`, r
`
`ASSIGN IMAGE TO FILE FOLDER
`
`502
`
`l)
`
`504
`
`l)
`
`,,
`
`·ADD IMAGE TO IMAGE BASED BROWSER l)
`
`506
`
`FIG. 32
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 28 of 32 US 2008/0062141 Al
`
`PROVIDE FIRST AND SECOND GUls J
`
`552
`
`1,
`
`554
`
`DETERMINE ORIENTATION OF PORTABLE J
`
`ELECTRONIC DEVICE
`
`,.
`
`PRESENT FIRST GUI
`WHEN PORT ABLE
`ELECTRONIC DEVICE
`IS IN FIRST
`ORIENTATION
`
`556
`
`~
`
`,,
`558
`)
`PRESENT SECOND GUI I
`WHEN PORTABLE L/
`ELECTRONIC DEVICE
`IS IN SECOND
`ORIENTATION
`
`FIG. 33
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 29 of 32 US 2008/0062141 Al
`
`MENU
`
`MENU ITEM 1
`MENU ITEM 2
`MENU ITEM 3
`MENU ITEM 4
`
`MENU ITEM 6
`MENU ITEM 7
`
`IMAGE BROWSER
`
`FIG. 34
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 30 of 32 US 2008/0062141 Al
`
`714
`
`/700
`
`User Input Device
`
`710
`
`712
`
`Display
`
`Processor
`
`716
`
`718
`
`711
`
`PWR
`
`Network / Bus
`Interface
`
`706
`Cache
`
`. 704
`
`File System
`(Solid-state Storage)
`
`722
`
`Charge Circuit
`
`720
`
`PWR
`
`Battery
`
`PWR
`
`RAM
`
`722
`
`FIG. 35
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 31 of 32 US 2008/0062141 Al
`
`802
`
`Host Computer
`
`814 Com.munication
`Module
`
`806
`
`Management
`. Module
`
`815
`
`Play
`Module
`
`File
`Manager
`
`812
`
`810
`
`Media Database
`
`Media Storage
`
`.808
`
`Data Storage
`
`809
`
`800
`
`/
`
`.,.,.,,,,,,
`
`818
`
`----2
`', ,·
`'
`""----- .....
`
`804
`
`'
`
`Communication
`Module
`
`· Play Module
`
`824
`
`Media Database
`
`Data Storage
`
`822
`
`821
`
`Media Player
`
`FIG. 36
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 32 of 32 US 2008/0062141 Al
`
`900~
`
`RECEIVE IMAGE DOWNLOAD
`REQUEST AT HOST DEVICE
`
`902
`__)
`
`' '
`PRODUCE IMAGE COLLECTION
`FOR EACH REQUESTED IMAGE
`AT A HOST DEVICE
`
`904
`__)
`
`,,
`SEND IMAGE COLLECTION FOR
`EACH REQUESTED IMAGE TO
`MEDIA DEVICE
`
`906
`__)
`
`FIG. 37
`
`1000~
`
`STORE IMAGE DATA
`
`1002
`__)
`
`,,
`1004
`RECEIVE DISPLAY COMMAND __)
`
`,,
`
`RETRIEVE DESIGNATED
`IMAGES
`
`1006
`__)
`
`1r
`
`1008
`OUTPUT ONE OR MORE OF __)
`RETRIEVED IMAGES
`
`FIG. 38 •
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`1
`
`MEDIA PLAYER WITH IMAGED BASED
`BROWSING
`
`CROSS-REFERENCE TO OTHER
`APPLICATIONS
`
`[0001] This application claims priority to: (i) U.S. Provi(cid:173)
`sional Patent Application No. 60/843,832, filed Sep. 11,
`2006, entitled "TECHNIQUES AND SYSTEMS FOR
`BROWSING MEDIA CONTENT", which is herein incor(cid:173)
`porated by reference; and (ii) U.S. Provisional Patent Appli(cid:173)
`cation No. 60/878,746, filed Jan. 5, 2007, entitled "ELEC(cid:173)
`TRONIC DEVICE WITH IMAGE BASED BROWSERS",
`which is herein incorporated by reference.
`[0002] This application also references U.S. patent appli(cid:173)
`cation Ser. No. 11/519,460, filed Sep. 11, 2006, entitled
`"MEDIA MANAGER WITH INTEGRATED BROWS(cid:173)
`ERS", which is herein incorporated by reference.
`
`BACKGROUND OF THE INVENTION
`
`Description of the Related Art
`
`[0003] Today, media playback devices, such as media
`players or music players, have storage capacity to store large
`collections of media, such as music. With such large media
`collections, in order for a user to select a particular song to
`be played by the media player, the user typically navigates
`through a long list of songs. As an example, the user could
`interact with the media player to display a list of artists that
`have songs that are stored within the media collection on the
`media player. The user then scrolls through the list and
`selects an appropriate song to be played. Unfortunately,
`however, as the storage capacity of media players increases,
`the number of songs stored in a media collection on a media
`player increases. Consequently, the list through which users
`must navigate in order to select a song can be extensive.
`[0004] Therefore,
`improved methods
`for browsing
`through content are desired.
`
`SUMMARY OF THE INVENTION
`
`[0005] The invention relates, in one embodiment, to a
`portable electronic device having an imaged based browser
`window for navigating through and selecting images that are
`related to data. Selecting an image causes an action to be
`initiated at the portable electronic device. The action may for
`example correspond to playing a media item associated with
`the image or launching a menu that lists media items
`associated with the image. Navigating through the images
`may be initiated with an input arrangement of the portable
`electronic device. In one example, navigating through the
`images horizontally is provided by rotational user inputs. In
`another example, navigating through the images horizon(cid:173)
`tally is provided by linear user inputs. The user inputs may
`for example be accomplished through various input devices.
`In one embodiment, the input device is an object sensing
`device such as a touch sensing device. In one example, the
`input device is selected from touch pads, touch screens and
`touch sensitive housings.
`[0006] The invention relates, in another embodiment, to a
`method for browsing images stored on a portable electronic
`device having a display and a user input device. The method
`includes presenting an image browser window that displays
`a plurality of images from a group of images. The images
`may be associated with media items. The method also
`
`includes performing an action associated with an image
`when the image is selected. The method further includes
`transitioning through the group of images in accordance
`with a user input. By way of example, the user input may be
`a rotational or linear user input. Furthermore, the input
`device may for example be a touch sensing device.
`[0007] The invention relates, in another embodiment, to a
`portable electronic device. The portable electronic device
`includes a display device. The portable electronic device
`also includes a user input device. The user input device may
`for example be a touch sensing device such as a touch pad,
`touch screen or touch sensitive housing. The portable elec(cid:173)
`tronic device further includes at least one memory device
`capable of storing a plurality of images associated with one
`or more data items and computer program code for display(cid:173)
`ing, navigating and selecting the plurality of images. The
`portable electronic device additionally includes a processing
`device operatively connected to the display device, the user
`input device and the at least one memory device. The
`processing device is capable of executing the computer
`program code for displaying, navigating, and selecting the
`plurality of images. The plurality of images from a group of
`images are displayed, and transitioned through in accor(cid:173)
`dance with a user input at the user input device. The user
`input may for example be a linear user input or a rotational
`user input. Furthermore, the images may be configured to
`move horizontally across the display device during transi(cid:173)
`tioning.
`[0008] The invention relates, in another embodiment, to a
`method of operating a portable electronic device. The
`method includes displaying an image based browser win(cid:173)
`dow. The method also includes detecting an object over a
`sensing surface. The sensing surface may for example be a
`touch sensing surface. The method further includes transi(cid:173)
`tioning through images of image based browser in accor(cid:173)
`dance with a navigation input associated with a moving
`object. The object may for example be a finger swirling,
`swiping or sliding relative to the sensing surface. The
`method additionally includes presenting selectable data
`items associated with a selected image in accordance with a
`first selection input. Moreover, the method includes initiat(cid:173)
`ing an action associated with a selected data item in accor(cid:173)
`dance with a second selection input.
`[0009] The invention relates, in another embodiment, to a
`handheld electronic device having a touch screen display.
`The touch screen display presents a plurality of images in at
`least two groups. A first group is presented in a first format.
`A second group is presented in a second format. The
`plurality of images is sequentially advanced from the first
`group to the second group in response to a user sliding their
`finger along a surface of the touch screen display. The
`advancing may be substantially proportional the speed of the
`finger as it is slid along the surface of the touch screen
`display.
`[0010] The invention relates, in another embodiment, to a
`handheld electronic device having a display and a touch pad.
`The display presents a plurality of images in at least two
`groups. A first group is presented in a first format. A second
`group is presented in a second format. The plurality of
`images sequentially advancing from the first group to the
`second group in response to a user sliding their finger along
`a surface of the touch pad. The advancing may be substan(cid:173)
`tially proportional the speed of the finger as it is slid along
`the surface of the touch pad.
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`2
`
`[0011] The invention relates, in another embodiment, to an
`electronic device. The electronic device includes a storage
`device for storing a plurality of media items and a touch
`screen display. The electronic device also includes an image
`browser module operable to present images associated with
`the media items on the touch screen display and to permit a
`user to browse through the images to locate a particular
`media item within the media items. The electronic device
`further includes a playback module operable to play back the
`particular media item.
`[0012] The invention relates, in another embodiment, to a
`computer readable medium including tangible computer
`program code executable by a computer for browsing
`images stored on an electronic device. The electronic device
`may have a display and a user input device. The computer
`readable medium may include at least: computer program
`code for presenting an image browser window that displays
`a plurality of images from a group of images; computer
`program code for transitioning through the group of images
`in accordance with at least one user input; computer pro(cid:173)
`gram code for selecting one of the images from the group of
`images following the transitioning; and computer program
`code for subsequently performing an action associated with
`the selected image.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0013] The invention may best be understood by reference
`to the following description taken in conjunction with the
`accompanying drawings in which:
`[0014] FIG. 1 is a diagram of an electronic device, in
`accordance with one embodiment of the invention.
`[0015] FIG. 2 is a diagram of a portable electronic device,
`in accordance with one embodiment of the invention.
`[0016] FIG. 3 is a diagram of a portable electronic device,
`in accordance with one embodiment of the invention.
`[0017] FIG. 4 is a simplified block diagram of a portable
`electronic device capable of storing, cataloging, selecting
`and outputting data, in accordance with one embodiment of
`the present invention.
`[0018] FIG. 5 is a diagram of a browse windows capable
`of browsing through images, in accordance with several
`embodiments of the present invention.
`[0019] FIG. 6 is a diagram of a browse windows capable
`of browsing through images, in accordance with several
`embodiments of the present invention.
`[0020] FIG. 7 is a diagram of a browse windows capable
`of browsing through images, in accordance with several
`embodiments of the present invention.
`[0021] FIG. 8 is a diagram of a browse windows capable
`of browsing through images, in accordance with several
`embodiments of the present invention.
`[0022] FIG. 9 is a method of operating a browser window,
`in accordance with one embodiment of the present inven(cid:173)
`tion.
`[0023] FIG. 10 is a menu hierarchy, in accordance with
`one embodiment of the present invention.
`[0024] FIG. 11 is a menu hierarchy, in accordance with
`one embodiment of the present invention.
`[0025] FIGS. 12A-12B shows an image based browser
`when the portable electronic device is in a phone or com(cid:173)
`munication mode, in accordance with one embodiment of
`the present invention.
`
`[0026] FIG. 13 shows an image based browser associated
`with applications, in accordance with one embodiment of
`the present invention.
`[0027] FIG. 14A-14D shows an image based browser
`associated with a date book or calendar, in accordance with
`one embodiment of the present invention.
`[0028] FIG. 15 shows an image based browser associated
`with a photo viewing application, in accordance with one
`embodiment of the present invention.
`[0029] FIG. 16 shows an image based browser associated
`with modes of the portable electronic device, in accordance
`with one embodiment of the present invention.
`[0030] FIG. 17A-17B show an image based browser asso(cid:173)
`ciated with entering data into the portable electronic device,
`in accordance with one embodiment of the present inven(cid:173)
`tion.
`[0031] FIG. 18 is a browsing method, in accordance with
`one embodiment of the present invention.
`[0032] FIGS. 19A-19H show several examples of object
`actions used to create navigation inputs for an image based
`browser, in accordance with one embodiment of the present
`invention.
`[0033] FIG. 20 is a browsing selection method, in accor(cid:173)
`dance with one embodiment of the present invention.
`[0034] FIGS. 21A-21F show several examples of object
`actions used to create selection inputs for an image based
`browser, in accordance with one embodiment of the present
`invention.
`[0035] FIG. 22 is a browser method, in accordance with
`one embodiment of the present invention.
`[0036] FIGS. 23A-23H illustrate an exemplary browsing
`sequence using the methods described in FIG. 22, in accor(cid:173)
`dance with one embodiment of the present invention.
`[0037] FIGS. 24A-24H illustrate an exemplary browsing
`sequence using the methods described in FIG. 22, in accor(cid:173)
`dance with one embodiment of the present invention.
`[0038] FIG. 25 is a selection method, in accordance with
`one embodiment of the present invention.
`[0039] FIGS. 26A-26E illustrate a flipping sequence for
`use in the embodiment mentioned above.
`[0040] FIG. 27 is a browsing method, in accordance with
`one embodiment of the present invention.
`[0041] FIGS. 28A and 28B are diagrams showing the
`method described in FIG. 27, in accordance with one
`embodiment of the present invention.
`[0042] FIG. 29 is a browsing method, in accordance with
`one embodiment of the present invention.
`[0043] FIGS. 30A and 30B are diagrams showing the
`method described in FIG. 29, in accordance with one
`embodiment of the present invention.
`[0044] FIG. 31 is a browse method, in accordance with
`one embodiment of the present invention.
`[0045] FIG. 32 is a method of assigning an image to a list,
`in accordance with one embodiment of the present inven(cid:173)
`tion.
`[0046] FIG. 33 is an operational method for a portable
`electronic device, in accordance with one embodiment of the
`present invention.
`[0047] FIG. 34 is a diagram showing a device transition(cid:173)
`ing between a menu based window in portrait mode, and an
`image based browser is in a landscape mode, in accordance
`with one embodiment of the present invention.
`[0048] FIG. 35 is a block diagram of a media device, in
`accordance with one embodiment of the present invention.
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`3
`
`[0049] FIG. 36 is a block diagram of a media management
`system, in accordance with one embodiment of the present
`invention.
`[0050] FIG. 37 is a method of transferring image data
`between a host device and a portable media device, in
`accordance with one embodiment of the present invention.
`[0051] FIG. 38 is an operational method for a portable
`media device, in accordance with one embodiment of the
`present invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`[0052] The invention generally pertains to methods and
`systems that improve the way media is played, sorted,
`modified, stored and cataloged on an electronic device, such
`as portable electronic device. One aspect of the invention
`relates to an imaged based browsing that allows a user to
`navigate through and/or select images.
`In accordance with one embodiment, an electronic
`[0053]
`device can perform or provide an image based browser
`function to perform image based browsing. The image based
`browser function provides a graphical user interface that
`allows a user to navigate through and/or select images rather
`than textual menu items contained in a conventional menu
`list ( e.g., vertical menu). Image based browsing can provide
`efficient, graphical browsing ( e.g., scrolling) through a
`group of digital items that can are or can be represented in
`a visual manner.
`[0054] The images being browsed may be related or linked
`to data. For example, the images may be associated with
`media files, address files, date book files, document files,
`applications, modes, etc. In one embodiment, image brows(cid:173)
`ing may be implemented to mimic turning pages or flipping
`through rolodex or calendar, or flipping through LP records
`or CD's in a bin.
`[0055] These and other embodiments of the invention are
`discussed below with reference to FIGS. 1-38. However,
`those skilled in the art will readily appreciate that the
`detailed description given herein with respect to these fig(cid:173)
`ures is for explanatory purposes as the invention extends
`beyond these limited embodiments.
`[0056] FIG. 1 is a diagram of an electronic device 2, in
`accordance with one embodiment of the invention. The
`electronic device 2 may for example be a portable electronic
`device that is easily transported or conveyed.
`[0057] The electronic device can for example correspond
`to a computer (e.g., personal computer), mobile phone (e.g.,
`cellular phone), personal digital assistant (PDA), media
`player ( e.g., music, videos, games, images), media storage
`device, camera, remote control, and/or the like. The elec(cid:173)
`tronic device may also be a multi-functional device that
`combine two or more of these device functionalities into a
`single device. Examples of multi-functional devices can be
`found in U.S. Provisional Patent Application No. 60/658,
`777 filed Mar. 4, 2005 and entitled "MULTI-FUNCTIONAL
`HAND-HELD DEVICE", which is herein incorporated by
`reference.
`[0058] The electronic device may further be a hand-held
`electronic device. The term hand-held generally means that
`the electronic device has a form factor that is small enough
`to be comfortably held in one hand. A hand-held electronic
`device may be directed at one-handed operation or two(cid:173)
`handed operation. In one-handed operation, a single hand is
`used to both support the device as well as to perform
`
`operations with the user interface during use. In two-handed
`operation, one hand is used to support the device while the
`other hand performs operations with a user interface during
`use or alternatively both hands support the device as well as
`perform operations during use. In some cases, the hand-held
`electronic device is sized for placement into a pocket of the
`user. By being pocket-sized, the user does not have to
`directly carry the device and therefore the device can be
`taken almost anywhere the user travels ( e.g., the user is not
`limited by carrying a large, bulky and often heavy device).
`In accordance with one embodiment, the electronic
`[0059]
`device 2 is capable of performing an image based browser
`function. The image based browser function provides a
`graphical user interface that allows a user to navigate
`through and/or select images rather than textual menu items
`contained in a conventional menu list (e.g., vertical menu).
`It should be noted however that the electronic device 2 is not
`limited to image based browsers and often includes both
`menu driven lists and image based browsers. In fact, the
`electronic device 2 may be configured to operate in either
`configuration depending on the needs of the device, software
`platform and/or user. In some cases, the electronic device 2
`may even operate both menu driven lists and image based
`browsers at the same time.
`[0060] Generally speaking, the image based browser pro(cid:173)
`vides a scrolling type action that permits a user to flip
`through images in an efficient and user friendly manner. The
`images generally describe graphically some aspect of a file
`stored on the electronic device 2. In many cases, the browser
`incl