`(12) Patent Application Publication (10) Pub. No.: US 2011/0163971 A1
`Wagner et al.
`(43) Pub. Date:
`Jul. 7, 2011
`
`US 2011 0163971 A1
`
`(54) DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR NAVIGATING AND
`DISPLAYING CONTENT IN CONTEXT
`
`(76) Inventors:
`
`(21)
`(22)
`
`Appl. No.:
`
`Filed:
`
`Oliver P. Wagner, San Francisco,
`CA (US); Michael Matas, San
`Francisco, CA (US)
`12/789,441
`May 27, 2010
`
`Related U.S. Application Data
`(60) Provisional application No. 61/335,520, filed on Jan.
`6, 2010.
`
`Publication Classification
`
`(51)
`
`Int. C.
`G06F 3/04
`
`(2006.01)
`
`(52) U.S. Cl. ........................................................ 345/173
`
`ABSTRACT
`(57)
`An electronic device displays one or more thumbnails. The
`device detects a first multi-contact gesture that includes
`movement of a first contact and a second contact; and, in
`response to detecting the first multi-contact gesture, the
`device displays content associated with a respective thumb
`nail and enlarges the content associated with the respective
`thumbnail to a respective enlarged size in accordance with the
`first multi-contact gesture. The device detects termination of
`the first multi-contact gesture; and, in response to detecting
`termination of the first multi-contact gesture: when a resizing
`metric based on the first multi-contact gesture is below a
`predefined threshold, the device ceases to display the content
`at the respective enlarged size; and, when the resizing metric
`based on the first multi-contact gesture is above the pre
`defined threshold, the device displays the content on the dis
`play in a predefined arrangement.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Portable Multifunction Device 100
`210
`
`210 is SM card slot
`212 is headphone jack
`
`ouch Screen 112
`
`203
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`External Port 124
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 1 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 1 of 62
`
`US 2011/O163971 A1
`
`Memory
`102
`
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Text input Module
`GPs Module
`Applications
`Contacts Module
`Telephone Module
`Video Conference Module
`E-mail Client Module
`Instant Messaging Module
`Workout Support Module
`cameramie
`Camera Module
`mage Management Module
`Video Player Module
`Music Player Module
`BrOWSer Module
`
`126
`
`128
`
`3.
`136
`137
`138
`139
`140
`141
`142
`-
`a
`145
`146
`147
`
`Portable Multifunction Device
`1 OO
`Applications (Continued)
`Calendar Module
`Widget Modules
`Weather Widget
`Stocks Widget
`Calculator Widget
`Alarm Clock Widget
`Dictionary Widget
`
`136
`148
`149
`149-1
`149-2
`149-3
`149-4
`149-5
`
`User-Created Widget(s)
`Widget Creator Module
`Search Module
`
`Device/Global Internal State
`162
`
`Power
`System
`
`149-6
`150
`151
`
`157
`
`124
`
`External
`POrt
`103
`RF Circuitry
`108
`10
`Speaker
`N --1a 111
`AUCO EC
`Circuitry
`110 HO
`Microhone
`Proximity
`113
`
`118
`
`103
`Control
`OOe
`
`
`
`
`
`
`
`Processor(s)
`
`Peripherals
`Interface
`
`103
`
`104
`
`122
`
`120
`
`106
`
`156
`
`
`
`
`
`
`
`
`
`
`
`
`103
`
`m
`
`I/O Subsystem
`
`158
`
`Display
`Controller
`
`Optical sensor(s)
`Controller
`
`Other input
`Controller(s)
`
`160
`
`
`
`103
`
`Touch-Sensitive
`Display System
`
`112
`
`103
`
`Other input
`Control Devices
`
`116
`
`103
`Optical
`Sensor(s)
`164
`Figure 1A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 2 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 2 of 62
`
`US 2011/O163971 A1
`
`Memory 102
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`T
`ext input Module
`E.
`pplicationS
`Contacts Module
`Telephone Module
`Video Conference Module
`E-mail Client Modul
`dul
`E.
`g
`Workout Support Module
`Camera Module
`Image Management Module
`Video & Music Player Module
`Notes Module
`Map Module
`Browser Module
`
`104
`122
`
`120
`
`106
`
`156
`
`
`
`
`
`
`
`
`
`
`
`
`
`Controller
`
`Display
`Controller
`
`Portable Multifunction Device 100 136
`126 Applications (continued)
`148
`128
`149
`130
`132
`134
`135
`136
`137
`138
`139
`
`149-1
`149-2
`149-3
`149-4
`149-5
`
`149-6
`
`150
`151
`155
`
`157
`
`140
`141
`142
`143
`
`144
`152
`
`153
`154
`
`- 147
`
`118
`
`POWer
`System
`
`POrt
`
`162
`
`124
`
`RF Circuitr
`
`A Y-2 103
`
`Peripherals
`Interface
`
`103
`
`103
`
`111
`
`I
`AUCO
`110 HO
`Proximity
`Sensor
`
`Microhone
`113
`166
`
`103
`
`Accelerometer(s)
`168
`Aaaaaaaaaaaaaaa
`
`16O
`
`Other input
`Controller(s)
`"
`
`1Y 103
`
`103
`
`Touch-Sensitive
`Display System
`
`112
`
`Optical
`Sensor(s)
`164
`
`Other input
`Control Devices
`
`116
`
`Figure 1B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 3 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 3 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`J??uOS quêAE
`
`0/ |
`
`
`
`
`
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 4 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 4 of 62
`
`US 2011/O163971 A1
`
`Portable Multifunction Device 100
`210
`Optical
`Sensor 164
`
`Speaker 111
`
`Proximity
`Sensor 166
`
`206
`
`200
`
`OO
`S
`
`CN
`
`210 is SM Card Slot
`212 is headphone jack
`
`Touch Screen 11
`
`2 O 2
`
`2O3
`
`Microphone
`113
`
`/
`\
`Home
`204
`
`Accelerometer(s)
`168
`
`External Port 12
`Figure 2
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 5 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 5 of 62
`
`US 2011/O163971 A1
`
`Memory 370
`
`Applications
`
`Widget Modules
`
`Device 300
`a
`
`31 O
`
`330
`
`
`
`I/O Interface
`
`32O
`
`340
`
`Keyboard/Mouse - 350
`
`Touchpad
`
`355
`
`:
`User-Created Widget(s)
`
`360
`
`NetWork
`Communications
`Interface
`
`
`
`126
`128
`130
`132
`
`3.
`
`137
`
`138
`139
`140
`141
`142
`143
`144
`145
`
`146
`147
`148
`149
`149-1
`149-2
`
`149-3
`149-4
`149-5
`
`151
`380
`
`382
`
`3.
`
`388
`390
`
`b
`Device/Global Internal State
`
`157
`
`Figure 3
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 6 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 6 of 62
`
`US 2011/O163971 A1
`
`
`
`2O6
`
`Portable Multifunction Device
`100
`
`>
`
`--- -
`---
`---
`---
`---
`---
`
`PhOtOS
`144
`
`Camera
`143
`
`Videos
`145
`
`Jan
`15
`
`Calendar
`148
`
`Stocks
`149-2
`
`WorkOut
`Support
`142
`
`\
`
`-x- ?
`
`--
`
`--
`
`A
`Calculator
`149-3
`
`-
`
`-- -
`
`-
`8,
`
`-
`
`8
`
`^
`
`ABC ca
`
`\
`
`Y-
`
`---
`
`Dictionary
`149-5
`
`Widget
`Widget
`149-6
`
`\,
`
`--
`
`A
`
`---
`
`Alarm
`149-4
`
`Music
`146
`
`Touch SCreen 11
`
`Microphone / Home
`113
`\ 204
`
`Accelerometer(s)
`168
`
`Figure 4A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 7 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 7 of 62
`
`US 2011/O163971 A1
`
`
`
`Portable Mutifunction Device
`100
`
`Calculator
`49-3
`
`Settings
`412
`
`113
`
`? Home
`204
`
`Accelerometer(s)
`168
`
`Figure 4B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 8 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 8 of 62
`
`US 2011/O163971 A1
`
`45O
`
`468
`
`470
`
`453
`
`
`
`Figure 4C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 9 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 9 of 62
`
`US 2011/O163971 A1
`
`
`
`CJ SJOdS
`
`
`
`(sebela | sºoed | siuea= |sung?w | soloud)
`
`VG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 10 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 10 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`(sebeld | sºoed | suba=|sung?v |soloud)
`
`gG aun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 11 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 11 of 62
`
`US 2011/O163971 A1
`
`
`
`8.
`
`8&s
`
`3.
`.
`
`.
`
`.
`
`8
`
`.
`
`.
`
`:::::::::::::::::::::::::::::::::::::::::::::::::: 8 38383
`::::::::::
`88.888
`8 8
`::::::: 888
`:::::::::::::
`33333333333333333&S
`83
`
`.
`
`.
`
`.
`
`:8
`:
`
`38
`:::::::::::
`:::::::::::::::::::::::::::
`8
`
`8.
`
`32
`
`888
`
`8
`8
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 12 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 12 of 62
`
`US 2011/O163971 A1
`
`
`
`0 | -800G
`
`
`
`C1G ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 13 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 13 of 62
`
`US 2011/O163971 A1
`
`
`
`EG aun61-I
`
`z??G
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 14 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 14 of 62
`
`US 2011/O163971 A1
`
`
`
`G-8009
`
`9 | -0 | 09
`
`
`
`-IG eun61-I
`
`
`
`| -8009
`
`| | | | # # # # |
`
`------ | || -8009
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 15 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 15 of 62
`
`US 2011/O163971 A1
`
`
`
`C
`t
`A.
`Cen
`O
`
`f
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 16 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 16 of 62
`
`US 2011/O163971 A1
`
`
`
`HG aun61-I
`
`G-8009
`
`
`
`Z-800G| -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 17 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 17 of 62
`
`US 2011/O163971 A1
`
`
`
`9 | -8009
`
`IG eunfil
`
`9-8009
`
`| || -8009
`
`G-800G
`
`
`
`9-900GZ-8009| -900G
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 18 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 18 of 62
`
`US 2011/O163971 A1
`
`
`
`Ca
`
`s
`
`D
`s
`o
`
`S
`
`i
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 19 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 19 of 62
`
`US 2011/O163971 A1
`
`
`
`[sz]]
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 20 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 20 of 62
`
`US 2011/O163971 A1
`
`
`
`6-O?OUGH
`
`TG eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 21 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 21 of 62
`
`US 2011/O163971 A1
`
`
`
`9-O?OUGH
`
`[sui] (I
`
`q-0ZOGQ_^
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 22 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 22 of 62
`
`US 2011/O163971 A1
`
`
`
`9-7 | 09
`
`NG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 23 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 23 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`LZ || || 6 || L | / | | |
`
`OG 3 Infi?
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 24 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 24 of 62
`
`US 2011/O163971 A1
`
`
`
`9-800G
`
`0 | -900G
`
`dG ?un61-I
`
`9 | -800G
`
`Z || -9009
`
`-| || -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 25 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 25 of 62
`
`US 2011/O163971 A1
`
`
`
`G-800G
`
`0 || -8009
`
`Og aun61-I
`
`9 | -9009
`
`Z || -8009
`
`| || -8009
`
`| -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 26 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 26 of 62
`
`US 2011/O163971 A1
`
`9 | -800G
`
`
`
`G-800G
`
`CN
`
`| -800G
`
`! |
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 27 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 27 of 62
`
`US 2011/O163971 A1
`
`
`
`SG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 28 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 28 of 62
`
`US 2011/O163971 A1
`
`
`
`LG ?un61-I
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 29 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 29 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`(sebeld | sºoed | siuea= | sung?v | soloud) 8069
`
`ng eun61
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 30 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 30 of 62
`
`US 2011/O163971 A1
`
`
`
`AG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 31 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 31 of 62
`
`US 2011/O163971 A1
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 32 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 32 of 62
`
`US 2011/O163971 A1
`
`
`
`suunqIV|
`
`XG aun61-I?79099909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 33 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 33 of 62
`
`US 2011/O163971 A1
`
`
`
`ZI, JO 6
`
`AG ?un61-I
`
`Z-8909
`
`| -890G
`
`7909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 34 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 34 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`
`
`^~-oos soweguonoun?hinw
`
`ZG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 35 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 35 of 62
`
`US 2011/O163971 A1
`
`Z || ||
`
`
`
`
`
`Vyg eun61-I
`
`L-O?OUGH7909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 36 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 36 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 37 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 37 of 62
`
`US 2011/O163971 A1
`
`
`
`€ULIOH|XIJOM|seleiduel)
`
`
`
`oog eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 38 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 38 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`CICIG eun61-I
`
`G-0909
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 39 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7,2011 Sheet 39 of 62
`
`US 2011/0163971 Al
`
`S-Oplls
`
`§-990S
`
`
`
`
`
`OL-990SOL-PPIIS
`
`
`
`
`6-8PliS
`
`6-990S
`
`b-8PllS
`
`
`
`{~~
`
`OL-890S
`
`fo
`
`6-890S
`
`
`SL-990S
`GL-®PIIS
`
`
`
` VL-SPIIS
`
`vL-990S
`
`€-moysapl|s \_o0¢eorneg
`
`
`
`
`
`
`
`
`
`
`
`c~SPulSL-8PllS
`
`GL-890S5
`
`vL-890S
`
`€1-890S
`
`
`
`Aaseun6bi4
`
`
`
`
`
`
`
`
`
`CL-OPIISLb-OPlIS
`
`
`
`cb-990SLL-990S
`
`L-990S
`
`uonsunyniny
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 40 of 90
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 40 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 40 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`H-IG eun61-I
`
`--~-------- --^--------- --~--------|--~-------- --^---------n
`
`
`
`
`
`
`G|--8909?7|| -8909£| -8909Z|| -8909| || -8909
`
`- - - - - - - - - -
`
`| -9909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 41 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 41 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`999 eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 42 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 42 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`HHG aun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 43 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 43 of 62
`
`US 2011/O163971 A1
`
`
`
`CD
`S
`O
`
`N4
`
`s
`
`O
`92
`C
`O.
`8
`CD
`H
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 44 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 44 of 62
`
`US 2011/O163971 A1
`
`
`
`9-queuunood
`
`0 | -9809
`
`0 | -8809
`
`!---
`
`9 | -9809
`
`
`
`Trg eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 45 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 45 of 62
`
`US 2011/O163971 A1
`
`
`
`0 | -9809
`
`01-9809
`
`9 | -9809
`
`
`
`XXG ?un61-I
`
`ZI, ?
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 46 of 90
`
`
`
`
` Sheet 46 of 62==US 2011/0163971 AlPublication
`Patent Application
`Jul. 7, 2011
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 47 of 90
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 47 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 47 of 62
`
`US 2011/O163971 A1
`
`600
`
`Displaying a plurality of pins on a map:
`
`Each of the pins is representative of content that is associated with a
`geographic location
`
`Each of the pins is displayed at a respective location on the map that
`corresponds to the geographic location of the content represented by
`the pin.
`
`|
`
`Detect a pin selection input associated with a respective pin of the
`plurality of pins
`
`In response to detecting the pin selection input, display the respective o
`thumbnail
`
`Display one or more thumbnails
`Each respective thumbnail of the one or more thumbnails is located at
`a respective initial region on the display and has a respective initial
`Size
`
`
`
`y
`Detect a first Contact and a Second Contact On the touch-Sensitive Surface
`| The first contact and the second contact are detected at locations on
`the touch-sensitive surface that correspond to an initial region of the
`respective thumbnail on the display
`
`- 612
`|- 613
`
`Figure 6A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 48 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 48 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`While continuing to detect the first contact and the second contact on the
`touch-Sensitive Surface:
`
`Detect a first multi-contact gesture that includes movement of the first
`COntact and the Second COntact
`
`- 614
`
`-- 616
`
`F.|- 620
`In response to detecting the first multi-contact gesture:
`
`--- 622
`
`— 624
`
`|- 626
`
`- 628
`
`|- 630
`
`-- 632
`
`-- 634
`
`Display content associated with a respective thumbnail
`
`|
`
`The Content is a plurality of images. The respective
`thumbnail is a representation of a stack of images that
`displays at least one image of the plurality of images.
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Displaying the content includes ceasing to display the
`respective thumbnail
`
`The respective thumbnail is a reduced-size representation
`of the content. Displaying the content includes enlarging
`the respective thumbnail.
`
`Figure 6B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 49 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 49 of 62
`
`US 2011/O163971 A1
`
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`
`- 614
`
`
`
`In response to detecting the first multi-contact gesture:
`Enlarge the content associated with the respective thumbnail to al
`respective enlarged size in accordance with the first multi-Contact
`gesture
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Enlarge the Content associated with the respective
`thumbnail to the respective enlarged size in accordance
`with the resizing metric
`
`:
`
`-
`
`|
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - L
`Enlarge the content associated with the respective
`| thumbnail to the respective enlarged size in proportion to
`|
`the resizing metric
`
`|
`
`Translate the content across the display in accordance with the
`first multi-Contact gesture
`
`Rotate the content in response to detecting the first multi-contact
`gesture
`
`The one or more thumbnails includes a plurality of thumbnails v
`other than the respective thumbnail.
`
`When the resizing metric based on the first multi-contact gesture
`reaches a predefined threshold, fade out the plurality of
`thumbnails.
`
`Detect termination of the first multi-contact gesture
`
`Figure 6C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 50 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 50 of 62
`
`US 2011/O163971 A1
`
`
`
`In response to detecting termination of the first multi-contact gesture
`When a resizing metric based on the first multi-contact gesture is
`below a predefined threshold
`Cease to display the Content at the respective enlarged size
`
`Redisplay the respective thumbnail in the initial region
`
`When the resizing metric based on the first multi-contact gesture is "--
`above the predefined threshold, display the Content on the display in a
`predefined arrangement
`
`In response to detecting the first multi-Contact gesture, rotate the
`content to an arbitrary angle in accordance with the first multi
`contact gesture.
`
`Displaying the content on the display in the predefined
`arrangement includes snapping the content to a predefined
`Orientation
`
`The Content includes a plurality of Content items. Displaying the
`Content on the display in the predefined arrangement includes
`displaying the Content items in a multi-row grid of Components
`
`Displaying the content on the display in the predefined
`arrangement includes displaying the content in a slideshow
`
`Detect a navigation input
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`In response to detecting the navigation input, navigate
`from the content to an adjacent image
`
`-
`
`-
`
`Figure 6D
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 51 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 51 of 62
`
`US 2011/O163971 A1
`
`in response to detecting termination of the first multi-contact gesture
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`-
`Enlarging the content includes resizing the content to an arbitrary
`Size.
`
`
`
`Displaying the content in a predefined arrangement in response
`to detecting termination of the first multi-contact gesture includes
`Snapping the Content to a predefined size.
`
`- 652
`
`- 658
`
`672
`
`Detect a third contact and a fourth Contact on the touch-sensitive
`Surface
`
`Detect a second multi-contact gesture that includes the third
`Contact and the fourth Contact
`
`A.
`y
`3.
`In response to detecting the Second multi-Contact gesture,
`enlarge the content to an enlarged size that is larger than the
`predefined size in accordance with the second multi-contact
`gesture
`
`|
`
`-
`
`676
`
`-- 678
`
`-
`
`- -
`
`l
`
`-
`-
`-
`-
`-
`- - - - - - - - - - - - - - - - - - - - - 680
`Detect termination of the second multi-contact gesture --
`
`.
`
`-
`
`- -
`
`-
`
`-
`
`-
`
`-
`
`After detecting termination of the second multi-contact gesture,
`continue to display the content at the enlarged size
`
`-
`
`-
`
`-
`
`-
`
`- -
`
`-
`
`-
`
`-
`
`- ---, -- 682
`
`Figure 6E
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 52 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 52 of 62
`
`US 2011/O163971 A1
`
`In response to detecting termination of the first multi-Contact gesture
`
`- 652
`
`
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`The one or more thumbnails include the respective thumbnail:
`and a plurality of other thumbnails arranged as an initial array of
`thumbnails. The content is a first image. Displaying the content
`in a predefined arrangement includes displaying the first image in
`a slideshow mode.
`
`While in Slideshow mode:
`
`Navigate from the first image to a subsequent image in the
`slideshow mode.
`
`Detect a third Contact and a fourth Contact on the touch-sensitive
`Surface.
`y
`Detect a second multi-contact gesture that includes the third
`Contact and the fourth Contact.
`y
`In response to detecting the Second multi-Contact gesture:
`
`-- 688
`
`690
`
`Exit the slideshow mode.
`
`Display an updated array of Content thumbnails that does not
`include a thumbnail for the subsequent image.
`
`Shrink the subsequent image in accordance with the second
`multi-contact gesture.
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`
`Detect termination of the second multi-contact gesture
`'- — 694
`In response to detecting termination of the second multi-contact
`gesture, display a thumbnail for the Subsequent image in the
`updated array
`
`Figure 6F
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 53 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 53 of 62
`
`US 2011/O163971 A1
`
`
`
`In response to detecting termination of the first multi-Contact gesture
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, displaying the content on the display
`in a predefined arrangement.
`
`The respective thumbnail is representative of respective content -
`that is aSSOciated with a respective geographical location.
`
`The respective thumbnail is displayed on a map in a region on
`the map that corresponds to the respective geographical location
`associated with the Content represented by the respective
`thumbnail.
`
`Enlarging the content associated with the respective thumbnail
`includes displaying the Content associated with the respective
`thumbnail overlaid on the map.
`
`Figure 6G
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 54 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 54 of 62
`
`US 2011/O163971 A1
`
`700
`
`Display one or more selectable objects
`
`- 702
`
`--
`
`Detect a first Contact and a second Contact. On the touch-sensitive Surface
`
`- 706
`
`708
`
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`Detect a first multi-Contact gesture that includes movement of the r
`Contact and the Second COntact
`y
`In response to detecting the first multi-contact gesture:
`Display content associated with a respective selectable object
`
`-- 710
`
`-- 712
`
`Enlarge the content associated with the respective selectable
`object to a respective enlarged size in accordance with the first
`multi-contact gesture
`
`
`
`-- 714
`
`
`
`Detect termination of the first multi-contact gesture
`
`In response to detecting termination of the first multi-contact gesture:
`
`When a resizing metric based on the first multi-contact gesture is
`below a predefined threshold, cease to display the content at the
`respective enlarged size
`
`
`
`---
`
`
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`
`- 716
`
`-718
`-- 720
`
`- 722
`
`Figure 7
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 55 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 55 of 62
`
`US 2011/O163971 A1
`
`800
`
`Display a plurality of album thumbnails
`
`A respective album thumbnail represents a respective plurality of
`Content items
`
`-
`
`Each respective album thumbnail of the plurality of album thumbnails
`is located at a respective initial region on the display and has a
`respective initial size
`
`a
`
`Detect a first Contact and a Second Contact On the touch-Sensitive Surface
`
`The first Contact and the Second Contact are detected at locations On
`the touch-sensitive surface that correspond to an initial region of a
`respective album thumbnail on the display
`
`t
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`
`Detect a first multi-contact gesture that includes movement of the first
`Contact and the Second Contact
`
`- 802
`- 804
`
`- 806
`
`- 808
`810
`
`-812
`
`– 814
`
`
`
`In response to detecting the first multi-contact gesture:
`Display representations of content items associated with the
`respective album thumbnail
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Cease to display the respective album thumbnail in an initial
`region of the respective album thumbnail
`|
`
`|- 816
`818
`
`.
`
`-- 820
`
`y
`Detect termination of the first multi-contact gesture
`
`- 822
`
`(a)
`
`Figure 8A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 56 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 56 of 62
`
`US 2011/O163971 A1
`
`In response to detecting termination of the first multi-Contact gesture:
`
`When a first resizing metric based on the first multi-contact gesture is
`below a predefined threshold:
`Cease to display the representations of the Content items
`associated with the respective album thumbnail
`
`-
`
`-
`
`Redisplaying the respective album thumbnail
`
`- - - -n or an or or or me are me or - w - - - - or or me a - m or m me -m or - or m so on was or - or me -
`
`When the first resizing metric based on the first multi-contact gesture
`is above the predefined threshold, display the representations of the
`content items associated with the respective album thumbnail on the
`display in a first predefined arrangement. A respective representation
`of a content item is a respective Content thumbnail that is associated
`with a respective content item.
`
`While displaying the representations of the content items associated with M
`the respective album thumbnail on the display in the first predefined
`arrangement, detect a third contact and a fourth contact on the touch
`Sensitive Surface
`
`
`
`The third Contact and the fourth Contact are detected at locations on
`the touch-sensitive surface that correspond to an initial region of the
`respective Content thumbnail on the display
`
`Figure 8B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 57 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 57 of 62
`
`US 2011/O163971 A1
`
`While continuing to detect the third contact and the fourth contact on the
`touch-Sensitive surface:
`
`Detect a second multi-contact gesture that includes movement of the -
`third Contact and the fourth Contact
`
`-838
`- 840
`
`In response to detecting the second multi-contact gesture:
`
`Display the respective Content item that is associated with the
`respective content thumbnail
`
`Cease to display the respective Content thumbnail in an initial
`region of the respective content thumbnail
`
`-
`
`- 848
`
`- 850
`
`
`
`Detect termination of the second multi-contact gesture
`y
`In response to detecting termination of the second multi-contact gesture:
`When a second resizing metric based on the second multi-contact
`gesture is below a predefined threshold:
`Cease to display the respective content item that is associated
`with the respective content thumbnail
`
`Redisplay the respective content thumbnail
`
`Figure 8C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 58 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 58 of 62
`
`US 2011/O163971 A1
`
`- 850
`858
`
`-- 860
`
`-- 862
`
`-- 864
`
`In response to detecting termination of the second multi-contact gesture:
`When the second resizing metric based on the second multi-contact
`gesture is above the predefined threshold:
`Display the respective content item in a second predefined
`arrangement
`
`---
`
`The first predefined arrangement of the representations of the
`Content items associated with the respective album thumbnail is
`an initial array of content thumbnails. The respective Content
`item is a first image. Displaying the respective content item in |
`the second predefined arrangement includes displaying the first
`image in a slideshow mode.
`y
`While in the slideshow mode:
`
`Navigate from the first image to a subsequent image in the
`slideshow mode.
`
`Detect a fifth contact and a sixth contact on the touch-sensitive
`Surface.
`
`Detect a third multi-contact gesture that includes the fifth contact
`and the Sixth Contact.
`
`-
`
`y
`In response to detecting the third multi-contact gesture:
`
`--866
`
`Exit the slideshow mode.
`
`Display an updated array of content thumbnails that does not
`include a content thumbnail for the subsequent image.
`
`Shrink the subsequent image in accordance with the third multi
`contact gesture.
`y
`Detect termination of the third multi-contact gesture
`
`-
`w
`y
`mo m m
`In response to detecting termination of the third multi-contact ....... --
`gesture, display the content thumbnail for the subsequent image
`in the updated array.
`
`-- 868
`
`- - 870
`
`Figure 8D
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 59 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 59 of 62
`
`US 2011/O163971 A1
`
`90
`
`Display a presentation user interface Configured to present Content items
`from a set of content items in a predetermined sequence. The presentation
`user interface includes:
`
`A display region for displaying a currently displayed content item in the T
`Set of Content items
`
`- 902
`
`- 904
`
`A scrubber for navigating between content items in the set of content
`items. The Scrubber includes:
`
`
`
`An ordered line of thumbnail representations for a plurality of
`Content items in the set of Content items. The Ordered line is
`ordered in accordance with the predetermined sequence.
`--
`
`The plurality of content items includes at least one video
`and at least one image
`
`The Ordered line is a Column.
`
`Each of the thumbnail representations has a height.
`
`The scrubber has a predefined maximum height.
`
`When the sum of the heights of the thumbnail
`representations of content items in the set of content items
`is less than the predefined maximum height, the plurality of
`Content items includes all of the Content items in the set of
`Content items.
`
`When the sum of the heights of the thumbnail
`representations of content items in the set of content items
`exceeds the predefined maximum height, the plurality of
`Content items includes less than all of the Content items in
`the set of Content items.
`
`When the plurality of content items includes less than
`all of the Content items in the set of Content items, the
`plurality of Content items is selected using predefined
`Criteria
`
`-906
`
`--- 908
`
`-- 910
`
`-- 912
`
`-- 914
`
`Figure 9A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 60 of 90
`
`
`
`Patent Application Publication
`
`Jul. 7, 2011 Sheet 60 of 62
`
`US 2011/O163971 A1
`
`Display a presentation user interface Configured to present Content items
`from a set of content items in a predetermined sequence. The presentation
`user interface includes:
`
`A scrubber for navigating between content items in the set of Content
`items. The Scrubber includes:
`An ordered line of thumbnail representations for a plurality of
`Content items in the set of Content items. The Ordered line is
`Ordered in accordance with the predetermined sequence.
`
`-902
`
`-- 906
`
`The Ordered line is a row.
`
`v
`
`Each of the thumbnail representations has a width.
`
`The scrubber has a predefined maximum width.
`
`When the Sum of the Widths of the thumbnail
`representations of content items in the set of content items
`| is less than the predefined maximum width, the plurality of
`Content items includes all of the Content items in the set of
`Content items.
`
`When the Sum Of the Widths of the thumbnail
`representations of content items in the set of content items
`exceeds the predefined maximum width, the plurality of
`Content item