throbber
(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2011/0163971 A1
`Wagner et al.
`(43) Pub. Date:
`Jul. 7, 2011
`
`US 2011 0163971 A1
`
`(54) DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR NAVIGATING AND
`DISPLAYING CONTENT IN CONTEXT
`
`(76) Inventors:
`
`(21)
`(22)
`
`Appl. No.:
`
`Filed:
`
`Oliver P. Wagner, San Francisco,
`CA (US); Michael Matas, San
`Francisco, CA (US)
`12/789,441
`May 27, 2010
`
`Related U.S. Application Data
`(60) Provisional application No. 61/335,520, filed on Jan.
`6, 2010.
`
`Publication Classification
`
`(51)
`
`Int. C.
`G06F 3/04
`
`(2006.01)
`
`(52) U.S. Cl. ........................................................ 345/173
`
`ABSTRACT
`(57)
`An electronic device displays one or more thumbnails. The
`device detects a first multi-contact gesture that includes
`movement of a first contact and a second contact; and, in
`response to detecting the first multi-contact gesture, the
`device displays content associated with a respective thumb
`nail and enlarges the content associated with the respective
`thumbnail to a respective enlarged size in accordance with the
`first multi-contact gesture. The device detects termination of
`the first multi-contact gesture; and, in response to detecting
`termination of the first multi-contact gesture: when a resizing
`metric based on the first multi-contact gesture is below a
`predefined threshold, the device ceases to display the content
`at the respective enlarged size; and, when the resizing metric
`based on the first multi-contact gesture is above the pre
`defined threshold, the device displays the content on the dis
`play in a predefined arrangement.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Portable Multifunction Device 100
`210
`
`210 is SM card slot
`212 is headphone jack
`
`ouch Screen 112
`
`203
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`External Port 124
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 1 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 1 of 62
`
`US 2011/O163971 A1
`
`Memory
`102
`
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Text input Module
`GPs Module
`Applications
`Contacts Module
`Telephone Module
`Video Conference Module
`E-mail Client Module
`Instant Messaging Module
`Workout Support Module
`cameramie
`Camera Module
`mage Management Module
`Video Player Module
`Music Player Module
`BrOWSer Module
`
`126
`
`128
`
`3.
`136
`137
`138
`139
`140
`141
`142
`-
`a
`145
`146
`147
`
`Portable Multifunction Device
`1 OO
`Applications (Continued)
`Calendar Module
`Widget Modules
`Weather Widget
`Stocks Widget
`Calculator Widget
`Alarm Clock Widget
`Dictionary Widget
`
`136
`148
`149
`149-1
`149-2
`149-3
`149-4
`149-5
`
`User-Created Widget(s)
`Widget Creator Module
`Search Module
`
`Device/Global Internal State
`162
`
`Power
`System
`
`149-6
`150
`151
`
`157
`
`124
`
`External
`POrt
`103
`RF Circuitry
`108
`10
`Speaker
`N --1a 111
`AUCO EC
`Circuitry
`110 HO
`Microhone
`Proximity
`113
`
`118
`
`103
`Control
`OOe
`
`
`
`
`
`
`
`Processor(s)
`
`Peripherals
`Interface
`
`103
`
`104
`
`122
`
`120
`
`106
`
`156
`
`
`
`
`
`
`
`
`
`
`
`
`103
`
`m
`
`I/O Subsystem
`
`158
`
`Display
`Controller
`
`Optical sensor(s)
`Controller
`
`Other input
`Controller(s)
`
`160
`
`
`
`103
`
`Touch-Sensitive
`Display System
`
`112
`
`103
`
`Other input
`Control Devices
`
`116
`
`103
`Optical
`Sensor(s)
`164
`Figure 1A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 2 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 2 of 62
`
`US 2011/O163971 A1
`
`Memory 102
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`T
`ext input Module
`E.
`pplicationS
`Contacts Module
`Telephone Module
`Video Conference Module
`E-mail Client Modul
`dul
`E.
`g
`Workout Support Module
`Camera Module
`Image Management Module
`Video & Music Player Module
`Notes Module
`Map Module
`Browser Module
`
`104
`122
`
`120
`
`106
`
`156
`
`
`
`
`
`
`
`
`
`
`
`
`
`Controller
`
`Display
`Controller
`
`Portable Multifunction Device 100 136
`126 Applications (continued)
`148
`128
`149
`130
`132
`134
`135
`136
`137
`138
`139
`
`149-1
`149-2
`149-3
`149-4
`149-5
`
`149-6
`
`150
`151
`155
`
`157
`
`140
`141
`142
`143
`
`144
`152
`
`153
`154
`
`- 147
`
`118
`
`POWer
`System
`
`POrt
`
`162
`
`124
`
`RF Circuitr
`
`A Y-2 103
`
`Peripherals
`Interface
`
`103
`
`103
`
`111
`
`I
`AUCO
`110 HO
`Proximity
`Sensor
`
`Microhone
`113
`166
`
`103
`
`Accelerometer(s)
`168
`Aaaaaaaaaaaaaaa
`
`16O
`
`Other input
`Controller(s)
`"
`
`1Y 103
`
`103
`
`Touch-Sensitive
`Display System
`
`112
`
`Optical
`Sensor(s)
`164
`
`Other input
`Control Devices
`
`116
`
`Figure 1B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 3 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 3 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`J??uOS quêAE
`
`0/ |
`
`
`
`
`
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 4 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 4 of 62
`
`US 2011/O163971 A1
`
`Portable Multifunction Device 100
`210
`Optical
`Sensor 164
`
`Speaker 111
`
`Proximity
`Sensor 166
`
`206
`
`200
`
`OO
`S
`
`CN
`
`210 is SM Card Slot
`212 is headphone jack
`
`Touch Screen 11
`
`2 O 2
`
`2O3
`
`Microphone
`113
`
`/
`\
`Home
`204
`
`Accelerometer(s)
`168
`
`External Port 12
`Figure 2
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 5 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 5 of 62
`
`US 2011/O163971 A1
`
`Memory 370
`
`Applications
`
`Widget Modules
`
`Device 300
`a
`
`31 O
`
`330
`
`
`
`I/O Interface
`
`32O
`
`340
`
`Keyboard/Mouse - 350
`
`Touchpad
`
`355
`
`:
`User-Created Widget(s)
`
`360
`
`NetWork
`Communications
`Interface
`
`
`
`126
`128
`130
`132
`
`3.
`
`137
`
`138
`139
`140
`141
`142
`143
`144
`145
`
`146
`147
`148
`149
`149-1
`149-2
`
`149-3
`149-4
`149-5
`
`151
`380
`
`382
`
`3.
`
`388
`390
`
`b
`Device/Global Internal State
`
`157
`
`Figure 3
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 6 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 6 of 62
`
`US 2011/O163971 A1
`
`
`
`2O6
`
`Portable Multifunction Device
`100
`
`>
`
`--- -
`---
`---
`---
`---
`---
`
`PhOtOS
`144
`
`Camera
`143
`
`Videos
`145
`
`Jan
`15
`
`Calendar
`148
`
`Stocks
`149-2
`
`WorkOut
`Support
`142
`
`\
`
`-x- ?
`
`--
`
`--
`
`A
`Calculator
`149-3
`
`-
`
`-- -
`
`-
`8,
`
`-
`
`8
`
`^
`
`ABC ca
`
`\
`
`Y-
`
`---
`
`Dictionary
`149-5
`
`Widget
`Widget
`149-6
`
`\,
`
`--
`
`A
`
`---
`
`Alarm
`149-4
`
`Music
`146
`
`Touch SCreen 11
`
`Microphone / Home
`113
`\ 204
`
`Accelerometer(s)
`168
`
`Figure 4A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 7 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 7 of 62
`
`US 2011/O163971 A1
`
`
`
`Portable Mutifunction Device
`100
`
`Calculator
`49-3
`
`Settings
`412
`
`113
`
`? Home
`204
`
`Accelerometer(s)
`168
`
`Figure 4B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 8 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 8 of 62
`
`US 2011/O163971 A1
`
`45O
`
`468
`
`470
`
`453
`
`
`
`Figure 4C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 9 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 9 of 62
`
`US 2011/O163971 A1
`
`
`
`CJ SJOdS
`
`
`
`(sebela | sºoed | siuea= |sung?w | soloud)
`
`VG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 10 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 10 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`(sebeld | sºoed | suba=|sung?v |soloud)
`
`gG aun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 11 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 11 of 62
`
`US 2011/O163971 A1
`
`
`
`8.
`
`8&s
`
`3.
`.
`
`.
`
`.
`
`8
`
`.
`
`.
`
`:::::::::::::::::::::::::::::::::::::::::::::::::: 8 38383
`::::::::::
`88.888
`8 8
`::::::: 888
`:::::::::::::
`33333333333333333&S
`83
`
`.
`
`.
`
`.
`
`:8
`:
`
`38
`:::::::::::
`:::::::::::::::::::::::::::
`8
`
`8.
`
`32
`
`888
`
`8
`8
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 12 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 12 of 62
`
`US 2011/O163971 A1
`
`
`
`0 | -800G
`
`
`
`C1G ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 13 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 13 of 62
`
`US 2011/O163971 A1
`
`
`
`EG aun61-I
`
`z??G
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 14 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 14 of 62
`
`US 2011/O163971 A1
`
`
`
`G-8009
`
`9 | -0 | 09
`
`
`
`-IG eun61-I
`
`
`
`| -8009
`
`| | | | # # # # |
`
`------ | || -8009
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 15 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 15 of 62
`
`US 2011/O163971 A1
`
`
`
`C
`t
`A.
`Cen
`O
`
`f
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 16 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 16 of 62
`
`US 2011/O163971 A1
`
`
`
`HG aun61-I
`
`G-8009
`
`
`
`Z-800G| -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 17 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 17 of 62
`
`US 2011/O163971 A1
`
`
`
`9 | -8009
`
`IG eunfil
`
`9-8009
`
`| || -8009
`
`G-800G
`
`
`
`9-900GZ-8009| -900G
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 18 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 18 of 62
`
`US 2011/O163971 A1
`
`
`
`Ca
`
`s
`
`D
`s
`o
`
`S
`
`i
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 19 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 19 of 62
`
`US 2011/O163971 A1
`
`
`
`[sz]]
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 20 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 20 of 62
`
`US 2011/O163971 A1
`
`
`
`6-O?OUGH
`
`TG eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 21 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 21 of 62
`
`US 2011/O163971 A1
`
`
`
`9-O?OUGH
`
`[sui] (I
`
`q-0ZOGQ_^
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 22 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 22 of 62
`
`US 2011/O163971 A1
`
`
`
`9-7 | 09
`
`NG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 23 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 23 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`LZ || || 6 || L | / | | |
`
`OG 3 Infi?
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 24 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 24 of 62
`
`US 2011/O163971 A1
`
`
`
`9-800G
`
`0 | -900G
`
`dG ?un61-I
`
`9 | -800G
`
`Z || -9009
`
`-| || -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 25 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 25 of 62
`
`US 2011/O163971 A1
`
`
`
`G-800G
`
`0 || -8009
`
`Og aun61-I
`
`9 | -9009
`
`Z || -8009
`
`| || -8009
`
`| -8009
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 26 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 26 of 62
`
`US 2011/O163971 A1
`
`9 | -800G
`
`
`
`G-800G
`
`CN
`
`| -800G
`
`! |
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 27 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 27 of 62
`
`US 2011/O163971 A1
`
`
`
`SG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 28 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 28 of 62
`
`US 2011/O163971 A1
`
`
`
`LG ?un61-I
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 29 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 29 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`(sebeld | sºoed | siuea= | sung?v | soloud) 8069
`
`ng eun61
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 30 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 30 of 62
`
`US 2011/O163971 A1
`
`
`
`AG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 31 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 31 of 62
`
`US 2011/O163971 A1
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 32 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 32 of 62
`
`US 2011/O163971 A1
`
`
`
`suunqIV|
`
`XG aun61-I?79099909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 33 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 33 of 62
`
`US 2011/O163971 A1
`
`
`
`ZI, JO 6
`
`AG ?un61-I
`
`Z-8909
`
`| -890G
`
`7909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 34 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 34 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`
`
`^~-oos soweguonoun?hinw
`
`ZG ?un61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 35 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 35 of 62
`
`US 2011/O163971 A1
`
`Z || ||
`
`
`
`
`
`Vyg eun61-I
`
`L-O?OUGH7909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 36 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 36 of 62
`
`US 2011/O163971 A1
`
`
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 37 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 37 of 62
`
`US 2011/O163971 A1
`
`
`
`€ULIOH|XIJOM|seleiduel)
`
`
`
`oog eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 38 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 38 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`CICIG eun61-I
`
`G-0909
`
`Z || ||
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 39 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 39 of 62
`
`US 2011/0163971 Al
`
`S-Oplls
`
`§-990S
`
`
`
`
`
`OL-990SOL-PPIIS
`
`
`
`
`6-8PliS
`
`6-990S
`
`b-8PllS
`
`
`
`{~~
`
`OL-890S
`
`fo
`
`6-890S
`
`
`SL-990S
`GL-®PIIS
`
`
`
` VL-SPIIS
`
`vL-990S
`
`€-moysapl|s \_o0¢eorneg
`
`
`
`
`
`
`
`
`
`
`
`c~SPulSL-8PllS
`
`GL-890S5
`
`vL-890S
`
`€1-890S
`
`
`
`Aaseun6bi4
`
`
`
`
`
`
`
`
`
`CL-OPIISLb-OPlIS
`
`
`
`cb-990SLL-990S
`
`L-990S
`
`uonsunyniny
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 40 of 90
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 40 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 40 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`H-IG eun61-I
`
`--~-------- --^--------- --~--------|--~-------- --^---------n
`
`
`
`
`
`
`G|--8909?7|| -8909£| -8909Z|| -8909| || -8909
`
`- - - - - - - - - -
`
`| -9909
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 41 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 41 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`999 eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 42 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 42 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`HHG aun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 43 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 43 of 62
`
`US 2011/O163971 A1
`
`
`
`CD
`S
`O
`
`N4
`
`s
`
`O
`92
`C
`O.
`8
`CD
`H
`
`S
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 44 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 44 of 62
`
`US 2011/O163971 A1
`
`
`
`9-queuunood
`
`0 | -9809
`
`0 | -8809
`
`!---
`
`9 | -9809
`
`
`
`Trg eun61-I
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 45 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 45 of 62
`
`US 2011/O163971 A1
`
`
`
`0 | -9809
`
`01-9809
`
`9 | -9809
`
`
`
`XXG ?un61-I
`
`ZI, ?
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 46 of 90
`
`

`

`
` Sheet 46 of 62==US 2011/0163971 AlPublication
`Patent Application
`Jul. 7, 2011
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 47 of 90
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 47 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 47 of 62
`
`US 2011/O163971 A1
`
`600
`
`Displaying a plurality of pins on a map:
`
`Each of the pins is representative of content that is associated with a
`geographic location
`
`Each of the pins is displayed at a respective location on the map that
`corresponds to the geographic location of the content represented by
`the pin.
`
`|
`
`Detect a pin selection input associated with a respective pin of the
`plurality of pins
`
`In response to detecting the pin selection input, display the respective o
`thumbnail
`
`Display one or more thumbnails
`Each respective thumbnail of the one or more thumbnails is located at
`a respective initial region on the display and has a respective initial
`Size
`
`
`
`y
`Detect a first Contact and a Second Contact On the touch-Sensitive Surface
`| The first contact and the second contact are detected at locations on
`the touch-sensitive surface that correspond to an initial region of the
`respective thumbnail on the display
`
`- 612
`|- 613
`
`Figure 6A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 48 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 48 of 62
`
`US 2011/O163971 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`While continuing to detect the first contact and the second contact on the
`touch-Sensitive Surface:
`
`Detect a first multi-contact gesture that includes movement of the first
`COntact and the Second COntact
`
`- 614
`
`-- 616
`
`F.|- 620
`In response to detecting the first multi-contact gesture:
`
`--- 622
`
`— 624
`
`|- 626
`
`- 628
`
`|- 630
`
`-- 632
`
`-- 634
`
`Display content associated with a respective thumbnail
`
`|
`
`The Content is a plurality of images. The respective
`thumbnail is a representation of a stack of images that
`displays at least one image of the plurality of images.
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Displaying the content includes ceasing to display the
`respective thumbnail
`
`The respective thumbnail is a reduced-size representation
`of the content. Displaying the content includes enlarging
`the respective thumbnail.
`
`Figure 6B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 49 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 49 of 62
`
`US 2011/O163971 A1
`
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`
`- 614
`
`
`
`In response to detecting the first multi-contact gesture:
`Enlarge the content associated with the respective thumbnail to al
`respective enlarged size in accordance with the first multi-Contact
`gesture
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Enlarge the Content associated with the respective
`thumbnail to the respective enlarged size in accordance
`with the resizing metric
`
`:
`
`-
`
`|
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - L
`Enlarge the content associated with the respective
`| thumbnail to the respective enlarged size in proportion to
`|
`the resizing metric
`
`|
`
`Translate the content across the display in accordance with the
`first multi-Contact gesture
`
`Rotate the content in response to detecting the first multi-contact
`gesture
`
`The one or more thumbnails includes a plurality of thumbnails v
`other than the respective thumbnail.
`
`When the resizing metric based on the first multi-contact gesture
`reaches a predefined threshold, fade out the plurality of
`thumbnails.
`
`Detect termination of the first multi-contact gesture
`
`Figure 6C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 50 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 50 of 62
`
`US 2011/O163971 A1
`
`
`
`In response to detecting termination of the first multi-contact gesture
`When a resizing metric based on the first multi-contact gesture is
`below a predefined threshold
`Cease to display the Content at the respective enlarged size
`
`Redisplay the respective thumbnail in the initial region
`
`When the resizing metric based on the first multi-contact gesture is "--
`above the predefined threshold, display the Content on the display in a
`predefined arrangement
`
`In response to detecting the first multi-Contact gesture, rotate the
`content to an arbitrary angle in accordance with the first multi
`contact gesture.
`
`Displaying the content on the display in the predefined
`arrangement includes snapping the content to a predefined
`Orientation
`
`The Content includes a plurality of Content items. Displaying the
`Content on the display in the predefined arrangement includes
`displaying the Content items in a multi-row grid of Components
`
`Displaying the content on the display in the predefined
`arrangement includes displaying the content in a slideshow
`
`Detect a navigation input
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`In response to detecting the navigation input, navigate
`from the content to an adjacent image
`
`-
`
`-
`
`Figure 6D
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 51 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 51 of 62
`
`US 2011/O163971 A1
`
`in response to detecting termination of the first multi-contact gesture
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`-
`Enlarging the content includes resizing the content to an arbitrary
`Size.
`
`
`
`Displaying the content in a predefined arrangement in response
`to detecting termination of the first multi-contact gesture includes
`Snapping the Content to a predefined size.
`
`- 652
`
`- 658
`
`672
`
`Detect a third contact and a fourth Contact on the touch-sensitive
`Surface
`
`Detect a second multi-contact gesture that includes the third
`Contact and the fourth Contact
`
`A.
`y
`3.
`In response to detecting the Second multi-Contact gesture,
`enlarge the content to an enlarged size that is larger than the
`predefined size in accordance with the second multi-contact
`gesture
`
`|
`
`-
`
`676
`
`-- 678
`
`-
`
`- -
`
`l
`
`-
`-
`-
`-
`-
`- - - - - - - - - - - - - - - - - - - - - 680
`Detect termination of the second multi-contact gesture --
`
`.
`
`-
`
`- -
`
`-
`
`-
`
`-
`
`-
`
`After detecting termination of the second multi-contact gesture,
`continue to display the content at the enlarged size
`
`-
`
`-
`
`-
`
`-
`
`- -
`
`-
`
`-
`
`-
`
`- ---, -- 682
`
`Figure 6E
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 52 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 52 of 62
`
`US 2011/O163971 A1
`
`In response to detecting termination of the first multi-Contact gesture
`
`- 652
`
`
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`The one or more thumbnails include the respective thumbnail:
`and a plurality of other thumbnails arranged as an initial array of
`thumbnails. The content is a first image. Displaying the content
`in a predefined arrangement includes displaying the first image in
`a slideshow mode.
`
`While in Slideshow mode:
`
`Navigate from the first image to a subsequent image in the
`slideshow mode.
`
`Detect a third Contact and a fourth Contact on the touch-sensitive
`Surface.
`y
`Detect a second multi-contact gesture that includes the third
`Contact and the fourth Contact.
`y
`In response to detecting the Second multi-Contact gesture:
`
`-- 688
`
`690
`
`Exit the slideshow mode.
`
`Display an updated array of Content thumbnails that does not
`include a thumbnail for the subsequent image.
`
`Shrink the subsequent image in accordance with the second
`multi-contact gesture.
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`
`Detect termination of the second multi-contact gesture
`'- — 694
`In response to detecting termination of the second multi-contact
`gesture, display a thumbnail for the Subsequent image in the
`updated array
`
`Figure 6F
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 53 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 53 of 62
`
`US 2011/O163971 A1
`
`
`
`In response to detecting termination of the first multi-Contact gesture
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, displaying the content on the display
`in a predefined arrangement.
`
`The respective thumbnail is representative of respective content -
`that is aSSOciated with a respective geographical location.
`
`The respective thumbnail is displayed on a map in a region on
`the map that corresponds to the respective geographical location
`associated with the Content represented by the respective
`thumbnail.
`
`Enlarging the content associated with the respective thumbnail
`includes displaying the Content associated with the respective
`thumbnail overlaid on the map.
`
`Figure 6G
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 54 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 54 of 62
`
`US 2011/O163971 A1
`
`700
`
`Display one or more selectable objects
`
`- 702
`
`--
`
`Detect a first Contact and a second Contact. On the touch-sensitive Surface
`
`- 706
`
`708
`
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`Detect a first multi-Contact gesture that includes movement of the r
`Contact and the Second COntact
`y
`In response to detecting the first multi-contact gesture:
`Display content associated with a respective selectable object
`
`-- 710
`
`-- 712
`
`Enlarge the content associated with the respective selectable
`object to a respective enlarged size in accordance with the first
`multi-contact gesture
`
`
`
`-- 714
`
`
`
`Detect termination of the first multi-contact gesture
`
`In response to detecting termination of the first multi-contact gesture:
`
`When a resizing metric based on the first multi-contact gesture is
`below a predefined threshold, cease to display the content at the
`respective enlarged size
`
`
`
`---
`
`
`
`When the resizing metric based on the first multi-contact gesture is
`above the predefined threshold, display the content on the display in a
`predefined arrangement
`
`- 716
`
`-718
`-- 720
`
`- 722
`
`Figure 7
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 55 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 55 of 62
`
`US 2011/O163971 A1
`
`800
`
`Display a plurality of album thumbnails
`
`A respective album thumbnail represents a respective plurality of
`Content items
`
`-
`
`Each respective album thumbnail of the plurality of album thumbnails
`is located at a respective initial region on the display and has a
`respective initial size
`
`a
`
`Detect a first Contact and a Second Contact On the touch-Sensitive Surface
`
`The first Contact and the Second Contact are detected at locations On
`the touch-sensitive surface that correspond to an initial region of a
`respective album thumbnail on the display
`
`t
`While continuing to detect the first contact and the second contact on the
`touch-sensitive surface:
`
`Detect a first multi-contact gesture that includes movement of the first
`Contact and the Second Contact
`
`- 802
`- 804
`
`- 806
`
`- 808
`810
`
`-812
`
`– 814
`
`
`
`In response to detecting the first multi-contact gesture:
`Display representations of content items associated with the
`respective album thumbnail
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`Cease to display the respective album thumbnail in an initial
`region of the respective album thumbnail
`|
`
`|- 816
`818
`
`.
`
`-- 820
`
`y
`Detect termination of the first multi-contact gesture
`
`- 822
`
`(a)
`
`Figure 8A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 56 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 56 of 62
`
`US 2011/O163971 A1
`
`In response to detecting termination of the first multi-Contact gesture:
`
`When a first resizing metric based on the first multi-contact gesture is
`below a predefined threshold:
`Cease to display the representations of the Content items
`associated with the respective album thumbnail
`
`-
`
`-
`
`Redisplaying the respective album thumbnail
`
`- - - -n or an or or or me are me or - w - - - - or or me a - m or m me -m or - or m so on was or - or me -
`
`When the first resizing metric based on the first multi-contact gesture
`is above the predefined threshold, display the representations of the
`content items associated with the respective album thumbnail on the
`display in a first predefined arrangement. A respective representation
`of a content item is a respective Content thumbnail that is associated
`with a respective content item.
`
`While displaying the representations of the content items associated with M
`the respective album thumbnail on the display in the first predefined
`arrangement, detect a third contact and a fourth contact on the touch
`Sensitive Surface
`
`
`
`The third Contact and the fourth Contact are detected at locations on
`the touch-sensitive surface that correspond to an initial region of the
`respective Content thumbnail on the display
`
`Figure 8B
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 57 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 57 of 62
`
`US 2011/O163971 A1
`
`While continuing to detect the third contact and the fourth contact on the
`touch-Sensitive surface:
`
`Detect a second multi-contact gesture that includes movement of the -
`third Contact and the fourth Contact
`
`-838
`- 840
`
`In response to detecting the second multi-contact gesture:
`
`Display the respective Content item that is associated with the
`respective content thumbnail
`
`Cease to display the respective Content thumbnail in an initial
`region of the respective content thumbnail
`
`-
`
`- 848
`
`- 850
`
`
`
`Detect termination of the second multi-contact gesture
`y
`In response to detecting termination of the second multi-contact gesture:
`When a second resizing metric based on the second multi-contact
`gesture is below a predefined threshold:
`Cease to display the respective content item that is associated
`with the respective content thumbnail
`
`Redisplay the respective content thumbnail
`
`Figure 8C
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 58 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 58 of 62
`
`US 2011/O163971 A1
`
`- 850
`858
`
`-- 860
`
`-- 862
`
`-- 864
`
`In response to detecting termination of the second multi-contact gesture:
`When the second resizing metric based on the second multi-contact
`gesture is above the predefined threshold:
`Display the respective content item in a second predefined
`arrangement
`
`---
`
`The first predefined arrangement of the representations of the
`Content items associated with the respective album thumbnail is
`an initial array of content thumbnails. The respective Content
`item is a first image. Displaying the respective content item in |
`the second predefined arrangement includes displaying the first
`image in a slideshow mode.
`y
`While in the slideshow mode:
`
`Navigate from the first image to a subsequent image in the
`slideshow mode.
`
`Detect a fifth contact and a sixth contact on the touch-sensitive
`Surface.
`
`Detect a third multi-contact gesture that includes the fifth contact
`and the Sixth Contact.
`
`-
`
`y
`In response to detecting the third multi-contact gesture:
`
`--866
`
`Exit the slideshow mode.
`
`Display an updated array of content thumbnails that does not
`include a content thumbnail for the subsequent image.
`
`Shrink the subsequent image in accordance with the third multi
`contact gesture.
`y
`Detect termination of the third multi-contact gesture
`
`-
`w
`y
`mo m m
`In response to detecting termination of the third multi-contact ....... --
`gesture, display the content thumbnail for the subsequent image
`in the updated array.
`
`-- 868
`
`- - 870
`
`Figure 8D
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 59 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 59 of 62
`
`US 2011/O163971 A1
`
`90
`
`Display a presentation user interface Configured to present Content items
`from a set of content items in a predetermined sequence. The presentation
`user interface includes:
`
`A display region for displaying a currently displayed content item in the T
`Set of Content items
`
`- 902
`
`- 904
`
`A scrubber for navigating between content items in the set of content
`items. The Scrubber includes:
`
`
`
`An ordered line of thumbnail representations for a plurality of
`Content items in the set of Content items. The Ordered line is
`ordered in accordance with the predetermined sequence.
`--
`
`The plurality of content items includes at least one video
`and at least one image
`
`The Ordered line is a Column.
`
`Each of the thumbnail representations has a height.
`
`The scrubber has a predefined maximum height.
`
`When the sum of the heights of the thumbnail
`representations of content items in the set of content items
`is less than the predefined maximum height, the plurality of
`Content items includes all of the Content items in the set of
`Content items.
`
`When the sum of the heights of the thumbnail
`representations of content items in the set of content items
`exceeds the predefined maximum height, the plurality of
`Content items includes less than all of the Content items in
`the set of Content items.
`
`When the plurality of content items includes less than
`all of the Content items in the set of Content items, the
`plurality of Content items is selected using predefined
`Criteria
`
`-906
`
`--- 908
`
`-- 910
`
`-- 912
`
`-- 914
`
`Figure 9A
`
`UNIFIED PATENTS EXHIBIT 1006
`Page 60 of 90
`
`

`

`Patent Application Publication
`
`Jul. 7, 2011 Sheet 60 of 62
`
`US 2011/O163971 A1
`
`Display a presentation user interface Configured to present Content items
`from a set of content items in a predetermined sequence. The presentation
`user interface includes:
`
`A scrubber for navigating between content items in the set of Content
`items. The Scrubber includes:
`An ordered line of thumbnail representations for a plurality of
`Content items in the set of Content items. The Ordered line is
`Ordered in accordance with the predetermined sequence.
`
`-902
`
`-- 906
`
`The Ordered line is a row.
`
`v
`
`Each of the thumbnail representations has a width.
`
`The scrubber has a predefined maximum width.
`
`When the Sum of the Widths of the thumbnail
`representations of content items in the set of content items
`| is less than the predefined maximum width, the plurality of
`Content items includes all of the Content items in the set of
`Content items.
`
`When the Sum Of the Widths of the thumbnail
`representations of content items in the set of content items
`exceeds the predefined maximum width, the plurality of
`Content item

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket