(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2007/0150842 A1
`(43) Pub. Date:
`Jun. 28, 2007
`Chaudhri et al.
`
`US 2007 O150842A1
`
`(54) UNLOCKING A DEVICE BY PERFORMING
`GESTURES ON AN UNLOCK IMAGE
`
`(76) Inventors: Imran Chaudhri, San Francisco, CA
`(US); Bas Ording, San Francisco, CA
`(US); Freddy Allen Anzures, San
`Francisco, CA (US); Marcel Van Os,
`San Francisco, CA (US); Stephen O.
`Lemay, San Francisco, CA (US); Scott
`Forstall, Mountain View, CA (US);
`Greg Christie, San Jose, CA (US)
`Correspondence Address:
`MORGAN LEWIS & BOCKUS LLP, APPLE
`COMPUTER INC.
`2 PALO ALTO SQUARE
`3OOOEL CAMINO REAL
`PALO ALTO, CA 94.306 (US)
`(21) Appl. No.:
`11/322,549
`
`(22) Filed:
`
`Dec. 23, 2005
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`G06F 3/00
`(52) U.S. Cl. .............................................................. 71.5/863
`
`(57)
`
`ABSTRACT
`
`A device with a touch-sensitive display may be unlocked via
`gestures performed on the touch-sensitive display. The
`device is unlocked if contact with the display corresponds to
`a predefined gesture for unlocking the device. The device
`displays one or more unlock images with respect to which
`the predefined gesture is to be performed in order to unlock
`the device. The performance of the predefined gesture with
`respect to the unlock image may include moving the unlock
`image to a predefined location and/or moving the unlock
`image along a predefined path. The device may also display
`visual cues of the predefined gesture on the touch screen to
`remind a user of the gesture.
`
`
`
`Device
`400
`
`Touch SCreen 408
`
`Menu
`Button 410
`
`Petitioners Samsung and Sony Ex-1007, 0001
`
`

`

`144
`
`150
`152
`146
`
`108
`
`1
`10
`
`
`
`Memory
`Controller
`
`104
`
`111
`
`106
`
`CPU
`
`O
`Peripherals
`Interface
`
`11 O
`
`110
`
`110
`
`RF Circuitry
`112
`
`External POrt
`
`Speaker
`116
`
`Audio HI
`Circuitry
`114. O
`Microphone
`118
`
`Patent Application Publication Jun. 28, 2007 Sheet 1 of 15
`
`US 2007/O150842 A1
`
`Memory 102
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Optical Intensity Module
`
`Figure 1
`132
`134
`138
`140
`142
`
`Device 100
`-
`
`
`
`
`
`
`
`User Interface State Module
`
`LOCk Module
`Unlock Module
`Application(s)
`
`110
`
`
`
`I/O Subsystem 120
`
`Touch-Screen
`Controller 122
`
`Other input
`Controller(s) 124
`
`110
`
`
`
`110
`
`Touch Screen
`126
`
`Other input/
`Control Devices
`128
`
`Petitioners Samsung and Sony Ex-1007, 0002
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 2 of 15
`
`US 2007/O150842 A1
`
`Se
`
`200
`
`N
`
`Device
`
`
`
`Device set to user
`interface lock state by
`any predefined
`manner, prevent
`device from
`performing predefined
`Set of actions
`
`
`
`
`
`
`
`
`
`
`
`206
`
`Contact the touch
`sensitive display
`
`
`
`Figure 2
`
`Display visual Cue(s)
`of unlock action (e.g.,
`gesture)
`
`Detect Contact With
`touch sensitive
`display
`
`Yes
`
`Does Contact
`correspond to
`unlock gesture?
`
`Maintain device in
`user interface lock
`State
`
`
`
`Transition device to
`user interface unlock
`State
`
`
`
`
`
`
`
`
`
`
`
`
`
`Petitioners Samsung and Sony Ex-1007, 0003
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 3 of 15
`
`US 2007/O150842 A1
`
`User
`
`300 N
`
`Device
`
`
`
`
`
`306
`
`Contact the touch
`sensitive display
`
`
`
`Figure 3
`
`Device Set to user
`interface lock state by
`any predefined
`manner, prevent
`device from
`performing predefined
`set of actions
`
`Display unlock image
`and visual cue(s) of
`unlock action using the
`image (e.g., gesture,
`moving image to
`location, moving
`image along path)
`
`Detect Contact with
`touch sensitive display
`
`Does contact
`correspond to unlock
`gesture using the
`image?
`
`Maintain device in
`user interface lock
`State
`
`
`
`Transition device to
`user interface unlock
`State
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Petitioners Samsung and Sony Ex-1007, 0004
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 4 of 15
`
`US 2007/O150842 A1
`
`Device
`400
`Na
`
`Touch Screen 408
`
`Figure 4A
`
`
`
`Touch Screen 408
`
`Device
`400
`
`Figure 4B
`
`Petitioners Samsung and Sony Ex-1007, 0005
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 5 of 15
`
`US 2007/O150842 A1
`
`
`
`Device
`400
`
`Touch SCreen 408
`
`Figure 5A
`
`Touch Screen 408
`
`Device
`400
`
`Figure 5B
`
`502
`
`Movement
`504
`
`Menu
`Button 410
`
`Petitioners Samsung and Sony Ex-1007, 0006
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 6 of 15
`
`US 2007/O150842 A1
`
`Touch Screen 408
`
`Device
`400
`Na
`
`Figure 5C
`
`Movement
`504
`
`Menu
`Button 410
`
`
`
`Touch Screen 408
`
`A
`
`A
`
`A
`
`R|| | COCOG)C)
`GE)(E)(i)(a)
`
`Device
`400
`
`A
`
`Figure 5D
`
`App
`9
`
`App
`10
`
`App
`11
`
`App
`12
`
`506
`
`Menu
`Button 410
`
`Petitioners Samsung and Sony Ex-1007, 0007
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 7 of 15
`
`US 2007/O150842 A1
`
`6OO N
`
`
`
`While an electronic device is in a first user
`interface state, detect progress towards
`satisfaction of a user input condition needed to
`transition to a second user-interface state
`
`While the device is in the first user-interface
`state, indicate progress towards satisfaction of
`the condition by transitioning an optical intensity
`of one or more user interface objects associated
`With the Second user-interface State
`
`Transition the device to the Second user
`interface State if the Condition is Satisfied
`
`Figure 6
`
`Petitioners Samsung and Sony Ex-1007, 0008
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 8 of 15
`
`US 2007/O150842 A1
`
`Touch screen 714
`
`Incoming call from:
`John Doe
`mobile
`
`Device
`
`700 Na
`
`Figure 7A
`
`
`
`Touch Screen 714
`
`7O6
`
`Incoming call from:
`John Doe
`mobile
`
`Figure 7B
`
`Movement
`712
`
`Petitioners Samsung and Sony Ex-1007, 0009
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 9 of 15
`
`US 2007/0150842 A1
`
`Touch Screen 714
`
`706
`
`incoming call from:
`John DOe
`
`Device
`700
`
`Figure 7C
`
`MOVement
`712
`
`
`
`Touch Screen 714
`
`706
`
`Device
`700
`
`Incoming call from:
`John Doe
`mobile
`
`Figure 7D
`
`Petitioners Samsung and Sony Ex-1007, 0010
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 10 of 15
`
`US 2007/O150842 A1
`
`Figure 8A
`
`Figure 8B
`
`|
`
`
`
`|
`
`Completion
`
`100%
`
`O%
`
`Completion
`
`100%
`
`Figure 8C
`
`:
`
`O O%
`
`Completion
`
`100%
`
`Petitioners Samsung and Sony Ex-1007, 0011
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 11 of 15
`
`US 2007/O150842 A1
`
`User
`
`900 N
`
`Device
`
`
`
`906
`
`
`
`
`
`
`
`
`
`Contact the touch
`sensitive display
`
`
`
`
`
`Figure 9
`
`
`
`
`
`
`
`
`
`Device Set to user
`interface lock state by
`any predefined manner,
`prevent device from
`performing predefined
`set of actions
`
`Display 2 (or more)
`unlock images and
`visual cue(s) of manner
`of transitioning to active
`state using the images
`
`908
`
`Detect contact with
`touch sensitive display
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Does Contact
`correspond to unlock
`gesture using an
`image?
`
`Maintain device in user
`interface lock State
`
`Transition device to
`active state
`corresponding to the
`image used (e.g., first
`image -> first active
`state, second image->
`second active state, ...)
`
`
`
`Petitioners Samsung and Sony Ex-1007, 0012
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 12 of 15
`
`US 2007/O150842 A1
`
`
`
`Device
`1000
`
`Touch Screen 1014
`
`Figure 10
`
`Petitioners Samsung and Sony Ex-1007, 0013
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 13 of 15
`
`US 2007/O150842 A1
`
`Touch Screen 1014
`
`Device
`1 OOO
`Nal
`
`O08
`
`a.
`
`Figure 11A
`
`
`
`Touch Screen 1014
`
`Device
`1OOO
`
`Figure 11B
`
`110
`
`Movement
`4 11 O4
`
`Petitioners Samsung and Sony Ex-1007, 0014
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 14 of 15
`
`US 2007/O150842 A1
`
`Touch Screen 1014
`
`Figure 11C
`
`s
`
`Movement
`1104
`
`Device
`1000
`
`
`
`
`
`Touch Screen 1014
`
`New text message
`Read message?
`
`Device
`1OOO
`Ne
`
`Figure 11D
`
`Petitioners Samsung and Sony Ex-1007, 0015
`
`

`

`Patent Application Publication Jun. 28, 2007 Sheet 15 of 15
`
`US 2007/O150842 A1
`
`Touch Screen 1014
`
`Device
`1000
`
`Figure 11E
`
`100
`
`Movement
`1 104
`
`
`
`Device
`1000
`Nal
`
`Artist X
`2 : 05 || 4 - 21
`
`Figure 11F
`(C) () (O) () () () ()
`——
`
`1108
`Touch Screen 1014
`
`Petitioners Samsung and Sony Ex-1007, 0016
`
`

`

`US 2007/O 150842 A1
`
`Jun. 28, 2007
`
`UNLOCKING ADEVICE BY PERFORMING
`GESTURES ON AN UNLOCK IMAGE
`
`RELATED APPLICATIONS
`0001. This application is related to U.S. patent applica
`tion Ser. No.
`attorney docket number 063266-5010
`US, titled “Indication of Progress Towards Satisfaction of a
`User Input Condition, filed
`2005, which applica
`tion is incorporated by reference herein in its entirety.
`
`TECHNICAL FIELD
`0002 The disclosed embodiments relate generally to user
`interfaces that employ touch-sensitive displays, and more
`particularly, to the unlocking of user interfaces on portable
`electronic devices.
`
`BACKGROUND
`0003 Touch-sensitive displays (also known as “touch
`screens' or “touchscreens') are well known in the art. Touch
`screens are used in many electronic devices to display
`graphics and text, and to provide a user interface through
`which a user may interact with the devices. A touch screen
`detects and responds to contact on the touch screen. A device
`may display one or more soft keys, menus, and other
`user-interface objects on the touch screen. A user may
`interact with the device by contacting the touch screen at
`locations corresponding to the user-interface objects with
`which she wishes to interact.
`0004 Touch screens are becoming more popular for use
`as displays and as user input devices on portable devices,
`Such as mobile telephones and personal digital assistants
`(PDAs). One problem associated with using touch screens
`on portable devices is the unintentional activation or deac
`tivation of functions due to unintentional contact with the
`touch screen. Thus, portable devices, touch screens on Such
`devices, and/or applications running on Such devices may be
`locked upon satisfaction of predefined lock conditions. Such
`as upon entering an active call, after a predetermined time of
`idleness has elapsed, or upon manual locking by a user.
`0005 Devices with touch screens and/or applications
`running on Such devices may be unlocked by any of several
`well-known unlocking procedures, such as pressing a pre
`defined set of buttons (simultaneously or sequentially) or
`entering a code or password. These unlock procedures,
`however, have drawbacks. The button combinations may be
`hard to perform. Creating, memorizing, and recalling pass
`words, codes, and the like can be quite burdensome. These
`drawbacks may reduce the ease of use of the unlocking
`process and, as a consequence, the ease of use of the device
`in general.
`0006.
`Accordingly, there is a need for more efficient,
`user-friendly procedures for unlocking Such devices, touch
`screens, and/or applications. More generally, there is a need
`for more efficient, user-friendly procedures for transitioning
`Such devices, touch screens, and/or applications between
`user interface states (e.g., from a user interface state for a
`first application to a user interface state for a second appli
`cation, between user interface States in the same application,
`or between locked and unlocked states). In addition, there is
`a need for sensory feedback to the user regarding progress
`towards satisfaction of a user input condition that is required
`for the transition to occur.
`
`SUMMARY
`0007. In some embodiments, a method of controlling an
`electronic device with a touch-sensitive display includes:
`detecting contact with the touch-sensitive display while the
`device is in a user-interface lock state; moving an image
`corresponding to a user-interface unlock state of the device
`in accordance with the contact; transitioning the device to
`the user-interface unlock state if the detected contact corre
`sponds to a predefined gesture; and maintaining the device
`in the user-interface lock state if the detected contact does
`not correspond to the predefined gesture.
`0008. In some embodiments, a method of controlling a
`device with a touch-sensitive display includes: displaying an
`image on the touch-sensitive display while the device is in
`a user-interface lock state; detecting contact with the touch
`sensitive display; transitioning the device to a user-interface
`unlock State if the detected contact corresponds to moving
`the image to a predefined location on the touch-sensitive
`display; and maintaining the device in the user-interface
`lock state if the detected contact does not correspond to
`moving the image to the predefined location.
`0009. In some embodiments, a method of controlling a
`device with a touch-sensitive display includes: displaying an
`image on the touch-sensitive display while the device is in
`a user-interface lock state; detecting contact with the touch
`sensitive display; and transitioning the device to a user
`interface unlock state if the detected contact corresponds to
`moving the image on the touch-sensitive display according
`to a predefined path on the touch-sensitive display; and
`maintaining the device in the user-interface lock state if the
`detected contact does not correspond to moving the image
`according to the predefined path.
`0010. In some embodiments, a method of controlling a
`device with a touch-sensitive display includes: displaying
`first and second images on the touch-sensitive display while
`the device is in a user-interface lock state; detecting contact
`with the touch-sensitive display; transitioning the device to
`a first active state corresponding to the first image if the
`detected contact corresponds to a predefined gesture with
`respect to the first image; and transitioning the device to a
`second active state distinct from the first active state if the
`detected contact corresponds to a predefined gesture with
`respect to the second image.
`0011. The aforementioned methods may be performed by
`a portable electronic device having a touch-sensitive display
`with a graphical user interface (GUI), one or more proces
`sors, memory and one or more modules, programs or sets of
`instructions stored in the memory for performing these
`methods. In some embodiments, the portable electronic
`device provides a plurality of functions, including wireless
`communication.
`0012 Instructions for performing the aforementioned
`methods may be included in a computer program product
`configured for execution by one or more processors.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0013 For a better understanding of the aforementioned
`embodiments of the invention as well as additional embodi
`ments thereof, reference should be made to the Description
`of Embodiments below, in conjunction with the following
`
`Petitioners Samsung and Sony Ex-1007, 0017
`
`

`

`US 2007/O 150842 A1
`
`Jun. 28, 2007
`
`drawings in which like reference numerals refer to corre
`sponding parts throughout the figures.
`0014 FIG. 1 is a block diagram illustrating a portable
`electronic device, according to Some embodiments of the
`invention.
`0.015
`FIG. 2 is a flow diagram illustrating a process for
`transitioning a device to a user-interface unlock state,
`according to Some embodiments of the invention.
`0016 FIG. 3 is a flow diagram illustrating a process for
`transitioning a device to a user-interface unlock state,
`according to Some embodiments of the invention.
`0017 FIGS. 4A-4B illustrate the GUI display of a device
`in a user-interface lock state, according to some embodi
`ments of the invention.
`0018 FIGS.5A-5D illustrate the GUI display of a device
`at various points of the performance of an unlock action
`gesture, according to Some embodiments of the invention.
`0.019
`FIG. 6 is a flow diagram illustrating a process for
`indicating progress towards satisfaction of a user input
`condition according to Some embodiments of the invention.
`0020 FIGS. 7A-7D illustrate the GUI display of a device
`that is transitioning the optical intensity of user-interface
`objects, according to some embodiments of the invention.
`0021
`FIGS. 8A-8C are graphs illustrating optical inten
`sity as a function of the completion of the user input
`condition, according to some embodiments of the invention.
`0022 FIG. 9 is a flow diagram illustrating a process for
`transitioning a device to a user interface active state, accord
`ing to Some embodiments of the invention.
`0023 FIG. 10 illustrates the GUI of a device in a user
`interface lock state that displays a plurality of unlock
`images, according to some embodiments of the invention.
`0024 FIGS. 11A-11F illustrate the GUI display of a
`device at various points in the performance of an unlock
`action gesture, according to some embodiments of the
`invention.
`
`DESCRIPTION OF EMBODIMENTS
`Reference will now be made in detail to embodi
`0.025
`ments, examples of which are illustrated in the accompany
`ing drawings. In the following detailed description, numer
`ous specific details are set forth in order to provide a
`thorough understanding of the present invention. However,
`it will be apparent to one of ordinary skill in the art that the
`present invention may be practiced without these specific
`details. In other instances, well-known methods, procedures,
`components, and circuits have not been described in detail
`So as not to unnecessarily obscure aspects of the embodi
`mentS.
`0026 FIG. 1 illustrates a portable electronic device,
`according to some embodiments of the invention. The
`device 100 includes a memory 102, a memory controller
`104, one or more processing units (CPUs) 106, a periph
`erals interface 108, RF circuitry 112, audio circuitry 114, a
`speaker 116, a microphone 118, an input/output (I/O) sub
`system 120, a touch screen 126, other input or control
`devices 128, and an external port 148. These components
`communicate over the one or more communication buses or
`
`signal lines 110. The device 100 can be any portable
`electronic device, including but not limited to a handheld
`computer, a tablet computer, a mobile phone, a media player,
`a personal digital assistant (PDA), or the like, including a
`combination of two or more of these items. It should be
`appreciated that the device 100 is only one example of a
`portable electronic device 100, and that the device 100 may
`have more or fewer components than shown, or a different
`configuration of components. The various components
`shown in FIG.1 may be implemented in hardware, software
`or a combination of both hardware and software, including
`one or more signal processing and/or application specific
`integrated circuits.
`0027. The memory 102 may include high speed random
`access memory and may also include non-volatile memory,
`Such as one or more magnetic disk storage devices, flash
`memory devices, or other non-volatile solid state memory
`devices. In some embodiments, the memory 102 may further
`include storage remotely located from the one or more
`processors 106, for instance network attached storage
`accessed via the RF circuitry 112 or external port 148 and a
`communications network (not shown) Such as the Internet,
`intranet(s), Local Area Networks (LANs), Wide Local Area
`Networks (WLANs), Storage Area Networks (SANs) and
`the like, or any suitable combination thereof. Access to the
`memory 102 by other components of the device 100, such as
`the CPU 106 and the peripherals interface 108, may be
`controlled by the memory controller 104.
`0028. The peripherals interface 108 couples the input and
`output peripherals of the device to the CPU 106 and the
`memory 102. The one or more processors 106 run various
`Software programs and/or sets of instructions stored in the
`memory 102 to perform various functions for the device 100
`and to process data.
`0029. In some embodiments, the peripherals interface
`108, the CPU 106, and the memory controller 104 may be
`implemented on a single chip, such as a chip 111. In some
`other embodiments, they may be implemented on separate
`chips.
`0030) The RF (radio frequency) circuitry 112 receives
`and sends electromagnetic waves. The RF circuitry 112
`converts electrical signals to/from electromagnetic waves
`and communicates with communications networks and other
`communications devices via the electromagnetic waves. The
`RF circuitry 112 may include well-known circuitry for
`performing these functions, including but not limited to an
`antenna system, an RF transceiver, one or more amplifiers,
`a tuner, one or more oscillators, a digital signal processor, a
`CODEC chipset, a subscriber identity module (SIM) card,
`memory, and so forth. The RF circuitry 112 may commu
`nicate with the networks, such as the Internet, also referred
`to as the World Wide Web (WWW), an Intranet and/or a
`wireless network, Such as a cellular telephone network, a
`wireless local area network (LAN) and/or a metropolitan
`area network (MAN), and other devices by wireless com
`munication. The wireless communication may use any of a
`plurality of communications standards, protocols and tech
`nologies, including but not limited to Global System for
`Mobile Communications (GSM), Enhanced Data GSM
`Environment (EDGE), wideband code division multiple
`access (W-CDMA), code division multiple access (CDMA),
`time division multiple access (TDMA), Bluetooth, Wireless
`
`Petitioners Samsung and Sony Ex-1007, 0018
`
`

`

`US 2007/O 150842 A1
`
`Jun. 28, 2007
`
`Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE
`802.11g and/or IEEE 802.11n), voice over Internet Protocol
`(VoIP), Wi-MAX, a protocol for email, instant messaging,
`and/or Short Message Service (SMS)), or any other suitable
`communication protocol, including communication proto
`cols not yet developed as of the filing date of this document.
`0031. The audio circuitry 114, the speaker 116, and the
`microphone 118 provide an audio interface between a user
`and the device 100. The audio circuitry 114 receives audio
`data from the peripherals interface 108, converts the audio
`data to an electrical signal, and transmits the electrical signal
`to the speaker 116. The speaker converts the electrical signal
`to human-audible sound waves. The audio circuitry 114 also
`receives electrical signals converted by the microphone 116
`from sound waves. The audio circuitry 114 converts the
`electrical signal to audio data and transmits the audio data to
`the peripherals interface 108 for processing. Audio data may
`be may be retrieved from and/or transmitted to the memory
`102 and/or the RF circuitry 112 by the peripherals interface
`108. In some embodiments, the audio circuitry 114 also
`includes a headset jack (not shown). The headset jack
`provides an interface between the audio circuitry 114 and
`removable audio input/output peripherals, such as output
`only headphones or a headset with both output (headphone
`for one or both ears) and input (microphone).
`0032) The I/O subsystem 120 provides the interface
`between input/output peripherals on the device 100, such as
`the touch screen 126 and other input/control devices 128,
`and the peripherals interface 108. The I/O subsystem 120
`includes a touch-screen controller 122 and one or more input
`controllers 124 for other input or control devices. The one or
`more input controllers 124 receive/send electrical signals
`from/to other input or control devices 128. The other input/
`control devices 128 may include physical buttons (e.g., push
`buttons, rocker buttons, etc.), dials, slider Switches, Sticks,
`and so forth.
`0033. The touch screen 126 provides both an output
`interface and an input interface between the device and a
`user. The touch-screen controller 122 receives/sends elec
`trical signals from/to the touch screen 126. The touch screen
`126 displays visual output to the user. The visual output may
`include text, graphics, video, and any combination thereof.
`Some or all of the visual output may correspond to user
`interface objects, further details of which are described
`below.
`0034. The touch screen 126 also accepts input from the
`user based on haptic and/or tactile contact. The touch screen
`126 forms a touch-sensitive surface that accepts user input.
`The touch screen 126 and the touch screen controller 122
`(along with any associated modules and/or sets of instruc
`tions in the memory 102) detects contact (and any move
`ment or break of the contact) on the touch screen 126 and
`converts the detected contact into interaction with user
`interface objects, such as one or more soft keys, that are
`displayed on the touch screen. In an exemplary embodiment,
`a point of contact between the touch screen 126 and the user
`corresponds to one or more digits of the user. The touch
`screen 126 may use LCD (liquid crystal display) technology,
`or LPD (light emitting polymer display) technology,
`although other display technologies may be used in other
`embodiments. The touch screen 126 and touch screen con
`troller 122 may detect contact and any movement or break
`
`thereof using any of a plurality of touch sensitivity tech
`nologies, including but not limited to capacitive, resistive,
`infrared, and Surface acoustic wave technologies, as well as
`other proximity sensor arrays or other elements for deter
`mining one or more points of contact with the touch screen
`126. The touch-sensitive display may be analogous to the
`multi-touch sensitive tablets described in the following U.S.
`Pat. Nos. 6,323,846 (Westerman et al.), 6,570,557 (Wester
`man et al.), and/or 6,677.932 (Westerman), and/or U.S.
`Patent Publication 2002/0015024A1, each of which is
`hereby incorporated by reference. However, the touch
`screen 126 displays visual output from the portable device,
`whereas touch sensitive tablets do not provide visual output.
`The touch screen 126 may have a resolution in excess of 100
`dpi. In an exemplary embodiment, the touch screen 126 may
`have a resolution of approximately 168 dpi. The user may
`make contact with the touch screen 126 using any Suitable
`object or appendage, such as a stylus, finger, and so forth.
`0035) In some embodiments, in addition to the touch
`screen, the device 100 may include a touchpad (not shown)
`for activating or deactivating particular functions. In some
`embodiments, the touchpad is a touch-sensitive area of the
`device that, unlike the touch screen, does not display visual
`output. The touchpad may be a touch-sensitive Surface that
`is separate from the touch screen 126 or an extension of the
`touch-sensitive surface formed by the touch screen 126.
`0036) The device 100 also includes a power system 130
`for powering the various components. The power system
`130 may include a power management system, one or more
`power sources (e.g., battery, alternating current (AC)), a
`recharging system, a power failure detection circuit, a power
`converter or inverter, a power status indicator (e.g., a light
`emitting diode (LED)) and any other components associated
`with the generation, management and distribution of power
`in portable devices.
`0037. In some embodiments, the software components
`include an operating system 132, a communication module
`(or set of instructions) 134, a contact/motion module (or set
`of instructions) 138, a graphics module (or set of instruc
`tions) 140, a user interface state module (or set of instruc
`tions) 144, and one or more applications (or set of instruc
`tions) 146.
`0038. The operating system 132 (e.g., Darwin, RTXC,
`LINUX, UNIX, OS X, WINDOWS, or an embedded oper
`ating system Such as VxWorks) includes various software
`components and/or drivers for controlling and managing
`general System tasks (e.g., memory management, storage
`device control, power management, etc.) and facilitates
`communication between various hardware and software
`components.
`0039 The communication module 134 facilitates com
`munication with other devices over one or more external
`ports 148 and also includes various Software components for
`handling data received by the RF circuitry 112 and/or the
`external port 148. The external port 148 (e.g., Universal
`Serial Bus (USB), FIREWIRE, etc.) is adapted for coupling
`directly to other devices or indirectly over a network (e.g.,
`the Internet, wireless LAN, etc.).
`0040. The contact/motion module 138 detects contact
`with the touch screen 126, in conjunction with the touch
`screen controller 122. The contact/motion module 138
`
`Petitioners Samsung and Sony Ex-1007, 0019
`
`

`

`US 2007/O 150842 A1
`
`Jun. 28, 2007
`
`includes various Software components for performing vari
`ous operations related to detection of contact with the touch
`screen 122. Such as determining if contact has occurred,
`determining if there is movement of the contact and tracking
`the movement across the touch screen, and determining if
`the contact has been broken (i.e., if the contact has ceased).
`Determining movement of the point of contact may include
`determining speed (magnitude), Velocity (magnitude and
`direction), and/or an acceleration (including magnitude and/
`or direction) of the point of contact. In some embodiments,
`the contact/motion module 126 and the touch screen con
`troller 122 also detects contact on the touchpad.
`0041. The graphics module 140 includes various known
`Software components for rendering and displaying graphics
`on the touch screen 126. Note that the term “graphics
`includes any object that can be displayed to a user, including
`without limitation text, web pages, icons (such as user
`interface objects including soft keys), digital images, videos,
`animations and the like.
`0042. In some embodiments, the graphics module 140
`includes an optical intensity module 142. The optical inten
`sity module 142 controls the optical intensity of graphical
`objects, such as user-interface objects, displayed on the
`touch screen 126. Controlling the optical intensity may
`include increasing or decreasing the optical intensity of a
`graphical object. In some embodiments, the increase or
`decrease may follow predefined functions.
`0043. The user interface state module 144 controls the
`user interface state of the device 100. The user interface state
`module 144 may include a lock module 150 and an unlock
`module 152. The lock module detects satisfaction of any of
`one or more conditions to transition the device 100 to a
`user-interface lock state and to transition the device 100 to
`the lock state. The unlock module detects satisfaction of any
`of one or more conditions to transition the device to a
`user-interface unlock state and to transition the device 100
`to the unlock state. Further details regarding the user inter
`face states are described below.
`0044) The one or more applications 130 can include any
`applications installed on the device 100, including without
`limitation, a browser, address book, contact list, email,
`instant messaging, word processing, keyboard emulation,
`widgets, JAVA-enabled applications, encryption, digital
`rights management, voice recognition, Voice replication,
`location determination capability (such as that provided by
`the global positioning system (GPS)), a music player (which
`plays back recorded music stored in one or more files. Such
`as MP3 or AAC files), etc.
`0045. In some embodiments, the device 100 may include
`the functionality of an MP3 player, such as an iPod (trade
`mark of Apple Computer, Inc.). The device 100 may, there
`fore, include a 36-pin connector that is compatible with the
`iPod. In some embodiments, the device 100 may include one
`or more optional optical sensors (not shown), such as CMOS
`or CCD image sensors, for use in imaging applications.
`0046.
`In some embodiments, the device 100 is a device
`where operation of a predefined set of functions on the
`device is performed exclusively through the touch screen
`126 and, if included on the device 100, the touchpad. By
`using the touch screen and touchpad as the primary input/
`control device for operation of the device 100, the number
`
`of physical input/control devices (such as push buttons,
`dials, and the like) on the device 100 may be reduced. In one
`embodiment, the device 100 includes the touch screen 126,
`the touchpad, a push button for powering the device on/off
`and locking the device, a Volume adjustment rocker button
`and a slider Switch for toggling ringer profiles. The push
`button may be used to turn the power on/off on the device
`by depressing the button and holding the button in the
`depressed state for a predefined time interval, or may be
`used to lock the device by depressing the button and
`releasing the button before the predefined time interval has
`elapsed. In an alternative embodiment, the device 100 also
`may accept