1111111111111111 IIIIII IIIII 11111 1111111111 lllll 111111111111111 11111 11111 1111111111 11111111
`US 20080229255Al
`
`c19) United States
`c12) Patent Application Publication
`Linjama et al.
`
`c10) Pub. No.: US 2008/0229255 Al
`Sep. 18, 2008
`(43) Pub. Date:
`
`(54) APPARATUS, METHOD AND SYSTEM FOR
`GESTURE DETECTION
`
`(75)
`
`Inventors:
`
`Jukka Linjama, Espoo (FI); Kalle
`Pikkujamsa, Oulu (FI)
`
`Correspondence Address:
`WARE FRESSOLA VAN DER SLUYS & ADOL(cid:173)
`PHSON, LLP
`BRADFORD GREEN, BUILDING 5, 755 MAIN
`STREET, P O BOX 224
`MONROE, CT 06468 (US)
`
`(73) Assignee:
`
`NOKIA CORPORATION
`
`(21) Appl. No.:
`
`11/725,169
`
`(22) Filed:
`
`Mar. 15, 2007
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`G06F 3/03
`(2006.01)
`(52) U.S. Cl. ........................................................ 715/863
`ABSTRACT
`(57)
`
`Apparatuses, methods, and computer program products are
`provided to sense orientations or sequence of orientations, i.e.
`gestures, of mobile devices. The orientation or sequence of
`orientations control components and/or functions of the
`mobile device. Indications may be provided to a user to
`inform the user that the mobile device is in a particular ori(cid:173)
`entation, or that the user has successfully performed a
`sequence of orientations corresponding to a functionality of
`the mobile device. The orientation or sequence of orientations
`may be performed while the mobile device is in a locked or
`idle state in order to control components and/or functions of
`the mobile device. A low energy sensor may activate the
`mobile device after a particular orientation is achieved.
`
`810
`'-----
`"">
`
`Provide a first and
`second signal
`indicative of a first and I< - - -~
`second orientation of
`a mobile device
`
`,.... __ J ___ l
`
`I
`S 11 ~I Provide a signal
`: indicative of motion of I
`I
`the mobile device
`I
`
`I
`
`NO
`
`S12
`
`813
`
`YES
`
`I Provide art indicaiion l
`I (e.g. vibration, LED) to I
`a user that the
`'-.._J
`I
`I predefined gesture
`I
`~ _h~ occ~e~ _ I
`
`S14
`
`Provide control signal
`corresponding to
`predefined gesture
`
`S16
`
`Peforrn at least one
`functionality of mobile
`device
`
`Petitioner Samsung Ex-1012, 0001
`
`

`

`Patent Application Publication
`
`Sep. 18, 2008 Sheet 1 of 2
`
`US 2008/0229255 Al
`
`10
`-·-·-·-·-·-·-·-·-·-·-·-·-·-·-·-·L·-·-·-·-
`20 a
`
`20
`
`CLOCK
`
`23
`
`24
`
`Volatile memory
`(executable memory)
`
`Processor
`(inc. BIOS/ device
`handlers for audio,
`video, DSPs, ASICs)
`
`/19
`
`Indicator
`
`18
`
`Non-volatile memory
`(storage memory)
`
`Controller
`
`25
`
`26 ""
`
`TRX
`
`TRX interface
`(DSPs/ ASICs/ FPGAs)
`
`15
`
`Functionality
`(e.g. user
`interface, light)
`
`13~
`
`Display
`
`Gesture Sensor
`
`16
`
`17----......_ User Input (e.g.
`keypad)
`
`Orientation v 12
`Sensor
`
`Motion Sensor v 14
`
`Fig. 1
`
`Petitioner Samsung Ex-1012, 0002
`
`

`

`Patent Application Publication
`
`Sep. 18, 2008 Sheet 2 of 2
`
`US 2008/0229255 Al
`
`810
`
`Provide a first and
`second signal
`"---... indicative of a first and -~ - - - -
`'-
`second orientation of
`a mobile device
`
`r - - - - ---1
`S11 ~I Provide a signal
`I
`: indicative of motion of I
`I
`the mobile device
`I
`
`I
`
`NO
`
`S12
`
`813
`
`j
`
`YES
`
`1Provide art indication l
`
`I (e.g. vibration, LED) to I
`a user that the
`I
`predefined gesture
`I
`I
`I
`has occurred
`- - - - - - -
`
`'
`
`S14"---... Provide control signal
`corresponding to
`predefined gesture
`
`S16~ Peform at least one
`functionality of mobile
`device
`
`Fig. 2
`
`Petitioner Samsung Ex-1012, 0003
`
`

`

`US 2008/0229255 Al
`
`Sep. 18,2008
`
`1
`
`APPARATUS, METHOD AND SYSTEM FOR
`GESTURE DETECTION
`
`BACKGROUND OF THE INVENTION
`
`[0001]
`1. Technical Field
`[0002] The present invention relates to user interface and
`control of mobile devices.
`[0003] 2. Related Art
`[0004] Mobile devices, such as mobile terminals used in
`communications over telecommunication networks, are
`being implemented with greater and greater functionality. For
`example, mobile terminals may be used for gaming, as clocks
`or alarm clocks, and other functions. Generally the functions
`of a mobile terminal are controlled by a user input device, for
`example a keypad or softkeys. However, often times the input
`device may be locked to prevent inadvertent contact with the
`mobile terminal from activating functions of the terminal.
`When the input device of a mobile terminal is locked, in order
`to use any of the functions of the mobile terminal, a user must
`first unlock the input device, by pressing a sequence of keys or
`the like. It may be desirable to allow use of the functionality
`of the mobile terminal without the need for unlocking the
`input device.
`[0005] While the input device may be locked and unlocked
`or functions of the mobile terminal activated and de-activated
`when the mobile terminal is moved in some manner, continu(cid:173)
`ously activating and de-activating of the mobile terminal
`results in high power consumption. Due to the mobile nature
`of mobile terminals they are often subject to continuous
`movement, leading to unintentional activation of functions in
`mobile terminals employing motion detecting activation
`mechanisms. The activation of functions of the mobile termi(cid:173)
`nals consumes the power source of the mobile terminals,
`which may be limited.
`[0006] Furthermore, there may be various operations of the
`mobile terminal that cannot be performed while the mobile
`terminal is in a locked or idle state. In order to perform the
`operations the mobile terminal must be unlocked, and the
`entire system of the mobile terminal must be activated.
`Unlocking and activating the mo bile terminal for a quick task,
`such as looking at the time, will consume a relatively large
`amount of power compared to the complexity of the task. In
`addition, unlocking of mobile terminals generally requires
`actuating a particular combination of keys in a specific order.
`Unlocking the mobile terminal by actuating keys may be time
`consuming relative to the task that the user wishes to perform,
`i.e. illuminate the display to check the time on a clock of the
`mobile terminal. Therefore, there is a need for gesture recog(cid:173)
`nition that provides reliable detection of user intent, and
`allows the user to perform operations of the mobile terminal
`without activating the entire system of the mobile terminal.
`
`SUMMARY OF THE INVENTION
`
`[ 0007]
`In order to overcome the limitations associated with
`mobile devices mentioned above, apparatuses, methods, and
`computer program products are provided to sense orienta(cid:173)
`tions or sequence of orientations, i.e. gestures, of mobile
`devices. For example, an orientation may include orienting
`the mobile device face down for a half second to two seconds,
`and a sequence of orientations may include face down for a
`period of time followed by turning the mobile device face up.
`The orientation or sequence of orientations control compo(cid:173)
`nents and/or functions of the mobile device. Indications may
`
`be provided to a user to inform the user that the mo bile device
`is in a particular orientation, or that the user has successfully
`performed a sequence of orientations corresponding to a
`functionality of the mobile device. The orientation or
`sequence of orientations may be performed while the mobile
`device is in a locked or idle state in order to control compo(cid:173)
`nents and/or functions of the mobile device. A low energy
`sensor may activate the mobile device after a particular ori(cid:173)
`entation is achieved.
`[0008]
`In a first aspect of the invention, an apparatus is
`provided and may include a sensor configured to sense at least
`a first orientation and a second orientation of the apparatus
`and provide a first signal indicative of the first orientation and
`a second signal indicative of the second orientation and a
`gesture detector, responsive to the first signal and the second
`signal, for providing a control signal based at least on the first
`predetermined orientation and the second predetermined ori(cid:173)
`entation.
`[0009]
`In accordance with the first aspect of the invention,
`the control signal may be configured to activate at least a first
`component of the apparatus.
`[0010]
`In accordance with the first aspect of the invention,
`the control signal may be configured to deactivate at least a
`first component of the apparatus.
`[0011]
`In accordance with the first aspect of the invention,
`the first component may be a light for illuminating a display
`of the apparatus.
`[0012] The apparatus according to the first aspect of the
`invention may include an indicator, responsive to the control
`signal, for providing an indication representing at least the
`first predetermined orientation.
`[0013] The apparatus according to the first aspect of the
`invention may include a motion sensor configured to provide
`information related to the movement of the apparatus.
`[0014]
`In accordance with the first aspect of the invention,
`the gesture detector may be further responsive to the infor(cid:173)
`mation related to the movement of the apparatus for providing
`the control signal additionally based on the information
`related to the movement of the apparatus.
`[0015]
`In accordance with the first aspect of the invention,
`the sensor comprises at least one gravity sensing device.
`[0016]
`In accordance with the first aspect of the invention,
`the sensor comprises a low-power sensor.
`[0017]
`In accordance with the first aspect of the invention,
`the gesture detector may be configured to provide the control
`signal when the apparatus is in an idle state.
`[0018]
`In accordance with the first aspect of the invention,
`the first orientation and the second orientation comprise a
`predefined gesture.
`[0019]
`In accordance with the first aspect of the invention,
`at least the predefined gesture is user determined.
`[0020]
`In accordance with the first aspect of the invention,
`the sensor comprises at least one tilt sensor.
`[0021]
`In accordance with the first aspect of the invention,
`the motion sensor comprises at least one accelerometer.
`[0022]
`In accordance with the first aspect of the invention,
`at least the first component is activated by the control signal
`when at least one user-input device of the apparatus is inac(cid:173)
`tivated.
`[0023] The apparatus according to the first aspect of the
`invention comprises a mobile terminal device.
`[0024] The apparatus according to the first aspect of the
`invention, may further include a transceiver configured for
`radio frequency communication.
`
`Petitioner Samsung Ex-1012, 0004
`
`

`

`US 2008/0229255 Al
`
`Sep. 18,2008
`
`2
`
`[0025] The apparatus according to the first aspect of the
`invention, may further include a controller responsive to the
`control signal configured to control at least a first component
`of the apparatus.
`[002~]
`In a second aspect of the invention, a method is
`provided that may include providing a first signal indicative
`of a first orientation of a mobile device to a gesture detector
`providing a second signal indicative of a second orientation of
`the mobile device to said gesture detector, and providing a
`control signal based at least on the first signal and the second
`signal.
`!0027]_ The method according to the second aspect of the
`mvent10n may further include providing at least a movement
`signal indicative of at least a first movement of the mobile
`device.
`[0028]
`In accordance with the second aspect of the inven(cid:173)
`tion, the control signal may be configured to activate at least
`a first component of the mobile device.
`[0029]
`In accordance with the second aspect of the inven(cid:173)
`ti?n, the first com~onent may be a light for illuminating a
`display of the mobile device.
`[0030]
`In accordance with the second aspect of the inven(cid:173)
`tion, the control signal may be configured to deactivate at
`least a first component of the mobile device.
`[0031]
`In accordance with the second aspect of the inven(cid:173)
`tion, the first orientation and the second orientation may
`comprise a predefined gesture.
`[0032]
`In accordance with the second aspect of the inven(cid:173)
`tion, the predefined gesture may be user defined.
`[0033]
`In accordance with the second aspect of the inven(cid:173)
`tion, the control signal may be based at least in part on the
`movement signal.
`[0034]
`In accordance with the second aspect of the inven(cid:173)
`tion, the control signal may be provided during an idle-state
`of the mobile device.
`[0035]
`In accordance with the second aspect of the inven(cid:173)
`tion, the control signal may be provided when at least one user
`input device of the mobile device is inactivated.
`[0036] The method according to the second aspect of the
`invention may further include detecting the first orientation of
`the mo bile device, and detecting the second orientation of the
`mobile device.
`[0037] The method according to the second aspect of the
`invention, may further include providing an indication to a
`user of the mobile device based at least in part on the control
`signal, the indication may correspond to at least the first
`orientation of the mobile device.
`[0038]
`In a third aspect of the invention a computer pro(cid:173)
`gram product comprising a computer readable storage struc(cid:173)
`ture embodying computer program code thereon for execu(cid:173)
`tion by a computer processor, wherein the computer program
`code comprising instructions for performing a method com(cid:173)
`prising providing a first signal indicative of a first orientation
`of a mobile device, providing a second signal indicative of a
`second ~rientation of the mobile device, and providing a
`control signal based at least one the first signal and the second
`signal is provided
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0039] Having thus described the invention in general
`terms, reference will now be made to the accompanying
`drawings, which are not necessarily drawn to scale, where:
`[0040] FIG. 1 is a block diagram of a mobile terminal in
`accordance with an embodiment of the invention.
`
`[0041] FIG. 2 is a flowchart illustrating exemplary steps in
`a method for controlling the functionality of a mobile termi(cid:173)
`nal by predefined gestures.
`
`DETAILED DESCRIPTION
`
`[0042] The present invention now will be described more
`~lly ~ereinafter with reference to the accompanying figures,
`m which exemplary embodiments of the invention are shown.
`The invention may, however, be embodied in many different
`forms and should not be construed as limited to the embodi(cid:173)
`ments set forth herein. Like reference numerals refer to like
`elements throughout.
`[0043] FIG. 1 shows an exemplary embodiment of the
`invention as a mobile terminal 10. The mobile terminal 10
`may be a cellular telephone device, which may include other
`devices, or the mobile terminal may be any other mobile
`device, such as a personal data assistant (PDA), pager, laptop
`computer, or the like. The mobile terminal 10 may include a
`transceiver 26 for effecting communication over a telecom(cid:173)
`munications network or networks, as are known to one of skill
`in the art. The mobile terminal may also include a transceiver
`interface 25. The mobile terminal 10 may also include a
`display 13, i.e. a screen, that is configured to provide repre(cid:173)
`sentations of the operations and functions performed by the
`mobile terminal. The mobile terminal 10 may also include a
`user input 17, such as a keypad or control key, to allow a user
`to control the operations and functions of the mobile terminal
`10. Although the display 13 and user input 17 are shown in
`FIG. 1 as distinct elements, it is understood that the display 13
`and user input 17 may comprise a single component of the
`mobile terminal, for example a screen with softkeys. Addi(cid:173)
`tionally, the mobile terminal 10 may include an orientation
`sensor 12. The orientation sensor 12 is configured to sense the
`orientation of the mobile terminal 12, and to provide signals
`that may be used to determine if a gesture has been made with
`respect to the mobile terminal 10.
`[0044] As used in the present application, gesture means a
`motion and/or movement or combination of motions and/or
`movements, including but not limited to motions or move(cid:173)
`ments that result in a particular orientation or orientations of
`a device for more than a transitory period of time. In exem(cid:173)
`plary embodiments of the present invention gestures or com(cid:173)
`binations of gestures may be used to perform various func(cid:173)
`tions and/or activate or deactivate various components of the
`mobile terminal 10. The gestures may be preset or user
`defined. If the gestures are user defined, the mobile terminal
`10 may include devices for recording and storing the user
`defined gestures, and for correlating the user defined gestures
`to control functions and/or activation or deactivation of com(cid:173)
`ponents of the mobile terminal 10.
`[0045] The orientation sensor 12 may include one or more
`devices that are acted upon by gravity in order to provide a
`sig~al or signals that indicate in which direction gravity is
`actmg upon the device or devices. For example, the orienta(cid:173)
`tion sensor 12 may include one or more tilt sensors on one or
`more perpendicular axis. One tilt sensor may be positioned on
`the X-axis, one on the Y-axis, and one on the Z-axis. However
`it is understood that the orientation sensor 12 does not need t~
`be abl_e to provide information from all three axis, as it may be
`sufficient for the present invention for the orientation sensor
`12 to provide information from one axis. The orientation
`sensor 12 may be configured such that is provides information
`regarding the orientation of the mobile terminal 10 relative to
`one or more display devices 13 or user inputs 17.
`
`Petitioner Samsung Ex-1012, 0005
`
`

`

`US 2008/0229255 Al
`
`Sep. 18,2008
`
`3
`
`[0046] For example, the orientation sensor 12 may be con(cid:173)
`figured so that it is able to provide a signal when the display
`13 of the mobile terminal 10 is facing substantially down, i.e.
`towards the direction of gravity, and a signal when the display
`13 of the mobile terminal 10 is facing substantially upwards,
`i.e. away from the direction of gravity. It is also understood
`that the orientation sensor 12 may be comprised of one or
`more acceleration sensors, either alone or in combination
`with other sensors, such as tilt or other motion sensors. It is
`also understood that the orientation sensor 12 may be config(cid:173)
`ured to provide signals indicative of the orientation of the
`mobile terminal 10 when the mobile terminal 10 is in particu(cid:173)
`lar orientations and not others. In this manner, it may be
`possible to reduce the signaling and thus the power consump(cid:173)
`tion of the mobile terminal 10. Additionally or alternatively,
`the orientation sensor 10 may be a low energy sensor, for
`example one that only provides a signal indicative of the
`orientation approximately once every 300 milliseconds (ms)
`or 3 Hz.
`[0047] The mobile terminal 10 may also include a gesture
`detector 16 that receives signals from the orientation sensor
`12, and determines whether a predefined gesture has been
`made. For example, the gesture detector 16 may receive a
`signal indicative of a first orientation and a signal indicative of
`a second orientation of the mobile terminal 10 from the ori(cid:173)
`entation sensor 12. The gesture detector 16 may be configured
`to determine that the signals are indicative of a particular
`predefined gesture. The gesture detector 16 is configured to
`provide a control signal to a controller 18 when the gesture
`detector 16 determines that a predefined gesture has occurred.
`The controller 18 is coupled to a processor 20 of the mobile
`terminal 10, to non-volatile memory 24 and volatile memory
`23 as well. The controller 18 either by itself or in conjunction
`with the processor 20 is responsible for carrying out the
`functions, i.e. controlling the components, of the mobile ter(cid:173)
`minal 10. When the controller 18 receives a signal from the
`gesture detector 16 indicating a predefined gesture has
`occurred, the controller 18 is configured to determine which
`function the predefined gesture corresponds to, and activate
`or inactivate that function of the mobile terminal 10. It is
`understood that the control signal from the gesture detector
`16 may activate or inactivate one or more functions 15 of the
`mobile terminal 10. A predefined gesture may be used to
`control one or more functions of the mobile terminal in the
`following manner.
`[0048]
`In an exemplary embodiment of the present inven(cid:173)
`tion, the preset or user defined gesture, i.e. predefined gesture,
`may include turning mobile terminal 10 to face downwards
`for a certain period of time, i.e. one or two seconds, and then
`turning the mobile terminal 10 to face upwards. In this
`example, when the mobile terminal 10 is in a downward
`orientation, the orientation sensor 12 provides a signal to the
`gesture detector 16 indicating that the mobile terminal 10 is
`oriented downward. If the mobile terminal 10 remains ori(cid:173)
`ented downward, the next time the orientation sensor 12
`samples the orientation of the mobile terminal it will again
`provide a signal to the gesture detector 16 indicating that the
`mobile terminal 10 is oriented downward. The gesture detec(cid:173)
`tor 16 receives the signals from the orientation sensor 12 and
`provides control signals to the controller 18 based on the
`received signals. In this exemplary embodiment, two con(cid:173)
`secutive signals indicating that the mobile terminal 10 is
`facing downwards within a particular period of time, i.e. two
`seconds, are identified by the gesture detector 16 to corre-
`
`spond to a particular predefined gesture. Therefore, the ges(cid:173)
`ture detector 16 will provide a control signal based on the
`determined predefined gesture.
`[0049] The control signals may be related to the timing and
`sequence of signals received from the orientation sensor 12.
`For example, in the exemplary situation discussed above, the
`gesture detector 16 receives two successive signals indicating
`the mobile terminal 10 is facing downward. When these suc(cid:173)
`cessive signals correspond to a defined gesture, the gesture
`detector 16 provides a control signal corresponding to that
`defined gesture. In the above example, the signals from the
`orientation sensor 12 indicate that the mobile terminal has
`been downward for a certain period of time, and accordingly
`the gesture detector 16 is configured to provide a control
`signal corresponding to the orientation of the mobile terminal
`10 when the mobile terminal 10 has been downward for a
`periodoftime, i.e. one or two seconds. The control signal may
`activate or inactive a component, i.e. functionality 15, of the
`mobile terminal 10. For example, the control signal provided
`in this example may activate a user interface function, i.e.
`indicator 19, providing an indication to a user that the pre(cid:173)
`defined gesture has occurred. The indication may be a vibra(cid:173)
`tion indication, sound indication or visual indication, for
`example illuminating one or more lights of the mobile termi(cid:173)
`nal, i.e. an indicator 19. It is understood that the indicator 19
`of the mobile terminal may be one or more of the components
`used in the normal functioning of the mobile terminal 10, for
`example a LED light, a speaker for producing a sound indi(cid:173)
`cating an incoming call or message, or a vibration device used
`to indicate an incoming call or message when the mobile
`terminal 10 is in a silent mode.
`[0050] The detection of the orientation, i.e. gesture, of the
`mo bile terminal 10 may be performed in a locked or idle state
`of the mobile terminal 10. Thereby allowing a function of the
`mobile terminal 10 to be performed without unlocking or
`fully powering up the mobile terminal 10. It is understood that
`the orientation of the mobile terminal 10, i.e. downwards or
`upwards, may correspond to a component or components of
`the mobile terminal 10. For example, the downwards orien(cid:173)
`tation of the mobile terminal 10 may represent the display 13
`of the mobile terminal 10 facing in a downwards direction.
`The orientation of the mobile terminal 10 may also corre(cid:173)
`spond to other visible components of the mobile terminal 10.
`[0051]
`It is understood that the gesture discussed above
`may also be part of another predefined gesture. For example,
`in another exemplary embodiment of the invention after the
`user has received the indication, the user may then tum the
`mobile terminal 10 so that the mobile terminal is facing
`upwards. The orientation sensor 12 senses that the mobile
`terminal 10 is facing upwards, and provides a signal to the
`gesture detector 16 indicating this orientation. When this
`sequence of orientations corresponds to a predefined gesture,
`the gesture detector 16 provides a control signal representing
`this predefined gesture to the controller 18. In this exemplary
`scenario the predefined gesture comprises the mobile termi(cid:173)
`nal 10 down for one or two seconds, followed by the mobile
`terminal 10 facing upwards. The control signal may activate
`or inactive one or more components of the mobile terminal
`10. In the present example, the control signal may cause the
`display to be illuminated for a period of time, i.e. five seconds.
`The control signal may in addition or alternatively cause an
`indication, i.e. vibration, audio, visual, to be provided to the
`user that the predefined gesture has occurred. The indication
`may be provided by an indicator 19 of the mobile terminal. It
`
`Petitioner Samsung Ex-1012, 0006
`
`

`

`US 2008/0229255 Al
`
`Sep. 18,2008
`
`4
`
`is understood that any number, sequence and combinations of
`gestures comprising various orientations are contemplated by
`the present invention.
`[0052]
`In addition or alternatively to orientations of the
`mobile terminal, the gestures may also comprise movement,
`i.e. acceleration, or lack thereof of the mobile terminal. In
`another exemplary embodiment of the invention, the mobile
`terminal 10 may further comprise one or more motion sensors
`14 that are configured to determine whether the mobile ter(cid:173)
`minal is moving. It is understood that although the motion
`sensor 14 is presented in FIG.1 as a separate element from the
`orientation sensor 12, the motion sensor 14 may be incorpo(cid:173)
`rated as a part of the orientation sensor 12, thereby providing
`a sensor for orientation and motion detection. The motion
`sensors 14 may provide signals to the gesture detector 16
`indicative of whether the mobile terminal is moving. The
`signals may comprise information related to the direction and
`magnitude of movement of the mobile terminal. The move(cid:173)
`ment information related signals may be used by the gesture
`detector 16 either alone, or in combination with signals from
`the orientation sensor 12, to determine whether a predefined
`gesture has occurred. For example, the motion sensor 14 may
`determine that the mobile terminal is substantially stationary,
`and may provide a signal indicating that the mobile terminal
`is substantially stationary to the gesture detector 16. At
`approximately the same time, the gesture detector 16 receives
`from the orientation sensor 12 a signal or signals indicating
`that the mobile terminal is in a downward orientation. This
`combination of substantially stationary and downward orien(cid:173)
`tation may correspond to a predefined gesture, and therefore
`the gesture detector 16 may provide a control signal indicat(cid:173)
`ing that the predefined gesture has occurred to the controller
`18. For example, the predefined gesture may correspond to a
`control signal activation or inactivating one or more of the
`components, i.e. functionalities of the mobile terminal 10.
`For example, the control signal for the predefined gesture
`discussed above may correspond to inactivating the audible
`sounds of the mobile terminal 10, by placing the mobile
`terminal 10 in a silent mode.
`[0053]
`In another exemplary embodiment of the invention,
`the predefined gesture may include one or more taps on the
`mobile terminal 10 followed by turning the mobile terminal
`10 to a particular orientation. In this exemplary embodiment
`of the invention, the predefined gesture may deactivate the
`audible sound made by the mobile terminal upon receipt of a
`call or message, i.e. ringing. In this scenario, the user taps the
`mobile terminal 10 a certain number of times, for example
`twice. The motion sensor 14 senses the motion of the mobile
`terminal 10 caused by the taps and sends a signal indicating
`that the user has tapped the mobile terminal one or more
`times. The gesture detector 16 receives the signals from the
`motion sensor 14, and then may receive a signal from the
`orientation sensor 12 indicating that the mobile terminal is in
`a display down orientation. In response to these signals, the
`gesture detector 16 may provide a control signal for control(cid:173)
`ling the functionality of the mobile terminal 10. In this exem(cid:173)
`plary embodiment, the control signal mutes the mobile ter(cid:173)
`minal's ringing. The control signal may also activate an
`indication to the user that the mobile terminal is in the display
`down orientation.
`[0054]
`In another exemplary embodiment of the present
`invention, the predefined gestures may be carried out while
`the mobile terminal 10 is in an idle or sleep state. In this
`manner, the entire mo bile terminal system does not need to be
`
`powered up in order to perform the function corresponding to
`the predefined gesture. In addition, the predefined gestures
`may be performed while one or more user input devices 17,
`i.e. keypad or keys, is in a locked state. The functions corre(cid:173)
`sponding to the predefined gestures may be performed with(cid:173)
`out unlocking the keys.
`[0055] FIG. 2 illustrates various steps in a method forusing
`predefined gestures to control various functions of a mobile
`terminal. At step Sl 0 a first and second signal indicative of a
`first and second orientation of a mobile device are provided.
`The signals may be provided to a gesture detector, and the
`gesture detector may be a component of the mobile device. At
`optional step Sll a signal indicative of the motion of the
`mobile device may also be provided. Similarly, the signal
`indicator of the motion of the mobile device may be provided
`to the gesture detector as well. In step S12 it is determined
`whether the signals correspond to a predefined gesture. If the
`signals do not correspond to a predefined motion, the method
`starts over at step SlO. If the signals correspond to a pre(cid:173)
`defined motion, at step S14 a control signal is provided, and at
`step S16 at least one functionality of the mobile device is
`performed based on the control signal. In optional step S13 an
`indication, i.e. vibration, light from a light emitting diode
`(LED), may be provided to a user of the mobile device to
`inform the user that the predefined gesture has occurred. It is
`understood that the indication may correspond to a particular
`predefined gesture, or each various indication may corre(cid:173)
`spond to multiple predefined gestures. It is contemplated that
`the user may be able to select which indication is used to
`inform the user that a predefined gesture or gestures have
`occurred.
`[0056] An exemplary embodiment of the present invention
`may also include a computer program product comprising a
`computer readable storage structure embodying computer
`program code thereon for execution by a computer processor,
`wherein the computer program code comprising instructions
`for performing at least the steps of the method according to
`the invention discussed above in relation to FIG. 2. It is
`understood that the above discussed mobile devices, i.e.
`mobile terminals, methods and computer program products
`may be implemented in a telecommunications system, and
`that the above discussed embodiments may include compo(cid:173)
`nents known to one of skill in the art for implementation in
`telecommunications systems.
`[0057]
`It is to be understood that all of the present figures,
`and the accompanying narrative discussions of correspond(cid:173)
`ing embodiments, do not purport to be completely rigorous
`treatments of the method, apparatus, system, and software
`product under consideration. A person skilled in the art will
`understand that the steps and signals of the present applica(cid:173)
`tion represent general cause-and-effect relat