(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2008/0155415 A1
`(43) Pub. Date:
`Jun. 26, 2008
`YOON et al.
`
`US 2008O155415A1
`
`(54) DEVICE AND METHOD FOR PROVIDING
`HAPTC USER INTERFACE IN MOBILE
`TERMINAL
`
`(75) Inventors:
`
`Sang Hyeon YOON, Seoul (KR):
`Ki Tae LEE, Seoul (KR)
`Correspondence Address:
`THE FARRELL LAW FIRM, P.C.
`333 EARLE OVINGTON BOULEVARD, SUITE
`TO1
`UNIONDALE, NY 11553
`
`(73) Assignee:
`
`SAMSUNGELECTRONICS
`CO.,LTD., Suwon-si (KR)
`
`(21) Appl. No.:
`
`11/962,306
`
`(22) Filed:
`
`Dec. 21, 2007
`
`(30)
`
`Foreign Application Priority Data
`
`Dec. 21, 2006 (KR) ............................. 2006-0131772
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`G06F 3/00
`(52) U.S. Cl. ........................................................ 71.5/716
`(57)
`ABSTRACT
`A device and method for providing a haptic user interface in
`a mobile terminal that can provide a haptic response to user
`manipulation are provided. The device for providing a haptic
`user interface in a mobile terminal includes a pointing device
`for receiving manipulation from a user to control a pointer, a
`display unit for displaying the pointer on a screen; a memory
`unit for storing information of a Voltage level to be supplied to
`a vibration unit according to a coordinate value of the pointer;
`a controller for outputting a control signal based on the coor
`dinate value of the pointer in the display unit according to
`movement of the pointing device and information of the
`memory unit; and a vibration unit for generating a vibration
`according to the control signal. Therefore, by generating a
`vibration according to movement of a pointer, a user can feel
`a response to manipulation of the user interface with the sense
`of touch as well as the sense of sight, thereby providing
`interest and convenience to the user.
`
`
`
`19:25
`
`210
`
`
`
`
`
`
`
`
`
`
`
`1. MY SCREEN
`:
`2. MOWINGPICTURE
`:
`3. MP3
`
`s
`
`7. BLUETOOTH
`
`Exhibit 1036 - Page 1 of 11
`
`

`

`Patent Application Publication
`
`Jun. 26, 2008 Sheet 1 of 5
`
`US 2008/O155415 A1
`
`FIG - 1
`
`100
`Y
`
`
`
`
`
`140
`
`110
`
`BATTERY
`
`PONTING
`
`
`
`POWER SUPPLY
`UNIT
`
`
`
`160
`
`CONTROLLER
`
`
`
`
`
`WBRATION UNIT
`
`MEMORY UNIT
`
`DISPLAY UNIT
`
`FIG. 2A
`
`
`
`19:25
`ENTERTAINMENT FUNCTION
`
`(12GBaglala
`
`210
`
`1. MYSCREEN
`2. MOVINGPICTURE.
`
`6. FILE VIEWER
`7. BLUETOOTH
`
`Exhibit 1036 - Page 2 of 11
`
`

`

`Patent Application Publication
`
`Jun. 26, 2008 Sheet 2 of 5
`
`US 2008/O155415 A1
`
`FIG 2B
`
`234
`
`
`
`236
`
`S&
`
`SCHEDULE
`MANAGEMENT
`
`ENTERTAINMENT
`FUNCTION |
`
`
`
`232
`&N-236
`R
`210
`FACLITES
`FUNCTION
`
`
`
`
`
`MEMORY
`MANAGEMENT
`
`MOBILEPHONE
`SETING
`
`l
`
`FIG 2C
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`19:25
`PHONE FUNCTION - - - - -
`1PHONEBOOK
`N
`ABERVATION NUMBER
`MANAGEMENT
`3GROUPENVIRONMENT SETTING
`4COMMUNICATIONLIST
`5 MESSAGE
`6PHONE USING TIME
`PHONE NAME CARD
`
`wa
`
`My
`
`vs.
`
`MS
`s
`W.
`t
`
`MENU
`
`
`
`SELECT
`
`CANCE
`
`FFTEENTH
`
`LEVEL
`FOETH
`THIRTEENTH
`El
`TWELFTH
`LEVEL
`ELEVENTH
`LEVEL
`TENTHLEVEL
`NNTHLEVEL
`
`Exhibit 1036 - Page 3 of 11
`
`

`

`Patent Application Publication
`
`Jun. 26, 2008 Sheet 3 of 5
`
`US 2008/O155415 A1
`
`FIG ... 3
`
`
`
`no
`
`POSINE POSPE VOLTAGELEVEL
`HORIZONTAL
`VERTICAL
`VARIABLE | NOT SPECIFIED
`FIRST LEVEL
`
`43 - 84
`
`85 - 126
`
`127-168
`
`FOURTEENTH EVEL
`
`THIRTEENTH EVEL
`
`ALL MENU
`
`20-140
`
`520-61O
`
`SIXTEENTHLEVE.
`
`130-180
`
`FIFTEENTHLEVEL
`
`FOURTEENTH EVEL
`
`240-290
`
`THIRTEENTHLEVE.
`
`460-510
`
`NNTHLEVEL
`
`Exhibit 1036 - Page 4 of 11
`
`

`

`Patent Application Publication
`
`Jun. 26, 2008 Sheet 4 of 5
`
`US 2008/0155415 A1
`
`FIG .. 4
`
`
`
`
`
`S410
`
`MOVE POINTER 2
`
`GENERATE WIBRATION
`OF FIRST INTENSTY
`
`S430
`
`POSITION POINTER
`ATSPECIFICAREA 2
`
`
`
`
`
`S440
`
`S450
`
`GENERATE WIBRATION
`OF SECONOINTENSITY
`
`
`
`POSITION POINTER
`AT AREA OF FREQUENTLY
`SED ITEM 2
`
`S460
`
`
`
`GENERATE WIBRATION
`OF THIRD INTENSITY
`
`Exhibit 1036 - Page 5 of 11
`
`

`

`Patent Application Publication
`
`Jun. 26, 2008 Sheet 5 of 5
`
`US 2008/0155415 A1
`
`FIG .. 5
`
`S51O
`
`
`
`S520
`
`
`
`MOVE POINTER
`
`DETERMINE COORDINATEWALUE
`OF POINTER
`
`GENERATE WIBRATION
`OF INTENSITY CORRESPONDING
`TO COORDINATEWALUE
`
`
`
`FIG .. 6
`
`
`
`S610
`
`MOVE INDICATOR
`
`GENERATE WIBRATION
`CORRESPONDING TOMOWING IN
`MOVEMENT DIRECTION OF INDICATOR
`
`
`
`
`
`S630
`
`
`
`GENERATE WIBRATION
`CORRESPONDING TO AREA AT
`WHICH INDICATOR IS POSITIONED
`
`
`
`Exhibit 1036 - Page 6 of 11
`
`

`

`US 2008/O 155415 A1
`
`Jun. 26, 2008
`
`DEVICE AND METHOD FOR PROVIDING
`HAPTCUSER INTERFACE IN MOBILE
`TERMINAL
`
`PRIORITY
`0001. This application claims priority under 35 U.S.C. S
`119(a) to a Korean Patent Application entitled “DEVICE
`AND METHOD FOR PROVIDING HAPTIC USER
`INTERFACE IN MOBILE TERMINAL filed in the Korean
`Intellectual Property Office on Dec. 21, 2006 and assigned
`Serial No. 2006-0131772, the contents of which are incorpo
`rated herein by reference.
`
`BACKGROUND OF THE INVENTION
`0002 1. Field of the Invention
`0003. The present invention relates generally to a user
`interface of a mobile terminal, and in particular, to a device
`and method for providing a haptic user interface in a mobile
`terminal that can provide a haptic response to user manipu
`lation.
`0004 2. Description of the Related Art
`0005. In general, a mobile terminal includes a display unit
`and buttons as a user interface, and a user presses buttons to
`manipulate a function of the mobile terminal and checks the
`operation of the manipulated function through a display func
`tion (i.e., a display screen).
`0006 With a conventional user interface, the user can
`confirm if he/she has pressed the intended button by visually
`checking the mobile terminal display screen or by listening
`for a distinct sound (e.g., beeping sound) emanating from the
`mobile terminal as a button is pressed. However, in order to
`provide other types of sensory stimulation to the users as they
`manipulate the buttons of the mobile terminal, methods uti
`lizing the sense of touch have been introduced.
`0007 Today, a haptic interface is currently being used that
`provides a response to the user using a vibration function,
`such that when the user presses a button, the interface notifies
`the user that the button is pressed by generating vibration.
`0008. However, a typical haptic interface is limited in that
`in a mobile terminal having a pointing device Such as a
`mouse, the user can confirm the movement of the moving
`pointer only by viewing the moving pointer on the mobile
`terminal display unit.
`
`SUMMARY OF THE INVENTION
`0009. An aspect of the present invention is to substantially
`Solve at least the above problems and/or disadvantages and to
`provide at least the advantages below. Accordingly, one
`aspect of the present invention is to provide a device and
`method for providing a haptic user interface in a mobile
`terminal that can provide a haptic response to user manipu
`lation.
`0010. Another aspect of the present invention is to provide
`a device and method for providing a haptic user interface in a
`mobile terminal that can provide convenience to mobile ter
`minal users during their manipulation of the mobile termi
`nal's pointing device.
`0011. According to one aspect of the present invention,
`there is provided a device for providingahaptic user interface
`in a mobile terminal. The device includes a pointing device
`for receiving manipulation from a user to control a pointer, a
`display unit for displaying the pointer on a screen; a memory
`unit for storing information of a Voltage level to be supplied to
`
`a vibration unit according to a coordinate value of the pointer;
`a controller for outputting a control signal based on the coor
`dinate value of the pointer displayed in the display unit
`according to movement of the pointing device and informa
`tion of the memory unit; and a vibration unit for generating a
`vibration according to the control signal.
`0012. According to another aspect of the present inven
`tion, there is provided a method of providing a haptic user
`interface in a mobile terminal. The method includes moving a
`pointer on a screen by user manipulation; generating a vibra
`tion of a first intensity according to the movement of the
`pointer; and generating, if the pointer is positioned at a spe
`cific area, a vibration of a second intensity different from the
`vibration of the first intensity.
`0013. According to yet another aspect of the present
`invention, there is provided a method of providing a haptic
`user interface in a mobile terminal. The method includes
`moving a pointer on a screen by user manipulation; and
`generating a vibration of an intensity that is set corresponding
`to an area at which the pointer is positioned.
`0014. According to still another aspect of the present
`invention, there is provided a method of providing a haptic
`user interface in a mobile terminal. The method includes
`moving an indicator; generating a vibration corresponding to
`a movement direction of the indicator, and generating a vibra
`tion corresponding to an area at which the indicator is posi
`tioned.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0015 The objects, features and advantages of the present
`invention will be more apparent from the following detailed
`description in conjunction with the accompanying drawings,
`in which:
`0016 FIG. 1 is a block diagram illustrating a configuration
`of a device for providing a haptic user interface in a mobile
`terminal according to the present invention;
`0017 FIGS. 2A to 2C are examples of a screen in which a
`pointer is positioned at a specific menu in the device of FIG.
`1;
`0018 FIG.3 is a diagram illustrating an example of a table
`of voltage levels to be provided to a vibration unit in the
`device of FIG. 1;
`0019 FIG. 4 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention;
`0020 FIG. 5 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention; and
`0021
`FIG. 6 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention.
`
`DETAILED DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`0022 Exemplary embodiments of the present invention
`are described with reference to the accompanying drawings in
`detail. The same reference numbers are used throughout the
`drawings to refer to the same or like parts. Detailed descrip
`tions of well-known functions and structures incorporated
`herein may be omitted to avoid obscuring the Subject matter
`of the present invention.
`0023 FIG. 1 is a block diagram illustrating a configuration
`of a device for providing a haptic user interface in a mobile
`
`Exhibit 1036 - Page 7 of 11
`
`

`

`US 2008/O 155415 A1
`
`Jun. 26, 2008
`
`terminal according to an exemplary embodiment of the
`present invention. FIGS. 2A to 2C are examples of a screen in
`which a pointer is positioned at a specific menu in the device
`of FIG. 1.
`0024. In FIG. 1, a device 100 for providing a haptic user
`interface includes a pointing device 110 for receiving
`manipulation for a user to control a pointer (for example, a
`mouse input device); a display unit 120 for displaying the
`pointer on a screen; a memory unit 170 for storing informa
`tion of a voltage level to be supplied to a vibration unit 160
`according to a coordinate value of the pointer, a controller
`130 for outputting at least two control signals based on a
`coordinate value of the pointer displayed in the display unit
`120 according to movement of the pointing device 110 and
`information of the memory unit 170; and a vibration unit 160
`for generating vibration according to the control signal.
`0025. The device 100 for providing a haptic user interface
`further includes a battery module 140 for supplying power;
`and a power supply unit 150 for converting power of the
`battery module 140 to a level of a voltage corresponding to a
`control signal and outputting the converted Voltage to the
`vibration unit 160.
`0026. The pointing device 110 may be an optical mouse,
`ball mouse, touchpad mouse, and a similar function module.
`0027. The controller 130 moves the pointer on the screen
`of the display unit 120 by a distance and in a direction that
`correspond to user manipulation of the pointing device 110.
`The coordinate value of the pointer may be pixel information
`of a position on the screen at which a tip of the pointer is
`positioned.
`0028. The memory unit 170 stores information of a volt
`age level to be supplied to the vibration unit 160 that is set
`according to a coordinate value range of the pointer. The
`controller 130 determines the coordinate value of the pointer
`and determines the voltage level to supply to the vibration unit
`160 referring to the information. The information is updated
`through wired and wireless communication or is updated or
`changed by the user.
`0029. The controller 130 outputs, while the pointer moves,
`i.e. while the coordinate value of the pointer displayed in the
`display unit 120 changes, a control signal for controlling the
`power supply unit 150 to supply a voltage of a first level to the
`vibration unit 160. Upon receiving the control signal, the
`power supply unit 150 converts power of the battery module
`140 to the voltage of the first level and supplies the voltage of
`the first level to the vibration unit 160. The vibration unit 160
`then generates vibration by rotating a motor provided within
`the vibration unit 160 with the received voltage of the first
`level.
`0030 The voltage of the first level is the lowest voltage
`that can drive the vibration unit 160. When the pointer moves
`by manipulation of the pointing device 110 by the user, the
`weakest vibration that can be sensed by the user is generated.
`0031. That is, when the pointer moves by manipulating the
`pointing device 110. Such as an optical mouse, by the user,
`minute vibration is generated that is just Sufficient for move
`ment of the pointer by manipulation of the pointing device
`110 to be sensed by the user with the sense of touch, instead
`of by the sense of sight or the sense of hearing.
`0032. The controller 130 outputs, if the pointer is posi
`tioned at a coordinate of a specific position, a control signal
`for controlling the power supply unit 150 to supply a voltage
`of a second level different from the Voltage of the first level to
`the vibration unit 160. The power supply unit 150 converts
`
`power of the battery module 140 to the voltage of the second
`level and supplies the voltage of the second level to the
`vibration unit 160. The vibration unit 160 then rotates a motor
`with the supplied voltage of the second level. A coordinate
`value range of the specific position and information of the
`Voltage of the second level to be supplied according to the
`coordinate value range are stored in the memory unit 170.
`0033. The voltage of the second level is higher than the
`voltage of the first level, so that when the vibration unit 160
`receives the voltage of the second level, the vibration unit 160
`generates vibration stronger than that generated when receiv
`ing the voltage of the first level.
`0034) For example, as shown in FIG. 2A, if the pointer 210
`is positioned at areas 212 to 226 of a specific menu item for
`performing a specific function, the vibration unit 160 gener
`ates vibration stronger than that generated when the pointer
`moves. Accordingly, the user can recognize that the pointer is
`positioned at a position for executing the specific function.
`0035) If a coordinate value at which the pointer is posi
`tioned corresponds to a coordinate value range of an item
`frequently used by the user, the controller 130 outputs a
`control signal for controlling the power supply unit 150 to
`supply a voltage of a third level to the vibration unit 160. The
`power supply unit 150 converts power of the battery module
`140 to the voltage of the third level and supplies the voltage of
`the third level to the vibration unit 160. The vibration unit 160
`then generates a vibration by rotating a motor with the
`received voltage of the third level. A coordinate value range of
`the item frequently used by the user and information of the
`voltage of the third level to be supplied according to the
`coordinate value range are stored in the memory unit 170.
`0036. The voltage of the third level may be higher than the
`voltage of the second level. That is, the vibration unit 160
`generates vibration stronger than that generated with the Volt
`age of the second level by rotating a motor with the Supplied
`voltage of the third level. For example, as shown in FIG. 2B,
`when the pointer 210 is positioned at an area that can execute
`a function item Such as a message confirmation item 232 or
`a phone number search item 234 frequently used by the user,
`the vibration unit 160 generates vibration stronger than that
`generated when the pointer 210 is positioned at a function
`item for executing a function that is not so frequently used, so
`that the user can recognize that the pointer 210 is positioned
`at a position for executing a frequently used function item. As
`shown in FIG. 2B, in the function item frequently used by the
`user, an icon 236 can be displayed to distinguish the fre
`quently used function item from other items. The controller
`130 can further control the vibration unit 160 to generate
`vibration of a specific level for a frequently used item as well
`as for a function item, for example, when a frequently used
`phone number is highlighted within a communication list, the
`controller 130 can control the vibration unit 160 to generate a
`vibration of a specific level.
`0037. Further, the controller 130 controls the power sup
`ply unit 150 to supply a voltage of further levels to the vibra
`tion unit 160 to identify each menu item by further dividing a
`voltage level supplied from the power supply unit 150 to the
`vibration unit 160, thereby controlling to generate a vibration
`of different intensity.
`0038. For example, as shown in FIG. 2C, when the pointer
`210 is positioned at a phone book item, the controller 130
`controls the power supply unit 150 to supply a voltage of the
`fifteenth level to the vibration unit 160; when the pointer 210
`is positioned at an abbreviated number management item,
`
`Exhibit 1036 - Page 8 of 11
`
`

`

`US 2008/O 155415 A1
`
`Jun. 26, 2008
`
`the controller 130 controls the power supply unit 150 to
`supply a voltage of the fourteenth level to the vibration unit
`160; when the pointer 210 is positioned at a group environ
`ment setting item, the controller 130 controls the power
`supply unit 150 to supply a voltage of the thirteenth level to
`the vibration unit 160; when the pointer 210 is positioned at a
`communication list item, the controller 130 controls the
`power supply unit 150 to supply a voltage of the twelfth level
`to the vibration unit 160; and when the pointer 210 is posi
`tioned at a message' item, the controller 130 controls the
`power supply unit 150 to supply a voltage of the eleventh level
`to the vibration unit 160. That is, whenever the pointer 210 is
`positioned at a menu item, the controller 130 controls the
`power supply unit 150 to supply a voltage of a different level
`to those of other items to the vibration unit 160, thereby
`controlling to generate a vibration of a corresponding inten
`sity, so that a haptic response is provided to the user according
`to movement and position of the pointer. As a result, a table of
`voltage levels can be stored in the memory unit 170.
`0039 FIG.3 is a diagram illustrating an example of a table
`of voltage levels to be provided to a vibration unit according
`to a coordinate value of the pointer.
`0040. The controller 130 controls the power supply unit
`150 to supply to the vibration unit 160 a voltage of a level
`corresponding to a coordinate value of the pointer that is set
`according to data stored in the memory unit 170.
`0041
`Further, the controller 130 can adjust a vibration
`level according to a menu level, for example, the controller
`130 can control to generate a vibration of level 1 in an upper
`level menu, a vibration of level 2 in a lower level menu, and a
`vibration of level 3 in menus beneath the lower level menu.
`Accordingly, the user can recognize a menu level at which the
`pointer 210 is positioned without need for viewing.
`0042. The device 100 for providing a haptic user interface
`may include further vibration units in addition to the vibration
`unit 160 in order to transmit a more specific impression to the
`USC.
`0043. The controller 130 can control to generate vibra
`tions transmitting various impressions according to move
`ment of the pointer 210 using at least two vibration units.
`0044) For example, when the pointer 210 moves from a
`lower part to an upper part on a screen, the controller 130
`controls to sequentially generate vibration from a vibration
`unit 160 positioned at the lower part then from a vibration unit
`160 positioned at the upper part using vibration units verti
`cally disposed, thereby giving an impression that the pointer
`210 moves upwards. When the pointer moves from the upper
`part to the lower part on the screen, the controller 130 controls
`to sequentially generate a vibration from the upper part then
`from the lower part, thereby giving an impression that the
`pointer 210 moves downwards.
`0045. Further, when the menu is converted to a menu
`disposed at the left or right of the menu or when the pointer
`210 is moved in a horizontal or diagonal direction, the con
`troller 130 controls one vibration unit to strongly vibrate and
`an adjacent vibration unit disposed in a direction correspond
`ing to the movement direction to weakly vibrate, thereby
`giving an impression that the pointer 210 moves in a specific
`direction.
`0046. If a scroll or an indicator (for example, a highlight)
`positioned at a menu item in addition to the pointer 210 is
`moved, the same vibration effects can be used to indicate
`moVement.
`
`0047 Even if only the vibration unit 160 is controlled,
`more specific impressions can be obtained. For example,
`when the controller 130 controls the vibration unit 160 to
`gradually increase or decrease a vibration level, a different
`impression can be obtained by user input or manipulation.
`0048. Further, although not shown, the device 100 for
`providing a haptic user interface in the mobile terminal may
`further include a storage medium insertion unit for storing
`data by inserting an external storage medium Such as a
`memory card, and other units such as a camera module,
`broadcasting reception module, Radio Frequency (RF) trans
`mission and reception module, audio signal output device
`Such as a speaker, Sound signal input device such as a micro
`phone, connection terminal for exchanging data with an
`external digital appliance, charging terminal, and digital
`sound reproduction module such as an MP3 module. Accord
`ing to a function convergence trend of digital appliances, the
`mobile terminal can be modified, and other units may also be
`included in the device 100 for providing a haptic user inter
`face.
`0049 FIG. 4 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention.
`0050. In FIG. 4, the method of providing a haptic user
`interface includes moving the pointer 210 on a screen by user
`manipulation; generating a vibration of a first intensity
`according to the movement of the pointer 210; and generat
`ing, when the pointer 210 is positioned at a specific area, a
`vibration of an intensity different from the first intensity.
`0051. That is, if a pointing user interface is used, the con
`troller 130 determines whether the pointer 210 moves on a
`screen in step S410. If the pointer 210 moves on a screen, the
`controller 130 controls to supply a voltage of a level for
`generating a vibration of the first intensity to the vibration unit
`160 while the pointer 210 moves and controls the vibration
`unit 160 to generate a vibration in step S420.
`0052. The controller 130 determines whether the pointer
`210 is positioned at a coordinate within a specific area on the
`screen in step S430.
`0053. If the pointer 210 is positioned at a coordinate
`within a specific area on the screen, the controller 130 con
`trols to Supply a Voltage of a level corresponding to the spe
`cific area to the vibration unit 160 and to generate a vibration
`of a second intensity different from the first intensity in step
`S440. The specific area may be an area at which a specific
`menu item that can perform a specific function is positioned.
`0054 The method of providing a haptic user interface may
`further include, if the pointer 210 is positioned at an area of a
`frequently used menu item, generating a vibration of another
`intensity.
`0055. That is, the controller 130 determines whether the
`pointer 210 is positioned at a coordinate within an area of a
`frequently used menu item in step S450. If the pointer 210 is
`positioned at an area of a frequently used menu item, the
`controller 130 controls to generate a vibration of a third
`intensity different from the first intensity and the second
`intensity in step S460.
`0056 FIG. 5 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention.
`0057. In FIG. 5, the method of providing a haptic user
`interface includes moving the pointer 210 on a screen by user
`
`Exhibit 1036 - Page 9 of 11
`
`

`

`US 2008/O 155415 A1
`
`Jun. 26, 2008
`
`manipulation; and generating a vibration of an intensity that
`is set to correspond to an area at which the pointer 210 is
`positioned.
`0058 An area at which the pointer 210 is positioned may
`be an area of a menu item that can perform a specific function.
`That is, the controller 130 controls to move the pointer 210 on
`a screen according to user manipulation of the pointing device
`110 in step S510, and the controller 130 determines a coor
`dinate value of the pointer 210 in step S520.
`0059. The controller 130 controls to supply a voltage of a
`level corresponding to the determined coordinate value of the
`pointer 210 to the vibration unit 160 and to generate a vibra
`tion corresponding to the voltage level in step S530.
`0060 For example, the controller 130 controls to generate
`a different vibration for each of a confirmation button and a
`cancellation button one the screen, such that when the pointer
`210 is positioned at the confirmation button or the cancel
`lation button on the screen, the user can recognize the button
`or a function at which the pointer 210 is positioned according
`to an intensity of vibration. Furthermore, a coordinate value
`range can be divided according to a function execution area
`Such as a menu item or a function button.
`0061
`FIG. 6 is a flowchart illustrating a method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention.
`0062. In FIG. 6, the method of providing a haptic user
`interface includes moving an indicator; generating a vibration
`for giving an impression of moving of the indicator in a
`movement direction of the indicator; and generating a Vibra
`tion for giving an impression corresponding to an area at
`which the indicator is positioned.
`0063. The controller 130 controls to move the indicator
`(for example, a pointer, highlight of a menu item, and Scroll)
`according to manipulation by the user in step S610, and the
`controller 130 controls to generate a vibration for giving an
`impression of moving the indicator in a movement direction
`of the indicator in step S620.
`0064. For example, as described above, when the indicator
`moves from a lower part to an upper part on the screen, the
`controller 130 controls to sequentially generate a vibration
`from a vibration unit positioned at the lower part then from a
`vibration unit positioned at the upper part using vibration
`units vertically disposed, thereby giving an impression that
`the pointer moves upwards. When the indicator moves from
`the upper part to the lower part on the screen, the controller
`130 controls to sequentially generate a vibration from the
`vibration unit positioned at the upper part then from a vibra
`tion unit positioned at the lower part using vibration units
`Vertically disposed, thereby giving an impression that the
`pointer moves downwards.
`0065. Further, when the menu is converted to a menu
`disposed at the left or right of the screen and when the indi
`cator is moved to a horizontal direction or a diagonal direc
`tion, the controller 130 controls one vibration unit to strongly
`vibrate and an adjacent vibration unit disposed in a direction
`corresponding to the movement direction to weakly vibrate,
`thereby giving an impression that the indicator moves in a
`specific direction.
`0066. The controller 130 controls to generate vibration of
`an impression corresponding to an area at which the indicator
`is positioned (S630). For example, the controller 130 controls
`to generate a vibration of level 1 at an upper menu, a vibration
`of level 2 at a lower menu, and a vibration of level 3 at menus
`beneath the level of the lower menu.
`
`0067. In order to determine a movement direction of the
`indicator and an area at which the indicator is positioned, the
`controller 130 determines a coordinate value of the indicator
`and necessary information Such as data read from the memory
`unit 170.
`0068. Further, although not shown, as described above,
`when converting the menu, the controller 130 can adjust a
`vibration level according to a level of the menu, for example,
`the controller 130 controls to generate a vibration of level 1 at
`an upper level menu, a vibration of level 2 at a lower level
`menu, and a vibration of level 3 at menus beneath the lower
`level menu.
`0069. As described above, in a device and method of pro
`viding a haptic user interface in a mobile terminal according
`to the present invention, by generating a vibration according
`to movement of a pointer, a user can feel a response to
`manipulation of the user interface with the sense of touch as
`well as the sense of sight, thereby providing interest and
`convenience to the user.
`0070 Further, according to movement and position of the
`pointer and an area at which the pointer is positioned, by
`generating a vibration of different intensity and different
`impressions, a different haptic response is provided to the
`user according to a menu or function, or user manipulation,
`thereby providing convenience to the user.
`0071 Although exemplary embodiments of the present
`invention have been described in detail hereinabove, it should
`be clearly understood that many variations and modifications
`of the basic inventive concepts herein taught which may
`appear to those skilled in the present art will still fall within
`the spirit and scope of the present invention, as defined in the
`appended claims.
`What is claimed is:
`1. A device for providing a haptic user interface in a mobile
`terminal, the device comprising:
`a pointing device for receiving manipulation from a user to
`control a pointer,
`a display unit for displaying the pointer on a screen;
`a memory unit for storing information of a Voltage level to
`be supplied to a vibration unit according to a coordinate
`value of the pointer;
`a controller for outputting a control signal based on the
`coordinate value of the pointer displayed in the display
`unit according to movement of the pointing device and
`information of the memory unit; and
`a vibration unit for generating a vibration according to the
`control signal.
`2. The device of claim 1, wherein the coordinate value of
`the pointer is pixel information of a position on the screen at
`which a tip of the pointer is positioned.
`3. The device of claim 1, further comprising:
`a battery module for Supplying power; and
`a power Supply unit for converting power of the battery
`module to a Voltage level corresponding to the control
`signal and outputting the Voltage to the vibration unit.
`4. The device of claim3, wherein the controller outputs, if
`the pointer is moving, a control signal for controlling the
`power Supply unit to Supply a Voltage of a first level to the
`vibration unit.
`5. The device of claim 4, wherein the vibration unit gener
`ates a vibration by rotating a motor with the Supplied Voltage
`of the first level.
`6. The device of claim 5, wherein the voltage of the first
`level is the lowest voltage to drive the vibration unit.
`
`Exhibit 1036 - Page 10 of 11
`
`

`

`US 2008/O 155415 A1
`
`Jun. 26, 20