US007307623B2
`
`(12) United States Patent
`Enomoto
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,307,623 B2
`Dec. 11, 2007
`
`(54) INFORMATION PROCESSING DEVICE
`HAVING DETECTOR CAPABLE OF
`DETECTING COORDINATE VALUES, AS
`WELL As CHANGES THEREOF, OF A
`PLURALITY OF POINTS ON DISPLAY
`SCREEN
`
`(75) Inventor: Shigeru Enomoto, KanagaWa (JP)
`
`(73) Assignee: Sony Computer Entertainment Inc.,
`Tokyo (JP)
`
`( * ) Notice:
`
`
`
`Subject to any disclaimer, the term of this patent is extended or adjusted under 35
`
`U-S-C- 154(1)) by 415 days-
`
`(21) Appl. No.: 10/374,678
`
`(22) Filed:
`
`Feb. 26, 2003
`
`6,335,722 B1
`2002/0018051 A1
`
`1/2002 Tani m1.
`2/2002 Singh
`
`EP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`
`JP
`
`JP
`JP
`
`FOREIGN PATENT DOCUMENTS
`0 622 722
`11/1994
`59-68779
`4/1984
`61-267128
`11/1986
`62498979
`9/1987
`4-373084
`12/1992
`5427654
`5/1993
`6-110442
`4/1994
`7-160901
`6/1995
`
`2000472391
`
`2000-235653
`2002-525705
`
`6/2000
`
`8/2000
`8/2002
`
`(Continued)
`OTHER PUBLICATIONS
`
`(65)
`
`Prior Publication Data
`
`Written Opinion, Sep, 1, 2003,
`
`US 2004/0021644 A1
`
`Feb. 5, 2004
`
`(Continued)
`
`Foreign Application Priority Data
`(30)
`Feb. 28, 2002
`(JP)
`........................... .. 2002-053833
`
`Primary ExamineriRegina Liang
`74Azz
`A 2
`F' iKtt Mh'R
`(LU),
`Omey’ gen’ or m” a en uc m osenman
`
`(51) Int- Cl-
`(2006.01)
`G09G 5/00
`(52) US. Cl. ..................................... .. 345/173; 345/156
`0f Classi?cation Search .............. ..
`_
`_
`345/173479; 178/1301, 18-03
`See aPPhCaUOn ?le for Complete Search 1115101'3’ -
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`
`4/1990 Dunthorn
`4,914,624 A
`9/1998 Shieh
`5,808,605 A
`5,844,547 A * 12/1998 Minakuchi et a1. ....... .. 345/173
`5,861,886 A *
`1/1999 Moran et a1. ............. .. 345/179
`
`ABSTRACT
`
`57
`(
`)
`Using a touclkpanel Capable of detecting Coordinate Values
`of a
`of points’ as Well as Changes therein, on the
`display screen, a data block as a target for the information
`processing is selected based on the coordinate Values of a
`plurality of the points‘ Which are speci?ed by the user on the
`display screen, and is then subjected to a predetermlned
`processing. This alloWs the user to handle the data through
`an operation closely simulating actual motion in the real
`World
`'
`
`30 Claims, 14 Drawing Sheets
`
`11 “L CPU
`
`2/ l
`CONTROLLER
`|’\14
`COMMUNIC TION
`
`12x!‘
`
`RAM
`
`DISPLAY UNIT N15
`
`19m, INTERFACE
`"3A1 PROGRAM
`‘3N R0 E88 0
`20" BATE UNW
`
`JT~16
`
`T0 CH—PANEL
`UN T
`17
`
`1
`
`Petitioner Samsung 1011
`
`

`

`US 7,307,623 B2
`Page 2
`
`FOREIGN PATENT DOCUMENTS
`
`WO
`
`12/2001
`01/98885
`OTHER PUBLICATIONS
`
`Noti?cation of Reason(s) for Refusal mailed Aug. 22, 2006, from
`corresponding Japanese Application No. 2006-026646.
`
`Noti?cation of Reason(s) for Refusal dated Mar. 29, 2005.
`Communication pursuant to Article 96(2) EPC dated Nov. 24, 2006
`for corresponding European Application EP 03 701 1012-1527.
`Noti?cation of Reason(s) for Refusal dated Dec. 21, 2005, with
`translation, for corresponding Japanese Application 2002-053833.
`
`* Cited by examiner
`
`2
`
`

`

`US. Patent
`
`Dec. 11, 2007
`
`Sheet 1 of 14
`
`US 7,307,623 B2
`
`FIG.1
`
`
`
`3
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 2 0f 14
`Sheet 2 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`F|G.3
`FIG.3
`
`
`
`4
`
`

`

`U.S. Patent
`
`Dec. 11,2007
`
`Sheet 3 0f 14
`
`US 7,307,623 B2
`
`F|G.5
`
`DETECTING COORDINATE VALUE
`OF PRESSED-DOWN POINT "a"
`
`YES
`
`DETECTING COORDINATE VALUE 0F|,\/S4
`PRESSED-DOWN POINT "b"
`1000
`BEEEWT'ITTNSEB'FETED"
`ABE
`a
`
`ON
`
`'
`
`S3
`
`20%: 2:51“
`Q3
`
`SP
`
`5
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 4 0f 14
`Sheet 4 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`FIG. 6A
`FIG. 6A
`
`a
`
`(J
`
`. .
`
`
`
`6
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 5 0f 14
`Sheet 5 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`FIG. 7A
`
`
`
`7
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 6 0f 14
`Sheet 6 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`FIG.8
`FIG.8
`
`
`
`FIG.9
`
`
`
`~15
`
`8
`
`

`

`US. Patent
`
`Dec. 11, 2007
`
`Sheet 7 of 14
`
`US 7,307,623 B2
`
`FIG.IO
`
`
`
`
`
`START
`
` SZI
`
`DETECTING
`COORDINATE VALUE
`OF PRESSED-
`
`DOWN POINT "a"
`
`
`
`324
`ICH FALLS WITHIN
`CENTERED ROUND
`3
`
`$25
`DISPLAYING THE FOUND OBJECT AS
`BEING MOVED CLOSE TO THE PRESSED
`—DOWN POINT "a'
`
`
`’
`
`$26
`
`DETECTING COORDINATE VALUE 0
`PRESSED—DOWN POINT
`b
`
`
`
`
`
`F
`
`L
`
`s
`
`8
`
`323
`
`T
`
`F
`
`D D TA
`
`
`
`527
`
`I
`
`
`
`NP
`
`
`
`WH
`FI
`DING ANY OBJEC
`T
`
`A
`REDETERMINED RAN
`GE
`
`TH
`E PRESSED—DOWN PO TIN
`
`
`
`WITHI
`ROUND
`YES
`OUND OBJECT AS BOINO
`fiiggrégg? MEJECX AS
`
`DISPLAYING TH E F
`RESSED—DOWN POINT 'b”
`MOVED CLOSE TO P
`
`
`
`
`
`FINDING ANY OBJECT
`WHICH FALLS WITHIN
`A PREDETERMINED
`
`RANGE CENTERED
`
`ROUND THE MOVED
`
`PRESSED+DOWN
`
`POINT,AND
`
`DISPLAYING THE
`
`FOUND OBJECT AS
`
`BEING MOVED CLOSE
`
`THERETO
`
`
`
`
`
`
`JECES U
`
`
`’s‘EEEMIB IREAO
`
`9
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 8 0f 14
`Sheet 8 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`F|G.11A
`FIG.11A
`
`
`
`10
`
`10
`
`

`

`U.S. Patent
`US. Patent
`
`Dec. 11,2007
`Dec. 11, 2007
`
`Sheet 9 0f 14
`Sheet 9 of 14
`
`US 7,307,623 B2
`US 7,307,623 B2
`
`FIG.12
`FIG.12
`
`31
`
`
`
`15
`
`11
`
`11
`
`

`

`U.S. Patent
`
`Dec. 11,2007
`
`Sheet 10 0f 14
`
`US 7,307,623 B2
`
`FIG.13A
`
`FIG.13B
`
`12
`
`

`

`U.S. Patent
`
`Dec. 11, 2007
`
`Sheet 11 0f 14
`
`US 7,307,623 B2
`
`FIG. I4
`
`‘sIEIIIID°RIEIITINIIHI>EIDEIIIIGWIIEI“IIFERMAT|0~I~S41
`E
`E
`I ‘gm AEIIIIEcIQ IIIIc?EPXEEs @342
`T
`s
`CIID I A
`
`FIG.I5
`
`FIG.I6
`
`EEIIITIII EIIIIIIIIIIISLIIEPFIFSEEIEI‘EIII"
`
`%[E)NQI!'EGSEESUk-FS OFHNEE DIVISION
`RVE MAC
`
`13
`
`

`

`U.S. Patent
`
`Dec. 11,2007
`
`Sheet 12 0f 14
`
`US 7,307,623 B2
`
`F|G.17A
`
`A
`
`B
`
`33
`
`327
`
`F|G.17B
`
`A
`
`B
`
`33
`
`3 T
`a
`b
`
`F|G.17C
`
`34
`
`14
`
`

`

`U.S. Patent
`
`Dec. 11,2007
`
`Sheet 13 0f 14
`
`US 7,307,623 B2
`
`FIG.I8A
`
`A
`
`B
`
`N33
`
`G
`FIG.I8B
`{)
`A V/
`
`5
`
`N33
`
`0 x
`\
`1
`a
`
`A
`
`B
`
`C
`
`ADDING ELEMENTS "A" AND "B" DF OBJECTS N861
`I!
`ERASING ELEMENTS "B" AND DISPLAYING ONE
`OBJECT ADED WITH ELEMENT "A"
`I!
`EEEBEHGMXEEIQESULT OF THE ADDITION TO THE N363
`
`N862
`
`FIG.I9
`(5%.)
`
`Ci
`
`15
`
`

`

`U.S. Patent
`
`Dec. 11,2007
`
`Sheet 14 0f 14
`
`US 7,307,623 B2
`
`FIG. 20A
`
`35
`
`36
`
`FIG. 20B
`
`35
`
`16
`
`

`

`US 7,307,623 B2
`
`1
`INFORMATION PROCESSING DEVICE
`HAVING DETECTOR CAPABLE OF
`DETECTING COORDINATE VALUES, AS
`WELL AS CHANGES THEREOF, OF A
`PLURALITY OF POINTS ON DISPLAY
`SCREEN
`
`This application is related to Japanese Patent Application
`No. 2002-53833 ?led on Feb. 28, 2002, based on Which this
`application claims priority under the Paris Convention and
`the contents of Which are incorporated herein by reference.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`The present invention relates to an information processing
`device having a detector Which can detect coordinate values
`of a plurality of points, as Well as changes thereof, on the
`display screen, such as a touch-panel unit, and also relates to
`an information processing program used therefor, a com
`puter-readable recording medium having recorded therein an
`information processing program, and an information pro
`cessing method.
`2. Description of the Related Art
`There are knoWn touch-panels capable of recognizing
`coordinate values of points, as Well as changes thereof,
`speci?ed by the user on the display screen. Using such panel,
`the user can readily make a device execute various process
`ing simply by touching the display screen through the ?nger
`or an input device folloWing a displayed guidance output
`from the device. The touch-panel is thus applied to a Wide
`variety of information processing environment in need of
`simple operation, examples of Which include portable infor
`mation processing devices such as PDA (personal digital
`assistants), railWay ticket issuing machine and auto-teller
`machine at bank.
`HoWever in the information processing environment
`applied With the conventional touch-panels, the user has to
`handle data through operations Which are never encountered
`in the real World but unique to the information processing
`device, Which operations are typically such that specifying
`data by a single tap operation, and moving thereof by
`dragging. Thus those not fully accustomed to such data
`handling on the information processing device cannot
`readily operate the device even if the touch-panel is pro
`vided. In these years, there is thus a groWing market need for
`an interface Which can readily be operated even by those not
`fully accustomed to the data handling on the information
`processing device.
`
`SUMMARY OF THE INVENTION
`
`The present invention is completed in order to respond the
`foregoing need, and its object is to provide an information
`processing device Which alloWs the user not fully accus
`tomed to data handling on the information processing device
`to handle the data in a simple manner, an information
`processing program, a computer-readable recording medium
`having recorded therein the information processing pro
`gram, and an information processing method.
`One aspect of the present invention resides in that, using
`a touch-panel capable of detecting coordinate values of a
`plurality of points, as Well as changes therein, on the display
`screen, a data block as a target for the information process
`ing is identi?ed based on the coordinate values of a plurality
`of points Which are speci?ed by the user on the display
`screen or on changes therein caused by moving operation of
`
`2
`such plurality of points, and thus-identi?ed data block is
`then subjected to a predetermined processing. This consti
`tution typically alloWs the user to specify a plurality of
`points using a plurality of ?ngers and to execute information
`processing through an operation closely simulating actual
`motion in the real World, so that even those not fully
`accustomed to operation of the device can readily handle the
`data.
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`The above and other features Will be better understood
`from the exemplary embodiments described beloW, taken
`together With the draWings, of Which:
`FIG. 1 is a schematic draWing of a constitution of an
`information processing system according to an embodiment
`of the present invention;
`FIG. 2 is a block diagram of a constitution of the
`information processing system shoWn FIG. 1;
`FIG. 3 is a schematic draWing of a constitution of the
`touch-panel unit shoWn in FIG. 2;
`FIG. 4 is a schematic draWing shoWing an exemplary data
`displayed on the display unit shoWn in FIG. 1;
`FIG. 5 is a How chart shoWing a data selection method
`according to a ?rst embodiment of the present invention;
`FIGS. 6A and 6B are schematic draWings shoWing
`pressed-doWn points effected by the user on the display unit;
`FIG. 7A is a schematic draWing shoWing a selected area
`speci?ed by tWo pressed-doWn points on the display unit,
`and
`FIG. 7B is a schematic draWing explaining a status Where
`the data moves as the siZe of the selected area varies;
`FIG. 8 is a schematic draWing explaining a status Where
`objects deform as the siZe of the selected area varies;
`FIG. 9 is a schematic draWing explaining a modi?ed
`example of the data selection method according to the ?rst
`embodiment of the present invention;
`FIG. 10 is a How chart shoWing a data selection method
`according to a second embodiment of the present invention;
`FIGS. 11A and 11B are schematic draWings explaining
`statuses Where objects move close to pressed-doWn points;
`FIG. 12 is a schematic draWing explaining a status Where
`objects move as the pressed-doWn point moves;
`FIGS. 13A to 13C are schematic draWings explaining
`statuses Where an unintended object in the vicinity of the
`pressed-doWn point is brought apart;
`FIG. 14 is a How chart shoWing a data copying method
`according to an embodiment of the present invention;
`FIG. 15 is a schematic draWing explaining a status Where
`the copied objects have vanished from the display unit;
`FIG. 16 is a How chart for explaining a data dividing
`method according to an embodiment of the present inven
`tion;
`FIGS. 17A to 17C are schematic draWings explaining a
`data dividing method shoWn in FIG. 16;
`FIGS. 18A and 18B are schematic draWings explaining a
`modi?ed example of the data dividing method shoWn in
`FIG. 16;
`FIG. 19 is a How chart for explaining data synthesis
`method according to an embodiment of the present inven
`tion; and
`FIGS. 20A and 20B are schematic draWings for explain
`ing the data synthesis method shoWn in FIG. 19.
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`17
`
`

`

`US 7,307,623 B2
`
`3
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`Preferred embodiments of the present invention are
`described in detail below, with references made to relevant
`accompanying drawings.
`The present invention is applicable to an information
`processing device having a touch-panel unit capable of
`detecting coordinate values of a plurality of points, as well
`as changes therein, on the display screen.
`
`20
`
`25
`
`30
`
`The display unit 15 comprises a display output device
`such as a liquid-crystal display or CRT (Cathode Ray Tube),
`and outputs various information in a displayed manner
`following instruction issued by the CPU 11.
`The touch-panel unit 16 comprises a touch-panel capable
`of detecting coordinate values, as well as changes therein, of
`a plurality of points speci?ed by the user on the display unit
`15, and is built in, or is adhered with an adhesive to the
`display unit 15.
`The touch-panel unit 16 speci?cally has, as shown in FIG.
`3, a plurality of touch detection lines 21, 22 extending along
`the longitudinal and transverse directions, and touch keys
`provided at around orthogonal intersections of these touch
`detection lines along the longitudinal and transverse direc
`tions. The detection lines along the longitudinal and trans
`
`55
`
`60
`
`65
`
`Constitution of Information Processing Device
`An information processing device 1 according to an
`embodiment of the present invention is, as shown in FIG. 1,
`connected via a network 4 to a server machine 3 provided
`with a data base 2 which has stored therein various data,
`which constitution allows the information processing device
`1 to carry out various operation such as copying, synthesis
`or division of the data stored in the data base 2. The data
`include those having various forms such as music data and
`image data. The network 4 covers an entire range of com
`munication network employing electric communication
`technology, which speci?cally includes telephone commu
`nication line, the Internet, WAN (wide area network), LAN
`(local area network), optical ?ber communication, cable
`communication and satellite communication.
`The information processing device 1 comprises, as shown
`in FIG. 2, a CPU 11, a RAM 12, a ROM 13, a communi
`cation controller 14, a display unit 15 and a touch-panel unit
`16 also serves as a detector, where all of which are electri
`cally connected with each other by a bus line 17.
`The CPU 11 comprises an ordinary processor device, and
`controls operation of the information processing device 1
`according to various programs stored in the ROM 13.
`The RAM 12 comprises a volatile semiconductor
`memory, and provides a work area for temporarily storing
`programs and data which relate to processing executed by
`the CPU 11.
`The ROM 13 comprises a non-volatile semiconductor
`memory, and has a program unit 19 having recorded therein
`various programs such as boot program for activating the
`information processing device 1 and interface program 18
`which is used for executing the processing described later,
`and a processing data unit 20 having recorded therein
`various data necessary for executing these programs.
`Another possible constitution relates to that a part or entire
`portion of the programs to be stored in the ROM 13 is
`downloaded through the network 4.
`The communication controller 14 controls communica
`tion processing between the information processing device 1
`and the server machine 3 connected thereto via the network
`4.
`
`35
`
`40
`
`45
`
`50
`
`4
`verse directions are designed to connect with each other at
`the site of touch key 23 upon being pressed by the user.
`Detection of the coordinate values, as well as changes
`therein, of a plurality of points speci?ed by the user means
`that the touch-panel detects connection, and position of such
`connection, of the touch detection lines which extend along
`the longitudinal and transverse directions. It should now be
`noted that the structure of the touch-panel unit 16 shown in
`FIG. 3 is only of an exemplary type, and any other structures
`or operational principle may be allowable in the present
`invention provided that they can recogniZe a plurality of
`points speci?ed by the user.
`Operation of Information Processing Device
`With thus-composed information processing device 1, the
`user can execute various processing, through the touch
`panel unit 16, of data stored in the database 2.
`
`Selection of Data (1)
`The information processing device 1 selects data in the
`database 2 corresponding to an operation made through the
`touch-panel unit 16 by the user.
`In the selection processing, the information processing
`device 1 now shows data stored in the database 2 in a style
`as shown in FIG. 4. In the exemplary display shown in FIG.
`4, data in the database 2 are individually expressed by a
`plurality of spherical objects 31 arranged in a two-dimen
`sional plane, and each object 31 has attribute information
`which comprises a correspondent data name and information
`related to its coordinate value in the two-dimensional plane.
`The user can select the data in the database 2 by selecting the
`object 31 through the touch-panel unit 16. While the above
`description on the present embodiment dealt with the case
`where the data in the database 2 is expressed by the object
`31, the present invention is by no means limited thereto, and
`allows expression of the individual data in any other forms
`or styles. It is even allowable to arrange the object 31 in a
`three dimensional space by assigning an additional coordi
`nate value (along the direction normal to the display screen)
`to the object 31.
`The next paragraphs will detail, making reference to a
`?ow chart shown in FIG. 5, operations of the information
`processing device 1 when the user executes the operation of
`selecting the data in the database 2.
`The operational ?ow expressed by a ?ow chart in FIG. 5
`starts when the CPU 11 detects a touch at one point on the
`touch-panel unit 15 effected by the user, and the CPU 11 then
`executes processing of step S1 according to the interface
`program 18 stored in the ROM 13. While the following
`description deals with a case where the user touches the
`touch-panel unit 16 with the ?nger, it is to be noted that the
`present invention is by no means limited thereto, where the
`user can touch the touch-panel unit 16 also using a prede
`termined device such as a pen-input device.
`In the processing of step S1, the CPU 11 detects a
`coordinate value of a ?rst touch point (referred to as pressed
`down point “a” hereinafter, see FIG. 6A) touched by the user
`through the touch-panel unit 16. This completes the pro
`cessing of step S1, and the selection processing advances
`from a processing step of S1 to a processing of step S2.
`In the processing of step S2, the CPU 11 refers the
`coordinate values of the pressed-down point “a” and the
`object 31, and determines whether the object is displayed at
`a position corresponded to the pressed-down point “a”. If the
`object is found to be displayed at the position corresponded
`to the pressed-down point “a”, the CPU 11 then assumes in
`step S3 data corresponded to such object as a user-speci?ed
`data, and stores information on the user-speci?ed data in the
`
`18
`
`

`

`US 7,307,623 B2
`
`5
`RAM 12. A series of selection processing thus completes.
`On the contrary, if the object is not found to be displayed at
`the position corresponded to the pressed-doWn point “a”, the
`selection processing jumps from the processing of step S2 to
`a processing of step S4.
`In the processing of step S4, the CPU 11 detects a
`coordinate value of a second touch point (referred to as
`pressed-doWn point “b” hereinafter, see FIG. 6B) effected by
`the user. This completes the processing of step S4, and the
`selection processing advances from the processing of step
`S4 to a processing of step S5.
`In the processing of step S5, the CPU 11 refers coordinate
`values of the pressed-doWn points “a” and “b”, draWs as
`shoWn in FIG. 7A straight line segments Which extend from
`both pressed-doWn points and are oriented 0t degrees aWay
`from the straight line segment Which connects both pressed
`doWn points, and de?nes an area 40 (referred to as “selected
`area 40”, hereinafter) surrounded by these straight line
`segments as an area Within Which the succeeding processing
`is executed. This completes the processing of step S5, and
`the selection processing advances from the processing of
`step S5 to a processing of step S6.
`In the processing of step S6, the CPU 11 determines
`Whether the user has moved at least either of the pressed
`doWn points “a” and “b” While keeping the user’s contact
`With the touch panel unit 16. If the pressed-doWn point Was
`found to have moved by the user, the selection processing
`goes back from the processing of step S6 to the processing
`of step S5. On the contrary, if neither of the pressed-doWn
`points “a” and “b” Was found to have moved by the user, the
`selection processing advances from the processing of step
`S6 to a processing of step S7.
`SiZe of the selected area 40 Will vary as the processing of
`steps S5 and S6 are repeated, Where the CPU 11 controls the
`display unit 15 so as to display, as shoWn in FIG. 7B, the
`objects Which fall Within the ?rst selected area as being
`moved. This kind of processing alloWs the user to manipu
`late the objects as if the user picks the objects With the
`?ngers. Such mobile display of the objects is effective in
`particular When the distance betWeen the pressed-doWn
`points “a” and “b” becomes shorter than the initial value.
`Another strategy of mobile display of the objects Which
`fall Within the selected area 40 is such that, as shoWn in FIG.
`8, deforming the objects so as to protrude them toWards the
`user depending on the moving distance of the pressed-doWn
`points, Which Will more strongly impress the user With a
`“sense of picking the objects”. Possible Ways of deforming
`the objects typically include such that assuming the display
`screen as one texture and deforming the texture to a degree
`equivalent to the moving distance of the pressed-doWn
`points, and such that expressing a three-dimensional sWell of
`the object by varying position of the object in the direction
`normal to the display screen.
`In the processing of step S7, the CPU 11 determines
`Whether the user released the ?nger from either of the
`pressed-doWn points on the touch-panel unit 16. If the ?nger
`Was not found to have released from the pressed-doWn point,
`the selection processing goes back from the processing of
`step S7 to the processing of step S6. On the contrary, if the
`?nger Was found to have released from either of the pressed
`doWn points “a” and “b”, the selection processing advances
`from the processing of step S7 to processing of steps S8 and
`S9.
`In the processing of steps S8 and S9, the CPU 11
`determines Whether the user released another ?nger from the
`other pressed-doWn point Within a predetermined time
`period after the previous release of the ?nger from either of
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`the pressed-doWn points. If the user’s another ?nger Was not
`found to have released from the other pressed-doWn point
`Within a predetermined time period after the previous release
`of the ?nger from either of the pressed-doWn points, the
`CPU 11 returns the selection processing back to the pro
`cessing of step S5. On the contrary, if the user’s another
`?nger Was found to have released from the other pressed
`doWn point Within a predetermined time period, the CPU 11
`assumes, in a processing of step S10, the data corresponded
`to the objects Which fall Within the selected area 40 as the
`user-speci?ed data, and stores information on the user
`speci?ed data in the RAM 12. A series of selection process
`ing thus completes.
`While the above description dealt With the case Where the
`selected area 40 Was de?ned based on tWo points pressed on
`the touch-panel by the user, the selected area 40 may also be
`de?ned by connecting three or more user-speci?ed points
`With straight line segments as shoWn in FIG. 9.
`
`Selection of Data (2)
`The information processing device 1 can select the data in
`the database 2 also in accordance With user’s operations
`which differs from those described in the above. The next
`paragraphs Will detail, making reference to a How chart
`shoWn in FIG. 10, operations of the information processing
`device 1 When the user executes the operation of selecting
`the data in the database 2. The description noW starts from
`step S24 and proceeds step by step thereafter, since steps
`S21 to S23 in FIG. 10 are same as steps S1 to S3 in FIG. 5.
`In the processing of step S24, the CPU 11 refers coordi
`nate values of the pressed-doWn point “a” and of the objects,
`and ?nds the objects Which fall Within a predetermined
`range aWay from the pressed-doWn point “a”. This com
`pletes the processing of step S24, and the selection process
`ing then advances from the processing of step S24 to a
`processing of step S25.
`In the processing of step S25, the CPU 11 controls the
`display unit 15 so that, as shoWn in FIG. 11A, the objects
`Which fall Within a predetermined range aWay from the
`pressed-doWn point “a” are displayed as being moved to
`thereby gather close to such pressed-doWn point “a”. This
`completes the processing of step S25, and the selection
`processing then advances from the processing of step S25 to
`a processing of step S26.
`In the processing of step S26, the CPU 11 detects the
`coordinate position of the pressed-doWn point “b”. This
`completes the processing of step S26, and the selection
`processing then advances from the processing of step S26 to
`a processing of step S27.
`In the processing of step S27, the CPU 11 refers coordi
`nate values of the pressed-doWn point “b” and of the objects,
`and ?nds the objects Which fall Within a predetermined
`range aWay from the pressed-doWn point “b”. This com
`pletes the processing of step S27, and the selection process
`ing then advances from the processing of step S27 to a
`processing of step S28.
`In the processing of step S28, the CPU 11 controls the
`display unit 15 so that, as shoWn in FIG. 11B, the objects
`Which fall Within a predetermined range aWay from the
`pressed-doWn point “b” are displayed as being moved to
`thereby gather. close to such pressed-doWn point “b”. This
`completes the processing of step S28, and the selection
`processing then advances from the processing of step S28 to
`a processing of step S29.
`In the processing of step S29, the CPU 11 determines
`Whether the user has moved at least either of the pressed
`doWn points “a” and “b” While keeping the user’s contact
`
`19
`
`

`

`US 7,307,623 B2
`
`7
`With the touch panel unit 16. If neither of the pressed-doWn
`points “a” and “b” Was found to have moved by the user, the
`selection processing advances from the processing of step
`S29 to a processing of step S30. On the contrary, if at least
`either of the pressed-doWn points Was found to have moved
`by the user, the selection processing jumps from the pro
`cessing of step S29 to the processing of step S31.
`In the processing of step S30, the CPU 11 detects a locus
`of the moved pressed-doWn point, and displays, as shoWn in
`FIG. 12, the objects Which fall Within a predetermined range
`aWay from the moved pressed-doWn point (pressed-doWn
`point “b” in an exemplary case of FIG. 12) as being properly
`moved close to the pressed-doWn point. This completes the
`processing of step S30, and the selection processing again
`goes from the processing of step S30 back to the processing
`of step S29.
`In the processing of step S31, the CPU 11 determines
`Whether the user has released the ?nger from at least either
`of the pressed-doWn points “a” and “b”. If the user Was
`found to have not released the ?nger from neither of them,
`the selection processing again goes from the processing of
`step S31 back to the processing of step S29. On the contrary,
`if the user Was found to have released the ?nger from either
`of the pressed-doWn points, the selection processing
`advances from the processing of step S31 to processing of
`steps S32 and S33.
`In the processing of steps S32 and S33, the CPU 11
`determines Whether the user released another ?nger from the
`other pressed-doWn point Within a predetermined time
`period. If the user’s ?nger Was not found to have released
`from the other pressed-doWn point Within a predetermined
`time period, the CPU 11 returns the selection processing
`back to the processing of step S26. On the contrary, if the
`user’s ?nger Was found to have released from the other
`pressed-doWn point Within a predetermined time period, the
`CPU 11 assumes, in a processing of step S34, the data
`corresponded to the objects Which fall Within the selected
`area 40 as the user-speci?ed data, and stores information on
`the user-speci?ed data in the RAM 12. A series of selection
`processing thus completes.
`It is also alloWable noW in the above processing that the
`objects closer to the pressed-doWn point can gather faster
`and those more distant from the pressed-doWn point can
`gather sloWer depending on the length of the press-doWn
`time. This successfully provides a proper space betWeen the
`objects closer to the pressed-doWn point and those more
`distant therefrom, Which facilitates the selection operation of
`the objects.
`While the above description dealt With the case Where the
`information processing device 1 executes the selection pro
`cessing based on tWo points pressed on the touch-panel by
`the user, the selection operation may also be executed based
`on three or more pressed-doWn points. The selection pro
`cessing based on three or more pressed-doWn points alloWs
`the user, even for the case Where unintended objects are
`displayed as being moved close to the pressed-doWn point,
`to bring such unintended objects aWay from the pressed
`doWn point, and to execute the selection processing Without
`retrial.
`Possible processing for such case Will speci?cally be
`explained referring to an exemplary case shoWn in FIG. 13A
`Where an unintended object 31a is displayed as being moved
`close to the pressed-doWn point “a”. In this example, the
`user speci?es a pressed-doWn point “c” Within a predeter
`mined range aWay from the object 3111 While keeping the
`?nger touch on the pressed-doWn points “a” and “b”. Since
`the CPU 11 displays the object 31a so as to move toWards
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`the pressed-doWn point “c”, the object 31a can be brought
`aWay from the pressed-doWn point “a” as shoWn in FIG.
`13B. If the user further moves the pressed-doWn point “c”
`While keeping the ?nger touch on the touch-panel unit 16,
`and then releases the ?nger from the pressed-doWn point
`“c”, the object 31a is displayed as shoWn in FIG. 13C so as
`to be moved together With the pressed-doWn point “c”,
`Which can bring the object 31a further aWay from the
`pressed doWn point “a”.
`For the case Where all user-speci?ed, pressed-doWn points
`are cancelled Within a predetermined time period as
`described in the above, execution of the selection processing
`Will come to the end. For the case Where at least one
`pressed-doWn point remains after the elapse of a predeter
`mined time period, the selection processing Will be contin
`ued based on such remaining pressed-doWn point. For the
`case Where there is only one pressed-doWn point and such
`pressed-doWn point is cancelled, execution of the selection
`processing is cancelled. With the aid of such canceling
`operation of the selection processing the user can alter
`arrangement of the objects, Which alloWs the user to execute
`processing such as altering the arrangement of other objects
`in order to facilitate selection of a desired object.
`
`Copying of Data
`The information processing device 1 can copy the data in
`the database 2 selected by the user according to user’s
`operations as described beloW. The next paragraphs Will
`detail, making reference to a How chart shoWn in FIG. 14,
`operations of the information processing device