`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SAMSUNG EXHIBIT 1017
`Samsung Electronics America Inc. v. Uniloc Luxembourg, S.A.
`IPR2018-01664
`
`Page 1 of 16
`
`

`

`Patent Application Publication
`
`Nov. 22, 2007 Sheet 1 0f 6
`
`US 2007/0268246 A1
`
`
`
`Page 2 of 16
`
`Page 2 of 16
`
`

`

` > SPEAKER
`
`
`28
`
`
`
`
`
`22
`
`
`
`42
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`MEMORY
`
`
`
`VIRTUAL
`
`SCREEN
`
`STORAGE
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication
`
`
`
`
`
`
`
`Nov. 22, 2007 Sheet 2 of 6
`
`
`
`US 2007/0268246 A1
`
`
`
`20
`
`
`
`SOUND
`
`
`
`
`PROCESSING
`
`
`
`
`
`MICROPHONE
`MOTION
`
`
`
`
`
`
`SENSOR
`PROCESSING
`
`
`
`
`
`
` MOTION SIGNAL
`I
`
`
`DISPLAY DEVICE
`
`
`
`
`
`
`
`CPU
`
`
`
`
`
`
`
`
`CONTROL
`
`CIRCUIT
`
`MOBILE
`
`PHONE
`
`
`LPF
`FUNCTIONS
`
`
`
`
`45
`
`
`24.26
`
`>
`
`
`
`
`
`
`I__—
`BLUETOOTH,
`
`22a
`
`
`
`POWER
`IR. WLAN,
`
`
`
`
`SUPPLY
`SMS,
`
`
`MMS
`
`
`
`
`
`
`
`
`
`
`I3K3.2
`
`
`40\
`
`
`40'\‘
`
`
`40"\‘
`
`Page 3 of 16
`
`
`
`
`
`
`
`
`
`60
`
`
`
`64
`
`
`
`
`
`MOHON
`
`
`
`SENSOR
`
`
`FHC3.5
`
`
`
`5
`
`I
`
`
`
`
`
`g
`
`
`
`IIIIIIII
`.L____________________________________________.
`70b—/”
`
`Page 3 of 16
`
`

`

`
`
`Patent Application Publication
`
`
`
`
`
`
`
`Nov. 22, 2007 Sheet 3 0f 6
`
`
`
`US 2007/0268246 A1
`
`
`
`
`
`Page 4 of 16
`
`Page 4 of 16
`
`

`

`
`
`Patent Application Publication
`
`
`
`
`
`
`
`Nov. 22, 2007 Sheet 4 0f 6
`
`
`
`US 2007/0268246 A1
`
`
`
` AGeo-den u ”9:":
`
`gum-d ~< H,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
` “mi-.1
`a
`D
`{1.11 U .ud‘d.
`urn-w, “5-3.”:an
`
`
`
`
`
`
`
`
`
`'
`M’
`~9®flfl¥iwiwfic
`
`'
`
`
`FIG 7B
`'
`
`1“ WM;
`
`,IV a:
`
`.
`
`+ WW‘MM
`
`
`
`
`
`
`
`
`
`
`.59" flu}? $r“»n” I
`
`
`
`
`
`2“} kna- raw»); ,,
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 70
`
`
`
`Page 5 of 16
`
`Page 5 of 16
`
`

`

`
`
`Patent Application Publication
`
`
`
`
`
`
`
`Nov. 22, 2007 Sheet 5 0f 6
`
`
`
`US 2007/0268246 A1
`
`Accel
`
`
`
`
`
`102
`
`
`
`
`100
`
`/
`
`
`
`
`FIG. 8A
`
`110
`
`
`
`
`FIG. 88
`
`Page 6 of 16
`
`Page 6 of 16
`
`

`

`
`
`Patent Application Publication
`
`
`
`
`
`
`
`Nov. 22, 2007 Sheet 6 of 6
`
`
`
`US 2007/0268246 A1
`
`
` ls motion
`
`
`
`processing
`enabled?
`
`
`
`
`120
`
`
`
`\
`
`
`
`No 122
`
`
`
`124
`
`
`
`No
`
`Is motion
`
`
`
`
` occu ring?
`
`
`
`
`
` ls motion
`
`
`intended
`
`motion?
`
`
`
`
`
`
`
`
`
`126
`
`
`
`
`
`Yes
`
`No
`
`Yes
`
`
`
`
`
`
`
`
`Change display
`
`origin to
`
`Pan—
`correspond to
`
`
`
`
`
`
`requested pan
`
`
`direction
`
`
`
`
`
`
`
`Retreive from
`
`
`
`
`memory screen
`
`
`
`
`image data
`
`
`corresponding to
`
`
`new origin
`
`
`
`
`
`Display image on
`screen referenced
`
`
`
`
`
`
`from new origin
`
`J
`
`1 34
`
`1 36
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`132
`
`
`
`
`
`128
`
`
`
`
`
`
`
`
`
`
` Compute
`movement vectors
`
`
`
`
`to determine
`
`
`
`
`requested
`
`operation
`
`130
`
`
`
`
`
`
`
`
` ls request for
`
`-an or zoom?
`
`
`
`
`
`Zoom
`
`
`Change
`
`
`magnification rate
`to correspond to
`
`
`zoom in orzoom
`
`
`
`out request
`
`
`
`138
`
`
`
`140
`
`
`
`Apply zoom factor
`
`
`
`
`to display data
`
`
`
`
`
`
`
`142
`
`
`FIG. 9
`
`Page 7 of 16
`
`
`
`
`
`
`Display image on
`
`
`M
`screen with new
`
`
`
`virtual
`
`
`
`magnification rate
`
`
`
`Page 7 of 16
`
`

`

`
`
`US 2007/0268246 A1
`
`
`
`Nov. 22, 2007
`
`
`
`ELECTRONIC EQUIPMENT WITH SCREEN
`
`
`
`PAN AND ZOOM FUNCTIONS USING
`
`
`
`
`
`MOTION
`
`
`
`
`
`TECHNICAL FIELD OF THE INVENTION
`
`
`
`
`
`
`
`
`
`
`
`
`[0001] The present
`invention relates generally to elec-
`
`
`
`
`
`
`
`tronic equipment and, more particularly, to electronic equip-
`ment that includes motion activated pan and zoom functions
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`for viewing a Virtual page, and a method of performing
`motion activated pan and zoom functions on electronic
`
`
`
`
`
`
`
`
`
`equipment.
`DESCRIPTION OF THE RELATED ART
`
`
`
`
`
`
`
`
`
`
`
`[0002] Conventional mobile phones, in addition to pro-
`
`
`
`
`
`
`viding voice communication capabilities, also provide a
`
`
`
`
`
`
`
`number of non-voice related features. For example, mobile
`
`
`
`
`
`
`
`
`
`phones can be used to surf the intemet, transmit and receive
`
`
`
`
`
`
`
`
`
`messages (e.g., emails and text messages), play music and
`
`
`
`
`
`
`
`videos, take and display photographs, as well as a number of
`other features. While these features utilize various sub-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`systems of the mobile phone, one subsystem that often is
`
`
`
`
`
`
`
`
`used in all of these features is the display subsystem.
`
`
`
`
`
`
`
`[0003]
`In designing the physical characteristics of mobile
`
`
`
`
`
`
`
`phones, a number of considerations are taken into account.
`
`
`
`
`
`
`
`
`
`Two features of mobile phones that are highly desirable are
`
`
`
`
`
`
`
`
`the size of the mobile phone (generally a smaller phone is
`
`
`
`
`
`
`
`
`
`preferred) and the viewing area provided by the mobile
`
`
`
`
`
`
`
`phone’s display (generally a larger viewing area is pre-
`ferred). However, as the size of the phone is reduced, the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`size of the display (and thus the viewing area) also is
`
`
`
`
`
`
`
`
`reduced. Conversely, as the viewing area of the display (and
`
`
`
`
`
`
`
`
`
`thus the display size) is increased, the size of the phone is
`
`
`
`
`
`increased. Consequently, a compromise is reached between
`
`
`
`
`
`
`
`
`
`the size of the mobile phone and the display viewing area
`
`
`
`
`
`
`
`
`such that satisfactory operation and portability are achieved.
`
`
`
`
`
`
`
`[0004] While the above compromise between mobile
`
`
`
`
`
`
`
`
`phone size and display viewing area provides satisfactory
`
`
`
`
`
`
`
`
`operation of the mobile phone, there are some drawbacks.
`
`
`
`
`
`
`
`
`
`
`For example, current web pages are formatted for use with
`
`
`
`
`
`
`
`
`conventional computer displays. When such web pages are
`
`
`
`
`
`
`
`viewed on conventional mobile phone displays (which are
`
`
`
`
`
`
`
`substantially smaller than a computer display), only a por-
`
`
`
`
`
`
`
`
`tion of the web page can be reasonably viewed on the screen.
`
`
`
`
`
`
`
`
`
`
`To view portions not shown on the display, the user must
`
`
`
`
`
`
`
`
`
`scroll
`through the web page using the mobile phone’s
`
`
`
`
`
`
`
`
`keypad, which can be a slow and tedious process. As a result,
`
`
`
`
`
`
`
`
`
`special web pages particularly suited for the small displays
`
`
`
`
`
`
`
`
`
`of mobile phones have been developed. Such web pages,
`
`
`
`
`
`
`
`
`however, typically do not include the content of their larger
`counter parts.
`
`
`Similar issues exist for other media viewed on the
`[0005]
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`mobile phone’s display. For example, photographs often are
`
`
`
`
`
`
`
`
`
`taken and/or shared via mobile phones, wherein the photo-
`
`
`
`
`
`
`
`
`graphs are viewed on the mobile phone’s display. Often it is
`
`
`
`
`
`
`
`
`desired to zoom in and/or out of the photographic image
`
`
`
`
`
`
`
`
`and/or pan the photographic image on the display. Again,
`
`
`
`
`
`
`
`
`this requires the user to manipulate the mobile phone’s
`
`
`
`
`
`
`
`
`keypad. As will be appreciated, such problems can arise for
`
`
`
`
`
`
`
`
`
`any application that requires use of the mobile phone’s
`
`display.
`[0006]
`In an attempt to address the above issues, motion
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`driven panning of screen displays has been implemented in
`
`
`
`
`
`
`
`mobile phones. In such systems, the motion of the mobile
`
`
`
`
`
`
`
`
`
`phone is correlated to a pan request (e.g., motion to the right
`
`
`
`
`
`
`
`
`
`
`indexes the display to the right, motion to the left indexes the
`
`
`
`
`
`
`
`
`
`display to the left, etc.). While such systems are effective,
`
`
`
`
`
`
`
`
`
`they do not provide the user with precise control of the pan
`
`
`
`
`
`
`
`
`function. Instead, each motion indexes the display a prede-
`
`
`
`
`
`
`
`
`termined amount. For example, if a user wishes to pan right
`
`
`
`
`
`
`
`
`on the display, he must move or “shake” the mobile phone
`
`
`
`
`
`
`
`
`
`in the right direction, which causes the display to index a
`
`
`
`
`
`
`
`
`predetermined amount to the right (e.g., the image appears
`
`
`
`
`
`
`
`
`
`to snap or tab over a predetermined distance). The user then
`
`
`
`
`
`
`
`
`
`must look at the display to determine if the screen shows the
`desired content. If not, then the user must again move the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`phone to the right to initiate another pan request, causing the
`
`
`
`
`
`
`display to again index by the predetermined distance.
`SUMMARY
`
`
`
`
`
`
`
`
`
`
`[0007] The present invention enables a mobile phone to
`
`
`
`
`
`
`
`
`
`easily and intuitively pan and zoom content viewed on the
`
`
`
`
`
`
`
`mobile phone’s display. A motion sensor, such as an accel-
`
`
`
`
`
`
`
`
`erometer or the like, detects motion of the mobile phone
`
`
`
`
`
`
`forward/reverse, sideways, up/down,
`rotate, etc.).
`(e.g.,
`
`
`
`
`
`
`
`
`When viewing content on the display, this motion can be
`translated into pan or zoom functions, such that the user
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`need not manipulate the mobile phone’s keypad. Further, the
`
`
`
`
`
`
`
`
`motion of the phone (e.g., direction and velocity) is corre-
`
`
`
`
`
`
`
`
`
`
`lated to a virtual page image such that the pan and/or zoom
`functions can simulate the movement of a window or
`
`
`
`
`
`
`
`
`
`
`
`
`
`magnifying glass over a large document, such as a newspa-
`
`
`
`
`
`
`
`
`
`per, for example. The overall viewing effect is smoother and
`
`
`
`
`
`
`
`
`
`
`more precise than using the keypad and/or prior art motion
`
`
`panning systems.
`
`
`
`
`
`
`[0008] According to one aspect of the invention, there is
`
`
`
`
`
`
`
`provided an electronic equipment that includes a display for
`
`
`
`
`
`
`
`viewing a virtual page, a transducer operable to detect
`motion of the electronic equipment, and a control circuit for
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`providing information to the display. The control circuit is
`
`
`
`
`
`
`responsive to detected motion to perform at least one of a
`
`
`
`
`
`
`
`pan or zoom of information provided to the display, wherein
`
`
`
`
`
`
`
`
`the pan and/or zoom correspond to a direction and velocity
`of the detected motion.
`
`
`
`
`
`
`
`
`
`the transducer is
`[0009] According to another aspect,
`
`
`
`
`
`
`operable to generate a motion signal that corresponds to
`acceleration and/or deceleration of the electronic equipment,
`
`
`
`
`
`
`
`
`
`
`
`
`and the control circuit is operable to determine a velocity of
`
`
`
`
`
`
`
`the electronic equipment from the motion signal.
`
`
`
`
`
`
`[0010] According to another aspect,
`the transducer
`
`
`
`
`
`
`
`comprises a signal conditioning circuit to filter out
`
`
`
`
`
`
`representing motion not
`representative of
`signals
`
`
`
`
`
`intended motion of the electronic equipment.
`
`
`
`
`
`
`[0011] According to another aspect, the signal condition-
`
`
`
`
`
`
`ing circuit comprises a low pass filter.
`
`
`
`
`
`
`
`[0012] According to another aspect, the electronic equip-
`
`
`
`
`
`
`
`ment includes a motion signal processing circuit operative to
`
`
`
`
`
`
`provide a motion signal indicative of duration of the motion,
`
`
`
`
`
`
`
`amplitude of the motion, and/or frequency of the motion.
`
`
`
`
`
`
`
`
`
`The motion signal processing circuit can include at least one
`
`
`
`
`
`
`
`
`of a low pass filter, a threshold detector, an amplitude
`
`
`
`detector or a frequency detector.
`
`
`
`
`
`
`
`[0013] According to another aspect, the transducer com-
`prises an accelerometer, a velocimeter or a signal detector.
`
`
`
`
`
`
`
`
`
`
`
`[0014] According to another aspect,
`the transducer is
`
`
`
`
`
`
`
`
`operable to detect at least one of acceleration, position,
`
`
`rotation or proximity.
`
`
`
`Page 8 of 16
`
`Page 8 of 16
`
`

`

`
`
`US 2007/0268246 A1
`
`
`
`Nov. 22, 2007
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0015] According to another aspect, the detected motion is
`
`
`
`
`
`relative to an orientation of the electronic equipment.
`
`
`
`
`
`
`[0016] According to another aspect, at least one of the pan
`
`
`
`
`
`or zoom motions is user configurable.
`
`
`
`
`
`
`[0017] According to another aspect, user configurable pan
`
`
`
`
`
`
`
`
`or zoom motions can include at least one of defining motion
`
`
`
`
`
`
`
`along each axis to correspond to a pan or zoom function, and
`
`
`
`
`
`adjusting pan and/or zoom rates.
`
`
`
`
`
`
`[0018] According to another aspect, the electronic equip-
`
`
`
`ment is a mobile phone.
`
`
`
`
`
`
`[0019] According to another aspect, the electronic equip-
`
`
`
`
`
`
`
`ment is at least one of a personal audio device, a personal
`
`
`
`
`
`Video device or a personal digital assistant.
`
`
`
`
`
`
`[0020] Another aspect of the invention relates to a method
`
`
`
`
`
`
`
`
`of viewing a Virtual
`image on an electronic equipment
`
`
`
`
`
`
`
`display, including moving the electronic equipment; detect-
`
`
`
`
`
`
`
`ing such moving; and in response to said moving of a
`
`
`
`
`
`
`
`
`prescribed character; and panning and/or zooming the vir-
`
`
`
`
`
`
`
`
`
`image on the display, wherein said panning and/or
`tual
`
`
`
`
`
`
`
`zooming corresponds to a direction and velocity of the
`
`
`detected moving.
`
`
`
`
`
`[0021] Another aspect of the invention relates to panning
`
`
`
`
`
`
`and/or zooming on the virtual display in proportion to said
`
`
`
`velocity and direction.
`
`
`
`
`
`
`[0022] Another aspect of the invention relates to condi-
`
`
`
`
`
`
`
`tioning the detected motion to filter out signals representing
`
`
`
`
`
`motion not representative of intended motion of the elec-
`
`
`tronic equipment.
`
`
`
`
`
`
`
`
`the prescribed
`[0023] Another aspect of the invention,
`character of motion includes at least one of acceleration,
`
`
`
`
`
`
`
`
`
`
`
`velocity, direction, directional change or rotation.
`
`
`
`
`
`[0024] Another aspect of the invention relates to enabling
`
`
`
`
`
`
`
`or disabling motion detection via a user input.
`
`
`
`
`
`
`[0025] Another aspect of the invention, enabling or dis-
`
`
`
`
`
`
`
`
`abling motion detection via a user input includes pressing
`
`
`
`
`
`
`
`
`and holding a key of the mobile phone to enable motion
`detection.
`
`[0026] Another aspect of the invention relates to a com-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`puter program operable in electronic equipment, said elec-
`
`
`
`
`
`
`
`tronic equipment including a display for viewing informa-
`
`
`
`
`
`
`
`tion, including code to operate the electronic equipment to
`detect the character of motion of such electronic equipment,
`
`
`
`
`
`
`
`
`
`
`
`
`
`and code for causing information to be panned or zoomed on
`
`
`
`
`
`
`
`the display, said panning and/or zooming corresponding to
`the detected character of motion, wherein said panning
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`and/or zooming corresponds to a direction and velocity of
`the character of motion.
`
`
`
`[0027] Another aspect of the invention relates to an elec-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`tronic equipment that includes a display for viewing a virtual
`
`
`
`
`
`
`
`page, a transducer operable to detect motion of the electronic
`
`
`
`
`
`
`
`equipment, and a control circuit for providing information to
`
`
`
`
`
`
`
`
`the display. The control circuit is responsive to detected
`
`
`
`
`
`
`
`
`
`motion to perform at
`least one of a pan or zoom of
`
`
`
`
`
`
`
`information provided to the display, wherein said pan or
`
`
`
`
`
`
`
`zoom is substantially continuous with the detected motion.
`
`
`
`
`
`
`
`[0028]
`To the accomplishment of the foregoing and the
`related ends,
`the invention,
`then, comprises the features
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`hereinafter fully described in the specification and particu-
`
`
`
`
`
`
`
`
`
`larly pointed out in the claims, the following description and
`
`
`
`
`
`
`
`
`the annexed drawings setting forth in detail certain illustra-
`tive embodiments of the invention, these being indicative,
`
`
`
`
`
`
`however, of but several of the various ways in which the
`
`
`
`
`
`
`
`
`
`
`
`
`
`principles of the invention may be suitably employed.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0029] Other systems, methods, features, and advantages
`
`
`
`
`
`
`
`of the invention will be or become apparent to one with skill
`
`
`
`
`
`
`
`
`in the art upon examination of the following drawings and
`
`
`
`
`
`
`
`detailed description. It is intended that all such additional
`
`
`
`
`
`
`systems, methods, features, and advantages be included
`
`
`
`
`
`
`
`
`within this description, be within the scope of the present
`
`
`
`
`
`invention, and be protected by the accompanying claims.
`
`
`
`
`
`
`
`[0030] Although the invention is shown and described
`
`
`
`
`
`
`
`
`
`with respect
`to one or more embodiments,
`it
`is to be
`
`
`
`
`
`
`
`understood that equivalents and modifications will occur to
`
`
`
`
`
`
`
`
`
`others skilled in the art upon the reading and understanding
`
`
`
`
`
`
`
`
`of the specification. The present invention includes all such
`
`
`
`
`
`
`
`equivalents and modifications, and is limited only by the
`
`
`
`scope of the claims.
`
`
`
`
`
`
`
`
`[0031] Also, although the various features are described
`
`
`
`
`
`
`and are illustrated in respective drawings/embodiments, it
`
`
`
`
`
`
`
`
`will be appreciated that features of a given drawing or
`
`
`
`
`
`
`
`embodiment may be used in one or more other drawings or
`embodiments of the invention.
`
`
`
`
`
`
`
`
`
`
`
`[0032]
`It should be emphasized that the term “comprise/
`
`
`
`
`
`
`
`comprising” when used in this specification is taken to
`
`
`
`
`
`
`
`
`
`specify the presence of stated features, integers, steps or
`
`
`
`
`
`
`
`
`components but does not preclude the presence or addition
`
`
`
`
`
`
`
`
`of one or more other features, integers, steps, components or
`
`
`groups thereof.”
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0033] Many aspects of the invention can be better under-
`
`
`
`
`
`
`
`stood with reference to the following drawings. The com-
`
`
`
`
`
`
`
`ponents in the drawings are not necessarily to scale, empha-
`
`
`
`
`
`
`
`instead being placed upon clearly illustrating the
`sis
`
`
`
`
`
`principles of the present invention. Likewise, elements and
`
`
`
`
`
`
`features depicted in one drawing may be combined with
`
`
`
`
`
`
`elements and features depicted in additional drawings.
`
`
`
`
`
`
`Moreover, in the drawings, like reference numerals desig-
`
`
`
`
`
`
`
`nate corresponding parts throughout the several views.
`[0034]
`FIG. 1 is schematic illustration of an exemplary
`
`
`
`
`
`
`
`mobile phone.
`FIG. 2 is a schematic block diagram of a number of
`[0035]
`
`
`
`
`
`
`
`
`
`
`
`
`exemplary relevant portions of the respective mobile phone
`of FIG. 1 in accordance with an embodiment of the present
`
`
`
`
`
`
`invention.
`
`
`
`
`
`
`
`
`FIGS. 3, 4 and 5 are, respectively, schematic illus-
`[0036]
`
`
`
`
`
`
`
`trations of exemplary motion transducers providing for
`motion detection based on threshold, amplitude, or fre-
`
`
`
`
`
`
`
`
`quency.
`
`
`
`
`
`
`FIG. 6A is a schematic diagram illustrating motion
`[0037]
`
`
`
`
`
`
`
`of the mobile phone and exemplary interpretations of the
`motion.
`
`
`
`
`
`
`
`
`
`
`FIG. 6B is a schematic diagram illustrating exem-
`[0038]
`
`
`
`
`
`
`plary panning of an image on a mobile phone display in
`accordance with the invention.
`
`
`
`
`FIGS. 7A-7C illustrate several views of an exem-
`[0039]
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`plary mobile phone display showing a map viewed with
`different levels of zoom in accordance with the invention.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIGS. 8A-8B are exemplary signals that may be
`[0040]
`
`
`
`
`
`
`generated using an accelerometer as the motion sensor.
`
`
`
`
`Page 9 of 16
`
`Page 9 of 16
`
`

`

`
`
`US 2007/0268246 A1
`
`
`
`Nov. 22, 2007
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 9 is a flow chart representing the exemplary
`[0041]
`
`
`
`
`
`operation of the electronic equipment in accordance with the
`
`
`present invention.
`DETAILED DESCRIPTION OF EMBODIMENTS
`
`
`
`
`
`
`
`
`
`
`
`[0042] The present invention will now be described with
`
`
`
`
`
`
`
`reference to the drawings, wherein like reference numerals
`
`
`
`
`
`
`are used to refer to like elements throughout.
`
`
`
`
`
`
`
`[0043] The term “electronic equipment” includes portable
`
`
`
`
`
`
`
`radio communication equipment. The term “portable radio
`
`
`
`
`
`
`communication equipment,” which herein after is referred to
`
`
`
`
`
`
`
`as a “mobile radio terminal,” “mobile phone,” “mobile
`device,” or “mobile terminal” and the like,
`includes all
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`equipment such as mobile telephones, pagers, communica-
`
`
`
`
`
`
`
`i.e., electronic organizers, personal digital assistants
`tors,
`
`
`
`
`
`(PDAs), smartphones, portable communication apparatus or
`
`
`
`
`
`
`
`
`
`the like. The term “electronic equipment” also may include
`
`
`
`
`
`
`
`
`portable digital music and/or Video devices, e.g.,
`iPod
`
`
`
`
`devices, mp3 players, etc.
`
`
`
`
`
`
`
`
`the invention is
`In the present application,
`[0044]
`
`
`
`
`
`
`
`
`described primarily in the context of a mobile phone.
`
`
`
`
`
`
`
`
`However,
`it will be appreciated that the invention is not
`
`
`
`
`
`
`
`
`intended to be limited to a mobile phone and can be any type
`
`
`
`of electronic equipment.
`
`
`
`
`
`
`
`[0045] An electronic equipment, such as a mobile phone,
`
`
`
`
`
`
`
`includes a display for viewing information, such as text
`
`
`
`
`
`
`
`messages (e.g., emails), images (e.g., photographs), videos
`
`
`
`
`
`
`
`
`(e.g., movies), menus, web pages, programs, games, etc.
`
`
`
`
`
`
`Prior to display, such information is stored in a memory of
`
`
`
`
`
`
`
`
`the mobile phone, and is referred to as a virtual page image.
`[0046] The mobile phone also includes a motion sensor,
`
`
`
`
`
`
`
`
`such as an accelerometer, for example. The motion sensor
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`detects motion of the mobile phone, such as, for example,
`
`
`
`
`
`
`forward/reverse (z-axis), sideways (x-axis), and up/down
`
`
`
`
`
`
`
`(y-axis). The detected motion is provided to a signal con-
`
`
`
`
`
`
`
`ditioning circuit, which analyzes the detected motion to
`determine whether the motion is intended motion or inci-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`dental motion (e.g., a slight bounce from walking or riding
`in a car). If the motion is determined to be intended motion,
`
`
`
`
`
`
`
`the intended motion is provided to a control circuit, which
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`then operates on the virtual page image data so as to pan
`
`
`
`
`
`
`
`
`and/or zoom the display to correspond to the intended
`
`
`
`
`
`
`
`
`motion. More specifically, the control circuit, using data
`from the motion sensor, determines (or is provided with) a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`direction and velocity component of the intended motion.
`
`
`
`
`
`
`
`
`
`The pan and/or zoom functions then are implemented using
`
`
`
`
`
`
`the direction and velocity components so as to simulate a
`
`
`
`
`
`
`
`window or magnifying glass held over a document. In other
`
`
`
`
`
`
`
`words, the pan or zoom appears substantially continuous
`with the intended motion (e.g., pan or zoom, as viewed on
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the display, appears to directly correspond to the actual
`
`
`
`
`
`
`motion, as opposed to snapping or tabbing of the image).
`The control circuit can include a signal conditioner, such as
`
`
`
`
`
`
`
`
`a low pass filter or the like, to enhance the smoothness of the
`
`
`
`
`
`
`
`
`
`pan and zoom functions.
`
`
`
`
`
`
`
`
`
`
`
`
`[0047]
`For example, a virtual page image may represent a
`
`
`
`
`
`
`
`document printed on an 8.5" by 11" sheet of paper. As the
`
`
`
`
`
`
`
`
`user moves the mobile phone to the right (simulating move-
`
`
`
`
`
`
`
`
`
`
`ment over the virtual page image), the image on the mobile
`
`
`
`
`
`
`
`
`phone’s display pans right at a rate and distance correspond-
`
`
`
`
`
`
`
`
`ing to the actual phone movement. The image presented in
`
`
`
`
`
`
`
`
`the display continuously and smoothly changes with the
`
`
`
`
`
`
`motion, thereby simulating a window or magnifying glass
`being scanned over a document.
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0048] As will be appreciated, the velocity and direction
`
`
`
`
`
`
`
`
`
`of motion may be provided to the control circuit by the
`
`
`
`
`
`
`motion sensor or by another signal conditioning circuit. As
`
`
`
`
`
`
`
`
`used herein, the term “pan” is defined as moving the viewing
`
`
`
`
`
`
`
`window up, down, sideways or a combination thereof, to
`
`
`
`
`
`
`
`
`display areas in a data set which, at the current viewing
`
`
`
`
`
`
`
`
`
`scale, lie outside the viewing window. The term “zoom” is
`
`
`
`
`
`
`
`
`defined as enlarging (zoom in) or decreasing (zoom out)
`
`
`
`
`
`
`
`proportionately the size of the display features shown on the
`
`
`
`
`
`
`
`computer screen by rescaling the image. Zooming out shows
`
`
`
`
`
`
`
`
`
`
`more area with less detail, while zooming in shows less area
`with more detail.
`
`
`
`
`
`
`
`
`
`[0049] Referring now to FIG. 1, a mobile phone 10 is
`
`
`
`
`
`
`
`shown as having a “brick” or “block” design type housing
`
`
`
`
`
`
`
`
`
`18, but it will be appreciated that other type housings, such
`
`
`
`
`
`
`
`
`as, for example, claim shell or slide-type housings, may be
`
`
`
`
`
`
`
`utilized without departing from the scope of the invention.
`
`
`
`
`
`
`
`
`The mobile phone 10 includes housing 18 (sometimes
`
`
`
`
`
`
`
`
`referred to as a case), speaker 20, display 22, navigation
`
`
`
`
`
`
`
`
`switch and selection/function keys or switches 24, key pad
`
`
`
`
`
`
`
`
`
`26, microphone 28, and volume control slide switch 30;
`
`
`
`
`
`
`
`
`these are illustrative and exemplary of parts of a typical
`
`
`
`
`
`
`
`
`
`mobile phone, but it will be appreciated that other parts that
`are similar or different in form and/or function may be
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`included in the mobile phone 10. The mobile phones to
`
`
`
`
`
`
`
`
`which the invention pertains also may be of the types that
`
`
`
`
`
`
`
`
`have more or fewer functions, keys, etc., compared to those
`illustrated and described herein.
`
`
`
`
`
`
`
`
`
`
`
`
`[0050] As will be appreciated, the mobile phone 10 may
`function as a conventional mobile phone. The mobile phone
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`10 may have additional functions and capabilities that may
`
`
`
`
`
`
`
`be developed in the future. From a conventional point of
`
`
`
`
`
`
`
`view, the display 22 displays information to a user, such as
`
`
`
`
`
`
`
`operating state, time, phone numbers, contact information,
`various navigational menus, etc., which facilitate and/or
`
`
`
`
`
`
`
`enable the user to utilize the various features of the mobile
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`phone. The display also may be used to view movies,
`
`
`
`
`
`
`
`
`
`
`
`images, or to play games, for example. Part or all of the
`
`
`
`
`
`
`
`
`
`display 22 may be a touch screen type device 2211 (FIG. 2).
`
`
`
`
`
`
`
`
`The navigation and function keys 24 and the keypad 26 may
`
`
`
`
`
`
`
`
`
`be conventional in that they provide for a variety of user
`
`
`
`
`
`
`
`
`operations. For example, one or more of the function keys
`
`
`
`
`
`
`
`and navigation device 24 may be used to navigate through
`
`
`
`
`
`
`
`
`a menu displayed on the display 22 to select different phone
`
`
`
`
`
`
`
`functions, profiles, settings, etc., as is conventional. The
`
`
`
`
`
`
`
`keypad 26 typically includes one or more special function
`
`
`
`
`
`
`
`
`
`keys, such as, a “call send” key for initiating or answering
`
`
`
`
`
`
`
`
`
`
`a call, a “call end” key for ending or hanging up a call, and
`
`
`
`
`
`
`
`
`dialing keys for dialing a telephone number. Other keys
`
`
`
`
`
`
`
`
`
`included in the navigation and function keys 24 and/or
`
`
`
`
`
`
`
`
`keypad 26 may include an on/olf power key, a web browser
`
`
`
`
`
`
`
`
`
`launch key, a camera key, a voice mail key, a calendar key,
`
`
`
`
`
`
`
`
`etc. The volume control switch 30 may be operated to
`increase or to decrease the volume of the sound output from
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the speaker 20. If desired, a sensitivity control also may be
`
`
`
`
`
`provided to change the sensitivity of the microphone 28 as
`
`
`
`
`
`
`
`
`it picks up sounds for transmission by the mobile phone 10.
`
`
`
`
`
`
`Further, a motion enable/disable key may be implemented as
`a function key 24 or within the keypad 26, wherein the
`
`
`
`
`
`
`
`
`
`
`motion enable/disable key enables or inhibits operation of
`
`
`
`
`
`
`the motion detection function, as described in more detail
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`below. The mobile phone 10 may have more of fewer keys,
`
`
`
`
`
`
`navigation devices, etc., compared to those illustrated.
`
`Page 10 of 16
`
`Page 10 of 16
`
`

`

`
`
`US 2007/0268246 A1
`
`
`
`Nov. 22, 2007
`
`
`
`
`
`
`
`
`
`FIG. 2 represents a functional block diagram of an
`[0051]
`
`
`
`
`
`
`
`
`exemplary mobile phone, for example, the mobile phone 10.
`
`
`
`
`
`
`
`The representation also is similar to those of PDAs and/or
`
`
`
`
`
`
`other electronic equipment, as will be appreciated by those
`
`
`
`
`
`
`
`
`
`
`having ordinary skill in the art. The construction of the
`
`
`
`
`
`
`
`mobile phone 10, which is presented by way of example
`
`
`
`
`
`
`
`
`is generally conventional with the exception of the
`here,
`
`
`
`
`
`
`capability provided by a motion transducer 40 and use of
`
`
`
`
`
`information provided by the motion transducer, as described
`
`
`
`
`
`
`
`
`
`in greater detail below. The various functions carried out by
`
`
`
`
`
`
`
`
`the parts represented in the functional block diagram of FIG.
`
`
`
`
`
`
`
`
`2 may be carried out by application software within the
`
`
`
`
`
`
`
`
`mobile phone 10. However,
`it will be apparent to those
`
`
`
`
`
`
`
`
`
`
`having ordinary skill in the art that such operation can be
`
`
`
`
`
`
`
`carried out via primarily software, hardware, firmware, or a
`
`
`
`
`
`
`
`combination thereof, without departing from the scope of
`the invention.
`
`
`
`
`
`
`
`
`
`[0052] The mobile phone 10 includes a primary control
`
`
`
`
`
`
`
`circuit 42 that is configured to carry out overall control of the
`
`
`
`
`
`
`
`
`functions and operations of the mobile phone 10, e.g., as is
`
`
`
`
`
`
`
`
`represented at block 43. The control circuit 42 may include
`
`
`
`
`
`
`
`a CPU 44 (central processor unit), microcontroller, micro-
`
`
`
`
`
`
`
`processor, etc., collectively referred to herein simply as CPU
`
`
`
`
`
`
`
`
`
`44. The CPU 44 executes code stored in memory within the
`
`
`
`
`
`
`
`control circuit 42 (not shown) and/or in a separate memory
`
`
`
`
`
`
`
`46 in order to carry out conventional operation of the mobile
`
`
`
`
`
`
`
`
`phone functions within the mobile phone 10. In addition, the
`
`
`
`
`
`
`
`
`
`CPU 44 executes code stored in the memory 46,
`for
`
`
`
`
`
`
`
`example, or in some other memory (not shown) in order to
`
`
`
`
`
`
`
`perform the various functions of detecting motion based on
`
`
`
`
`
`
`
`
`signals provided by the motion transducer 40 and to alter the
`display data based on the detected motion. The control
`
`
`
`
`
`
`
`
`
`circuit 42 also includes a signal conditioner 45, such as a low
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`pass filter, for example. The signal conditioner 45 provides
`
`
`
`
`
`
`smoothing of the pan or zoom directives during continuous
`motion of the mobile phone 10.
`
`
`
`
`
`
`
`
`
`
`
`[0053] Continuing to refer to FIG. 2, the mobile phone 10
`includes a conventional antenna 50, radio circuit 52, and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`sound processing signal circuit 54, all of which are coop-
`erative to send and to receive radio frequency (or other)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`signals in conventional manner. For an incoming signal, for
`
`
`
`
`
`
`
`
`example, the sound processing signal circuit 54 may include
`
`
`
`
`
`
`
`
`
`an amplifier to amplify the signal and to provide it to the
`
`
`
`
`
`
`
`
`
`speaker 20 so a user may hear the sound, and the sound
`
`
`
`
`
`
`
`
`processing signal circuit 54 also may use the same amplifier
`
`
`
`
`
`
`
`
`