(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2006/0034042 A1
`(43) Pub. Date:
`Feb. 16, 2006
`Hisano et al.
`
`US 20060034042A1
`
`(54) ELECTRONIC APPARATUS HAVING
`UNIVERSAL HUMAN INTERFACE
`(75) Inventors: Katsumi Hisano, Matsudo-shi (JP);
`Masanori Ozawa, Kawasaki-shi (JP);
`Ryo Furukawa, Kawasaki-shi (JP);
`Minoru Mukai, Tokyo (JP)
`Correspondence Address:
`FINNEGAN, HENDERSON, FARABOW,
`GARRETT & DUNNER
`LLP
`901 NEW YORKAVENUE, NW
`WASHINGTON, DC 20001-4413 (US)
`(73) Assignee: KABUSHIKI KAISHA TOSHIBA
`(21) Appl. No.:
`11/196,462
`(22) Filed:
`Aug. 4, 2005
`(30)
`Foreign Application Priority Data
`
`Aug. 10, 2004 (JP)...................................... 2004-233643
`
`
`
`14A
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`G06F III6
`(52) U.S. Cl. ........................... 361/681; 345/905; 248/917
`
`(57)
`
`ABSTRACT
`
`An electronic apparatus includes first and Second display
`devices having first and Second display Screens held in first
`and Second housings, respectively. The Second display
`Screen is provided with a Sensor which generates an output
`Signal determining an input area in response to an external
`predetermined input to the Second display Screen. The first
`and Second housings are connected together by a connecting
`mechanism So that an opening angle between the first and
`Second housings can be adjusted. A first interface image is
`displayed on the Second display Screen. An instruction input
`to the interface image is determined on the basis of a Sensor
`output Signal. In response to the instruction input, a Second
`display image is displayed in place of the first display image.
`In response to the instruction input, a Second interface image
`is displayed in place of the first interface image.
`
`Lenovo EX-1020, Page 001
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 1 of 10
`
`US 2006/0034042 A1
`
`
`
`14A
`
`Optical guide
`plate
`
`30
`
`36
`
`34
`
`32
`
`Lenovo EX-1020, Page 002
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 2 of 10
`
`US 2006/0034042 A1
`
`
`
`
`
`07U
`
`87
`
`97
`
`79
`
`02
`
`Column driver
`
`Y COOrdinate SenSOr
`
`Lenovo EX-1020, Page 003
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 3 of 10
`
`US 2006/0034042 A1
`
`
`
`
`
`Not determined that key
`input has been provided
`
`S16
`
`
`
`
`
`
`
`
`
`X-Y SenSOr detects area
`touched by USer's finger
`during predetermined period
`
`S12
`
`S14
`
`S18
`
`COntact area at
`least predetermined
`Size 2
`Yes
`
`
`
`COntact
`area Smaller than
`predetermined size
`
`YeS
`
`Determine touch to be
`keyboard input and measure - S20
`COOrdinates Of Center Of area
`
`Compare Center COOrdinates
`with key position
`
`S22
`
`Output key COde
`
`S24
`
`F. G. 4
`
`S26
`
`Lenovo EX-1020, Page 004
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 4 of 10
`
`US 2006/0034042 A1
`
`
`
`62
`
`60
`
`Lenovo EX-1020, Page 005
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 5 of 10
`
`US 2006/0034042 A1
`
`
`
`Lenovo EX-1020, Page 006
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 6 of 10
`
`US 2006/0034042 A1
`
`
`
`130A
`
`Lenovo EX-1020, Page 007
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 7 of 10
`
`US 2006/0034042 A1
`
`
`
`Lenovo EX-1020, Page 008
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 8 of 10
`
`US 2006/0034042 A1
`
`146
`
`150
`
`4
`
`148
`
`142
`
`
`
`Lenovo EX-1020, Page 009
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 9 of 10
`
`US 2006/0034042 A1
`
`
`
`Remote COnference
`image display
`
`Lenovo EX-1020, Page 010
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`Patent Application Publication Feb. 16, 2006 Sheet 10 of 10
`
`US 2006/0034042 A1
`
`
`
`172
`
`Optical
`interface
`
`Lenovo EX-1020, Page 011
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`US 2006/0034042 A1
`
`Feb. 16, 2006
`
`ELECTRONIC APPARATUS HAVING UNIVERSAL
`HUMAN INTERFACE
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`0001. This application is based upon and claims the
`benefit of priority from prior Japanese Patent Application
`No. 2004-233643, filed Aug. 10, 2004, the entire contents of
`which are incorporated herein by reference.
`
`BACKGROUND OF THE INVENTION
`0002) 1. Field of the Invention
`0003. The present invention relates to an electronic appa
`ratus having a universal human interface, and in particular,
`to improvements in a user interface for a portable informa
`tion apparatus having a planar display device and a device
`that allows a user to provide inputs using the user's finger or
`a stylus.
`0004 2. Description of the Related Art
`0005. Notebook personal computers, PDAs, cellular
`phones, and the like are known as typical electronic appa
`ratuses having user interfaces. For example, a conventional
`notebook personal computer comprises, as a user interface,
`a display Such as a liquid crystal display which displayS
`characters, graphics S, and the like on a plane Surface, and
`a keyboard that allows a user to input characters by depress
`ing keys arranged in a predetermined manner, as described
`in Jpn. Pat. Appln No. 1997-130935. In such a notebook
`personal computer, the display and the keyboard are held in
`respective independent housings, which are foldably con
`nected together using hinges. When the notebook personal
`computer is used, the keyboard is placed on a plane almost
`parallel to a desk Surface by appropriately adjusting the
`hinge angle of one of the housings to that of the other, both
`housings being placed on the desk Surface. The display is
`placed So as to face the user. The user can input characters
`from the keyboard and move a cursor by operating keys on
`which arrows are printed. A pointing device called a touch
`pad is provided on the Surface of the housing in which the
`keyboard is installed; the touch pad is located farther from
`the hinge than the keyboard. The user can move the mouse
`cursor by touching this pointing device with his or her
`fingertip. Available pointing devices include a Stick System
`that allows the user to move the mouse cursor by using his
`or her finger to exert a force on a Stick provided near the
`center of the keyboard.
`0006. In general, for portable electronic apparatuses,
`portability is inconsistent with operability and visibility
`asSociated with ease of use. It has thus been desirable to
`make portability consistent with ease of use. That is, the
`notebook personal computer is an information apparatus that
`the user carries with him or her for use. Accordingly, the
`sizes of the housings are important Specification items.
`Obviously, the display area of the display decreases consis
`tently with housing size. Further, when the notebook per
`Sonal computer is equipped with a keyboard having a key
`arrangement and a key number Significantly different from
`the Standards, the general-purpose properties of the note
`book personal computer are degraded. Consequently, the
`key pitch of the keyboard decreases consistently with hous
`ing size. The consistence between portability and the human
`
`interface is very important for the notebook personal com
`puter. Thus, notebook personal computers are classified into
`a category including what is called full-size notebook per
`Sonal computers which are inferior in portability and which
`have large housings, a large Screen, and almost the same key
`pitch as that of desktop computers and a category including
`notebook personal computers having mobile housings which
`are Small and easy to carry out but which have a Small-sized
`Screen, a Small key pit, and a Small touch pad area, that is,
`an inferior human interface. The user Selects the category to
`which the personal computer the user is to purchase belongs,
`assuming a situation in which the personal computer is most
`frequently used. Also in this regard, for portable electronic
`apparatuses, portability must be compatible with ease of use.
`0007 For portable electronic apparatuses, it is desirable
`to improve the operability of the pointing device. To move
`the mouse cursor on the Screen using the touch pad, the user
`must move the mouse cursor within a plane much Smaller
`than the Screen by moving his or her finger. This pointing
`device is considered to offer operability inferior to that of a
`mouse connected to the notebook personal computer and
`which can be moved to a larger extent than the touchpad in
`controlling the mouse cursor. Similarly, to move the mouse
`cursor using the Stick, the user must use the force of his or
`her finger to adjust the movement of the position of the
`mouse cursor. This pointing device is considered to offer
`operability inferior to that of a mouse connected to the
`notebook personal computer and which can be moved to a
`larger extent than the Stick in controlling the mouse cursor.
`0008. The mouse, which is externally installed, is easier
`to operate than the touchpad, which is incorporated into the
`notebook personal computer because it allows the user to
`use a larger area than the touch pad. However, disadvanta
`geously, the user must move his or her arm quite a long
`distance in a horizontal direction from the keyboard, from
`which the user commonly provides inputs using both hands,
`to the mouse, which is operated with the user's right or left
`hand. Further, when it is difficult to operate the computer
`using the mouse, hardware Such as a joy Stick or a game pad
`must be mounted on the computer as an external input
`device, the hardware being specialized for Software. Such
`hardware may not offer Sufficient general-purpose properties
`and is likely to be infrequently used. Disadvantageously, the
`cost effectiveness of the device introduced by the user is
`Virtually low. Further, manufacturing many devices infre
`quently used may lead to contamination of environment and
`consumption of resources. Also in this regard, the use of
`Such hardware is not preferable.
`0009. Notebook personal computers are also commer
`cially available which have an electromagnetic or pressure
`Sensitive touch panel lying on top of an LCD panel So that
`direct touch with the Screen enables the position on the
`Screen to be input. However, with Such a notebook personal
`computer, when inputting characters, while editing the input
`characters using the pointing device, the user must fre
`quently move his or her arm a relatively long distance
`against gravity from the keyboard to the Screen. This is
`disadvantageously inappropriate if both keyboard and point
`ing device are frequently operated.
`0010 Further, such a notebook personal computer
`enables the user to input characters by displaying a Software
`based keyboard on the Screen and depressing virtual keys.
`
`Lenovo EX-1020, Page 012
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`US 2006/0034042 A1
`
`Feb. 16, 2006
`
`However, the keyboard is almost two-dimensionally placed
`on a desk Surface, and the display Surface is placed at an
`angle with the desk Surface So as to face the user. AS is easily
`understood from this arrangement, the angle of a plane
`suitable for input is different from that of a plane suitable for
`Viewing. There is a limit to the improvement of the input
`environment based on the addition of the touch panel
`function to one display.
`0.011) Moreover, it is desirable to adapt the portable
`electronic apparatus to a particular situation So that the
`apparatus can be used easily in that Situation. In general, the
`keyboard arrangement is specified. Accordingly, when the
`keyboard is utilized for a particular task, the fixed arrange
`ment may disadvantageously be unsuitable for improving
`work efficiency. For example, the user may carry the note
`book personal computer with him or her in order to proceSS
`personal information. In this example, information Stored in
`the notebook personal computer may be shown to a perSon
`different from the user. In Some cases, a perSon different
`from the user may be allowed to perform a simple operation
`to execute a specified proceSS on the basis of a procedure
`stored in a server on the network to which the notebook
`personal computer is connected, thus providing outputs
`constituting Services. In other cases, Subsequent busineSS
`activities for articles or insurances may be based on these
`outputs. In Such an example, not all the keys of the keyboard
`are required in the Site where the user carries the notebook
`personal computer with him or her. Further, the client may
`provide incorrect input. If it is inconvenient to be able to use
`all the key inputs, the notebook personal computerS manu
`factured by the current techniques offer no solutions. The
`possibility of incorrect operations can be reduced by allow
`ing the client to operate only the previously described touch
`panel-installed display. However, the presence of the key
`board may hinder fundamental Solutions. To Solve this, a
`portable personal computer has been provided which has no
`keyboard and which is composed of an externally rectan
`gular housing comprising a display and the minimum
`required input device Such as a power Supply Switch. How
`ever, adapting the hardware only to a particular situation
`may degrade general-purpose properties. Specifically, when
`the user carries the apparatus to the client with him or her
`and if the client Suddenly changes the contents of the
`operation, it is difficult to deal with this change with the
`above computer. Further, the user normally places paper flat
`on the desk when writing characters on the paper with a
`pencil. When reading a book, the user holds the book in his
`or her hand So that his or her line of Sight is perpendicular
`to the print Surface of the book. AS is apparent from this
`behavior, the angle of a plane at which the user can easily
`input characters with his or her finger or a pen is different
`from that of a plane at which the user can easily read
`information displayed on the plane. This may disadvanta
`geously tire the user. Moreover, for the electronic appara
`tuses, the user interface desirably meets users individual
`requirements. That is, the input device needs to flexibly
`conform to the physical properties or preferences of users. It
`is well known that the size of each part of the human body
`varies. The input device Such as a common keyboard or
`mouse has fixed dimensions. Consequently, a comfortable
`work environment cannot be realized unless the user pre
`pares an input device of a size Suitable for himself or herself.
`However, in the notebook personal computer, the keyboard
`
`is integrated with the main body. Thus, disadvantageously,
`the user cannot adjust the key pitch or arrangement.
`0012. The interface for the electronic apparatus can desir
`ably provide a quieter environment. That is, when the user
`inputs characters from the keyboard, typing Sounds occur.
`Accordingly, the keyboard is inconvenient for taking notes
`in a situation where making noise is not preferable, for
`example, in a library or during a class in School. It is thus
`desirable to enable input while maintaining a quiet environ
`ment.
`
`BRIEF SUMMARY OF THE INVENTION
`0013. It is an object of the present invention to provide an
`electronic apparatus which is excellent in portability, oper
`ability, visibility, and reliability.
`0014. According to an aspect of the present invention,
`there is provided an electronic apparatus comprising:
`0015 a first display device comprising a first housing
`and a first display screen which is held in the first
`housing,
`0016 a second display device comprising a second
`housing and a Second display Screen which is received
`and held in the Second housing, the Second display
`Screen comprising a Sensor which generates a Sensor
`output Signal depending on an input on the Second
`display Screen;
`0017 a connecting mechanism configured to connect
`the first and Second housings together and capable of
`adjusting an opening angle of the first housing with
`respect to the Second housing;
`0018 a display processing section configured to dis
`play a first display image on the first display Screen and
`a first interface image on the Second display Screen;
`0019 a determining section configured to determine an
`instruction to the interface image on the basis of the
`Sensor output signal; and
`0020 a control section configured to control the dis
`play processing Section in response to the instruction to
`cause a Second display image to be displayed in place
`of the first display image and control the display
`processing Section in response to the instruction to
`cause a Second interface image to be displayed in place
`of the first interface image.
`0021 According to another aspect of the present inven
`tion, there is provided a foldable display device comprising:
`0022 a first device having a first display screen to
`display application images;
`0023 a second device having a second display screen
`to display interface images and an input Sensor pro
`vided around the Second display Screen to Sense an
`input position of touching or a movement on the Second
`display Screen;
`0024 a connecting mechanism configured to arbi
`trarily Set an angle of the first display Screen of the first
`device and the Second display Screen of the Second
`device and to be capable to be folded;
`
`Lenovo EX-1020, Page 013
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`US 2006/0034042 A1
`
`Feb. 16, 2006
`
`0025 an input processor to converting an input posi
`tion Sensed by the Sensor into an input data to the
`display processor, and
`0026 a display processor to generate application
`images to be displayed on the first display Screen and
`interface images to be displayed on the Second display
`Screen,
`0027 wherein the display processor generates a first
`interface image indicating distinctly displaying the
`input position after receiving the input data on the
`Second display Screen, and generates a first application
`image reflecting the input data on the first display
`SCCC.
`0028. According to yet another aspect of the present
`invention, there is provided a portable computer, compris
`ing:
`0029 a flat panel having a first display panel and a
`Second display panel, that is foldable along a centerline
`and that a Surface of the Second display panel
`approaches to a Surface of the first display panel when
`they are folded;
`0030 a touch panel sensor provided at least on a
`Second display panel to detect a user's input operation;
`0031 a display processor to supply display data to the
`first display panel and the Second display panel; and
`0032 a display controller to control the display pro
`ceSSor in at least two modes comprising,
`0033 a first mode where the display processor Supplies
`an application image to the first display panel while
`Supplying an interface image to the Second display
`panel So as to use the Second display panel as an input
`device, and
`0034 a second mode where an application image is
`divided into two part and one part of the application
`image is Supplied to the Second display panel and the
`other part of the application image is Supplied to the
`first display panel So as to use the first and Second
`display panels as a one extended Screen.
`BRIEF DESCRIPTION OF THE SEVERAL
`VIEWS OF THE DRAWING
`FIG. 1 is a perspective view schematically show
`0.035
`ing a notebook personal computer as an example of a
`portable electronic apparatus according to an embodiment of
`the present invention;
`0.036
`FIG. 2 is a sectional view schematically showing
`the internal Structure of the notebook personal computer
`shown in FIG. 1;
`0037 FIG. 3 is a block diagram showing a driving circuit
`that drives a touch panel-equipped LCD panel of the note
`book personal computer shown in FIG. 1;
`0038 FIG. 4 is a flowchart showing control with which
`a key code is output in response to an input to a virtual
`keyboard displayed on the touch panel-installed LCD panel
`of the notebook personal computer shown in FIG. 1;
`0.039
`FIG. 5 is a sectional view schematically showing
`the Structure of an illuminating mechanism incorporated into
`the notebook personal computer shown in FIG. 1;
`
`0040 FIG. 6 is a sectional view schematically showing
`another Structure of the illuminating mechanism incorpo
`rated into the notebook personal computer shown in FIG. 1;
`0041
`FIG. 7 is a perspective view schematically show
`ing how a document is displayed on two Screens according
`to another usage of the notebook personal computer shown
`in FIG. 1;
`0042 FIG. 8 is a perspective view schematically show
`ing an interface display according to yet another usage of the
`notebook personal computer shown in FIG. 1;
`0043 FIG. 9 is a perspective view schematically show
`ing usage of a notebook personal computer as an example of
`a portable electronic apparatus according to another embodi
`ment of the present invention;
`0044 FIG. 10 is a perspective view schematically show
`ing usage of a notebook personal computer comprising a
`gravity Sensor as a portable electronic apparatus according
`to yet another embodiment of the present invention;
`004.5 FIGS. 11A and 11B are perspective views sche
`matically showing usage of a notebook personal computer as
`an example of a portable electronic apparatus according to
`Still another embodiment of the present invention;
`0046 FIG. 12 is a perspective view schematically show
`ing another usage of the notebook personal computer shown
`in FIG. 1;
`0047 FIG. 13 is a perspective view schematically show
`ing a notebook personal computer comprising a Silicon on
`glass Structure as an example of a portable electronic appa
`ratus according to further another embodiment of the present
`invention;
`0048 FIG. 14 is a perspective view schematically show
`ing usage of a notebook personal computer comprising an
`input display function a as an example of a portable elec
`tronic apparatus according to further another embodiment of
`the present invention;
`0049 FIG. 15 is a perspective view schematically show
`ing usage of a notebook personal computer comprising an
`input display function a as an example of a portable elec
`tronic apparatus according to yet another embodiment of the
`present invention;
`0050 FIG. 16 is a perspective view schematically show
`ing usage of a camera-installed notebook personal computer
`as an example of a portable electronic apparatus according
`to Still another embodiment of the present invention; and
`0051
`FIG. 17 is a perspective view schematically show
`ing usage of a camera-installed notebook personal computer
`as an example of a portable electronic apparatus according
`to further another embodiment of the present invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`0052 With reference to the drawings, description will be
`given of an electronic apparatus having a universal human
`interface according to an embodiment of the present inven
`tion.
`0053 FIG. 1 is a perspective view schematically show
`ing a notebook personal computer as an example of a
`portable electronic apparatus according to an embodiment of
`the present invention.
`
`Lenovo EX-1020, Page 014
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`US 2006/0034042 A1
`
`Feb. 16, 2006
`
`0.054 As shown in FIG. 1, the notebook personal com
`puter is made portable by foldably connecting a first housing
`2 and a Second housing 4 together using hingeS 6A and 6B
`and folding the first housing 2 over the Second housing 4 to
`lay the first housing 2 on top of the Second housing 4.
`Further, as shown in FIG. 1, the first housing 2 is opened
`with respect to the Second housing 4 So that a user can
`operate the notebook personal computer while Viewing the
`first housing 2 and the Second housing 4. That is, the user can
`place the Second housing 4 on a desk Surface and use the
`hingeS 6A and 6B to appropriately adjust the angle of the
`first housing 2 So that the user can easily view an LCD panel
`in the first housing 2.
`0055) The first housing 2 has the LCD (liquid crystal
`display) panel 8 installed in its frame 10 to display images,
`characters, and the like. A driving circuit (not shown) is
`stored in the housing 2 to drive the LCD panel 8. Further, in
`addition to the LCD panel 8, an antenna for wireless LAN
`or radio communication Such as Bluetooth is Stored in the
`first housing 2. The LCD panel 8 displays a pointer 12 used
`to Select any of icons shown as images or characters. The
`pointer 12 can be used to make any of the icons active to
`operate the related application.
`0056. In the second housing 4, rubber pads 14A and 14B
`are applied to the Surface of the frame 10 as a cushioning
`material So as to prevent the first housing 2 and the Second
`housing 4 from being Shocked when they are folded.
`Accordingly, the rubber pads 14A and 14B absorb an
`external shock applied when the notebook personal com
`puter is folded or carried. This prevents the first housing 2
`and the Second housing 4 from being damaged by the shock.
`0057 The second housing 4 has a touch panel-installed
`LCD panel 18 installed in its frame 16. The touch panel
`installed LCD panel 18 includes a pressure-sensitive touch
`panel laminated to an LCD panel (liquid crystal display
`device) used to display images, characters, and the like. The
`Second housing 4 stores a driving circuit (not shown) that
`drives the LCD panel of the touch panel-installed LCD panel
`18 and a detecting circuit (not shown) that detects an input
`to the touch panel. Further, the Second housing 4 has a
`built-in motherboard on which a CPU and a memory are
`mounted, and a drive device such as an HDD. The housings
`2 and 4 Supply power to each other and eXchange informa
`tion with each other via a bundle of electric wires passing
`through the neighborhood of the center of a shaft of each of
`the hinges 6A and 6B.
`0.058. The touch panel-installed LCD panel 18 displays a
`Virtual keyboard 20 corresponding to a keyboard image that
`can be used to input characters or the like by providing key
`input as with common keyboards. That is, an input to the
`touch panel is replaced with a code or the like which is
`generated when the corresponding key of the common
`keyboard is depressed, on the basis of the relationship
`between the input and the corresponding display image. The
`code is then input to a CPU in the notebook personal
`computer main body, where the code is then Subjected to
`Software processing. Then, the resulting image is displayed
`on the LCD panel 8. In this manner, emulation of the
`mechanical keyboard may be implemented by a special
`electronic circuit that controls the touch panel-installed LCD
`panel. Alternatively, it may be implemented by processing
`executed by Software Such as firmware. The user may create
`
`the keyboard image in bitmap form. Further, the touch
`panel-installed LCD panel can be used as an interface in a
`form different from the keyboard as described later.
`0059) The touch panel-installed LCD panel 18 displays
`not only the virtual keyboard 20 but also a virtual mouse 22
`operated Similarly to a common mouse to move a pointer
`position or make any icon active. That is, an image corre
`sponding to the mouse 22 is displayed in a Screen on which
`the keyboard 20 is displayed. The user uses his or her hand
`to touch and depress a part of the touch panel corresponding
`to the displayed position of the Virtual mouse 22, to move the
`Virtual mouse 22. This results in a Setting Such that the entire
`touch panel is used as an area in which the Virtual mouse can
`move. In this case, even if the Virtual keyboard is depressed
`during the operation of the Virtual mouse 22, this is not
`recognized as a key input. When the user's hand remains off
`the virtual mouse 22 for a specified time, the Virtual mouse
`moves to the lower right of the touch panel-installed display
`18, shown in FIG. 1, to wait for an operation. Then, an input
`can be provided to the virtual keyboard 20. Of course, the
`standby position of the virtual mouse 22 is not limited to the
`lower right of the touch panel-installed display 20 but can be
`arbitrarily set by the user. Further, by making the displayed
`virtual mouse 22 smaller while it is standing by than while
`it is being used, as in the case of the icons, it is possible to
`reduce the possibility that the virtual mouse 22 will interfere
`with an input area for the virtual keyboard 20. If the
`Standing-by virtual mouse 22 is displayed as an icon, then
`tapping the icon enables the virtual mouse 22 to be displayed
`near the icon in the use-time size.
`0060. The following action may be taken instead of
`causing the Virtual mouse 22 to Stand by while it is not used:
`upon Sensing the thenar eminence, hypothenar eminence,
`index finger, and middle finger of one hand touching the
`touch panel and moving over the touch panel 20 while
`maintaining the same positions, the computer may deter
`mine that the Virtual mouse 22 is being operated. In this case,
`the Virtual mouse is displayed on the touch panel-installed
`LCD panel 20 so that a pointer on the screen can be moved.
`Further, the computer can be allowed to determine, on the
`basis of the preSSure of the finger, whether a button is being
`pressed or the finger is off the button, to perform a click
`operation. Further, when one of the fingerS moves in a way
`that the distances from this finger to the thenar eminence and
`to hypothenar eminence change, the computer may deter
`mine that this input indicates that a wheel has been moved.
`In this manner, as in the case of the common mouse, an
`output from the virtual mouse is provided to the CPU in the
`personal computer main body, where it is Subjected to
`Software processing. The results of the Software processing
`are displayed as an image on the LCD panel 8.
`0061. In this case, when the virtual mouse 22 moves onto
`the virtual keyboard 20, it may be displayed on top of the
`Virtual keyboard 20 So as to appear translucent or opaque.
`Further, when the virtual mouse 22 or the virtual keyboard
`20 is touched, the brightness, color, or image contrast of the
`touched input area may be changed depending on the
`intensity of the input to the touch panel. Furthermore, if any
`line or character is already displayed in an input area when
`the virtual mouse 22 or the virtual keyboard 20 is touched,
`the thickness of the line, the Size of the character, or the font
`may be changed. A Sound may be generated which corre
`sponds to the Virtual key displayed in the input area.
`
`Lenovo EX-1020, Page 015
`IPR2021-00822 (Lenovo Inc. v. LiTL LLC.)
`
`

`

`US 2006/0034042 A1
`
`Feb. 16, 2006
`
`Further, the touch panel-installed LCD panel 18
`0.062
`can display other icons 24A and 24B and the like as required
`and also display images, characters, and the like without
`showing the virtual keyboard 20 similarly to the LCD panel
`8. A combination of the LCD panel 8 and the LCD panel 18
`provides a larger work area than with common personal
`computers. On the touch panel-installed LCD panel 18, the
`icons 24A and 24B may be displayed on top of another
`image. When displayed on top of another image, the icons
`24A and 24B may be translucent or opaque.
`0.063. In the above embodiment, the touch panel-installed
`LCD panel 18 senses a contact pressure on the basis of the
`contact area. However, obviously, the touch panel-installed
`LCD panel 18 may be able to sense the pressure exerted
`directly on a touch panel 18T. Similarly, the touch panel
`installed LCD panel 18 may be able to electromagnetically
`sense a touch with the touch panel 18T. The electromagnetic
`type adopts a Sensor that can detect the intensity of electro
`magnetic waves on the touch panel 18T to Sense a touch on
`the basis of a change in intensity.
`0064. The second housing 4 is assembled in the following
`manner: the panel Surface of the touch panel-installed LCD
`panel 18, installed in the second housing 4, is flush with the
`top surface of the frame 16 of the second housing 4 so that
`no step is formed between the panel Surface of the LCD
`panel 18 and the frame 16 of the housing 14. Since there is
`almost no step between the surface of the LCD panel in the
`housing and the Surface of the Second housing, the move
`ment of the user's hand is not hindered by Steps at the ends
`of the panel when the virtual mouse is operated.
`0065. With the conventional notebook personal com
`puter, the pointer moving all over the Screen is operated by
`moving the user's finger i