PCT
`
`Intematlonal Bureau
`WORLD INTELLECTUAL PROPERTY ORGANIZATION
`
`
`
`(71) Applicant (for all designated States except US): BRITISH
`TELECOMMUNICATIONS PUBLIC LIMITED COM-
`PANY [GB/GB]; 81 Newgate Street, London EC1A 7AJ
`(GB).
`
`(72) Inventor; and
`(75) Inventor/Applicant (for US only): WILLIAMS, Hilary, Lyn-
`dsay [GB/GB]; 9 Gallagher Close, Crown Hill, Milton
`Keynes, Buckinghamshire MK8 OLQ (GB).
`
`(74) Agent: BRADLEY, David, William; BT Group Legal Services,
`Intellectual Property Dept, Holbom Centre, 8th floor, 120
`Holbom, London EC1N 2TB (GB).
`
`Published
`With international search report.
`
`(54) Title: PORTABLE COMPUTERS
`
`-——.-—-—.————
`——u——
`
`SCROLL MESSAGE
`SCROLL MESSAGE
`'lAFlY TIM .
`
`A portable computer arranged to rest comfortably in the hand has a small display screen (5). Accelerometers capable of detecting
`movement of the pen with respect to gravity provide input to a microcontroler which selects from a number of viewing modes a response.
`The pen may be held in either hand and output message to the screen will be oriented according to the location of the pen. Full personal
`digital assistant functionality may be incorporated in a relatively small plastics casing and functions, such as calendar, contacts and the like
`may be incorporated.
`
`1
`
`APPLE 1016
`
`INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
`
`
`
`
`(51) International Patent Classification 6 :
`(11) International Publication Number:
`W0 99/22338
`G06K 11/18, 9/24
` (43) International Publication Date:
`
`
`6 May 1999 (06.05.99)
`
`
`
`(21) International Application Number:
`PCT/GB98/03016
`(81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR,
`BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GD.
`GE, GH, GM, HR, HU, ID, IL, IS, JP, KE, KG, KP, KR,
` (22) International Filing Date: 8 October 1998 (08.10.98)
`
`KZ, LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, MN,
`
`MW, MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK,
`
`SL, TJ, TM, TR, ’IT, UA, UG, US, UZ, VN, YU, ZW,
`(30) Priority Data:
`
`
`
`ARIPO patent (GH, GM, KE, LS, MW, SD, 82, UG, ZW),
`28 October 1997 (28.10.97)
`GB
`9722766.4
`Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM),
`European patent (AT, BE, CH, CY, DE, DK, ES, FI, FR,
`GB, GR, IE, IT, LU, MC, NL, PT, SE), OAPI patent (BF,
`BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NE, SN,
`TD, TG).
`
`
`
`
`
`
`
`(57) Abstract
`
`
`1
`
`APPLE 1016
`
`

`

`
`FOR THE PURPOSES OF INFORMATION ONLY
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Albania
`Armenia
`Austria
`Australia
`Azerbaijan
`Bosnia and Herzegovina
`Barbados
`Belgium
`Burkina Faso
`Bulgaria
`Benin
`Brazil
`Belarus
`Canada
`Central African Republic
`Congo
`Switzerland
`C6te d’lvoire
`Cameroon
`China
`Cuba
`Czech Republic
`Germany
`Denmark
`Estonia
`
`
`
`SI
`SK
`SN
`SZ
`TD
`TG
`TJ
`TM
`TR
`TT
`UA
`UG
`US
`UZ
`VN
`YU
`ZW
`
`Slovenia
`Slovakia
`Senegal
`Swaziland
`Chad
`Togo
`Tajikistan
`Turkmenistan
`Turkey
`Trinidad and Tobago
`Ukraine
`Uganda
`United States of America
`Uzbekistan
`Viet Nam
`Yugoslavia
`Zimbabwe
`
`LS
`LT
`LU
`LV
`MC
`MD
`MG
`MK
`
`ML
`MN
`MR
`MW
`MX
`NE
`NL
`NO
`NZ
`PL
`PT
`R0
`RU
`SD
`SE
`SG
`
`Lesotho
`Lithuania
`Luxembourg
`Latvia
`Monaco
`Republic of Moldova
`Madagascar
`The former Yugoslav
`Republic of Macedonia
`Mali
`Mongolia
`Mauritania
`Malawi
`Mexico
`Niger
`Netherlands
`Norway
`New Zealand
`Poland
`Portugal
`Romania
`Russian Federation
`Sudan
`Sweden
`Singapore
`
`Codes used to identify States party to the PCI‘ on the front pages of pamphlets publishing international applications under the PCT.
`
`AL
`AM
`AT
`AU
`AZ
`BA
`BB
`BE
`BF
`BG
`13.]
`BR
`BY
`CA
`CF
`CG
`CI]
`CI
`CM
`CN
`CU
`CZ
`DE
`DK
`EE
`
`ES
`FI
`FR
`GA
`GB
`GE
`GH
`GN
`GR
`HU
`IE
`IL
`IS
`11‘
`JP
`KE
`KG
`KP
`
`KR
`KZ
`LC
`LI
`LK
`LR
`
`Spain
`Finland
`France
`Gabon
`United Kingdom
`Georgia
`Ghana
`Guinea
`Greece
`Hungary
`Ireland
`Israel
`Iceland
`Italy
`Japan
`Kenya
`Kyrgyzstan
`Democratic People's
`Republic of Korea
`Republic of Korea
`Kazakstan
`Saint Lucia
`Liechtenstein
`Sri Lanka
`Liberia
`
`2
`
`

`

`WO 99/22338
`
`PCT/GB98/03016
`
`PORTABLE COMPUTERS
`
`The present invention relates to portable computers and more particularly
`
`but not exclusively to hand-held computers of the kind sometimes referred to as
`
`personal digital assistants.
`
`A personal digital assistant includes data files defining such items as an
`
`electronic diary, address book and other applications such as word processing
`software, calculators and the like. As more powerful memories and processors
`
`have been developed in smaller packages it has become possible to provide quite
`
`powerful computers in relatively small portable cases. However, the limitation of
`
`miniaturisation occurs when a viewing screen and keyboard are needed for data
`
`input and read out. Thus, so called palm top personal computers (PPC) are usually
`
`of the order of 15 cm by 7 cm in order to provide a readable screen and a usable
`
`keyboard. Such palm top computers are known, for example Psion Corporation
`
`have produced a Psion Series 5 (trade mark) PPC having an 8 megabyte RAM and
`
`processor while Hewlett Packard similarly produce PPCs as e.g.
`
`the HP320LX
`
`(trade mark). The capabilities of such PPCs may be enhanced by incorporating so
`
`called flash cards enabling the expansion of the RAM by up to 10 megabytes or
`
`more while PCMCIA cards may be provided to enable connection of the PPC to
`
`telephone networks by way of
`
`cellular
`
`’phones or
`
`telephony sockets
`
`for
`
`communication with other computers and the so called Internet and intranets.
`
`Most PPCs incorporate a docking arrangement
`
`to enable them to be
`
`connected with a desktop computer or other main frame for the purposes of
`
`synchronisation of data files and the like.
`
`However, generally speaking PPCs are not robust and are prone to damage
`
`mainly because of the clam shell design requiring a hinge that opens to reveal the
`
`incorporated keyboard and screen. Thus PPCs are more usually used on a desk top
`
`or table or may be held in one hand while typing with the other.
`
`According to the present invention there is provided a portable computer
`
`including movement detection means responsive to movement of the computer to
`
`produce an electrical output signal representative of such movement, processing
`
`means responsive to the output of said position detection means to determine
`
`detected movement data defining a user’s intention, the processing means using
`
`10
`
`15
`
`20
`
`25
`
`30
`
`3
`
`

`

`A
`
`; WO 99/22338
`
`PCT/GB98/03016
`
`said data to provide a mode response selected from a multiplicity of stored
`
`possible modes.
`
`Preferably the movement detection means
`
`includes
`
`at
`
`least
`
`one
`
`acceleration or tilt detection means responsive to movement of the computer to
`
`produce the output electrical signal. There may be a plurality of acceleration
`
`detection means each producing a respective electrical output signal representative
`
`of movement components in respective directions, the detectors generally being
`
`mounted to detect X and Y movement components at a ninety degree angle.
`
`The processing means may include a data input mode in which detected
`
`10
`
`movement data is used to generate alphanumeric
`
`or graphical data. The
`
`alphanumeric or graphical data may be stored in data storage of the portable
`
`computer or may be output by transmitting means to receiving means connected
`
`to another processing device.
`
`The processing means may include a screen output mode in which
`
`15
`
`detected movement data is used to modify output
`
`to display means of
`
`the
`
`computer whereby scrolling of displayed information is effected.
`
`In the screen
`
`output mode the processing means may be responsive to relative lateral
`
`tilting
`
`movement to cause the display of information stored as to one or other side of
`
`currently displayed information. Relative rolling movement may cause the display
`
`20
`
`of information stored as above or below the currently displayed information.
`
`In the screen output mode the processing means may be responsive to
`
`detected movement data to determine a most likely orientation of the computer
`
`display means with respect to a user’s eye line whereby the signals output to the
`
`display means may cause inversion of the displayed information such that the
`
`25
`
`computer may be held and used in either hand.
`
`The computer may include proximity detection means arranged to provide
`
`signals indicative of the proximity of the display screen to a user’s view,
`
`the
`
`processing means being responsive to changes in the relative proximity to increase
`
`or decrease density of displayed information.
`
`30
`
`In a further development, security data derived from movement of the
`
`computer defining an authorised user’s password is stored, the processing means
`
`being locked in a secure mode until detected movement data corresponding to the
`
`security data is received.
`
`4
`
`

`

`‘ WO 99/22338
`
`PCT/GB98/03016
`
`The computer may include a sound input device , the processing means
`
`having a second data input mode in which alphanumeric data is derived from input
`
`speech signals. A sound output device may also be included to permit the output
`
`of speech derived from stored data. Alternatively the sound input and output
`
`devices may be combined with a radio transceiver whereby cellular or other radio
`
`telephony networks may be used.
`
`The computer may be housed in a casing shaped to facilitate a user
`
`holding the computer as if holding a writing stylus. The casing is preferably of
`
`substantially radiused triangular cross section along a substantial portion of its
`
`length and may include a flattened section incorporating a display screen. The
`
`casing may include angular shaping between a forward holding area and a rearward
`
`screen area the shaping being such as to provide a natural viewing angle of an
`
`incorporated display screen while the casing is held as a writing stylus. The
`
`shaping may also be such as to facilitate support of the rearward screen area by
`
`the dorsal aspect of a user’s hand between the root of the thumb and index finger
`
`and the wrist.
`
`A portable computer
`
`in accordance with the invention will now be
`
`described by way of example only with reference to the accompanying drawings of
`
`which:
`
`Figure 1 shows a plan view of the computer;
`
`Figure 2 shows a side view of the computer of Figure 1:
`
`Figure 3 is a block schematic diagram of the circuits of the computer of
`
`1O
`
`15
`
`20
`
`Figure 1;
`
`Figure 4 is a circuit diagram showing details of the circuitry described with
`
`25
`
`respect to Figure 3;
`
`Figure 5 is a circuit diagram of a docking station to enable the computer of
`
`Figure 1
`
`to be connected to a desktop or other device;
`
`Figures 6 to 9 are flow charts showing some of the programs incorporated
`
`in the microprocessor of Figure 4;
`
`3O
`
`Figures 10 to 13 are graphical
`
`representations of
`
`the outputs of
`
`the
`
`accelerometers of Figure 4 as analysed by the microprocessor;
`
`Figure 14 is a graphical comparison of the representations of the outputs
`
`of the accelerometers as shown in Figures 10 to 13;
`
`5
`
`

`

`4 W0 99/22338
`
`PCT/GB98/03016
`
`4
`
`Figure 15 is a schematic diagram of a power saving arrangement of the
`
`portable computer of Figure 1;
`
`Figure 16 is a schematic diagram of a voice input arrangement of the
`
`portable computer of Figure 1;
`
`Figure 17 shows mounting positions of the accelerometers of Figure 4
`
`with respect to each other;
`
`Figure 18 is a table showing a program response to movement of the
`
`accelerometers of Figure 16 in a particular mode of operation; and
`
`Figure 19 is a schematic diagram of a part of a scroll detector of the
`
`10
`
`portable computer of Figure 1.
`
`Referring to Figures
`
`1 and 2,
`
`the hand—held computer of
`
`the present
`
`invention has a case 1 of a moulded plastics material having a triangular barrel
`
`cross section towards the forward end, that is towards the point, with radiused
`
`sides providing a diameter of approximately 15mm. The case is shaped to have a
`
`curve so that when the forward part of the barrel of the casing is held as a writing
`
`stylus using the thumb, index finger and second finger of the user, the screen area
`
`A-A rests comfortably on the dorsal area at the back of the hand between the root
`
`of the thumb and index finger of the hand and the user’s wrist.. This provides
`
`some additional support to allow the entire computer to be operated using one
`
`hand only. After assembly the case is sealed using an O—ring seal much in the
`
`manner of sealing watch parts. Coating the casing with wax polythene completes
`
`the sealing of the unit so that to all intents and purposes the case is waterproofed.
`
`The
`
`casing is weighted at one
`
`end
`
`(for example by including a
`
`rechargeable battery 2) at the forward end so that if the item is dropped on to a
`
`surface it tends to fall
`
`in a specified manner such that the tip which may include
`
`some impact protection,
`
`for example by being rubber cased, prevents any
`
`significant damage to internal components. The weighting also assists balancing
`
`of the unit in a user’s hand.
`
`The case may incorporate a hook 3 for attachment of a strap or key ring
`
`(not shown) and may have a pocket clip 4. The hook is preferably recessed within
`
`15
`
`20
`
`25
`
`30
`
`the casing.
`
`Externally mounted a small liquid crystal diode screen which may be of the
`
`kind manufactured by Batron and supplied under type number BT4ZOO3STYC is
`
`included. To either side of the LCD 5 touch or pressure sensitive switches 6 to 13
`
`6
`
`

`

`‘
`
`'.WO 99/22338
`
`PCT/GB98/03016
`
`are provided. These switches may be soft programmed to provide functions as
`
`hereinafter described. A touch scroll strip 14 (hereinafter described) is provided in
`
`front of the screen 5 and the system includes a pyroelectric detector 15 used in
`
`determining the proximity of the computer to a user’s eye.
`
`Audio input and output devices are also provided together with an alerting
`
`device.
`
`For example, a microphone 16, annunciator 17 and speaker 18 may be
`
`included. Finger switches 18, 19, 20 are provided forward of the annunciator 17
`
`and again may be soft programmed for functionality. Also visible are gold docking
`
`pins 21 used for connecting the hand—held computer for recharging of the battery 2
`
`1O
`
`and transfer of data by way of a docking device to other computers, for example
`
`desk mounted personal computers.
`
`As an alternative means of transferring data from the computer of the
`
`invention to another processing device or to enable the computer of the invention
`
`to be used as an input device for a PC, an infrared transceiver 22 is mounted
`
`15
`
`towards the front of the casing 1.
`
`Also included is a light emitting diode 23 which may be of the kind having
`
`three or more colours. Individual colours allow for a small amount of illumination or
`
`may be used to provide indication or alarm functions. Alternatively,
`
`a single
`
`coloured red light emitting diode part TLSH18OP from Toshiba may be used. This
`
`ultrabright LED aids human night sight viewing and whilst only being of low power
`
`may in a dark environment assist the user.
`
`Turning now to Figure 3, a block schematic diagram of the component
`
`parts of the computer is shown.
`
`It will be noted that the display 5 receives inputs
`
`from a microcontroller 30 which may be of the type supplied by Microchip under
`
`the reference PIC16C74. The PIC16C74 includes on board read only memory
`
`(ROM) but in a preferred embodiment an ARM processor with a larger memory is
`
`used. Also mounted within the casing 1 are two accelerometers 31, 32 which
`
`may be of the kind known as ADXL05 from Analog Devices Limited and which are
`
`buffered by operational amplifiers,
`
`for example National Semiconductor
`
`type
`
`LPC662. The keys 6 to 13 and 18 to 20 are here represented as a keypad 33.
`
`Some of the keys may be used to control a speech recorder 34 which is also used
`
`as an interface between the microcontroller 30, and microphone 16 and the
`
`speaker 18. A radio transmitter 35, which may be a radio transceiver,
`
`is also
`
`20
`
`25
`
`30
`
`incorporated.
`
`7
`
`

`

`‘ 3W0 99/22338
`
`PCT/GB98/03016
`
`One function of the radio transmitter may be to allow use of the hand-held
`
`computer of the invention as an input device for a desk mounted or other PC 40
`
`having corresponding receiver 36 and an appropriate converter without physical
`
`interconnection. Other functions of the transceivers 35, 36 may be apparent from
`
`the description hereinafter.
`
`Referring now to Figure 4,
`
`the microcontroller 30 is connected to the
`
`display 5 using standard control inputs of the display to provide a visual output of
`
`the result of program activities requested by the user.
`
`It will be noted that the
`
`accelerometers 31 and 32 have associated buffer circuits which each include an
`
`operational amplifier to buffer the input to the microcontroller. The operational
`
`amplifiers 41 may be type LPC662 from National semiconductor.
`
`Power to the accelerometers 31 is by way of a transistor TR2 so that if
`
`the microcontroller 30 determines that no movement of the computer is occurring
`
`or that the present program does not require use of the accelerometers 31 and 32,
`
`output RB1 may be set to stop current being drawn to minimise battery usage.
`
`The microcontroller may allow periodic sampling during dormant periods so that if
`
`the computer is picked up the sensors may again be activated.
`
`An EEPROM integrated circuit chip type X24F064 8 Kbyte from Xicor
`
`providing 8 Kbytes of memory is also provided accessible from the microcontroller
`
`30 in known manner. Switches 81 to 88 (keys 33 in Figure 3) are wired to
`
`respective inputs of the microcontroller 30.
`
`Note that TR1 controls power input to the back lighting circuitry of the
`
`LCD display 5. Again, the microcontroller 30 will normally bias TR1 off when the
`
`computer is dormant and will maintain TR1 biased off unless back lighting is
`
`requested by operation of one of the keys of the keyboard 33.
`
`For the avoidance of doubt
`
`it
`
`is here noted that the microcontroller 30
`
`includes a program which uses position outputs from the accelerometers 31, 32 to
`
`determine from the orientation of the computer whether the hand-held computer is
`
`in the left hand or right hand of the user.
`
`It
`
`is here noted that accelerometer
`
`output may depend upon the tilt angle of the included accelerometers to the
`
`earth’s gravitational field. The keys 81 to 88 are then swapped over in soft
`
`programming mode such that functionality is determined by the apparent top of the
`
`display 5 to the user in its current position. Similarly, determination of orientation
`
`of alphanumeric or other display information on the screen 5 will be determined
`
`1O
`
`15
`
`20
`
`25
`
`30
`
`8
`
`

`

`‘
`
`'WO 99/22338
`
`PCT/GB98/03016
`
`from the orientation of the computer itself. Thus, data output to the screen from
`
`the controller 30 arranged to provide an appropriately oriented display.
`
`The speech recorder 34 is implemented using Sequoia technology sound
`
`recording integrated circuit type lSD2560. The Sequoia technology chip is capable
`
`of recording 60 seconds of speech message in digital form and is connected so
`
`that the microphone 16 can be used to provide an input. The three switches SW1,
`
`SW2 and SW3 may correspond to the fingertip switches 18 to 20 of Figure 1 or
`
`may be selected in software from keys 6 to 13.
`
`In speech recording mode SW1 provides a start and pause control function
`
`for the user, SW2 is a stop or reset function while SW3 switches between the
`
`record and play modes.
`
`Short messages are played back by way of the loud speaker 18. As
`
`currently implemented the microphone 16 is a Maplin type QYSZS, the speaker is
`
`from Hosiden type HDR9941.
`
`"Speech notes” recorded by this method may be
`
`down loaded to a PC for sorting and categorising.
`
`Turning briefly to Figure 5,
`
`the hand-held computer of Figure 1 can be
`
`inserted in a corresponding docking port shaped to align the contact 21 with T5 to
`
`T7 of Figure 5. The contact T5 and T8 provide serial receive and transmit paths
`
`for synchronising databases between a PC and the portable computer and also
`
`provide battery charging. Contact T7 provides an earth contact. Speech samples
`
`and other data may be up loaded from a PC to the portable computer.
`
`A Maxim integrated circuit 42, which may be type MAX232IC, converts
`
`R3232 level serial output and input required by current PCs to the voltage level
`
`required by the microcontroller 30 of Figure 4. Note also the ability to receive
`
`radio input by way of an antenna connected to the radio receiver chip type
`AMHRR3-418.
`
`Having discussed the hardware of the portable computer of the invention
`
`we shall now consider various uses to which the writing stylus input, voice input
`
`and screen may be used. Exemplary flow charts for some aspects of the use of
`
`the portable computer are attached. While functions are individually discussed in
`
`respect of the flow charts of Figure 6 to 9,
`
`it will be appreciated that combinations
`
`of programs may be used in the implementation of features described hereinafter.
`
`Turning now to Figure 6,
`
`the tilt sensor software uses inputs from the
`
`accelerometers 31, 32 which, as shown in Figure 17 to which reference is
`
`1O
`
`15
`
`20
`
`25
`
`30
`
`9
`
`

`

`,
`
`‘WO 99/22338
`
`PCT/GB98/03016
`
`additionally made, are mounted with their respective sensitive axes at right angles
`
`to each other. As will have been seen from Figure 4,
`
`the output from each
`
`accelerometer
`
`is
`
`filtered by a
`
`resistor capacitance network to remote high
`
`frequency noise for example, and the outputs are then read by an analogue to
`
`digital converter included within the microcontroller 30. Thus, referring to Figure
`
`6,
`
`for special sensing the microcontroller 30, display 5 and analogue to digital
`
`conversion circuits are initialised at 100 and the interrupts and port pins of the
`
`microcontroller 30 are reset or cleared at 105. The output of the accelerometers
`
`31, 32 is
`
`read from respective analogue input pins AND and AN1
`
`of
`
`the
`
`1O
`
`microcontroller 30 and an index to a look up table is calculated at step 110 using
`
`the formula I = a + (b1 x 16).
`
`In this case a is calibration constant and b1 is the
`
`digitised output of the accelerometer 31. This allows for a look up table allowing
`
`a16 by 16 matrix of left to right position to be determined. For vertical tilt position
`
`the formula I = a + (b2 x 16) where b2 is the output of the accelerometer 32 may
`
`15
`
`be used to address a further matrix to determine the relative up/down position. By
`
`20
`
`25
`
`3O
`
`applying one or more of the indices to the look up table it,
`
`is possible to select one
`
`of n screen positions or to determine the amount of movement since the last
`
`reading at step 115. The system then waits for 10ms as indicated at step 120
`
`before repeating the reading of the accelerometer output.
`
`The program allows for the screen 5 to be scrolled in accordance with the
`
`user's requirements.
`
`The mounting of these sensors, as shown in Figure 17,
`
`allows posiitonal movement such as up, down,
`
`left and right
`
`to resolved to
`
`fractions of a degree.
`
`Using software the microcontroller 30 may use the output
`
`from the
`
`accelerometers 31, 32 to determine a user’s requirement for a different view to be
`
`displayed on the screen 6. Thus a virtual hinge is created such that if the user
`
`moves the stylus whilst
`
`it
`
`is in viewing position the screen information may be
`
`changed to respond to a natural reaction for looking up or down or to the left or
`
`right. Thus, as shown in Figure 18 in a simplified arrangement,
`
`if the display on
`
`the screen at any time is designated as current page (CPl then tilting the stylus
`
`towards the left will cause the display of a page stored as to the right of CP (CR).
`
`The page which was formerly CR (as represented by data held within the storage
`
`of the microcontroller 30 or an associated data store) is now CP. Tilting the stylus
`
`to the right will cause a page of information (CL) to the left of GP to be displayed.
`
`10
`
`10
`
`

`

`‘
`
`‘WO 99/22338
`
`PCT/GB98/03016
`
`For
`
`the avoidance of doubt
`
`the term page is used here as for a screen for
`
`information. Thus the action of tilting the stylus to the left or right is analogous to
`
`the natural inclination to look through a window towards the right or left to obtain
`
`additional information from a scene.
`
`Similarly,
`
`if the stylus is turned towards the user information stored at UC
`
`will be displayed and tilting the stylus away results in the information DC being
`
`It will be appreciated that combining tilt angles may result in the display
`displayed.
`of information up and to the left (UL), up and to the right (UR), down and to the
`
`left (DL) and down and to the right (DR). This simplified description of a multiple
`
`line screen moving as if a jump is occurring should be considered as allowing single
`
`line scrolling in which CP defines the top line of the screen, DC the line below and
`
`further lines to the limit of screen viewability also being displayed with CP such
`
`that single line scroll movement or smooth scrolling appears to occur.
`
`Finer
`
`scrolling modes such as single pixel movements are also possible. The user may
`
`select the rate of response using keys 6 to 13 or fingertip switches 18 to 20.
`
`It
`
`should also be noted that
`
`the tilt
`
`sensor arrangement 31, 32 allows
`
`the
`
`microcontroller 30 to determine the most likely viewing angle and to adjust pixel
`
`mapping to the screen accordingly so that if a user holds the stylus in the left hand
`
`the display is inverted to that shown in Figure 1 so that the bottom right corner, as
`
`viewed by a right handed user, becomes the top left corner as viewed by a left
`
`handed user.
`
`lt should be noted that the microcontroller does not require an input
`
`from the user to determine whether the stylus is being held in the left or right hand
`
`and, if a user changes hands during the course of viewing the screen output will be
`
`inverted accordingly.
`
`it is also possible, particularly if pictorial rather than alphanumeric display
`
`is required, for the screen to enter a ”portrait” mode if the stylus is held vertically.
`
`In this case the orientation will be appropriate to the stylus being held with its tip
`
`above or below the waist of the stylus.
`
`To prevent scrolling or orientation change the user may use a soft key 6 to
`
`13 or fingertip switch 18 to 20 to lock and unlock display movement.
`
`Further, while as described with reference to Figure 3, the display screen
`
`is a Batron,
`
`in a preferred embodiment a Kopin Cyberdisplay 320 having 1/: VGA
`
`colour
`
`resolution may be used. Using the Kopin display and the associated
`
`monocular viewing lens mounted and on to the body allows clear viewing of some
`
`1O
`
`15
`
`20
`
`25
`
`30
`
`11
`
`11
`
`

`

`4 WO 99/22338
`
`PCT/GB98/03016
`
`1O
`
`15 lines of normal
`
`text. The Kopin Monocular lens is approximately 20mm by
`
`18mm which gives an acceptable size to a pen body incorporating movement
`
`sensing means as herein described.
`
`In a still further development the pyroelectric detector (Murata type IRA-
`
`E7OOSTO) 15 may be used to detect the presence of the user and the proximity of
`
`the user to the viewing screen 5. Using the Kopin ‘A VGA display it is possible to
`
`decrease the size of character displayed. Thus the microcontroller 30 uses the
`
`output of the pyroelectric detector 15 to determine how close to a user's eye the
`
`stylus is held and may adjust the size of print so that more characters are fitted on
`
`the screen 5.
`
`In this way large areas of text may be read by holding the screen
`
`close to the user’s eye. A further use of the pyroelectric detector for power saving
`
`purposes it discussed hereinafter.
`
`As has been mentioned detection of
`
`the
`
`position of the screen with respect to the user’s left or right side is possible.
`
`Referring to Figure 8,
`
`clearing of
`
`interrupt and set port pins
`
`and
`
`initialisation as previously mentioned with regard to Figure 6 is carried out. One of
`
`the accelerometers, for example the accelerometer 31, is read at step 200 and its
`
`value compared with a predetermined value m. Values greater than m indicate that
`
`the display is most
`
`likely in the user’s left hand so that as indicated at 215
`
`inverted characters are displayed on the screen 5.
`
`If
`
`the value read from
`
`accelerometer 31 is less than m then it may be assumed that the stylus is in the
`
`user’s right hand and normal ROM LCD characters are displayed. As indicated at
`
`220, a check may be carried every 10ms to determine the whereabouts for the
`screen.
`
`It is envisaged that input to the computer system either for use as a PDA
`
`or
`
`for word processing purposes, will be carried out either by hand writing
`
`recognition (HR) or by voice input using the microphone 16. Handwriting
`
`recognition does not require the user to write on a surface, although some users
`
`may find this a preferable method of operation, but requires the user merely to
`
`move the stylus (that
`
`is the whole computer) as if writing letters and numbers.
`
`1O
`
`15
`
`2O
`
`25
`
`3O
`
`Katakana or Cyrillic texts may also be entered as may symbols.
`
`Thus using one of the two accelerometers 31, 32 and referring to Figures
`
`10 to 14, the output of one of the accelerometers 31, 32 is read at a simple rate
`
`of 100 times per second. The received data is stored in a random access memory
`
`(RAM) buffer as a set of acceleration values against unit time. Using a software
`
`12
`
`12
`
`

`

`‘ WO 99/22338
`
`PCT/GB98/03016
`
`11
`
`process of autocorrelation the microcontroller 30 may determine the character
`
`entered. Thus, referring to the Figures, Figure 10 shows three entries of the letter
`
`C, Figures 11 shows three entries of letter B, Figure 12 3 entries of letter F and
`
`figure 13 three entries of letter H for exemplary purposes only. Feedback to the
`
`user either on the display or by character speech output or simply by an acoustic
`
`beep indication may be used to note acceptance of a character.
`
`The validity
`
`indication may be user selectable.
`
`It will be noted from Figure 14 that a single accelerometer output
`
`is
`
`distinct for each of the input characters and therefore the microcontroller can
`
`determine the entry made. The entry may be of text which can be reflected to the
`
`viewing screen 5 or maybe instructions couched in appropriate terms such as ”get
`
`Monday diary”. Once the diary has been recovered from the store the appropriate
`
`entries may be displayed on the screen 5 with appropriate soft key indications for
`
`the keys 6 to 13.
`
`Note that predefined user gestures such as drawing an “envelope” to
`
`request e-mail mode or a table for diary mode, for example, may be used. The
`
`instructions may be user selectable or teachable so that on initialisation the user
`
`draws and selects the mode. Subsequently drawing the same symbol will cause
`
`the microcontroller 30 to enter the appropriate selected mode.
`
`Again sensing may be used to move around the displayed area (as
`
`discussed with reference to Figure 6 and Figure 18) or the touch strip controller 14
`
`may be used in combination with the keys 6 to 13 to select appropriate areas.
`
`Entry of information to the diary may also be by handwriting input.
`
`It
`
`is
`
`convenient here to consider the construction of the touch strip 14 which as shown
`
`in Figure 19 comprises
`
`a 0.4mm printed board having a
`
`surface area of
`
`approximately 20 mm by 5m with
`
`horizontal strips in the 5mm dimension as
`
`indicated as 47 to 50 for Figure 19 which shown a part of the strip 14. The strip
`
`14 thus replaces the rotational elements of potentiometer so that hermetic sealing
`
`of
`
`the casing may be complete and a control which is resistant
`
`to wear as
`
`provided. The strips 47 to 50 etc, are interfaced to the microcontroller 30 so that
`
`as a finger
`
`is moved across the strip direction of movement and speed of
`
`movement may be determined. The information may be used in the same way as
`
`a rotary potentiometer.
`
`1O
`
`15
`
`20
`
`25
`
`30
`
`13
`
`13
`
`

`

`‘ WO 99/22338
`
`PCT/GB98/03016
`
`12
`
`It will be appreciated that incorporating a second strip at right angles to
`
`the strip 14 would allow full
`
`functionality of
`
`(eg)
`
`a computer mouse to be
`
`simulated.
`
`Thus as shown in figure 19,
`
`if a user moves a finger such that,
`
`for
`
`example, the presence of the finger bridging 48, 49 and 50 subsequent to the
`
`presence of a finger bridging 47 to 50 indicates that the user would wish to rotate
`
`a potentiometer in a counter-clockwise direction. Similarly, detection of a finger
`
`bridging 47 and 48 subsequent to there having been no previous bridge indicates
`
`rotation in a clockwise direction.
`
`It will be appreciated, however,
`
`that
`
`if
`
`the tilt detection mechanism
`
`hereinbefore described indicates that the device is in the left hand rather than the
`
`right hand the functionality of bridging and unbridging is reversed accordingly.
`
`Entry of data files, for example the composition of letters or reports can be
`
`carried out using either the write sensing arrangement, hereinbefore described, to
`
`determine input alphanumeric which may be stored for subsequent transmission to
`
`a printer or for transfer as data files to a PC for example. Data entered and
`
`converted into appropriate