`
`Ex. GOOG 1006
`
`EX. GOOG 1006
`
`
`
`
`
`

`

`(12) United States Patent
`Wilska et al.
`
`US006427078B1
`US 6,427,078 B1
`Jul. 30, 2002
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`(54) DEVICE FOR PERSONAL
`COMMUNICATIONS, DATA COLLECTION
`AND DATA PROCESSING, AND A CIRCUIT
`CARD
`
`(75) Inventors: Kari-Pekka Wilska, Salo; Reijo
`Paajanen, Tampere; Mikko Terho,
`Tampere; Jari Hamalainen, Tampere,
`all of (F1)
`
`(73) Assignee: Nokia Mobile Phones Ltd., Salo (FI)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 08/807,322
`(22) Filed:
`Feb. 27, 1997
`
`Related US. Application Data
`
`(63) Continuation of application No. 08/444,224, ?led on May
`18, 1995.
`Foreign Application Priority Data
`
`(30)
`
`Jun. 12, 1995
`
`(F1) ............................................... .. 942334
`
`(51) Int. Cl.7 ................................................ .. H04B 1/38
`
`(52) US. Cl. ..................... .. 455/550; 455/556; 455/557;
`455/558; 348/14.02; 348/231; 348/552
`
`(58) Field of Search ........................ .. 455/90, 403, 550,
`455/556, 557, 558, 566, 575, 348/14, 231,
`552, 14.01, 14.02, 14.13, 14.14, 395/800.14
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`2/1990 Carter et al. .............. .. 364/708
`4,903,222 A
`5,189,632 A * 2/1993 Paajanen et al. ..... .. 364/705.05
`5,272,598 A 12/1993 Kobayashi et al. ....... .. 361/686
`5,404,580 A * 4/1995 Simpson et al. . . . . .
`. . . .. 455/89
`5,438,359 A * 8/1995 Aoki ........................ .. 348/207
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`JP
`JP
`JP
`JP
`JP
`WO
`W0
`WO
`
`2/1993
`0 526 802 A2
`6/1988
`63151283 A
`6/1989
`1160286 A
`6/1992
`4170881 A
`10/1992
`4295886
`3/1994
`6-70314
`5/1992
`WO92/09169
`6/1994
`WO 94/14274
`9607269 A1 * 3/1996
`
`.......... .. H04N/5/30
`
`OTHER PUBLICATIONS
`
`Reimer, John, “Memories in My Pocket”, Byte, Feb. 1991,
`pp. 251, 252, 254—256, 258.
`Patent Abstracts of Japan, vol. 17, No. 107 (P—1496) (5736)
`Mar. 4, 1993, JP—A—4—295886.
`Patent Abstracts of Japan, vol. 18, No. 320 (E—1563) (6660)
`Jun. 17, 1994, JP—A—6—70314.
`Patent Abstract published in UK, “Lights Camera Multime
`dia”, Network, pp. 56—58, 60, Nov. 1993, K. Young.
`
`* cited by examiner
`Primary Examiner—Nay Maung
`(74) Attorney, Agent, or Firm—Perman & Green, LLP
`(57)
`ABSTRACT
`
`The object of the invention is a device for personal
`communication, data collection and data processing, Which
`is a small-sized, portable and hand-held Work station com
`prising a data processing unit (2); a display (9); a user
`interface (10, 11); a number of peripheral device interfaces
`(12, 17); at least one memory unit (13); a poWer source,
`preferably a battery (3); and an application softWare.
`According to the invention the device also comprises a
`camera unit (14). The camera unit (14) comprises a camera
`(14a), preferably a semiconductor camera, and optics (14b)
`connected thereto, Which are placed in the housing (1) of the
`device. Alternatively, the camera unit (14) is ?tted on a
`PCMCIA card (15) Which can be connected to the PCMCIA
`card slot (16) of the device. An object of the invention is also
`a PCMCIA card (15) provided With a camera unit (14).
`
`76 Claims, 3 Drawing Sheets
`
`Ex. GOOG 1006
`
`

`

`US. Patent
`
`Jul. 30, 2002
`
`Sheet 1 0f3
`
`US 6,427,078 B1
`
`
`
`29
`
`\
`
`5
`
`“
`
`11\ __
`MOUSE TRACK BALL
`
`3
`
`BATTERY
`
`PC IN_A_CHIP
`
`2
`
`9
`
`DISPLAY
`
`28
`
`12
`
`1o
`
`KEYBOARD
`
`INFRAREDLINK
`
`
`PCMCIA CAMERA
`OR OTHER
`PCMCIA
`
`
`EXTENSIONS
`15.16
`
`
`
`
`
`
`CENTRAL
`PROCESSOR
`
`IQ—CONTROLLER
`
`l
`
`4
`
`8
`
`CMT
`CONTROL
`
`CONTROLLER
`
`6
`
`7
`
`D'SPLAY
`
`13
`
`
`
`
`
`
`MEMORIES
`(SRAM,
`
`EEPROM.
`
`FLASH)
`
`MEMORY
`CONTROLLER
`
`14
`
`CAMERA
`UNIT
`
`‘3ELLULAR
`MOBILE
`TELEPHONE
`17" AND MODEM
`
`EX. GOOG 1006
`
`Ex. GOOG 1006
`
`

`

`U.S. Patent
`
`Jul. 30, 2002
`
`Sheet 2 of3
`
`US 6,427,078 B1
`
`22
`
`23
`
`14c
`/14o
`/
`[___\____lC_i____,I_/_ ___________ __l_____?l
`|
`~T— ,MP
`1 000 IMAGE SENSOR — OPTICS :
`
`140
`
`‘
`
`:
`24\ ;
`‘:0
`
`l_____|_ _ _ _ _ _ _ _ _ ‘ _ _ _ _ _ ___
`
`_____l
`
`;
`MEMORIES
`:
`VOLATILE
`NON—VOLATILE E
`
`BACK__UP
`BATTERY
`/21
`
`14b
`
`L _ _ _ _ _ _ _ _ _ _ _ _ _ __J
`
`1
`ga / /9 34 /36
`i
`/
`I
`/ /
`r
`J,
`/
`% NOKIA A
`340 \/
`K
`
`21
`
`19
`
`10
`
`35 2O
`16
`/
`,7
`
`I
`|
`
`l
`|
`||
`
`I
`|
`||
`
`0
`| [F1
`I
`l
`|
`|
`|
`|
`|| ll_|l ||\‘| QBK
`\
`11
`35o
`
`15 150
`f
`
`i
`
`14o‘14b
`'
`
`Ex. GOOG 1006
`
`

`

`U.S. Patent
`
`Jul. 30, 2002
`
`Sheet 3 of3
`
`US 6,427,078 B1
`
`Ex. GOOG 1006
`
`

`

`US 6,427,078 B1
`
`1
`DEVICE FOR PERSONAL
`COMMUNICATIONS, DATA COLLECTION
`AND DATA PROCESSING, AND A CIRCUIT
`CARD
`
`This is a continuation of copending application Ser. No.
`08/444,224 ?led on May 18, 1995.
`
`BACKGROUND OF THE INVENTION
`The object of the invention is a device according to the
`introductory part of claim 1 for personal communication,
`data collection and data processing. The device consists of
`a small-siZed housing comprising a data processing unit
`Which contains a data processor With peripheral circuits and
`memory units, a display, a user interface, a number of
`peripheral device interfaces, a poWer source, preferably a
`battery, and application softWare.
`Another object of the invention is a circuit card according
`to the introduction of claim 8 Which can be ?tted to the card
`slot arranged in connection With a device intended for
`personal communication, data collection and processing, in
`particular.
`Personal communication devices and/or mobile
`organisers, such as notebook computers and the like, knoWn
`from before, are small, light-Weight, portable and hand-held
`or laptop Workstations. A number of accessories and appli
`cation programs Which offer service functions can be
`installed in such personal devices, When necessary A such
`notebook computer is disclosed in international patent appli
`cation WO-93/14458.
`The notebook computer can be equipped With an elec
`tronic scanner by means of Which both teXt and ?gures can
`be read into the memory of the computer. This helps to
`eliminate the draWbacks of small keyboards, in particular.
`Data required in many connections, such as contact infor
`mation included in business cards, can be read into the
`memory of the computer. HoWever, electronic scanners
`comprise ?ne-mechanical parts Which Wear and may cause
`problems. Especially paper feeding arrangements ?tted in
`small notebook computers are problematic.
`The general purpose of this invention is to provide a neW
`device for personal communication, data collection and
`processing Which improves communication especially
`betWeen a user and the device. A special purpose of the
`invention is. to provide a device for personal
`communication, data collection and processing Which makes
`it possible to collect data efficiently and to communicate
`With the environment. This is accomplished by the charac
`teristic features of the invention, disclosed in appended
`claims 1—7.
`Another purpose of the Invention is to provide a neW
`interface card Which makes it possible to improve the data
`collection systems of small microcomputers, in particular.
`This is accomplished by the characteristic features of the
`invention, disclosed in claim 8.
`An advantage of the invention is that one and the same
`device, personal communications, data collection and pro
`cessing comprises an easy-to-use data collection device,
`ef?cient data processing equipment (programs) and data
`transmission equipment.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The invention is described in the folloWing in more detail
`With reference to the appended draWings in Which:
`FIG. 1 shoWs a device according to the invention for
`personal communication, data collection and processing, in
`
`10
`
`15
`
`20
`
`25
`
`30
`
`40
`
`45
`
`55
`
`60
`
`65
`
`2
`Which the data collection device is implemented by means of
`an integrated camera unit;
`FIG. 2 shoWs another device according to the invention
`for personal communication, data collection and processing,
`in Which the data collection device is implemented by a
`camera unit arranged in a PCMCIA card;
`FIG. 3 shoWs a device for personal communication, data
`collection and processing, in the form of a block diagram;
`FIG. 4 shoWs a PCMCIA card, i.e., a PCMCIA camera
`card comprising a camera unit as an essential part thereof;
`FIG. 5 shoWs a block diagram of the camera unit;
`FIG. 6 shoWs a device according to the invention, Whose
`display illustrates an eXample of an application related to the
`camera unit;
`FIG. 7 shoWs a device according to the invention for
`personal communication, data collection and processing,
`comprising a replaceable keyboard;
`FIG. 8 shoWs a device according to FIG. 7, comprising a
`digitiZer pad instead of the keyboard; and
`FIG. 9 shoWs the device of FIG. 7 When closed.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`FIGS. 1 and 2 shoW tWo application eXamples of the
`device according to the invention for personal communica
`tion. data collection and processing. Ablock diagram of such
`device is shoWn in general form in FIG. 3. The device
`according to the invention is called a notebook computer in
`the folloWing.
`A notebook computer is a small, portable Work station.
`The external dimensions of its housing 1 are preferably in
`the order of 170 mm><85 mm><30 mm (length><Width><height)
`and the Weight 1000 g at the most, preferably 800 g or less.
`The device is preferably arranged to operate by one or more
`batteries 3 (FIG. 3) Which are ?tted replaceably inside
`housing 1.
`The notebook computer comprises data processing unit 2
`(FIG. 3) Which is preferably arranged on one semiconductor
`chip. Data processing unit 2 comprises processor 4 Which is
`preferably a loW poWer RISC processor. Data processing
`unit 2 further comprises input/output controller 5, display
`controller 6, memory controller 7 and cellular mobile phone
`controller 8. In addition, data processing unit 2 comprises
`connection buses and cables betWeen different controllers
`and the data processor Which are not separately shoWn in the
`block diagram of FIG. 3.
`The notebook computer further comprises display 9
`Which is arranged, in the application eXamples of FIGS. 1
`and 2, ?Xedly in connection With housing 1 on large side 1a
`thereof Which is essentially of a rectangular shape. Display
`9 is provided, for eXample, by a liquid crystal display, The
`resolution of Which is at least 640x200 pixels2 and the
`dimensions in the order of 130 mm><70 mm. Display 9 is
`connected to display controller 6.
`The notebook computer also comprises keyboard 10
`and/or mouse/track ball 11 as a user interface. Keyboard 10
`and track ball 11 in this application are arranged ?Xedly to
`the notebook computer in the vicinity of display 9. The
`notebook computer preferably comprises Infrared link 12 by
`means of Which the connection With peripheral devices, such
`as a printer, another microcomputer or the like is provided.
`Keyboard 10, mouse/track ball 11 and infrared link 12 are
`connected to input/output controller 5, as shoWn in FIG. 3.
`The notebook computer further comprises one or more
`memory units 13. The memory unit can be implemented by
`
`Ex. GOOG 1006
`
`

`

`US 6,427,078 B1
`
`3
`means of SRAM, EEPROM and/or FLASH memory
`circuits, for instance. The operating system and preferably at
`least part of the application programs are recorded in
`memory unit 13. In addition, memory unit 13 contains a
`sufficient amount of read-Write memory space.
`The notebook computer further comprises a data collec
`tion device Which is Implemented by means of a camera
`unit. The embodiment of FIG. 1 represents camera unit 14
`(FIG. 3) ?tted in housing 1 of the notebook computer as a
`stationary part thereof. In this application, camera 14a of
`camera unit 14 and related optics 14b are arranged on the
`same side of the housing as display 9, though a different
`disposition is also possible. Camera unit 14 is connected via
`input/output controller 5 to data processing unit 2 (FIG. 3).
`Camera unit 14, Which is represented in the form of a block
`diagram in FIG. 5, consists of camera arrangement 140
`Which comprises camera 14a provided With suitable optics
`14b, and image processing unit 14c connected to the camera
`arrangement. This data collection unit can be used to transfer
`data presented on paper or the like as Well as an image taken
`of the surroundings, for instance of a person, to the notebook
`computer to be processed further.
`In the notebook computer application of FIG. 2 camera
`unit 14 is ?tted in a circuit card, preferably in PCMCIA card
`15. Camera 14a and optics 14b of camera arrangement 140
`are integrated in this card 15 together With their peripheral
`electronics, i.e., the image processing unit 14c (FIG. 5). The
`circuit card, i.e., camera card 15, in turn, can be ?tted into
`the card slot, such as PCMCIA card slot 16, of the mobile
`organiser. Camera 14a of the embodiment of both FIG. 1 and
`FIG. 2 is implemented as a semiconductor camera, prefer
`ably as a small CCD (Charge Coupled Device) camera. The
`adapter in PCMCIA card slot 16 is connected to input/output
`controller 5, as illustrated in FIG. 3. It is obvious that other
`corresponding, applicable PCMCIA cards, Which meet the
`standards draWn up for card slots, can also be ?tted into this
`card slot 16.
`The notebook computer further comprises a
`radiotelephone, i.e., cellular mobile phone unit 17, prefer
`ably as an Integrated part thereof. It is connected to cellular
`mobile phone controller 8 of data processing unit 2 and to
`receiver/transmitter antenna 18. In the case of a telephone
`set operating in an analogue cellular netWork, a modem is
`preferably connected to cellular mobile phone unit 17.
`Cellular mobile phone unit 17 is based on the standard
`cellular mobile phone technology. Both data and speech can
`be transmitted via integrated cellular mobile phone unit 17.
`The data transmission properties are based on an analogue
`modem and the GSM data interface, for instance, the tech
`nology of both of them being conventional. For a speech
`connection, miniature speaker 19 and microphone 20 can be
`arranged in the housing of notebook computer 1 on both
`sides of display 9. The notebook computer can then be used
`in the same Way as a conventional hand-held telephone.
`An additional part of the notebook computer is softWare
`applied for it. It is recorded in memory unit 13. Using the
`softWare, the user controls different functions of the mobile
`organiser as required. The functions related to the notebook
`computer include, for instance: telephone services Which are
`based on the cellular mobile phone (data transmission and/or
`speech transmission properties), facsimile services, elec
`tronic mail, short message service/SMS, a calendar and
`scheduler softWare, a clock With alarm clock functions.
`camera functions to record images and paper documents, as
`Well as computer i.e., PC interface functions for transferring
`information to PC applications.
`Camera unit 14 operating as the data collection device is
`considered more closely in the folloWing. Camera 14a and
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`65
`
`4
`optics 14b connected thereto are ?tted to PCMCIA card 15
`in the camera unit. The Personal Computer Memory Card
`International Association, i.e., the PCMCIA Was formed in
`order to advance the exchangeability of integrated circuit
`cards in computers and other electronic devices.
`Consequently, the PCMCIA cards are standardiZed cards
`Which are applicable for both memory cards and expansion
`cards of peripheral circuits, i.e., for input/output cards.
`Camera card 15 described herein is based on the standard
`mentioned above in Which camera arrangement 140 and
`peripheral circuits required by it are integrated in the stan
`dard card. FIG. 4 shoWs a physical model of a possible
`PCMCIA card 15 in Which camera unit 14 is ?tted in the
`thickened part 15a of the card. Camera 14a, such as a CCD
`(Charged Coupled Device) camera, is preferably a camera
`focused on a ?xed distance and it is preferably ?tted to the
`centre part of the enlargement 15a of the card. Camera 14a
`With its optics 14b is arranged so that the image ?eld 14d of
`the camera opens up perpendicular to the surface of card 15.
`Adapters 15b are arranged at the other end of card 15 to
`connect the card to the PCMCIAcard slot 16 in the notebook
`computer and to the counter connectors in the card slot.
`In principle, the structure of both camera card 15 and
`camera unit 14 conforms to the block diagram shoWn in FIG.
`5. By example, camera card 15 consists of camera arrange
`ment 140 Which comprises camera 14a and optics 14b,
`image processing unit 14c, battery 21 and interface 22 to
`external systems Which in this case is a standard PCMCIA
`Interface concerning camera card 15. Image processing unit
`14c comprises microprocessor 23 and a number of memory
`units 24. Optics 14b are provided by a suitable lens
`arrangement, by means of Which a sharp image is obtained
`of the object to be scanned in on the image plane of camera
`14a. Camera 14a is preferably implemented as a CCD
`camera comprising a tWo-dimensional light-sensitive CCD
`sensor, the resolution of Which is from 250 k pixel as high
`as to 26.2 Mpixel. Memory units 24 preferably comprise tWo
`kinds of memory units: volatile memory units,, such as
`DRAM and SRAM units used as scratch pad storages, and
`non-volatile memory units, such as FLASH and EPROM
`units Which are used as base program memories. PoWer to
`the PCMCIA card. is supplied via the PCMCIA interface
`from the notebook computer. Battery 21 is mainly used to
`ensure that images are maintained in the volatile memory
`units if the PCMCIA card is detached from the card slot.
`Battery 21 can be also used for the same purpose in camera
`unit 14 (FIG. 1) integrated in the notebook computer.
`Camera unit 14 functions in the folloWing Way, Whether
`it is ?xedly integrated to the notebook computer or connect
`able to the card slot of the notebook computer as camera
`card 15: a picture of a document or three-dimensional
`environment taken by camera 14a through optics 14b is
`transferred to image processing unit 14c and through its
`microprocessor 23 to memory unit 24, such as RAM. When
`the user Wishes to vieW the picture thus taken on display 9
`of the notebook computer, he/she can do that immediately.
`The desired image information is read from memory unit 24
`by means of microprocessor 23 of camera card 15, and the
`image information is transmitted to processor 4 of the
`mobile organiser along PCMCIA interface 22 or a corre
`sponding interface and further to display 9 via display
`controller 6. Image processing unit 14c processes the image
`information into a suitable form to be presented to the user
`by the mobile organiser.
`The image information recorded in camera card 15 can be
`scanned in either by the mobile organiser or by another
`computer and/or device provided With a PCMCIA interface
`
`Ex. GOOG 1006
`
`

`

`US 6,427,078 B1
`
`10
`
`15
`
`35
`
`45
`
`5
`or the like. It is possible to edit the picture by an external
`computer and the modi?ed picture can be recorded again in
`memory unit 24 of camera card 15. By virtue of battery 21,
`the operation of microprocessor 23 of image processing unit
`14c and that of memory unit 24 is assured in all circum
`stances.
`Camera unit 14 comprises a character recognition soft
`Ware Which is similar to that used in computers provided
`With pen interfaces, for instance. Previously knoWn pattern
`recognition softWare can be used to recognise graphical
`objects, After a text and/or an image has been scanned in the
`notebook computer, the user can start an application pro
`gram to process the data to suit his/her purposes.
`The application program of camera unit 14 functions, e.g.,
`in the folloWing Way: business card handler application 36
`(FIG. 6) is selected for the application program. The user
`?rst scans in the business card by camera 14a, then the
`picture of the business card and the information contained in
`it are transferred from camera unit 14 to memory unit 13 of
`the notebook. computer and via data processing unit 2 to
`display 9. After the scanned image 34 of the business card
`is visible on display 9, the user opens business card handler
`application 36 and key ?elds 35 of this application appear on
`display 9, as illustrated in FIG. 6. Key ?elds 35 have been
`recorded in the database. The user selects a suitable ?eld 34a
`from the business card and drops it to the correct key ?eld
`35a of the business card handler application, The selection
`and dropping are made by means of the mouse or track ball
`11. The ?elds required are selected from picture 34 of the
`business card and dropped to corresponding ?elds 35 of
`business card handler application 36. After the above
`described procedures have been carried out, the information
`contained in the business card can be used as address
`directory for letters, as telephone memo information or for
`other suitable purposes.
`Other kinds of information can also be scanned in the
`notebook computer by means of camera unit 14. The docu
`ment can be a note Written on a paper by hand, for instance.
`The user scans in the document, stores it in the memory unit
`of the notebook computer and processes it as required. A
`graphics handler softWare can be arranged to function With
`camera unit 14. It can function in the folloWing manner: the
`user draWs a graphical object, such as a circle or a line, on
`a paper. The images are scanned in by camera 14a to
`memory unit 13 of the notebook computer and the user starts
`the graphics handler softWare using the keyboard or the
`mouse. The scanned picture of the graphical object is then
`shoWn on the display. The user can select a picture on the
`display and modify the object by means of the graphics
`handler application to look like a desired object, such as a
`regular circle.
`The user can also select the character recognition softWare
`after the picture on the paper is scanned in the notebook
`computer by camera unit. 14. The character recognition
`softWare converts the hand Written text into ASCII charac
`ters. Indistinct characters are guessed by the softWare or the
`user is asked for further information.
`The simplest alternative is to store the information
`scanned in memory unit 13 of the mobile organiser by
`camera unit 14, in the form of a bitmap. This type of image
`information is used in facsimile/telefax transmission. The
`same kind of image storing can also be used for storing
`incoming telefax messages.
`The telefax functions can be implemented in the folloW
`ing Way: the user Writes notes on a paper and the characters
`on the paper are scanned in memory unit 13 of the notebook
`
`55
`
`65
`
`6
`computer by camera unit 14. The user selects the telefax
`application from the application programs and de?nes a
`receiver for the message. Next the picture of the notes is
`transmitted as a bitmap and a telefax message from the
`mobile organiser’s memory unit via cellular mobile phone
`unit 17 comprising a telefax modem. Incoming telefax
`messages are received in a corresponding manner via cel
`lular mobile phone 17 and stored in the mobile organiser’s
`memory as bitmaps. After the picture is ready, it is output on
`display 9 of the mobile organiser by means of the telefax
`program. All the images stored in the mobile organiser’s
`memory can be vieWed on the display using an operating
`program Which applies the said bitmap.
`When a user interface based on camera unit 14 is inte
`grated in connection With the notebook computer and espe
`cially its housing 1, obvious advantages are accomplished.
`With such camera unit 14 the user can scan different Written
`and/or draWn information into the memory of the notebook
`computer quickly and easily. The use of camera unit 14 is
`faster and easier than Writing With a pen, for instance.
`Information on business cards, as already mentioned, printed
`material and hand Written notes, etc., can be scanned into the
`memory of the notebook computer by using camera unit 14.
`FIGS. 7 and 8 shoW a notebook computer 27 according to
`the invention, in Which keyboard 28 for Writing texts and
`digitiZer pad 29 can be installed replaceably. FIG. 9 shoWs
`the notebook computer according to FIGS. 7 and 8 in Which
`keyboard/digitizer pad 30 is turned against the display of the
`notebook computer and locked in its place. In this Way it is
`easy to carry notebook computer 27 along and to even put
`it in the pocket. Alternatively, the notebook computer can be
`carried by Wrist strap 31.
`Notebook computer 27 comprises essentially the same
`parts and units as shoWn above in the embodiments accord
`ing to FIGS. 1 or 2. Consequently, the parts of notebook
`computer 27 Which are visible externally include housing 1,
`display 9, keyboard 10, miniature speaker 19 and micro
`phone 20 as Well as antenna 18 (cf. FIGS. 1 and 2 and the
`block diagram in FIG. 3).
`The external keyboard 28 of notebook computer 27 is
`used for Writing. In spite of the small siZe, keyboard 28
`comprises all the necessary characters,, such as letters,
`numbers and a number of function keys. An advantage of
`such normal, external keyboard 28 is that the user is familiar
`With the keyboard itself and he/she can use it in a conven
`tional Way for Writing and feeding texts to the notebook
`computer.
`External keyboard 28 is connected to notebook computer
`27 by means of connector 32. In the case of FIGS. 7 and 8,
`the male part 32a of connector 32 is in connection With
`housing 1 of the notebook computer, While the female
`connector part 32b is in connection With external keyboard
`28. In addition, male part 32a of connector 32 is hinged to
`the loWer part of display 9 or to the elongated side of housing
`1, Whereby it can be turned up by at least 90° With respect
`to the surface of the display so that the keyboard can be
`turned up to cover display 9, as shoWn in FIG. 9, for
`instance. The female connector parts 32b of keyboard 28 are
`pushed to male connector parts 32a in the direction of
`arroWs A, as shoWn in FIG. 7, When the external keyboard
`is connected to notebook computer 27. Keyboard 28 is
`automatically connected to input/output controller 5 of note
`book computer 27 and to data processing unit 2 (cf. FIG. 3).
`Digitizer pad 29 can be used advantageously instead of
`the above-described keyboard 28 in connection With note
`book computer 27, as illustrated in FIG. 8. A similar
`
`Ex. GOOG 1006
`
`

`

`US 6,427,078 B1
`
`7
`connector part 32b to that of external keyboard 28 is
`connected to digitizer pad 29, Whereby digitizer pad 29 can
`be installed directly in place of eXternal keyboard 28 in a
`corresponding manner, When external keyboard 28 is
`removed.
`Digitizer pad 29 is based on a knoWn technique. The user
`can Write teXts or draW ?gures on vieWing screen 29a in the
`digitizer pad using pen 33, and digitizer pad 29 recognises
`the touch of pen 33 simultaneously and converts the draWn
`?gure into a bitmap. The bitmap is shoWn on vieWing screen
`29a of the digitizer pad until the user accepts it. After this the
`accepted digitised image is to be displayed on display 9 of
`notebook computer 27. The functions of digitizer pad 29
`include an erase function of the draWn ?gure, Which can be
`implemented in a knoWn manner in various Ways. For
`instance, digitizer pad 29 can include a function key by
`means of Which the mode of digitizer pad 29 can be
`converted from the draWing mode into the erase mode and
`back again. In the draWing mode, ?gures can be draWn on
`vieWing screen 29a of the digitizer pad, While in the erase
`mode these ?gures can be removed in a desired Way.
`An advantage of digitizer pad 29 is that teXts or ?gures
`can be Written or draWn on it almost in the same Way as on
`a piece of paper. It is easy to edit the draWn ?gures or teXts
`into an appropriate form using the application programs
`included in notebook computer 27.
`A teXt or a ?gure Written or draWn on digitizer pad 29 of
`notebook computer 27 can be stored later as an image in
`memory unit 13 of the notebook computer or fed to the
`character/object recognition softWare for further processing.
`Hand Written teXts can be converted into ASCII teXts by the
`character recognition softWare, and graphical characters can
`be converted easily in the same Way as is done by the
`recognition softWare. The operating modes of these softWare
`are described above in connection With the camera unit.
`The bitmap images or converted ASCII texts/graphics
`transferred to the memory from digitizer pad 29 of notebook
`computer 27 can be later forWarded via telefaX or electronic
`mail services, as disclosed above in the description of the
`invention. The ?les stored in the memory of notebook
`computer 27 can also be edited by means of eXternal
`keyboard 28 and/or digitizer pad 29.
`The notebook computer according to the invention com
`prises a number of facilities and/or application programs, by
`means of Which the possibilities of the notebook computer
`can be utilised effectively Such tools include, for instance:
`electronic calendar, phone list and note pad, fully integrated
`With each other and to the communications, data collection
`and data processing functions of the notebook computer. The
`services used most frequently include functions related to
`speech communications, telefaX function, electronic mail,
`paging, data bank services and on-line information service
`connections. When transmitting electronic mail or telefaX
`messages, the user can digitise the message on the display of
`the notebook computer and to simply select the recipient
`information from the phone list. The phone list is generally
`an application Which offers an easy Way to select the address
`information of the recipient for a chosen electronic contact
`as Well as for a possible Written letter. The user can input
`address information and telephone number information of
`different people in the memory of the notebook computer by
`means of the camera unit functioning as the data collection
`device and by means of suitable utility functions related to
`the camera unit. The address ?le may include different
`additional information, such as a telephone number, telefaX
`number, e-mail address as Well as other necessary
`
`10
`
`15
`
`25
`
`35
`
`45
`
`55
`
`60
`
`m 5
`
`8
`information, In addition to the name and address. It depends
`on the application selected for the notebook computer,
`Which information the user chooses from the phone list and
`connects to the message to be transmitted.
`When cellular mobile phone unit 17 of the notebook
`computer and the related cellular mobile phone controller 8
`are implemented as a digital GSM system, the user can
`transmit SMS messages (Short Message Service). The user
`Writes the message to the notebook computer using the
`keyboard or a pen on the digitizer pad, or the message
`reading is read by the data collection device such as camera
`unit 14. After the message has been transmitted via a cellular
`mobile phone to a GSM short message centre, it is for
`Warded to the recipient. The recipient is chosen from the
`phone list or the user inputs it manually.
`An electronic mail message is implemented in the same
`Way as the SMS message above, but the electronic mail
`message may be longer.
`A device in accordance With the invention may also be a
`radiotelephone comprising a microprocessor, a display, a
`user interface, a microphone, a speaker, and a camera unit.
`It is possible to place other cards according to the PCM
`CIA standard into the PCMCIA card slot of the notebook
`computer. For instance, a hard disc, an additional memory
`and a PCMCIA radio module are viable. The PCMCIA radio
`module provides a possibility to use the notebook computer
`in all cellular mobile phone systems. In this case, only an
`appropriate radio module card is installed in the PCMCIA
`card slot.
`The notebook computer can communicate With another
`personal computer via a serial and/or parallel port or via a
`PCMCIA interface. The interface betWeen the notebook
`computer and another computer can be implemented by
`means of an infrared link or a cable connection. Infrared link
`12 can be used for communication betWeen the notebook
`computer and a PC or other peripheral devices. For instance,
`the Writing of a ?le can be implemented so that the ?le is
`transferred to The printer by means of the Infrared link and
`then printed.
`The invention is described above With reference to some
`preferred embodiments thereof, but it is obvious that the
`invention can be modi?ed in various Ways Within the
`inventive idea de?ned by the appended claims.
`What is claimed is:
`1. A device for personal communication, data collection