`
`MUK Patent Application WGB (11)2 289 555 (131A
`
`(43) Date ofA Publiution 22.11.1995
`
`
`(21) Application No 9509961.!)
`(51)
`INT c1.“
`GMF 3/001/16 , HMM 1/72 , HM1I00 , H040. 7/32
`
`
`
`
`
`(30) Priority Data
`(32) 19.05.1994
`(31)
`942334
`133)
`Fl
`
`
`
`(71) Applicant(s)
`Noltia Mobile Phones Limited
`
`(22) Dale of Filing 17.05.1995
`
`(Incorporated in Finlandl
`
`P.0. BOX 86, SF-24101 Sale, Finland
`
`(72)
`
`lnventor(s)
`KarH'elika Wilslia
`Heiio Palisnen
`Mildro Torho
`Jui Hemalainen
`
`(52) UK CL (Edition N)
`64A ADT AKS
`HAK KFH
`U18 $2125 $2127 $2196 $2210 $2215
`
`(56) Documents Cited
`EP 0525802 A2
`
`(53)
`
`Field Of Search
`UK CL (Edition N) GM ADT AKS . l-MK KPH , IML
`LECX
`iNT CL8 GOBF,H04M.H040
`OMJNE :WPI
`
`
`
`
`
`
`
`
`(74) Agent and/or Address for Service
`
`J M Potter
`
`Nelda Mobile Phones, Patent qutrnent.
`
`St Georges Court. St Georges Road. 9 Huh Street.
`CANBERLEY, Surrey, GU15 302, United Kingdom
`
`
`
`
`(54) Device for personal communications, data collection and data processing and a circuit card
`
`(57) A device for personal communication, data collection and data processing, which is a smell-sized,
`portable and hand-held work station comprising a data processing unit (2): a display (9); a user interface
`(10, 11); a number of peripheral device interfaces (12, 17); at least one memory unit (13); a power source,
`preferably a battery (3); and an application software; also comprises a camera unit (14). The camera unit (14)
`comprises a camera (143), preferably a semiconductor camera, and optics (14b) connected thereto, which are
`placed in the housing (1) of the device. Alternatively, the camera unit (14) is fitted on a PCMCIA card (15) which
`can be connected to the PCMCIA card slot (16) of the device.
`
`29
`
`11
`
`3
`
` 4
`-6
`
`DISPLAY
`‘L‘A [1.7"
`11‘
`
`10
`
`
`
`”—*7
`
`
`EXTENSMS
`
`
`
`fElLULAR
`
`-
`
`FI93 N
`
`w
`
`N
`
`CD
`(0
`
`O1
`O1
`01
`
`>
`
`
`
`Page 1 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`10-
`
`
`
`
`
`4
`
`DISPLAY
`CONTROLLER
`
`CENTRAL
`PROCESSOR
`
`6
`
`8
`
`MEMORY
`CONTROLLER
`CMT
`CONTROL
`
`7
`
` 9
`
`
`Q.
`Lu
`:i
`
`
`
`g
`L.
`
`E
`MEMORIES
`{SRAH
`9.
`RCMC/A CAMERA
`
`
`Effigy
`OR OTHER
`9
`mm
`EXTENSIONS
`
`
`
`CAMERA
`UNIT
`
`77
`
`CELLULAR
`MOBILE
`TELEPHONE
`AND MODEM
`
`
`
`Fig.3
`
`Page 2 of 21
`
`SAMSUNG EXHIBIT 1005
`
`
`
`

`

`_..__l___
`
`ccn IMAGE SEA/$0 '
`
`mmw
`
`#___
`
`wmw
`
`L
`rmms‘r
`
`I l
`
`
`
`Page 3 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`Page 4 of 21
`
`SAMSUNG EXHIBIT 1005
`
`
`
`

`

`2289555
`
`
`
`VI
`
`
`
`Fi PER
`
`
`AL O M NICATI NS DATA COLLE
`
`
`
`
`ON AND DATA
`
`
`
`
`
`PRO ESSING ANDA CIRCUIT CARD
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The object of the invention is a device according to the introductory part of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Claim 1 for personal communication, data coiiection and data processing. The
`
`
`
`
`
`
`
`
`
`
`
`device consists of a smali~sized housing comprising a data processing unit
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`which contains a data processor with peripheral circuits and memory units, a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`display, a user interface. a number of peripheral device interfaces, a power
`
`
`
`
`
`
`
`
`
`source, preferably a battery, and application software.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Another object of the invention is a circuit card according to the introduction of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Claim 8 which can be fitted to the card siot arranged in connection with a
`
`
`
`
`
`
`
`
`
`
`
`
`device intended for personal communication, data collection and processing. in
`
`
`
`particular.
`
`
`
`
`
`
`
`
`
`
`
`Personal communication devices andior mobile organisers. such as notebook
`
`
`
`
`
`
`
`
`
`
`
`computers and the like, known from before, are email,
`
`
`
`
`light—weight, portable
`
`
`
`
`
`
`
`
`
`
`
`
`
`and hand-heid or laptop workstations. A number of accessories and appiication
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`programs which offer service functions can be installed in such persona!
`
`
`
`
`
`
`
`devices, when necessary. A such notebook computer
`
`
`
`
`
`is disclosed in
`
`
`
`
`
`
`international patent application “(09314458.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer can be equipped with an electronic scanner by means
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of which both text and figures can be read into the memory of the computer.
`
`
`
`
`
`
`
`
`
`
`
`
`This helps to eliminate the drawbacks of small keyboards.
`
`
`
`in particular. Data
`
`
`
`
`
`
`
`
`
`
`
`
`
`required in many connections, such as contact information included in business
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`cards, can be read into the memory of the computer. However, electronic
`
`
`
`
`
`
`
`
`
`
`
`
`
`scanners comprise fine-mechanical parts which wear and may cause problems.
`
`
`
`
`
`
`
`
`
`
`
`Especiaily paper feeding arrangements fitted in small notebook computers are
`
`problematic.
`
`
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`cooowovcnhmw
`
`_\ O
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`
`
`
`Page 5 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 5 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The general purpose of this invention is to provide a new device for personal
`
`
`
`
`
`
`
`
`
`
`communication, data collection and processing which improves communication
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`especially between a user and the device. A special purpose of the invention is
`
`
`
`
`
`
`
`
`
`
`
`
`
`to provide a device for personal communication, data collection and processing
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`which makes it possible to collect data efficiently and to communicate with the
`
`
`
`
`environment. This
`
`
`
`
`
`
`
`
`
`is accomplished by the characteristic features of
`
`
`
`the
`
`
`
`
`
`
`
`
`invention, disclosed in appended Claims 1-7.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Another purpose of the invention is to provide a new interface card which
`
`
`
`makes
`
`
`
`
`it possible
`
`
`
`
`to improve
`
`
`
`
`the data
`
`
`
`collection
`
`
`
`
`systems
`
`of
`
`
`
`
`small
`
`microcomputers,
`
`
`
`
`
`in particular. This
`
`
`
`
`
`
`
`is accomplished by the characteristic
`
`
`
`
`
`
`
`
`
`
`features of the invention, disclosed in Claim 8.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`An advantage of the invention is that one and the same device, personal
`
`
`
`
`
`
`
`
`
`
`
`communications, data collection and processing comprises an easy—to-use data
`
`
`
`
`
`
`
`
`
`
`
`collection device, efficient data processing equipment {programs} and data
`
`
`
`
`transmission equipment.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The invention is described in the following in more detail with reference to the
`
`
`
`
`
`
`appended drawings in which:
`
`
`
`
`Figure
`
`
`
`1
`
`shows
`
`
`
`
`
`a
`
`device
`
`
`
`according
`
`
`
`
`
`to the
`
`invention
`
`
`
`for
`
`
`
`
`personal
`
`
`
`
`
`communication, data collection and processing,
`
`
`
`
`
`
`
`in which the data collection
`
`
`
`
`
`
`
`
`
`
`
`
`device is implemented by means of an integrated camera unit;
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figure 2 shows another device according to the invention for personal
`
`
`
`
`
`
`
`
`communication, data collection and processing,
`
`
`
`
`
`in which the data collection
`
`
`
`'
`
`
`
`
`
`
`
`
`
`
`
`
`device is implemented by a camera unit arranged in a PCMCIA card;
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figure 3 shows a device for personal communication, data collection and
`
`
`
`
`
`
`
`
`processing, in the form of a block diagram;
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`OCOCONCDO‘l-bmk)
`
`_\
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`
` M
`
`Page 6 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 6 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`Figure 4 shows a PCMCIA card.
`
`
`
`
`
`
`
`i.e., a PCMCIA camera card comprising a
`
`
`
`
`
`
`
`
`
`camera unit as an essential part thereof;
`
`
`
`
`
`
`
`
`
`
`
`
`Figure 5 shows a block diagram of the camera unit:
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figure 6 shows a device according to the invention. whose display illustrates an
`
`
`
`
`
`
`
`
`
`example of an application related to the camera unit;
`
`
`
`
`Figure
`
`
`
`7'
`
`shows
`
`
`
`
`
`a
`
`device
`
`
`
`according
`
`
`
`
`to the
`
`
`
`invention
`
`
`
`for
`
`
`
`personal
`
`
`
`
`
`
`
`communication, data collection and processing, comprising a
`
`
`
`replaceable
`
`
`
`
`
`keyboard;
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figure 8 shows a device according to Figure 7, comprising a digitizer pad
`
`
`
`
`
`
`
`
`instead of the keyboard; and
`
`
`
`
`
`
`
`
`
`
`
`Figure 9 shows the device of Figure 7 when closed.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figures 1 and 2 show two application examples of the device according to the
`
`
`
`
`
`
`
`
`
`
`
`
`invention for personal communication. data collection and processing. A block
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`diagram of such device is shown in general form in Figure 3. The device
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`according to the invention is called a notebook computer in the following.
`
`
`
`
`
`
`
`
`
`
`
`
`A notebook computer is a small, portable work station. The external dimensions
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of its housing 1 are preferably in the order of 170 mm x 35 mm x 30 mm
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`{length x width x heightl and the weight 1000 g at the most, preferably 800 g
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`or less. The device ls preferably arranged to operate by one or more batteries 3
`
`
`
`
`
`
`
`
`
`
`
`
`{Figure 3} which are fitted repleceably inside housing 1.
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer comprises data processing unit 2 {Figure 3} which is
`
`
`
`
`
`
`
`
`
`
`
`
`preferably arranged on one semiconductor chip. Data processing unit 2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`comprises processor 4 which is preferably a low power RISC processor. Data
`
`
`
`
`
`
`
`
`
`
`processing unit 2 further comprises inputloutput controller 5, display controller
`
`
`
`_\
`
`2
`
`3 4
`
`1 2 3 4 5 6 7 8 9
`8 9
`
`5 6
`
`7
`
`10
`10
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`
`
`
`Page 7 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 7 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`l
`
`;
`
`;
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`6, memoryI controller 7 and cetluler mobile phone controfier 8. In addition, data
`
`
`
`
`
`
`
`
`
`
`
`
`processing unit 2 comprises connection buses and cabtes between different
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`controllers and the data processor which are not separately shown in the block
`
`
`
`
`
`
`diagram of Figure 3.
`
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer further comprises display 9 which is arranged,
`
`
`in the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`application exampies of Figures 1 and 2, fixedly in connection with housing 1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`on large side 1a thereof which is essentially of a rectangular shape. Display 9 is
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`provided, for example, by a liquid crystal display, the rasoiutlon of which is at
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`least 640 x 200 pixeis2 and the dimensions in the order of 130 mm x 70 mm.
`
`
`
`
`
`
`
`
`Display 9 is connected to display controller 6.
`
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer also comprises keyboard 10 andlor mouseltrack ball 11
`
`
`
`
`
`
`
`
`
`
`
`
`as a user interface. Keyboard 10 and track hall 11
`
`
`
`
`
`
`in this application are
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`arranged fixedly to the notebook computer in the vicinity of display 9. The
`
`
`
`
`
`
`
`
`
`
`
`
`notebook computer preferabiv comprises infrared link 12 by means of which the
`
`
`
`
`
`
`
`
`
`
`
`
`
`connection with peripheral devices, such as a printer, another microcomputer or
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the like, is provided. Keyboard 10, mouseftrack ball 11 and infrared link 12 are
`
`
`
`
`
`
`
`
`
`
`
`connected to ioputi’output controller 5, as shown in Figure 3.
`
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer further comprises one or more memory units 13. The
`
`
`
`
`
`
`
`
`
`
`
`
`
`memory unit can be impiemented by means of SRAM, EEPROM andror FLASH
`
`
`
`
`
`
`
`
`
`
`
`
`memoryr circuits, for instance. The operating system and preferably at least part
`
`
`
`
`
`
`
`
`
`
`
`
`of the application programs are recorded in memory unit 13.
`
`
`
`
`In addition,
`
`
`
`
`
`
`
`
`
`
`
`
`
`memory unit 13 contains a sufficient amount of reed-write memory space.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The netebook computer further comprises a data collection device which is
`
`
`
`
`
`
`
`
`
`
`
`implemented by means of a camera unit. The embodiment of Figure
`
`
`
`1
`
`
`
`
`
`
`
`
`represents camera unit 14 (Figure 3,1
`
`
`
`
`
`
`
`
`
`fitted in housing 1 of the notebook
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`computer as a stationary part thereof. in this application, camera 14a of camera
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`unit 14 and related optics 14h are arranged on the same side of the housing as
`
`
`
`
`display 9,
`
`
`
`
`
`
`
`
`
`
`
`
`
`though a different disposition is also possible. Camera unit 14 is
`
`
`
`;
`
`r
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`COCONCDO‘l-bmk)
`
`_\ 0
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`2O
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`32
`32
`
`Page 8 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 8 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`connected via inputi'output controiier 5 to data processing unit 2 {Figure 3}.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Camera unit 14, which is represented in the form of a block diagram in Figure
`
`
`
`
`
`
`
`
`
`
`
`
`5, consists of camera arrangement 140 which comprises camera 14a provided
`
`
`
`
`
`
`
`
`
`
`
`
`with suitable optics 14b, and image processing unit 140 connected to the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`camera arrangement. This data collection unit can be used to transfer data
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`presented on paper or the like as well as an image taken of the surroundings,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`for instance of a person. to the notebook computer to be processed further.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`In the notebook computer application of Figure 2 camera unit 14 is fitted in a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`circuit card. preferably in PCMCIA card 15. Camera 14a and optics 14b of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`camera arrangement 140 are integrated in this card 15 together with their
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`peripheral electronics, i.e.. the image processing unit 14c {Figure 5). The circuit
`
`
`
`card,
`
`
`
`
`
`
`i.e., camera card 15,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`in turn, can be fitted into the card slot, such as
`
`
`
`
`
`
`
`
`
`
`
`
`
`PCMCIA card slot 16, of the mobile organiser. Camera 14a of the embodiment
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of both Figure 1 and Figure 2 is implemented as a semiconductor camera,
`
`
`
`
`
`
`
`
`
`
`
`
`preferably as a small CCD {Charge Coupled Device) camera. The adapter in
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`PCMCIA card slot 16 is connected to inputfoutput controller 5. as illustrated in
`
`
`
`
`Figure 3.
`
`
`
`it
`
`
`
`
`
`
`
`
`
`
`is obvious that other corresponding, applicable PCMCIA cards.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`which meet the standards drawn up for card slots, can also be fitted into this
`card siot 36.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The notebook computer further comprises a radiotelephone, i.e., cellular mobile
`
`
`
`
`
`
`
`
`
`
`phone unit 17, preferably as an integrated part
`
`
`
`thereof.
`
`
`
`
`
`it
`
`
`
`is connected to
`
`
`
`
`
`celluiar mobile phone
`
`
`
`
`
`
`
`
`controller 8 of data processing unit
`
`
`
`
`
`2 and to
`
`
`
`
`
`receiverltransmit‘ter antenna 18.
`
`
`
`
`
`
`
`
`
`
`
`
`In the case of a telephone set operating in an
`
`
`
`
`
`
`
`
`
`
`
`
`
`analogue cellular network, a modem is preferably connected to cellular mobile
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`phone unit 17. Cellular mobile phone unit 17 is based on the standard cellular
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`mobile phone technology. Both data and speech can be transmitted via
`
`
`
`
`
`
`
`
`
`
`
`integrated cellular mobile phone unit 17. The data transmission properties are
`
`
`
`
`
`
`
`
`
`
`
`
`based on an analogue modem and the GSM data interface,
`
`
`
`
`
`for instance, the
`
`
`
`
`
`
`
`
`
`
`
`
`
`technology of both of them being conventional. For a speech connection,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`miniature speaker 19 and microphone 20 can be arranged in the housing of
`
`
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`COCONCDO‘i-bmk)
`
`_\ O
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`32
`32
`
`
`
`Page 9 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 9 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`notebook computer 1 on both sides of display 9. The notebook computer can
`
`
`
`
`
`
`
`
`
`
`
`
`
`then be used in the same way as a conventional handheld telephone.
`
`
`
`
`
`
`
`
`
`
`
`
`An additional part of the notebook computer is software applied for it.
`
`
`
`It
`
`
`
`is
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`recorded in memory unit 13. Using the software, the user controls different
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`functions of the mobile organiser as required. The functions related to the
`
`
`
`
`
`
`
`
`
`
`
`
`notebook computer include, for instance: telephone services which are based
`
`
`
`
`
`
`
`
`
`
`
`
`on the cellular mobile phone {data transmission andror speech transmission
`
`
`
`
`
`
`
`
`
`
`
`properties}, facsimile services, electronic mail, short message servicer'SMS, a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`calendar and scheduler software, a clock with alarm clock functions, camera
`
`
`
`
`
`
`
`
`
`
`
`
`
`functions to record images and paper documents, as well as computer, i.e., PC
`
`
`
`
`
`
`
`
`
`
`interface functions for transferring information to PC applications.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Camera unit 14 operating as the data collection device is considered more
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`closely in the following. Camera 14a and optics 14b connected thereto are
`
`
`
`
`
`
`
`
`
`
`
`
`
`fitted to PCMCIA card 15 in the camera unit. The Personal Computer Memory
`
`
`
`
`
`Card International Association,
`
`
`
`i.e.,
`
`
`
`
`
`
`
`
`
`the PCMCIA was formed in order to
`
`
`
`
`
`
`
`
`
`
`
`
`
`advance the exchangeahility of integrated circuit cards in computers and other
`
`
`
`
`
`electronic devices. Consequently,
`
`
`
`
`
`
`
`
`
`the PCMCIA cards are standardised cards
`
`
`
`
`
`
`
`
`
`
`
`
`which are applicable for both memory cards and expansion cards of peripheral
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`circuits, i.e., for inputioutput cards. Camera card 15 described herein is based
`
`
`
`
`
`
`
`
`
`
`
`
`
`on the standard mentioned above in which camera arrangement 140 and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`peripheral circuits required by it are integrated in the standard card. Figure 4
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`shows a physical model of a possible PCMCIA card 15 in which camera unit 14
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`is fitted in the thickened part 15a of the card. Camera 143, such as a CCD
`
`
`
`
`
`
`{Charged Coupled Device} camera,
`
`
`
`
`
`
`
`
`
`
`
`is preferably a camera focused on a fixed
`
`a-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`distance and it is preferably fitted to the centre part of the enlargement 15a of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the card. Camera 143 with its optics 14b is arranged so that the image field
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`14d of the camera opens up perpendicular to the surface of card 15. Adapters
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`15b are arranged at the other end of card 15 to connect the card to the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`PCMCIA card slot 16 in the notebook computer and to the counter connectors
`
`
`
`in the card slot.
`
`
`
`
`
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`COCONCDO‘l-bmk)
`
`_\ 0
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`32
`32
`
`
`
`Page 10 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 10 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`in principie. the structure of both camera card 15 and camera unit 14 conforms
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`to the block diagram shown in Figure 5. Camera card 15 consists of camera
`
`
`
`
`
`
`
`
`arrangement 140 which comprises camera 14a
`
`
`
`
`
`and optics 14b.
`
`
`
`
`image
`
`
`
`
`
`
`
`
`
`
`
`
`
`processing unit 14c, battery 21 and interface 22 to external systems which in
`
`
`
`
`
`
`
`
`
`
`
`
`
`this case is a standard PCMCIA interface concerning camera card 15.
`
`
`
`Image
`
`
`
`
`
`
`
`
`
`
`
`
`
`processing unit 14:: comprises microprocessor 23 and a number of memory
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`units 24. Optics 14b are provided by a suitable lens arrangement, by means of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`which a sharp image is obtained of the object to be scanned in on the image
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`plane of camera 14a. Camera 14a is preferably implemented as a CCD camera
`
`
`
`comprising a two-dimensional
`
`
`
`
`
`fight-sensitive CCD sensor,
`
`
`
`
`
`the resoiution of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`which is from 250 k pixel as high as to 26.2 Mpixel. Memory units 24
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`preferabiy comprise two kinds of memory units: volatile memory units. such as
`
`
`
`
`
`
`
`
`
`
`
`
`DRAM and SRAM units used as scratch pad storages, and non-volatile memory
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`units. such as FLASH and EPROM units which are used as base program
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`memories. Power to the PCMCIA card is supplied via the PCMCiA interface
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`from the notebook computer. Battery 21 is mainly used to ensure that images
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`are maintained in the volatile memory units if the PCMCIA card is detached
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`from the card siot. Battery 21 can be also used for the same purpose in camera
`
`
`
`
`
`
`
`
`
`unit 14 (Figure 1} integrated in the notebook computer.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Camera unit 14 functions in the foiiowing way. whether it is fixediy integrated
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`to the notebook computer or connectable to the card siot of the notebook
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`computer as camera card 15: a picture of a document or three-dimensions!
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`environment taken by camera 14a thrOugh optics 14b is transferred to image
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`processing unit 140 and throngh its microprocessor 23 to memory unit 24.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`such as HAM. When the user wishes to View the picture thus taken on display
`
`
`
`
`
`
`
`
`
`
`
`9 of the notebook computer. hershe can do that
`
`
`
`
`
`
`immediately. The desired
`
`
`
`
`
`
`
`
`
`
`
`
`
`image information is read from memory unit 24 by means of microprocessor 23
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of camera card 15. and the image information is transmitted to processor 4 of
`
`
`
`
`
`
`
`
`
`
`
`
`
`the mobile organiser along PCMClA interface 22 or a corresponding interface
`
`
`
`
`
`
`
`
`
`
`
`and further to dispiay 9 Via dispiay controller 6.
`
`
`
`
`
`
`Image processing unit Me
`
`
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`cooowovcnhmw
`
`_\ 0
`10
`
`11
`11
`12
`12
`13
`13
`
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`_25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`
`
`
`Page 11 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 11 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`
`
`processes the image Information into a suitable term to be presented to the
`
`
`
`
`
`
`
`user by the mobile organiser.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The image information recorded in camera card 15 can be scanned in either by
`
`
`
`
`
`
`
`
`
`
`
`the mobiie organiser or by another computer andlor device provided with a
`
`
`
`
`
`F
`
`
`
`
`
`PCMCIA interface or the like.
`
`
`
`It
`
`
`
`
`
`
`
`
`
`
`
`is possible to edit the picture by an external
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`computer and the modified picture can be recorded again in memory unit 24 of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`camera card 15. By virtue of battery 21, the operation of microprocessor 23 of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`image processing unit 14c and that of memory unit 24 is assured in all
`
`circumstances.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Camera unit 14 comprises a character recognition software which is similar to
`
`
`
`
`
`
`
`
`
`
`
`
`
`that used in computers provided with pen interfaces, for instance. Previously
`
`
`
`
`
`
`
`
`
`
`
`
`
`known pattern recognition software can be used to recognise graphical objects.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`After a text andior an image has been scanned in the notebook computer, the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`user can start an application program to process the data to suit hislher
`
`
`
`purposes.
`
`
`
`
`
`
`
`
`
`
`
`The application program of camera unit 14 functions, e.g.,
`
`
`
`
`
`in the foliowinp
`
`
`
`
`
`
`
`
`
`
`way: business card handler application 36 (Figure Si
`
`
`
`
`
`is selected for
`
`
`
`the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`application program. The user first scans in the business card by camera 14a,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`then the picture of the business card and the information contained in it are
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`transferred from camera unit 14 to memory unit 13 of the notebook computer
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`and via data processing unit 2 to display 9. After the scanned image 34 of the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`business card is visible on display 9, the user opens business card handler
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`application 35 and key fields 35 of this application appear on display 9. as
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`illustrated in Figure 6. Key fields 35 have been recorded in the database. The
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`user selects a suitable field 343 from the business card and drops it to the
`
`
`
`'
`
`
`
`
`
`
`
`
`
`
`
`
`
`correct key field 35a of the business card handler application. The selection and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`dropping are made by means of the mouse or track ball 11. The fields required
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`are selected from picture 34 of the business card and dropped to corresponding
`
`
`
`
`
`
`
`
`
`
`
`
`
`fields 35 of business card handler application 36. After the above-described
`
`
`
`_\
`
`2
`
`3 4
`
`5
`
`6
`
`1 2 3 4 5 6 7 8 9
`
`7
`
`8
`
`9
`
`10
`10
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`32
`32
`
`
`
`Page 12 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 12 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`
`
`
`
`
`
`procedures have been carried out.
`
`
`
`
`
`
`
`
`the information contained in the business
`
`
`
`
`
`
`
`
`
`
`card can be used as address directory for
`
`
`
`
`
`
`letters, as telephone memo
`
`
`
`
`
`
`
`
`information or for other suitable purposes.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Other kinds of information can also be scanned in the notebook computer by
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`means of camera unit 14. The document can be a note written on a paper by
`
`
`
`
`
`
`
`
`
`
`
`
`
`hand. for instance. The user scans in the document. stores it
`
`
`
`
`
`in the memory
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`unit of the notebook computer and processes it as required. A graphics handler
`
`
`
`
`
`
`
`
`
`
`
`
`software can be arranged to function with camera unit 14.
`
`
`
`
`
`
`It can function in
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the following manner: the user draws a graphical obiect. such as a circle or a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`tine, on a paper. The images are scanned in by camera 14a to memory unit 13
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of the notebook computer and the user starts the graphics handler software
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`using the keyboard or the mouse. The scanned picture of the graphical object is
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`then shown on the display. The user can seiect a picture on the display and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`modify the object by means of the graphics handler appiication to look like a
`
`
`
`
`
`
`
`
`
`desired object, such as a regular circle.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The user can also select the character recognition software after the picture on
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the paper is scanned in the notebook computer by camera unit 14. The
`
`
`
`character
`
`
`
`
`
`
`
`
`
`recognition software converts the hand written text
`
`
`
`
`into ASCII
`
`
`
`characters.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`indistinct characters are guessed by the software or the user is
`
`asked for further information.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The simplest alternative is to store the information scanned in memory unit 13
`
`
`
`
`
`
`
`
`
`
`of the mobile organiser by camera unit 14,
`
`
`
`
`
`
`
`
`
`
`
`in the form of a bitmap. This type of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`image information is used in facsimiieitelefax transmission. The same kind of
`
`
`
`
`
`
`
`
`
`
`
`
`image storing can also be used for storing incoming telefax messages.
`
`
`
`
`
`
`
`
`
`
`
`
`
`The telefax functions can be implemented in the following way: the user writes
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`notes on a paper and the characters on the paper are scanned in memory unit
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`13 of the notebook computer by camera unit 14. The user seiects the telefax
`
`
`
`
`
`
`
`
`
`
`application from the application programs and defines a
`
`
`
`
`receiver
`
`for
`
`
`
`the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`message. Next the picture of the notes is transmitted as a bitmap and a teiefax
`
`
`
`_\
`
`1 2 3 4 5 6 7 8 9
`
`OCOCONCDO‘l-bmk)
`
`_\
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`
`25
`25
`26
`‘26
`27
`27
`28
`28
`29
`29
`30
`30
`31
`31
`32
`32
`
`
`
`Page 13 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 13 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`1O
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`message from the mobile organiser’s memory unit via celiuiar mobiie phone unit
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`incoming telefax messages are received in a
`1'? comprising a telefax modem.
`corresponding manner via cellular mobile phone 17 and stored in the mobile
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`organiser’s memory as bitmaps. After the picture is ready,
`
`
`
`it
`
`
`
`is output on
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`display 9 of the mobile organiser by means of the teiefax program. Ali the
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`images stored in the mobile organiser’s memory can be viewed on the dispiay
`
`
`
`
`
`
`
`
`
`
`
`using an operating program which applies the said bitmap.
`
`
`
`‘
`
`s
`
`
`
`
`
`
`
`
`
`
`
`
`
`When a user interface based on camera unit 14 is integrated in economies with
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the notebook computer and especialiy its housing 1, obvious advantages are
`
`
`
`
`
`
`
`
`
`
`
`
`accomplished. With such camera unit 14 the user can scan different written
`
`
`
`
`
`
`
`
`
`
`
`
`
`andlor drawn information into the memory of the notebook computer quickly
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`and easily. The use of camera unit 14 is faster and easier than writing with a
`
`
`
`
`
`
`
`
`
`
`
`
`
`pen, for instance. information on business cards, as already mentioned, printed
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`material and hand written notes, etc., can be scanned into the memory of the
`
`
`
`
`
`
`
`
`
`notebook computer by using camera unit 14.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figures 7 and 8 show a notebook computer 2? according to the invention,
`
`
`
`
`
`in
`
`
`
`
`
`
`
`
`
`
`
`
`
`which keyboard 28 for writing texts and digitizer pad 23 can be installed
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`replaceably. Figure 9 shows the notebook computer according to Figures 7 and
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`8 in which keyboardidigitizsr pad 30 is turned against the display of the
`
`
`
`
`
`
`
`
`
`notebook computer and locked in its piece.
`
`
`
`
`
`
`in this way it
`
`
`
`
`
`
`is easy to carry
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`notebook computer 2‘? along and to even put it in the pocket. Aiternativeiy, the
`
`
`
`
`
`
`
`
`
`
`
`notebook computer can be carried by wrist strap 31.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Notebook computer 27 comprises essentiaiiy the same parts and units as
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`shown above in the embodiments according to Figures 1 or 2. Consequently,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`the parts of notebook computer 27 which are visibie externaliy include housing
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1, display 9, keyboard 10, miniature speaker 19 and microphone 20 as wet! as
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`antenna 18 (of. Figures 1 and 2 and the block diagram in Figure 31.
`
`1 2 3 4 5 6 7 8 9
`8 9
`
`1
`
`2
`3
`
`4
`
`5
`
`6
`
`7
`
`10
`10
`
`11
`11
`12
`12
`13
`13
`14
`14
`15
`15
`16
`16
`17
`17
`18
`18
`19
`19
`20
`20
`21
`21
`22
`22
`23
`23
`24
`24
`25
`25
`26
`26
`27
`27
`28
`28
`29
`29
`30
`30
`
`w
`
`Page 14 of 21
`
`SAMSUNG EXHIBIT 1005
`
`Page 14 of 21
`
`SAMSUNG EXHIBIT 1005
`
`

`

`11
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`The external keyboard 28 of notebook computer 27 is used for writing.
`
`
`
`
`in spite
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`of the small sizer keyboard 28 comprises all the necessary characters, such as
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`letters, numbers and a number of function keys. An advantage of such normal.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`external keyboard 28 is that the user is familiar with the keyboard itself and
`
`
`
`
`hershc can use it
`
`
`
`
`
`
`
`
`
`
`
`
`
`in a conventional way for writing and feeding texts to the
`
`
`
`
`notebook computer.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`External keyboard 28 is connected to notebook computer 27 by means of
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`connector 32. in the case of thures 7 and 8. the male