US006144848A
`6,144,848
`[11] Patent Number:
`[19]
`United States Patent
`
`Walsh et al.
`[45] Date of Patent:
`Nov. 7, 2000
`
`[54] HANDHELD REMOTE COMPUTER
`CONTROL AND METHODS FOR SECURED
`INTERACTIVE REAL-TIME
`TELECOMMUNICATIONS
`
`[75]
`
`Inventors: Joseph F. Walsh, Lynnwood, Wash.;
`David H. Boydston, Goleta, Calif.
`:
`,
`.
`.
`[73] Assignee: Weiss Jensen Ellis & Howard,Seattle,
`9
`.
`[21] Appl. No.: 08/657,892
`[22]
`Filed:
`Jun. 7, 1996
`
`Related U.S. Application Data
`. i,
`.
`[63] Continuation-in-part of application No. 08/482,261, Jun. 7,
`1995, abandoned, and a continuation-in-part of application
`No. 08/485,083, Jun. 7, 1995, abandoned, and a continua-
`tion-in-part of application No. 08/480,614, Jun. 7, 1995,Pat.
`No.5,696,824.
`sa 1k ©]A H04Q 7/20; HO4M 11/00;
`HO4M 11/06; HO4L 9/00
`[52] U.S. Che caacccsecsseusecee 455/419; 455/403; 455/414;
`455/418; 455/422, 235/379; 235/380; 235/472;
`340/825.35; 379/102.01; 379/106.01; 380/255;
`380/257; 380/270; 380/287; 705/50; 705/64;
`705/73; 713/150; 713/153; 713/189
`[58] Field of Search oo...ese 235/375, 379,
`235/380, 462, 472; 340/825.29, 825.34,
`825.35, 825.44, 825.31; 380/9, 23, 24,
`25, 49, 50, 54, 59, 247, 255, 257, 270.
`271, 277, 278, 287; 359/142, 143, 144,
`145, 146, 147, 148; 379/102.01, 102.06,
`106.01, 106.09, 106.11; 455/403, 410, 411,
`414, 418, 419, 420, 422; 705/50, 64, 73;
`713/150, 151, 153, 182, 189, 200, 201
`References Cited
`U.S. PATENT DOCUMENTS
`
`[56]
`
`5/1985 Kodron .
`4,516,016
`2/1986 Sandstedt.
`4,569,421
`1/1989 Stein.
`4,797,920
`8/1989 Gombrichetal. .
`4,857,716
`8/1990 Gorog .
`4,947,028
`4,961,220 10/1990 Tenller etal. .
`4.978.305
`12/1990 Kraft .
`4,988,849
`1/1991 Sasaki et al.
`.
`5,109,222
`4/1992 Welty oo.cee 359/142 X
`5,204,768
`4/1993 Tsakiris et al.
`secccccsssscsesesnee 359/148
`5,221,838
`6/1993 Gutmanetal. .
`5,324,922
`6/1994 Roberts .
`5,340,966
`8/1994 Morimoto .
`........... 379/102.01 X
`5,347,646
`9/1994 Hirosawa et al.
`5,365,050 11/1994 Worthington etal. .
`5,365,577
`11/1994 Davis et al.
`.
`5,465,291
`11/1995 Barrusetal. .
`:
`5,483,052
`1/1996 Smith etal. .
`
`FOREIGN PATENT DOCUMENTS
`
`PCT/US92/
`03049
`
`10/1992 WIPO.
`
`.
`.
`Primary Examiner—Bernarr E. Gregory
`Attorney, Agent, or Firm—Weiss Jensen Ellis & Howard
`
`ABSTRACT
`[57]
`thod
`icati
`bi-directional
`An interactive
`tel
`bi-directional
`interactive
`telecommunication metho
`using a handheld low power user device to access a host
`computer server along a telecommunication path, and to
`command the host computer server to transmit audio and/or
`visual reports to the user device. Asystem for host computer
`ordering of consumer products and services using the tele-
`communications method and handheld low power uscr
`device.
`
`4,471,218
`
`9/1984 Culp.
`
`77 Claims, 16 Drawing Sheets
`
`HOST SERVER £10
`
`
`ORDER PROCESSING ELEMENT /2!
`
`SOUND PROCESSING ELEMENT
`
`SYNTHESIZER
`MODEM
`AN
`
`
`
` TELEPHONE
`
`
`
`
`
`
` TRANSCEIVERFP-—-4.25-
`
`
`
`
`NETWORK
`\hesr 120- Vai
`
`SPEAKER
`
`AMPLIFIER
`
`
`AND MIXER
`
`124\
`129
`"| TONE
`WICROPHONE
`cae
`
` £
`
`
`426
`128:
`DISPLAY
`PROTECTED
`MEMORY
`
`MICRO-COMPUTER:
`<EY PAD
`
`|
`422
`127
`BAR CODE CIRCUITS
`
`
`1
`
`SAMSUNG 1076
`SAMSUNG 1076
`SAMSUNG v. SMART MOBILE
`SAMSUNG v. SMART MOBILE
`IPR2022-01004
`IPR2022-01004
`
`1
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 1 of 16
`
`6,144,848
`
` HOST SERVER 170
`ORDER PROCESSING ELEMENT_/71
`
`
`SOUND PROCESSING ELEMENT
`12
`
`MODEM
`US
`
`
`
`
`
`SYNTHESIZER
`
`14
`
`
`132 —
`
`
`
`/ L
`
`e
`AMPLIFIER
`AND MIXER
`
`125
`
`120
`
`2
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 2 of 16
`
`6,144,848
`
`104
`
`102
`
`| 121
`
`120
`
`122
`
`KEYPAD
`
` BAR CODE CIRCUITS
`
`PROTECTED
`MEMORY
`
`DISPLAY
`
`12
`
`6
`
`123
`
`TRANSCEIVER
`TONE
`GEN.
`
`MICROPHONE
`
`AMPLIFIER
`AND MIXER
`
`| TELEPHONE LINE
`
`3
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 3 of 16
`
`6,144,848
`
`SOUND PROCESSOR SYSTEM
`
`COMPUTER PROCESSING UNIT
`
`INTERFACE TO CENTRAL
`COMPUTER SYSTEM
`
`MASS MEMORY STORAGE
`
`CD-ROM, HARD DISK, MAG. TAPE
`
`SOUND SYNTHESIZERS
`CALLER 1D
`SOUND RECOGNITION DEVICE
`FACSIMILE
`MODEM
`CONNECTION TO TELEPHONE LINES
`
`POWER SUPPLY
`
`200
`
`201
`
`202
`
`203
`
`205
`
`112_/
`
`
`207
`
`208
`
`TELEPHONE LINES
`
`
`
`
`
` 204
`
` 209
`
`
`
`UN-INTERRUPTIBLE
`POWER SUPPLY
`AC POWER
`
`206
`Fi2. 2
`
`
`
`4
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 4 of 16
`
`6,144,848
`
` Fig. 4
`
`5
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 5 of 16
`
`6,144,848
`
`WIRELESS
`TRANSCEIVER
`
`606
`
`TO PHONE LINES
`
`10 POWER
`
`Fig. 6
`
`6
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 6 of 16
`
`6,144,848
`
`i UMN
`mi
`UM
`
`Lo]
`
`TL
`[6]
`oT LD
`[9]
`
`init i i
`
`vm
`TL
`
`Tl we wi wm
`
`
`
`[MORE| LESS ENTER
`
`
`
`7
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 7 of 16
`
`6,144,848
`
`AIRLINE TICKET
`
`
`
`DATE TIME—CARRIER» ~—Ss*FFLIGHT=GATE.— FARE
`
`
`
`
`
`601
`
`OAR
`
`Wand for Up To Date Information
`
`
`
`
`
`
`
`
`
`
`eS
`
`
`|
`|
`|
`|
`|
`|
`SPACE
`805
`
`
`||AVAILABLE i | |
`
`
`|
`|
`|
`
`|DIRECTIONS
`|
`|
`|
`||TO AIRPORT
`|
`|
`|
`|
`|
`| RENTAL CAR
`|
`|
`|
`|INFORMATION
`|
`
`|
`|
`|
`|
`||SAY_ IT AGAIN /
`||START OVER 1 | |
`
`
`
`
`_-—— —
`LJ
`
`
`
`Flight Informatio
`n Card
`800
`cesenamsen |
`_—————=1
`|
`|
`|
`||FLIGHT
`|
`|INFORMATION
`|
`|
`|
`|
`|
`|
`|
`
`z m><aa
`
`| |
`
`802
`
`| TM
`
`804
`
`| l | | l | |
`
`Fig. 6
`
`8
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 8 of 16
`
`6,144,848
`
`||
`
`900
`
`901
`
`|
`Name and Address of Service Provider
`To: Customer's Name
`Account Representative |
`Business Name
`Telephone Number
`Address
`Facsimile Number
`Date:
`.
`
`L—-—— J bow eee J
`
`|
`|
`|
`
`Thank You for Your Order
`QUANTITY] PRODUCT DESCRIPTION|UNIT PRICE AMOUNT
`
`
`
`| |
`
`SUB-TOTAL
`DISCOUNT
`SHIPPING
`TAX
`TOTAL >
`
`| | ||
`
`| |
`
`-—-Tr
`|
`
`| ||
`
`Your Approval Required M i Required wy
`rINVOICE NUMBER:;
`1234567890
`|
`coePMMM | AAT ”
`
`
`
`[Wand To Approve Order!|Wond To Edit Order |
`
`Fig. 9
`
`9
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 9 of 16
`
`6,144,848
`
`Name and Address of Service Provider
`
`To: Customer's Name
`Business Name
`Address
`
`Account Representative
`Telephone Number
`Facsimile Number
`
`Thank You for Your Order
`
`SUB-TOTAL
`DISCOUNT
`SHIPPING
`
`|JenfrrrSs
`
`Lo -_
`"onde Approved By|
`INVOICE NUMBER: |
`
`
`| approver's Name! |_1234567800 |
`few) |
`
`| Date: of approval
`
`|
`
`Fie. 10
`
`10
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 10 of 16
`
`6,144,848
`
`
`
`___SOUNDWAND _VOICE_PROCESSOR(VE)_
`
`
`
`1147
`
`(116
`
`(119
`
`1110
`
`WAND WAKE UP
`
`WAIT FORANY WAND
`
`1124
`
`yin
`
`1112
`
`CONNECT VP
`
`COMMUNICATION
`
`CONNECT WAND
`
`
`ENABLE SCANNING
`
`
`
`
`
`
`
`Fig. 11
`
`11
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 11 of 16
`
`6,144,848
`
`WAND CONNECT TO
`VOICE PROCESSOR (VP)
`
`VOICE PROCESSOR (VP)
`CONNECT T0 WAND
`
`CONNECTION MONITOR
`
`INITIALIZE VP
`CONNECTION MONITOR
`
`1219
`
`CALL VP
`
`COMMUNICATION]
`
`ANSWER CALL
`
`1220
`VALIDATE/LOG CALLER-ID
`IF AVAILABLE
`
`WAIT FOR WAND
`CONNECT PROMPT
`
`1124
`
`
`(eonncrTEN)
`
`1221
`
`SEND WAND CONNECT
`PROMPT
`
`SEND WAND NUMBER
`0 VP
`
`1124
`K [COMMUNICATION]
`
`WAIT FOR WAND
`NUMBER
`
`1222
`
`1225
`
`1224
`
`
`1218
` INITIALIZE WAND
`
`
`
`
`
`
`
`
`
`CREATE WAND NUMBER
`
`
`
`
`
`
`
`
`YES
`1124
`
`
`WAND CONNECT
`——K [COMMINCATION YeNSHAKE
`
`
`
` 1227
`
`
`
`VP CONNECT
`PGOuNECT
`
`UP DATA SEQUENCE
`NUMBER
`
`VALID WAND NUMBER
`
`NO
`
`LOG FAILURE
`
`1226
`
`1225
`ABORT CONNECTION
`
`MODIFY SECURITY
`NUMBER
`
`1228
`
`PLAY INTERACT SESSION
`BEGIN MESSAGE
`
`12
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 12 of 16
`
`6,144,848
`
`WAND SCANNING
`
`
`INITIALIZE
`NO ACTIVITY TIMER
`
`
`MESSAGE ACCEPTANCE
`
`
`
`
`
`RECEIVE MESSAGE
`OR COMMAND
`
`1319
`
`PLAY MESSAGE
`
`END COMMAND?
`
`
`
`
`PROCESS
`MESSAGE/COMMAND
`
`1320
`
`
`1322
`
`INTERRUPT
`
`NO ACTIVITY TIME OUT
`YES
`
`CALLER HUNG UP
`OTHER MONITOR FUNCTION
`
`1323
`
`
`
`PLAY INTERACT SESSION
`END MESSAGE
`
`13
`
`13
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 13 of 16
`
`6,144,848
`
`1319
`
`PLAY ITEM MESSAGE
`
`PLAY ITEM NOT CARRIED
`MESSAGE
`
`14
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 14 of 16
`
`6,144,848
`
`YES
`
`1513
`
`1514
`
`1515
`
`MVODEN
`
`SEND PROTOCOL
`
`ID TONE
`
`SEND MODEM PACKET
`
`
`
`
`1510
`NO
`
`
`
`SUFFICIENT
`POWER
`AVAILABLE?
`
`1511
`
`POWER
`TIMEOUT?
`
`
`
`
`YES
`
`4512
`
`REPORT
`CONDITION
`
`1516
`a YES
`
`
`
`
`VALID SERVER
`RESPONSE?
`
`MORE
`PACKETS?
`
`REPORT ERROR
`
`YES
`
`4578
`
`PROCESS
`Roc
`
`1520
`
`SLEEP MODEM
`
`Fig. 15
`
`15
`
`15
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 15 of 16
`
`6,144,848
`
`PROTOCOL
`
`STOP AUDIO
`
`AUDIO
`IN PROGRESS?
`
`SET MODEM
`
`GET MODEM
`PACKET
`
`1614
`
`1615
`
`ID TONE?
`
` 1611
`
`PROTOCOL
`
`
`
`
`
`1612
`
`1616
`
`1619
`
`NO
`
`YES.
`
`MORE
`PACKETS?
`
`1621
`
`PROCESS PACKET
`
`VALID WAND
`PACKET
`
`ERROR ACTION
`
`SEND MODEM
`PACKET (REPLY)
`
`Y ES
`
`SET RETRY FLAG
`FOR REPLY PACKET
`
`
`1618
`
`
`
`SET OK FLAG FOR
`
`.Fig. 16
`
`16
`
`

`

`U.S. Patent
`
`Nov.7, 2000
`
`Sheet 16 of 16
`
`6,144,848
`
`1714
`
`CTTT
`
`1722
`
`g
`
`1725
`
`+ VOLTS
`
`GROUND
`
`ROXIMITYLEDENABLE
`
`LEDS PROXIMITY
`ENABLETARGET
`
`
`
`NABLELIGHTARRAY
`DETECT
`
`Qu]
`
`tat
`
`RESISTORS
`
`
`
`LL
`
`
`711
`
`Y
`ros
`|
`|
`|
`|
`148 |
`yt—ES
`
`|
`
`‘
`1710
`
`1730
`
`S|
`o.5|
`qo)
`fizcl
`a}ai=)7)
`Sj a}?
`
`5
`Ss
`=<
`=
`°
`
`Fig. 17
`
`17
`
`17
`
`

`

`6,144,848
`
`1
`HANDHELD REMOTE COMPUTER
`CONTROL AND METHODS FOR SECURED
`INTERACTIVE REAL-TIME
`TELECOMMUNICATIONS
`
`This application is a continuation-in-part application of
`US. application Ser. Nos. 08/482,261, now abandoned,
`08/485,083, now abandoned, and 08/480,614, now US. Pat.
`No. 5,696,824, all three applications filed on Jun. 7, 1995
`and all three applications incorporated herein by reference.
`FIELD OF THE INVENTION
`The invention relates to a handheld remote control wand
`
`having bar code, sound,voice and visual telecommunication
`systems for controlling a host computer server.
`BACKGROUND OF THE INVENTION
`
`10
`
`15
`
`2
`Gorog, and assigned to Arbor-International, Inc. (Gorog),
`shows a limited automated order and payment system. An
`order is entered at an “Order Computer Terminal” using a
`keyboard and/or a bar code reader to communicate with a
`central computer system where credit informationis verified
`and instructions are sent back to the order entry terminal to
`print or display an orderverification for the user. While this
`system generally achieves a purposeof orderentry, it suffers
`from beinglittle more than a re-packaged personal computer
`(PC). Attendant disadvantages of the system are numerous,
`foremost being expense and lack of portability. Disclosed
`systems in Gorog also do not include methodsto allow rapid
`presentation of voice information to a customer
`interactively, or in real-time, or using a handheld portable
`unil to accomplish the methods disclosed. (In the latter case,
`the system does not have a voice/data modem, nor low
`powercircuitry or power management, nor a communica-
`tions protocol to achieve voice and data on ordinary tele-
`phone lines while managing power usage.)
`USS. Pat. No. 5,221,838, “Electronic Wallet’, issued Jun.
`22, 1993, in the name of Jose Gutmanetal. and assigned to
`Motorola, Inc., discloses an “electronic wallet” for storing a
`bank balance and for receiving a radio message to update the
`balance. The system apparently updates the balance in
`memory in responseto data entered by the user. Included are
`a user terminal with keyboard, magnetic card reader, bar
`code reader, display screen and printer. However, the system
`is really little more than a re-packaged PC, drawing power
`from a 110 V wall outlet (or from large bulky batteries),
`without ease of portability, and without capability for mul-
`timedia real-time interactive bi-directional communication
`with an automated order center computer. In short,
`the
`attendant disclosure docs not secm to disclose interactive
`
`In the cmerging Internet cra, communications between
`personal computers (PCs) is becoming routine. However,
`problems remain to be solved, foremost among which are
`ease of use and access and portability of communication
`equipment. While desk and laptop PCs offer telecommuni-
`cations access to a variety of different server networks,
`commonly any exchange of information between the user
`and server is conducted in the public domain,i.e., on one big
`“party line” where ease-dropping and data manipulation can
`occur. While suitable for recreational use, this is not suitable
`for most business activities. While modem or facsimile
`communications between PCs may be more secure, they
`suffer from other disadvantages in that communication is
`commonly restricted to textual and/or graphic materials and
`do not usually allow simultaneous voice or sound content.
`Likewise, telephone conversations commonly involve voice
`without textual or graphic support. While multimedia com-
`multimedia real-time presentation of information to a user.
`munication systems may be available for use in a presenta-
`U.S. Pat. No. 5,365,577, “Telecommunication Display
`tion conference room setting, they often involve expensive
`System”, issued Nov. 15, 1994, in the name of Richard A.
`and/or bulky equipmentthat is not easily portable.
`Davis et al. and assigned to Radish Communications
`In everyday personal and business life there are many
`Systems, Inc., shows a telecommunication system that can
`times when it would be desirable communicate onareal-
`reportedly be dynamically switched between voice mode
`40
`and data mode in the course of a single telephone call. But
`this system suffers from the disadvantage that it requires
`“smart” PCs, and involves in methods for “peer-to-peer”
`communications generally involving an interrupted voice
`conversation between two parties. The system seems to
`involve directional couplers that also add expense. The two
`peer PCs each require power from a 110 V wall outlet, (or
`large bulky batteries); and, are not easily handheld.
`U.S. Pat. No. 5,465,291, “Apparatus for Ordering ['rom
`Remote Locations”, issued Nov. 7, 1995 in the name of
`Barrus et al. (Barrus) discloses a method for transmitting
`uscr information to a remote computer in a dual-tone mul-
`tiple frequency (DTMF)“touch tone” formatthat suffers not
`including a way to accomplish bi-directional communica-
`tion such as needed for transmitting data for display by a
`user. Also missing, are ways to check for errors in
`transmission, or to encrypt user sensitive data, or ways to
`receive confidential data from a host computer for display in
`a protected manner, or ways to protect confidential infor-
`mation. In addition, DTMFsystems suffer from at least the
`general disadvantages of failing to encode self-correcting
`error-free telecommunication signals; and, being a relatively
`slow method for transmission of data. Approximately 0.1
`seconds being required for each different integer and 0.2
`seconds for each alpha character encoded by a DTMFtonal
`pair using 50 milliseconds “on” followed by 50 milliseconds
`“off” for each character digit. This is excessively slow for
`transmission of bar code data. For example, a 16 digit code
`
`30
`
`35
`
`45
`
`50
`
`55
`
`60
`
`65
`
`time secure basis, and in a multimedia manner, e.g., with the
`main office, in a secure manner.
`Advertising sales and marketing materials are commonly
`distributed using a print media, such as newspapers,
`magazines, brochures and catalogs. On the one hand, these
`media can have advantages of low cost, ease ofdistribution,
`and sales effectiveness. However, on the other hand, print
`media are relatively inflexible as a method of communica-
`tion. Copyis often directed towards the “average buyer”, in
`the full recognition that such an individual maynot exist,
`and with limited provision for an alternative presentation
`other than launching several different expensive ad cam-
`paigns. Printed copy provides no opportunity for questions,
`or interaction between the writer and the person reading the
`copy. Print media is also weak at the actual point of order
`cntry. At best, a printed advertisement can offer a mail or
`FAX order form; or,
`it can direct a potential buyer to a
`telephone number for placing an order. Tele-marketing is
`similarly non-interactive and considered by many potential
`buyersto be intrusive. It is, therefore, considered ineffective
`for most products.
`Methods for order entry using a bar code reader include
`transmittal of data to a host processor, but are not presently
`believed to include methods for presentation of information
`to a customerat a handheld unit in a multimedia format, or
`in real time.
`
`US. Pat. No. 4,947,028, “Automated Order and Payment
`System”, issued Aug. 7, 1990, in the name of Jonathan M.
`
`18
`
`18
`
`

`

`6,144,848
`
`3
`requires approximately 1.6 seconds just for transmission and
`decodingat a server while a 16 alpha character code requires
`3.2 seconds.
`
`Accordingly, it would be advantageous haveanerror-free,
`secure, bi-directional communication method to provide an
`ordering and advertising system that could be used within a
`printed media that would non-intrusively allow an interested
`party to obtain additional information in an interesting and
`interactive manner, without
`the intervention of a sales
`person, and in an automated hands-off secure manner that
`might result in entryof a bank cardsale. In addition, it would
`be advantageous to have a system for telecommerce that
`would offer error-free, secure, optionally-encrypted commu-
`nications and with storage of sensitive confidential data in a
`secure location.
`
`SUMMARYOF THE INVENTION
`
`The invention provides a telecommunications device for
`secure, encrypted, interactive multimedia communication,
`in real-time between a central processing unit (CPU) in a
`host computer server(host server). The device is low power
`and handheld, and it contains an audio system, microphone,
`speaker, keypad, display screen, bar code reader,
`microprocessor, and telecommunications transceiver (with
`modem, voice processor, call progress monitor,
`bi-directional voice/data mixer, DIMF(or MF) signal gen-
`erator and an optional codec unit). The device maintains its
`low power status by drawing powerforall functions (ie.,
`less than about 300 milliwatts of power and preferably less
`than about 150 mw) from a convenient telephone wall jack
`or a wireless telephone battery. The disclosed unit is a
`relatively inexpensive to manufacture having a micropro-
`cessor with simple less than about 128 K bytes of PROM
`and 8 K bytes of RAM.Although relatively “dumb” when
`compared with a PC, interactive error-free, bi-directional,
`real-time telecommunications allow the device to transpar-
`ently behave like a sophisticated “super computer”, in this
`case, the host server.
`The user device is highly versatile and provides simple,
`rapid, secure and encrypted, self-correcting, error-free,
`inexpensive, handheld unit
`to access, control,
`instruct,
`command, and query a host server. Auser“in the field”(e.g.,
`a customer) can enter command messages (including bar
`coded messages) directing the host server to supply infor-
`mation on a real-time, interactive basis including multime-
`dia information such as text, data, calculations, reports,
`voice, sound, music and graphic information. Commands
`can also be transmitted to the hostserver to take actions, ¢.g.,
`access files, make calculations, provide quotations, investi-
`gate and provide credit/debit information or credit history,
`enter orders for products, and the like. Security provisions
`and encryption installed in the handheld user device allow it
`to interactively obtain confidential business information and
`place credit card orders. While the handheld user device
`contains a relatively simple microprocessor the telecommu-
`nications data packets transmitted from the handheld user
`device to the host server have capability for multimedia
`content.
`
`less than about 300
`The maximal power budget (ie.
`milliwatts and preferably less than about 150 mw) can easily
`be consumed by the transceiver, or bar code reader in the
`absence of management and control. Power management
`and conservation protocols within the user device include
`three different methods for expediting and controlling tele-
`communications to save power. First, bar coded data packets
`(ic., from scanning printed bar codes) are used to direct
`
`4
`commands to the host server allowing: (i) faster entry; (ii)
`faster encoding and encryption; (ii) faster transmission;
`and, (iv) lower power consumption. Second, during tele-
`communications with the host server the user device is the
`“master” (not the slave) andthusis ableto selectively supply
`current to only the hardware components that are necessary
`for the instantancous form of communication with the
`server,i.e., voice, visual or data. (When they are not needed
`the respective hardware components are immediately pow-
`ered down to save power.) Third, rapid communication
`“signal switching” is provided by using data packets that
`contain DTMF (or MF) “switch signal” codes. The latter
`“switch signal” codes are capable of instructing a host server
`e.g. (a) to switch voice “off” and data communications “on”;
`and, (b) select communication parameters (e.g., set baud to
`1200, set parity to Even); all in less than 0.15 seconds.
`Attendant advantages to “switch signal” codes in the user
`device include: (i) multimedia transmissions within a simul-
`taneous telecommunication transmission(e.g., from voice to
`bar code data then to keystroke data then back to voice); (ii)
`faster interactive communications between the user and
`server; (iii) elimination of powerintensive time consuming
`(i.e., 10 second) modem negotiations required to set com-
`munication parameters; and, (iv) power savings by allowing
`the user device to control the course of the telecommunica-
`
`tion session and power-down unused hardware. Interactive
`telecommunications between the user device and host server
`can be very fast but also very complex. As an example, the
`user device may encode and transmit a data packet having
`the following orderofinstructions: namely,(i) switch signal
`(e.g.,
`turn voice off,
`turn data on, set communication
`parameters, receive data); (ii) command bar code (e.g.,
`“order the following item”); (iii) UPC bar code(e.g., “prod-
`uct to be ordered”); (iv) commandbarcode(e.g., “two units
`of the bar coded item”); (iv) “switch signal” (e.g. from data
`to voice, switch on voice recorder, and receive incoming
`voice message); (v) “voice message”(e.g., ‘don’t deliver at
`the backdoor,
`the dog bites’.) Following receipt of the
`command message, the host server may signal an acknow]l-
`edgmentto the user, e.g., an audio message, an update to the
`screen display, or alternatively, the server may transmit a
`facsimile (KAX)-response,
`i.e.,
`to a FAX machine at the
`user’s location. The FAX message mayoptionally contain a
`set of commandbar codes, capable of generating additional
`command messages,to further expedite telecommunications
`in the interactive loop between the user device and the
`server,
`
`BRIEF DESCRIPTION OF‘THE DRAWINGS
`
`FIG. 1A depicts telecommunication between a user device
`(according to the disclosure below) and a host server; FIG.
`1B depicts a block diagram of a user device containing a
`CCD-type bar code reader, (below).
`FIG. 2 depicts a block diagram of the sound processor
`element.
`
`FIG. 3 depicts a diagram ofa first user device.
`FIG. 4 depicts a diagram of a second user device.
`FIG. 5 depicts a diagram of a third user device.
`FIG. 6 depicts a diagram of a fourth user device.
`FIG. 7 illustrates a first bar code command card.
`
`FIG. 8 illustrates commandcards such as maybe useful
`in an alternative embodiment for obtaining airline informa-
`tion.
`FIG. 9 illustrates a first command card such as for use
`
`with an embodiment regarding order approval.
`
`10
`
`15
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`19
`
`19
`
`

`

`6,144,848
`
`6
`iotermittently draws small amounts of current from
`either a telephone-loop power supply, or from a wire-
`less telephone battery, without
`interfering with the
`telecommunication link or significantly reducing bat-
`tery life cycle; and,
`a method for establishing an interactive multimedia
`real-time telecommunication link between a host
`
`server and a handheld low poweruser device.
`a method for securing confidential information such as
`credit card numbers, account balance information,
`and encryption parameters, (i.c., from thieves) by
`storing the subject
`information in a protected
`memory in the subject user device.
`In the accompanying disclosure, a presently preferred
`embodiment of the invention is described with regard to
`preferred hardware, process steps and data structures.
`However, those skilled in the art will recognize that certain
`substitutions and/or alterations may be made without depart-
`ing from the spirit and scope of the present invention. The
`present invention may be used in conjunction with inven-
`tions disclosed in the inventor’s U.S. Ser. Nos. 08/480,614,
`now U.S. Pat. No. 5,696,824, and 08/485,083, now
`abandoned, both filed Jun. 7, 1995 and both incorporated
`herein by reterence.
`
`Overview of the Method and System
`Disclosed herein are methods for multimedia communi-
`cation using a low power, portable, lightweight, handheld,
`relatively inexpensive user device powered by a telephone
`line or wireless phone, that does not require a user PC,or a
`“peer-to-peer” communication system. The subject device
`does not contain user software and is easy to install by
`simply plugging it into a telephone wall jack, or into a ccll
`phoneaccess port. A comparison between the handheld low
`power user device of the invention and a desktop PC is
`provided in TABLEA,below.
`
`5
`FIG. 10 illustrates a first command card such as for use
`with an embodimentregarding order approval.
`FIG. 11 shows a process flow diagram for the present
`method of using the user device according to the accompa-
`nying disclosure, below.
`FIG. 12 shows a process flow diagram of the present
`method for coupling the user device and a host server.
`FIG. 13 showsa process flow diagram for an order session
`according to the present method.
`FIG. 14 showsa process flow diagram for an order session
`command message according to the present method.
`FIG. 15 depicts data packet
`transfer methods of the
`invention from the perspective of a user device.
`FIG. 16 depicts data packet
`transfer methods of the
`invention from the perspective of a host server.
`FIG. 17 depicts a CCD type bar code reader with a
`proximity detector (as disclosed below).
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`
`~
`
`~
`
`po
`
`The methodsof the invention are highly versatile and find
`uses in a variety of consumer, business and private settings.
`Aspects of the invention include e.g. methods for the fol-
`lowing: namely,
`a method for commandinga host server lo transmit voice,
`sound, data, alphanumeric and/or graphic displays, and
`the like, as informational messages to a handheld low
`power user device; by transmitting a command mes-
`sage data packet; in an error-free fashion, with modem
`communication protocols, from the user device to the
`host server; where the data packet includes (butis not
`limited to) bar coded commandinstructions and key-
`stroke data;
`method for using DTMF or MF ‘switch signal’ to
`instruct a host server to switch a communications path
`from voice mode to data mode, and to provide com-
`patibility with an ADSI server;
`method for transparently initiating telecommunication
`with a host server using a bar code reader in a low
`power handheld user device to initiate the link;
`method for establishing a bi-directional, secured,
`confidential, private and crror-free telecommunication
`path to a host server and for commanding the host
`server along that communication path to encode,
`encrypt and transmit sensitive information in a secure
`manner to a host handheld low power user device,
`a method for transmitting multimedia presentations (i-e.,
`optionally. encrypted data, voicc, numerical, and/or
`graphic information) along an error-free path to a
`handheld low poweruser device;
`a method for encoding, encrypting and transmitting mul-
`timedia presentations from a handheld low poweruser
`device to a host server;
`method for transmitting long complex command pro-
`gram instructions to a host server using one or more bar
`coded commandsthat are encoded into a short com-
`
`~
`
`~
`
`mand message;
`method for transmitting multilingual multimedia pre-
`sentations to a handheld user device;
`a method for using a low power handheld user device to
`access a host server and transmitting thereto command
`messages (optionally cncrypted) containing digital tcle-
`communication signals, voice, keystrokes;
`method for establishing a telecommunication link
`between a host server and a handheld user device which
`
`~
`
`10
`
`15
`
`30
`
`35
`
`40
`
`50
`
`55
`
`60
`
`65
`
`20
`
`Hardware
`Component
`RAM
`Processor
`
`User Software
`Drive(s)
`
`45
`
`Modem
`Bar Code
`Reader
`Monitor/Screen
`Power Supply
`
`TABLE A
`
`Illustrative
`PC
`8-16Mb
`32-64 bits
`10-14 watts
`Assorted
`Hard drive(s)
`Floppy drive(s)
`CDROMdrive(s)
`2000-3000 mw
`External (2-3 amps)
`
`100 watts
`250 watts
`
`Handheld Low
`Power Uscr Device
`<8Kb
`8 bits 50 mw
`
`Com-
`parison**
`<0.01%
`<1%
`
`None
`None
`
`15-50 mw
`Internal <20ma
`
`<50 milliwatts
`<300 millliwatts
`
`None
`None
`
`<2%
`<0.1%
`
`<0.1%
`0.1%
`
`**Comparison User Device Specification/Illustrative Specification x 100%
`
`Embodiments of the invention provide a data and voice
`communication system using a low power user device that
`derives power from either a telephone loop-line current or a
`wireless telephone battery. The user device draws powerat
`such a low level that it operates without interfering with
`voice or data telecommunication systems, e.g., it does not
`trigger a “wink start” signal or other supervisory telecom-
`munication signal. The subject user device contains an
`internal bar code reader and method for managing voice and
`data communications to and from a host server and involv-
`
`ing bi-directional voice and data tclecommunication over
`ordinary telephone lines.
`In other embodiments the invention provides a user with
`a highly portable system for transmitting, on ordinary phone
`
`20
`
`

`

`In other embodiments the invention provides a method for
`transmitting data signals, bar code informational and voice
`communication on a single telecommunication channel by
`initiating a transmission with a DTMF or MF “switch
`signal” code, followed by a data packet. The “switch signal”
`instructs the host computcr system to turn off voice mes-
`sages and enable modem communications and receive data
`packets. Data packets may include data, bar code
`information, commandinstructions(i.e., instructions from
`the user device to the host server), keystrokes and/or
`optional voice messages. In alternative embodiments, com-
`mandinstructions encoded in bar codes and/or keystrokes
`(e.g., soft keys, below) are included in data packets. The
`commandinstructions are interpretable by the application
`running in the host server as instructions to (i) switch from
`In yet other embodiments, methods are provided for a
`data reception to voice communications; and, then (ii) send
`handheld low power user device to control voice or data
`a voice informational message to the user device; or
`transmission and reception by a host server by transmitting
`alternatively, reccive and record a voice communication
`to the host server a coded DTMEF (and/or MF) “switch
`from the user device (i.e.,
`in response to the command
`signal” that commands switching between data and voice.
`instruction). The method of the invention allows switching
`Switch signals are preferably transmitted immediately
`from voice to modem (in response to a “switch signal”) and
`before a telecommunication data packet,
`in this case.
`then switching back to voice (in response to a data packet
`Receipt of the “switch signal” al the host server instructs a
`command instruction.)
`The user device initiates all data transfers and “com-
`switching of telecommunications signal types, i.e., between
`voice and data. The subject switch signals are capable of
`mands” a host server. The host
`is a “server” and only
`switching between forms of communication in less than
`transmits in response to commands from the user device.
`about 1 seconds, preferably less than about 0.5 seconds, and
`‘The methods of the invention allow a handheld low power
`user device to conserve power by reducing (or cutting)
`most preferably less than about 0.1 seconds. DTMF and MF
`current to the modem when no responses from the host
`signals have the advantage that they are distinguishable from
`server are pending. Thus, the user device is able to keep the
`voice signals. Each DTMF(or MF)signal is composed of
`modem in a low power“sleep” mode mostof the time. This
`two frequenciesthat are not harmonic with each other. These
`is very important because the modem can drawasignificant
`non-harmonic tonc pairs do not appear in speech or music.
`amount of the poweravailable for all circuits.
`Thus, electronic circuits can detect DTMF (or MF) “switch
`In other embodiments, the subject method for managing
`signal” codes even in the presence of voice or music
`telecommunications includes methods for insuring the secu-
`messages on the line.
`rity of communications on the channel by using encryption
`Modem communications use KSK, DPSK, QAM and
`and several different types of security and authorization
`other signaling protocols to encode data. However, the tones
`verification methods. The subject methods find a variety of
`used in these data encoding systems also may appear in
`uses including many different uses in advertising and sales,
`voice and music. Thus, electronic circuits cannot readily
`€.g.,
`In remote product ordering. The subject methods do not
`distingu