United States Patent
`US 6,169,789 B1
`(10) Patent No.:
`(12)
`Raoetal.
`(45) Date of Patent:
`Jan. 2, 2001
`
`
`US006169789B1
`
`FOREIGN PATENT DOCUMENTS
`INTELLIGENT KEYBOARD SYSTEM
`W092/03884 *
`3/1992 (WO) wc 379/FOR 132
`Inventors: Sanjay K. Rao; Sunil K. Rao; Raman
`* cited by examiner
`AlloCA(US) aeAlexis Dr, Palo
`Primary Examiner—Wing F. Chan
`.
`.
`
`(*) Notice:—Under 35 U.S.C. 154(b),the term ofthis (74) Altorney, Agent, or Firm—Trial & Technology Law
`patent shall be extended for 0 days.
`Group
`ABSTRACT
`(21) Appl. No.: 09/281,739
`(57)
`(22)
`Filed:
`Jun. 4, 1999
`This invention generally relates to a system level scheme
`utilizing an intelligent keyboard, hereafter called an
`Intellikeyboard, which can operate as a universal compute,
`command,and control module that interfaces either through
`wired or wireless means with a number of intelligent
`appliances, personal computers, work-stations, servers,
`_'elevisions, printers, smart devices,
`intelligent devices,
`telephones, or other devices. The Intellikeyboard has the
`ability to transmit and receive voice, text, graphics, and
`other data through either wired or wireless means. The
`Intellikeyboard may work in tandem with a local or network
`server to perform standard computing functions, serve as a
`command
`and
`control unit,
`perform standard
`telephon
`d
`and
`1
`unit,
`perf
`dard_
`telephony
`functions, transmit and receive electronic mail, voice mail,
`video, and audio. The invention also anticipates the need for
`multichannel and sequential/simultaneous tasking andinter-
`face with numerousintelligent appliances and devices.
`
`(54)
`(76)
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 08/764,903,filed on
`Dec. 16, 1996, now abandoned.
`(51) Unt C17eessnnneneiiennntennssee HO4M 11/00
`(52)
`379/110.01; 379/90.01
`
`:
`”
`non
`:
`(58) Field of one 05.93.37.100.OLon10OF
`419 420 418 40 4A] TOR 132
`;
`;
`;
`;
`;
`:
`References Cited
`U.S. PATENT DOCUMENTS
`.
`5
`Th
`5
`heea ‘ ‘otosy romey TerereseneneseneeeseeeesSotoa
`
`.. 379/110.01
`5,195,130 *
`3/1993 Weiss et al.
`..
`5,577,118 * 11/1996 Sasaki et al. eee 379/428
`
`(56)
`
`INTELLIGENT
`
`MULTICHANNEL
`MULTIPLEXING
`TRANSMITTER/
`
`KEYBOARD INSIDE LINE
`RECEIVER
` OUTSIDE LINE
`
`NETWORK SERVER
`
`1 Claim, 12 Drawing Sheets
`
`Exhibit 1052
`Samsung v. Smart Mobile
`IPR2022-01249
`
`Exhibit 1052
`Samsung v. Smart Mobile
`IPR2022-01249
`
`1
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 1 of 12
`
`US 6,169,789 B1
`
`TO PRINTER
`(OPTIONAL)
`
`TO PC
`(OPTIONAL)
`
`
`
`
`
`INTELLIKEYBOARD
`
`
`AUDIO/VIDEO-
`INPUT/OUTPUT
`
`CRT/TV DISPLAY
`OUTPUT
`
`
`
`POWER
`INCLUDING BATTERY POWER
`
`40
`
`FIGURE 1
`
`2
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 2 of 12
`
`US 6,169,789 B1
`
`MAY
`
`TRANSMIT/RECEIVE
`DISPLAY|TELEPHONY
`RECEIVER BLOCK
`FUNCTION OR MODEM
`DECODER BLOCK
`WHICH MAY OPERATE
`INPUT BUFFER BLOCK
`THROUGH EITHER
`MICROPHONE
`INPUT CONTROLLER BLOCK|WIRED OR WIRELESS
`PROCESSOR BLOCK
`MEANS
`
`INCLUDE BUILT-IN
`
`AND SPEAKERS INPUT BLOCK
`
`DATA COMPRESSION BLOCK
`
`OUTPUT BUFFER BLOCK
`
`OUTPUT CONTROLLER BLOCK
`
`ENCODER BLOCK
`
`TRANSMISSION BLOCK
`
`MEMORY BLOCK
`
`DATA STORAGE BLOCK
`
`PROGRAMMABLE LOGIC
`
`BLOCK
`
`FIGURE 2
`
`3
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 3 of 12
`
`US 6,169,789 B1
`
`MULTIPLE INPUTS FROM
`INTELLIGENT APPLIANCES
`AND OR INTELLIGENT KEYBOARD
`
`FROM COMMUNICATION
`LINE OR LINES
`
`J
`
`|
`
`4
`
`;
`
`|
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TRANSMISSION BLOCK
`
`TO INTELLIGENT
`DEVICES AND/OR
`INTELLIKEYBOARD
`
`TO COMMUNICATION
`LINE OR LINES
`
`SINGLE OR
`MULTIPLE
`OUTPUTS
`
`FIGURE 3
`
`4
`
`4
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 4 of 12
`
`US 6,169,789 B1
`
`SENDING DATA:
`
`CODE
`
`INFORMATION
`
`CODE
`
`RECEIVING DATA:
`
`DECODE
`
`INFORMATION
`
`DECODE
`
`FIGURE 4
`
`5
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 5 of 12
`
`US 6,169,789 B1
`
`OUTSIDE WORLD
`
`NETWORK SERVER
`
`30
`
`20
`
`MULTI/CHANNEL
`MULTIPLEXING
`TRANSMITTER/RECEIVER|TELEPHONE LINE
`OR OTHER DATA
`COMMUNICATION
`LINE
`
`
`
`INTELLIGENT
`APPLIANCE/DEVICE1|* >|
`
`
`
`
`
`PO/SERVER
`
`INTELLIKEYBOARD
`
`
`
`
`
`INTELLIGENT
`APPLIANCE/DEVICE 2
`
`44
`
`10
`
`FIGURE 9
`
`6
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 6 of 12
`
`US 6,169,789 B1
`
`OUTPUT
`
`MUX
`
`2 OUT
`
`
`
`
`
`DUAL CHANNEL
`
`
`RECEIVE
`
`PROCESSORS(S)
`
`CONTROLLER(S)
`2 1N
`
`
`INTERFACE(S)
`PROGRAMMABLE LOGIC
`TRANSMIT
`
`
`
`
`
`4 IN
`
`RECEIVE
`PROCESSORS(S)
`CONTROLLER(S)
`INTERFACE(S)
`PROGRAMMABLELOGIC
`TRANSMIT
`
`
`OUTPUT
`
`MUX
`4 QUT
`
`
`
`
`
`QUAD CHANNEL
`
`
`
`
`2 IN
`
`
`
`
`RECEIVE
`PROCESSORS(S)
`CONTROLLER(S)
`INTERFACE(S)
`PROGRAMMABLE LOGIC
`TRANSMIT
`
`
`OUTPUT
`
`MUX
`4 QUT
`
`
`
`
`
`DUAL IN, QUAD OUT
`
`FIGURE 6
`
`7
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 7 of 12
`
`US 6,169,789 B1
`
`ANTENNA
`
`IMBEDDED RADIO
`FREQUENCY CONTROLLER
`
`
`
`RECEIVER CONTROLLER|TRANSMITTER
`
`PROCESSOR
`
`
`
`
`INTELLIGENT ELECTRICAL OUTLET
`
`EMBEDDED RADIO FREQUENCY CONTROLLER
`
`PROGRAMMABLE
`LOGIC
`
`ANTENNA
`
`ANTENNA
`
`EMBEDDED RADIO
`FREQUENCY
`CONTROLLER
`
`FIGURE 7
`
`EMBEDDED RADIO
`FREQUENCY
`CONTROLLER
`
`TRANSDUCER
`
`INTELLIGENT ON/OFF OR VARIABLE SWITCH
`
`INTELLIGENT SENSOR
`
`8
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 8 of 12
`
`US 6,169,789 B1
`
`INTELLIGENT
`KEYBOARD
`
`10
`
`
`
`MULTICHANNEL
`MULTIPLEXING
`TRANSMITTER/
`RECEIVER
`
`INSIDE LINE
`
`OUTSIDE LINE
`
`NETWORK SERVER
`
`FIGURE 8
`
`9
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 9 of 12
`
`US 6,169,789 B1
`
`10
`
`INTELLIGENT
`KEYBOARD
`
`INSIDE LINE
`
` MULTICHANNEL
`
`TRANSMITTER/
`RECEIVER
`
`MULTIPLEXING P| INTELLIGENT
`
`PRINTER
`
`20
`
`OUTSIDE LINE
`
`10
`
`30
`
`NETWORK SERVER
`
`FIGURE 9
`
`10
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 10 of 12
`
`US 6,169,789 B1
`
`10
`
`INTELLIGENT
`KEYBOARD
`
`INSIDE LINE
`
`
`
`MULTICHANNEL
`
`TRANSMITTER/
`RECEIVER
`
`MULTIPLEXING P| INTELLIGENT
`
`TV/MONITOR
`
`20
`
`OUTSIDE LINE
`
`59
`
`30
`
`NETWORK SERVER
`
`FIGURE 10
`
`11
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 11 of 12
`
`US 6,169,789 B1
`
`KEYBOARD
`
`INTELLIGENT
`
`INSIDE LINE
`
`20
`
`RECEIVER
`
`MULTICHANNEL
`MULTIPLEXING
`TRANSMITTER/
`
`OUTSIDE LINE
`
`“30
`
`NETWORK SERVER
`
`INTELLIGENT
`APPLIANCE/DEVICE 1
`
`APPLIANCE/DEVICE 2
`
`INTELLIGENT
`
`FIGURE 11
`
`12
`
`

`

`U.S. Patent
`
`Jan. 2, 2001
`
`Sheet 12 of 12
`
`US 6,169,789 B1
`
` INTELLIGENT
`KEYBOARD
`
`
`INSIDE LINE
`FREQUENCY LOCAL
`
`
`
`
`
`
`
`
`MULTICHANNEL
`
`OUTSIDE LINE
`MULTIPLEXING
`
`FREQUENCY OUTSIDE
`TRANSMITTER/
`
`RECEIVER
`
`
`
`OUTSIDE LINE
`FREQUENCY OUTSIDE
`
`SATELLITE
`TRANSMITTER/
`RECEIVER
`
`25
`
`NETWORK SERVER
`
`
`
`FIGURE 12
`
`13
`
`

`

`US 6,169,789 B1
`
`1
`INTELLIGENT KEYBOARD SYSTEM
`CROSS REFERENCE TO RELATED PATENT
`APPLICATIONS
`
`The present application is a continuation-in-part of appli-
`cation Ser. No. 08/764,903, now abandoned filed Dec. 16,
`1996, entitled “A System Level Scheme To Control Intelli-
`gent Appliances Utilizing An Universal Compute Command
`And Control Keyboard”, and which is hereby incorporated
`by reference.
`BACKGROUND OF THE INVENTION
`
`The invention relates generally to an intelligent keyboard
`system including an intelligent keyboard, hereafter called an
`Intellikeyboard, which can execute complex tasks previ-
`ously resident on the personal computer, workstation, server,
`or a mainframe computer; more particularly, the Intellikey-
`board leverages the tremendous power of both the Intranet
`and the Internet. Intelligent telephony, appliances, devices,
`and equipment will find increasing use in modern society.
`There is a need for one single universal, handheld,
`lightweight,
`transportable,
`intelligent device that can
`compute, command, and controlall theseintelligent devices.
`TheIntellikeyboardis lightweight and portable. TheIntel-
`likeyboard consists of an optional builtin or externaldisplay,
`a microphone, speaker, high speed transmit/receive device,
`such as a modem,in addition to a full function keyboard.
`The Intellikeyboard may have additional input/output ports
`for plugging in auxiliary devices such as a digital camera,
`printer, and other devices through either wired or wireless
`means. The Intellikeyboard has a transmitter, receiver, a
`digital signal processor(s), other processors, controller, dis-
`play electronics and audio/video electronics. These func-
`tional blocks may be implemented using standard electronic,
`mechanical, or electromechanical components or custom
`electronic, mechanical, or electromechanical components by
`those knowledgeable in the art.
`The Intellikeyboard is able to leverage the computing
`powerof the network or local server to process data. The
`Intellikeyboard serves as a transmit and receive hub. Thus,
`the Intellikeyboard is able to access a networkor local server
`or an intelligent peripheral device to perform any operation
`or function.
`
`The Intellikeyboard is able to transmit data inputted by
`the user to the network or local server or other devices for
`
`further processing. Auser may inputdata intothe Intellikey-
`board by typing on the keyboard, inputting voice or sound
`through the Intellikeyboard’s speaker, touching the screen of
`the display on the Intellikeyboard, using a mouse that
`interfaces with the Intellikeyboard, using a pen that inter-
`faces with the Intellikeyboard, or through another method or
`device that interfaces with the Intellikeyboard. This data and
`commandsgenerated by the Intellikeyboard may be sent to
`the local network server or other devices for further pro-
`cessing. The Intellikeyboard is able to retrieve data pro-
`cessed by the local or network server or other devices. The
`Intellikeyboard can then perform further processing or out-
`put this data through the optional display, the speaker, or
`another device that interfaces with the Intellikeyboard.
`Multiple intelligent equipment,
`intelligent appliances,
`televisions, printers and other devices can be accessed by a
`single intelligent keyboard or multiple intelligent keyboards
`either through a local/network server or directly. Unique
`addressing identification of each intelligent device, sequenc-
`ing of instructions, execution of commands will be per-
`formed via a commonset of protocols and procedures that
`reside on a local or network server or on other intelligent
`devices.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`Multiple Intellikeyboards may coexist in an environment
`to access a commonsetof intelligent equipment,intelligent
`appliances,televisions, printers, and other devices. Multiple
`Intellikeyboards will operate in this common environment
`without conflict by leveraging a commonset of protocols
`that reside on the local or network server and the Intellikey-
`board.
`
`The Intellikeyboard with a built-in transmit/receive
`device, may access standard telephone lines or other com-
`munication lines to communicate with other intelligent
`devices that may be either resident locally or located across
`an Intranet or the Intenet. This two way Communication
`may be either wired or wireless. The Intellikeyboard has the
`ability to dial-up and connect with a communication line or
`anotherintelligent appliance. The Intellikeyboard may also
`work in tandem with other modems and transmit/receive
`devices that may exist in other appliances or work with a
`central host modem or transmit/receive unit.
`
`The Intellikeyboard combinestransmitting and receiving
`information, performing standard computing functions
`through use of a network or local server, interacting and
`commanding manyintelligent peripheral devices around the
`homeoroffice through wired or wireless means, telephony,
`handwriting recognition, barcode creating,
`reading and
`printing; magnetic stripe creating, reading and printing;
`electronic mail, which may include audio, text/graphics, and
`video; mass storage device and display features, video
`input/output,
`imaging, audio input/output, voice mail
`capability, voice synthesis, language translation with text to
`voice and voice to text capability built in to one multi-
`function device.
`
`The Intellikeyboard may also serve as a base station or
`individual station for telephony able to operate with a
`built-in or detachable handset.
`It can also operate with
`multiple telephones and handsets. In this mode, the Intel-
`likeyboard can convert voice to text, text to voice, or voice
`to voice in the same language or in another language. With
`the large computing /processing power of the local or
`network server the possibility to conduct live conversation
`in same or two or more different languagesis feasible. Also
`text transcription of voice conversations and the reverse is
`possible. The Intellikeyboard may also include the option to
`have the keys in its keyboard be inscribed in Braille for
`individuals that are visually impaired. The Intellikeyboard
`may be limited to someorall of the features described above
`or may includeall the features described above based on the
`options desired by the user.
`In this age of the Intranet and the Internet, there is a trend
`for the computing power and software protocols to move
`away from the user location, such as the personal computer,
`to the local server/network server. The Intellikeyboard may
`use the local server/network server to perform complex
`operations, such as language translation. In addition, the
`Intellikeyboard may have some language translation capa-
`bility resident in itself via language translation modules that
`may be easily plugged in and out of the Intellikeyboard.
`Currently, keyboards only have the capability to transmit
`keystrokes to a computing device. However, a keyboard that
`can perform other complex functions as enumerated above
`and hereafter in this invention have not been defined. This
`
`novel invention for the first time integrates currently avail-
`able functions such as transmitting keystrokes to a comput-
`ing device with transmitting and receiving information,
`performing standard computing functions through use of a
`network or local server, interacting and commanding many
`intelligent peripheral devices around the home or office
`14
`
`14
`
`

`

`US 6,169,789 B1
`
`3
`through wired or wireless means, telephony, handwriting
`recognition, bar code creating, reading and printing; mag-
`netic stripe creating, reading and printing; electronic mail,
`which may include audio, text/graphics, and video mass
`storage device and display features, video input/output,
`imaging, audio input/output, voice mail capability, voice
`synthesis, language translation, with text to voice and voice
`to text capability, and other high speed communication
`features that may be either wired or wireless. For example,
`the Intellikeyboard can interact with various intelligent
`peripherals and appliances, through either wired or wireless
`means, to print, scan, fax, copy or perform other functions.
`SUMMARYOF THE INVENTION
`
`An object of the invention is to enable the basic
`Intellikeyboard, which possesses the electronics and com-
`puting powerto transmit data to and receive data from either
`a network server (the network server can be a PC) or
`intelligent peripheral or intelligent appliance through either
`wired or wireless means, to serve as a transmit and receive
`hub. Using the computing power resident on the network
`server a user can perform all standard computing functions
`from the Intellikeyboard. The Intellikeyboard has a
`transmitter, receiver, a digital signal processor, controller,
`display electronics and audio electronics which are available
`as chips. These chips may be standard integrated circuits or
`custom built. There can be a modem or a transmit/receive
`device built
`into the Intellikeyboard. This modem or
`transmit/receive device can operate through either wired or
`wireless means.
`
`Anotherobject of the inventionis to enable the Intellikey-
`board to interact and command manyintelligent peripheral
`devices around the homeoroffice through either wired or
`wireless means and thus serve as a universal keyboard. By
`using the processing power of the network server,
`the
`Intellikeyboard can assign an identification numberto each
`peripheral or appliance. With this unique identification num-
`ber and the processing capability of the network server, the
`Intellikeyboard can then control that particular appliance or
`peripheral. All the appliances and peripherals will subscribe
`to the same protocols such that they will be able to com-
`municate with each other and be able to execute instructions.
`
`The intelligent appliances and Intellikeyboards may operate
`with a common Operating System that may be either pro-
`prietary or an industry standard.
`Yet another object of the invention is to enable a com-
`munication and control schemeofintelligent appliances and
`peripherals using the Intellikeyboard. The Central multi-
`channel multiplexing transmit/receive device may receive
`inputs from the local intelligent appliances and route these
`inputs to the network server/outside world. Conversely, the
`Central multichannel multiplexing transmit/receive device
`may receive inputs from the outside world/network server
`and route these inputs to the local intelligent appliances. The
`Central multichannel multiplexing transmit/receive device is
`also able to facilitate communication between the local
`
`intelligent appliances. The Central multichannel multiplex-
`ing transmit/receive device or functional block may have
`multiple input and output channels such that sequential/
`simultaneous addressing and communication with numerous
`intelligent appliances and communication pathsis possible.
`The Intellikeyboard is one element that would serve as a
`universal keyboard/command, compute, and control unit
`within this environment. It is anticipated that the Central
`multichannel multiplexing transmit/receive device would
`exist in each home/office environmentto facilitate the over-
`all scheme described in this invention. The Central multi-
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`channel multiplexing transmit/receive device may be built in
`multiple configurations. The Central multichannel multi-
`plexing transmit/receive device may be configured with the
`desired number of input and output channels. The Central
`multichannel multiplexing modem can be implemented by
`those knowledgeable in the art utilizing the electronic func-
`tional blocks described in this invention. The Central mul-
`
`tichannel multiplexing transmit/receive device may work in
`tandem with an embedded transmit/receive device that may
`exist in each intelligent appliance. Thus, there may exist
`within the home/office environmenta hierarchy of transmit/
`receive devices:
`
`1. An embeddedtransmit/receive device may exist in each
`intelligent appliance.
`This embedded transmit/receive device may have mul-
`tiple inputs/outputs facilitating communication between
`other intelligent appliances and the central transmit/receive
`device or directly with the outside world.
`2. A central transmit/receive device that will exist in the
`home/office environment such that it may communicate with
`numerousintelligent appliances and the outside world.
`3. The ability to convert passive electrical outlets and
`switches that could communicate within this environment
`and be controlled by an Intellikeyboard or other means.
`4. A universal intelligent keyboard that will facilitate the
`command, compute and control of all intelligent appliances
`and systems within the home/office environment.
`Another object of the invention is to enable the
`Intellikeyboard, which has a speaker and microphone to
`facilitate interaction between voice recognition software
`resident on the network server and the Intellikeyboard. The
`Intellikeyboard is also capable of outputting sound. It is also
`able to convert sound to data that can be transmitted to a
`
`network server. By using the voice recognition software
`resident on the network server, Intellikeyboard can convert
`text data into voice and broadcast voice through a speaker
`mechanism.
`
`Another object of the invention is to enable the Intellikey-
`board’s display to send data to and receive data from the
`network server. This display is capable of showing text,
`graphics or other data.
`Another object of the invention is to enable the Intellikey-
`board to transmit inputs from either the keypad, display or
`voice inputs (sound) picked up from the microphoneto the
`network server or intelligent peripheral or intelligent appli-
`ance for processing (through either wired or wireless
`means). Thus one mayeither send data to software resident
`on the network serverorintelligent peripheral or intelligent
`appliance through the keypad, through voice commands, or
`through the display by touching the screen.
`Another object of the invention is to enable the Intellikey-
`board to receive and transmit information through a modem,
`a telephone line, an ethernet line or other form of data
`communication. These inputs and outputs are then processed
`by a networkserver or local server and are relayed back to
`the Intellikeyboard and/or the display. The Intellikeyboard
`can use its modem to transmit data to and receive data from
`a network server or “intelligent” peripheral or appliance
`through either wired or wireless means. In this scenario, the
`network server may perform any computation that is nec-
`essary. Intelligent peripherals and appliances will interact
`with the Intellikeyboard through either wired or wireless
`means.
`
`For example, wireless communication may be achieved
`through either radio frequency, in which line of sight is not
`15
`
`15
`
`

`

`US 6,169,789 B1
`
`5
`is
`in which line of sight
`required, or through infrared,
`required. For wireless operation, a radio frequency transmit/
`receive device or functional block can be built into the
`Intellikeyboard. The radio frequency transmit/receive device
`or functional block allows the Intellikeyboard, which uses
`the computing powerof the networkserver, to interface and
`control other intelligent peripherals or intelligent appliances.
`The radio frequency modem can beeither single or multi-
`channel. This means that
`the radio frequency transmit/
`receive device or functional block which is built into the
`Intellikeyboard can receive all of its input from the Intel-
`likeyboard or it can receive many different inputs from
`various intelligent appliances and peripherals simulta-
`neously. The radio frequency may be in any range that is
`FCC approved, including spread spectrum.
`Anotherobject of the inventionis to enable the Intellikey-
`board to be connected to a local area network or wide area
`
`through either wired or
`network including the Internet,
`wireless means, to receive inputs of text and/or voice and to
`send outputs of text or voice depending on the user’s choice.
`Voice sent to a network server could be stored as a datafile.
`
`Anotherobject of the inventionis to enable the Intellikey-
`board to work in tandem with a network server to receive
`text or voice data and process these inputs for audio output.
`The primary computing power/protocols and software reside
`on the server.
`
`Voice includes spoken, as well as, other audio and or
`audible tones inclusive of music/sound.
`Anotherobject of the inventionis to enable the Intellikey-
`board to have options and attachments added to it. For
`instance,
`the Intellikeyboard can have more processing
`power such that it can perform basic computations and will
`not haveto directly communicate with the network server to
`perform certain functions. For example, Intellikeyboard can
`possess more processing power so that it can assign an
`identification number to various appliances and peripherals,
`recognize various appliances and peripherals and so that it
`can assign instructions for these appliances and peripherals
`to execute. Additionally, other features such as data storage
`can be added to the Intellikeyboard. A module or storage
`device can be built into the Intellikeyboard to record and
`store data and voice. For example, this can be accomplished
`by using a PCMCIAcard. The Intellikeyboard can also be
`connected to a mouse, CD-ROM,printer, CRT/TV byeither
`wired or wireless means. As an option a scanner may
`interface with the Intellikeyboard so that documents can
`then be sent to the network server for further processing.
`An object of the invention is to enable a user to use voice
`commands to access the Internet and at
`the same time
`
`command intelligent peripherals and appliances through
`either wired or wireless means.
`
`Anotherobject of the invention is to combine transmitting
`and receiving information, performing standard computing
`functions through use of a network or
`local server,
`interacting, and commanding many intelligent peripheral
`devices around the homeoroffice through wired or wireless
`means,
`telephony, handwriting recognition, bar code
`creation, reading and printing; magnetic stripe creating,
`reading and printing; electronic mail, which may include
`audio, text/graphics, and video; mass storage device and
`display features, video input/output, imaging, audio input/
`output, voice mail capability, voice synthesis,
`language
`translation with text to voice and voice to text capability, and
`other high speed communication features that may be either
`wired or wireless into one device.
`
`Yet another object of the invention is to enable a user to
`translate voice in one language to text or voice in another
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`language. This can be accomplished either by using lan-
`guage translation modules whichfit into the Intellikeyboard
`or by using the software capabilities of the local or network
`server. The output can be in audio, display/video format or
`the Intellikeyboard can command an intelligent peripheral
`such as a printer to convert this output into hard copy format.
`Yet another object of the invention is to enable a user to
`translate text in one language to text or voice in another
`language. This can be accomplished by either using lan-
`guage translation modules whichfit into the Intellikeyboard
`or by using the software capabilities of the local or network
`server. The output can be in audio, display/video format, or
`the Intellikeyboard can command an intelligent peripheral
`such as a printer to convert this output into hard copy format.
`Yet another object of the invention is to enable users to
`communicate with and command the Intellikeyboard
`remotely,
`through either the Internet or through a data
`communication line such as a telephone line.
`Still another object of the invention is to enable a user to
`commandthe Intellikeyboard through voice commands. As
`an example, a user could dictate a messageto the Intellikey-
`board in any language.
`Yet another object of the invention is to enable the
`Intellikeyboard to be able to interact with other intelligent
`peripherals or intelligent appliances. This could involve, for
`instance, interacting with an intelligent television to output
`the keystrokes that are typed on the Intellikeyboard.
`Yet another object of the invention is to enable the
`Intellikeyboard to interact with other devices through either
`wired or wireless means.
`
`Still another object of the Intellikeyboard is to enable the
`device to work in conjunction with a local or network server
`to receive text, voice, or other data and process these inputs
`for either editing, audio, video, and other data output.
`A feature of the Intellikeyboard is to use the computing
`powerof the local or network server to perform complex
`tasks. As an example, a local server may be a personal
`computer.
`Another unique feature of the Intellikeyboardis that it has
`a built-in communication functional block such as a high
`speed transmit/receive device. This high speed transmit/
`receive function enables the Intellikeyboard to access the
`network at very high data rates that are necessary in order to
`transmit and receive data from other devices or from the
`
`network. The ability to transmit/receive may reside within
`the keyboard or be external to it. This access to the the
`Internet, the Intranet, cable network, wireless network, or
`other networks may be via wired or wireless means. As an
`example, the Intellikeyboard may receive/transmit through a
`wireless satellite network. It is anticipated that many intel-
`ligent appliances will have a commontransmit/receive func-
`tion that would operate under common industry standards
`and protocols. These standards would apply both for the
`hardware and the software implementation. These transmit/
`receive functional blocks will be part of the hardware of
`many intelligent appliances/devices.
`Another unique feature of the Intellikeyboard is that it
`could serve as the base station or as a handset for telephony
`with the ability to operate with multiple telephone handsets.
`This will enable the user to transmit and receive using voice
`and selectively display as needed. The telephony may be
`either wired or wireless.
`In accordance with another feature of the invention the
`Intellikeyboard may have options and other devices added
`on to it. For example, extra data/mass storage devices can
`16
`
`16
`
`

`

`US 6,169,789 B1
`
`7
`interact with the Intellikeyboard. This will allow local
`archival of confidential and sensitive messages and data,
`while at the same time will enable the user to access certain
`
`types of data since it is resident locally rather than on the
`network.
`
`Another unique feature of the Intellikeyboard is that it can
`take inputs of written word or spoken word and output a
`synthesized voice through its speakers. The database that
`contains the intonation and phonetic character of the voice
`can reside either in specialized modules whichfit into the
`Intellikeyboard, or on the local or network server, or on the
`Intellikeyboard itself. Various synthesized voices can be
`selected ranging from your own to someone else’s. As an
`example, you could record some selected sounds and it
`would recognize your voice patterns and synthesize it. This
`allows text to be outputted as speech in your own voice or
`another voice.
`
`Anotherobject of the inventionis to enable the Intellikey-
`board to capture images from books, blackboards, white
`boards, paper easel boards, and other displaysto eitherprint,
`process, transmit, or store for future use. As an example, the
`Intellikeyboard may have an image capture capability
`through a digital camera. The image capture capability may
`either be built-in, or be in an optional attachmentor be part
`of a peripheral device that works in tandem with the Intel-
`likeyboard. In this scenario, the Intellikeyboard can digitize
`the text/drawings or other information displayed on a book,
`sheet of paper, blackboard, white board, papereasel, or other
`forms of display for archival, further processing, or trans-
`mission via a network to other locations/devices.
`
`Anotherobject of the inventionis to enable the Intellikey-
`board to use its digital camera, which can be an attachment
`or can be built into the Intellikeyboard, to digitize an image.
`This image can then be converted to either voice or text. As
`an example, if the digital camera took a digitized image of
`a page in a book which might be inconvenient to scan in
`through a page-feed scanner, as opposed to a flat-bed
`scanner, it could then convert this image into text and store
`this as a text document, process this information further,
`could convert the image into voice for further processing, or
`output the voice through the speakers.
`Another object of the invention is to automatically add
`subtitles/text
`to a video clip, which may be displayed
`continuously or frame by frame. The. Intellikeyboard con-
`verts the voice from the video clip into text and is able to
`display this text/subtitle on a CRT or display in any or
`multiple languages. As an example, this option would be of
`great benefit
`to individuals who are hearing impaired.
`Another example of the benefit of this textual display is the
`ability for those watching a movie in one language to hear
`the soundin that language but view the text/subtitles on the
`screen in a different language.
`Another object of the invention is to recognize alpha-
`numeric text to create bar codes. The Intellikeyboard can
`also read bar codes to create alpha-numeric text. With a bar
`code reader attachment which may be wired or wireless the
`Intellikeyboard serves as a vehicle either to print bar code
`labels or to store the digitized bar code information for
`further processing.
`Anotherobject of the inventionis to enable the Intellikey-
`board to serve as a point of sale terminal that can read
`magnetically coated information from credit cards. In this
`configuration, the Intellikeyboard will have a built-in feature
`or an external attachment wherea credit card can be swiped
`across a reader that would be able to read magnetically
`coated information from the credit card for transmission,
`
`10
`
`15
`
`20
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`transaction, and confirmation. The
`verification,
`Intellikeyboard, as an example, may be used in stores to
`conduct transactions. By interacting, and commanding an
`intelligentprinter, the Intellikeyboard would be ableto print.
`It is also anticipated that the Intellikeyboard would be able
`to facilitate home banking, home shopping via this feature
`with the ability to provide printed receipts or storage of
`relevant information on a local and/or network server.
`
`Another object of the invention is to enable a user to input
`handwritten text
`in any specific language and have the
`Intellikeyboard output