(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2002/0026311 A1
`(43) Pub. Date:
`Feb. 28, 2002
`Okitsu
`
`US 20020026311A1
`
`(54) APPARATUS FOR RESPONDING TO SOUND
`ATA REMOTE TERMINAL
`(75) Inventor: Hiromi Okitsu, Hamamatsu (JP)
`Correspondence Address:
`Roger R. Wise
`PILLSBURY WINTHROP LLP
`Suite 2800
`725 South Figueroa Street
`Los Angeles, CA 90017-5406 (US)
`(73) Assignee: YAMAHA CORPORATION
`(21) Appl. No.:
`09/982.404
`(22) Filed:
`Oct. 18, 2001
`Related U.S. Application Data
`(63) Continuation of application No. 09/361,094, filed on
`Jul. 26, 1999.
`Foreign Application Priority Data
`
`(30)
`
`Aug. 3, 1998 (JP)........................................... 10-219.309
`
`Publication Classification
`
`(51) Int. Cl." ........................... G10L 21/00; G1OL 19/00
`
`(52) U.S. Cl. .............................................................. 704/201
`
`(57)
`
`ABSTRACT
`
`An information apparatus is constructed for notifying output
`information to a remote terminal in response to an input
`Signal of a Sound. In the information apparatus, a first
`memory block memorizes characteristic data representing
`characteristics of various Sounds. A Second memory block
`memorizes various items of output information in corre
`spondence to the characteristic data of the various Sounds
`Such that each item of the output information is associated
`to each Sound. An input device collects a Sound to provide
`an input signal of the collected Sound. An analyzer device
`extracts characteristic data from the input signal of the
`collected Sound. A controller device operates according to
`the extracted characteristic data for addressing the first
`memory block and the second memory block to identity the
`item of the output information corresponding to the col
`lected Sound. A transmitter device transmits the identified
`item of the output information to the remote terminal. A new
`Sound and a corresponding item of output information can
`be registered for updating the first memory block and the
`Second memory block Such that the analyzer device extracts
`new characteristic data from the new Sound. The controller
`device registers the extracted new characteristic data into the
`first memory block and registers the corresponding item of
`the output information into the Second memory block.
`
`O
`
`MICROPHONE
`
`
`
`
`
`
`
`
`
`
`
`CONTROLLER
`
`TRANSMITTER/
`RECEIVER
`E
`
`
`
`
`
`
`
`
`
`
`
`RECEIPT
`NOTIFYING
`BLOCK
`
`
`
`gastressic"
`
`MORY
`
`BLOCK
`
`INFORMATION
`MEMORY BLOCK
`
`52
`
`Exhibit 1019
`Page 01 of 13
`
`

`

`Patent Application Publication Feb. 28, 2002 Sheet 1 of 3
`F. G. 1
`
`US 2002/0026311 A1
`
`M
`d
`
`5O
`
`characteristics
`DATA MEMORY
`
`MEMORY BLOCK
`
`
`
`
`
`
`
`
`
`1O
`
`MICROPHONE
`
`2O
`
`30
`
`A/D
`CONVERTER
`
`FREQUENCY
`ANALYZER
`
`40
`
`CONTROLLER
`
`
`
`RECEIVER
`
`INFORMATION
`RECEIPT
`NOTIFYING DISPLAY
`BLOCK
`BLOCK
`
`Exhibit 1019
`Page 02 of 13
`
`

`

`Patent Application Publication
`
`Feb. 28, 2002 Sheet 2 of 3
`
`US 2002/0026311 Al
`
`
`
`aqaATHOdAa
`
`
`
`MDOTdTHONVD
`
`
`
`05LSOeOeL9-7~]ONIAVdINOONAMOd
`SMOOTHANOWAINadATHONELNANAONNONNV
`
`
`
`ANOWEWViva|/———_teNOLLVOOTHOMNOS
`
`OLLSTNALLOVEVHO29|~DOOTd
`NOILVWAOANI/pe8SMOOTHMOOTHONIASTINACI
`
`cS/SALLINSNVAL
`
`a]|ALAAONLLOALA
`SNOHdONOIN][ANOHAONOIN][ANOHAONODA-—|éOlas
`
`
`
`LL
`
`LL
`
`
`
`NOILVOOTHOINOS
`
`09
`
`Exhibit 1019
`
`Page 03 of 13
`
`Exhibit 1019
`Page 03 of 13
`
`
`
`
`
`

`

`Patent Application Publication Feb. 28, 2002. Sheet 3 of 3
`
`US 2002/0026311 A1
`
`F. G. 3
`
`PRIOR ART
`
`O
`
`12O
`
`130
`
`VOICE INPUT BLOCK
`
`VOICE ANALYZING
`BLOCK
`
`
`
`50
`1
`
`
`
`CHARACTERISTIC DATA
`EXTRACTING BLOCK
`140
`CHARACTERISTIC DATA
`CHARACTERISTIC DATA
`N MEMORY BLOCK
`MATCHING BLOCK
`16O
`17O
`INFORMATION OUTPUT Cs INFORMATION MEMORY
`BLOCK
`BLOCK
`
`
`
`
`
`Exhibit 1019
`Page 04 of 13
`
`

`

`US 2002/0026311 A1
`
`Feb. 28, 2002
`
`APPARATUS FOR RESPONDING TO SOUNDATA
`REMOTE TERMINAL
`
`BACKGROUND OF THE INVENTION
`0001) 1. Field of the Invention
`0002 The present invention generally relates to an infor
`mation announcing apparatus, an information announcing
`terminal device, and a method of controlling the information
`announcing apparatus. More particularly, the present inven
`tion relates to an information announcing apparatus, an
`information announcing terminal device, and a method of
`controlling the information announcing apparatus, that can
`detect and recognize a Sound Signal and that can notify a user
`of the information based on the recognition.
`0003 2. Description of Related Art
`0004 Voice recognition equipment is known in which a
`Voice Signal is detected, analyzed, and matched with one of
`recorded Voice patterns. Then, the matching pattern is
`retrieved to identify the Voice Signal. Thus, the known Voice
`recognition equipment detects from among recorded Voice
`patterns a corresponding Voice, and displays the kind and
`contents of the Voice Signal.
`0005 The following describes a general configuration of
`the known voice recognition equipment with reference to
`FIG. 3. As shown, a voice input block 110 detects a voice
`Signal and converts the same into an electrical Signal, which
`is then supplied to a voice analyzing block 120. The voice
`analyzing block 120 analyzes the frequency of the electrical
`Signal, and Supplies the analyzed results to a characteristic
`data eXtracting block 130. The characteristic data extracting
`block 130 extracts characteristic data of the frequency
`analyzed voice Signal, and Supplies the extracted character
`istic data to a characteristic data matching block 140. The
`characteristic data matching block 140 compares the
`extracted characteristic data with each of plural voice pat
`terns stored in a characteristic data memory block 150 to
`retrieve a matching Voice pattern.
`0006 Consequently, in response to the matching voice
`pattern stored in the characteristic data memory block 150,
`an information output block 170 reads output information
`asSociated to the corresponding voice characteristic pattern
`from an information memory block 160 which stores the
`output information for use by the user to evaluate and
`respond to the Voice signal. Then, the information output
`block 170 produces the output information on a screen
`display or in the form of audio announcement.
`0007. However, in the conventional voice recognition
`equipment, the characteristic data memory block 150 only
`Stores pre-Selected characteristic patterns in advance. There
`fore, new voice patterns cannot be Stored after factory
`Shipment. This disables the conventional voice recognition
`equipment to notify the user of the detection of a new Voice
`Signal that is not stored in the characteristic data memory
`block 150.
`0008 An aid device for notifying auditory handicapped
`perSons of the detection of an input voice Signal by media
`other than audio is disclosed in Japanese Published Unex
`amined Patent Application No. Hei 7-93669. With the dis
`closed device, if an alarm Siren of an ambulance generated
`from a loudspeaker of a television Set is incidentally picked
`
`up, the false alarm Siren is erroneously recognized as a real
`alarm Sound, thereby notifying the auditory handicapped
`perSon of the false information or message.
`0009. The conventional voice recognition equipment is
`constructed So that the Voice input block and the information
`output block cannot be arranged at widely Spaced locations.
`This construction limits the Voice detecting range. In addi
`tion, the conventional equipment cannot allocate a Source
`point of a voice Signal. Consequently, the conventional
`equipment cannot provide information Sufficient for the aid
`of auditory handicapped perSons.
`
`SUMMARY OF THE INVENTION
`0010. It is therefore an object of the present invention to
`provide an information announcing apparatus, an informa
`tion announcing remote terminal, and a method of control
`ling the information announcing apparatus, which allow the
`user to register any desired Sounds and prevent a false
`announcement caused by an artificial Sound from a televi
`Sion Set or else.
`0011. In a first aspect of the invention, an information
`apparatus is constructed for notifying output information to
`a remote terminal in response to an input Signal of a Sound.
`The information apparatus is comprised of a first memory
`block that memorizes characteristic data representing char
`acteristics of various Sounds, a Second memory block that
`memorizes various items of output information in corre
`spondence to the characteristic data of the various Sounds
`Such that each item of the output information is associated
`to each Sound, an input device that collects a Sound to
`provide an input Signal of the collected Sound, an analyzer
`device that extracts characteristic data from the input Signal
`of the collected Sound, a controller device that operates
`according to the extracted characteristic data for addressing
`the first memory block and the second memory block to
`identity the item of the output information corresponding to
`the collected Sound, and a transmitter device that transmits
`the identified item of the output information to the remote
`terminal, wherein a new Sound and a corresponding item of
`output information can be registered for updating the first
`memory block and the Second memory block Such that the
`analyzer device extracts new characteristic data from the
`new Sound, and the controller device registers the extracted
`new characteristic data into the first memory block and
`registers the corresponding item of the output information
`into the Second memory block.
`0012. In a second aspect of the invention, an information
`apparatus is constructed for notifying output information to
`a remote terminal in response to an input Signal of a Sound.
`The information apparatus is comprised of a first memory
`block that memorizes characteristic data representing char
`acteristics of various Sounds, a Second memory block that
`memorizes various items of output information in corre
`spondence to the characteristic data of the various Sounds
`Such that each item of the output information is associated
`to each Sound, a plurality of input devices that are spatially
`distributed to collect a Sound from a Source location, and that
`respectively provide input signals of the Same Sound, a
`detector device that processes the input Signals provided
`from the spatially distributed input devices to detect the
`Source location of the Sound, an analyzer device that extracts
`characteristic data from at least one of the input Signals of
`
`Exhibit 1019
`Page 05 of 13
`
`

`

`US 2002/0026311 A1
`
`Feb. 28, 2002
`
`the collected Sound, a controller device that operates accord
`ing to the extracted characteristic data for addressing the first
`memory block and the second memory block to identity the
`item of the output information corresponding to the col
`lected Sound, and a transmitter device that transmits the
`identified item of the output information to the remote
`terminal together with the detected Source location of the
`Sound. Preferably, the information apparatus further com
`prises a canceler device that checks whether the output
`information associated to the Sound is true or false according
`to the Source location of the Sound, and that cancels trans
`mission of the output information if the output information
`is false.
`0013 In a specific form, the analyzer device analyzes a
`frequency Spectrum of the Sound to extract therefrom a
`characteristic pattern, which is memorized as the character
`istic data in the first memory block, and the controller device
`uses the characteristic pattern as an indeX to identity the item
`of the output information corresponding to the Sound.
`0.014. The inventive remote terminal for use in combina
`tion with the inventive information apparatus of the first
`aspect is comprised of a receiver device that receives the
`output information transmitted from the information appa
`ratus, a Stimulator device that is activated when the output
`information is received by the receiver device for physically
`Stimulating a user of the remote terminal to draw attention
`of the user to the output information, a display device that
`displays the received output information Such that the Stimu
`lated user can readily read the output information, a com
`mander device that is operated by the user when a new Sound
`is to be registered for inputting a command effective to
`activate the analyzer device of the information apparatus to
`extract the characteristic data from the new Sound and to
`enable the controller device of the information apparatus to
`register the characteristic data together with the correspond
`ing item of the output information, and a transmitter device
`that transmits the inputted command to the information
`apparatuS.
`0.015 The inventive remote terminal for use in combina
`tion with the inventive information apparatus of the Second
`aspect is comprised of a receiver device that receives the
`output information transmitted from the information appa
`ratus, a Stimulator device that is activated when the output
`information is received by the receiver device for physically
`Stimulating a user of the remote terminal to draw attention
`of the user to the output information, and a display device
`that displays the received output information Such that the
`Stimulated user can readily read the output information.
`0016 Further, an inventive informing method is designed
`for notifying output information to a remote terminal in
`response to an input signal of a Sound. The informing
`method is comprised of the Steps of memorizing character
`istic data representing characteristics of various Sounds in a
`first memory, memorizing various items of output informa
`tion in correspondence to the characteristic data of the
`various Sounds in a Second memory Such that each item of
`the output information is associated to each Sound, collect
`ing a Sound to provide an input Signal of the collected Sound,
`extracting characteristic data from the input Signal of the
`collected Sound, addressing the first memory and the Second
`memory based on the extracted characteristic data to identity
`the item of the output information corresponding to the
`
`collected Sound, transmitting the identified item of the
`output information to the remote terminal, and registering a
`new Sound and a corresponding item of output information
`to update the first memory and the Second memory Such that
`new characteristic data is extracted from the new Sound and
`the corresponding item of the output information is deter
`mined in association with the new Sound, and then the
`extracted new characteristic data is memorized in the first
`memory while the corresponding item of the output infor
`mation is memorized in the Second memory.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0017. These and other objects of the invention will be
`Seen by reference to the description, taken in connection
`with the accompanying drawings, in which:
`0018 FIG. 1 is a block diagram illustrating a first pre
`ferred embodiment of the invention;
`0019 FIG. 2 is a block diagram illustrating a second
`preferred embodiment of the invention; and
`0020 FIG. 3 is a block diagram illustrating the configu
`ration of a conventional voice recognition apparatus.
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENTS
`0021. This invention will be described in further detail by
`way of example with reference to the accompanying draw
`ings.
`0022, 1 First Preferred Embodiment
`0023 1.1 System Configuration
`0024 Now, referring to FIG. 1, reference numeral 10
`denotes a microphone that is an input device for converting
`a collected Sound into an analog electrical input signal.
`Reference numeral 20 denotes an A/D (Analog to Digital)
`converter for Sampling the analog input Signal and convert
`ing the Sampled Signal into a digital Signal. Reference
`numeral 30 denotes a frequency analyzer for performing
`frequency Spectrum analysis on the digital Sound Signal
`through FFT (Fast Fourier Transform) for example. Refer
`ence numeral 40 denotes a controller including a central
`processing unit (CPU) for controlling the operation of the
`entire information announcing apparatus. The operation
`includes Steps of executing Sound pattern extraction, pattern
`matching, and Voice recognition. Reference numeral 50
`denotes a memory device for Storing the patterns of various
`sound signals extracted by the controller 40 and items of
`announcement information associated with these patterns.
`Reference numeral 70 denotes an information transmitter/
`receiver for converting the announcement information based
`on the Sound analysis into a radio signal, transmits the same
`to another information transmitter/receiver 80. In return, the
`information transmitter/receiver 70 receives an operation
`command and other commands from the information trans
`mitter/receiver 80 of a remote terminal. The information
`transmitter 80 converts the radio signal into the announce
`ment Signal again to notify the user of the information, and
`transmits an operation command to the controller 40 of the
`information announcement apparatus.
`0025 The memory device 50 is composed of a charac
`teristic data memory block 51 for Storing characteristic data
`of various input Sounds in the form of Sound patterns, and an
`
`Exhibit 1019
`Page 06 of 13
`
`

`

`US 2002/0026311 A1
`
`Feb. 28, 2002
`
`information memory block 52 for Storing the announcement
`information associated with the Stored Sound patterns.
`0026. The inventive information apparatus of FIG. 1 is
`constructed for notifying output information to the remote
`terminal in response to an input signal of a Sound. In the
`information apparatus, the first memory block 51 memorizes
`characteristic data representing characteristics of various
`sounds. The second memory block 52 memorizes various
`items of output information in correspondence to the char
`acteristic data of the various Sounds Such that each item of
`the output information or phrase is associated to each Sound.
`The input device composed of the microphone 10 collects a
`Sound to provide an input Signal of the collected Sound. An
`analyzer device including the frequency analyzer 30 extracts
`characteristic data from the input Signal of the collected
`sound. The controller device 40 operates according to the
`extracted characteristic data for addressing the first memory
`block 51 and the second memory block 52 to identity the
`item of the output information corresponding to the col
`lected Sound. A transmitter device contained in the trans
`mitter/receiver 70 transmits the identified item of the output
`information to a receiver device contained in the transmitter/
`receiver 80 of the remote terminal. The inventive informa
`tion apparatus has a registration mode, in which a new Sound
`and a corresponding item of output information can be
`registered for updating the first memory block 51 and the
`second memory block 52 such that the analyzer device
`extracts new characteristic data from the new Sound, and the
`controller device 40 registers the extracted new character
`istic data into the first memory block 51 and registers the
`corresponding item of the output information into the Second
`memory block 52.
`0027. The remote terminal includes the transmitter/re
`ceiver 80, an receipt notifying block 81 for telling the
`dispatch of the information from the information transmitter/
`receiver 70, an information display block 82, and a com
`mand input block 83 for transmitting an operation command
`to the controller 40 by means of a radio signal, thereby
`constituting a radio communication System capable of
`announcing the information in text and image (including
`motion pictures).
`0028. In the above-mentioned configuration, the infor
`mation transmitter/receiver 70 of the information apparatus
`and the information transmitter/receiver 80 of the remote
`terminal may be replaced by a transmitter/receiver equip
`ment having the capabilities equivalent to those of commer
`cially available PHS (Personal Handy-phone System),
`mobile telephone, and transceiver having a display capabil
`ity for displaying announcement information and a termi
`nation indicating capability by means of physical Stimula
`tion such as vibration and light. When utilizing only the
`receiving capability of the information transmitter/receiver
`80, the same may be replaced by a radio Signal receiving
`device Such as a pager.
`0029) 1.2 General Configurations and Operations of Fre
`quency Analyzer and Controller
`0030) The following describes the details of the fre
`quency analyzer 30 and the controller 40 shown in FIG. 1.
`The frequency analyzer 30 performs FFT for example on an
`input Sound Signal Supplied from the A/D converter 20, and
`develops the transformed Sound Signal to the time-Series
`Spectrum of frequency and amplitude variations, thereby
`
`providing a Sound Spectrum. The Sound spectrum is Supplied
`to the controller 40 in which a Sound pattern characterizing
`the Sound is extracted from the Sound Spectrum. The
`extracted Sound pattern indicates the characteristics unique
`to the timbre and tone of the Sound. If the information
`announcing apparatus according to the invention is Set to the
`registration mode, the extracted Sound pattern is Stored in the
`characteristic data memory block 51 of the memory device
`50 under the control of the controller 40. Namely, in the
`inventive information apparatus, the analyzer device includ
`ing the frequency analyzer 30 and controller 40 analyzes a
`frequency Spectrum of the Sound to extract therefrom a
`characteristic pattern, which is memorized as the character
`istic data in the first memory block 51, and the controller 40
`uses the characteristic pattern as an indeX to identity the item
`of the output information corresponding to the Sound.
`0031) If the information announcing apparatus according
`to the invention is Set to a normal recognition mode, the
`controller 40 Sequentially compares the extracted Sound
`pattern with the plural Sound patterns Stored in the charac
`teristic data memory block 51, thereby identifying the best
`matching one (for example, a Sound pattern having the
`closest similarity) as the Sound pattern of the input Sound. In
`doing So, a So-called pattern matching technique is used.
`0032. Next, the announcement information correspond
`ing to the matching Sound pattern is read from the informa
`tion memory block 52. This information is converted by the
`information transmitter/receiver 70 into a radio signal, and
`is dispatched to the information transmitter/receiver 80 of
`the remote terminal.
`0033 1.3 Operation of the Information Announcing Sys
`tem
`0034. The following describes the operation of the infor
`mation announcing System. The information announcing
`System practiced as the first preferred embodiment of the
`invention has the two operating modes: the registration
`mode in which Sound patterns are Stored in the characteristic
`data memory block 51 and the announcement information
`corresponding to these Sound patterns is Stored in the
`information memory block 52, and the recognition mode in
`which a Sound pattern extracted from the input Sound is
`matched against the Sound patterns Stored in the character
`istic data memory block 51 for identifying one having the
`closest Similarity. Before describing the operation of the
`information announcing System, these operating modes will
`be described below.
`0035) 1.3.1 Registration Mode
`0036 When registering the information or phrase asso
`ciated to an input Sound Signal to be recognized by the
`information announcing apparatus, the registration mode is
`Selected in the operating mode Setting. When the registration
`mode is Selected and a Sound Signal to be recognized is
`inputted through the microphone 10, the Sound pattern of the
`inputted Sound Signal is extracted by the frequency analyzer
`30 and the controller 40. The extracted sound pattern is
`stored in the first memory block 51 via the controller 40. It
`should be noted that the new Sound Signal to be Stored may
`include not only a human Voice but also a telephone ringing
`tone, an alarm Sound, a bark of dog, and So on. In addition,
`the announcement information or phrase for telling the
`meaning and contents of the Sound Signal is Stored in the
`
`Exhibit 1019
`Page 07 of 13
`
`

`

`US 2002/0026311 A1
`
`Feb. 28, 2002
`
`information memory block 52 of the memory device 50 via
`an input tool Such as keyboard (not shown) or via the
`information transmitter/receiver 80. This announcement
`information is determined for telling the user of the remote
`terminal about the meaning and contents of the detected
`Sound Signal. This information includes data for displaying
`a text and a still image (or a motion picture) and a signal for
`telling a kind of the input Sound by means of light, color, or
`Vibration. The announcement information in the information
`memory block 52 is Stored in one-to-one correspondence to
`each Sound pattern Stored in the characteristic data memory
`block 51.
`0037 AS described, the inventive informing method is
`designed for notifying output information to a remote ter
`minal in response to an input Signal of a Sound. The
`informing method is comprised of the Steps of memorizing
`characteristic data representing characteristics of various
`Sounds in the first memory block 51, memorizing various
`items of output information in correspondence to the char
`acteristic data of the various Sounds in the Second memory
`block 52 such that each item of the output information is
`asSociated to each Sound, collecting a Sound to provide an
`input Signal of the collected Sound, extracting characteristic
`data from the input Signal of the collected Sound, addressing
`the first memory block 51 and the second memory block 52
`based on the extracted characteristic data to identity the item
`of the output information corresponding to the collected
`Sound, transmitting the identified item of the output infor
`mation to the remote terminal, and registering a new Sound
`and a corresponding item of output information to update the
`first memory block 51 and the second memory block 52 such
`that new characteristic data is extracted from the new Sound
`and the corresponding item of the output information is
`determined in association with the new Sound, and then the
`extracted new characteristic data is memorized in the first
`memory block 51 while the corresponding item of the output
`information is memorized in the second memory block 52.
`0038 1.3.2 Recognition Mode
`0039. In the recognition mode, the kind and contents of
`an inputted Sound Signal is recognized. When the recogni
`tion mode is Selected, a Sound Signal inputted through the
`microphone 10 is converted by the A/D converter 20 into a
`digital Signal. The frequency analyzer 30 develops the
`digital Sound Signal into a frequency Spectrum by means of
`FFT for example, and analyzes the frequency spectrum to
`extract a Sound pattern. The controller 40 compares the
`extracted Sound pattern with the Sound patterns Stored in the
`characteristic data memory block 51 to identify one sound
`pattern that has the closest similarity. Then, the controller 40
`reads the announcement information associated with the
`recognized Sound pattern from the information memory
`block 52, and sends this information to the information
`transmitter/receiver 70. The announcement information is
`converted by the information transmitter/receiver 70 into a
`radio signal, which is Sent to the information transmitter/
`receiver 80 of the separate remote terminal.
`0040 1.3.2.1 Treatment of Announcement Information in
`Remote Terminal
`0041. The announcement information received from the
`information transmitter/receiver 70 is displayed on the infor
`mation display block 82 of the remote terminal. This
`announcement information is the data for use in displaying
`
`text, graphics, and/or images, and is provisionally Stored in
`the information memory block 52 in corresponding relation
`with the items of the Sounds (or the Sound patterns) stored
`in the characteristic data memory block 51. When the
`announcement information is received by radio from the
`information transmitter/receiver 70, the receipt notifying
`block 81 Starts operating, for telling, by means of light
`and/or vibration, the terminal user of the arrival of the
`announcement information from the information transmit
`ter/receiver 70. Then, when the user depresses a receive
`button of the information transmitter/receiver 80, the
`announcement information is displayed on the information
`display block 82. As described, the information memory
`block 52 stores the plural items of the announcement infor
`mation to be displayed on the information display block 82
`in corresponding relation with the Sound patterns. The
`announcement information Stored in the information
`memory block 52 is used to display the contents of the
`recognized Sound in text and/or graphics. The announce
`ment information tells the user, at a glance, of what kind of
`Sound has occurred.
`0042 1.4 Selection and Setting of Operating Modes
`0043. An operating mode can be selected and set also by
`Sending, by radio, an operating mode Selection and Setting
`command from the command input block 83 of the remote
`terminal to the information transmitter/receiver 70. When
`Selecting and Setting an operating mode from the command
`input block 83, the user Selects and inputs by pressing one
`button corresponding to the registration mode or another
`button corresponding to the recognition mode on the oper
`ating mode Selection and Setting Screen of the information
`display block 82.
`0044) 1.5 Effects of First Preferred Embodiment
`0045 According to the first preferred embodiment of the
`invention, the information announcing System is provided
`with the registration mode for inputting and Storing desired
`Sound Signals and their corresponding announcement infor
`mation, thereby allowing the user to make the information
`announcing apparatus recognize a desired Sound Signal.
`0046. In addition, a command for the operating mode
`Selection and Setting is inputted from the command input
`block 83 of the remote terminal. The inputted command is
`Sent by a radio wave to the information transmitter/receiver
`70 to control the controller 40 of the information announcing
`apparatus. This constitution allows the user to remotely
`Select and Set the operation mode of the information
`announcing apparatus from the information transmitter/re
`ceiver 80 of the remote terminal. Within a range in which
`radio communication is enabled between the information
`transmitter/receiver 70 and the information transmitter/re
`ceiver 80, the information transmitter/receiver 80 becomes
`available as a portable device. Consequently, the novel
`constitution can transmit aid information to the user Such as
`an auditory handicapped perSon, who is remote from the
`Sound input device of the information announcing apparatus,
`and allows the user to command the operation of the
`information announcing apparatus.
`0047 The inventive remote terminal is designed for use
`in combination with the inventive information apparatus. In
`the remote terminal, the receiver device contained in the
`transmitter/receiver 80 receives the output information
`
`Exhibit 1019
`Page 08 of 13
`
`

`

`US 2002/0026311 A1
`
`Feb. 28, 2002
`
`transmitted from the information apparatus. A Stimulator
`device composed of the receipt notifying block 81 is acti
`vated when the output information is received by the
`receiver device for physically Stimulating a user of the
`remote terminal to draw attention of the user to the output
`information. The display device 82 displays the received
`output information Such that the Stimulated user can readily
`read the output information. The command input device 83
`is operated by the user when a new Sound is to be registered
`for inputting a command effective to activate the analyzer
`device of the information apparatus to extract the charac
`teristic data from the new Sound and to enable the controller
`device of the information apparatus to register the charac
`teristic data together with the corresponding item of the
`output information. A transmitter device contained in the
`transmitter/receiver 80 transmits the inputted command to
`the information apparatus.
`0048 2. Second Preferred Embodiment
`0049 2.1 System Configuration
`0050. The following describes a second preferred
`embodiment of the invention with reference to FIG. 2. The
`second preferred embodiment differs from the first preferred
`embodiment in that the Second preferred embodiment has a
`plurality of