United States Patent [191
`Tsumura et al.
`
`Us005208413A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,208,413
`May 4, 1993
`
`[54]
`[75]
`
`[73]
`[21]
`[22]
`
`Japan .................................. .. 346983
`
`VOCAL DISPLAY DEVICE
`Mihoji Tsumura; Shinnosuke
`Inventors:
`Tam'guchi, both of Osaka, Japan
`Assignee: Ricos C0,, Ltd., Japan
`Appl. No.: 803,155
`Filed:
`Dec. 5, 1991
`Foreign Application Priority Data
`Jan. 16, 1991 [JP]
`Jan. 16, 1991 [JP]
`Jan. 16, 1991 [JP]
`Jan. 16, 1991 [JP]
`Jan. 16, 1991 [JP]
`
`Japan .................................. .. 3-16987
`
`Int. Cl.5 ...................... .. G11B 20/02; GlOG 7/02
`U.S. Cl. ...................................... .. 84/615; 84/462;
`
`‘
`
`'
`
`84/610
`
`Field of Search ............... .. 84/601, 602, 615, 647,
`84/653, 454, 609, 610, 625, 634, 477 R, 463
`References Cited
`U.S. PATENT DOCUMENTS
`
`4,120,229 10/1978 Ota ...................................... .. 84/454 '
`5,046,004 9/1991 Tsumura et al. .................. .. 364/419
`
`FOREIGN PATENT DOCUMENTS
`1-184685 7/l989 Japan.
`2-62760 3/1990 Japan.
`
`2-153665 6/1990 Japan .
`2-183660 7/1990 Japan .
`2-192259 7/1990 Japan .
`
`Primary Examiner-William M. Shoop, Jr. >
`Assistant Examiner—Helen Kim
`Attorney, Agent, or Firm—Thompson, Hine and Flory
`[57]
`ABSTRACT
`Conventional karaoke devices simply show lyrics on
`screen. This invention displays not only lyrics but also
`data useful for the enhancement of the singer’s presenta
`tion such as the strength of the vocals and the pitch.
`More precisely, vocal data, which indicates the special
`' requisites of a speci?c vocal rendition such as its
`strength and pitch, and the current lyric position indica
`tor, which marks the current position in the lyrics, are
`correlated with the music data to which they corre
`spond and then stored in memory. The said vocal data
`and current lyric position data are then read out of
`memory and each block of vocal data is displayed on
`the screen of a visual display medium a little in advance
`of the music to which it corresponds while the current
`lyric position within said block of vocal data is indi
`cated in time with the music. Moreover, the strength
`and basic frequency of an actual vocal rendition can be
`detected and compared with the stored vocal data.
`
`9 Claims, 9 Drawing Sheets
`
`[no
`
`[120
`
`f I40
`
`MEMORY 1-—- VOCAL --> '"AGE _-{F"“_1
`1
`RQQJQR
`‘
`A CONTROL
`;
`L____.1
`
`LYRIC
`POSITION
`READER
`
`Page 1 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`US. Patent
`
`May 4, 1993
`
`Sheet 1 0f 9
`
`5,208,413
`
`fuo
`
`[I20
`
`{I40
`
`MEMORY -—- om ‘—- ‘"AGE
`‘
`READER ‘
`, CONTROL
`
`I
`‘—-1'
`L _ _ __J|
`
`I
`
`LYRIC
`
`PQSIHON
`
`Page 2 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`U.S. Patent
`
`May 4, 1993
`
`Sheet 2 of 9
`
`5,208
`
`,413
`
`on.-25
`
`93.:
`
`N I E
`
`2
`u.
`
`55:6
`
`<3:
`
`$5.53
`
`<2:
`
`
`
` 85:3“<2:3T553$
`
`Page 3 of 18
`
`PET|T|ONERS' EXHIBIT 1002
`
`Page 3 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`
`
`
`

`
`US. Patent
`
`May 4,1993
`
`Sheet 3p!’ 9
`
`5,208,413
`
`HQRiZONTAL
`UNH' ‘HME
`
`A
`
`2
`
`1
`
`3
`
`2
`
`4
`
`3
`
`5
`
`4
`
`VOCAL DATA
`
`5
`
`MUSIC DATA
`
`/G
`I
`
`(L
`\
`
`50
`{
`
`i
`
`w
`
`a
`
`FIG - 4
`
`r210
`
`_ _ _ _
`r240
`/ 220
`F
`WAGE
`VOCAL
`“l
`MEMORY ——- om ——> CONTROL —-g
`:
`READER
`*
`l___ __J
`
`LYRIC
`L- POSITION
`READER
`\zso
`
`F | G - 5
`
`f3")
`MEMORY
`
`/52°
`VOCAL
`om
`READER
`LYRIC
`POSITION
`330 ~ READER
`
`.
`
`[34o
`IMAGE
`-- CQNTROL
`
`1"""7
`‘-—--I
`I
`L_ _ __:
`
`DLEETVEECLT
`
`380
`
`FIG - 6
`
`Page 4 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`US. Patent
`
`May 4, 1993
`
`Sheet 4 of 9
`
`5,208,413
`
`2:2:
`
`__ '____""'___l
`
`Page 5 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`US. Patent
`
`May 4, 1993
`
`Sheet 5 of 9
`
`5,208,413
`
`FIG-8
`
`4:0
`f
`
`420
`/
`"8m
`1 READER
`
`[44°
`
`Page 6 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`U
`
`311
`
`%OTO_n_
`
`4.9_
`
`u2
`
`,:5___$__KN:"M_F.I...:|||||ll...l.lIL0‘ul-
`W..E3_55::."_:3___m_Txse
`
`m...“uIaau|I:.I:I:I.iu«..:..I..
`8..M.55::4/2:
`
`QM9:.as
`
`
`
` §_IIIIJ_ES.__..........--._N..._P“:55:
`
`Page 7 of 18
`
`PET|T|ONERS' EXHIBIT 1002
`
`Page 7 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`
`

`
`US. Patent
`
`May 4,1993
`
`Sheet 7 on
`
`5,208,413
`
`484
`/
`
`/484E
`
`COMP
`
`A
`
`r4848
`[484A
`SAND _, wAvE
`* A’EEA
`DEW
`
`/484A
`W0
`H F??éa
`
`[434B
`WAVE
`DETECT
`
`[484C
`'"T
`
`[48%
`m
`
`L-q I
`'
`
`:
`l
`l
`l
`
`E
`|__
`
`r484A
`BAND
`55%
`
`(434a
`DEW
`
`__, WM
`
`£483
`i“ "7
`DIVIDE ;
`:
`|______l FIG-11
`
`[5K1
`MEMORY
`
`[520
`‘40%?
`—L READER
`YR";
`PbSITlON
`READ
`
`53o” LEVEL
`DETECT
`
`\580
`
`[540
`‘ms r" ___I
`'
`J
`CONTROL
`:______:
`
`V
`
`_
`
`Page 8 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`U.S. Patent
`
`May 4, 1993
`
`Sheet 8 of 9
`
`5,208,413
`
`so
`
`as“2:23—|
`
`an
`
`lI|..|IIIl|.I.l|'|||lIII
`
`.52::,.E§..mauI...
`
`I
`
`so
`
`Page 9 of 18
`
`PET|T|ONERS' EXHIBIT 1002
`
`Page 9 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`
`

`
`U.S. Patent
`
`4
`
`B
`
`ova
`
`ma<=_
`
`.°¢_=°o
`
`cww
`
`°_¢
`
`4<oo>
`
`<p<a
`
`¢ma<wz
`
`o_=,4
`
`.5.F39..
`
`=wa¢mz
`
`cmm
`
`>zc=w:
`
`W¢._-0_..._asE
`
`cam
`
`3as55Ims.2m,:55:
`
`ImI“5.I.TT\as
`4.,I5...
`
`.5E~$.2IIIHIIIIIIIIIII.HMH.HHMI.7IIIIIII.En9as_mm_..m.=5._2:2EEn3.w_FIIIIIIIIL.m\w_Q.cc»?E:55::H5::5::EEscan_FIII!III!llllIIIIIIL
`
`Page 10 of 18
`
`PET|T|ONERS' EXHIBIT 1002
`
`Page 10 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`
`
`
`

`
`1
`
`VOCAL DISPLAY DEVICE
`
`BACKGROUND OF THE INVENTION
`1. Field of the Invention
`This invention relates to a device for the display of
`vocal features such as strength and pitch during the
`reproduction of music for vocal accompaniment.
`2. Description of the Prior Art
`The conventional type of karaoke device is normally
`understood to involve the reproduction of karaoke
`music using some kind of music reproduction device
`while at the same time displaying the appropriate lyrics
`in time with the music on a visual display medium. The
`applicant has made a number of other patent applica
`tions in connection with this type of technology (for
`example, Japanese Patent Application 863-308503, Jap
`anese Patent Application Ill-3086, Japanese Patent
`Application Ill-11298).
`Although this sort of device makes it quite easy for a
`user to check the lyrics of a song as he is singing along,
`there are nevertheless other items of data which a singer
`also needs in order to improve his general rendition of a
`song.
`
`5,208,413
`2
`ceptual illustration of the con?guration of the music
`data and FIG. 4 illustrates the sort of screen display
`which would be presented on the visual display me
`dium.
`FIG. 5 is a block diagram illustrating the basic con?g
`uration of the second preferred embodiment of the in
`vention.
`FIG. 6 to FIG. 8 illustrate the third preferred em
`bodiment of the invention where FIG. 6 is a block dia
`gram illustrating the basic con?guration of the inven
`tion, FIG. 7 is a block diagram illustrating the con?gu
`ration of the invention in more detail and FIG. 8 illus
`trates the sort of screen display which would be pres
`ented on the visual display medium.
`FIG. 9 to FIG. 11 illustrate the fourth preferred em
`bodiment of the invention where FIG. 9 is a block dia
`gram illustrating the basic con?guration of the inven
`- tion, FIG. 10 is a block diagram illustrating the con?gu
`ration of the invention in more detail and FIG. 11 is a
`block diagram illustrating the con?guration of the fre
`quency analyzer.
`FIG. 12 and FIG. 13 illustrate the fifth preferred
`embodiment of the invention where FIG. 12 is a block
`diagram illustrating the basic con?guration of the in
`vention and FIG. 13 is a block diagram illustrating the
`con?guration of the invention in more detail.
`FIG. 14 and FIG. 15 illustrate the sixth preferred
`embodiment of the invention where FIG. 14 is a block
`diagram illustrating the basic con?guration of the in
`vention and FIG. 15 is a block diagram illustrating the
`con?guration of the invention in more detail.
`
`25
`
`SUMMARY OF THE INVENTION
`It is an object of this invention to provide a vocal
`display device on which to display features of vocal
`presentation such as strength and pitch and which could
`easily be ?tted to a karaoke device of the sort outlined
`above. In order to achieve the above object, this inven
`tion has been designed in such a way as to enable vocal
`data, which indicates the special features of a speci?c
`vocal rendition such as its strength and pitch, and the
`current lyric position indicator, which marks the cur
`rent position in the lyrics, to be correlated with the
`music data to which it corresponds and then stored in
`memory. The invention also enables said vocal data and
`said current lyric position data to be read out of mem
`ory and each block of vocal data to be displayed on the
`screen of a visual display medium somewhat in advance
`of the music to which it corresponds and the current
`lyric position within said block of vocal data to be indi
`cated in time with the music. The user is able in this way
`to ascertain details of the features of each vocal block
`45
`such as its strength and pitch before the corresponding
`music is reproduced.
`The invention also enables the detection of the
`strength and basic frequency of an actual vocal presen
`tation which can then be compared with the vocal data
`and the results of the comparison displayed on the vi
`sual display medium. The user is in this way able to
`gauge the perfection of his own vocal rendition in terms
`of, for example, its strength and pitch. Appropriate
`indications are also output in accordance with the re
`sults of the comparison made between the vocal data
`and the strength and basic frequency of the actual rendi
`tion. The user is thus able to obtain an impartial and at
`the same time simple evaluation of the precision of his
`own vocal rendition in terms of features such as its
`strength and pitch.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 to FIG. 4 illustrate the ?rst preferred embodi
`ment of the invention where FIG. 1 is a block diagram
`illustrating the basic con?guration of the invention,
`FIG. 2 is a block diagram illustrating the con?guration
`of the invention in more detail, FIG. 3 provides a con
`
`35
`
`50
`
`55
`
`65
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`There follows a description of the ?rst preferred
`embodiment of the invention by reference to FIG. 1 to
`FIG. 4. FIG. 1 illustrates the basic con?guration of the
`invention while FIG. 2 shows the same thing but in
`more detail. In FIG. 2 110 is a memory means in which
`music data for a large number of different pieces of
`music is stored. Each item of music data also contains
`vocal data relating to the vocal features of the music. As
`shown in FIG. 3, the data is divided in conceptual terms
`into a number of blocks 1, 2, 3-—in the ratio of one block
`to one bar and the blocks are arranged in order in accor
`dance with the forward development of the tune. The
`vocal data blocks are each almost exactly one block in
`advance of their corresponding music data blocks. Said
`vocal data also incorporates strength data which is used
`to indicate the appropriate strength of the vocal presen
`tation.
`A screen display indicator is inserted at the end of
`each block as shown by the long arrows in FIG. 3 to
`indicate that the screen display should be updated at
`these points. Current lyric display position indicators -
`are similarly inserted as required at the points marked
`by the short arrows in FIG. 3 to show that these are the
`appropriate points at which to indicate the lyric display
`position. In practice, of course, each screen display '
`indicator is, in fact, set at a speci?c time interval t in
`advance of the boundary of each block of music data.
`As a result each current lyric position indicator is also
`set at the same speci?c time interval t in advance of its
`real position. The horizontal unit time is written in at
`the head of the vocal data. This indicates the maximum
`number of current lyric position indicators permissible
`per block. Clear screen data is written in at the end of
`
`Page 11 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`25
`
`5,208,413
`4
`3
`same time the user can also see the space behind the
`the vocal data to clear the screen at the end of the piece
`vertical line L change to a different color from that of
`of music. The memory means 110 is also used to store
`the space ahead of said vertical line L. Then, when the
`character data relating to the display of the lyrics in
`next screen display indicator is read, the screen is
`character form. Said memory means 110 is also con
`cleared and the wavy line graph G of the strength data
`nected to a reproduction device 160 such that music
`of the next block is displayed on screen and the current
`data can be read from the memory means 110 and subse
`lyric position processing operation, which is carried out
`quently reproduced on said reproduction device.
`in accordance with the current lyric position indicators,
`The memory means 110 is also connected to a de
`is repeated as required. When the piece of music ends,
`coder 121 which is in turn connected in sequence to a
`the screen is cleared by the clear screen data.
`vocal data extractor 122, a strength data extractor 123
`There now follows a description of the display of
`and ?nally a buffer 141. The vocal data extractor 122
`lyrics by means of the visual display medium 150. A
`extracts vocal data from which the strength data extrac
`tor 123 then extracts strength data and this is ?nally
`character code extractor 171, a buffer 172 and a charac
`ter pattern generator 173 are each connected in se
`stored block by block in the buffer 141. A horizontal
`quence to the aforementioned decoder 121 such that the
`unit time extractor 142, a screen display indicator ex
`character codes relating to each block can be read by
`tractor 143, a clear screen data extractor 144 and a
`the character code extractor 171 and input to the buffer
`current lyric position indicator extractor (current lyric
`172 block by block. The character codes are subse
`position indicator reading means) 130 are each con
`- quently output from the buffer into the character pat’
`nected in parallel to the decoder 121 for the purpose of
`extracting horizontal unit time, screen display indica
`tern generator 173 where they are used as the basis for
`the creation of character patterns. In this case, the out
`tors, clear screen data and current lyric position indica
`put signal of the screen display indicator extractor 143
`tors respectively. The current lyric position indicator
`constitutes a trigger signal to the buffer 172. 174 is a
`extractor 130 is in turn connected to a delay device 145
`character color change device which is activated by
`which delays the output signal by the time interval t.
`output signals from the delay device 145. The output
`The output signals from each of the buffer 141, the
`signals from both the character pattern generator 173
`horizontal unit time extractor 142, the screen display
`and the character color change device 174 are input to
`indicator extractor 143, the clear screen data extractor
`the character display device 175 where they form the
`144 and the delay device 145 are each input to the graph
`basis for the creation of the second image signal which
`plotting device 146 where the ?rst image signal is cre
`is used to indicate the characters required. The second
`ated in accordance with said output signals in order to
`image signal is then input by way of the synthesis device
`indicate the appropriate vocal strength level. The ?rst
`image signal is then input to the synthesis device 147
`147 to the visual display medium 150.
`There now follows a description of the operation of
`where it is combined with the second image signal from
`the visual display medium 150 on receipt of the second
`the character display device 175, which will be de
`image signal. First, when the screen display indicator is
`scribed in more detail below, and then input to the
`visual display medium 150. The output signal of the
`read by the screen display indicator extractor 143, then
`the data stored in the buffer 172 is also released and in
`aforementioned screen display indicator extractor 143 is
`this way the lyrics are displayed on screen. There is also
`‘ input in the form of a trigger signal to the aforemen
`a corresponding change in the color of the lyrics up as
`tioned buffer 141.
`Next there follows a description of the operation of
`far as a point determined as the end of a ?xed period of
`time t after the current lyric position indicator has been
`the visual display medium 150 on receipt of the ?rst
`read by the current lyric position indicator extractor
`image signal. First, the horizontal size W of the image is
`130. In other words the color of the words changes up
`determined on the basis of the horizontal unit time read
`to and in line with the forward movement of the current
`by the horizontal unit time extractor 142. Next, the ?rst
`lyric position as synchronized with the progress of the
`image signal is set to high by the screen display indica
`piece of music. Within the overall con?guration out
`tor, which has been read by the screen display indicator
`lined above, we may also identify a vocal data reading
`extractor 143, and at the same time strength data is
`means 120 which comprises the decoder 121, the vocal
`output from the buffer 141. As a result the strength data
`data extractor 122 and the strength data extractor 123
`for one block is converted into the form of the wavy
`and which, by referencing the memory means 110,
`line graph G, as shown in FIG. 4, which is displayed on
`reads vocal data from which it then extracts strength
`screen in advance of the corresponding music. The
`current position within the said block, as speci?ed by
`data. We may also identify an image control means 140
`which comprises the buffer 141, the horizontal unit time
`the current lyric position indicator, which is read by the
`current lyric position indicator extractor 130, is marked
`extractor 142, the screen display indicator extractor
`143, the clear screen data extractor 144, the delay de
`in time with the music by the vertical line L. The areas
`vice 145, the graph plotting device 146 and the synthesis
`to left and right of the vertical line L are displayed in
`device 147 and which, on receipt of output from the
`different colors. In this case, since the screen display
`vocal data reading means 120 and the current lyric
`indicators are set at ?xed time intervals t in advance of
`position indicator reading means 130, controls the visual
`the boundary of each block, the screen update for a
`display medium 150 in such a way that it displays the
`given block (bar) will be carried out at time interval t in
`60
`strength data extracted from the vocal data relating to a
`advance of the end of the corresponding music. The
`current lyric position indicator, however, is delayed by
`given block in advance of the corresponding music
`while at the same time displaying the lyric position
`the delay device 145 and output in time with the music
`within said block in time with the corresponding music.
`itself. In other words, the user is able to watch the verti
`In other words, with the ‘help of the preferred em
`cal line L, which marks the current position in the lyr
`ics, moving across the screen from left to right on the
`bodiment outlined above, the user is able to observe the
`required strength of a particular vocal block in advance
`background formed by the wavy line graph G, which
`of the reproduction of the corresponding music and in
`represents the strength data of the current block. At the
`
`45
`
`55
`
`65
`
`Page 12 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`20
`
`5,208,413
`6
`5
`plotting device 346. The output signals of the graph
`this way to keep a check on the strength of vocal pre
`plotting device are input to the visual display medium
`sentation that is required while he is singing.
`350. At the same time, the output signal of the afore
`There now follows a description of the second pre
`mentioned screen display indicator extractor 343 is
`ferred embodiment. FIG. 5 illustrates the basic con?gu
`input in the form of a trigger signal to the aforemen
`ration of the second preferred embodiment. In the ?rst
`preferred embodiment, the vocal data incorporated
`tioned buffer 341.
`There follows a description of the detection of vocal
`strength data. In the second preferred embodiment, on
`strength level from an actual vocal presentation. 381 in
`the other hand, the vocal data incorporates pitch data,
`FIG. 7 is a known microphone which is used to collect
`which indicates the appropriate pitch of a piece of mu
`sic, in place of strength data. In other words, the vocal
`the sound of the user’s vocals and to which are con
`nected in sequence a microphone ampli?er 382, a full
`data reading means 220 references the memory means
`wave recti?er 383, an integrator 384, a divider 385, a
`210 in order to read vocal data from which it then ex
`sample holder 386 and an AD converter 387. A voice
`tracts pitch data. On receipt of output from the vocal
`signal received from the microphone 381 is ?rst ampli
`data reading means 220 and the current lyric position
`?ed by the microphone ampli?er 382, then recti?ed by
`indicator reading means 230, the image control means
`the full-wave recti?er 383 and integrated by the integra
`240 controls the visual display medium in such a way
`tor 384. The resultant signal is then subjected to sam
`that it displays the pitch data extracted from the vocal
`_ pling and the sample value stored by the sample holder
`data relating to a given block in advance of the corre
`386. At the same time, the timing of the sampling opera
`sponding music while at the same time displaying the
`tion is determined by a signal output by the divider 385
`lyric position within said block in time with the corre
`on the basis of a division of the current lyric position
`sponding music. A more detailed block diagram of this
`indicator frequency. The signal output by the sample
`con?guration would thus bear a very close resemblance
`holder 386 is next subjected to AD conversion by the
`to the con?guration illustrated in FIG. 2 except thatthe
`AD converter 387 and then input to the graph plotting
`strength data extractor 123 would be replaced by a
`device 345 as vocal strength level.
`pitch data extractor and the pitch data would be ex
`The graph plotting device 346 then creates an image
`tracted from the vocal data by said pitch data extractor.
`signal, based both on the strength data extracted from
`In other words, with the help of the second preferred
`the vocal data and also on the vocal strength level de
`embodiment, the user is able to observe the required
`rived from the actual vocal presentation, and inputs it to
`pitch of a particular vocal block in advance of the re
`the visual display medium 350 for comparison and dis
`production of the corresponding music and in this way
`play. First, the horizontal size W of the image is deter
`to keep a check on the pitch of the vocal presentation
`mined on the basis of the horizontal unit time read by
`that is required while he is singing.
`the horizontal unit time extractor 342. Next, the image
`There now follows a description of the third pre
`signal is set to high by the screen display signal which
`ferred embodiment of the invention by reference to
`has been read by the screen display signal extractor 343,
`FIG. 6 to FIG. 8. The ?rst and second preferred em
`35
`and at the same time strength data is output from the
`bodiments illustrated con?gurations for the display of
`buffer 341. This results in the strength data for one
`vocal data. The third preferred embodiment, on the
`block assuming the form of the solid line graph G as
`other hand, illustrates a con?guration of the invention
`shown in FIG. 8 which is displayed on screen in ad
`suitable for the comparison of vocal data and actual
`vance of the corresponding music. The current position
`vocal presentation and for the display of the results of
`40
`within the said block, as speci?ed by the current lyric
`said comparison. FIG. 6 illustrates the basic con?gura
`position indicator read by the current lyric position
`tion of the invention while FIG. 7 shows the same thing
`indicator extractor 330, is marked in time with the
`but in more detail. In FIG. 7 310 is a memory means of
`music by the vertical line L. The areas to left and right
`the same type as that incorporated into the ?rst pre
`of the vertical line L are displayed in different colors. In
`ferred embodiment and the vocal data also incorporates
`strength data.
`other words, the user is able to watch the vertical line
`L, which marks the current position in the lyrics, mov
`Said memory means 310 is also connected to a repro
`ing across the screen from left to right on the back
`duction device 360 such that music data can be read
`ground formed by the solid line graph G, which repre
`from the memory means 310 and subsequently repro
`sents the strength data of the current block. At the same
`duced on said reproduction device.
`time the user is also able to watch the space behind the
`The memory means 310 is also connected to a de
`vertical line L change to a different color from that of
`coder 321 which is connected in sequence to a vocal
`the space ahead of said vertical line L.
`data extractor 322, a strength data extractor 323 and
`In this sort of case, the vocal strength level p obtained
`?nally a buffer 341. The vocal data extractor 322 ex
`by a sampling operation timed to coincide with the
`tracts vocal data from which the strength data extractor
`current lyric position indicators is displayed above the
`323 then extracts strength data and this is ?nally stored
`block by block in the buffer 341.
`vertical line L as shown in FIG. 8. Each separate re
`cording of the vocal strength level p is kept in the same
`A horizontal unit time extractor 342, a screen display
`position on screen until the whole of the block in ques
`indicator extractor 343, a clear screen data extractor 144
`and a current lyric position indicator extractor (current
`tion is cleared from the screen with the result that the ’
`lyric position indicator reading means) 330 are each
`indications of vocal strength level p up as far as the
`current lytic position are displayed on screen in the
`connected in parallel to the decoder 321 for the purpose
`form of the broken line graph P, which thus enables the
`of extracting horizontal unit time, screen display indica
`user to make an instant comparison with the strength
`tors, clear screen data and current lyric position indica
`data represented by the solid line graph G. In other
`tors respectively. The output signals from each of the
`buffer 341, the horizontal unit time extractor 342, the
`words, the user is able to ascertain his own vocal
`strength level from the broken line graph P and to com
`screen display indicator extractor 343, and the clear
`pare this with the strength data represented by the solid
`screen data extractor 344 are each input to the graph
`
`60
`
`65
`
`25
`
`45
`
`55
`
`Page 13 of 18
`
`PETITIONERS' EXHIBIT 1002
`
`

`
`20
`
`5,208,413
`8
`7
`extractor (current lyric position indicator reading
`line graph G. The user is in this way able to gauge the
`means) 430 are each connected in parallel to the de
`perfection of his own vocal rendition in terms of its
`strength.
`coder 421 for the purpose of extracting horizontal unit
`time, screen display indicators, clear screen data and
`When the next screen display indicator is read, the
`current lyric position indicators respectively. The out
`current screen is cleared and the strength data con
`put signals from each of the buffer 441, the horizontal
`tained in the next block is displayed on the screen in the
`unit time extractor 442, the screen display indicator
`shape of the solid line graph G. The processing opera
`extractor 443, the clear screen data extractor 444 and
`tion outlined above is then repeated whereby the actual
`the current lyric position indicator extractor 430 are
`vocal strength level, which is obtained by sampling in
`input to the graph plotting device 446. The output sig
`time with the current lyric display indicators which
`nals of the graph plotting device 446 are input to the
`have been used for the display of the current lyric posi
`visual display medium 450. At the same time, the output
`tion, is recorded on screen in the form of the broken line
`signal of the aforementioned screen display indicator
`graph P. When the piece of music ends, the screen is
`extractor 443 is input in the form of a trigger signal to
`cleared by the clear screen data.
`~
`the aforementioned buffer 341.
`The display of lyrics on screen is, of course, also
`There follows a description of the identi?cation of
`based on the use of character data but a description of
`the basic frequency from an actual vocal presentation.
`this particular processing operation has been omitted.
`_ 481 in FIG. 10 is a microphone which is used to collect
`Within the overall con?guration outlined above, we
`the sound of the user’s vocals and to which are con
`may also identify a vocal data reading means 320 which
`nected in sequence a microphone ampli?er 482 and a
`comprises the decoder 321, the vocal data extractor 322
`frequency analyzer 484. A voice signal received from
`and the strength data extractor 323 and which, by refer
`the microphone 481 is ?rst ampli?ed by the microphone
`encing the memory means 310, reads vocal data from
`ampli?er 482 and the basic frequency is then identi?ed
`which it then extracts strength data. We may also iden
`by the frequency analyzer 484. At the same time, the
`tify a vocal strength level detection means 380 which
`current lytic position indicator frequency is divided by
`detects the strength level of an actual vocal rendition
`the divider 483 and the resultant signal input to the
`and which comprises a microphone 381, a microphone
`frequency analyzer 484. The signal output by the fre
`ampli?er 382, a full-wave recti?er 383, an integrator
`quency analyzer 484 is then input to the graph plotting
`384, a divider 385, a sample holder 386 and an AD
`device 446.
`converter 387.
`There now follows a description of the con?guration
`We may further identify an image control means 340
`of the above mentioned frequency analyzer 484 by ref
`which comprises the buffer 341, the horizontal unit time
`erence to FIG. 11. The frequency analyzer 484 com
`extractor 342, the screen display indicator extractor
`prises a number of matched ?lters. 4840 in FIG. 11
`343, the clear screen data extractor 344, and the graph
`represents a number N of band pass ?lters numbered
`plotting device 346 which, on receipt of output from the
`from l to N respectively and connected in parallel with
`vocal data reading means 320, the current lyric position
`the microphone ampli?er 482. Each of the frequency
`indicator reading means 330 and the vocal strength
`bands obtained by dividing the vocal sound band into N
`level detection means 380, controls the visual display
`number of smaller bands is allocated as a pass band to
`medium 350 in such a way that it displays the strength
`one of said ?lters. A wave detector 48411 and an integra
`data extracted from the vocal data relating to a given
`tor 4840 are connected in sequence to each band pass
`block in advance of the corresponding music while at
`?lter 4840. The wave detector 48412 detects the signals
`the same time displaying the lyric position within said
`passing each of the band pass ?lters 484a and eliminates
`block in time with the corresponding music, and while
`the high frequency component, after which the signal is
`also comparing the strength levels of actual vocal rendi
`integrated by the integrator 484c. The output of each of
`tions with the strength data.
`the integrators 484c is then input to the comparator
`There now follows a description of the fourth pre
`detector circuit 484e. At the same time, the output of
`ferred embodiment of the invention by reference to
`the aforementioned divider 483 is input both to said
`FIG. 9 to FIG. 11. In the third preferred embodiment,
`integrators 4840, after being subjected to delay process
`the vocal data incorporated strength data. In the fourth
`ing by the delay circuit 484d, and also, without further
`preferred embodiment, on the other hand, the strength
`processing, to the comparator detector circuit 484e. In
`data is replaced by pitch data. FIG. 9 illustrates the
`other words, the comparator detector circuit 484e ?rst
`basic con?guration of the invention while FIG. 10
`compares the values output by each of the integrators
`shows the same thing but in more detail. In FIG. 10 410
`484c and then, having identi?ed the highest value exhib
`is a memory means of the same type as that incorpo
`ited by any of the band pass ?lters 4840, it outputs the
`rated int