US007542814B2
`
`(12) United States Patent
`Barr
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,542,814 B2
`Jun. 2, 2009
`
`(54) HOME ENTERTAINMENT APPARATUS AND
`METHOD
`
`2004/0117825 A1*
`
`6/2004 Watkins ..................... .. 725/40
`
`(76)
`
`( * ) Notice‘
`'
`
`Inventor: Craig Barr, 2925 Alta Ter., La Cresenta,
`CA (US) 91214
`Subject to any disclaimer the term ofthis
`5
`patent is extended or adjusted under 35
`U.S.C. l54(b) by 923 days.
`
`(21) Appl. No.: 10/860,356
`
`(22)
`
`Filed;
`
`J1111, 1, 2004
`
`(65)
`
`Prior Publication Data
`
`Dec‘ 15’ 2005
`
`US 2005/0278764 A1
`Int CL
`,
`(2006.01)
`G06F 17/00
`(200601)
`H04B 1/00
`(52) U.s. Cl.
`......................................... 700/94; 381/119
`(58) Field of Classification Search ................... 700/94;
`381/119; 725/40’ 41’ 49’ 139; 369/1'12
`See application file for Complete Search history‘
`References Cited
`U.S. PATENT DOCUMENTS
`
`(51)
`
`(56)
`
`* Cited by examiner
`Primary Examiner—Curtis Kuntz
`1473:5323?’ Exm::1mer:An1g.rew
`orne,
`en,or zrm—.
`y g
`
`.
`
`1 er
`
`(57)
`
`ABSTRACT
`
`e
`.
`A home entertainment system or home theater includes an
`audio/visual program source with a stereo or surround sound
`system. An apparatus and method according to the present
`invention adds supplemental audio content to live or pre-
`recorded events, such as football games, baseball games, and
`other sporting events in a spontaneous dynamic environment
`promoting group participation and enthusiasm. Random
`access to the supplemental audio content instantaneously and
`by remote control affords a usereof the apparatus an opportu-
`‘;‘:1ydi:i°0f1:§a:;::g1:Ifid0}°e1:1;eS:‘evfefli
`efieeted Se thatheme Viewers efgfie event eereeive a Seamless
`audio content
`including the supplemental audio Audio
`effects, such as a simulation ofthe reverberation of aistadium
`or large hall, can also be added to further increase the sensa-
`tion of attending a live sporting event.
`
`2003/0231205 A1* 12/2003 Shima et al.
`
`.............. .. 345/744
`
`21 Claims, 19 Drawing Sheets
`
`AUDIOMSUAL DATA SOURCE
`
`(TV TUNER. CABLE RECEIVER. DVD PLAVER. SATELLITE RECENER,
`
`4- VISUAL DATA OUT
`
`
`
`
`
`HOME THEATER AUDIO
`PR%E/SSOR AMPLIFIER.
`
`29
`
`
`
`APPLE 1012
`
`APPLE 1012
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 1 of 19
`
`US 7,542,814 B2
`
`
`
`AUDIONISUAL DATA SOURCE
`(TV TUNER, CABLE RECEIVER, DVD PLAYER, SATELLITE RECEIVER.
`
`
`
`
`
`PROCESSOR AMPLIFIER.
`
`LEI-'I' LINE LEVEL AUDIO
`OUT
`
`4- VISUAL DATA OUT
`
`HOME ENTERTAINMENT APPARATUS
`
`LEFT LINE LEVEL AUDIO
`OUT
`
`RIGHT LIN I LEVEL AUDIO
`'
`
`HOME THEATER AUDIO
`
`
`
`VISUAL DISPLAY I
`PROJECTOR
`
`
`12A
`
`
`
`2
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 2 of 19
`
`US 7,542,814 B2
`
`TO USER'S HOME THEATER
`FROM USER'S AUDIO VISUAL
`‘AUDIO IN‘
`SOURCE ‘AUDIO OUT
`
`IQ‘ WA, §.§\_ .RcA.
`
`
`(2) TO (1) STEREO
`MIXER wmu
`DIGITAL on
`VOLTAGE
`CONTROLLED
`AMPLIFIERS
`
`;
`2
`=
`5
`g
`
`
`ANALOG CONVERTER
`
`
`E8—LEVEL CONTROL SIGNAL
`§_QA
`RESIDENT DIGITAL
`STORAGE DEVICE
`AND REQUIRED
`SYST M MEMORY
`
`STEREO ANALOG
`
`REVERBERATION
`
`
`GENERATOR
`
`
`
`
`62B
`
`REVERB __
`DIGITAL ._
`.
`
`
`Aumo DATA
`ICONTROL SIGNAL
`
`STEREO DIGITAL TO
`
`§_Q
`
`MICROPROCESSOR CONTROLLER
`
`RE“"°V“BLED'g'\fi'CT!’E‘L 5T°R"I5E
`E
`
`>
`
`5
`I
`E
`
`‘BANK SELECTED LEDS'
`
`‘BANK 20-29 LED‘
`‘BANK so-39 LED” ’
`
`
`
`POWER BUSSED TO
`
`Al.L COMPONENTS
`I....._§§9!-.'!!"f'_'."‘3..‘.’.9‘!‘_’!5t!‘_‘;__________________________________________________ __
`
`
`55
`POWER CONVERTER
`
`ETHERNET
`PORT
`
`
`
`< 45
`
`AQ
`
`m
`8
`K
`Di
`
`ҤZA
`
`33A
`
`fig
`ENC LOSU RE
`
`I
`
`FIG. 2
`
`.
`use PORT
`
`
`
`3
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 3 of 19
`
`US 7,542,814 B2
`
`
`
`LOAD SAVED
`CONFIGURATION
`
`POWER UP
`
`
`
`
`i
`
`SET TO ‘BANK 0' &
`ET ILLUMINATE “BANK 0-
`9' LED
`
`
`
`VALID DATA
`FROM REMOTE
`
`
`
`
`YE
`
`GO TO “BUTTON 0'
`
`VALID DATA
`FROM USE
`PORT
`
`YE
`
`
`
`FILE TRANSFER AND
`
`VALID DATA
`FROM
`ETHERNET
`PORT
`
`
`
`
`
`YES
`
`ENTER USB FILE
`TRANSFER AND OPS
`MODE
`
`ENTER ETHERNET
`
`OPS MODE
`
`FIG. 3
`
`4
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 4 of 19
`
`US 7,542,814 B2
`
`“BUTTON 0“
`
` §§.
`
`NO
`IS BUTTON "0'
`
`
`
`SELECTED?
` YES
`
`GO TO ‘BUTTON 1"
`
`
`NO
`
`92
`IS BANK “o'
`SELECTED
`
`
`22
`NO
`IS BANK "1"
`
`
`SELECTED
`
` 9.4;
`SEEK TO START OF
`
`FILE IN LOCATION ‘'00’
`
`
`
`YES
`
`IS BANK "2"
`SELECTED
`
`
`
`Jm
`GO TO
`
`FIG. 4
`
`
`SEEK TO START OF
`“E3
`
`
`
`SEEK TO START OF
`
`
`Flb IN LOCATION “20'
`
`E
`IS BANK “3”
`SELECTED
`
`NO
`
`SEEK TO START OF
`FILE IN LOCATION "30'
`
`
`FILE LOCATION "10'
`
`
`
`"PLAYFILE"
`
`5
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 5 of 19
`
`US 7,542,814 B2
`
` §.§
`
`NO
`IS BUTTON '1'
`
`
`
`SELECTED?
`
`
`YES
`
`GO TO “BUTTON 2'
`
`NO
`IS BANK "O"
`
`
`SELECTED
`
` NO
`
`
`IS BANK '1"
`SELECTED
`
`IS BANK "2"
`SEEK TO START OF
`
`SELECTED
`
`FILE IN LOCATION "01"
`
`
`
`
`NO
`
`SEEK TO START OF
`
`FILE IN LOCATION "11"
`
`
`'5 BANK "3"
`
`
`
` NO
`
`SELECTED
`
` SEEK TO START OF
`
`
`FILE IN LOCATION "21"
`
`
`YES
`
`SEEK TO START OF
`FILE IN LOCATION '31"
`
`
`'PLAYFILE'
`
`GO TO
`
`FIG. 5
`
`6
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 6 of 19
`
`US 7,542,814 B2
`
`"BUTTON 2'
`
`
`§§
`NO
`IS BUTTON '2'
`
`
`SELECTED?
` YES
`
`GO TO "BUTTON 3"
`
`NO
`
`IS BANK "0'
`SELECTED
`
`YES
`
`NO
`
`IS BANK "1"
`SELECTED
`
`SEEK TO START OF
`FILE IN LOCATION "oz"
`
`YES
`
`NO
`
`'3 BANK "2
`SELECTED
`
`
`
`
`
`
`
`NO
`
`YES
`FILE IN LOCATION "32"
`
`SEEK TO START or
`FILE IN LOCATI N "12"
`O
`
`YES
`
`IS BANK "3”
`SELECTED
`
`SEEK TO START OF
`FILE IN LOCATION -22"
`
`SEEK TO START OF
`
`y
`
`GO TO
`'PLAYF|LE"
`
`FIG. 6
`
`7
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 7 of 19
`
`US 7,542,814 B2
`
`
`IE
`NO
`IS BUTTON "3'
`
`
`SELECTED?
`
`
`YES
`
`GO TO "BUTTON 4'
`
`NO
`
`IS BANK '0'
`SELECTED
`
`
`
`
`
`YES
`
`NO
`
`IS BANK "1"
`SELECTED
`
`F
`T
`FILE IN LOCATION "03"
`SEEK TO S ART 0
`
`YES
`
`IS BANK "2"
`SELECTED
`
`SEEK TO START OF
`
`SEEK TO START OF
`FILE IN LOCATION "23’
`
`
`FILE IN LOCATION “13"
`'3 BANK _3,
`
`SELECTED
`
`
`
`SEEK TO START OF
`FILE IN LOCATION "33"
`
`GO TO
`
`“PlAYFILE'
`
`
`
`FIG. 7
`
`8
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 8 of 19
`
`US 7,542,814 B2
`
`‘BUTTON 4'
`
`
`E
`NO
`IS BUTTON '4'
`
`
`SELECTED?
`
`
`YES
`
`GO TO ‘BUTTON 5"
`
`NO
`
`IS BANK '0'
`SELECTED
`
`
`
`
`YES
`
`NO
`
`IS BANK "1"
`SELECTED
`
`YES
`
`SEEK TO START OF
`
`FILE IN LOCATION "04"
`
`FILE IN LOCATION "14’
`SEEK TO START OF
`
`IS BANK "2"
`SELECTED
`
`
`IS BANK __3_
`
`SELECTED
`
`
`
`SEEK TO START OF
`
`FILE IN LOCATION "24'
`
`SEEK TO START OF
`FILE IN LOCATION “34'
`
`
`
`
`GO TO
`
`
`"PLAYFILE'
`
`FIG. 8
`
`9
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 9 of 19
`
`US 7,542,814 B2
`
`
`NO
`
` §§
`IS BUTTON '5'
`
`SELECTED?
`
`
`
`YES
`
`GO TO “BUTTON 6'
`
`IS BANK "0"
`SELECTED
`
`
`
`
`
`NO
`IS BANK '1 "
`
`SELECTED
`
`SEEK TO START OF
`
`FILE IN LOCATION "05"
`
`
`IS BANK "2"
`
`SELECTED
`
`
`
`NO
`
`SEEK TO START OF
`
`FILE IN LOCATION "15"
`
`
`IS BANK "3"
`
`NO
`
`
`
`SELECTED YES
`
`
`SEEK TO START OF
`
`
`FILE IN LOCATION "25'
`
`
`SEEK TO START OF
`FILE IN LOCATION "35"
`
`
`
`
`GO TO
`"PLAYF|LE'
`
`FIG.
`
`10
`
`10
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 10 of 19
`
`US 7,542,814 B2
`
`"BUTTON 6"
`
`
`.231
`NO
`IS BUTTON "6"
`
`
`SELECTED?
`
`
`YES
`
`GO TO "BUTTON 7"
`
`NO
`
`IS BANK "0"
`SELECTED
`
`YES
`
`NO
`
`IS BANK ‘1"
`SELECTED
`
`YES
`
`SEEK TO START OF
`
`"0
`
`IS BANK "2'
`SELECTED
`
`
`
`
`
`
`FILE IN LOCATION "06"
`
`FILE IN LOCATION "16"
`
`
`SEEK TO START OF
`
`YES
`
`NO
`
`IS BANK "3"
`SELECTED
`
`SEEK TO START OF
`FILE IN LOCATION '26"
`
`YES
`
`I
`
`SEEK TO START OF
`FILE IN LOCATION "36"
`
`“PLAYFlLE'
`
`so TO
`
`FIG. 10
`
`11
`
`11
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 11 of 19
`
`US 7,542,814 B2
`
`
`NO
` E
`IS BUTTON "7"
`SELECTED?
`
`
`
`
`
`YES
`
`GO TO ‘BUTTON 6‘
`
`NO
`
`IS BANK '0"
`SELECTED
`
`NO
`
`IS BANK “1'
`SELECTED
`
`IS BANK '2”
`SEEK TO START OF
`
`
`SELECTED
`FILE IN LOCATION "07"
`
`
`NO
`
`
`
`
`
`
`
`SEEK TO START OF
`FILE IN LOCATION "17"
`
`SEEK TO START OF
`FILE IN LOCATION "27"
`
`
`
`NO
`
`IS BANK "3"
`SELECTED
`
`YES
`
`SEEK TO START OF
`FILE IN LOCATION "37"
`
`GO TO
`‘PLAYFlLE'
`
`
`
`FIG. 11
`
`12
`
`12
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 12 of 19
`
`US 7,542,814 B2
`
`‘BUTTON 8”
`
`§§
`IS BUTTON ‘B’
`SELECTED?
`
`GO TO "BUTTON 9'
`
`NO
`
`IS BANK "0'
`SELECTED
`
`IS BANK "1'
`SELECTED
`
`SEEK TO START OF
`
`FILE IN LOCATION "08"
`
`
`IS BANK '2'
`
`SELECTED
`
`
`NO
`
`
`
`
`
`
`
`SEEK TO START OF
`
`FILE IN LOCATION "13"
`
`SEEK TO START OF
`
`FILE IN LOCATION "28"
`
`NO
`
`'3 BANK '3”
`SELECTED
`
`YES
`
`
`
`
`
`SEEK TO START OF
`FILE IN LOCATION ‘38'
`
`GO TO
`
`‘PLAYF|LE'
`
`FIG. 12
`
`13
`
`13
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 13 of 19
`
`US 7,542,814 B2
`
`..BUTI-ON 9.
`
`
`.8.§
`NO
`IS BUTTON '9'
`
`
`SELECTED?
`
`
`ADJUST“ YES
`
`GO TO “VOLUME
`
`NO
`
`IS BANK "0'
`SELECTED
`
`
`
`
`YES
`
`NO
`
`IS BANK '1"
`SELECTED
`
`
`FILE IN LOCATION "09’
`
`
`T F
`T
`SEEK OSTAR O
`
`NO
`
`IS BANK "2"
`SELECTED
`
`SEEK TO START OF
`
`
`FILE IN LOCATION "19-
`
`NO
`
`'3 BANK "3"
`SELECTED
`
`SEEK TO START OF
`FILE IN LOCATION “29"
`
`
`
`YES
`
`SEEK TO START OF
`
`FILE IN LOCATION “39”
`
`
`
`GO TO
`'PU\YFlLE'
`
`FIG. 13
`
`14
`
`14
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 14 of 19
`
`US 7,542,814 B2
`
`M
`“PLAY”
`
`START SELECTED
`
`FILE
`
`RAMP VOLUME TO
`(vx) m (.x) seconos
`
`E4
`
`ACTIVITY LED ON
`
`10
` N0
`
`MOMENTARY
`MODE?
`
`
`
`YES
`
`N0
`
`
`1%
`BUTTON STILL
`
`
`HELD DOWN?
`
`
`TOGGLE MODE
`
`
` Q NO
`ANY BUTTON
`
`LEADING EDGE
`DETECTED?
`
`
`
`
`END OF FILE?
`
`
`
`YES
`
`RAMP VOLUME TO (0)
`IN (1) SECOND
`9
`
`.115.
`STOP PLAYING FILE
`
`
`
`ACTIVITY LED OFF
`
`GO TO
`“SCAN”
`
`FIG. 14
`
`15
`
`15
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 15 of 19
`
`US 7,542,814 B2
`
`
` 11
`
`
`
`‘VOLUME ADJUST“
`
`NO
`
`IS THE BUTTON
`"VOLUME UP‘
`SELECTED?
`
`
`
`ADD (1) TO VOLUME
`LEVEL
`
`FLASH ACTIVITY LED
`
`
`
`
`12
`GO TO
`
`
`“BANK SELECT‘
`
`
`
`
`
`
`
`s THE BUTTO
`"VOLUME
`DOWN’
`SELECTED?
`
`"0
`
`SUBTRACT (1) FROM
`VOLUME LEVEL
`
`
`
`
`FLASH ACTIVITY LED
`
`FIG. 15
`
`16
`
`16
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 16 of 19
`
`US 7,542,814 B2
`
`
`
`STEP UP ONE “BANK'.
`LOOP TO BOTTOM
`WHEN TOP IS
`REACHED
`
`
`
`FLASH ACTIVITY LED
`
`ILLUMINATE
`
`
`APPROPRIATE FRONT
`PANEL “BANK” LED
`
`
` 12
`IS THE BUTTON
`“CHANNEL UP”
`SELECTED?
`
`
`
`
`
`
`‘CHANNEL
`DOWN‘
`
`GO TO
`“REVERB SELECT‘
`
`SELECTED?
`
`STEP DOWN ONE
`“BANK”, LOOP TO TOP
`WHEN BOTTOM IS
`REACHED
`
`I
`
`FLASH ACTIVITY LED
`
`ILLUMINATE
`APPROPRIATE FRONT
`
`PANEL “BANK” LED
`
`17
`
`FIG. 16
`
`17
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 17 of 19
`
`US 7,542,814 B2
`
`REVERB SELECT
`
`
`
`
`
`IS THE BUTTON
`“VIDEO PLAY”
`SELECTED?
`
`
`GO TO
`
`“MODE SELECT"
`
`
`
`
`
`
`STEP DOWN TO NEXT
`PRESET REVERB
`MODE, LOOP TO TOP
`WHEN BOTTOM IS
`REACHED
`
`
`
`FLASH ACTIVITY LED
`1 TIME FOR “HALL”,
`2 TIMES FOR "LARGE ROOM”,
`3 TIMES FOR “STADIUM”,
`RE\/ERB MODES.
`
`
`
`
`
`FIG. 17
`
`18
`
`18
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 18 of 19
`
`US 7,542,814 B2
`
`‘MODE SELECT”
`
`1%
`
`
`
`
`(S THE BUTTON
`GO TO
`
`
`‘RECORD’
`‘AMPLITUDE
`
`SELECTED?
`LEVELING”
`
`
`TOGGLE BETWEEN
`TWO OPERATIOANL
`MODES:
`"MOMENTARY” OR
`"TOGGLE"
`
`
`
`
`
`
`
`FLASH ALL “BANK” PANEL LEDS
`1 TIME FOR “MOMENTARY”,
`2 TIMES FOR "TOGGLE",
`
`
`
`FIG. 18
`
`19
`
`19
`
`

`

`U.S. Patent
`
`Jun. 2, 2009
`
`Sheet 19 of 19
`
`US 7,542,814 B2
`
`‘AMPLITUDE
`LEVELING"
`
`
`
` 10
`
`IS THE BUTTON
`“STOP”
`SELECTED?
`
`
`
`
`TOGGLE BET\NEEN
`TWO OPERATIONAL
`MODES:
`OFF /ON
`
`
`
`FLASH ALL PANEL LEDS
`1 TIME FOR “OFF”,
`2 TIMES FOR "ON',
`
`
`
`
`
`GO TO
`“SCAN”
`
`FIG. 19
`
`20
`
`20
`
`

`

`US 7,542,814 B2
`
`1
`HOME ENTERTAINMENT APPARATUS AND
`METHOD
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`Ihe present invention relates generally to an audio-video
`entertainment apparatus and method, and particularly relates
`to an audio device for use in conjunction with and as an
`addition to a visual display unit (such as a television) and with
`an interconnected audio system (such as a home stereo sys-
`tem or home theater system). The interconnected system is
`able to provide time sequenced and selected supplemental
`audio content which is supplemental to both the television
`picture and to the audio content of the audio-visual program
`(i.e., such as a television program). The supplemental audio
`content is provided in a spontaneous dynamic environment
`allowing for and promoting interaction of a view with the
`television program being watched.
`For example, the present invention may be used to provide
`time-sequenced supplemental audio content (i.e., provided in
`addition to the audio content of a television program, or in
`addition to the audio/video content of a VHS or DVD video
`
`file, for example) in a spontaneous dynamic environment in
`order to enhance and accentuate the experience of viewing a
`sporting or other dramatic active event. Moreover, supple-
`mental audio content is provided in a spontaneous dynamic
`environment by use of the inventive apparatus and method
`with a minimum ofviewer distraction required to operated the
`apparatus. Such a spontaneous dynamic environment encour-
`ages
`infectious group enthusiasm, and enhances and
`improves the group experience of watching live or pre-re-
`corded sporting events, such as foot ball and basket ball
`games, at home on television. A simulation of live attendance
`of the sporting event is thus achieved at home.
`Further, the apparatus and method embodying the present
`invention may be incorporated into or made integral with
`another home electronic entertainment device (such as a tele-
`vision, VHS, or DVD player), or into a home theatre system
`(i.e., one capable of providing surround sound, for example).
`That is, the selected supplemental audio content is pro-
`vided, for example, to users of the audio-video apparatus
`along with the video images provided by the television, and
`along with the regular television audio content, which also
`plays through the user’ s home stereo or home theater system.
`The present audio-video entertainment apparatus provides
`substantially instantaneous random access to multiple files of
`selected supplemental audio content, such as cheers, music
`clips, novelty sound tracks (i.e., stamping feet, clapping
`hands, or even Bronx cheers, for example), and to stadium
`fight songs, in order enhance the infectious group viewing
`and listening experience of the users of the system. Overall,
`the viewing experience of those in a group watching sporting
`events at home can thus be made much more like the live
`
`experience of actual stadium attendance, with encourage-
`ment of the same infectious group enthusiasm, interaction,
`mutuality, and an overarching general “game ambiance.” In
`fact, by use of the present invention, audio content that is
`additional to, more creative than, and more exciting than that
`experienced in the stadium by those actually attending the
`event can be achieved.
`
`2. Related Technology
`Audio players have been known for some considerable
`time. For example, a cassette tape recorder and player can be
`employed to add selected supplemental audio content played
`along with the audio of a television program. This selected
`supplemental audio content can even be mixed with and
`
`2
`
`played over the same home stereo speakers or home theater
`speakers that the user is employing to provide the regular
`television audio content. In this way, such supplements as
`cheers, boos, fight songs, and novelty sound tracks, can be
`played along with the audio content of a sporting event, for
`example.
`However, in the use of a cassette tape recorder and player
`for such a purpose, the selection of the desired audio clip,
`cheer, sound track, or other supplemental audio content, is
`awkward and time consuming to accomplish. This is the case
`in part because the cassette tape recorder has only sequential
`access to the audio content on any particular tape, and in part
`because the audio content of a particular tape is very limited.
`The greater the storage capacity of the tape, the longer is
`required to access any particular content on that tape. Thus, in
`the unpredictable and spontaneous dynamic environment ofa
`real-time sporting event, time is simply not sufficient to
`access desired supplemental audio content from a list of avail-
`able content located on a cassette tape, and to play the selected
`audio content in supplement to the live (or prerecorded)
`action of a sporting event as the event unfolds for the home
`viewers.
`As an alternative to use of a cassette tape recorder and
`player, an MP3 recorder and player might be considered for
`such use. However, while the MP3 recorder and player offers
`semi-random access to the audio content recorded within the
`
`device, selection ofthe available content and providing ofthis
`content along with regular audio content of a televised live
`sporting event is not conveniently accomplished. That is, the
`MP3 player is not configured to mix the audio sources easily
`with the home theatre system, does not provide for beginning
`and ending manipulations ofthe added audio content to blend
`this content with the regular audio of a television program,
`and also does not provide the user with a remote control and
`indication capability. Such deficiencies of the MP3 player
`largely rule out its use in the context contemplated by the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`In view of the deficiencies of the conventional related
`technology, it is an object of this invention to overcome or
`ameliorate one or more of these deficiencies.
`
`Particularly, an object for this invention is to provide a
`simulation at home of the live interaction, mutuality, and
`infectious group enthusiasm that often accompanies live sta-
`dium attendance and viewing of a sporting event. That is, the
`live stadium experience often includes cheers, boos, novelty
`sound tracks, stamping feet, clapping hands, shouting, and
`other stadium live interactions of sports enthusiasts with the
`activities and play of the teams on the playing field. These
`sounds and interactions in a spontaneous dynamic environ-
`ment can be substantially replicated at home by the use ofthis
`present invention in combination with a television, and a
`home stereo or home theater system.
`To this end, the present invention provides an apparatus and
`method of mixing with and adding to the regular audio con-
`tent of a televised (live or pre-recorded) sporting event,
`selected supplemental audio content in a real-time, spontane-
`ous manner under the dynamic and creative control of one or
`more of the people watching the televised sporting event. The
`supplemental audio content is provided via the same home
`stereo or home theater sound system through which the tele-
`vision audio content is provided to the viewers of the televi-
`sion program.
`Additionally, beginning and ending audio manipulations
`are automatically applied by the present invention to modify
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`21
`
`21
`
`

`

`US 7,542,814 B2
`
`3
`the supplemental audio content in such a way as to “smooth”
`the beginning and ending of the added audio content.
`Further, the present invention provides an apparatus and
`method for wireless remote control of the apparatus by the
`user of the device, in order to select and mix supplemental
`audio content with regular television audio in real time. A
`standard television remote control may be used for this pur-
`pose, although the invention is not so limited. That is, the user
`need not physically manipulate a tape player, an MP3 player,
`or other device interconnected with his television and home
`
`audio system, and need not have a wired device extending to
`his viewing location, but may accomplish the selection and
`mixing of supplemental audio content from the comfort and
`convenience of the user’s ordinary viewing location.
`Similarly, the user can employ an Ethernet or USB port
`interface of the present audio apparatus with a home com-
`puter system having intemet access, allowing the user to
`select, download, and store in the present audio apparatus,
`those cheers, novelty sound tracks, and other supplemental
`audio tracks that are appropriate and desired for particular
`sporting events. By means of the same USB or Ethernet
`interface, an application program running on the users home
`computer may be used to operate the apparatus according to
`the present invention.
`Thus, the user of the present apparatus and method brings
`an element ofnovelty, creativity, and artistry to the viewing of
`sporting events by the individual selection of supplemental
`audio available to be utilized during the sporting event, in
`addition to the actual selection, sequence, and timing of the
`mixing of those supplemental audio tracks with the live (or
`pre-recorded) action and audio of the sporting event in a
`spontaneous dynamic environment.
`Other objects, features, and advantages of the present
`invention will be apparent to those skilled in the art from a
`consideration of the following detailed description of a pre-
`ferred exemplary embodiment thereof taken in conjunction
`with the associated figures which will first be described
`briefly.
`
`BRIEF DESCRIPTION OF THE DRAWING
`FIGURES
`
`FIG. 1 provides a diagrammatic representation of a home
`entertainment system including apparatus embodying the
`present invention, and allowing the method of the present
`invention to be practiced;
`FIG. 2 is an illustration in block diagram form of an appa-
`ratus embodying the present invention; and
`FIGS. 3 through 19 are flow charts illustrating the method
`of operation of the present apparatus by reference to the
`operative software that is implemented by a microprocessor
`based control system.
`
`DETAILED DESCRIPTION OF EXEMPLARY
`PREFERRED EMBODIMENTS OF THE
`INVENTION
`
`While the present invention may be embodied in many
`different forms, disclosed herein is one specific exemplary
`embodiment which illustrates and explains the principles of
`the invention. In conjunction with the description of this
`embodiment, a method of providing supplemental audio con-
`tent for an audio-video system is described. It should be
`emphasized that the present invention is not limited to the
`specific embodiment illustrated.
`Referring first to FIG. 1, a home entertainment system 10 is
`depicted diagrammatically. The system 10 includes a visual
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`display unit, such as a television 12, which may be of any
`desired type. In other words, the television 12 may be a
`convention cathode ray tube type, a projection television, a
`flat panel type of television, or any other type. The television
`12 provides a video display, indicated with the numeral 12a,
`and also has an audio output function. With a stand-alone
`television, the audio output function will ordinarily be per-
`formed by a built in or integral speaker or speakers 12b, which
`provide the ordinary or regular audio content ofthe television
`program or channel being displayed on the television 12.
`Alternatively, the television 12 may be interfaced with a home
`stereo system (not seen in the drawing Figures) so that the
`speakers of this home stereo system are utilized to deliver the
`audio portion ofthe audio-visual program from the television
`12. Further, it is also well understood that many entertainment
`systems, such as the system 10, include a multi-charmel audio
`output system, generally referred to as a home theater system
`14. The home theater system provides multi-charmel audio
`(i.e., 2 channel stereo, 4 charmel surround-sound, or 5 channel
`bass-enhanced surround-sound, for example). The system 10
`according to the preferred exemplary embodiment provides
`what is referred to as 5.1 channel surround sound, and has a
`front left speaker 16a and a front right speaker 16b. A left rear
`speaker is indicated at 18a while a right rear speaker is indi-
`cated at 18b. A bass carmon type of speaker 17b and a display
`point-source speaker 17:; may also be included in the system
`10, as is well understood (i.e., in a 5-channel bass-enhanced
`system, for example). And again, although the components
`(i.e.,
`tuner, amplifier,
`turntable,
`tape player, and/or CD
`player) of a home stereo music system are not shown in FIG.
`1, it is to be remembered as well that the speakers 16a-18b
`(i.e., as few as two speakers, or possibly four or five or more
`speakers) may be components also of such a home stereo
`music system.
`Further, the home theater system 14 includes a controller
`20, which is used to separate out and to amplify and provide
`the two, or four or five charmels of sound for the speakers
`16a-18b (although it is to be recognized that the invention is
`not so limited, and that some home theater systems may use
`the home stereo music system for all or part of this function).
`The controller 20 provides for volume control, left-right bal-
`ance, front-rear fade control, etc., as is well understood. Also,
`the system 10 may include a cable or satellite decoder box 22,
`which provides for the system to receive audio-video signals
`(i.e., television programs and sporting events, for example)
`from a cable or satellite entertainment content provider, as is
`also well understood.
`
`The system 10 may also have a VHS recorder/player 24,
`and/or a DVD recorder (or DVD recorder/player or TiVo type
`of recorder/player (all generally indicated by the reference
`numeral 24). With the exception ofthe speaker wires 26 to the
`various speakers 1611-1819, the interconnections ofthe various
`components 12, 14, 20, 22, and 24 of the home theater system
`10 are not detailed in FIG. 1. These interconnections will vary
`with the configuration and elements of, and according to the
`requirements of, the particular components of the home the-
`ater system 10, and are well understood in the pertinent arts.
`However, a user of the system 10 controls essentially all of
`the functions of the various components of the system 10
`using one or more wireless remote control devices 30 (again,
`the invention is not so limited, and may be used with more
`than one remote control, or without remote control(s), or one
`or more of the remote control(s) may be of the wired type).
`The various remote control devices 30 control the devices of
`the system 10 by means of infrared or other signals, generally
`indicated by the arrowed numeral 30a.
`
`22
`
`22
`
`

`

`US 7,542,814 B2
`
`5
`Further considering the home theater system 10 illustrated
`diagrammatically by FIG. 1, it is seen that this system also
`includes an audio-video sports entertainment apparatus 32 for
`carrying out a method of the present invention. That is, the
`apparatus 32 provides an audio device for use in conjunction
`with a television 10, and an interconnected audio system,
`such as a home stereo system or home theater system 14, in
`order to provide time sequenced and selected supplemental
`audio content for a sporting or other event.
`Further viewing FIG. 1, a typical infrared remove control
`device 30 is depicted. The invention is not limited to any
`particular type or configuration ofremote control. However, it
`is seen that the typical remote control 30 seen in FIG. 1
`includes device selector switches or pushbuttons (indicated at
`34) by which the remote control may be switched among
`available devices to control. For example, the remote control
`30 may include settings for: TV, VCR, DVD, and AUX
`(meaning auxiliary). Various remote controls will be config-
`ured to control several home entertainment devices. Thus, the
`remote control 30 may be configured to control a TV, a DVD,
`and one or more auxiliary devices. The apparatus 32 may be
`selected to be an auxiliary device for the remote control 30,
`although the invention is not so limited. That is, alternatively
`the apparatus 32 may have a dedicated remote control.
`In the preferred embodiment, the remote control 30 is
`configured to control a TV, a VCR, and one auxiliary device.
`Accordingly, the remote control 30 includes a key pad 36 of
`numbered pushbuttons 0-9, a charmel select rocker button 38
`(i.e., rocking up for a higher numbered channel and down for
`a lower numbered channel) or pair of buttons, and a similar
`volume select rocker button 40 or pair of buttons.
`Turning now to FIG. 2 it is seen that the apparatus 32
`includes a housing 32a, seen in FIG. 1 as a solid box line and
`depicted in FIG. 2 by a dashed line. Outwardly displayed on
`the housing 32a is an array of 5 indicator lamps or lights,
`generally indicated with the numeral 42. These lights may be
`light emitting diodes (LED’ s) although the invention is not so
`lin1ited. The array 42 includes a light 4211, which when lighted
`indicates to a user of the device 32 that an a valid remote
`
`control signal is being received and a function is imple-
`mented. So too, the array includes 4 lights generally indicated
`with the underlined numeral 42b, which when lighted indi-
`vidually indicate the respective one bank of audio files that
`has been selected for indication of a particular file to be
`played. The preferred embodiment includes 4 bank indicator
`lights 42b, respectively indicated with the numerals 0-9,
`10-19, 20-29, and 30-39. Thus, the preferred embodiment
`provides the user with an internally stored selection of 40
`audio files that may be selected. As will be seen, however, the
`apparatus has the facility to accept a removable memory
`media (i.e., such as a flash memory card, or compact flash
`card) so that a larger number than 40 of audio files may be
`available to play. In the case of a larger number of files than 40
`being available to play, the indicator lights 42b may include
`more than 4 lights, or the 4 lights ofthe preferred embodiment
`may be lighted in groups of two or more to indicate the bank
`of audio files selected. That is, lights 0-9, plus 19-20 when
`lighted together could indicate the files 40-49, and so on).
`Further considering the diagrammatic presentation of FIG.
`2, it is seen that the apparatus 32 is associated with a power
`converter 44, receiving line power from a receptacle 46. The
`power converter 44 provides the lower voltage level and
`power required for the apparatus 32. Apparatus 32 also may
`receive inputs (arrowed numeral 3 0a) from the remote control
`30 via an infrared port or receiver 48. Again, the apparatus 32
`is not limited to the use of a remote control or to the use of any
`particular type of remote control. However, operation of the
`
`6
`apparatus 32 by use of a remote control 30 is the intended
`primary mode of operation and is explained in detail below.
`The operation of the apparatus 32 by use of one or more
`remote controls 30 is believed to most effectively contribute
`to and promote the creation of a spontaneous dynamic envi-
`ronment in which user(s) of the apparatus 32 add to the home
`viewing experience for sporting events and other activities in
`a creative and individual way.
`A reader 50 for a removable digital storage media 52 (i.e.,
`a memory card) also provides optional input to (i.e., by
`changing out one memory card for another) and audio file
`storage memory for the apparatus 32. As will be further
`explained, insertion of a memory card 52 into the reader 44
`makes a supplemental library of sound effects which are
`stored on the memory card immediately available to the user
`of the apparatus 32. Further, by appropriate input commands
`effected to the apparatus 32 (i.e., using a computer commu-
`nicating over a USB port, or over a network interfaced via an
`Ethernet port), one or more of the sound effects (i.e., audio
`files) stored on the memory card 46 may be relocated to
`permanent memory and stored in the apparatus 32 at a
`selected one of the “on board” memory locations.
`Further to the desired function of the user being able to
`select and store sound effect files in the apparatus 32, it is seen
`that the apparatus includes a USB port 54 and an Ethernet port
`56. Each of the ports 54 and 56 provide for the apparatus 32
`to be interfaced with a personal computer (i.e., either directly
`via USB, or via a network via Ethernet), and via the personal
`computer to be interfaced with the intemet. Consequently, the
`user 28 ofthe apparatus 32 may access the internet, and select
`from a great variety of interesting sound effect files presently
`there available or to be made available in the future. Desir-
`
`ably, the sound effect files are MP3 files, although the appa-
`ratus 32 is not limited to use of MP3 audio files. That is, the
`apparatus 32 may accept and play audio files of format other
`then MP3. For example, the apparatus 32 may accept and play
`Wave audio files.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`As is seen in FIG. 2, all ofthe input and output functions of
`the apparatus 32 are moderated to and by the microprocessor-
`based control unit or controller 60. This controller 60 accord-
`
`40
`
`ing to the preferred embodiment includes some on-board
`memory 60a (i.e., non-volatile, as well as random access
`memory which may be volatile), which may be implemented
`as EPROM and RAM memory, and in which the program-
`ming ofthe controller 60, as well as at least a partial library of
`sound effect files (i.e., a library of 40 internally stored audio
`files according to the preferred embodiment) are stored. As is
`seen in FIG. 2, the on-board memory in the preferred embodi-
`ment is implemented by use of a resident (on board, but not
`on-chip) digital storage device 6011, which communicates
`with the microprocessor controller 60 via a bi-directional
`command and data link 60b. Alternatively, as will be well
`understood to those ordinarily skilled in the pertinent arts, the
`microprocessor controller 60 my have an associated internal
`(or on-chip) memory facility, which may be of the PROM, or
`RAM type (or of both types), or the necessary memory facil-
`ity may be of another type according to the particular pr