USOO8363087B2
`
`(12) Unlted States Patent
`(10) Patent No.:
`US 8,363,087 B2
`
`Iwabuchi et al.
`(45) Date of Patent:
`Jan. 29, 2013
`
`(54) TELEVISION RECEIVERWITHATV PHONE
`FUNCTION
`
`(75)
`
`_
`_
`Inventors: Kazunorl Iwabuchl, Yokohama (JP);
`Hiroki Mizosoe, Kawasaki (JP);
`.
`-
`-
`'
`Mqtsuml ShlmOda’ Kawasakl UP)’
`Setlawan Bondan, Yamato (JP);
`Manabu Sasamoto, Yokohama (JP)
`
`.
`(73) Ass1gnee: Hitachi, Ltd., Tokyo (JP)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 632 days.
`
`7,593,031 B2*
`................. 348/14.04
`9/2009 Root et a1.
`8,013,938 B2*
`348/14.04
`9/2011 Shyu ........
`2007/0139514 A1*
`6/2007 Marley ....................... 348/14.01
`2007/0216760 A1
`9/2007 Kondo et al.
`2009/0073253 A1 *
`3/2009 Lee ............................ 348/14.04
`2009/0079813 A1*
`3/2009 Hildreth
`348/14.03
`
`2009/0174762 A1*
`7/2009 Takahashi
`348/14.02
`2009/0251526 A1 * 10/2009 Book ......................... 348/1401
`
`JP
`JP
`JP
`
`JP
`JP
`
`FOREIGN PATENT DOCUMENTS
`05-056190
`8/1991
`05-236472
`2/1992
`07-184174
`12/1993
`
`09-083983
`2006-20286
`
`9/1995
`5/2005
`
`* cited by examiner
`
`(21) Appl.No.: 12/457,257
`
`(22)
`
`Filed:
`
`Jun. 4, 2009
`
`Primary Examiner 7 Stella W00
`(74) Attorney, Agent, or Firm 7 Stites & Harbison, PLLC;
`Juan Carlos A. Marquez, Esq.
`
`Prior Publication Data
`
`(57)
`
`ABSTRACT
`
`(65)
`
`(30)
`
`US 2010/0073455 A1
`
`Mar. 25, 2010
`
`Foreign Application Priority Data
`
`Sep. 25, 2008
`
`(JP) ................................. 2008-246232
`
`(51)
`
`Int. Cl.
`(2006.01)
`H04N 7/14
`(52) US. Cl.
`.................................................... 348/14.04
`(58) Field of Classification Search ............... 348/14.04,
`348/14.01, 14.07
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,526,037 A *
`6,339,842 B1 *
`
`............ 348/14.04
`6/1996 Cortjens et al.
`1/2002 Fernandez et al.
`......... 348/14.04
`
`A videophone system includes a processor which selectively
`sets a television (TV) broadcast program viewing function
`mode and videophone function mode in response to manual
`operation of a remote control, a decoder which performs, in
`the TV program view mode, a TV program-use decode func-
`tion for decoding a broadcast program signal received from a
`TV tuner to thereby display it on a display screen while
`producing audio sounds by loudspeakers and which per-
`forms, in the videophone function mode a Videophone-use
`decode function for decoding a videophone signal received
`from a distant party to thereby display on the screen an image
`of the distant party using the screen and speakers, and an
`encoder which performs a Videophone-use encode function
`for encoding a video signal from a camera and a voice signal
`from a microphone to generate a videophone signal, which is
`sent to the distant party via a network.
`
`8 Claims, 10 Drawing Sheets
`
`f1
`
`DISPLAY SCREEN
`
`
`
`3
`
`SPEAKER
`
`
`
`
`
`BROADCAST
`TUNER
`DECODER
`
`
`
`
`
`14
`12
`
`2
`INBOUND
`CALL
`DETECTOR
`
`PROCESSOR
`
`
`
`
`
`
`
`
`
`_1_
`
`
`NETWORK
`IIF
`RECEIVER
`no SIGNAL ~16
`
`
`
`
`
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1010 Page 1
`
`IPR2020-00200
`Apple Inc. EX1010 Page 1
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 1 of 10
`
`US 8,363,087 B2
`
`
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 2
`
`IPR2020-00200
`Apple Inc. EX1010 Page 2
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 2 of 10
`
`US 8,363,087 B2
`
`FIG.2
`
`DISPLAYSCREEN
`
`'
`
`I
`
`DECODER
`
`BROWSER
`
`ENCODER
`
`I
`
`|BROADCASTI
`
`TUNER I
`
`PROCESSOR
`
`RC SIGNAL
`RECEIVER
`
`INBOUND
`CALL
`
`DETECTOR
`
`|PR2020-00200
`
`Apple Inc. EX101O Page 3
`
`IPR2020-00200
`Apple Inc. EX1010 Page 3
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 3 of 10
`
`US 8,363,087 B2
`
`FIG .3
`
`SERVER
`
`SERVER
`
`
`
`
`
`VIDEOPHONE
`VIDEOPHONE
`FUNCTION-ADDED
`FUNCTION-ADDED
`TV RECEIVER
`TV RECEIVER
`
`
`
`
`
`1|
`
`
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 4
`
`IPR2020-00200
`Apple Inc. EX1010 Page 4
`
`

`

`U.S. Patent
`
`Jan. 29, 2013
`
`Sheet 4 of 10
`
`US 8,363,087 B2
`
`FIG.5
`
`ITEM #
`
`VOD PROCESSING
`
`PHONE PROCESSING
`
`PW BUTTON DEDRESSED
`
`PW BUTTON DEPRESSED
`
`OVOD BUTTON DEPRESSED
`0 BROWSER START
`
`° PHONE BUTTON PRESSED
`0 BROWSER START
`
`SERVER SEN DS
`OPERATION SCREEN
`
`- BROWSER STOP
`
`TITLE SELECTED & DECIDED
`
`CALL DESTINATION
`SELECTED & DECIDED
`
`CHECK CHARGE &
`PLAYBACK RIGHT
`
`0 DISPLAY CALIJNG MESSAGE
`OACTNATE CAMERA, MIC &
`B\ICODER
`
`° SVVTTCH DECODER INPUT
`0 DECODER OPERATION START
`-PLAYBACK
`’
`
`° SWITCH DECODER INPUT
`- DECODER OPERATION START
`-TALKING BY PHONE
`
`0 STOP BUTTON DEPRESSED
`0 DECODER STOP
`
`'STOP BUTTON DEPRESSED
`- DECODER STOP
`' BROWSER STOP
`' CAMERA, MIC &
`ENCODER DEACTNATED
`
`SAME BUTTON
`OPERATION AS
`DECODER
`IS DEACTNATED
`
`7 mm
`
`cw —
`
`FIG.6
`
`- PWOFF
`
`DURINGTVWATCHING
`
`DURING VOD
`
`WATCHING
`
`‘
`
`OTHERS
`
`' AUTO-PLAY START ' PRESENT STATE SAVE
`
`-AUTO-PW ON
`0 CALL HAN DUNG
`°TVWATCHING
`
`0 AUTO-VID EOREC START
`0 CALL HANDLING
`
`~AUTO-PAUSE
`0 CALL HAN DIJNG
`- PAUSE RESET
`
`0 CALL HAN DUNG
`° RECOVER TO SAVED
`STATE
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 5
`
`IPR2020-00200
`Apple Inc. EX1010 Page 5
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 5 of 10
`
`US 8,363,087 B2
`
`FIG .7A
`
`SELF-SIDEVIDEOPHONE
`FUNCTION-ADDED TV RECBVER 1
`
`0TH ER-SIDE VIDEOPHONE
`FUNCTION-ADDED TV RECEIVER 1'
`
`
` INSTRUCT TO
`
`
`NOTIFY
`
`
`ASECNQE'EHNH
`
`
` INSTRUCT TO
`
`ACTNATE
`
`
`BJCODER 18'
`
`
`
`NOTIFY
`
`ACTIVATION OF
`
`ENCODER 18‘
`
`
`
`
`DETECT DEPRESSION
`OF PHONE BUTTON 7d
`
`GEI' BROWSER
`13 STARTED
`
`ACTNATE
`DECODER 11'
`
`
`
`ACTNATE
`DECODER 1 1'
`
`ENCODER 1a
`GETSSTARTED
`
`DECODER 11
`GETS STARTED
`
`TALKING BY PHONE
`
`F | G . 7 B
`
`700
`
`
`701
`
`703
`
`704
`
`
`
`
`706
`
`
`
`710
`
`712
`
`713
`
`716
`
`OTHER-SIDEVIDEOPHONE
`FUNCTION-ADDED TV RECENER 1'
`
`I
`.
`!
`
`SflF-SIDE VIDEOPHONE
`FUNCTION-ADDED TV RECEVER 1
`DETECTDB’RESSION
`OF STOP BUTTON 7n
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`71 4
`
`
`
`
`I
`
`DECODER 11
`
`NOTIFY DEACTNATION
`
`DEACTNATION
`OF DECODER 11'
`
`DEACTNATE
`DECODER 11‘
`
`DEACTNATE
`3100053 18
`
`
`
`
`DE‘IEIR/‘Hm
`
`
`OF ENCODER 18'
`
`
`
`DEACTNATE
`ENCODEFI 18'
`
`|PR2020-00200
`
`Apple Inc. EX101O Page 6
`
`IPR2020-00200
`Apple Inc. EX1010 Page 6
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 6 of 10
`
`US 8,363,087 B2
`
`
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 7
`
`IPR2020-00200
`Apple Inc. EX1010 Page 7
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 7 of 10
`
`US 8,363,087 B2
`
`FIG.9
`
`1a
`
`DISPLAY SCREEN
`
`.ROADCAST
`_UNER
`
`-]
`.
`DECODER =
`all SPEAKER
`BROWSER -il
`
`INBOUND
`CALL
`DETECTOR
`
`HTML
`
`LINK-/F
`
`-AMERA
`
`|PR2020-00200
`
`Apple Inc. EX101O Page 8
`
`IPR2020-00200
`Apple Inc. EX1010 Page 8
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 8 of 10
`
`US 8,363,087 B2
`
`FIG.1O
`
`POWER ON
`
`
`
`CHECK CONNECTION STATE
`OF VIDEO CAMERA 30
`
`
`
`- CONNECTED
`- DISCONNECTED—>CONNECTED
`
`' NOT CONNECTED
`' CONNECTEDfiDISCONNECTED
`VIDEO CAMERA
`
`30 CONNECTED
`
`
`
`
`
` SET ENCODER 34 OF
`VIDEO CAMERA 30 IN
`LIVE OUTPUT MODE
`
`'
`
`DISABLE VIDEOPHONE
`FUNCTION MODE
`
`
`
`
`
`
`ENABLE VIDEOPHONE
`FUNCTION MODE
`
`POWER ON
`
`CHECK CALL STATE
`
`FIG.11
`
`
`
`
`
`
`
`
`VIDEOPHONE
`
`REQUESTED
`
`
`
`
`
`
`SET ENCODER 34 OF
`VIDEO CAMERA 30 IN
`LIVE OUTPUT MODE
`
`
`
`SET VIDEO CAMERA
`
`ENCODER IN CUMULATIVE
`
`VIDEO-REC MODE
`
`|PR2020-00200
`
`Apple Inc. EX101O Page 9
`
`IPR2020-00200
`Apple Inc. EX1010 Page 9
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 9 of 10
`
`US 8,363,087 B2
`
`FIG.12
`
`DISPLAY SCREEN
`
`- ENCODER
`
`DECODER
`
`I DECODER .l
`HTML
`I
`
`BROWSER -
`
`INBOUND
`
`I. De?é‘é#on
`
`NETWORK
`l/F
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 10
`
`IPR2020-00200
`Apple Inc. EX1010 Page 10
`
`

`

`US. Patent
`
`Jan. 29, 2013
`
`Sheet 10 of 10
`
`US 8,363,087 B2
`
` A
`
`(a) OUTPUTTo RIGHT M
`(b, OUTPUT To LEFT m
`
`B
`
`/
`
`Am
`
`SPEAKER 3R
`
`SPEAKER 3L
`
`(C) INPUT OF MIC 5
`
`(d) INPUT OF ENCODER 18
`
`MA—a—
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 11
`
`IPR2020-00200
`Apple Inc. EX1010 Page 11
`
`

`

`US 8,363,087 B2
`
`1
`TELEVISION RECEIVER WITH A TV PHONE
`FUNCTION
`
`INCORPORATION BY REFERENCE
`
`The present application claims priority from Japanese
`application JP2008-246232 filed on Sep. 25, 2008, the con-
`tent of which is hereby incorporated by reference into this
`application.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The present technology relates to a television (TV) receiver
`set with TV phone functionality added thereto, which is
`arranged to have a Video telephone call enabling means to
`thereby make it possible to perform video/voice-based tele-
`communication with another machine. This technology also
`relates to a TV phone system using videophone function-
`added TV receivers of this type.
`2. Description of the Related Art
`A telephone communication system and TV broadcast sys-
`tem are independently established systems. Traditionally, a
`telephone equipment and TV receiver set are quite different
`apparatuses. In cases where a telephone receives an incoming
`call and generates a ring sound or melody (calling sound)
`signaling the incoming call, a called party fails to hear this
`sound from time to time. A technique for avoiding this risk is
`disclosed, for example, in JP-A-5-56l90. With this tech-
`nique, a telephone is communicatively connected by a signal
`transmission line to a TV receiver, wherein the TV receiver is
`arranged so that upon receipt of an incoming call at the
`telephone, the TV receiver displays a phone call arrival mes-
`sage on its display screen.
`Alternatively, a video telephone apparatus is also known,
`which is arranged to enable a user to make a phone call with
`a distant party at the other end of a line by transmission and
`reception of video images and voices. This type of video-
`phone typically has a camera, microphone, loudspeaker and
`image display device and is designed to transmit toward the
`distant party’s videophone video and voice signals that are
`obtained by the camera and microphone ofthe videophone on
`the self side, receive video and voice signals from the distant
`party’s videophone, and display this video by the image dis-
`play device while reproducing the voice by the speaker. In a
`case where transmission is done to the distant party’s video-
`phone, a video image and voice are subjected to compression
`processing (encoding) for transmission while simultaneously
`performing expansion processing (decoding) of a video and
`voice that are received from the distant party’s videophone,
`and reproducing them at the image display device and speaker
`(for detail, see JP-A-9-83983).
`
`SUMMARY OF THE INVENTION
`
`In the prior known technique as disclosed in JP-A-5-
`56190, the TV receiver and the videophone are arranged so
`that these are discrete devices which operate independently of
`each other. Upon receipt of an incoming telephone call at the
`videophone during watching a TV broadcast program by the
`TV receiver, a message which notifies arrival of such phone
`call is displayed on the TV receiver’s display screen so that a
`user easily knows that there is an incoming phone call. In this
`event, the user must walk to a place at which this videophone
`is put and perform manual operations for startup of talking
`with a caller on the videophone. This is a time-consuming and
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`troublesome work for the user who is watching his or her
`preferred TV broadcast program.
`In the case of not only starting a telephone call but also
`ending the phone call, the user is required to perform a manual
`operation for the phone call completion (e. g., putting a trans-
`ceiver handset on a base unit or. “cradle”). This operation also
`is performed at the location in which the videophone is
`placed.
`In this way, traditionally, when there is an incoming phone
`call during watching a TV broadcast program by TV receiver,
`the user must move from a place at which he or she was there
`until then and perform manual operations for startup and
`completion of the phone call. These operations are time-
`consuming and troublesome works to the user.
`To provide a solution to the above-stated problem, this
`technology provides a new and improved TV receiver with
`TV function(referred to as videophone function-added TV
`receiver hereafter) set having videophone call handling func-
`tionality, which performs both the reception of a digital
`broadcast program signal and the transmission and reception
`ofa videophone signal between itselfand another videophone
`function-added TV receiver at the other end of a communi-
`
`cation line, wherein the videophone function-added TV
`receiver is characterized by having a decoder which decodes
`a received digital broadcast program signal and videophone
`signal, a display panel to which is supplied a video signal that
`is decoded by the decoder and which visually displays it on a
`screen, a loudspeaker module to which is supplied an audio/
`voice signal which is decoded by the decoder, a camera, a
`microphone, and an encoder which encodes output signals of
`the camera and microphone.
`Another feature of the videophone function-added TV
`receiver lies in that it further includes an encoder which
`
`generates a videophone signal to be transmitted for video-
`phone communications and a means for detecting completion
`of a videophone signal decoding operation ofthe decoder and
`for stopping an encoding operation of the encoder for gen-
`eration of the videophone signal.
`This technology also provides a video telephone system
`using a plurality of videophone function-added TV receiver
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone func-
`tion-added TV receiver includes a decoder which has a video-
`
`phone-use decode function for decoding a videophone signal
`from another videophone function-added TV receiver at the
`other end of a line and a TV program-use decode function for
`decoding a digital broadcast program received, a display
`panel which displays a video signal that is decoded by the
`decoder, a loudspeaker to which is supplied an audio signal
`that is decoded by the decoder, a camera, a microphone, an
`encoder which has a videophone-use encode function for
`encoding a video signal from the camera and an audio signal
`from the microphone to thereby generate a videophone signal
`to be sent forth toward a videophone function-added TV
`receiver of a distant party at the other end of a line in a
`videophone call session, a means for stopping a decoding
`operation of the decoder by means of the videophone-use
`decode function in responding to either a stop operation or the
`end of a videophone signal from the videophone function-
`added TV receiver of the distant party in the videophone call
`session, and a means for detecting completion of the video-
`phone signal decoding operation performed by the decoder
`and for stopping the encoding operation of the encoder,
`wherein in case one of the videophone function-added TV
`receivers which are presently involved in a videophone com-
`munication session experiences termination of the decode
`
`|PR2020-00200
`
`Apple Inc. EX1010 Page 12
`
`IPR2020-00200
`Apple Inc. EX1010 Page 12
`
`

`

`US 8,363,087 B2
`
`3
`operation of the decoder by means of the videophone-use
`decode function thereof in response to execution of the stop
`operation, when the encoding operation of the encoder is
`stopped in responding thereto,
`the videophone function-
`added TV receiver of the distant party, e. g., a calling party or
`a called party at the other end of the line, is such that the
`decoder stops its decoding operation by means of the video-
`phone-use decode function thereof to thereby force the
`encoder to stop its encoding operation by means ofthe video-
`phone-use encode function in response to the stop of the
`decoding operation.
`This technology also provides a Video telephone system
`using a plurality of videophone function-added TV receiver
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone func-
`tion-added TV receiver includes a decoder which has a video-
`
`phone-use decode function for decoding a videophone signal
`from another videophone function-added TV receiver at the
`other end of a line and a TV program-use decode function for
`decoding a digital broadcast program received, a display
`panel which displays a video signal that is decoded by the
`decoder, a loudspeaker to which is supplied an audio signal
`that is decoded by the decoder, a camera, a microphone, an
`encoder which has a videophone-use encode function for
`encoding a video signal from the camera and an audio signal
`from the microphone to thereby generate a videophone signal
`to be sent forth toward a videophone function-added TV
`receiver of a distant party at the other end of a line in a
`videophone call session, a means for stopping a decoding
`operation of the decoder by means of the videophone-use
`decode function in responding to either a stop operation or the
`end of a videophone signal from the videophone function-
`added TV receiver of the distant party in the videophone call
`session, a means for detecting completion of the videophone
`signal decoding operation performed by the decoder and for
`stopping the encoding operation of the encoder, and a means
`for detecting completion of the videophone signal decoding
`operation of the decoder and for sending a stop command
`signal to the videophone function-added TV receiver of the
`distant party at the other end of the line, wherein in case one
`of the videophone function-added TV receivers which are
`presently involved in a videophone communication session
`experiences termination of the decode operation of the
`decoder by means of the videophone-use decode function
`thereof in response to execution of the stop operation, when
`the encoding operation of the encoder is stopped in respond-
`ing thereto, and also when the stop command signal is sent to
`the videophone function-added TV receiver of the distant
`party, this distant party’s videophone function-added TV
`receiver operates so that the decoder stops its decoding opera-
`tion by means of the videophone-use decode function thereof
`in response to receipt of the stop command signal and, in
`response to this decode operation stop, the decoder stops the
`decoding operation by means of the videophone-use decode
`function thereof.
`
`This technology also provides a video telephone system
`using a plurality of videophone function-added TV receiver
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone func-
`tion-added TV receiver includes a decoder which has a video-
`
`phone-use decode function for decoding a videophone signal
`from another videophone function-added TV receiver at the
`other end of a line and a TV program-use decode function for
`decoding a digital broadcast program received, a display
`panel which displays a video signal that is decoded by the
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`decoder, a loudspeaker to which is supplied an audio signal
`that is decoded by the decoder, a camera, a microphone, an
`encoder which has a videophone-use encode function for
`encoding a video signal from the camera and an audio signal
`from the microphone to thereby generate a videophone signal
`to be sent forth toward a videophone function-added TV
`receiver of a distant party at the other end of a line in a
`videophone call session, a means for stopping an encoding
`operation by means ofthe videophone-use encode function of
`the encoder in response to a stop operation of a videophone
`call, a means for detecting completion of an encoding opera-
`tion of a video signal from the camera and an audio signal
`from the microphone to be performed by the encoder and for
`stopping the decoding operation by means ofthe videophone-
`use decode function of the decoder, and a means for detecting
`completion of the encoding operation of the encoder and for
`sending a stop command signal to a videophone function-
`added TV receiver of a distant party at the other end of a line,
`wherein in case one of the videophone function-added TV
`receivers which are presently involved in a videophone com-
`munication session experiences termination of the encode
`operation of the encoder by means of the videophone-use
`encode function thereof in response to execution of a stop
`operation, when the decoding operation of the decoder is
`stopped in responding thereto, and also when the stop com-
`mand signal is sent to the videophone function-added TV
`receiver of the distant party, this distant party’s videophone
`function-added TV receiver is such that the encoder stops its
`encoding operation by means of the videophone-use encode
`function thereof in response to receipt of the stop command
`signal and, in response to the stop of this encode operation,
`the decoder stops the decoding operation by means of the
`videophone-use decode function thereof.
`This technology also provides a videophone function-
`added television receiver having a video camera detachably
`connected to an apparatus main body, wherein the TV
`receiver includes in the apparatus main body a decoder which
`has a television program-use decode function for decoding a
`digital broadcast program signal received and a videophone-
`use decode function for decoding a video telephone signal as
`received in a videophone call session, and a processor for
`control of each component, wherein the video camera has a
`camera, a microphone, a storage device which stores therein
`a video signal from the camera and an audio signal from the
`microphone, and an encoder to which are supplied a video
`signal as output from the camera and an audio signal as output
`from the microphone and which encoder has a videophone-
`use encode function of encoding the video signal and the
`audio signal into a video telephone signal to be transmitted to
`a videophone function-added television receiver of a distant
`party in a videophone call session and a video recording-use
`encode function for encoding the video signal and the audio
`signal into a video signal to be recorded in the storage device,
`and wherein in a state that the video camera is connected to
`
`the apparatus main body, when the decoder is in a state that it
`operates to perform the videophone-use decode function, the
`processor sets the encoder in a state that it operates to perform
`the videophone-use encode function thereof, resulting in the
`decoder being switched from the operation state of the video-
`phone-use decode function to an operation state of the tele-
`vision program-use decode function and, alternatively, when
`the video camera is in a state that it is disconnected from the
`
`apparatus main body, the processor sets the encoder in a state
`that it operates to perform the video recording-use encode
`function.
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1010 Page 13
`
`IPR2020-00200
`Apple Inc. EX1010 Page 13
`
`

`

`US 8,363,087 B2
`
`5
`In the videophone function-added television receiver, the
`Video camera is a separate equipment independent of the
`apparatus main body and is detachably coupled to the appa-
`ratus main body.
`Alternatively, in the videophone function-added television
`receiver, the video camera is internally mounted in the appa-
`ratus main body.
`This technology also provides a videophone system using
`a plurality of videophone function-added TV receivers of the
`type stated above, which are linked together via a network for
`enabling users to make a videophone call between any two of
`the videophone function-added TV receivers, wherein the
`system includes a means for stopping an encoding operation
`by means of a videophone-use encode function of an encoder
`in response to a stop operation of a videophone call, a means
`for detecting completion of an encoding operation of a video
`signal from a camera and an audio signal from a microphone
`to be performed by the encoder and for stopping a decoding
`operation by means of a videophone-use decode function of a
`decoder, and a means for detecting completion of the encod-
`ing operation ofthe encoder and for sending a stop command
`signal to a videophone function-added TV receiver of a dis-
`tant party at the other end of a line, wherein in case one of the
`videophone function-added TV receivers which are presently
`involved in a videophone communication session experi-
`ences termination of the encode operation of the encoder by
`means of the videophone-use encode function thereof in
`response to execution of a stop operation, when the decoding
`operation ofthe decoder is stopped in responding thereto, and
`also when the stop command signal is sent to the videophone
`function-added TV receiver of the distant party, this distant
`party’s videophone function-added TV receiver is such that
`the encoder stops its encoding operation by means of the
`videophone-use encode function thereof in response to
`receipt of the stop command signal and, in response to this
`encode operation stop, the decoder stops the decoding opera-
`tion by means ofthe videophone-use decode function thereof.
`This technology also provides a videophone function-
`added TV receiver, wherein a decoder includes a first decoder
`operative to decode the received digital broadcast program
`signal and a second decoder for decoding the video telephone
`signal, wherein a display panel performs two-window display
`for simultaneously displaying on one screen a video image
`based on the digital broadcast program signal decoded by the
`first decoder and a video image based on the video telephone
`signal decoded by the second decoder, wherein an echo can-
`celler is provided to receive an audio signal as output from the
`microphone and an input audio signal of the speaker, and
`wherein an echo signal due to unwanted mixture of audio
`sounds from the speaker into the audio signal as output from
`the microphone is canceled by the echo canceller using the
`input audio signal of the speaker and is then supplied to an
`encoder.
`
`The technology further provides a videophone system
`using videophone function-added TV receivers of the type
`stated supra, wherein a decoder includes a first decoder opera-
`tive to decode the received digital broadcast program signal
`and a second decoder for decoding the video telephone signal,
`wherein a display panel performs two-window display for
`simultaneously displaying on one screen a video image based
`on the digital broadcast program signal decoded by the first
`decoder and a video image based on the video telephone
`signal decoded by the second decoder, wherein an echo can-
`celler is provided to receive an audio signal as output from the
`microphone and an input audio signal of the speaker, and
`wherein an echo signal due to mixture of audio sounds from
`the speaker into the audio signal as output from the micro-
`
`6
`phone is canceled by the echo canceller using the input audio
`signal of the speaker and is then supplied to an encoder.
`With the above- stated arrangement, it is possible to provide
`a TV receiver with increased usability for users. For example,
`video image displaying for a videophone call is performed
`using the display screen and loudspeaker module which are
`inherently used for digital TV broadcast programs; so, it is
`possible for a user to start a phone call and finish the call
`without having to move from a place at which s/he is enjoying
`a digital TV broadcast program. This saves the user’ s labor for
`such moving action. Additionally, upon completion of the
`phone call, the decoder and encoder are automatically ren-
`dered inoperative without requiring the user to perform
`manual operations. This results in a decrease in labor for such
`operations. It is also possible to prevent a calling party from
`becoming aware ofthe digital TV broadcast program which is
`watched by the user.
`Other objects, features and advantages ofthe invention will
`become apparent from the following description of the
`embodiments of the invention taken in conjunction with the
`accompanying drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a diagram showing a perspective view of exterior
`appearance of a videophone function-added television (TV)
`receiver set in accordance with a first embodiment.
`
`FIG. 2 is a block diagram showing a practical example of
`an electrical/electronic circuit configuration of the video-
`phone function-added TV receiver of the first embodiment
`shown in FIG. 1.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`FIG. 3 is a system diagram showing one embodiment of a
`video telephone system using videophone function-added TV
`receivers.
`
`35
`
`40
`
`45
`
`50
`
`FIG. 4 is a plan view of an example of operation part ofa
`remote control in FIGS. 1 and 2.
`
`FIG. 5 is a diagram showing, in table form, processing
`procedures in a video-on-demand (VOD) function mode and
`videophone function mode ofthe videophone function-added
`TV receiver shown in FIGS. 1 and 2.
`
`FIG. 6 is a diagram showing one example of inbound call
`handling processing in a case where there is a call-in of the
`videophone function-added TV receiver shown in FIG. 1 or
`FIG. 2.
`
`FIGS. 7A and 7B are flow charts showing practical
`examples of forced start/stop control operations of a decoder
`and encoder, which are executed by respective processors
`upon startup and completion of a phone call between the
`videophone function-added TV receivers shown in FIG. 3.
`FIG. 8 is a diagram showing a perspective view of outer
`appearance of a videophone function-added TV receiver in
`accordance with a second embodiment.
`
`55
`
`FIG. 9 is a block diagram showing a practical example of a
`circuit configuration of the videophone function-added TV
`receiver of the second embodiment shown in FIG. 8.
`
`60
`
`65
`
`FIG. 10 is a flowchart showing a procedure for connect
`control of a video camera of FIG. 9 to be performed by a
`processor in videophone function mode.
`FIG. 11 is a flowchart showing a procedure for select
`control of an operation mode of the video camera in FIG. 9.
`FIG. 12 is a block diagram showing a practical example of
`a circuit configuration of a videophone function-added TV
`receiver in accordance with a third embodiment.
`
`FIG. 13 is a diagram for explanation of leakage of audio
`sounds from a pair of loudspeakers to a microphone in the
`videophone function-added TV receiver shown in FIG. 12.
`
`IPRZOZO-OOZOO
`
`Apple Inc. EX1010 Page 14
`
`IPR2020-00200
`Apple Inc. EX1010 Page 14
`
`

`

`US 8,363,087 B2
`
`7
`FIGS. 14 is a diagram schematically showing waveforms
`of some major signals for explanation of an operation of an
`echo canceller shown in FIG. 12.
`
`DESCRIPTION OF THE EMBODIMENTS
`
`Currently preferred embodiments will be described with
`reference to the accompanying figures of the drawing below.
`FIG. 1 is a diagram showing a perspective view of exterior
`appearance of a television (TV) receiver set with additional
`video telephone functionality in accordance with a first
`embodiment. The videophone function-added TV receiver is
`designated by reference numeral 1, which has a display
`screen 2, loudspeaker module 3, video camera 4, microphone
`5, communications network cable 6, and wireless remote
`control device 7.
`
`As shown in FIG. 1, the loudspeaker module 3 includes a
`couple of spaced-apart speakers, which are mounted in a front
`panel of housing of the videophone function-added TV
`receiver 1 at right and left side comers below the display
`screen 2. The camera 4 is embedded in the front panel at a
`center position of lower side which is midway between the
`right and left speakers. This camera 4 has its image pickup
`lens which is exposed to outside. The microphone 5 is built in
`the front panel of housing at an upper center position above
`the display screen 2. This first embodiment is the one that has
`a built-in video camera in the housing of videophone func-
`tion-added TV receiver 1.
`
`The videophone function-added TV receiver 1 also has an
`antenna (not shown) for enabling it to receive digital broad-
`cast programs and, simultaneously, is linked by the network 6
`to a video-on-demand (VOD) server, thereby enabling it to
`receive services (downloads) of any available contents from
`this VOD server-say, VOD contents. The videophone func-
`tion-added TV receiver 1 is also linked by the network 6 to
`other videophone function-added TV receivers and thus is
`capable of performing video telephone communications with
`these TV receivers.
`
`The videophone function-added TV receiver 1 of FIG. 1 is
`controlled by the remote control 7 and, by a manual operation
`of this remote control, receives digital broadcast programs,
`downloads VOD contents and/or makes a videophone call
`with another videophone function-added TV receiver.
`Note here that in the case of considering the height due to
`recent growth in size ofTV receivers, when a user watches the
`display screen while he or she sits on a sofa in a room, such as
`a family room, if the camera 4 is disposed on upside of the
`display screen 2, the camera 4 looks down the user and, in this
`state, captures or “shoots” an image of the user. Accordingly,
`when the videophone function-added TV receiver 1 is used as
`a videophone, a video image of the user who bends down his
`or her head is transmitted to and displayed at a videoph