I 1111111111111111 1111111111 11111 1111111111 1111111111 111111111111111 IIII IIII
`
`
`
`
`
`
`
`US010084991B2
`
`c12) United States Patent
`Iwabuchi et al.
`
`US 10,084,991 B2
`(IO) Patent No.:
`*Sep.25,2018
`(45) Date of Patent:
`
`(54) COMMUNICATION APPARATUS AND
`METHOD FOR RECEIVING AN INBOUND
`VIDEOPHONE CALL NOTICE WHILE
`DISPLAYING DIGITAL INFORMATION ON
`THE DISPLAY
`
`(71) Applicant: Maxell, Ltd., Kyoto (JP)
`
`(72)
`
`Inventors: Kazunori Iwabuchi, Yokohama (JP);
`Hiroki Mizosoe, Kawasaki (JP);
`Mutsumi Shimoda, Kawasaki (JP);
`Setiawan Bondan, Yamato (JP);
`Manabu Sasamoto, Yokohama (JP)
`
`(73) Assignee: Maxell, Ltd., Kyoto (JP)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 15/837,402
`
`(22) Filed:
`
`Dec. 11, 2017
`
`(65)
`
`Prior Publication Data
`
`US 2018/0109761 Al
`
`Apr. 19, 2018
`
`Related U.S. Application Data
`
`(63) Continuation of application No. 15/631,298, filed on
`Jun. 23, 2017, which is a continuation of application
`(Continued)
`
`(30)
`
`Foreign Application Priority Data
`
`Sep. 25, 2008
`
`(JP) ................................. 2008-246232
`
`(51)
`
`Int. Cl.
`H04N 7114
`H04N 71173
`
`(2006.01)
`(2011.01)
`(Continued)
`
`(52) U.S. Cl.
`CPC ..... H04N 7117318 (2013.01); H04L 65/1063
`(2013.01); H04N 71147 (2013.01);
`(Continued)
`(58) Field of Classification Search
`CPC ............ G0lS 5/0072; H04M 1/72572; H04M
`2201/40; H04M 2250/52; H04M 3/4936;
`(Continued)
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,467,388 A * 11/1995 Redd, Jr.
`
`5,473,366 A * 12/1995 Imaeda
`
`.
`
`H04M 1/663
`379/196
`H04M 1/6505
`348/14.01
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`
`3/1993
`05-056190
`9/1993
`05-236472
`(Continued)
`
`OTHER PUBLICATIONS
`
`Japanese Office Action received in corresponding Japanese Appli(cid:173)
`cation No. 2013-230194 dated Mar. 10, 2015.
`(Continued)
`
`Primary Examiner - Khai N Nguyen
`(74) Attorney, Agent, or Firm - Mattingly & Malur, PC
`
`ABSTRACT
`(57)
`A videophone system includes a processor which selectively
`sets a television (TV) broadcast program viewing function
`mode and videophone function mode in response to manual
`operation of a remote control, a decoder which performs, in
`the TV program view mode, a TV program-use decode
`function for decoding a broadcast program signal received
`from a TV tuner to thereby display it on a display screen
`while producing audio sounds by loudspeakers and which
`performs, in the videophone function mode a videophone-
`(Continued)
`
`DISPLAY SCREEN
`
`IPR2020-00200
`Apple Inc. EX1001 Page 1
`
`

`

`US 10,084,991 B2
`Page 2
`
`use decode function for decoding a videophone signal
`received from a distant party to thereby display on the screen
`an image of the distant party using the screen and speakers,
`and an encoder which performs a videophone-use encode
`function for encoding a video signal from a camera and a
`voice signal from a microphone to generate a videophone
`signal, which is sent to the distant party via a network.
`
`16 Claims, 10 Drawing Sheets
`
`(51)
`
`(52)
`
`(58)
`
`Related U.S. Application Data
`
`No. 15/215,839, filed on Jul. 21, 2016, now Pat. No.
`9,723,268, which is a continuation of application No.
`14/811,048, filed on Jul. 28, 2015, now Pat. No.
`9,432,618, which is a continuation of application No.
`13/723,312, filed on Dec. 21, 2012, now Pat. No.
`9,124,758, which is a continuation of application No.
`12/457,257, filed on Jun. 4, 2009, now Pat. No.
`8,363,087.
`
`(2011.01)
`(2011.01)
`(2011.01)
`(2006.01)
`
`Int. Cl.
`H04N 211422
`H04N 2114223
`H04N 2114788
`H04L 29106
`U.S. Cl.
`CPC ......... H04N 71148 (2013.01); H04N 2114223
`(2013.01); H04N 21/42203 (2013.01); H04N
`2114788 (2013.01)
`
`Field of Classification Search
`CPC .......... H04M 3/5191; H04N 2007/145; H04N
`21/254; H04N 21/42203; H04N 21/4223;
`H04N 21/431; H04N 21/4788; H04N
`5/272; H04N 7/14; H04N 7/141; H04N
`7/142; H04N 7/144; H04N 7/147; H04N
`7/148; H04N 7/15; H04N 7/152; H04N
`7/155; H04N 7/157; H04N 7/17318;
`H04W 4/18; H04W 4/185
`......... 348/14.01, 14.02, 14.03, 14.04, 14.05,
`348/14.06, 14.07, 14.08, 14.09, 14.1,
`348/14.11, 14.12, 14.13, 14.14, 15.15,
`348/14.16; 379/265.03; 455/414.1, 566;
`704/270
`See application file for complete search history.
`
`USPC
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,526,037 A *
`
`6/1996 Cortjens
`
`5,528,285 A
`6/1996 Morikawa
`3/1997 Abecassis
`5,610,653 A
`5,684,918 A * 11/1997 Abecassis
`
`H04N 5/23203
`348/14.04
`
`............... A63F 13/10
`348/14.01
`H04M 3/42221
`348/14.06
`H04N7/147
`348/14.01
`7/1998 Skarbo ................... H04M 11/10
`348/14.06
`
`5,710,591 A *
`
`5,771,065 A *
`
`5,778,053 A *
`
`6,339,842 Bl
`6,529,742 Bl
`6,859,526 B2 *
`
`1/1998 Bruno
`
`6/1998 Hijikata
`
`1/2002 Fernandez et al.
`3/2003 Yang
`2/2005 Macklin .
`
`7,593,031 B2
`
`9/2009 Root et al.
`
`8,013,938 B2 *
`
`9/2011 Shyu .
`
`8,325,214 B2 * 12/2012 Hildreth .
`
`8,326,355 Bl
`8,363,087 B2 *
`
`12/2012 Fujisaki
`1/2013 Iwabuchi
`
`8,676,273 Bl
`9,124,758 B2 *
`9,432,618 B2 *
`9,723,268 B2 *
`2001/0041053 Al*
`
`3/2014 Fujisaki
`9/2015
`Iwabuchi
`8/2016
`Iwabuchi
`8/2017
`Iwabuchi
`11/2001 Abecassis
`
`2002/0019984 Al
`2003/0041333 Al *
`
`2/2002 Rakib
`2/2003 Allen
`
`2003/0206720 Al
`2004/0128700 Al*
`
`11/2003 Abecassis
`7/2004 Pan .
`
`2005/0250531 Al*
`
`11/2005 Takebe .
`
`2006/0041926 Al
`2006/0212920 Al
`2007/0070188 Al *
`
`Istvan
`2/2006
`9/2006 Yamaguchi
`3/2007 Shyu .
`
`2007 /0094691 Al *
`
`4/2007 Gazdzinski
`
`2007/0139514 Al
`2007/0186002 Al *
`
`6/2007 Marley
`8/2007 Campbell
`
`2007/0216760 Al
`2007/0233839 Al
`2007/0261091 Al*
`
`9/2007 Kondo et al.
`10/2007 Gaos
`11/2007 Tachikawa .
`
`2008/0134278 Al
`2008/0172693 Al
`2008/0212949 Al
`2008/03097 59 Al *
`
`6/2008 Al-Karmi
`7/2008 Ludvig
`9/2008 Wachtfogel
`12/2008 Wilson .
`
`2009/0013373 Al
`2009/0073253 Al
`2009/0079813 Al *
`
`1/2009 Iizuka
`3/2009 Lee
`3/2009 Hildreth .
`
`2009/0174762 Al*
`
`7/2009 Takahashi
`
`.
`
`2009/0251526 Al*
`
`10/2009 Book
`
`2010/0073455 Al*
`
`3/2010
`
`Iwabuchi
`
`2013/0033561 Al
`2013/0127977 Al*
`
`2/2013 Kwon et al.
`5/2013
`Iwabuchi
`
`2015/0334352 Al*
`
`11/2015 Iwabuchi
`
`2016/0330409 Al*
`2017/0289502 Al*
`
`11/2016 Iwabuchi
`10/2017 Iwabuchi
`
`H04N7/147
`348/14.04
`H04N7/147
`348/14.03
`
`H04N7/142
`348/14.04
`
`H04N7/142
`H04N7/142
`H04N7/17318
`............... A63F 13/10
`386/291
`
`H04N 5/76
`725/106
`
`H04N 5/76
`725/136
`H04W 52/0261
`455/550.1
`
`H04N7/147
`348/14.11
`H04N7/17318
`725/62
`
`H04N7/142
`709/231
`
`H04N7/163
`725/105
`
`G08B 13/1968
`348/143
`
`H04N7/147
`348/14.03
`H04M 1/72522
`348/14.02
`H04N7/148
`348/14.01
`H04N7/142
`348/14.04
`
`H04N7/142
`348/14.01
`H04N7/142
`348/14.04
`H04N7/142
`H04N7/17318
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`
`05-236472 A
`07-184174
`08-289280
`08289280 A
`09-083983
`2000184346 A
`2001086475 A
`2003-348510
`2006-20286
`2006-157610
`2007-300594 A
`2008-079215
`
`9/1993
`7 /1995
`11/1996
`* 11/1996
`3/1997
`6/2000
`3/2001
`12/2003
`6/2004
`6/2006
`11/2007
`4/2008
`
`H04M 1/6505
`348/14.06
`
`Japanese Office Action dated Aug. 5, 2014 in corresponding Japa(cid:173)
`nese Application No. 2013-230194.
`
`OTHER PUBLICATIONS
`
`IPR2020-00200
`Apple Inc. EX1001 Page 2
`
`

`

`US 10,084,991 B2
`Page 3
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Domestic technical journal 2007-00349-006-Skype
`video call.
`
`realizes handy
`
`* cited by examiner
`
`IPR2020-00200
`Apple Inc. EX1001 Page 3
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 1 of 10
`
`US 10,084,991 B2
`
`FIG.1
`
`1
`
`5
`
`4
`
`3
`
`3~7
`
`IPR2020-00200
`Apple Inc. EX1001 Page 4
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 2 of 10
`
`US 10,084,991 B2
`
`FIG.2
`
`1
`
`(
`
`2
`
`~
`
`a-
`
`I---
`
`DISPLAY SCREEN
`
`9 t
`
`10
`)
`
`-
`
`BROADCAST
`TUNER
`
`J
`
`'
`
`12
`)
`
`PROCESSOR
`
`-
`-
`
`11
`)
`
`DECODER
`,.,_...
`
`-
`
`HTML
`BROWSER
`l
`13
`
`RC SIGNAL ----16
`RECEIVER
`
`HOD
`
`l{
`4-H CAMERA
`s-H MIC
`
`17
`
`18
`l
`
`ENCODER
`
`3
`)
`
`SPEAKER
`
`14
`)
`
`- INBOUND
`
`CALL
`DETECTOR
`
`6
`)
`
`....__ NETWORK
`...-
`1/F
`7
`15
`
`IPR2020-00200
`Apple Inc. EX1001 Page 5
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 3 of 10
`
`US 10,084,991 B2
`
`FIG.3
`
`20
`
`TELEPHONE
`SERVER
`
`VOD
`SERVER
`
`21
`
`6
`
`1
`
`VIDEOPHONE
`FUNCTION-ADDED
`TV RECEIVER
`
`VIDEOPHONE
`FUNCTION-ADDED
`TV RECEIVER
`
`1'
`
`FIG.4
`
`7
`
`7c
`
`7d
`
`7b ~ ct=JG
`~ (~CH) (~usr) ( TIRr)
`7f (D 7g
`7e
`7h
`ENTER ) 8
`,-Ji
`7j (I) ( CANCa )
`
`7a _,__--I
`
`POWER
`
`TV
`
`(.-~
`
`~)~~~
`
`((
`
`PAUSE
`
`))
`
`7k
`
`71
`
`7ma
`
`7ms
`
`IPR2020-00200
`Apple Inc. EX1001 Page 6
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 4 of 10
`
`US 10,084,991 B2
`
`FIG.5
`
`ITEM#
`
`VOD PROCESSING
`
`PHONE PROCESSING
`
`REMARKS
`
`1
`
`2
`
`3
`
`4
`
`5
`
`6
`
`FW BUTTON DEPRESSED
`
`FW BUTTON DEPRESSED
`
`• VOD BUTTON DEPRESSED
`• BROWSER START
`
`• PHONE BUTTON PRESSED SERVER SENDS
`•BROWSER START
`OPERATION SCREEN
`
`TITLE SELECTED & DECIDED CAU.DESTINATION
`SELECTED & DECIDED
`
`CHECK CHARGE&
`PLAYBACK RIGHT
`
`• DISPLAY CAI.LING MESSAGE
`• ACTIVATE CAMERA, MIC &
`ENCODER
`• SWITCH DECODER INPUT
`•SWITCH DECODER INPUT
`• DECODER OPERATION ST ART •DECODER OPERATION START
`•PLAYBACK
`• T AL.KING BY PHONE
`• STOP BUTTON DEPRESSED SAMEBUTTON
`•STOP BUTTON DEPRESSED • DECODER STOP
`OPERATION AS
`•BROWSER STOP
`• DECODER STOP
`DECODER
`•CAMERA, MIC &
`• BROWSER STOP
`IS DEACTIVATED
`ENCODER DEACTIVATED
`
`7
`
`PLAYBACK END
`
`CAU.END
`
`FIG.6
`
`FWOFF
`
`DURING TV WATCHING DURINGVOD
`WATCHING
`
`OTHERS
`
`•AUTO-PWON • AUTO-VIDEOREC START • AUTO-PAUSE • PRESENT ST ATE SAVE
`CAU.
`•CAU. HANDLING
`ARRIVED •GAU.HANDLING • CALL HANDLING
`•CALL HANDLING •RECOVERTOSAVED
`•TVWATCHING • AUTO-PLAY ST ART
`•PAUSE RESET STATE
`
`IPR2020-00200
`Apple Inc. EX1001 Page 7
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 5 of 10
`
`US 10,084,991 B2
`
`FIG.7A
`I I
`SELF-stDE VIDEOPHONE
`FUNCTION-ADDED TV RECEIVER 1
`
`OTHER-stDE VIDEOPHONE
`FUNCTION-ADDED TV RECEIVER 1'
`
`700
`
`DETECT DEPRESSION
`OF PHONE BUTTON 7d
`
`701
`
`GETBROWSER
`13STARTED
`
`INSTRUCT TO
`ACTIVATE
`DECODER11'
`
`703
`
`704
`
`ENCODER18
`GETS STARTED
`
`DECODER11
`GETS STARTED
`
`7CY2.
`-------+-1
`
`INSTRUCT TO
`ACTIVATE
`ENCODER18'
`
`705
`
`---------+-1
`
`706
`
`T AU<lNG BY PHONE
`
`800
`
`801
`ACTIVATIONOF -----1
`
`NOTIFY
`DECODER11'
`
`ACTIVATE
`DECODER 11'
`
`802
`
`803
`
`ACTIVATE
`ENCODER18'
`NOTIFY
`ACTIVATIONOF ------1
`ENCODER18'
`
`DETECT DEPRESSION
`OF STOP BUTTON 7n
`
`FIG.78
`I
`SELF-SIDE VIDEOPHONE
`FUNCTION-ADDED TV RECEIVER 1
`I
`I
`714
`INSTRUCT !
`DEACTIVATION t-+--------(cid:173)
`OFDECODER11'
`
`OTHER-stDE VIDEOPHONE
`FUNCTION-ADDED TV RECEIVER 1'
`
`810
`
`DEACTIVATE
`DECODER11'
`
`INSTRUCT
`DEACTIVATION 1-+----------.
`OF ENCODER 18'
`
`710
`
`711
`
`712
`
`713
`
`716
`
`CAil.END
`
`715
`
`811
`
`DEACTIVATE
`ENCODER 18'
`
`IPR2020-00200
`Apple Inc. EX1001 Page 8
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 6 of 10
`
`US 10,084,991 B2
`
`FIG.a
`
`3
`
`1a
`
`3
`
`<:77
`
`30
`
`31
`
`IPR2020-00200
`Apple Inc. EX1001 Page 9
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 7 of 10
`
`US 10,084,991 B2
`
`FIG.9
`
`1a
`
`{
`
`DISPLAY SCREEN
`
`j~
`
`11
`)
`
`DECODER
`
`'
`
`3
`)
`
`SPEAKER
`
`2
`
`a-
`
`:--
`
`9 t
`
`10
`)
`
`BROADCAST
`TUNER
`'
`
`12
`>
`
`PROCESSOR
`
`RC SIGNAL
`RECEIVER
`
`l{ HDD
`
`3~
`
`32
`
`33
`
`CAMERA
`
`MIC
`
`-
`
`-
`-
`
`1-4-
`
`-
`1\..15
`
`17
`
`HTML
`BROWSER
`l
`13
`
`37
`)
`
`CAMERA
`LINK 1/F
`
`i----
`
`31-
`
`34
`l
`
`- INBOUND
`
`CALL
`DETECTOR
`l
`14
`NETWORK
`1/F
`l
`15
`
`- ..__
`
`6
`)
`
`36
`35
`l
`l
`i DECODER I-.__ ~
`
`-
`
`HDD
`
`~
`
`t--
`~
`
`ENCODER
`
`IPR2020-00200
`Apple Inc. EX1001 Page 10
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 8 of 10
`
`US 10,084,991 B2
`
`1000
`
`POWER ON
`
`FIG.10
`
`1001
`
`CHECK CONNECTION STATE
`OF VIDEO CAMERA 30
`
`1002
`
`• NOT CONNECTED
`• CONNECTED-DISCONNECTED
`
`·CONNECTED
`• DISCONNECTED-CONNECTED
`
`1003
`
`SET ENCODER 34 OF
`VIDEO CAMERA 30 IN
`LIVE OUTPUT MODE
`
`1004
`
`DISABLE VIDEOPHONE
`FUNCTION MODE
`
`1005
`
`ENABLE VIDEOPHONE
`FUNCTION MODE
`
`1100
`
`POWER ON
`
`1101
`
`CHECK CALL STATE
`
`1102
`
`NO
`
`FIG.11
`
`1103
`
`SET ENCODER 34 OF
`VIDEO CAMERA 30 IN
`LIVE OUTPUT MODE
`
`1104
`
`SET VIDEO CAMERA
`ENCODER IN CUMULATIVE
`VIDEO-REC MODE
`
`IPR2020-00200
`Apple Inc. EX1001 Page 11
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 9 of 10
`
`US 10,084,991 B2
`
`2 ~
`
`a- -
`9 t
`
`FIG.12
`
`1
`
`{
`
`DISPLAY SCREEN
`
`10
`>
`BROADCAST
`TUNER
`
`'
`
`11
`)
`DECODER
`
`I
`
`~
`DECODER I-
`1-3a
`HTML -
`
`BROWSER I-I-
`'l_ 13
`
`12
`)
`
`-
`PROCESSOR
`
`3
`)
`
`SPEAKER
`
`-
`
`14
`)
`INBOUND
`CALL
`DETECTOR
`
`t
`RC SIGNAL
`RECEIVER r-----16
`-
`{
`
`J
`
`HOD
`l
`17
`-
`4- ~ CAMERA I
`5- H MIC ~
`
`- ECHO
`CANCELLER - 1/F
`
`39
`)
`
`NETWORK -
`
`6
`)
`
`(
`15
`
`18
`l
`ENCODER
`
`I
`
`IPR2020-00200
`Apple Inc. EX1001 Page 12
`
`

`

`U.S. Patent
`
`Sep.25,2018
`
`Sheet 10 of 10
`
`US 10,084,991 B2
`
`FIG.13
`
`1
`
`5
`
`3R
`
`FIG.14
`
`C
`C
`
`(a) OUTPUT TO RIGHT
`SPEAKER 3R
`
`(b) ~~Jf~Jlf
`
`L LEFT
`
`(c) INPUT OF MIC 5
`
`(d) INPUT OF ENCODER 18
`
`IPR2020-00200
`Apple Inc. EX1001 Page 13
`
`

`

`1
`COMMUNICATION APPARATUS AND
`METHOD FOR RECEIVING AN INBOUND
`VIDEOPHONE CALL NOTICE WHILE
`DISPLAYING DIGITAL INFORMATION ON
`THE DISPLAY
`
`INCORPORATION BY REFERENCE
`
`US 10,084,991 B2
`
`2
`distant party's videophone, and reproducing them at the
`image display device and speaker (for detail, see JP-A-9-
`83983).
`
`SUMMARY OF THE INVENTION
`
`This application is a Continuation of U.S. application Ser.
`No. 15/631,298, filed Jun. 23, 2017, which is a Continuation
`of U.S. application Ser. No. 15/215,839, filed Jul. 21, 2016,
`now U.S. Pat. No. 9,723,268 which is a Continuation of U.S.
`application Ser. No. 14/811,048, filed Jul. 28, 2015, now
`U.S. Pat. No. 9,432,618, which is a Continuation of U.S.
`application Ser. No. 13/723,312, filed Dec. 21, 2012, now
`U.S. Pat. No. 9,124,758, which is a Continuation of U.S.
`application Ser. No. 12/457,257, filed Jun. 4, 2009, now U.S.
`Pat. No. 8,363,087. The present application claims priority
`from U.S. application Ser. No. 12/457,257 filed Jun. 4, 2009,
`now U.S. Pat. No. 8,363,087, which claims priority from 20
`Japanese application JP2008-246232 filed on Sep. 25, 2008,
`the content of which is hereby incorporated by reference into
`this application.
`
`BACKGROUND OF THE INVENTION
`
`Field of the Invention
`
`(TV)
`to a television
`relates
`technology
`The present
`receiver set with TV phone functionality added thereto,
`which is arranged to have a video telephone call enabling
`means to thereby make it possible to perform video/voice(cid:173)
`based telecommunication with another machine. This tech(cid:173)
`nology also relates to a TV phone system using videophone
`function-added TV receivers of this type.
`
`Description of the Related Art
`
`A telephone communication system and TV broadcast
`system are independently established systems. Traditionally,
`a telephone equipment and TV receiver set are quite differ(cid:173)
`ent apparatuses. In cases where a telephone receives an
`incoming call and generates a ring sound or melody ( calling
`sound) signaling the incoming call, a called party fails to
`hear this sound from time to time. A technique for avoiding
`this risk is disclosed, for example, in JP-A-5-56190. With
`this technique, a telephone is communicatively connected by
`a signal transmission line to a TV receiver, wherein the TV
`receiver is arranged so that upon receipt of an incoming call
`at the telephone, the TV receiver displays a phone call
`arrival message on its display screen.
`Alternatively, a video telephone apparatus is also known,
`which is arranged to enable a user to make a phone call with
`a distant party at the other end of a line by transmission and
`reception of video images and voices. This type of video-
`phone typically has a camera, microphone, loudspeaker and
`image display device and is designed to transmit toward the
`distant party's videophone video and voice signals that are
`obtained by the camera and microphone of the videophone
`on the self side, receive video and voice signals from the 60
`distant party's videophone, and display this video by the
`image display device while reproducing the voice by the
`speaker. In a case where transmission is done to the distant
`party's videophone, a video image and voice are subjected
`to compression processing
`( encoding) for transmission 65
`while simultaneously performing expansion processing ( de(cid:173)
`coding) of a video and voice that are received from the
`
`55
`
`In the prior known technique as disclosed in JP-A-5-
`56190, the TV receiver and the videophone are arranged so
`that these are discrete devices which operate independently
`10 of each other. Upon receipt of an incoming telephone call at
`the videophone during watching a TV broadcast program by
`the TV receiver, a message which notifies arrival of such
`phone call is displayed on the TV receiver's display screen
`so that a user easily knows that there is an incoming phone
`15 call. In this event, the user must walk to a place at which this
`videophone is put and perform manual operations for startup
`of talking with a caller on the videophone. This is a
`time-consuming and troublesome work for the user who is
`watching his or her preferred TV broadcast program.
`In the case of not only starting a telephone call but also
`ending the phone call, the user is required to perform a
`manual operation for the phone call completion ( e.g., putting
`a transceiver handset on a base unit or "cradle"). This
`operation also is performed at the location in which the
`25 videophone is placed.
`In this way, traditionally, when there is an incoming phone
`call during watching a TV broadcast program by TV
`receiver, the user must move from a place at which he or she
`was there until then and perform manual operations for
`30 startup and completion of the phone call. These operations
`are time-consuming and troublesome works to the user.
`To provide a solution to the above-stated problem, this
`technology provides a new and improved TV receiver with
`TV function (referred to as videophone function-added TV
`35 receiver hereafter) set having videophone call handling
`functionality, which performs both the reception of a digital
`broadcast program signal and the transmission and reception
`of a videophone signal between itself and another video(cid:173)
`phone function-added TV receiver at the other end of a
`40 communication
`line, wherein
`the videophone
`function(cid:173)
`added TV receiver is characterized by having a decoder
`which decodes a received digital broadcast program signal
`and videophone signal, a display panel to which is supplied
`a video signal that is decoded by the decoder and which
`45 visually displays it on a screen, a loudspeaker module to
`which is supplied an audio/voice signal which is decoded by
`the decoder, a camera, a microphone, and an encoder which
`encodes output signals of the camera and microphone.
`Another feature of the videophone function-added TV
`50 receiver lies in that it further includes an encoder which
`generates a videophone signal to be transmitted for video(cid:173)
`phone communications and a means for detecting comple(cid:173)
`tion of a videophone signal decoding operation of the
`decoder and for stopping an encoding operation of the
`encoder for generation of the videophone signal.
`This technology also provides a video telephone system
`using a plurality of videophone function-added TV receiver
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone
`function-added TV receiver includes a decoder which has a
`videophone-use decode function for decoding a videophone
`signal from another videophone function-added TV receiver
`at the other end of a line and a TV program-use decode
`function for decoding a digital broadcast program received,
`a display panel which displays a video signal that is decoded
`by the decoder, a loudspeaker to which is supplied an audio
`
`IPR2020-00200
`Apple Inc. EX1001 Page 14
`
`

`

`US 10,084,991 B2
`
`15
`
`3
`signal that is decoded by the decoder, a camera, a micro(cid:173)
`phone, an encoder which has a videophone-use encode
`function for encoding a video signal from the camera and an
`audio signal from the microphone to thereby generate a
`videophone signal to be sent forth toward a videophone
`function-added TV receiver of a distant party at the other
`end of a line in a videophone call session, a means for
`stopping a decoding operation of the decoder by means of
`the videophone-use decode function in responding to either
`a stop operation or the end of a videophone signal from the 10
`videophone function-added TV receiver of the distant party
`in the videophone call session, and a means for detecting
`completion of the videophone signal decoding operation
`performed by the decoder and for stopping the encoding
`operation of the encoder, wherein in case one of the video-
`phone function-added TV receivers which are presently
`involved in a videophone communication session experi(cid:173)
`ences termination of the decode operation of the decoder by
`means of the videophone-use decode function thereof in
`response
`to execution of the stop operation, when the 20
`encoding operation of the encoder is stopped in responding
`thereto, the videophone function-added TV receiver of the
`distant party, e.g., a calling party or a called party at the other
`end of the line, is such that the decoder stops its decoding
`operation by means of the videophone-use decode function 25
`thereof to thereby force the encoder to stop its encoding
`operation by means of the videophone-use encode function
`in response to the stop of the decoding operation.
`This technology also provides a video telephone system
`using a plurality of videophone function-added TV receiver 30
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone
`function-added TV receiver includes a decoder which has a
`videophone-use decode function for decoding a videophone
`signal from another videophone function-added TV receiver
`at the other end of a line and a TV program-use decode
`function for decoding a digital broadcast program received,
`a display panel which displays a video signal that is decoded
`by the decoder, a loudspeaker to which is supplied an audio
`signal that is decoded by the decoder, a camera, a micro(cid:173)
`phone, an encoder which has a videophone-use encode
`function for encoding a video signal from the camera and an
`audio signal from the microphone to thereby generate a
`videophone signal to be sent forth toward a videophone
`function-added TV receiver of a distant party at the other
`end of a line in a videophone call session, a means for
`stopping a decoding operation of the decoder by means of
`the videophone-use decode function in responding to either
`a stop operation or the end of a videophone signal from the
`videophone function-added TV receiver of the distant party
`in the videophone call session, a means for detecting
`completion of the videophone signal decoding operation
`performed by the decoder and for stopping the encoding
`operation of the encoder, and a means for detecting comple(cid:173)
`tion of the videophone signal decoding operation of the
`decoder and for sending a stop command signal to the
`videophone function-added TV receiver of the distant party
`at the other end of the line, wherein in case one of the
`videophone function-added TV receivers which are pres(cid:173)
`ently involved
`in a videophone communication session
`experiences
`termination of the decode operation of the
`decoder by means of the videophone-use decode function
`thereof in response to execution of the stop operation, when
`the encoding operation of the encoder is stopped in respond(cid:173)
`ing thereto, and also when the stop command signal is sent
`to the videophone function-added TV receiver of the distant
`
`4
`party, this distant party's videophone function-added TV
`receiver operates so that the decoder stops its decoding
`operation by means of the videophone-use decode function
`thereof in response to receipt of the stop command signal
`5 and, in response to this decode operation stop, the decoder
`stops the decoding operation by means of the videophone(cid:173)
`use decode function thereof.
`This technology also provides a video telephone system
`using a plurality of videophone function-added TV receiver
`sets which are linked together via a network for enabling
`users to make videophone calls between these videophone
`function-added TV receivers, wherein each videophone
`function-added TV receiver includes a decoder which has a
`videophone-use decode function for decoding a videophone
`signal from another videophone function-added TV receiver
`at the other end of a line and a TV program-use decode
`function for decoding a digital broadcast program received,
`a display panel which displays a video signal that is decoded
`by the decoder, a loudspeaker to which is supplied an audio
`signal that is decoded by the decoder, a camera, a micro(cid:173)
`phone, an encoder which has a videophone-use encode
`function for encoding a video signal from the camera and an
`audio signal from the microphone to thereby generate a
`videophone signal to be sent forth toward a videophone
`function-added TV receiver of a distant party at the other
`end of a line in a videophone call session, a means for
`stopping an encoding operation by means of the video(cid:173)
`phone-use encode function of the encoder in response to a
`stop operation of a videophone call, a means for detecting
`completion of an encoding operation of a video signal from
`the camera and an audio signal from the microphone to be
`performed by the encoder and for stopping the decoding
`operation by means of the videophone-use decode function
`of the decoder, and a means for detecting completion of the
`35 encoding operation of the encoder and for sending a stop
`command signal
`to a videophone
`function-added TV
`receiver of a distant party at the other end of a line, wherein
`in case one of the videophone function-added TV receivers
`which are presently involved in a videophone communica-
`40 tion session experiences termination of the encode operation
`of the encoder by means of the videophone-use encode
`function thereof in response to execution of a stop operation,
`when the decoding operation of the decoder is stopped in
`responding thereto, and also when the stop command signal
`45 is sent to the videophone function-added TV receiver of the
`distant party, this distant party's videophone function-added
`TV receiver is such that the encoder stops its encoding
`operation by means of the videophone-use encode function
`thereof in response to receipt of the stop command signal
`50 and, in response to the stop of this encode operation, the
`decoder stops the decoding operation by means of the
`videophone-use decode function thereof.
`This technology also provides a videophone function(cid:173)
`added television receiver having a video camera detachably
`55 connected to an apparatus main body, wherein the TV
`receiver includes in the apparatus main body a decoder
`which has a television program-use decode function for
`decoding a digital broadcast program signal received and a
`videophone-use decode function for decoding a video tele-
`60 phone signal as received in a videophone call session, and a
`processor for control of each component, wherein
`the video camera has a camera, a microphone, a storage
`device which stores therein a video signal from the camera
`and an audio signal from the microphone, and an encoder to
`65 which are supplied a video signal as output from the camera
`and an audio signal as output from the microphone and
`which encoder has a videophone-use encode function of
`
`IPR2020-00200
`Apple Inc. EX1001 Page 15
`
`

`

`US 10,084,991 B2
`
`5
`
`6
`signal as output from the microphone and an input audio
`signal of the speaker, and wherein an echo signal due to
`unwanted mixture of audio sounds from the speaker into the
`audio signal as output from the microphone is canceled by
`the echo canceller using the input audio signal of the speaker
`and is then supplied to an encoder.
`The technology further provides a videophone system
`using videophone function-added TV receivers of the type
`stated supra, wherein a decoder includes a first decoder
`10 operative to decode the received digital broadcast program
`signal and a second decoder for decoding the video tele(cid:173)
`phone signal, wherein a display panel performs two-window
`display for simultaneously displaying on one screen a video
`15 image based on the digital broadcast program signal
`decoded by the first decoder and a video image based on the
`video telephone signal decoded by the second decoder,
`wherein an echo canceller is provided to receive an audio
`signal as output from the microphone and an input audio
`20 signal of the speaker, and wherein an echo signal due to
`mixture of audio sounds from the speaker into the audio
`signal as output from the microphone is canceled by the echo
`canceller using the input audio signal of the speaker and is
`then supplied to an encoder.
`With the above-stated arrangement, it is possible to pro(cid:173)
`vide a TV receiver with increased usability for users. For
`example, video image displaying for a videophone call is
`performed using the display screen and loudspeaker module
`which are inherently used for digital TV broadcast pro-
`30 grams; so, it is possible for a user to start a phone call and
`finish the call without having to move from a place at which
`s/he is enjoying a digital TV broadcast program. This saves
`the user's labor for such moving action. Additionally, upon
`completion of the phone call, the decoder and encoder are
`35 automatically rendered inoperative without requiring the
`user to perform manual operations. This results in a decrease
`in labor for such operations. It is also possible to prevent a
`calling party from becoming aware of the digital TV broad-
`cast program which is watched by the user.
`Other objects, features and advantages of the invention
`will become apparent from the following description of the
`embodiments of the invention taken in conjunction with the
`accompanying drawings.
`
`5
`encoding the video signal and the audio signal into a video
`telephone signal to be transmitted to a videophone function(cid:173)
`added television receiver of a distant party in a videophone
`call session and a video recording-use encode function for
`encoding the video signal and the audio signal into a video
`signal to be recorded in the storage device, and wherein in
`a state that the video camera is connected to the apparatus
`main body, when the decoder is in a state that it operates to
`perform the videophone-use decode function, the processor
`sets the encoder in a state that it operates to perform the
`videophone-use encode function thereof, resulting in the
`decoder being switched from the operation state of the
`videophone-use decode function to an operation state of the
`television program-use decode function and, alternatively,
`when the video camera is in a state that it is disconnected
`from the apparatus main body, the processor sets the encoder
`in a state that it operates to perform the video recording-use
`encode function.
`In the videophone function-added television receiver, the
`video camera is a separate equipment independent of the
`apparatus main body and is detachably coupled to the
`apparatus main body.
`televi(cid:173)
`Alternatively, in the videophone function-added
`sion receiver, the video camera is internally mounted in the
`apparatus main body.
`This technology also provides a videophone system using
`a plurality of videophone function-added TV receivers of the
`type stated above, which are linked together via a network
`for enabling users to make a videophone call between any
`two of the videophone
`function-added TV receivers,
`wherein the system includes a means for stopping an encod(cid:173)
`ing operation by means of a videophone-use encode function
`of an encoder in response to a stop operation of a video(cid:173)
`phone call, a means for detecting completion of an encoding
`operation of a video signal from a camera and an audio
`signal from a microphone to be performed by the encoder
`and for stopping a decoding operation by means of a
`videophone-use decode function of a decoder, and a means
`for detecting completion of the encoding operation of the
`encoder and for sending a stop command signal to a video-
`phone function-added TV receiver of a distant party at the
`other end of a line, wherein in case one of the videophone
`function-added TV receivers which are presently involved in
`a videophone co