FILE HISTORY
`US 6,407,779
`
`PATENT:
`INVENTORS:
`
`6,407,779
`Herz, William S.
`
`TITLE:
`
`Method and apparatus for an intuitive
`universal remote control system
`
`APPLICATION
`NO:
`FILED:
`ISSUED:
`
`US1999277887A
`
`29 MAR 1999
`18 JUN 2002
`
`COMPILED:
`
`05 FEB 2014
`
`Universal Remote Control Exhibit: 1002 Page 000001
`
`

`

`0
`
`co
`
`i
`
`a t-
`
`NJ -N.
`
`i-,
`C-)
`
`= C
`
`_V _e
`
`n
`
`U4 - U
`
`(U~
`
`PATENT NUMBER
`
`640 77 79
`
`6407779
`
`US UTILITY PATENT APPLICATION
`
`) WITH Q DISK (CRC) O FICHE
`(Attached in pocket on right inside fllp)
`
`BEST COPY
`
`PREPARED AND APPROVED FOR ISSUE
`
`ORIGINAL
`
`ISSUING CLASSIFICATION
`CROSS REFERENCE(S)
`
`CLASS
`SUBCLASS
`I 739-
`31-
`INTERNATIONAL CLASSIFICATION
`
`1S
`a 4
`
`.
`¢o
`17 /o -
`
`CLASS
`_ 30-_
`3
`i
`1 3S'
`
`SUBCLASS (ONE SUBCLASS PER BLOCK)
`
`_od
`
`-7j
`
`82__
`
`
`1- 7 /
`pasS
`
`_
`
`0 TERMINAL
`
`Sheets Drwg
`
`DRAWINGS
`Figs Drwg
`
`Print Fig
`
`CLAIMS ALLOWED
`Total Claims
`Pnnt Claim for O G
`
`O Continued on Issue Slip Inside File Jacket
`
`O a) The term of this patent
`subsequent to __(date)
`has been disclaimed
`
`O b) The term of this patent shall
`not extend beyond the expiration date
`of U S Patent No
`
`/
`
`Examin r)
`(Assistant
`
`_
`
`Ib
`
`-'?
`
`1
`(Date)
`
`NOTICE OF ALLOWANCE MAILED
`
`I2 -4
`
`),I
`
`ISSUE FEE
`
`__nAmount
`
`Due
`
`Date Paid
`
`(Primary Examiner)
`
`Da)
`
`O c) The terminal
`months of
`this patent have been disclaimed
`
`(Legal Instruments Examiner)
`
`(Date)
`
`ISSUE BATCH NUMBER
`
`WARNING
`The information disclosed herein may be restncted Unauthorized disclosure may be prohibited by the United States Code Title 35 Sections 122 181 and 368
`Possession outside the U S Patent & Trademark Office is restncted to authorized employees and contractors only
`Form PTO 436A
`(Rev 6/98)
`
`.
`
`(LAB L AF)
`Fomal Drawngs
`
`set-
`Se
`
`Universal Remote Control Exhibit: 1002 Page 000002
`
`

`

`6,407,779
`
`METHOD AND APPARATUS FOR AN INTUITIVE UNIVERSAL
`REMOTE CONTROL SYSTEM
`
`Transaction History
`
`Date
`Transaction Description
`04-02-1999
`Initial Exam Team nn
`04-15-1999
`IFW Scan & PACR Auto Security Review
`04-19-1999 Notice Mailed--Application Incomplete--Filing Date Assigned
`05-17-1999
`Information Disclosure Statement (IDS) Filed
`05-17-1999
`Information Disclosure Statement (IDS) Filed
`05-20-1999 Application Is Now Complete
`05-21-1999 Application Dispatched from OIPE
`08-17-1999 Case Docketed to Examiner in GAU
`04-24-2000 Non-Final Rejection
`04-27-2000 Mail Non-Final Rejection
`05-02-2000 Workflow - Drawings Finished
`05-02-2000 Workflow - Drawings Matched with File at Contractor
`05-02-2000
`Incoming Letter Pertaining to the Drawings
`08-14-2000 Response after Non-Final Action
`08-14-2000
`Information Disclosure Statement (IDS) Filed
`08-14-2000
`Information Disclosure Statement (IDS) Filed
`08-14-2000 Request for Extension of Time - Granted
`08-25-2000 Date Forwarded to Examiner
`10-06-2000 Case Docketed to Examiner in GAU
`11-06-2000 Non-Final Rejection
`11-08-2000 Mail Non-Final Rejection
`02-12-2001 Response after Non-Final Action
`02-15-2001 Date Forwarded to Examiner
`04-23-2001 Non-Final Rejection
`04-25-2001 Correspondence Address Change
`04-25-2001 Mail Non-Final Rejection
`07-19-2001 Response after Non-Final Action
`07-19-2001
`Information Disclosure Statement (IDS) Filed
`07-19-2001
`Information Disclosure Statement (IDS) Filed
`08-21-2001 Date Forwarded to Examiner
`10-30-2001
`Final Rejection
`10-31-2001 Mail Final Rejection (PTOL- 326)
`12-27-2001 Response after Final Action
`01-02-2002 Correspondence Address Change
`01-09-2002 Date Forwarded to Examiner
`01-14-2002 Mail Notice of Allowance
`01-14-2002 Notice of Allowance Data Verification Completed
`01-15-2002 Dispatch to Publications
`01-16-2002 Dispatch to Publications
`01-16-2002 Dispatch to Publications
`01-18-2002 Workflow - File Sent to Contractor
`01-18-2002 Receipt into Pubs
`02-08-2002 Receipt into Pubs
`04-09-2002
`Issue Fee Payment Verified
`04-09-2002 Workflow -Received 85b - Unmatched
`04-09-2002
`Issue Fee Payment Received
`04-22-2002 Application Is Considered Ready for Issue
`04-23-2002 Receipt into Pubs
`04-30-2002 Receipt into Pubs
`05-14-2002 Receipt into Pubs
`05-17-2002 Receipt into Pubs
`05-31-2002
`Issue Notification Mailed
`
`Universal Remote Control Exhibit: 1002 Page 000003
`
`

`

`06-18-2002 Recordation of Patent Grant Mailed
`06-18-2002
`Patent Issue Date Used in PTA Calculation
`07-28-2009 Change in Power of Attorney (May Include Associate POA)
`07-28-2009 Correspondence Address Change
`
`Universal Remote Control Exhibit: 1002 Page 000004
`
`

`

`PATENT APPLICATION
`
`09277887
`
`PTO
`
`JC542 U S
`09/277887
`111IID
`lII III IIIII
`IIII I lD Ill
`
`03/29/99
`
`INITIALS _____
`
`Date received
`(Incl C of M)
`or
`Date Mailed
`
`1 Application +-4- 9
`
`papers
`
`/
`
`3
`
`-
`
`O
`
`CONTENTS
`Date received
`(Incl C~ of M )
`Date Mailed
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`42
`
`43
`
`44
`45__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`46 _______________
`
`47
`
`48
`
`49
`
`50
`
`51
`
`_______________
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`I
`
`__
`
`_
`
`__
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`511 7'2'~'
`I d
`
`_
`
`_ _ _ _
`
`5-4-:)
`-L~tea
`
`11
`
`13
`14
`
`4
`
`]S
`
`'7196'
`
`54
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`55__
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`17
`
`20
`
`21
`
`22
`
`23
`
`24
`
`25
`
`26
`
`27
`
`iQA4z
`AZ ___
`9
`
`(/e
`
`___
`
`____________
`
`____________
`
`56
`57
`58__
`
`59
`
`__
`
`~~60 __
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`61
`
`62
`
`__
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`________
`
`_______
`
`63,~_______________
`
`______ _____
`
`____________
`
`64
`
`65
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`________
`
`_______
`
`____________
`
`66 _________
`
`___
`
`_
`
`_
`
`_
`
`_
`
`______ _____
`
`67
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`28
`
`29
`
`30
`
`31
`
`32
`
`33
`
`______ _____
`
`___________
`
`_____ _____
`
`_____ _____
`
`__________
`
`______ _____
`
`68
`
`69
`
`70
`
`71
`
`72
`
`73
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`________________
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`-- ______
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`34
`
`35
`
`36
`
`37
`
`38
`
`39
`
`40
`
`41
`
`________
`
`____________
`
`___________
`
`______ _____
`
`______ _____
`
`______ _____
`
`____________
`
`74
`
`75
`
`76
`
`77
`
`78
`
`79
`
`80
`
`81
`
`82
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`________________
`
`________________
`
`__
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_ _
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`_
`
`________________
`
`Universal Remote Control Exhibit: 1002 Page 000005
`
`

`

`ISSUE SLIP SIAPLE AREA (fo
`
`'n I Ht~r; CFf-[16k l
`
`w
`
`I
`
`-4
`
`Non elected
`Interference
`Appeal
`Objected
`
`Claim
`
`Date
`
`101
`
`119
`104
`105
`
`106
`107
`108
`
`|09
`110
`111
`112
`11
`114
`115
`116
`117
`118
`119
`20
`121
`22
`12
`124
`125
`26
`127
`128,
`29
`30
`131
`
`3 3
`
`13
`
`3 3
`
`7
`38
`39
`40
`141
`142,
`142
`144
`45
`46
`-47
`48
`14
`so
`
`V
`
`-
`-
`
`(Through numeral)
`
`INDEX OF CLAIMS
`N
`Relected
`Allowed
`I
`Canceled
`A
`Restricted
`0
`
`Claim
`
`o \
`
`Date
`
`o ,
`
`=
`
`51 /
`.52
`53
`54
`55
`56
`57
`58
`59
`60
`61
`
`62
`63
`64
`65
`66
`67
`68
`69
`70
`71
`72
`73
`74
`75
`76
`77
`78
`79
`80
`81
`82
`83
`84
`85
`86
`
`87
`88
`89
`90
`
`91
`
`92
`93
`
`94
`95
`96
`97
`98
`99
`
`Claim
`
`Date
`
`f
`
`-"'.'
`
`N
`
`''l
`
`i
`
`V
`
`VV-
`
`6
`
`8
`
`1 1 1 1
`
`-~~ 4
`
`lilt
`
`21
`
`r-
`
`33 -
`36
`37
`0 36
`
`(3 39
`f 4 140
`
`'I,
`
`L43
`
`(10r
`
`_
`
`-
`
`Q
`lb45
`0
`746
`0
`1 47
`0
`q 48
`049 0 Ll
`' S
`
`If more than 150 claims or 10 actions
`staple additional sheet here
`
`II e" "
`
`Iklilfll I
`
`Universal Remote Control Exhibit: 1002 Page 000006
`
`

`

`.
`
`I --
`
`Universal Remote Control Exhibit: 1002 Page 000007
`
`

`

`West 1 2 Web Refine Search
`
`http //juplter 88/bin/gate exe?f-tocl&st
`
`rch=Refine+Search &pu_concpiece=p 19 p7 5
`
`snrrC~~rrC WEST4
`
`LHelp-
`
`;
`
`Logout-
`
`'lain v enu
`e"34rc Form
`I Edt
`_C__III__III__________11__1______1__
`
`fu r'i ier
`
`Search Results -
`Terms
`(Documentsl
`13
`14 and program$3 guide
`
`Database US Patents Full-Text Database
`
`14 and programS3 guide
`
`Refine Search
`
`Search History
`
`DB Name
`USPT
`USPT
`USPT
`USPT
`USPT
`
`Ouerv
`14 and program$3 guide
`12 and (voice or speech recognition)
`voice or speech recognition
`348/734 and remote control$3
`remote control$3 near voice recognition
`
`Hit Count Set Name
`13
`L5
`92
`L4
`L3
`44191
`844
`L2
`3
`L1
`
`4/17/00 3 24 PM
`
`Universal Remote Control Exhibit: 1002 Page 000008
`
`

`

`
`
`11111 | H 11 i 111|1 11 11 1111|111 11111| llll| 1111 1111111
`
`
`
`US006407779B1
`US 6,407,779 B1
`Jun. 18, 2002
`
`
`
`
`
`(12) United States Patent
`Herz
`
`(Il) Patent No.:
`(45) Date of Patent:
`
`(54) METHOD AND APPARATUS FOR AN
`INTUITIVE UNIVERSAL REMOTE
`CONTROL SYSTEM
`
`(75)
`
`Inventor: William S. Herz, Hayward, CA (US)
`
`(73) Assignee: Zilog, Inc., San Jose, CA (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/277,887
`
`(51)
`
`Mar. 29, 1999
`(22) Filed:
`Int. Cl. 7 ........................... H04 N 5 /4 4 ; II 0 4 L 17 / 0 2 ;
`G08G 19/00
`(52) U.S. Cl. .................... 348/734; 348/906; 341/176;
`341/175; 340/825.69; 340/825.72
`(58) Field of Search .............................. 348/734, 906;
`345/179, 173, 158, 169; 341/176, 175;
`340/825.69, 825.72, 825.49, 825.25, 825.56,
`825.17, 825.22, 825.24
`
`(56)
`
`References Cited
`
`U.S. PAfENT DOCUMENTS
`
`4,866,522 A
`4,872,195 A
`4,959,810 A
`5,199,080 A
`5,267,323 A
`5,282,028 A
`5,287,224 A
`5,371,901 A
`5,410,326 A
`5,455,560 A
`5,455,570 A
`5,500,691 A
`5,506,717 A
`5,523,794 A
`5,545,857 A
`5,598,14-3 A
`5,619,274 A
`5,646,608 A
`5,699,124 A
`
`9/1989 Beckley
`10/1989 Leonard
`* 9/1990 Darbee et al. .............. 364/900
`3/1993 Kimura et al.
`11/1993 Kimura
`* 1/1994 Johnson ....................... 358/86
`2/1994 Tsuchiya et al.
`12/1994 Reed et al.
`* 4/1995 Goldstein .................. 348/134
`10/1995 Owen
`* 10/1995 Cook ct al ......... 340/825.22
`* 3/1996 Martin et al ................ 348/734
`4/1996 Kho
`6/1996 Mankovitz et alt.
`* 8/1996
`Ie
`et al. .................. 178/18
`1/1997 Wentz
`4/1997 Roop et at.
`* 7/1997 Shintani ................ 340/825.52
`12/1997 Nuber et al.
`
`5,802,467
`5,898,398
`5,898,919
`5,903,259
`5,952,936
`5,956,025
`6,040,829
`6,052,155
`6,097,441
`6,104,334
`6,130,726
`6,211,856
`
`9/1998
`4/1999
`4/1999
`5/1999
`9/1999
`9/1999
`3/2000
`4/2000
`8/2000
`8/2000
`10/2000
`4/2001
`
`Salazar et al.
`Kumai
`..................... 341/176
`Yuen ........................ 455/420
`Brusky et al.
`............ 345/168
`Enomoto
`............... 340/825.69
`Goulden et al. .......... 345/327
`Croy et al.
`................. 345/327
`Cherrick et al. .......... 348/565
`Allport ..................... 348/552
`Allport ..................... 341/175
`Darbhee et al.
`............ 348/734
`Choi et al ............... 345/130
`
`FOREIGN PATENT DOCUMENTS
`
`05037873
`
`2/1993
`
`OTHER PUBLICATIONS
`
`PCT-International Search Report--dated Oct. 23, 2000.
`Written Opinion-International appln. No. PCT/US00/
`04407.
`
`* cited by examiner
`
`Primary Examiner-John W. Miller
`Assistant Examiner-Paulos Natnael
`(74) Anorne
`or Firm-Skjerven Morrill
`Agent,
`MacPherson LLP
`
`(57)
`
`ABSTRACT
`
`The present invention discloses a novel universal remote
`control system. Specifically, the remote control system
`according to the present invention provides the following
`features: bidirectional communications between the remote
`control and at least one of the audio/video devices; dual
`communication mode; automatic communication mode
`selection; loading and processing electronic program guide
`in the remote control; soft graphical user interface in the
`remote control; expanding the television set functions by the
`remote control; calibration handshake between the remote
`control and the audio/video device; updating the remote
`control; lost beacon signal in the remote control; handwrit-
`ing recognition mechanism, and voice recognition mecha-
`nism in the remote control.
`
`23 Claims, 16 Drawing Sheets
`
`Universal Remote Control Exhibit: 1002 Page 000009
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 1 of 16
`
`US 6,407,779 Bi
`
`Universal Remote Control Exhibit: 1002 Page 000010
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 2 of 16
`
`US 6,407,779 Bi
`
`cl
`
`I
`
`Universal Remote Control Exhibit: 1002 Page 000011
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 3 of 16
`
`US 6,407,779 B1
`
`wl
`
`FLASH
`MEMORY
`
`305a
`
`306
`
`MEMORY
`
`BUS
`CNTR.
`
`3f]5 -- r,
`
`BUS
`CNTR.
`
`308
`
`LCD
`
`LCD
`INTERRUPT
`
`RINGER
`
`309
`
`ADDR
`OE CS PGM [15:0] DATA [15:0]
`
`'IAt
`
`Ic
`
`l
`
`Li
`
`DSP
`M ICROPROCESSER
`
`RF
`TRCR
`
`1)
`
`I
`
`304 -
`
`~303
`
`302 115.2 K
`
`IRDA
`ENCODER/
`DECODER
`
`IRDA
`TRCR
`
`C-
`
`r-I- -
`
`- - -
`
`- - - - - - - - - - -
`
`9V
`
`BATTERY
`RECHARGER
`
`VOLTAGE
`I REG.
`
`VOLTAGE
`REG.
`
`t
`
`VOLTAGE
`REG.
`
`VOLTAGE
`REG.
`
`370b
`VOLTAGE REGULATOR
`I-----------------I-------
`
`310d
`30d
`
`--
`
`FIG._3
`
`I
`
`I
`I
`
`Universal Remote Control Exhibit: 1002 Page 000012
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 4 of 16
`
`US 6,407,779 Bl
`
`407
`
`IR-IN PIN OF
`MAIN CON-
`TROLLER
`
`f --------
`
`----
`
`410a
`
`VOLTAGE
`'REG.
`
`VOLTAGE
`REG.
`
`410c
`
`VOLTAGE
`REG.
`I
`
`410b
`
`VOLTAGE
`REG.
`
`VOLTAGE REGULATOR
`------------------------
`
`410d
`
`FIG._4
`
`Universal Remote Control Exhibit: 1002 Page 000013
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 5 of 16
`
`US 6,407,779 Bi
`
`S500
`
`- 516
`
`514a
`
`514c
`
`FIG..5
`
`-518
`
`S500
`
`514a
`
`514c
`
`FIG. -BA
`
`Universal Remote Control Exhibit: 1002 Page 000014
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 6 of 16
`
`US 6,407,779 Bi
`
`FIG. 6B
`
`609
`
`FIG.-6A
`
`Universal Remote Control Exhibit: 1002 Page 000015
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 7 of 16
`
`US 6,407,779 Bi
`
`WlF-
`LZ
`.-D
`
`Qci
`
`4-
`
`C
`
`D-W
`I >
`a W
`
`c
`
`rc
`
`L
`
`Ici
`
`Universal Remote Control Exhibit: 1002 Page 000016
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 8 of 16
`
`US 6,407,779 Bi
`
`-518
`<500
`
`- 514a
`
`-514c
`
`FIG. 8B
`
`500
`
`FIG._9A
`
`Universal Remote Control Exhibit: 1002 Page 000017
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 9 of 16
`
`US 6,407,779 Bi
`
`-518
`
`0
`
`500
`
`S514a
`
`514c
`
`FIG. _ 9B
`
`500
`
`FIG.. 11A
`
`Universal Remote Control Exhibit: 1002 Page 000018
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 10 of 16
`
`US 6,407,779 Bi
`
`1 0
`
`3
`
`Universal Remote Control Exhibit: 1002 Page 000019
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 11 of 16
`
`US 6,407,779 Bi
`
`C j
`
`Universal Remote Control Exhibit: 1002 Page 000020
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 12 of 16
`
`US 6,407,779 Bi
`
`0
`
`Universal Remote Control Exhibit: 1002 Page 000021
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 13 of 16
`
`US 6,407,779 Bi
`
`Universal Remote Control Exhibit: 1002 Page 000022
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 14 of 16
`
`US 6,407,779 Bi
`
`500
`
`FIG._ 11B
`
`-518
`
`500
`
`- 514a
`
`514c
`
`FIG. 11C
`
`Universal Remote Control Exhibit: 1002 Page 000023
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 15 of 16
`
`US 6,407,779 Bi
`
`-- 518
`
`500
`
`- 514a
`
`-514c
`
`FIG._ 12A
`
`-518
`
`500
`
`- 514a
`
`-514c
`
`FIG._ 12B
`
`Universal Remote Control Exhibit: 1002 Page 000024
`
`

`

`U.S. Patent
`
`Jun. 18, 2002
`
`Sheet 16 of 16
`
`US 6,407,779 Bi
`
`-
`
`co
`
`c-aL
`cfl
`
`r
`
`[r
`
`b c
`
`o C
`
`T
`
`l
`-J
`_J0
`CC
`I-
`
`Z00
`
`U
`
`IX 0
`
`0 0
`
`1 -Cc
`u-
`
`rr:
`
`o 0
`
`0
`
`t
`
`Universal Remote Control Exhibit: 1002 Page 000025
`
`

`

`US 6,407,779 B1
`
`METHOI) AND APPARATUS FOR AN
`INTUITIVE UNIVERSAL REMOTE
`CONTROL SYSTEM
`
`BACKGROUND OF TIIE INVENTION
`
`The present invention relates to a remote control system
`for remotely controlling various electronic devices such as
`television and audio visual ("AV") systems using a single
`remote control.
`In recent years, various electronic devices such as stereo
`systems, television receivers, cassette tape decks, video tape
`decks, compact disc players, laser vision disc players, and
`the like are equipped with remote control systems.
`In a conventional system, a remote control system having
`a transmitter is usually positioned remotely from a con-
`trolled device. The transmitter, when operated, transmits a
`remote control signal, such as an infrared remote control
`signal, which is received by a receiver in the controlled
`device. The received remote control signal is decoded to
`control the device as intended by the remote control signal.
`In a universal remote control system, one single remote
`control is capable of controlling more than one AV device.
`In one type of the universal remote control, the remote
`control comprises a remote memory storing all the coding
`signals for different brands of the AV devices. Then the user
`programs the remote control by entering a set of preassigned
`codes to call up the appropriate coding of each device. In
`another type of the universal remote control, the user acti-
`vates a learning mode of the remote control and lines up the
`universal remote control with the selected device. Then the
`remote control sequentially tests each control signal until the
`correct one is found. When the correct control signal is
`found, the device will signal the user to stop further testing
`and the corresponding control protocol is then stored.
`
`SUMMARY OF THE INVENTION
`
`It is an object of the present invention to provide a novel
`universal remote control system.
`It is another object of the present invention to provide a
`remote control system having a bidirectional communica-
`tion channel between the remote control and the audio video
`device(s) controlled by the remote control.
`It is another object of the present invention to provide a
`remote control system having a dual communication mode
`for communication between the remote control and the
`audio video device(s) controlled by the remote control.
`Specifically, the remote control system accommodates both
`infrared communication and radio frequency communica-
`tion.
`It is another object of the present invention to provide a
`remote control system that is capable of automatically
`switching between a plurality of communication modes.
`It is another object of the present invention to provide a
`remote control system that is capable of storing and updating
`in a remote control
`TV programming guide information
`memory.
`It is another object of the present invention to provide a
`novel user interface for the remote control in the remote
`control system.
`It is another object of the present invention to provide a
`soft graphical user interface ("GUI") to the remote control of
`the remote control system.
`It is another object of the present invention to provide a
`remote control system that allows expansion of the televi-
`sion functions that it controls.
`
`5
`
`It is another object of the present invention to provide a
`novel calibration handshake method for communications
`between the remote control and at least one audio/video
`device.
`It is another object of the present invention to provide a
`remote control that is capable of automatically updating the
`remote control memory with universal remote protocols
`associated with new home entertainment devices.
`It is another object of the present invention to provide a
`lost beacon feature for the remote control, wherein the user
`can activate a beacon signal when the remote is misplaced.
`It is another object of the present invention to provide a
`handwriting recognition input or voice recognition feature as
`the user interface for the remote control.
`Additional objects, features and advantages of various
`aspects of the present invention will become apparent from
`the following description of its preferred embodiments,
`which description should be taken in conjunction with the
`20, accompanying drawings.
`
`10
`
`BRIEF DESCRIITION OF THE DRAWINGS
`
`25
`
`FIG. 1 shows a preferred embodiment of a conceptual
`diagram of a universal remote control system according to
`the present invention.
`FIG. 2 shows a block diagram of a remote control system
`of a preferred embodiment according to the present inven-
`tion.
`FIG. 3 shows a preferred embodiment of a remote control
`block of the remote control system of FIG. 2.
`FIG. 4 shows a preferred embodiment of a television
`block or the remote control system of FIG. 2.
`FIG. 5 shows a preferred embodiment of a remote control
`35 according to the present invention.
`FIGS. 6a and 6b are flow charts of two preferred methods
`of communication mode selection according to the present
`invention.
`FIG. 7 shows a sequence of square pulses used for mode
`40 selection as shown in the flow chart of FIG. 6b.
`FIGS. 8a,b illustrate how EPG programming data can be
`used in a remote control of a preferred embodiment accord-
`ing to the present invention.
`FIGS. 9a,b illustrate the soft GUI displayed on a remote
`control of a preferred embodiment according to the present
`invention.
`FIGS. 10a,b,c,d illustrate the ability to expand the TV
`functions according to the present invention.
`la,b and c illustrate the calibration handshake
`FIGS.
`ability according to the present invention.
`
`50
`
`DETAILED DESCRIPTION OF TIlE DRAWINGS
`
`FIG. 1 shows a preferred embodiment of a conceptual
`55 diagram of a universal remote control system according to
`the present
`invention. In the preferred embodiment as
`shown, the universal remote control system comprises a
`remote control 110 and a television set 120. In another
`embodiment not shown, the television set can be substituted
`6o with a set top box connected to a television set. In addition,
`as in the universal remote control systems available on the
`market, the remote control of the present invention can also
`be used for controlling other AV devices such as videocas-
`sette recorder ("VCR"), stereo system, and digital versatile
`65 disc ("DVI3") components, etc. By encoding the signals sent
`out by the remote control, the remote control is able to
`establish communication channel between the remote con-
`
`Universal Remote Control Exhibit: 1002 Page 000026
`
`

`

`US 6,407,779 B1
`
`trol and the television set or other AV devices. In the
`preferred embodiment of the present invention, the commu-
`nication channel established between the remote control and
`any of the devices connected is a bi-directional communi-
`cation channel so that data and information can be trans-
`mitted to and from
`the remote control to each of the
`components in the remote control system.
`FIG. 2 shows a block diagram of a remote control system
`of a preferred embodiment according to the present inven-
`tion. As shown in the figure, the system as shown only
`comprises a remote control block 210 and a television set
`block 220. It should be noted also, as stated in the previous
`paragraphs, the present invention can be applied to other
`audio/video devices.
`The television set block 220 of the preferred embodiment
`comprises a video signal receiver 222 for receiving and
`processing radio frequency or baseband video data; a
`memory 224 for storing any information needed for the
`television set and the remote control; an infrared commu-
`nicator 226 for providing a infrared communication with the
`remote control; and a radio frequency communicator 228 for
`providing a radio frequency communication with the remote
`control. In the preferred embodiment as shown, the selection
`between these two communication modes (i.e. infrared and
`radio frequency) is performed and determined by a proxim-
`ity sensor 211 and a microcontroller 212 located in the
`remote control block 210 as shown.
`in FIG. 2, the remote control block 210
`As shown
`comprises an infrared communicator 213 for communicat-
`ing with the television set; a radio frequency communicator
`214 for communicating with the television set; a microcxn-
`troller 212 for controlling the basic functions of the remote
`control; a user interface mechanism 215 for inputting and
`displaying data; a remote control memory 216 for storing
`information (e.g. programming guide information); a prox-
`imity sensor 211 connected to the microcontroller 212 for
`facilitating the microcontroller 212 to select a communica-
`tion mode between the remote control 210 and the television
`set 220; a remote finder beacon mechanism comprising a
`radio frequency demodulator 218 connected to a remote
`finder beacon 217 and a beeper 219 for receiving beacon
`signal from the television set 220 for locating the remote
`control 210; a voice recognition mechanism (not shown) for
`processing voice commands issued by the user; and a power
`supply 231 for providing rechargeable and non-interruptible
`power to the remote control.
`In the preferred embodiment as shown, the microcontrol-
`ler 212 of the remote control controls all major functions,
`such as: (1) handling user commands received by the user
`interface 215, and generates control signals and transmits
`the control signals to the television set 220, or any other AV
`devices by one of the two transceivers; (2) processing
`electronic program guide ("EPG") data received from the
`television set and storing the EPG data in the remote control
`memory 216; (3) parsing, retrieving, and displaying the
`processed EPG data from the memory 216 as requested by
`the user through the use of the user interface 215; (4)
`updating the stored EPG data and communication
`protocol(s) received from the television set 220, or any other
`audio/video devices; (5) selecting the optimal communica-
`tion mode between the infrared communication mode and
`the radio frequency communication mode in response to the
`proximity sensor 211; and (6) analyzing and responding to
`user commands received from the user interface 215 and
`performing the appropriate functions, etc.
`FIG. 3 is a block diagram showing additional details of
`the remote control portion of the remote control system
`
`according to the present invention. The remote control
`portion as shown comprises a radio frequency transceiver
`301, a IRDA transceiver 302 and IRDA encoder/decoder
`303 pair supporting IRDA standard, a DSP microcontroller
`5 304 for controlling different components within the remote
`control block, a pair of bus controllers 305a,305h for
`controlling data transfer within the remote control block, a
`remote control memory 306 for storing the remote control
`system program and a handwriting recognition program, a
`10 nonvolatile flash memory 307 for storing the EPG data or
`universal remote control protocol(s) downloaded from the
`television set or a set-top box, a touch screen LCD device
`308 for data and/or command entry, a ringer 309 for pro-
`ducing a beacon or activating a flashing LED when a remote
`15 control finding signal is received. In addition, the remote
`control also comprises four voltage regulators 310a,310b,
`310c,310d. Two of the voltage regulators are used to supply
`currents to the IRDA encoder/decoder 303 and the IRDA
`receiver 302, and the remaining two voltage regulators are
`the
`20 used to supply currents to all other components on
`remote control. In the preferred embodiment as shown, the
`remote control is powered by a rechargeable battery. It
`should be noted that the IRDA standard is used for the
`infrared communication in this preferred embodiment of the
`25 present invention. The IRDA standard is a cordless data
`connection standard using infrared light. It is a low-cost
`transceiver signaling technology for two way data exchange.
`It provides high-speed digital exchange through the typical
`PC UART/serial port at 9600-115200 bits/s, and in some
`So units compatible high speed extensions up to 1 Mb/s and 4
`Mb/s speeds.
`FIG. 4 is a block diagram showing additional details of
`the television portion of the remote control according to the
`present invention. As shown in the figure, the television
`35 portion comprises a radio frequency transceiver 401, a
`IRDA transceiver 402 and IRDA encoder/decoder 403 pair
`supporting IRDA standard, a microcontroller 404 for con-
`trolling various components within the television portion, a
`remote control memory 405 for storing a remote control
`40 system program, a flash memory 406 for storing the EPG
`data downloaded from the cable company, satellite, pre-
`recorded cassettes, or DVI), etc., a bus controller 407 for
`controlling data transfer within the television portion, and a
`remote finder switch 408 for the user to activate the remote
`45 finding feature. Similarly, as in the remote control portion,
`the television portion also comprises four voltage regulators
`410a,410b,410c,410d for providing currents to different
`components of the television portion.
`FIG. 5 shows a preferred embodiment of a remote control
`so 500 according to the present invention. The remote control
`as shown comprises a display screen 510 for interfacing with
`the user; a plurality of buttons 512a,b,c,d & 514ab,c,d for
`issuing commands and/or entering data into the remote
`control 500; a stylus 516 for writing onto the screen 510 and
`55 a LED light 518 for indicating the communication mode
`currently running between the remote control and the device
`connected. As shown in the figure, the plurality of buttons
`comprises a group of four buttons 514a,b,c,d for moving any
`pointing device used in the display screen 510. In addition,
`the display screen 510 of the preferred embodiment is
`connected to a handwriting recognition mechanism (not
`shown) so that the user can issue commands and/or enter
`data to the remote control 500 by writing onto the screen
`510. It should be noted that, even with the disclosure of this
`6s embodiment, many aspects of the present invention can still
`be implemented in a universal remote control that does not
`provide the display 510 as used by this embodiment. In other
`
`60
`
`Universal Remote Control Exhibit: 1002 Page 000027
`
`

`

`US 6,407,779 B1
`
`words, other kinds of user interface such as keyboard and
`push buttons can also be employed in the present invention.
`In addition, the remote control according to the present
`invention is backward compatible with the current remote
`control system such that all the current remote control
`functionality can be emulated by the present invention.
`In another preferred embodiment according to the present
`invention, the touch screen display is also provided with
`pressure sensing ability for sensing different handwriting
`stroke pressures exerted on the screen. For example, instead
`of clicking a new command button on the emulated screen,
`a hard pressed period can be programmed in the remote
`control for the beginning of a new command.
`In another preferred embodiment, instead of using a
`display screen in the remote control to interface with the
`user, a touch pad can be used along with an on-screen
`display ("OSD") of the television to perform similar func-
`tions. Specifically, the user can enter the commands/data on
`the touch pad of the remote control and the corresponding
`graphical user interface can be shown on the OSD of the
`television. In other words, the command/data
`inputting
`functions of the display screen of the remote control is
`replaced by the touch pad whereas the graphical user inter-
`face functions of the display screen is replaced by the OSD
`of the television. By replacing the display screen with the
`touch pad, the cost of the remote control can be tremen-
`dously reduced. In the following discussions, it should be
`noted that each and every feature using the display screen of
`the remote control can be replaced by using a touch pad
`along with the OSD of the television.
`Tlhe followings discuss different aspects of the remote
`control of the present invention.
`1. Bidirectional Communications
`The first aspect of the present invention relates to the
`means of communication between the remote control and
`the television set/set top box (and any other audio/video
`devices). As discussed above, the communication between
`the remote control and the television is preferably performed
`bidirectionally so that commands and data can be transferred
`freely between the remote control and the television set.
`Thus, in addition to commands and data being sent from the
`remote control to the television set, commands and data can
`be sent back from the television set to the remote control. In
`the preferred embodiment, the communication is performed
`by transceivers located in the remote control and the tele-
`vision set. Particularly, each transceiver comprises both a
`transmitter and a receiver for sending and receiving data.
`This bi-directional communication feature of the present
`invention provides extreme flexibility in the remote control
`design because the remote control not only can control the
`television set, the television set can also provide data and
`control signals back to the remote control in response to
`changes in status and/or protocols.
`In one example of the present invention, the television set
`can forward the EPG programming data received from
`satellite delivery or terrestrial broadcast to the remote con-
`trol. The television set first receives the EPG data, and then
`forwards the data to the remote control via the bidirectional
`communication feature as discussed. By having the EPG
`programming data stored in the remote control memory, the
`remote control is able to parse and retrieve the EPG pro-
`gramming data when a user command is entered. Then the
`remote control can interpret the TV programming data and
`process the command entered, and