United States Patent [19J
`Launey et al.
`
`[75]
`
`[54] EXPANDABLE HOME AUTOMATIO:\"
`SYSTEM
`Inventors: Reuel 0. Launey, Arlington, Va.;
`Peter A. Grendler, Silver Spring,
`Md.; Donald L. Packham, Fort
`Lauderdale, Fla.; James M.
`Battaglia, Kettering; Howard E.
`Levine, Adelphi, both of Md.
`[73] Assignee: Custom Command Systems, College
`Park, Md.
`[21 J A pp!. No.: 304,300
`Jan. 31, 1989
`[22} Filed:
`Int. Cl.s .............................................. G05B 15/02
`[5 I]
`[52) U.S. Cl ..................................... 364/188; 364/189;
`340/825.37; 379/102
`[58) Field of Search ............... 364/200, 900, I 88, 189,
`364/513.5; 379/102, 104, 79; 340/825.37,
`825.69; 219/10.55 B, 506; 319/46, 47, 97, 98
`References Cited
`U.S. PA TENT DOCUMENTS
`4,503,288 3/1985 Kessler ............................. 179/2 DP
`4,513,189 4/1989 Ueda et al. ................... 219/10.55 B
`4,520,576 6/1985 Vander Molen ....................... 34/45
`4,521,645 6/1985 Carroll .................................. 379/98
`4,663,775 5/1987 Olek ...................................... 379/24
`
`[56]
`
`l~lillil!lllillillllililiillllllilllllli!llilil:1111111111111tllliilll,
`US005086385A
`[11] Patent Number:
`[45] Date of Patent:
`
`5,086,385
`Feb. 4, 1992
`
`4,665,544 5/1987 Honda et al. ....................... 379/104
`4,728,949 3/1988 Platte et al. .................... 340/825.37
`
`Primary Examiner-Jerry Smith
`Assistant Examiner-Paul Gordon
`Attorney, Agent, or Firm-Dickstein, Shapiro & Morin
`ABSTRACT
`[57]
`A system for and a method of providing an expandable
`home automation controller is disclosed which supports
`multiple numbers and multiple different types of data
`communications with both appliances and subsystems
`within the home as well as systems external to the
`home. The system is based upon a central processor,
`such as a microprocessor-based computer, and is con(cid:173)
`nected by means of a data bus to control the various
`products and subsystems within a home or commercial
`building, such as lighting systems, security systems,
`various sensors, multiple external terminals, as well as
`to allow for the input of commands by a variety of
`means such as touchscreens, voice recognition systems,
`telephones, custom switches or any device capable of
`providing an input to a computer system. The system
`functions can be readily controlled by the user utilizing
`a high resolution graphics display and associated touch(cid:173)
`screen interface.
`
`20 Claims, 45 Drawing Sheets
`
`13
`SERIAL
`WAl.l
`SWITCHES
`
`20
`
`40
`HOME AUTOMATION
`BLISSES SUCH AS
`CEBUS OR
`SMART HOUSE
`34
`
`48o
`
`48b
`
`MULTIPLE
`SERIAL
`INTERFACE
`
`12
`
`PROCESS
`CONTROLLER
`26
`
`29
`
`DIGITAL SrNSORS
`
`OTHER DEVICES
`~D Af'PLIANCES
`
`PLUMBING
`RE!.ATED
`SYSTEMS
`
`HOME
`LIGHTING
`SYSTEM
`CONTROLLER
`
`NETWORK
`FILE
`SERVER
`
`51
`
`GRAf'HICS
`INTERFACE
`
`VIDEO
`DISPLAY
`MONITOR
`
`Petitioner Google Ex-1009, 0001
`
`

`

`13,
`SERIAL
`WALL
`SWITCHES
`
`FIG. 1
`. 40 °)
`HOME AUTOMATION
`SUSSES SUCH AS
`CEBUS OR
`SMART HOUSE
`34""" I
`PROTOCOL
`CONVERTER
`
`-
`s
`r E
`48a N
`.__ s
`r
`0
`48b R
`
`s --44,
`
`REMOTE
`DATA BASE
`
`46,
`ANALOG
`INPUT
`INTERFACE
`
`18,
`KEYBOARD
`
`12,
`-
`- \....
`12
`
`42 ""'\
`MODEM
`
`1--
`
`MULTIPLE
`SERIAL
`INTERFACE
`
`12~
`
`r10
`
`CENTRAL
`PROCESSOR
`12 7
`12---
`ETHERNET
`NETWORK
`INTERFACE
`
`"-so
`
`TOUCH
`r
`16b SCREEN 2
`12
`J_ PARALLEL ..- 24a
`INTERFACE
`
`-
`
`(-
`12
`l./
`-
`
`58
`
`~
`
`PARALLEL
`INTERFACE
`
`-
`
`SPEECH
`PROCESSOR
`
`-
`
`24b
`
`NETWORK
`FllE
`SERVER
`
`r
`51
`
`52A I s20 I I s2c I
`
`'MULTIPLE EXfERNAL..)
`ITDUltJAI C:.:
`
`GRAPHICS
`VIDEO
`INTERFACE ~ DISPLAY
`r MONITOR
`56
`
`54_}
`
`2t RECEIVER FOR
`
`HAND-HELD
`REMOTE
`
`/
`
`HAND-HELD
`REMOTE
`
`22
`
`'J - 000
`000
`000
`280.,/
`
`(38
`
`HOME SECURllY
`SYSTEM
`
`r 36
`-
`
`RS-232 TO
`SECURITY SYSTEM
`TRANSLATOR
`,.. 14 16{ TOUCH
`SCREEN 1
`
`27
`
`000
`-000
`000
`28b
`ANALOG SENSORS
`
`,29
`
`DIGITAL StNSORS I
`31
`\.. OTHER DEVICES I
`- AND APPLIANCES I
`3z_ PLUMBING
`-
`RELATED
`SYSTEMS
`
`PROCESS
`CONTROLLER
`
`\. 26
`
`r26b
`
`I
`
`PROCESS
`CONTROLLER
`
`66"
`
`REMOTE
`SPEAKERS
`
`HOME
`LIGHTING
`r
`SYSTEM
`30 CONTROLLER
`I 32b
`32a
`\. 00 \ 00
`00 00
`
`HOME
`TELEPHONE
`SYSTEM
`
`r
`62
`fl?
`
`- MICROPHONES
`r
`64
`INTERFACE ----
`----
`
`REMOTE
`
`TELEPHONE
`
`r
`~n
`60
`
`~ •
`00 .
`""d =
`""""
`('t) = """"
`
`~
`C"
`
`~~
`
`~
`IO
`\0
`N
`
`(t)
`
`r:J)
`::r
`(t) ....
`0 ...,
`
`~
`
`~
`(JI
`
`...
`(.II
`0
`00
`°'
`... w
`
`00
`(.II
`
`Petitioner Google Ex-1009, 0002
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 2 of 45
`
`5,086,385
`
`FIG. 2
`
`2 POWER WIRES
`
`SILENT
`KNIGHT
`SECURITY
`SYSTEM
`
`SILENT
`KNIGHT
`KEYPAD
`
`2 DATA WIRES
`
`"'20
`
`ELECTRONIC
`SECURITY
`INTERFACE
`
`/
`24
`
`Z-80
`/" MICROCOMPUTER
`22 '----...-.----'
`
`>
`
`36
`
`HOME AUTOMATION
`SYSTEM CENTRAL PROCESSOR (10)
`AND SERIAL INTERFACE (34a)
`
`Petitioner Google Ex-1009, 0003
`
`

`

`u .s. Patent
`
`Feb. 4, 1992
`
`Sheet 3 of 45
`
`5,086,385
`
`[gff}
`
`THE ULTIMATEIV @!!]
`l AUDIO /YIDEO
`/._: ___ SECVH./11 /IANAG.ENENT .................. ____ ..
`l :ucHllNG .. VOODS.
`l _lNFOHIIATION ..
`I ENYl~NJIENTAL CONTROL
`/ . CON~NIENCE.:FEATU/?£S
`/ . SYSTEII CONUC.U!?ATION .. _ .... _.
`FIG. 3A
`
`LllACK I
`
`AUDIO / VIDEO
`I YCR _
`I TlllYISION
`I -. AN /FJI .Pl?ESETS
`I COJIPACT .. DISC ...
`I._ 0/STHIBUTED AUDIO
`I . AUDIO_ CONTROLS
`I SYSTEII Off . .
`
`FIG. 38
`
`Petitioner Google Ex-1009, 0004
`
`

`

`u .s. Patent
`
`Feb. 4, 1992
`
`Sheet 4 of 45
`
`5,086,385
`
`VCR
`
`I PLAY
`I STOP
`..
`I FAST. FOl?WAl?O .
`l HEYi/NO .
`I SLOW-llOllON .................... .
`I. FHEElE/FHAll[_AOYANCE .. .
`/ .. YCI? SCHEOUL/NC
`
`FIG. 3C
`
`LBACK / ·
`
`@ffJ
`
`CD SELECTION
`I CAl?JIINA. BUHANA
`I . PICTURES_ AT AN. ElHIBmON
`. / .. WACNEH SELECTIONS ..
`l BEETHOYEN.<PASTOl?ALE .
`I BHANOENBURa:coNCEHTOS
`I CO CONTHOLS .
`
`FIG. 3D
`
`Petitioner Google Ex-1009, 0005
`
`

`

`u .s. Patent
`
`Feb. 4, 1992
`
`Sheet 5 of 45
`
`5,086,385
`
`{BACK I
`
`DISTRIBUTED AUDIO @![}
`l FHOJI. COIIPACT DISC
`I FHOII HECEIYEH
`..
`l FHOJI. YCR . . . . . . __ . .
`I FH0/1 TllEY/SION ..
`I 0/STH/BUTED AUDIO OFF . .
`
`/m /
`
`DISTRIBUTED AUDIO:
`ENTRY LEVEL
`
`I
`
`I
`
`FIG. 3E
`!I!!J
`
`FIG. 3F
`
`Petitioner Google Ex-1009, 0006
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 6 of 45
`
`5,086,385
`
`SECURITY MANAGEMENT
`I UPP£/? LEY£l
`/_ .. ENTHY lEYEl _
`I. _ &HOUND LEY£l _____ _
`l FHONT.:OOfJt{ __ CAIIEHA _ _ __ _ __
`I _. CAHACE _ CAIIEHA __
`l SECURITY £Y£NT LOC __ _
`I HE-ENABLE BLOIYERS __
`
`__ _
`
`FIG. 3G
`
`Entry Level
`
`(cid:143)
`
`Zone #: 14
`Name: Living room window right
`Status: Enabled
`
`FIG. 3H
`
`ZONE KE.Y
`
`(cid:143) Open &
`
`Disabled
`0 Open
`D Disabled
`o Enabled
`SYSTEM
`STATUS:
`READY
`TO ARM
`
`Petitioner Google Ex-1009, 0007
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 7 of 45
`
`5,086,385
`
`ZONE KEY
`
`(cid:143) Open &
`
`Disabled
`D Open
`D Disabled
`a Enabled
`SYSTEM
`STATUS:
`READY
`TO ARM
`
`Entry Level
`
`(cid:143)
`
`DWlI
`lOIE
`lll/'lR
`IMl.
`SIIOIII)
`lMl
`
`Zone #: 14
`Name: Living room window right
`·
`Status: Disabled
`
`FIG. 31
`
`ffe.',CK/
`I 7 7
`I. ' 7
`I 1 I
`I CLEAR I
`
`jO{J!Tj
`
`PASSCODE
`I
`I I 9
`I 8
`I
`I I 6
`I 5
`I 2 I I J I
`I I OK
`I 0
`I
`FIG. 3J
`
`Petitioner Google Ex-1009, 0008
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 8 of 45
`
`5,086,385
`
`ZONE KEY
`
`(cid:143) Open &
`Disabled
`D Open
`(cid:143) Disabled
`o Enabled
`SYSTEM
`STATUS:
`
`I ARMED I
`
`Entry Level
`
`(cid:143)
`
`Zone #: 14
`Name: Living room window right
`Status: Disabled
`
`FIG. 3K
`
`SECURITY EVENT LOG
`
`22:32:
`22:32:
`
`IE~it«; Of ux;
`krtrusion ii zone 32: Siirun window east front
`02-03-1988
`kttrusion ii zone 32: SolariJrn lindor east front
`02-()3--1988
`krtrusion ii zone 23: jcjlchen doer rijit
`02--02-1988
`23-18:36
`kltrm it zone 2: ~ f~ gJoge lbx
`23:22:01
`02-02-1988
`krtrusion ii zone 1: Rs fO'j!!I' <ix>r
`23:23:11
`02-02-1988
`06: 11 :53
`krtrusion ii zone 61: PE master bedroom ckxlr 02-1~ 1988
`01:25:12
`kttrusion it zone Tl: SoloriJm lbx ~ht 02-20-1988
`kttrusion ii zone 32: Solarium rindol east front
`03-04-1988 13:19:
`03-04-1988 17:48:
`krlrusion ii zone 32: Saarium window east front
`kttrusion i1 zone 32: SobiJm wim east front
`03--04-1988 1a-ro:
`krtrusion ii zone 32: Solaritm window emt front
`03-04-1988 21:13:
`krtrusion it zone 32: Soooom lindor east front
`03-04-1988 21:21:
`
`I UP
`
`I I DOWN I I CLEA/1 LOG I
`FIG. 3L
`
`Petitioner Google Ex-1009, 0009
`
`

`

`u .s. Patent
`
`Feb. 4, 1992
`
`Sheet 9 of 45
`
`5,086,385
`
`/p.4CK /
`
`LIGHTING MOODS @fl
`I . EAHLY IIOHNING
`I .. NOHIIAL .DAY
`l NOHIIAL £YEN/NG
`l .. DAY PARTY .
`I .£YENING.PAl?Tf ....... .
`I HOJIANTIC. £YEN/NG . . .
`I ... Hl0Hl.UGHTJ: : ..... : ............................... .
`FIG. 3M
`
`.
`
`INFORMATION
`/ .. . SPOHTJ:scOH[S .
`I. KENNEOY:.coNCEHT HALL
`/ .. KENNEOY .. OPEHA ... HOUSE
`.: · ..
`/..STOCKS
`I. WEATHER
`
`FIG. 3N
`
`Petitioner Google Ex-1009, 0010
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 10 of 45
`
`5,086,385
`
`400
`
`ON H OF I.S. EVENT
`ON TOP OF QUEUE
`
`IS
`1
`
`IS
`4
`
`IS
`2
`
`IS
`s ...
`402
`IS. 3: FLASH QUIT
`TOUCHBOX
`
`YES
`
`408
`
`INSERT NEW I.S. EVENT
`n SECONDS LATER
`
`TOP
`POLL
`LOOP
`
`FIG. 4a
`
`IRQ-3 TRIGGER
`
`300
`
`INTERRUPT
`JUMP TO
`SERVER ROUTINE
`
`302
`
`ASK SERIAL CARD
`WHICH SERIAL LINE
`GENERATED INTERRUPT
`
`304
`
`PULL BYTE FROM
`APPROPRIATE SERIAL
`LINE'S RX REGISTER
`
`306
`
`IN
`PLACE BYTE
`APPROPRIATE SERIAL
`QUEUE
`
`308
`
`INCREMENT QUEUE
`IF QUEUE
`POINTER.
`POINTER > QUEUE SIZE,
`THEN MAKE QUEUE
`POINTER WRAP AROUND
`
`RETURN
`TO NORMAL
`PROGRAM
`
`FIG. 4b
`
`Petitioner Google Ex-1009, 0011
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 11 of 45
`
`5,086,385
`
`500
`
`502
`
`BAD DATA
`
`YES
`
`504
`SEC/FlRE 1
`DATA
`INTERPRITER
`
`GOOD DATA
`506
`/
`
`/ J TASK 1
`
`STATE
`DECODER
`
`SERIAL
`QUEUE 2
`
`SERIAL
`LINE 2
`(SECURnY /FIRE 2)
`
`INTERNAL
`SCHEDULED
`EVENT QUEUE....___~
`
`510
`
`TASK 2:
`SEC/FIRE 2
`
`400
`INTERNAL
`SCHEDULED 1 - - - - ~
`EVENT SERVER
`
`SERIAL
`UNE-=-3~-
`(I.O. CONTROLLER)
`
`11
`
`-
`
`KEYBOARD
`
`524
`
`FlG. 5C 1 - - - - - - . . . i
`
`530
`
`SERIAL
`SERIAL QUEUE 4
`,, 11
`LINE 4
`(TOUCHSCREEN 1)
`
`520
`
`YES
`
`TASK 3:
`1.0. CONTROLLER
`
`526
`
`DIAGNOSTIC
`ROUTINES
`
`532
`
`YES
`
`TASK 4:
`TOUCHSCREEN 1
`
`FIG. 5a
`
`Petitioner Google Ex-1009, 0012
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 12 of 45
`
`5,086,385
`
`FIG. 5b
`
`LINE 5
`(TOUCHSCREEN 2)
`
`SERIAL ~ - - i
`LINE 6
`(FUNCTION SWITCH 1)
`
`SERIAL - - - . . i
`LINE 7
`( FUNCTION SWITCH 2)
`
`60
`
`TELEPHONE
`INTERFACE
`
`536
`
`TASK 5:
`TOUCHSCREEN 2
`
`540
`
`TASK 6:
`FUNCTION SWITCH 1
`
`544
`
`TASK 7:
`FUNCTION SWITCH 2
`
`YES
`
`TASK 9:
`ANSWER
`PHONE
`
`550
`
`TASK 9:
`DECODE
`TOUCHTON ES
`
`548
`
`552
`
`Petitioner Google Ex-1009, 0013
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 13 of 45
`
`5,086,385
`
`KEYBOARD
`
`y
`
`N
`
`FIG. 5c
`
`y
`
`564
`
`N
`
`CALL INIT
`RECOGNITION
`
`568
`
`CHECK
`RECOGNmON
`ON BOARD 0
`
`CHECK
`RECOGNITION
`ON ACTIVE
`BOARD
`
`y
`
`572
`
`CHECK
`RECOGNmON
`ON BOARD 1
`
`576
`
`CHECK
`RECOGNITION
`ON BOARD 2
`
`578
`
`582
`
`586
`
`SHOW RECOGNITION
`SCORE
`
`584
`SET SIMULATED TOUCH
`CO-ORDINATES TO
`MIDDLE OF SCREEN
`
`TOUCHSCREEN 1
`
`Petitioner Google Ex-1009, 0014
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 14 of 45
`
`5,086,385
`
`FIG. 6a
`
`500
`
`YES
`
`600
`
`NO
`1 - - - - - - . . . . . i
`
`IS DATA
`VALID?
`YES
`
`NO
`
`604
`
`YES
`
`IF TOUCHPOINT>n PIXELS
`FROM PRIOR TOUCH, THEN
`DISPLAY NEW CURSOR
`
`606
`
`ON STATE OF TASK 4, GO TO ...
`
`608
`
`612
`
`610
`
`... OTHER TOUCHSCREEN
`MENUS
`
`Petitioner Google Ex-1009, 0015
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 15 of 45
`
`5,086,385
`
`FIG. 6b
`
`610
`
`618
`
`CHECKTOUCH
`
`YES
`
`NO
`
`622
`
`REMOVE • RETURN
`TO DORMANi
`1.S. EVENT
`
`624
`
`ON BOX TOUCHED, GO TO ...
`
`...OTHER TOUCHSCREEN
`MENUS ACCESSIBLE
`FROM THE MAIN MENU
`
`628
`
`LOAD LIGHTING MOOD
`MENU DATA. SET
`STATE OF TASK 4
`TO LIGHTING MOOD
`
`630
`
`LOAD A/V MENU
`DATA. SET STATE OF
`TASK 4 TO A/V MENU
`
`Petitioner Google Ex-1009, 0016
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 16 of 45
`
`5,086,385
`
`FIG. 6c
`
`632
`
`LIGHTING
`MOODS MENU
`618
`
`CHECK TOUCH
`
`YES
`
`NO
`
`634
`
`ON BOX TOUCHED, GO TO ...
`
`636
`
`638
`
`SET LIGHTING
`MOOD (n): CALL
`DEVICE DRIVER
`
`640
`
`BLANK LIT BOX
`
`500
`
`Petitioner Google Ex-1009, 0017
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 17 of 45
`
`5,086,385
`
`FIG. 7a
`
`700
`
`710
`
`NEW BYTE IN
`M.T.QUEUE
`
`ON V-STATE
`GO TO ...
`
`714
`
`CALCULATE
`UPPER HALF
`X-TOUCH
`CO-OR.
`
`718
`
`INCR.
`V-STATE
`
`724
`
`INCR.
`V-STATE
`
`INCR.
`V-STATE
`
`746
`
`748
`
`RESET
`V-STATE __ _
`
`CALCULATE
`LOWER HALF
`X-TOUCH
`CO-OR.;
`CALCULATE
`X-TOUCH
`
`734
`CALCULATE
`UPPER HALF
`Y-TOUCH
`CO-OR.
`
`CALCULATE
`LOWER HALF
`Y-TOUCH
`CO-OR.;
`CALCULATE ·
`Y-TOUCH
`
`y
`
`y
`
`y
`
`V-STATE 2
`
`Petitioner Google Ex-1009, 0018
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 18 of 45
`
`5,086,385
`
`FIG. 7b
`
`IMMEDIATE
`RESPONSE
`
`754
`
`CONVERT TOUCHSCREEN
`COORDINATES TO
`PIXEL SOORDINATES
`
`762
`
`NEUTRAL STATE
`
`764
`
`PAUSE 0.1.
`SECONDS
`
`FIG. 7c
`
`y
`
`770
`
`TURN ON SPEAKER
`ACCORDING TO
`ACTIVE TOUCHSCREEN
`
`N
`
`774
`
`y
`
`SPEAK
`• SYSTEM BUSY'
`
`y
`
`758
`
`ERASE PRIOR CURSOR;
`DRAW NEW CURSOR;
`STORE CURRENT TOUCH
`COORDINATES;
`
`760
`
`SET TOUCH FLAG
`
`762
`
`M.T. TASK
`STATE DECODER
`
`CALL
`PASSWORD
`SCREEN
`
`N
`
`784
`
`SPEAK GREETING
`
`786
`
`Petitioner Google Ex-1009, 0019
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 19 of 45
`
`5,086,385
`
`788
`SPEAK
`•PROMPi
`PHRASE
`
`INITIALIZATION
`ENTRY
`POINT
`
`790
`LOAD SCREEN:
`INDICATE STATUS
`OF MENU OPTIONS,
`IF NECESSARY
`792
`LOAD SPEECH
`RECOG. VOCAB.,
`IF APPLICABLE
`
`798
`
`799
`
`CALL
`CHECKTOUCH
`
`CALL
`DISPLAY CURSOR
`
`500
`
`794
`
`SET STATE
`TO CURRENT
`CONTEXTUAL STATE
`ENTRY POINT
`
`N
`
`FIG. 7d
`
`721
`
`REMOVE • SCREEN
`TIMEour EVENT
`FROM LS.LS;
`INSERT NEW
`> - - , ~ . SCREEN TIMEOLJi
`1.S.I.S. EVENT;
`TOUCHFLAG=O
`
`723
`
`INITIALIZ
`PRIOR
`SUBMENU
`(STATE)
`
`729
`
`REMOVE ·scREEN TIMEOUi
`EVENT FROM LS.LS;
`INSERT NEW • SCREEN
`TIMEOUi LS.LS. EVENT
`
`731
`INITIALIZE NEW
`SUB-MENU
`
`713
`
`ON BOX
`SELECTED .•.
`
`QUIT
`
`BACK
`
`725
`
`EXCLUDE ACTION
`
`y
`
`BLANK HIGH(cid:173)
`LIGHTED BOX
`
`735
`CLEAN OUT
`TOUCH BUFFER
`
`Petitioner Google Ex-1009, 0020
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 20 of 45
`
`5,086,385
`
`741
`PAUSE 0.25
`SECONDS
`
`ERASE
`CURSOR
`
`N
`
`HIGHLIGHT
`BOX TOUCHED
`
`FIG. 7e
`
`753
`
`FIG. 7f
`755
`
`ERASE Afff PREVIOUS
`ZONE STATUS MESSAGE
`
`757
`PRINT ZONE #,
`NAME, STATUS
`
`N
`
`REPLACE
`• DISABLE ZONE"
`TOUCHBOX WITH
`• ENABLE ZONE"
`
`REPLACE
`• ENABLE ZONE"
`TOUCHBOX WITH
`• DISABLE ZONE"
`
`763
`
`Petitioner Google Ex-1009, 0021
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 21 of 45
`
`5,086,385
`
`414
`
`SEND ·zoNE
`MAP REQUESi
`TO S/F
`INTERFACE;
`SET S/F TASK
`TO ·zoNE MAP
`REQUESi STATE;
`INSERT • SEC.
`RESPONSE
`EXPECTED•
`I.S.I.S. EVENT
`
`416
`
`SET M.T.
`TASK STATE
`
`412
`STORE FLOOR #;
`LOAD FLOOR
`PLAN SCREEN;
`SPEAK RESPONSE
`PHRASE;
`DISPLAY • PLEASE
`WAli MESSAGE
`
`420
`
`ON SUB-STATE
`GO TO ..•
`
`799
`
`CALL
`DISPLAY CURSOR
`
`424
`
`ZONE
`MAP
`REQUEST
`ENTRY
`POINT
`
`426
`
`ON RESULT
`GO TO •..
`
`GOOD
`
`NO RESPONSE
`
`430
`SPEAK •No
`RESPONSE" PHRASE
`
`428
`DECODE SECURITY ARMED,
`READY CONOmONS
`
`434
`ERASE • PLEASE WAii
`MESSAGE
`
`UNEXPECTED
`RESPONSE
`SPEAK • UNEXPECTED
`RESPONSE" PHRASE
`
`FIG. 7g
`
`Petitioner Google Ex-1009, 0022
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 22 of 45
`
`5,086,385
`
`FIG. 7h
`
`307
`
`SIT FADE COLOR
`TO BLACK;
`.___._,. LOAD FLOOR PLAN
`SCREEN ACCORDING
`TO FLOOR #:
`SIT FADE COLOR
`TO NORMAL
`
`DECODE
`.,__...__.-i ZONES'
`STATUS
`
`311
`
`MARK ZONES ON SCREEN;
`.,_._ _ _ _ _ ----1 DISPLAY STATUS OF OPEN
`OR SHUNTED ZONES
`
`317
`
`y
`
`MARK
`SELECTED ZONE
`
`319
`
`PRINT •No
`ZONE SELECTED"
`
`CALL PRINT
`ZONE STATUS
`
`313
`
`SHOW ARMED OR
`READY STATUS
`ON SCREEN
`
`798
`
`ANALYlE
`FLOOR
`PLAN
`TOUCHES
`CALL
`.___~ CHECK
`TOUCH
`
`323
`
`INSERT • SCREEN
`TIMEOLJr I.S.I.S. EVENT;
`TOUCHFLAG = 0
`
`325
`SIT STATE TO • ANALYlE
`FLOOR PLAN TOUCHE~ 1 - - - - - - - - - 1 _ .
`444
`
`ERASE
`,_Y----11~ PREVIOUS
`ZONE
`MARKER
`
`446
`
`MARK NEW ZONE;
`CALL PRINT ZONE STATUS
`
`Petitioner Google Ex-1009, 0023
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 23 of 45
`
`5,086,385
`
`FIG. 7 i
`
`PAUSE 0.1
`SECONDS t------~
`
`y
`
`452
`ON BOX TOUCHED
`GO TO •..
`
`QUIT
`
`BACK
`
`454
`
`456
`
`INITIALIZE
`SEC.
`MANAGEMENT
`SUB-MENU
`
`REMOVE • SCREEN
`TIMEOUi I.S.I.S.
`EVENT;
`INSERT NEW
`• SCREEN TIMEOLJi
`LS.LS. EVENT
`
`460
`
`ENABLE/DISABLE ZONE
`
`y
`
`HIGHEST
`ALTERNATE
`FLOOR
`
`LOWEST
`ALTERNATE
`FLOOR
`
`464
`
`SET FLOOR TO HIGHEST
`ALTERNATE FLOOR
`
`468
`
`SET FLOOR TO LOWEST
`ALTERNATE FLOOR
`
`Petitioner Google Ex-1009, 0024
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 24 of 45
`
`5,086,385
`
`REMOVE • SCREEN
`TIMEOUf I.S.I.S.
`EVENT;
`TOUCHFLAG = 0
`
`y
`
`FIG. 7j
`
`474
`
`SET
`ARMFLAG
`
`RESET
`ARMFLAG
`
`478
`
`SPEAK • ENTER
`PASSWORD"
`PHRASE
`
`480
`
`CALL GET
`1---1..,. PASSWORD.--.--<.
`
`490
`
`SEND DISARM MESSAGE &
`PASSWORD TO S/F INTERFACE
`492
`
`SET S/F STATE TO
`•DISARM SYSTE~
`
`486
`
`SEND ARM MESSAGE &
`PASSWORD TO S/F INTERFAC~
`488
`SET S/F STATE TO
`• ARM SYSTEM"
`
`494
`SET • SEC.
`RESPONSE."
`EXPECTED
`I.S.I.S. EVENT
`
`. - - - - - - - ,-.------.
`SPEAK • PLEASE
`DISPLAY • PLEASE
`WMi PHRASE
`WMi MESSAGE
`
`411
`
`SET
`SUB-STATE
`
`496
`
`498
`
`CALL
`t - - - - - - . . . i DISPLAY CURSOR
`
`Petitioner Google Ex-1009, 0025
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 25 of 45
`
`5,086,385
`
`489
`
`ON RESULT
`GO TO ...
`
`FIG. 7k
`
`ARM/DISARM
`SEC. SYSTEM
`SUB-STATE
`ENTRY POINT
`
`GOOD
`
`487
`INSERT ·wm
`FOR BAD
`PASSWORD•
`I.S.I.S. EVENT
`
`485
`
`SET SUB-STATE
`
`483
`
`SEND ZONE MAP
`REQUEST TO S/F
`INTERFACE;
`SET S/F STATE
`TO "ZONE MAP
`REQUEsr;
`SET "SEC.
`RESPONSE
`EXPECTED"
`I.S.I.S. EVENT
`
`NO BAD
`PASSWORD
`MESSAGE
`DURING DELAY
`SPEAK •No
`RESPONSt
`PHRASE
`
`ALREADY
`NO
`BAD
`RESPONSE PASSWORD ARMED/
`DISARMED
`
`479
`
`SPEAK • INVALID
`PASSWORD"
`PHRASE
`
`471
`N _ __._.__
`SPEAK
`"ALREADY
`ARMED"
`PHRASE
`
`475
`
`SPEAK
`"ALREADY
`DISARMED"
`PHRASE
`
`469
`
`ZONE MAP RETURNED
`
`467
`DECODE ARMED/
`DISARMED STATUS
`
`y
`463 _.....___
`SPEAK
`"SYSTEM
`ARMED"
`PHRASE
`
`SPEAK "SYSTEM
`DISARMED" PHRASE
`
`481
`SET SUB-STATE
`
`500
`
`466
`
`Petitioner Google Ex-1009, 0026
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 26 of 45
`
`5,086,385
`
`459
`
`457
`
`REMOVE ·scREEN TIMEOUi
`I.S.I.S. EVENT;
`TOUCHFLAG = 0
`
`FIG. 7 I
`
`453
`
`SPEAK • ENTER
`y
`> - - - - -~ PASSWORD"
`PHRASE
`
`447
`SEND SHUNT ZONE MESSAGE
`TO S/F INTERFACE
`
`449
`
`SET • SEC. RESPONSE
`I.S.I.S. EVENT;
`EXPECTED"
`STORE ZONE NUMBER
`FOR I.S.I.S. EVENT
`
`480
`CALL GET
`PASSWORD
`
`477
`
`SEND SHUNT ZONE COMMAND
`& PASSWORD TO S/F INTERFACE;
`
`449
`
`SET • SEC. RESPONSE
`I.S.I.S. EVENT;
`EXPECTED"
`STORE ZONE NUMBER
`FOR I.S.I.S. EVENT
`
`445
`
`SET S/F STATE TO
`•sHUNT ZONt
`
`443
`SPEAK • PLEASE WNT" PHRASE
`DISPLAY • PLEASE WNT" MESSAGE
`441
`SET SUB-STATE
`
`500
`
`Petitioner Google Ex-1009, 0027
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 27 of 45
`
`5,086,385
`
`439
`
`437
`ON RESULT
`GO TO ...
`
`FIG. 7m
`
`NO
`RESPONSE
`
`BAD
`PASSWORD
`
`UNEXPECTED
`RESPONSE
`
`SPEAK •No
`RESPONSt
`PHRASE
`
`479
`
`431
`
`REMOVE •wAfT
`FOR BAD
`PASSWORD"
`I.S.I.S. EVENT
`
`SPEAK
`•uNEXPECTED
`RESPONSt
`PHRASE
`
`475
`
`GOOD
`
`487
`
`SET • WAIT FOR
`BAD PASSWORD"
`LS.LS. EVENT
`
`433
`SET SUB-STATE
`
`500
`
`427
`
`NO BAD PASSWORD
`MESSAGE DURING DELAY
`
`SET S/F STATE TO
`·zoNE MAP REQUESi;
`SEND ZONE MAP REQUEST
`TO S/F INTERFACE
`
`435
`SET • SEC. RESPONSE
`EXPECTED" I.S.I.S. EVENT
`
`425
`SET SUB-STATE
`
`SPEAK • INVALID
`PASSWORD" PHRASE
`429
`
`466
`
`y
`
`N
`
`417
`
`421
`
`ERASE ·sHUNTED"
`INDICATOR
`
`PLACE ·sHUNTED"
`INDICATOR
`
`DECODE ARMED/
`DISARMED CONDmON
`
`419
`
`Petitioner Google Ex-1009, 0028
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 28 of 45
`
`5,086,385
`
`FIG. 7n
`
`N
`
`413
`
`y
`
`407
`
`SPEAK• NOW
`READY' PHRASE
`
`y
`
`SPEAK ·Now
`NOT READY'
`PHRASE
`
`y
`
`N
`
`N
`
`SPEAK ·Now
`DISARMED" PHRASE
`
`. y
`
`N
`
`y
`
`403
`
`SPEAK ·Now
`DISARMED" PHRASE
`
`306
`
`N
`ERASE • PLEASE
`>--t-.t WAli MESSAGE
`
`ERASE ZONE MARKER;
`BLANK HIGH-LIGHTED
`BOX
`
`308
`
`310
`
`Petitioner Google Ex-1009, 0029
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 29 of 45
`
`5,086,385
`
`312
`
`FIG. 7o
`314
`
`TURN OFF VOICE
`RESPONSE SPEAKERS
`
`332
`
`334
`
`RESET M.T. V-STATE
`
`336
`
`STORE PREVIOUS TOUCH
`COORDINATES TO NEW
`TOUCH COORDINATES
`
`338
`
`318
`HANG UP
`PHONE
`
`N
`
`y
`
`y
`
`322
`
`N
`
`TURN OFF
`VIDEO MONITORING
`
`324
`
`LOAD DORMANT
`SCREEN
`
`y
`
`328
`
`PRINT • PHONE
`CALL" MESSAGE
`
`500
`
`CALL
`INITRECOGNmON
`
`Petitioner Google Ex-1009, 0030
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 30 of 45
`
`5,086,385
`
`800 NEW BYTE IN ~ - - i ON V-STATE (1)
`S/F QUEUE
`GO TO ...
`
`802
`
`808
`
`INCR. V-STATE;
`ADD • COMPLETE
`> - -~ SEC. MESSA.Gt t - -~
`EVENT TO I.S.I.S.
`
`816
`
`INCR. V-STATE
`
`824
`
`INCR. V-STATE;
`STORE LENGTH ....-~
`
`834
`
`V-STATE=
`V-STATE 4 t-"1-9--..
`
`L-----1--iV-STATE =
`V-STATE 5
`
`836
`
`V-STATE 4
`
`840
`STORE nTH
`DATA BYTE
`848
`......-'---'---
`0 N V-STATE1-------------(cid:173)
`GO TO ...
`
`INCR.
`V-STATE
`
`850
`
`FIG. Ba
`
`Petitioner Google Ex-1009, 0031
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 31 of 45
`
`5,086,385
`
`852
`REMOVE • COMPLETE
`SECURllY MESSAGE
`FROM LS.LS.
`
`854
`
`V-STATE=O
`
`N
`
`V-STATE 5
`
`FIG. 8b
`
`IMMEDIATE
`RESPONSE
`
`858
`
`ACKNOWLEDGE
`MESSAGE TO
`S/F INTERFACE
`860
`ON STATE
`GO TO .••
`
`NEUTRAL
`STATE
`
`N (IGNORE ALL OTHER COMMANDS)
`
`ALL OTHER
`Al.ARMS
`
`868
`SET • ALL HOUSE
`UGHrs(cid:127) UGHTING t-----1..,
`MOOD
`
`•DISARM SYSTEM"-----
`STATE
`ON COMMAND
`GO TO ...
`
`870
`
`ACKNOWLEDGE
`
`872
`RESULT=
`GOOD
`
`ALREADY
`DISARMED
`RESULT=
`ALREADY
`DISARMED
`
`PASSWORD
`REJECTED
`RESULT=
`PASSWORD
`REJECTED
`
`876
`880
`
`878
`
`874
`M.T. TASK
`.__ _ _ _ ....,__ _ _ _ _ _.__---i DISARM SEC. SYSTEM
`SUB-STATE
`
`Petitioner Google Ex-1009, 0032
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 32 of 45
`
`5,086,385
`
`ON STATE
`GO TO ...
`SHUNT ZONE
`STATE
`
`882
`
`ON COMMAND
`GO TO ...
`
`FIG. Be
`
`ALL OTHER COMMANDS
`
`ACKNOWLEDGE REJECTED
`PASSWORD
`RESULT=
`PASSWORD
`REJECTED
`
`RESULT=
`GOOD
`
`884
`
`886
`
`892
`
`ON COMMAND
`GO TO ...
`
`ZONE MAP
`REQUEST STATE
`
`ACKNOWLEDGE
`
`RESULT= 894
`GOOD
`
`878
`
`890
`
`M.T. TASK
`SHUNT ZONE
`SUB-STATE
`
`REJECTED PASSWORD
`878
`
`896
`
`RESULT=
`PASSWORD
`REJECTED
`
`898
`
`ARM
`SYSTEM STATE
`
`899
`
`ON COMMAND
`GO TO ...
`
`ACKNOWLEDGE
`
`ALREADY
`ARMED
`RESULT=
`ALREADY
`ARMED
`
`RESULT=
`GOOD
`
`897
`
`893
`
`891
`
`NOT
`READY
`RESULT=
`NOT
`READY
`
`PASSWORD
`REJECTED
`RESULT=
`REJECTED
`PASSWORD
`
`889
`
`895
`
`M.T. TASK
`ARM/DISARM SEC.
`SYSTEM SUB-STATE
`
`Petitioner Google Ex-1009, 0033
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 33 of 45
`
`5,086,385
`
`900
`
`902
`
`FROM MAJN
`PROGRAM
`
`DISPLAY
`1----....i SCHEDULING SCREEN .....,_ _ _ _ ---1
`AND OPTIONS
`
`FIG.
`
`9
`
`y
`
`y
`
`y
`
`y
`
`N
`
`906
`DISPLAY GRAPHICS
`FOR START DATE
`AND ACCEPT INPUT
`
`910
`DISPLAY GRAPHICS
`FOR START TIME
`AND ACCEPT INPUT
`
`914
`DISPLAY GRAPHICS
`FOR STOP DATE
`AND ACCEPT INPUT
`
`918
`DISPLAY GRAPHICS
`FOR STOP TIME
`AND ACCEPT INPUT
`
`920
`
`STORE SCHEDULE &
`RETURN TO
`MAIN PROGRAM
`
`Petitioner Google Ex-1009, 0034
`
`

`

`_zz:_;' ·,·.'.',':.··.·:.:.,·.·'~~, .. ~.-. -.. -.-.-..
`. ..... -...... -............. ' ....... '' ,·.- ...... ' •. '.' .. ' .. ,-.-.. -.'
`.... -. . .
`-.~, ..... .
`-- ............ t..=.:.~·····························································································
`. ....... ' . .
`'
`. . . • . . . . .
`. ............ ' '.......
`.
`.
`.
`.
`. .
`. . . .
`. . .
`.
`.
`-
`.
`.
`.',"""1',.,,,,,,.'::::::.: ... .
`.. ::::
`
`.
`
`'lAPRILl :::: .... :Mo·y:: .. ::: :: fJUNEI. ::: :: :::: :: :::: :::: :: ·tNDE-'P.E·N·o· E·N· r:: --s·c·H· ·Eou· t··E--... ::::OK·····::,:·• . .-.-.-............... : .. •:•:•:•:1·
`1· •.• : • . • • • • • • • • • • • . • . • • • • • • • • • • • • . • • • • . • . : ~r:L\L/{ ":::::<:.:::.:_:.:::.:.:.:::.:.:::::.:.:.:::.:.:.:.:::.:::::::.:_:_:.:::::.:.:.:.:.:_:.:.:.:.:::.:.:> :t:f·:/:::::\:·::/:::::::t?\ •
`:.t Su Mo Tu We Th Fr Sa 1cvcw·············l · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · ······~~ ....... .
`. . . .. ............ . .. V,'ACAJ· 1 o·N· . ·M·oo·E· . . . . . . . . . . . . . . . . . . . ........... ............................................... .
`· ........... 1 ... 2 .. 3 .. 4 .. ~·· 1-Ldl ><<:::< < : : < <
`. 6 7 s 9 10 11 12
`. - - - - - - .................. ::::.
`. ...... ·. . . : :. . . . · ... : : :::::::: :::::::::.:•:•:•:·&it·:·:•:•:•:•:·:•:•:•:•:•:•:•:•:•:•:•:•:•:·
`.
`. . ...................... ' ... '...... ..........................
`<< <
`FIG I
`/ > M ~ 2 4
`.. .
`,.
`lm.rrt?}}?:?~t:I}:::: (:4®=!~?9!30AM·:::::?:·:•:•:•:·:</•:•:•:·:·:·:·:J
`13 14 15 16 17 18 19
`1 OA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ... ' . ' ..... ' . . . . . . . . . ffr35PM ............... 8iOOPM: ......................................... J
`(.::.:.::.::.:.::.:.::.:i:•:·:·:
`.
`..
`········ .
`..
`·····················
`20 21 22 23 24 25 26
`.: .. ' ............................... ::~??:?}} ::::::::
`,. , 27 28 29 30 31
`·. · .... · .... · · · ... · · :·:·:·:·
`---------------~ ...... -----· ...................... ·---------------------------------'
`. ..................... .
`. . .. .. .. . ' ........... .
`
`. ...
`
`FIG.
`:: 1 OB
`
`.
`
`.
`
`e •
`
`rJ'J.
`•
`~
`~
`""""
`
`(t) = """"
`
`I-Tl
`tt>
`C"'
`
`~.f;,.
`
`....
`
`\0
`\0
`N
`
`'J1
`t:r'
`tt>
`tt>
`~
`
`~
`.f;,.
`
`0 ...,
`.J.
`tit
`
`...
`01
`0
`00
`...
`°'
`w
`00
`01
`
`Petitioner Google Ex-1009, 0035
`
`

`

`. ·::l · 2· ·o· · · 2· · 1· · ·2· 2· · · ·2· 3. · · 2· ·4· · ·2·s ·· · ·2· s· · · f'"""''•~""'"·""'''['
`I
`I,, 27 iii 29 · Jo · 31 · · · · · · · · · · · i ·
`---~
`: :CMCEt/:/:\:::::
`..
`
`FIG.10E
`
`-.---.--.--.----.-.-.-.·. ---·.-.·.-.-.-. __ ._.-.-.-.-.-.-._.-.-.-:·.;,:,:-:-:-·-:-:-::,-··.·.-.-·-.:-:.-.-.-.-.---..... _. .. _. .......................................... -.. ............ .
`
`, ...... ,.,.,7fi,11 a111:i I
`
`~ •
`rJJ
`•
`~
`~
`~
`('t>
`::1
`
`~
`
`~
`('D
`Cr'
`
`~,J;,,,.
`
`'""" '° '° N
`
`r.ri =(cid:173)
`('D ....
`
`('D
`
`tu
`OI
`0 .....
`
`,J;,,,.
`OI
`
`...
`tit
`0
`00
`... w
`O'\
`
`00
`tit
`
`Petitioner Google Ex-1009, 0036
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 36 of 45
`
`5,086,385
`
`700
`
`FIG. 11
`
`618
`
`702
`
`IF A BOX WAS
`NO
`> - - ~ PREVIOUSLY LIT,
`IT
`THEN 81.ANK
`
`LIGHT UP
`APPROPRIATE BOX
`
`1 - - - - - - - J
`
`Fl G 6d
`
`642
`
`FIG. 6e
`
`500
`
`FIG. 6f
`
`646
`
`REMOVE PRIOR
`• RETURN TO DORM
`I.S. EVENT
`SET NEW •RETURN TO
`DORMANi I.S. EVENT
`LOAD MAIN MENU
`GRAPHICS & DATA.
`SET TASK 4 STATE
`TO MAIN MENU
`
`652
`
`REMOVE PRIOR
`•RETURN TO DORMANl"
`I.S. EVENT
`LOAD DORMANT
`SCREEN GRAPHICS
`& DATA.
`SET STATE TO
`DORMANT SCREEN
`
`NO
`
`644
`
`SPEAK GRE,ETING
`LOAD MAIN MENU
`GRAPHICS AND DATA
`SET STATE
`TO MAIN MENU
`SET UP • RETURN TO
`DORMANi I.S. EVENT
`IN
`TO OCCUR
`n SECONDS
`
`500
`
`650
`
`500
`
`654
`
`500
`
`Petitioner Google Ex-1009, 0037
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 37 of 45
`
`5,086,385
`
`FIG. 12A
`
`Petitioner Google Ex-1009, 0038
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 38 of 45
`
`5,086,385
`
`FIG. 12C
`
`Petitioner Google Ex-1009, 0039
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 39 of 45
`
`5,086,385
`
`FIG. 12F
`
`Petitioner Google Ex-1009, 0040
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 40 of 45
`
`5,086,385
`
`FIG. 12G
`
`Petitioner Google Ex-1009, 0041
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 41 of 45
`
`5,086,385
`
`FIG. 13a
`
`y
`
`1304
`
`BLINK QUIT BUTTON
`5 TIMES
`
`FIG. 13b
`1312
`
`N
`
`SEND MESSAGE TO S/F
`INTERFACE AGAIN
`1318
`INSERT • SEC. RESPONSE
`EXPECTED" I.S.I.S. EVENT
`
`500
`
`y
`
`1308
`
`INSERT NEW • SCREEN
`TIMEOUf I.S.I.S. EVENT
`
`500
`
`1320
`
`RESULT=
`NO RESPONSE
`1322
`
`ON M.T. STATE
`GO TO ...
`
`1326
`
`1328
`
`Petitioner Google Ex-1009, 0042
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 42 of 45
`
`5,086,385
`
`FIG. 13c
`
`1332
`
`SET RESULT TO •No BAD
`PASSWORD MESSAGt DURING DELAY
`
`1334
`SET S/F STATE TO NEUTRAL
`
`1336
`ON M.T. STATE
`GO TO ...
`
`1 - - - - - - . . i
`
`FIG. 13d
`
`1338
`
`1326
`
`1328
`
`AAM/
`DISAR~ SEC.
`SYSTEM SUB(cid:173)
`STATE ENTRY
`POINT-
`
`1340
`
`RESET S/F V-STATE
`
`500
`
`FIG. 14
`
`1402
`
`1400
`
`NEW BYrE IN ,_ ..... STORE SECONDAAY
`
`S.T. QUEUE
`
`TOUCHSCREEN ID.
`TO ACTIVETSCRN
`
`Petitioner Google Ex-1009, 0043
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 43 of 45
`
`5,086,385
`
`1500
`
`1502
`
`NEW DATA BYTE ..__.-.o1 ON V-STATE
`IN 1.0. QUEUE
`GO TO ...
`
`500
`
`V-STATE
`
`N
`
`STORE
`COMMAND
`
`1510
`STORE 1
`,,...._..._O LENGTH
`
`1514
`STORE 4 1----....i
`TO LENGTH
`
`INSERT • COMPLETE
`1.0. CONTROLLER MESSAGt
`I.S.I.S. EVENT
`
`1516
`
`N
`
`1520
`L-V_-_S1_AT_E_1~ STORE BYTE .,___ __ __.-<
`OR DATA
`
`N
`
`1522
`
`1524
`
`1526
`
`RESET
`V-STATE
`
`FIG. 15a
`
`REMOVE • COMPLETE 1/0
`CONTROLLER MESSAGE"'
`I.S.I.S. EVENT
`
`1512
`
`Petitioner Google Ex-1009, 0044
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 44 of 45
`
`5,086,385
`
`1528
`
`ON COMMAND
`GO TO ...
`
`FIG. 15b
`
`1530
`
`ON-TO-OFF OR OFF-TO-ON
`TRANSmON REPORT
`
`DECODE
`PORT#
`
`1532
`
`1534
`
`COMPARE BIT MASKS
`STORE NEW
`BIT MASK t - - t~ TO DETERMINE WHICH
`STORE OLD
`INPUT(S) CAUSED
`BIT MASK
`TRANsmoN REPORT
`
`DIGITAL
`STATUS
`RETURNED
`1536
`DECODE PORT #;
`DECODE DATA BYTES
`CORRESPONDING TO
`INPUT PORTS
`
`ACKNOWL(cid:173)
`EDGEMENT
`(DO
`NOTHING)
`
`500
`
`1538 . . . - - - - - - - - - - - - - - - - - - -
`
`ON STATE
`GO TO ...
`
`NEUTRAL
`STATE
`
`IGNORE ALL OTHER COMMANDS
`
`1542
`FOR EACH
`BIT IN
`BIT MASK
`
`1548
`
`y CALL
`OFF TO ON
`
`1550
`
`CALL
`ON TO OFF
`
`y
`
`Petitioner Google Ex-1009, 0045
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 45 of 45
`
`5,086,385
`
`FIG. 15c
`
`READ
`DIGITAL
`STATUS
`
`1554
`
`1556
`
`N
`
`1558
`
`REMOVE •1.0.• RESPONSE
`EXPECTED" I.S.I.S. EVENT
`
`1560
`
`FIG. 15d
`
`1548 __ _......_1562
`i--------.i ON PORT #
`GO TO .••
`
`PORT n
`
`PORT n+1
`
`PORT n+2
`
`ON BIT#
`GO TO ..•
`
`ON BIT#
`GO TO .••
`
`ON BIT # •••
`GO TO ..•
`
`Petitioner Google Ex-1009, 0046
`
`

`

`1
`
`5,086,385
`
`EXPANDABLE H0:\1:E AUT0:\1:ATIOl\" SYSTEM
`
`BACKGROUND OF THE INVENTION
`The present invention relates to computer controlled 5
`systems for automating a plurality of diverse electri(cid:173)
`cally controllable subsystems. More particularly, the
`present invention relates to a microprocessor-based
`electronic control system for use in the automation and
`control of electrical subsystems found in the home envi- 10
`ronment. Such systems may also be utilized in commer(cid:173)
`cial applications.
`In the past, sophisticated electronic control over
`complex systems has been limited primarily to industrial
`applications, and occasionally commercial applications. 15
`Such electronic control systems usuaJly required exten(cid:173)
`sive and costly equipment, as weJJ as technicaJJy trained
`operators. However, as consumer products and systems
`become more and more complex, untrained people in
`home environments have been increasingly desirous of 20
`obtaining a sophisticated electronic control system for
`enabling an easy to use control over such home prod(cid:173)
`ucts and systems. Many such products and systems are
`also increasingly being used in commercial environ(cid:173)
`ments, such as electronic conference rooms, in which it 25
`is also desirable to provide an easy to use control system
`for use by individuals who are often not skilled in tech(cid:173)
`nological arts.
`Known home automation systems are generally built
`around a smaJJ control box which is connected by 30
`means of existing household 110 volt AC wiring to one
`or more modules distributed throughout the home. The
`appliances and/or lights to be controlled are in turn
`connected to the modules and may thus be controlled
`from the control console by the homeowner. The main 35
`advantage of such "power-line carrier" home control
`systems is that they are low in cost and utilize existing
`home wiring. However, such power-line carrier control
`systems can be easily disrupted by outside environmen-
`tal electrical disturbances, such as weather conditions. 40
`In addition, such systems aJJow the control of only a
`relatively limited number of types of electrical appli(cid:173)
`ances, namely, lights and small electrical appliances.
`They do not, however, aJlow for any sophisticated
`programming functions other than perhaps a time on 45
`and time off feature Thus, power-line carrier control
`systems are of relatively limited utility for home auto(cid:173)
`mation purposes.
`More sophisticated home automation system designs
`are known, which are generaJJy built around a program- 50
`mable microprocessor connected to a local bus which
`accepts a limited number of input/ output control cards.
`Such systems may aJlow the connection of one or two
`µser control devices such as a keypad or a touchscreen
`for inputting control commands to the home automa- 55
`tion system. However, such systems have a predeter(cid:173)
`mined limited number of how many devices and user
`interfaces the system can support. Generally speaking,
`in order to expand such systems, a second identical
`controller is required with its own programming for 60
`controlling its own connected devices and user inter(cid:173)
`faces. Although such an approach may be cost effective
`for