VWGoA - Ex. 1003
`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`

`
`4.,Buz<:&<oz<xwsoezoo:88mo._«..__~~__nm._mz_wH.558E25mB8E.5&5:wmpmszooF3..zmmmom2:388%
`
`.mptmmomzmmo3<z<»E=H._mmso:25:9.mo8803;m2.5assanapgwxmwmmm:5RO00O00Ebimm
`a.m:-._z<:8.S_000000SSmzuozémeSamoa.8—.OEU.
`mmoma-355:883U
`000000Hose.
`
`
`zesmzszR25%zmpmfiEmsomwMano:E<:mmmzoczm
`
`
`
`
`
`
`
`58
`
`mo§m;__m825ddéé3:28N.5%.z2:EN§83.2H.2uz.25._n_SEmmR3NzH._Em3.
`%omzflmaam.38<.EE_~_omm_8E
`
`
`1N.mm3oEz88ES_z_mzfizm
`
`zommmmEgo:Hose.E32II.1Beam8§Ez_N.‘o8xmosmz3.
`e_<o@n._xm%mwooyaddsi3~_5Sm8.‘
`wawnownmxmxfimm
`
`wwWm55mm2
`
`mam.55
`
`mzoE8_o_=
`
`
`3.,8EB<z_z~E6Ecma.uaEEE_S5«E20:
`
`
`
`225%.maps:WmzmxmwéM2959>5%amoEE;__~_$_m_m
`5.$82>8_Es5EaE5.2.62
`
`2
`
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 2 of 45
`
`5,086,385
`
`FIG. 2
`
`2 POWER WIRES
`
`
`
`SILENT ——
`
`
`-I 2 DATA WIRES
` ELECTRONIC
`
`
`
`SECURITY
`
`INTERFACE
`
`24
`
`Z—8O
`
`36
`
`
`
`
`MICROCOMPUTER
`
`
`
` HOME AUTOMATION
`SYSTEM CENTRAL PROCESSOR 810)
`AND SERIAL INTERFACE (340
`
`3
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 3 of 45
`
`5,086,385
`
`THE ULTIMATE"
`
`HA1/0/WWM
`
`
`TLUG/W//63;Ll/0005 T
`
`1
`%
`%%%% L%/NF0/PW70//&
`
`
`[W190//#[Nl74l%C0A//7?0l
`C0/MW/[//6‘[ /H70/?[5
`%
`
`%%-5)$”/W 6Vh’f76UflA/70/{j %
`
`l.
`
`
`
`
`
`FIG. 3A
`
`AUDIO / V|DEO
`
`I[£H75/ON
`all//fl/1%/7/?[5[73
`COHPACT0/5€J%%%
`D/5/‘A’/.91//'[Nl/D/0
`Al/0/0 % 60/W015
`SKS‘lZ’ll0fTJ%L%
`
`
`
`
`
`FIG. 3B
`
`4
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 4 of 45
`
`5,086,385
`
`VCR
`
`— PW
`
`
`
`%
`
`
`5I'0P
`
`
`FA5f,f0/9171/B0
` fiflfl/V0
`SW-lIOI70N
`17 ,
`l7P[[Z[/FRAAIEAIW/LT
`TVMSC//IDUU//6
`
`%FIc. so
`
`on SELECTION
`
`,
`
`,
`
`
`,,6‘A:?l//I/AV,z9l//BA/IA
`P/€71/:4’f5,:4T If/LIX///:9/flab’
`M46W[A75[l[Cl70/I5, ,
`,,B[£77f0VF/£f,,PA5f0:?A£[
` 8,4’/4I$’0[//191/:5’67V,6‘0A’C‘[.’?/'05
` 00 6‘0/W015,
`
`,
`
`FIG. 3D
`
`5
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 5 of 45
`
`5,086,385
`
`DISTRIBUTED AUDIO
`
`
`
`/7P0!/C01/PAN 0/56‘
`
`j/7?0l(A’[6'[/Vffi’
`
`
`
`
`
`V1 %%/7P0ll7ZZ[W5/0//
` %0/57/F/H/IZ'0 AJI/Z?/0 0/T %
`
`%
`
`%
`
`
`
`
`
`
`
`FIG. 3E
`
`DISTRIBUTED AUDIO:
`ENTRY LEVEL
`
`6
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 6 of 45
`
`5,086,385
`
`SECURITY MANAGEMENT
`
`UPPIIP [Ml
`
`TS6:?0(/WZFVFZTTT
`/Z’0/l7_T000fi7...0Al/[/?AT,S
`
`>A
`
`‘
`
`T
`,.
`
` ST
`
`4
`
`
`
` SIC‘!/I?/l7'£V[l/7106‘ -
`Tr?!-[A’A:9l[Bl0Wf/?5
`
`V‘
`
`4
`
`
`
`ZONE KEY
`
`0
`ac
`
`U Dgzgled
`U Open
`
`D Disabled
`
`0 Enabled
`
`
`SYSTEM
`STATUS:
`
`
`READY
`TO ARM
`
`
`
`
`Zone #: _1_4
`Name: Llvmg room window right
`
`Status: Enabled
`
`7
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 7 of 45
`
`5,086,385’
`
`ZONE KEY
`
`o
`&
`D oféiréned
`U Open
`D Disabled
`
`1:: Enabled
`
`SYSTEM
`
`STATUS:
`
`READY
`TO ARM
`
`_
`_
`Zone #:_1_4
`room window nght
`Name: Lnvm
`Status: Disc led
`‘
`
`8
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 8 of 45
`
`5,086,385
`
`Entry Level
`
`ZONE KEY
`
`0 en 8:
`El Digobled
`D Open
`El Disabled
`
`:3 Enabled
`
`SYSTEM 0
`STATUS:
`
`‘
`
`: 14
`
`Nome:#Livin
`
`room window right
`
`Status: Disc led
`
`srcurrrr wrrrr LOG
`
`2232
`2232
`
`EGll0lllK3 OF 1.00
`02-03-1988
`h1rusion'nzone32Solrr_riunvirrdoeeostfront
`02-03-1988
`hlrusion ii zone 32 Solorirm Mow cost front
`htnrsion ‘n zone 23:
`ltilclren door right
`02-02-1988
`232836
`htrusion in zone 2 Rear foyer garage door
`02-02-1988
`23:22:01
`htrusion ‘n zone 1: Rent foyer door
`02-02-1988
`23:23:11
`06:11:53
`hlrusion in zone 61: PE master bedroom door
`02-10-1988
`hlrusion '11 zone 77: Solarium door right
`02-20-1988
`01:25:12
`irlrusion ‘n zone 32: Solarium rindov east front
`03-01-1988
`1319:
`hlrusion if zone 32 Solwium window east front
`03-04-1988 17:48:
`hlrusionirzone32SoloriumvindoIeostfront
`03-01-19881803:
`htmion if zone 32 Solarium Iindou end front
`03-04-1988 21:13:
`htrusion ‘n zone 32 Solarium vindol east front
`03-04-1988 2121:
`
`(IF
`
`6254,9106
`
`FIG. 3L
`
`9
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 9 of 45
`
`5,086,385
`
`ucnnnc MOODS
`
`
`
` E4/F17% 110,?///N6
`
`%%%%/{0AW4l%0AY *’
`&l/0/Pl//4l%[V[/////6‘
`
`1k%0AY%PAl?7Y%%%
`%
`
`{VIN/A’€LPA:?77
`]/P01/A//l7€A%fV[N/N6% %
`% .lV/0.}/I.L/6!/73%%%L..
`
`FIG. 3M
`
`INFORMATION
`
`%%5P02?l3.560fi[5%L
`% K[NN[flY%%CONC[/Fff/All
`— M/(ff//l[0X%0P[fi’A.{.lf0l/SE
`
` 1.
`
`
`
`
`IVFAT//I/F %
`
`
`
`FIG. 3N
`
`10
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 10 of 45
`
`5,086,385
`
`IRo—3 TmccER
`
`300
`
`JUMP TO INTERRUPT
`SERVER ROUTINE
`
`302
`
`ASK SERIAL CARD
`WHICH SERIAL LINE
`GENERATED INTERRUPT
`
`
`
`PULL BYTE FROM
`
`FRO”
`POLL
`
`LOOP
`
`400
`
`ON # OF I.S. EVENT
`ON TOP OF QUEUE
`
`IS
`
`1
`
`IS
`
`2
`
`IS
`
`4
`
`IS
`
`5...
`
`402
`
`IS. 3: FLASH QUIT
`
`TOUCHBOX
`
`
`
`
`TOUCHSCREEN
`DATA PENDING
`?
`
`YES
`
`408
`
`INSERT NEw Ls.EvENT
`n SECONDS LATER
`
`TOP
`
`POLL
`
`LOOP
`
`FIG. 40
`
`APPROPRIATE SERIAL
`LINE'S RX REGISTER
`
`
`
`
`
`
`
`
`PLACE BYTE IN
`APPROPRIATE SERIAL
`QUEUE
`
`
`
`
`
`
`
`INCREMENT QUEUE
`PonnER.
`IF QUEUE
`PowTER > QUEUE aza
`THEN MAKE QUEUE
`PoINTER wRAP AROUND
`
`
`
`
`
`RETURN
`
`TO NORMAL
`
`
`
`PROGRAM
`
`
`
`
`
`FIG- 4b
`
`11
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 11 of 45
`
`5,086,385
`
`
`504
`GOOD DATA
`
`506
`
`
`
`NEW sEC/
`SEC/FIRE I
`DATA
`.
`FIRE 1 DATA
`INTERPRETER
`._,
`
`
`
`
`
`
`
`
`FIRE 2 DATA
`
`500
`
`TOP
`POLL
`LOOP
`
`SERIAL
`QUEUE 1
`SERIAL
`Hlllllllllllllllll
`UNE 1
`(SECURITY/FIRE 1)
`
`SERIAL
`
`SERIAL
`
`UNE 2
`(SECURITY/FIRE 2)
`
`OUEUE 2 NEW SEC/
`
`
`
` INTERNAL
`SCHEDULED
`
`
`
`DIAGNOSTIC
`ROUTTNES
`
`512
`
`INTERNAL
`SCHEDULED
`
`IIIIIIIIIIIIIIIIIII
`
`EVENT QUEUE
`
`513
`
`SERIAL
`
`UNE 3
`(I.O. CONTROLLER)
`
`SERIAL
`
`LINE 4
`
`(TOUCHSCREEN 1)
`
`
`TASK 4:
`TOUCHSCREEN 1
`
`FIG. 50
`
`12
`
`12
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 12 of 45
`
`5,086,385
`
`FIG. 5b
`
`ZSSLSSEF
`
`LOOP
`
`SERML
`QUEUE 5
`mmmmmm
`
`534
`
`
`TOUCHSCREEN 2
`
`YES
`
`SERML
`UNE 5
`
`536
`
`TAsK 5:
`TOUCHSCREEN 2
`
`
`
`(TOUCHSCREEN 2)
`
`UNCHON SWHCH 1
`FUNCHON SWHCH 1
`
`54°
`
`TASK 5:
`
`
`
`
`
`SERML
`QUEUE 5
`
`sERu¢
`
`ommmmu
`“NE 6
`(FUNCHON swncH 1)
`
`
`
`544
`
`TAsK 7:
`.
`FUNCHON swncH 2
`
`SERML
`
`%:EUEm7
`SERML
`'“”“”
`UNE 7
`(FUNCHON swoon 2)
`
`so
`
`TELEPHONE
`INTERFACE
`
`
`
`
`TOUCHTONE
`’ECOGNEED?
`
`TASK 9:
`
`DECODE
`TOUCHTONES
`
`
`
`
`13
`
`13
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 13 of 45
`
`5,086,385
`
`524
`
`FIG. 5c
`
`555
`
`PHONE
`CALL ACTIVE?
`
`N
`
`
`
`
`CHECK
`RECOGNITION
`ON BOARD o
`
`
`
`570
`
`N
`
`RECPCII-I(EhCI:I'IIION
`
`
`
`BOARD
`
`572
`
`CHECK
`
`RECOGNWON
`
`N
`
`Egrfiflio
`
`582
`
`586
`
`576
`
`CHECK
`
`RECOGNITION
`
`ON BOARD 2
`
`
`
`573
`
`EMPLATE
`ETURNEIII’
`
`Y
`
`N
`
`558
`
`TOUCHSCREEN 1
`
`
`
`SHOW RECOGNITION
`SCORE
`
`584
`SET SIMULATED TOUCH
`CO—ORDINATES TO
`MIDDLE or SCREEN
`
`
`
`MASTER
`TOUCHSCREEN
`IMMEDIATE
`RESPONSE
`
`
`
`
`
`
`
`14
`
`14
`
`

`
`15
`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 14 of 45
`
`5,086,385
`
`‘
`FIG. 60
`
`500
`
`TOP
`POLUNG
`
`LOOP
`
`YES
`
`
`
`600
`
`528
`
`
`
`TOUCHSCREEN 1
`
`
`
`NO
`
`IS DATA
`VALID?
`
`YES
`
`602
`
`
`
`
`
`TOUCHPOINT?
`
`SUFFICIENT
`
`604
`
`YES
`
`IF TOUCHPO|NT>n PIXELS
`FROM PRIOR TOUCH, THEN
`
`DISPLAY NEW CURSOR
`
`606
`
`ON STATE or TASK 4, so To...
`
`608
`
`612
`
`...OTHER TOUCHSCREEN
`
`DORMANT
`SCREEN
`
`MENUS
`610
`
`15
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 15 of 45 I
`
`5,086,385
`
`FIG. 6b
`
`610
`
`618
`
`CHECKTOUCH
`
`620
`
`
`
`
`
`
`
`TOUCHSCREEN DATA
`I.S. EVENT
`
`REMOVE 'REI'URN
`TO DORMANT'
`
`624
`
`ON BOX TOUCHED, GO TO...
`
`...OTHER TOUCHSCREEN
`MENUS ACCESSIBLE
`FROM THE MNN MENU
`
`626
`
`|TO
`
`DORMANT
`
`528
`
`
`
`
`
`
`
`
`LOAD A/V MENU
`DATA. SET STATE OF
`TASK 4 TO A/V MENU
`
`
`
`16
`
`
`LOAD LIGHTING MOOD
`MENU DATA. SET
`STATE OF TASK 4
`TO LIGHTING MOOD
`
`
`
`16
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 16 of 45
`
`5,086,385
`
`HG‘ 6°
`
`632
`
`MOODS MENU
`
`618
`
`CHECK TOUCH
`
`TOP
`POLLING
`
`LOOP
`
`5°“
`
`YES
`
`620
`
`
`
`
`TOUCHSCREEN DATA
`
`
`NO
`
`534
`
`ON BOX TOUCHED,GO Tom
`
`.636
`
`
`
`DEVICE DRIVER
`
`SET LIGHTING
`MOOD (n): CALL
`
`640
`
`BLANK LFF BOX
`
`500
`
`TOP
`
`POLUNG
`
`LOOP
`
`17
`
`17
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 17 of 45
`
`5,086,385
`
`7oo ,
`
`710
`
`FIG. 70
`
`50°
`
`.
`NEW BYTE IN
`M-T-QUEUE
`
`ON V—STATE
`Go To...
`
`~
`
`TOP
`POLLING
`LOOP
`
`‘
`
`712
`
`715
`716
`714
`
`
`
`N
`°"‘L°”WE
`Y
`UPPER HALF
`
`X—TOUCH
`
`CO—OR
`
`SYNC-
`V—STATE o
`
`BUS->1ST
`BYTE?
`
`
`
`
`
`MJIDMA
`AMML?
`
`
`
`
`
`MORE
`MJJMUA
` V—SUUE
`
`
`
`MORE
`MJIDAEA V-SUWE
`
`
`
`
`
`
`Y—TOUCH
`
`
`CALCULATE ‘
`
` Y—TOUCH
`
`
`
`
`CALCULATE
`LOWER HALF
`
`
`co_-0R.:
`
`
`RESET
`
`L
`
`MI.
`
`RESPONSE
`
`IMMEDMJE
`
`18
`
`18
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 18 of 45
`
`5,086,385
`
`FIG. 7b
`
`752
`
`IMMEDIATE
`RESPONSE
`
`
`
`
`CONVERT TOUCHSCREEN
`COORDINATES TO
`PIXEL SOORDINATES
`
`
`
`NEUTRAL STATE
`
`764
`
`500
`
`
`
`PAUSE 0.I.
`SECONDS
`
`
`
`
`
`768
`
`N
`
`ERASE CURSOR
`
`770
`
`TURN ON SPEAKER
`ACCORDING TO
`
`ACTIVE TOUCHSCREEN
`
`>7 PMELS FROM
`LAST TOUCH?
`
`
`
`ERASE PRIOR CURSOR;
`DRAW NEW CURSOR;
`STORE CURRENT TOUCH
`
`COORDINATES; PASSWORD
`
`
`
`
`SCREEN
`
`760
`
`SET TOUCH FLAG
`
`752
`
`M:L TASK
`snuz DECODER
`
`
`
` VAIJD
`ASSWORD?
`
`
`
`784
`
`Y
`
`SPEAK GREE"”°
`
`786
`
`
`
`INHUMJZE
`MNN MENU
`
`
`STATE
`
`19
`
`
`
`
`
`19
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 19 of 45
`
`5,086,385
`
`
`
`
`
`792
`
`LOAD SPEECH
`RECOG. VOCAB.,
`IF APPUCABLE
`
`
`
`
`
`723
`
`
`
` PRTOR
`SUBMENU
`
`(STATE)
`
`FROM l.S.|.S;
`INSERT NEW
`'SCREEN TIMEOUT’
`|.S.l.S. EVENT;
`
`QUFT
`
` ,,
`
`
`
`725
`
`EXCLUDE ACTION
`
`727
`
`733
`
`90
`T°E§%§‘
`N
`
`BLANK ”'G”‘
`LIGHTED BOX
`
`REMOVE "SCREEN TIMEOUT"
`EVENT FROM |.S.l.S;
`
`INSERT NEw "SCREEN
`
`TIMEOUT’
`|.S.|.S. EVENT
`
`735
`500
`731
`INITIALJZE NEW
`SUB—MENU
`
`CLEAN °”T
`TOUCH BUFFER
`
`TOP
`POLUNG
`LOOP
`
`788 500 790
`
`
`
`LOAD SCREEN;
`TOP
`INDICATE STATUS
`Pou_|N(;
`
`
`OF MENU OPTTONS.
`Loop
`
`IF NECESSARY
`794
`
`
`
`
`SET STATE
`To CURRENT
`CONTEXTTJAL STATE
`
`ENTRY POINT
`
`’
`
`799
`
`CALL
`onspw CURSOR
`
`
`
`711
`
`N
`
`B0
`TOUCHED"
`Y
`
`.
`FIG. 7d
`
`79
`
`6
`
`
` ENTRY
`POINT FROM
`
`
`
`POLLING
`LOOP
`
`798
`
`CALL
`CHECKTOUCH
`
`
`
`713
`
`20
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 20 of 45
`
`5,086,385
`
`
`
`MORE
`M.T. DATA
`
`AVAIL?
`
`
`
`
`
`MORE
`M.T. DATA
`AVAIL?
`
`ERASE
`CURSOR
`
`
`
`
`
`
`N
`
`
`ZONE
`NOT SHUNTED
`. D ENABLE/WSABLE
`TOUCHBOX DISPLAYS
`"DISABLE
`zogqy-;"
`
`SHUNTED AND
`ENABLE/DISABLE
`TOUCHBOX DISPLAYS
`DISABLE
`Z09NE"
`
`
`
`21
`
`
`
`REPLACE
`REPLACE
`'D|SABLE ZONE‘
`"ENABLE ZONE"
`
`
`TOUCHBOX WITH
`TOUCHBOX WITH
`
`'ENABLE ZONE'
`'DlSABLE ZONE"
`
`
`
`
`
`21
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 21 of 45
`
`5,086,385
`
`
`
`sToRE FLOOR #;
`LOAD FLOOR
`PLAN SCREEN;
`SPEAK RESPONSE
`PHRASE;
`DISPLAY ‘PLEASE
`wAn" MT-;3sAgE
`
`420
`ON SUB_SWE
`so To
`
`SEND 'zoNE
`MAP REQUEST‘
`To S/F
`INTERFACE:
`SET_S/P TASK
`T0
`ZONE MAP
`REQUEST STATE;
`INSERT SEc.
`RESPONSE
`EXPECTED’
`|.S.l.S. EVENT
`
`416
`
`799
`
`SET M.T.
`TASK STATE
`
`CALL
`
`DISPLAY CURSOR
`
`424
`
`425
`
`ON RESULT
`so To...
`
`NO RESPONSE
`
`432
`
`UNEXPECTED
`RESPONSE
`
`
`
`430
`
`POEPNG
`LOOP
`
`7g
`
`
`
`
`
`
`
`
`SPEAK ‘No
`RESPoNSE' PHRASE
`
`SPEAK 'UNEXPECTED
`RESPONSE‘ PHRASE
`
`DECODE SECURITY ARMED,
`
`READY CONDITIONS
`
`434
`
`ERASE "PLEASE WAIT‘
`MESSAGE
`
`436
`
`22
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 22 of 45
`
`5,086,385
`
`303
`
`_
`
`500
`309
`
`POLUNG
`LOOP
`
`' DECODE
`ZONES’
`STATUS
`
`311
`
`438
`
`sEr FADE COLOR
`SUB-STATE
`TO BLACK;
`DECODER
`LOAD FLOOR PLAN
`
`
`SCREEN ACCORDING
`
`TO FLOOR f;
`SET FADE COLOR
`
`
`
`
`
`
`TO NORMAL
`
`
`313
`
`MARK ZONES ON SCREEN;
`DISPLAY STATUS OF OPEN
`OR SHUNTED ZONES
`
`
`
`
`
`
`
`SHOW ARMED OR
`READY STATUS
`ON SCREEN
`
`321
`
`‘
`
`PRINT "NO
`ZONE SEI£CTED'
`
`323
`
`INSERT "SCREEN
`TIMEOUT"
`|.S.I.S. EVENT;
`TOUCHFLAG = 0
`
`ANALYZE
`
`“
`
`325
`
`
`
`
`PREVIOUS
`ZONE
`
`
`
`
`MARK NEW ZONE:
`CAI.L PRINT ZONE STATUS
`
`
`
`CONTINUED
`NEXT PAGE
`AT (9
`
`
`
`
`
`23
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 23 of 45
`
`5,086,385
`
`
`
`7110
`
`Box
`TOUCHED
`7
`
`Y
`
`454
`
`445
`
`PAUSE 0.1
`SECONDS
`
`452
`
`ON BOX TOUCHED
`GO TO...
`
`QUIT
`
`BACK
`
`ARM/DISARM
`SYSTEM
`
`
`
`
`POLUNG
`LOOP
`
`A
`
`455
`
`INHWJZE
`SEC.
`
`
`MANAGEMENT
`SUB-MENU
`
`REMOVE 'scREEN
`TIMEOUT’
`l.S.|.S.
`EVENT;
`TNSERT Ngw
`'scREEN TIMEOUT‘
`
`
`
`
`
`A 455
`
`450
`
`455
`
`
`
`
`
`REDISPLAY
`SECURITY
`FLOOR PLANS
`
`
`
`ENABLE/DISABLE ZONE
`
`Y
`
`N
`
`
`
`464
`
`SET FLOOR TO HIGHEST
`ALTERNATE FLOOR
`
`455
`
`SET FLOOR TO LOWEST
`ALTERNATE FLOOR
`
`HIGHEST
`ALTERNATE
`FLOOR
`
`
`
`24
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 24 of 45
`
`5,086,385
`
`
`
`
`
`ARM/DISARM
`SYSTEM
`SUB—STATE
`
`
`
`458
`
`500
`
`TOP
`POLLING
`LOOP
`
`
`
`REMOVE 'SCREEN
`TIMEOUT’
`|.S.|.S.
`EVENT;
`TOUCHFUG = o
`
`478
`
`
`
`SPEAK TNTER
`P’;3H5R“g‘§3'
`
`480
`
`CALL GET
`PASSWORD
`
`
`
`REDISPLAY
`PASSWORD
`
`RETURNED
`sec. FLOOR
`
`
`'2
`PLANS
`
`
`466
`
`484
`
`490
`
`455
`
`SEND DISARM MESSAGE dc
`PASSWORD TO S/F INTERFACE
`
`SEND ARM MESSAGE &
`PASSWORD TO S/F wrzmcg
`
`492
`
`SET S/F STATE T0
`'D|SARM SYSTEM‘
`
`494
`
`488
`
`SET S/F STATE TO
`‘ARM SYSTEM"
`
`411
`
`
`
`SPEAK 'PLEASE
`WAIT PHRASE
`
`DISPLAY 'PLEASE
`WAIT’ MESSAGE
`
`SET
`SUB-STATE
`
`495
`
`498
`
`CALL
`
`DISPLAY CURSOR
`
`
`
`
`SET "SEC.
`RESPONSE'
`
`EXPECTED
`
`
`
`|.S.|.S. EVENT
`
` FROM
`
`SUB-STATE
`DECODER
`
`
`
`
`25
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 25 of 45
`
`5,086,385
`
`489
`
`FIG. 7k
`
`NO BAD
`PASSWORD
`MESSAGE
`DURING DELAY
`
` NO
`RESPONSE PASSWORD ARMED/
`
`
`
`SEND ZONE MAP
`REQUEST TO S/F
`INTERFACE;
`PASSWORD’
`
`l.S.|.S. EVENT
`ser S/F smz
`TO "ZONE MAP
`
`REQUESV;
`
`SET SUB-STATE
`,§EE§PO5NE§E'
`
`
`
`EXPECTED"
`LSLS.EVENT
`
`
`481
`
`SET SUB—STATE
`
`500
`
`POLLING
`LOOP
`
`
`
`
`
`SPEAK "NO
`RESPONSE"
`PHRASE
`
` ZONE MAP RETURNED
`457
`DECODE ARMED/
`DISARMED smus
`
`
`
`455
`
`Y
`
`461
`
`SPEAK "SYSTEM
`DlSARMED' PHRASE
`
`
`
`
`
`
`26
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 26 of 45
`
`5,086,385
`
`457
`
`FIG} 7 I
`
`% ‘59
`
`
`REMOVE "SCREEN TIMEOUT‘
`l.S.I.S. EVENT;
`TOUCHFLAG = O
`
`
`455
`
`
`
`Y
`
`
`
`'
`
`447
`
`SEND SHUNT ZONE MESSAGE
`TO S/F INTERFACE
`
`449
`
`
`
`SET 'SEC. RESPONSE
`EXPECTED'
`|.S.|.S. B/ENT;
`STORE ZONE NUMBER
`FOR LS.|.S. EVENT
`
`
`
`
`
`"53
`
`
`SPEAK ‘ENTER
`PASSWORD’
`PHRASE
`
`480
`
`CALL GET
`PASSWORD
`
`451
`
`455
`
`Y
`
`NULL
`PASSWORD
`'2
`
`477
`
`N
`
`SEND SHUNT ZONE COMMAND
`& PASSWORD TO S/F INTERFACE;
`
`449
`
`
`
`SET "SEC. RESPONSE
`EXPECTED’
`I.S.|.S. EVENT:
`
`STORE ZONE NUMBER
`
`FOR |.S.|.S. EVENT
`
`
`
`SE S/F STATE TO
`"SHUNT ZONE"
`
`445
`
`443
`
`SPEAK 'PLEASE WAIT’ PHRASE
`DISPLAY 'PLEASE WAIT‘ MESSAGE
`
`441
`
`SET SUB—STATE
`
`500
`
`Pfggfic
`
`27
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 27 of 45
`
`5,086,385
`
`
`
`439
`
`SHUNT
`ZONE SUB-
`
`437
`
`GOOD
`
`487
`
`NO
`
`RESPONSE
`
`BAD
`
`pAsgwoRD
`
`FIG 7m
`
`Ugééfigflgg
`
`SET ‘WAN FOR
`BAD PASSWORD"
`|.S.|.S. EVENT
`
`SPEAK "NO
`RESPONSE‘
`PHRASE
`
`REMOVE "WAIT
`FOR BAD
`PASSWORD"
`|.S.l.S. EVENT
`
`433
`
`479
`
`SET SUB—STATE
`
`500
`
`POLUNG
`LOOP
`
`427
`
`NO BAD PASSWORD
`MESSAGE DURING DELAY
`
`sEr S/F STATE T0
`‘ZONE MAP REQUEST;
`SEND ZONE MAP REQUEST
`
`TO S/F INTERFACE
`
`
`
`425
`
`SET SUB-STATE
`
`500
`
`POLUNG
`LOOP
`
`28
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 28 of 45
`
`5,086,385
`
`FIG. 7n
`
`409
`
`SEC. SYSTEM
`
`OT READY BEFOR
`SHUNHNG?
`
`
`
`
`WAS
`
`
`
`
`NOT READY'
`PHRASE
`
`
`411
`
`
`
`
`WAS
`SEC. SYSTEM
`
`300
`ALREADY ARMED
`BEFORE
`
`SHUNTING
`')
`
`
`
`
`
`
`
`SPEAK 'NOW
`D!SARMED' PHRASE
`
`
`
`ERASE ZONE MARKER:
`BLANK HIGH-UGHTED
`BOX
`
`29
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 29 of 45
`
`5,086,385
`
`312
`
`REDORW
`
`FIG. 70
`
`314
`
`TURN OFF VOICE
`REsPoNsE SPEAKERS
`
`315
`
`Y
`
`315
`
`HANG UP
`PHONE
`
`
`
`OUTGOING
`PHONE CALL
`
`
`'
`
`320
`
`Y
`
`
`
`VIDEO
`MONITORING
`ACTIVE
`?
`
` TURN OFF
`VIDEO MONITORING
`
`322
`
`324
`
`LOAD DORMANT
`SCREEN
`
`328
`
`PRINT "PHONE
`CALL’ MESSAGE
`
`
`
`FIG. 7p
`
`332
`
`334
`
`
`
`
`REsEr M.T. V—STATE
`
`STORE PREVIOUS TOUCH
`COORDINATES TO NEW
`TOUCH COORDINATES
`
`
`
`
`
`M.T.
`lMMED|ATE
`RESPONSE
`
`ROUHNES
`
`
`
`30
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 30 of 45
`
`5,086,385
`
`800
`
`NEW BYTE IN
`S/F QUEUE
`
`ow v—sTATE (1)
`Go To,__
`
`802
`
`L
`
`Top
`poLUNQ
`LOOP
`
`aoa
`
`
`
`304
`
`V-STATE I
`
`15-I SYNC
`BYTE
`
`
`
`
`ADD COMPLETE
`SEC. MESSAGE’
`EVENT To I.s.I.s.
`
`
`
`
`
`
`
`
`
`5/}: DATA
`AvAIL
`«_,
`
`
`
` MORE
`S/F DATA
`AVAIL
`
`?
`7
`
` MORE
`S/F DATA
`AVAIL
`
`
`
`
`
`S/F DATA
` V-STATE -4
`AVAIL
`?
` V- STATE =
`V-STATE 5
`
`
`
` S/F DATA
`
`31
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 31 of 45
`
`5,086,385
`
`“STATE 5
`
`FIG. 8b
`
`REMOVE 'COMPL8ETE
`SECURITY MESSAGE
`FROM I.S.I.S.
`
`
`
`854
`V-STATE=O
`
`500
`
`s
`
`PQTL([)_[PN(;
`LOOP
`
`856
`
`IMMEDIATE
`RESPONSE
`
`N
`
`858
`
`860
`
`ACKNOWLEDGE
`MESSAGE TO
`S/F INTERFACE
`
`ON STATE
`GO TO...
`
`M.T. TASK
`
`
`
`FIRE ALARM SET "ALL HOUSE
`
`
`
`
`
`UGHTS' LIGHTING
`MOOD
`
`PASSWORD
`REJECTED
`
`575
`
`PASSWORD
`
`REJECTED
`
`aao
`
`M.T. TASK
`DISARM SEC. SYSTEM
`SUB—STATE
`
`
`
`RESULT=
`
`ALREADY
`
`DISARMED
`
`872
`
`RESULT=
`
`coon
`
`OTHER
`ONTEXTU
`SW55
`
`32
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 32 of 45
`
`5,086,385
`
`
`
`
`
`ON STATE
`GO TO...
`SHUNT ZONE
`STATE
`
`
`
`FIG. 8c
`
`582
`on COMMAND
`so To...
`
`ALL OTHER COMMANDS
`
`375
`
`890
`M.T. TASK
`SHUNT ZONE
`3”B‘5TATE
`
`
`
`RESULT=
`
`GOOD
`
`88
`
`RESULT=
`
`PASSWORD
`REJECTED
`
`ACKNOWLEDGE
`
`REJECTED
`
`PASSWORD
`
`885
`
`ZONE MAP
`REQUEST STATE
`
`892
`
`ON COMMAND
`so To...
`
`ACKNOWLEDGE
`
`REJECTED PASSWORD
`
`896
`
`878
`
`393
`
`RETURN TO ROUTINE
`REQUESTING A ZONE
`MAP
`
`
`RESULT=
`PASSWORD
`
`
`
`REJECTED
`
`ARM
`SYSTEM STATE
`
`899
`ON COMMAND
`GO TO...
`
`RESULT=
`GOOD
`
`ACKNOWLEDGE
`
`ALREADY
`ARMED
`
`
`NOT
`READY
`
`PASSWORD
`REJECTED
`
`
`
`
`
`
`
`RESULT=
`ALREADY
`
`
`RE%JTLT
`
`RESULT=
`
`coon
`
`897
`
`RESULT=
`
`REJECTED
`
`PASSWORD
`
`ARMED
`
`READY
`
`891
`
`878
`
`M.T. TASK
`ARM/DISARM SEC.
`SYSTEM SUB—STATE
`
`395
`
`33
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 33 of 45
`
`5,086,385
`
`900
`
`902
`
`Ffiggcm”
`
`DISPLAY
`
`SCHEDUUNG SCREEN
`
`AND OPTIONS
`
`905
`
`DISPLAY GRAPHICS
`
`FOR START DATE
`AND ACCEPT INPUT
`
`910
`
`DISPLAY GRAPHICS
`
`FOR START TIME
`AND ACCEPT INPUT
`
`914
`
`DISPLAY GRAPHICS
`
`FOR STOP DATE
`
`AND ACCEPT INPUT
`
` FIG. 9
`
`
`
`AND ACCEPT INPUT
`
`DISPIAY GRAPHICS
`FOR STOP TIME
`
`920
`
`STORE SCHEDULE &
`RETURN TO
`MAIN PROGRAM
`
`34
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 34 of 45
`
`5,086,385
`
`
`
`
`
`._.H.................................m.m.
`
`3D
`
`..0:
`
`35
`
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 35 of 45
`
`5,086,385
`
`-Eflflil
`
` %1314151%6%W819%%2oL21..___22.23%24%%2s%%2632728293031
`
`FIG1ocf6ff7jfj8f[[éfi¢f1I1[fI1é
`
`FlG.1OE
`
`FIG10F
`
`C!
`U)
`
`L:
`.2
`
`P (
`
`D E :
`
`3
`|__
`
`O2 2
`
`(/3
`
`36
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 36 of 45
`
`5,086,385
`
`700
`
`701
`
`704
`
`
`
`IF A BOX WAS
`TO ACTIVE
`PREVIOUSLY LIT,
`MENU
`THEN BLANK IT
`
`RBURN
`
`
`
`
`
`
`OUCHPOINT
`
`INSIDE MENU'S
`TOUCHBOXES?
`
`705
`
`
`
`LIGHT UP
`
`APPROPRIATE BOX
`
`
`
`DORMANT
`
`SCREEN
`
`POLLING
`
`TOUCHSCREEN DATA
`
`
`
`SPEAK GREETING
`LOAD MAIN MENU
`REMOVE PRIQR
`GRAPHICS AND DATA
`‘RETURN To DORMAN1"
`SET STATE
`LS. EVENT
`TO MAIN MENU
`LOAD DORMANT
`SET UP "RETURN TO
`SCREEN GRAPHICS
`DORMANT I.S. EVENT
`& DATA.
`T0 OCCUR IN
`SET STATE T0
`
` DORMANT SCREEN n SECONDS
`
`
`REMOVE PRIOR
`"RETURN TO DORM
`LS. EVENT
`SET NEW ‘RETURN TO
`DORMANT.
`I.S. EVENT
`LOAD MAIN MENU
`GRAPHICS & DATA.
`SET TASK 4 STATE
`TO MAIN MENU
`
`
`
`
`500
`
`TOP
`
`37
`
`

`
`U S Patent
`
`Feb. 4, 1992
`
`Sheet 37 of 45
`
`5,086,385
`
`
`
`...........fistt~§§§::§§:t:.
`
`..........m.4.
`
`...I..‘..§l.JD.-E_.- .-‘.
`
`PRESENTATION
`
`I
`
`‘
`
`(
`
`‘
`
`>
`
`
`
`...\_....
`.....,.........
`.....’....
`
`.;_.............
`
`FIG.
`
`1 2A
`
`38
`
`38
`
`

`
` U.S.Patent
`
`Feb. 4, 1992
`
`Sheet 38 of 45
`
`5,086,385
`
`
`
`IG. 12
`
`c
`
`FIG. 12
`
`5
`
`39
`
`

`
`US.‘ Patent
`
`Feb. 4, 1992
`
`Sheet 39 of 45
`
`5,086,385
`
`.
`
`_
`
`..-_.:_.:..'-'_.'-,.'-_..-_.
`
`2"...
`
`
`_ __.__.__.._. _.\I..._ - _.
`
`
`
`
`
`
`
`PRE5E"“"°”
`
`.. .. ..
`
`.. .. _.
`
`
`
`
`
`
`vowus up
`
`40
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 40 of 45
`
`5,086,385
`
`41
`
`41
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 41 of 45
`
`5,086,385
`
`FIG. 130
`
`
`BUNK QUIT BUTTON
`5 TIMES
`
`
`
`
`1306
`
` 1308
`
` NEW
`TOUCHSCREEN
`DATA AVAIL.
`
`‘I310
`
`FIG. 13b
`
`INSERT NEW "SCREEN
`TIMEOUT’
`|.S.I.S. EVENT
`
`500
`
`
`
`
`1312
`
`’
`
`1314
`
`N
`
`Y
`
`1315
`SEND MESSAGE TO S/F
`INTERFACE AGAIN
`
`1315
`
`_
`
`sEc. RESPONSE
`INSERT
`EXPECTED’
`|.S.I.S. EVENT
`
`1320
`
`RESULT:
`No RESPONSE
`
`1322
`
`ON M.T. STATE
`co TO...
`
`
`
`
`SEC.
`RESPONSE
`
`
`
`|.S.|.S.
`EVENT
`
`
`
`
`42
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 42 of 45
`
`5,086,385
`
`1330
`
`
`WAIT
`FOR BAD
`
`
`
`
`PASSWORD
`|.S.I.S.
`
`
`
`1 332
`
`
`
`B/ENT
`
`FIG. 13c
`
`
`
`SET RESULT T0 "N0 BAD
`PASSWORD MESSAGE DURING DELAY
`
`
`SET S/F STATE TO NEUTRAL
`
`1334
`
`
`
`1336
`
`ON M.T. STATE
`
`GO TO...
`
`
`
`ARM/
`DISARM SEC.
`SYSTEM SUB-
`
`STATE ENTRY
`
`POINT.
`
`
`
`
`
`
`FIG. 13d
`
`
`
`1 340
`
`RESET S/F V—STATE
`
`500
`
`FIG. 14
`
`1 402
`
`NEW aw: IN
`S.T. ouaue
`
`STORE SECONDARY
`TOUCHSCREEN ID.
`
`TO ACTIVUSCRN
`
`
`
`
` M.T. TASK
`
`
`VALIDATION
`TOUTINE
`
`
`
`43
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 43 of 45
`
`5,086,385
`
`500
`
`Top
`POLUNG
`LOOP
`
`1510
`
`
`
`1500
`
`1502
`
`NEw DATA BYTE
`IN L0. OUEUE
`
`oN V-STATE
`G0 10...
`
`1505
`
` B
`
`1504
`
`Y
`
`STORE
`COMMAND
`
`1514
`
`STORE 4
`T0 LENGTH
`
`INSERT ‘COMPLETE
`1.0. CONTROU_ER MESSAGE’
`1.s.1.s. EVENT
`
`1515
`
`1518
`MORE
`
`LQ BMW
`
`
`
`OR DH}
`
`HQ 15(]
`
`‘524
`
`1525
`
`REsEr
`V—STATE
`
`REMOVE "COMPLETE 1/0
`CONTROLLER MESSAGE’
`1.s.1.s. EVENT
`
`1512
`
`IMMEDIATE
`RESPONSE
`’OUflNES
`-._
`
`44
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 44 of 45
`
`5,086,385
`
`on couwwo
`
`FIG’ 15b
`
`1528
`
`1530
`
`ACKNOWL-
`EDGEMENT
`(D0
`NOTHING)
`
`500
`
`
`ON—T0—0FF oR 0FF—TO—0N
`TRANSITION REPORT
`
`
`
`1532
`
`DECODE
`
`PORT #
`DECODE PORT #;
`
`DECODE DATA BYTES
`CORRESPONDING T0
`
`COMPARE an MASKS
`‘NWT PORTS
`TO DETERMINE WHICH
`|NPUT(S) CAUSED
`TRANSITION REPORT
`
`
`
`
`
`
`STORE NEW
`BIT MASK
`STORE ow
`an MASK
`
`TOP
`POLUNG
`
`
`
` FO§”E"?"CH
`
`arr MASK
`
`8éFLLTo ON
`
`
`
`BWS
`CHECKED
`7
`
`1538
`
`
`
`
`
`CONUNUED
`NEXT PAGE
`AT ©
`
`
`45
`
`

`
`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 45 of 45
`
`5,086,385
`
`READ
`DIGITAL
`
`
`
`
`
`STATUS
` OMMAND
`IS "DIGITAL
`STATUS
`?
`
`REMOVE 'I.O.' RESPONSE
`EXPECTED’
`I.S.I.S. EVENT
`
`
`
`
`
`
`
`READ
`
`DIGITAL
`INPUTS S.E.
`
`ROUTIN ES
`
`FIG. 15c
`
`FIG. 15d
`
`1562
`
` PORT n+2
`
`46
`
`

`
`1
`
`5,086,385
`
`EXPANDABLE HOME AUTOMATION SYSTEM
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates to computer controlled
`systems for automating a plurality of diverse electri-
`cally controllable subsystems. More particularly,
`the
`present
`invention relates to a microprocessor-based
`electronic control system for use in the automation and
`control of electrical subsystems found in the home envi-
`ronment. Such systems may also be utilized in commer-
`cial applications.
`In the past, sophisticated electronic control over
`complex systems has been limited primarily to industrial
`applications, and occasionally commercial applications.
`Such electronic control systems usually required exten-
`sive and costly equipment, as well as technically trained
`operators. However, as consumer products and systems
`become more and more complex, untrained people in
`home environments have been increasingly desirous of
`obtaining a sophisticated electronic control system for
`enabling an easy to use control over such home prod-
`ucts and systems. Many such products and systems are
`also increasingly being used in commercial environ-
`ments, such as electronic conference rooms, in which it
`is also desirable to provide an easy to use control system
`for use by individuals who are often not skilled in tech-
`nological arts.
`Known home automation systems are generally built
`around a small control box which is connected by
`means of existing household 110 volt AC wiring to one
`or more modules distributed throughout the home. The
`appliances and/or lights to be controlled are in turn
`connected to the modules and may thus be controlled
`from the control console by the homeowner. The main
`advantage of such “power-line carrier” home control
`systems is that they are low in cost and utilize existing
`home wiring. However, such power-line carrier control
`systems can be easily disrupted by outside environmen-
`tal electrical disturbances, such as weather conditions.
`In addition, such systems allow the control of only a
`relatively limited number of types of electrical appli-
`ances, namely,
`lights and small electrical appliances.
`They do not, however, allow for any sophisticated
`programming functions other than perhaps a time on
`and time off feature Thus, power-line carrier control
`systems are of relatively limited utility for home auto-
`mation purposes.
`More sophisticated home automation system designs
`are known, which are generally built around a program-
`mable microprocessor connected to a local bus which
`accepts a limited number of input/output control cards.
`Such systems may allow the connection of one or two
`_user control devices such as a keypad or a touchscreen
`for inputting control commands to the home automa-
`tion system. However, such systems have a predeter-
`mined limited number of how many devices and user
`interfaces the system can support. Generally speaking,
`in order to expand such systems, a second identical
`controller is required with its own programming for
`controlling its own connected devices and user inter-
`faces. Although such an approach may be cost effective
`for small home automation systems, it is too limiting for
`more sophisticated automation tasks or
`for
`larger
`homes.
`The inventive expandable home automation system
`disclosed in this application overcomes such limitations
`and drawbacks of the prior art systems by being de-
`
`l0
`
`15
`
`20
`
`25
`
`30
`
`35
`
`45
`
`50
`
`55
`
`65
`
`2
`signed as a master controller for intelligent subsystems.
`Although it can also control simple devices directly, the
`primary method of control ofthe present invention is by
`means of multiple communication channels which are
`compatible with or convertible to a wide variety of
`standard data communications protocols. Thus,
`the
`system disclosed in this application can be connected to
`virtually any type of electrically controlled device that
`may be presently found in a home or can conceivably be
`connected to either the standard data communication
`buses in existence today, local area networks or future
`home automation data buses such as CEBUS or the
`SMART HOUSE bus. The system may also be con-
`nected to devices to be controlled directly by parallel
`and serial ports.
`With the innovative expansion capabilities of the
`inventive system, simultaneous operation of multiple
`types of user devices can now be achieved. For exam-
`ple, the home automation system described herein may
`be connected to simple keyboards, serial data keypads,
`touchscreens, voice recognition circuitry, hand-held
`remote controls, computer keyboards or telephones. In
`fact, virtually any type of electronic subsystem may be
`connected, by means of an appropriate interface, to the
`present system.
`The present invention is also compatible with com-
`mercially available automation controllers. Thus, for
`example, when a control
`task requires an extensive
`number of inputs and outputs, the system can become
`the “master controller” for a wide variety of commer-
`cial or special purpose automation controllers. Such a
`capability is not available in any other known home
`automation system controller.
`Due to the innovative expansion capabilities dis-
`cussed above,
`the present
`invention, while allowing
`simultaneous operation of multiple types of user devices
`and compatibility with commercial automation control-
`lers, is also compatible with intelligent appliances and
`subsystems and with external information retrieval ser-
`vices.
`Consumer appliances used in the home are increas-
`ingly becoming more intelligent. The appliance manu-
`facturers are increasingly incorporating connections for
`microprocessor-based intelligent remote control. The
`system controller of the present invention embodies a
`multiple data port capability which provides for its
`connection to an unlimited number of such intelligent
`appliances simultaneously. For example, the expandable
`home automation system may be connected to control
`or communicate with intelligent audio/video systems,
`heating/cooling systems, access control systems, secu-
`rity systems, telephone systems, appliances and lighting
`systems.
`Having access to multiple data ports also allows the
`system disclosed in this application to dedicate one or
`more data ports for connection to external information
`services or gateways to information services by means
`of a modem or other type of data connection. That
`allows the instant inventive home automation system to
`become an information provider as well as a controller.
`
`SUMMARY AND OBJECTS OF THE
`INVENTION
`
`In view of the foregoing, it should be apparent that
`there still exists a need in the art for a home automation
`control system which allows for the sophisticated con-
`trol,
`including programming, of virtually any home
`
`47
`
`

`
`5,086,385
`
`3
`subsystem or appliance in which electronic means are
`utilized by the user in a simple to understand and yet
`precise manner to accomplish the desired control or
`monitoring function. It is, therefore, a primary object of
`this invention to provide an expandable home automa-
`tion control system for providing sophisticated control
`functions over complex subsystems found in a home
`which is characterized by intuitive and simple to use
`user interfaces.
`More particularly, it is an object of this invention to
`provide an expandable control system which provides
`for a simple, intuitive and easy to use control over com-
`plex subsystems utilized in commercial buildings.
`Still more particularly, it is an object of this invention
`to provide an expandable home automation control
`system which includes a multiple port, expandable con-
`troller.
`Another object of the present invention is to provide
`an expandable home automation control system in
`which the user utilizes high resolution color graphics
`touchscreens for instructing the system to perform its
`control functions.
`A further object ofthe present invention is to provide
`an expandable home automation control system in
`which voice recognition is utilized by the user to in-
`struct the system to control subsystems present in the
`home.
`
`A further object of the present invention is to provide
`an expandable home automation system in which voice
`recognition may be used in concert with high resolution
`color graphics displays in order to provide the user with
`an easy to use interface for instructing the system to
`perform its control or monitoring functions.
`Still another object of the present
`invention is to
`provide an expandable home automation system which
`incorporates multiple types of user devices which may
`be utilized simultaneously.
`A still further object of the present invention is to
`provide an expandable home automation control system
`which uses dynamic, object-oriented touch or cursor-
`controlled displays for controlling and scheduling ac-
`tions.
`Still more particularly, it is an object of this invention
`to provide an expandable home automation control
`system which integrates tailored information retrieval
`together with communication services.
`invention is to
`Still another object of the present
`provide an expandable home automation control system
`which displays plan views of the home and allows the
`user to create certain moods therefore.
`A still further object of the present invention is to
`provide an expandable home automation control system
`which provides multiple dimensions of interaction and
`control.
`Another object of the present invention is to provide
`an expandable home automation control system which
`utilizes multifunction display monitors to display multi-
`ple types of video imagery.
`A further object of the present invention is to provide
`an expandable home automation control system which
`utilizes an electronic interface to a multi-zone security
`system to thereby allow touch or cursor-control of the
`security system by means of graphics displays.
`Still another object of the present
`invention is to
`provide an expandable home automation control system
`in which spoken messages are utilized as prompts for
`touchscreen use.
`
`4
`Briefly described, these and other objects of the in-
`vention are accomplished in accordance with its appa-
`ratus aspects by providing a home automation control-
`ler which is designed to support multiple numbers and
`multiple different types of data communications with
`external systems. Such a controller is unlimited in its
`means of communications with external systems since it
`is fundamentally compatible with all forms of data com-
`munications. The system controller utilizes a micro-
`processor-based computer, such as an IBM AT type, or
`compatible, with its associated memory and storage
`subsystems. The processor is connected by means of a
`high speed data bus to a plurality of external parallel
`and serialinterfaces, external custom interfaces and
`external network interfaces. The external parallel and
`serial interfaces are connected to various external sys-
`tems, such as home'automation buses like CEBUS or
`SMART HOUSE.
`If necessary, optional protocol
`translators are connected between those external sys-
`tems and the external serial and parallel interfaces.
`The external custom interfaces are connected directly
`to various external systems, while the external network
`interfaces are connected directly to multiple external
`systems. By means of such structure, an 80286-based
`AT compatible microcomputer can be utilized, by
`means of the IBM AT data bus, to control various prod-
`ucts and subsystems within a home or commercial
`building, such as lighting systems, security systems,
`various sensors, multiple external
`terminals, and to
`allow for input of commands by a variety of means such
`as touchscreens, voice recognition, telephones, custom
`switches or any device capable of providing input to a
`computer system.
`The method of the present invention is carried out by
`the use of a Home Environment Automated Real-time
`Transactor (HEART) which is a standardized, modu-
`lar, software program that is configured for each instal-
`lation. Secondary processors
`are utilized, under
`HEART control, to relay information to the central
`80286-based microcomputer or central processor, or to
`translate central processor commands into commands
`their dedicated devices can understand. A star hard-
`ware topology is currently utilized. The secondary
`processors manage the voice recognition and voice
`synthesis subsystems, telephone communication subsys-
`tem