United States Patent (19)
`Launey et al.
`
`HHHHHHHHHH
`USOOSO86385A
`Patent Number:
`5,086,385
`11
`Feb. 4, 1992
`(45) Date of Patent:
`
`(54 EXPANDABLE HOME AUTOMATION
`SYSTEM
`75) Inventors: Reuel O. Launey, Arlington, Va.;
`Peter A. Grendler, Silver Spring,
`Md.; Donald L. Packham, Fort
`Lauderdale, Fla.; James M.
`Battaglia, Kettering; Howard E.
`Levine, Adelphi, both of Md.
`73) Assignee: Custom Command Systems, College
`Park, Md.
`21 Appl. No.: 304,300
`22 Filed:
`Jan. 31, 1989
`I51) Int. Cl............................................... G05B 15/02
`52 U.S. Cl. .................................... 364/188; 364/189;
`340/825.37; 379/102
`58 Field of Search ............... 364/200, 900, 188, 189,
`364/513.5; 379/102, 104, 79; 340/825.37,
`825.69; 219/10.55 B, 506; 319/46, 47,97, 98
`References Cited
`U.S. PATENT DOCUMENTS
`4,503,288 3/1985 Kessler ............................. 79/2 DP
`4,513,189 4/1989 Ueda et al. .........
`... 219/10.55 B
`4,520,576 6/1985 Vander Molen ....................... 34/45
`4,521,645 6/1985 Carroll .................................. 379/98
`4,663,775 5/1987 Olek ...................................... 379/24
`
`(56)
`
`4,665,544 5/1987 Honda et al. ....................... 379/104
`4,728,949 3/1988 Platte et al. .................... 340/825.37
`Primary Examiner-Jerry Smith
`Assistant Examiner-Paul Gordon
`Attorney, Agent, or Firm-Dickstein, Shapiro & Morin
`(57)
`ABSTRACT
`A system for and a method of providing an expandable
`home automation controller is disclosed which supports
`multiple numbers and multiple different types of data
`communications with both appliances and subsystems
`within the home as well as systems external to the
`home. The system is based upon a central processor,
`such as a microprocessor-based computer, and is con
`nected by means of a data bus to control the various
`products and subsystems within a home or commercial
`building, such as lighting systems, security systems,
`various sensors, multiple external terminals, as well as
`to allow for the input of commands by a variety of
`means such as touchscreens, voice recognition systems,
`telephones, custom switches or any device capable of
`providing an input to a computer system. The system
`functions can be readily controlled by the user utilizing
`a high resolution graphics display and associated touch
`screen interface.
`
`20 Claims, 45 Drawing Sheets
`
`HAND-HED 22
`20 RECEMER FOR
`HAND-HED l- REMOTE
`REMOTE
`is
`36
`
`OOO
`OOO
`990
`280
`
`RS-232 TO
`SECURITY SYSTEM
`TRANSLATOR
`
`HOME SECURITY
`SYSTEM
`
`TOUCH
`SCREEN 1
`TOUCH
`16b SCREEN 2
`12
`240
`
`PROCESS
`CONTROLLER
`26
`
`10
`
`
`
`MUTPLE
`SERA
`INTERFACE
`
`12
`
`12
`2
`
`12
`CENTRAL
`PROCESSOR
`12
`
`12
`
`13
`SERA
`WA
`SWITCHES
`
`40
`HOME AUTOMAON
`BUSSES SUCH AS
`CEBUS OR
`SMART HOUSE
`34
`PROTOCOL.
`CONMERTER
`
`45
`ANAOG
`
`42
`
`480
`
`48b.
`
`44
`
`DATA BASE
`
`INTERFACE
`18
`Ke?sor
`Rig HMODEV
`
`OO
`OO
`OO
`29
`28b
`ANAOC SENSORS
`
`DGAL SENSORS
`
`27
`
`31
`
`OHER DEMCES
`AND APPLANCES
`33
`
`PLUMBING
`RELATED
`SYSTEMS
`
`INTERFACE
`
`24b.
`
`26b
`
`
`
`PARALE
`12 INTERFACE
`
`PROCESS
`CONTROLLER
`66
`REMOTE
`ERS
`
`30 CONTROLER
`O
`32b
`OO V OO
`OO OO
`
`REMOTE
`MICROPHONES
`
`SPEECH
`PROCESSOR
`
`50
`
`58
`
`NEWORK
`FE
`ERVER
`
`52B
`MULTIPLE EXTERNAL
`TERMINAS
`
`GRAPHICS
`INTERFACE
`
`54
`
`56
`
`
`
`WDEO
`DISPLAY
`MONOR
`
`S4
`
`60
`
`TELEPHONE
`INTERFACE
`
`62
`
`HOME
`EEPHONE
`SYSTEM
`
`Ex.1029
`APPLE INC. / Page 1 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 1 of 45
`
`5,086,385
`
`OO || || OO O O N | O O
`
`H10WIB}}
`
`SENOHdOHO|W
`
`09
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Ex.1029
`APPLE INC. / Page 2 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 2 of 45
`
`5,086,385
`
`FIG. 2
`
`2 POWER WIRES
`
`
`
`
`
`
`
`one KNIGHT
`
`SILENT
`
`
`
`KEYPAD
`
`SILENT
`
`
`
`
`
`
`
`
`
`
`
`
`
`24
`
`
`
`ELECTRONIC
`SECURITY
`INTERFACE
`
`7-80
`MCROCOMPUTER
`
`36
`
`HOME AUTOMATION
`SYSTEM CENTRAL PROCESSOR (10)
`AND SERIAL INTERFACE (340
`
`
`
`
`
`
`
`
`
`Ex.1029
`APPLE INC. / Page 3 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 3 of 45
`
`5,086,385
`
`THE ULTIMATE"
`AUDIO/WDE0
`SECURIYANAGEMENT
`LIGHINGAOODS
`
`.
`
`.
`
`.
`
`.
`
`. WFORMATION
`
`EMWROMENIAL CONIROI
`COMWENIENCE FEATURES
`SYSIEW CONFIGURATION
`
`FIG 3A
`
`AUDIO / VIDEO
`| WCP
`IELAWSON
`AM/F/PRESIS
`COMPACT DISC
`DSIRIBUTEDAD0
`AUD10 CONIROIS
`SYSIEW OFF
`
`FIG. 3B
`
`Ex.1029
`APPLE INC. / Page 4 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 4 of 45
`
`5,086,385
`
`VCR
`
`PLAY
`SIOP
`FAST FORWARD
`PEWD
`SIOW-MOION
`FREEZE/FRAMEADWANCE
`WCPSCHEDDING
`FC 3C
`
`CD SELECTION
`CARMNA BORANA
`PICTURES AIAWEHIBION
`/ WAGNERSELECTIONS
`BEE/HOWEN PASIOPAIF
`BRANDENBURG CONCERIOS
`CD CONIROIS
`
`FIG. 3D
`
`Ex.1029
`APPLE INC. / Page 5 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 5 of 45
`
`5,086,385
`
`DISTRIBUTED AUDIO
`FROW COMPACT DISC
`FROV RECEIVEP
`FROW WCP
`FROM IELEWISION
`DSIRIBUIEDALDO OFF
`
`
`
`DISTRIBUTED AUDIO:
`ENTRYLEVEL
`
`FIG. 3F
`
`Ex.1029
`APPLE INC. / Page 6 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 6 of 45
`
`5,086,385
`
`SECURITY MANAGEMENT
`
`UPPEP LEWEl
`
`" .
`
`.
`
`.
`
`GROUND LEVEl
`FRONI DOOP CAMERA
`GAAGE CAMERA
`SECURITY EVEN 106
`REEMABLE BLOWERS
`
`
`
`ZONE KEY
`
`Open 5E
`O Open
`D Disabled
`O Enobled
`SYSTEM
`STATUS:
`READY
`TO ARM
`
`Zone #:14
`Nome:"Living room window right
`Status: Enobled
`
`Ex.1029
`APPLE INC. / Page 7 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 7 of 45
`
`5,086,385
`
`
`
`ZONE KEY
`
`Open OSE
`Open
`D Disabled
`Enobled
`SYSTEM
`STATUS:
`READY
`TO ARM
`
`f
`Zone : 14
`Name: Living room window right
`Stotus: Disabled
`
`Ex.1029
`APPLE INC. / Page 8 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 8 of 45
`
`5,086,385
`
`Entry Level
`
`
`
`ZONE KEY
`
`Open 5.
`Open
`D Disabled
`Enobled
`SYSTEM
`STATUS:
`
`g
`Zone #:14
`Nome:"Living room window right
`Status: Disabled
`
`SECURITY EVENT LOG
`BECNNING OF LOG
`intrusion in zone 32: Solarim window east front 02-03-1988 22:32:
`intrusion in Zone 32: Solarim window east front
`02-03-1988 22:32:
`intrusion in zone 23; Kitchen door fight C2-02-1988 23:28:36
`Intrusion in zone 2: Rear foyer garge door 02-02-1988 23:22:01
`intrusion in zone 1: Rear foyer door 02-02-1988 23:23:11
`intrusion in zone 6: PE master bedroom door 02-10-1988 06:1:53
`intrusion in zone Tl; Solorim door fight C2-20-1988 Ol:25:12
`intrusion in zone 32: Solorium window east front O-04-1988 1:19:
`intrusion in zone 2: Solorium window est front O-04-1988 17:48:
`intrusion in zone 32: Solarim window east front O-04-1988 18:05:
`intrusion in zone 2: Solarin windoy east front 03-04-1988 2:13;
`intrusion in Zone 32: Solorium window east front 0-04-1988 22:
`
`( UP 7
`
`CLEAR 106
`FIG. 3L
`
`Ex.1029
`APPLE INC. / Page 9 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 9 of 45
`
`5,086,385
`
`LIGHTING MOODS
`EARLY MORNING
`NORAI DAY
`NORAL EVENING
`DAY PARTY
`EVENING PAPIY
`ROMANICEWENING
`MGHILIGHIS
`
`FIG. 3M
`
`INFORMATION
`SPOR'S SCORES
`KENNEDY CONCERT HAI
`KENNEDY OPERA HOUSE
`
`FIG. 3N
`
`Ex.1029
`APPLE INC. / Page 10 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 10 of 45
`
`5,086,385
`
`FROM
`POLL
`
`400
`
`ON | OF I.S. EVENT
`ON TOP OF QUEUE
`
`IS. 3: FLASH QUIT
`TOUCHBOX
`
`
`
`
`
`
`
`IS
`TOUCHSCREEN
`DATA PENDING
`
`404
`
`
`
`
`
`YES
`
`408
`
`INSERT NEW I.S. EVENT
`
`TOP
`POLL
`LOOP
`
`FIG. 40
`
`RQ-3 TRIGGER
`
`JUMP TO INTERRUPT
`SERVER ROUTINE
`
`302
`
`
`
`
`
`
`
`ASK SERAL CARD
`WHICH SERIA LINE
`GENERATED INTERRUPT
`
`
`
`PULL BYTE FROM
`APPROPRIATE SERIAL
`LINE'S RX REGISTER
`
`406
`
`DORMAN
`SCREEN
`
`PLACE BYTE IN
`APPROPRIATE SERIAL
`QUEUE
`
`INCREMENT OUEUE
`POINTER. IF QUEUE
`POINTER x QUEUE SIZE,
`THEN MAKE QUEUE
`POINTER WRAP AROUND
`
`
`
`
`
`
`
`RETURN
`TO NORMAL
`PROGRAM
`
`
`
`FIG. 4b.
`
`Ex.1029
`APPLE INC. / Page 11 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 11 of 45
`
`5,086,385
`
`TOP N-N 500
`POLL
`LOOP
`
`
`
`
`
`
`
`SERA
`CUE.E. 1EW SEC/
`sERAL
`(SECURITY/FIRE 1)
`
`
`
`
`
`
`
`NEW SEC/
`FIRE 2 DATA
`
`SERA
`QUEUE 2
`
`
`
`
`
`SERAL
`LINE 2
`(SECURITY/FIRE 2)
`E 512
`INTERNAL E
`SCHEDULED E eS
`EVEN QUEUE
`
`
`
`SERIAL 58
`SERIAL SEE
`UNES
`(.0. CONTROLLER)
`
`
`
`KEYBOARD
`
`524
`
`F.G. 5C
`
`
`
`SERIAL
`
`SERAL
`LINE 4
`(TOUCHSCREEN 1)
`
`
`
`GOOD DATA
`
`506
`
`
`
`DECODER
`
`504
`SEC/FIRE 1
`INTERPRETER
`
`
`
`
`
`510
`
`TASK 2:
`SEC/FIRE 2
`
`INTERNAL
`SCHEDULED
`
`TASK 3:
`.O.. CONTROLLER
`
`DAGNOSTIC
`ROUTINES
`
`TASK 4:
`TOUCHSCREEN 1
`
`FIG. 50
`
`Ex.1029
`APPLE INC. / Page 12 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 12 of 45
`
`5,086,385
`
`FIG. 5b
`
`2EE
`
`LOOP
`
`SE:
`QUEUE 5
`SERA
`IEH
`LINE 5
`(TOUCHSCREEN 2)
`
`SERA
`
`SERA
`QUEUE 6
`-
`(FUNCTION SWITCH 1)
`
`SERA
`QUEUE 7
`SERIAL
`HH
`LINE 7
`(FUNCTION SWITCH 2)
`60
`
`
`
`TELEPHONE
`NTERFACE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`534
`YES
`TOUCHSCREEN 2
`
`536
`
`TASK 5:
`TOUCHSCREEN 2
`
`
`
`UNCTION SWITCH 1
`
`
`
`540
`
`ASK 6:
`FUNCTION SWITCH 1
`
`
`
`544
`
`NCTION SWITCH 2d
`
`TASK 7:
`FUNCTION SWITCH 2
`
`
`
`NCOMING
`
`TASK 9:
`DECODE
`TOUCHTONES
`
`
`
`
`
`TOUCHTONE
`RECOGNIZED?
`
`500
`
`
`
`
`
`TOP
`POLLING
`LOOP
`
`
`
`
`
`Ex.1029
`APPLE INC. / Page 13 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 13 of 45
`
`5,086,385
`
`
`
`524
`
`556
`
`PHONE
`CALL ACTIVE
`
`N
`
`FIG. 5C
`
`
`
`ACTIVE
`BOARD IS SPEEC
`BOARD?
`
`562
`
`BOARD EN
`TALKING
`MODE
`
`564
`
`CALL INT
`RECOGNITION
`
`568
`
`CHECK
`RECOGNON
`ON BOARD 0
`
`Eigh
`BOARD
`
`572
`
`CHECK
`RECOGNITION
`ON BOARD
`
`576
`
`SGENE
`
`N
`
`CHECK
`RECOGNITION
`ON BOARD 2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Y
`
`ETURNE
`
`N
`
`558
`
`TOUCHSCREEN 1
`
`582
`SHOW RECOGNITION
`SCORE
`
`586
`
`foie
`IMMEDIATE
`584 V RESPONSE
`SET SIMULATED TOUCH
`CO-ORDINATES TO
`MIDDLE OF SCREEN
`
`
`
`Ex.1029
`APPLE INC. / Page 14 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 14 of 45
`
`5,086,385
`
`500
`
`TOP
`POLLING
`LOOP
`
`FIG. 60
`
`528
`
`TOUCHSCREEN 1
`
`YES
`
`600
`
`602
`
`NO
`
`IS DATA
`WAD?
`YES
`
`SUFFICENT
`
`
`
`TOUCHPOINT2
`
`604
`
`
`
`YES
`
`F TOUCHPONYn PIXELS
`FROM PRIOR TOUCH, THEN
`DISPLAY NEW CURSOR
`
`ON STATE OF TASK 4, GO TO.
`
`606
`
`608
`
`DORMANT
`SCREEN
`
`610
`
`612
`
`
`
`
`
`GEN
`MENU
`
`
`
`614
`
`...OTHER TOUCHSCREEN
`MENUS
`
`Ex.1029
`APPLE INC. / Page 15 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 15 of 45
`
`5,086,385
`
`FIG. 6b
`
`610
`
`618
`
`500
`
`620
`
`
`
`TOP
`POLLING
`LOOP
`
`YES
`
`
`
`IS MORE
`TOUCHSCREEN DATA
`PENDING?
`
`NO
`
`622
`
`
`
`REMOVE RETURN
`TO DORMANT"
`.S. EVENT
`
`624
`
`ON BOX TOUCHED, GO TO.
`
`
`
`626 & TO
`
`DORMANT
`
`628
`
`OTHER TOUCHSCREEN
`MENUS ACCESSIBLE
`FROM THE MAN MENU
`
`
`
`
`
`
`
`LOAD LIGHTING MOOD
`MENU DATA. SET
`STATE OF TASK 4
`O LIGHTING MOOD
`
`500
`
`
`
`TOP
`POLLING
`LOOP
`
`
`
`
`
`
`
`LOAD AW MENU
`DATA. SET STATE OF
`TASK 4 TO AW MENU
`
`Ex.1029
`APPLE INC. / Page 16 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 16 of 45
`
`5,086,385
`
`FIG. 6c
`
`632
`
`MOODS MENU
`
`618
`
`CHECK TOUCH
`
`500
`
`620
`
`TOP
`POLLING
`LOOP
`
`
`
`YES
`
`IS MORE
`TOUCHSCREEN DATA
`PENDING?
`
`
`
`NO
`
`634
`
`ON BOX TOUCHED, GO TO.
`
`636
`
`
`
`638
`
`
`
`SET LIGHTING
`MOOD (n): CALL
`DEVICE DRIVER
`
`640
`
`BLANK LT BOX
`
`500
`
`TOP
`POLING
`LOOP
`
`Ex.1029
`APPLE INC. / Page 17 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 17 of 45
`
`5,086,385
`
`700
`
`710
`
`FIG. 70
`
`NEW BYTE IN
`M.T.OUEUE
`
`ON V-STATE
`GO TO.
`
`500
`
`TOP
`POLLING
`V LOOP
`
`714.
`712
`V-STATE O >1SYNCN Y SCUAE
`UPPER HALF
`BITS-1ST
`X-TOUCH
`BYTE?
`CO-OR.
`
`
`
`
`
`716 78
`NCR.
`V-STATE
`
`
`
`OREN N
`M.T.DATA
`AVAL2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SYNC,
`BTS-a-2ND
`
`
`
`
`
`
`
`CALCULATE
`LOWER HALF
`STOUGH
`CO-OR.;
`CACULATE
`X-TOUCH
`
`CALCULATE
`UPPER HALF
`Y-TOUCH
`CO-OR.
`
`
`
`CACULATE
`LOWER HALF
`Y-TOUCH
`CO-OR.;
`CALCULATE
`Y-TOUCH
`
`NCR.
`V-STATE
`
`MORE
`M.T.DATA
`AVAL2
`
`NCR.
`V-STATE
`
`MORE
`M.T.DATA
`
`
`
`M.T.
`IMMEDIATE
`RESPONSE
`
`Ex.1029
`APPLE INC. / Page 18 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 18 of 45
`
`5,086,385
`
`FIG. 7b
`752
`
`
`
`FROM
`
`VALIDATION SN) ME RESPONSE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`CONVERT TOUCHSCREEN
`COORDINATES TO
`PXEL SOORDINATES
`
`>7 PXELS FROM
`AST TOUCH2
`
`ERASE PRIOR CURSOR;
`DRAW NEW CURSOR;
`STORE CURRENT TOUCH
`COORDINATES;
`
`760
`
`SET TOUCH FLAG
`
`NEURAL STATE - 764
`PAUSE O.I.
`SECONDS
`
`FROM
`STATE
`DECODER
`
`500
`TOP
`POLLING
`
`762
`
`
`
`
`
`768
`
`N
`
`ERASE CURSOR
`
`770
`
`TURN ON SPEAKER
`ACCORDING TO
`ACTIVE TOUCHSCREEN
`
`
`
`
`
`PASSWORD
`SCREEN
`
`PASSWORD?
`
`
`
`
`
`
`
`762
`
`784
`
`Y
`
`M., TASK
`STATE DECODER
`
`SPEAK GREETING
`
`786
`
`
`
`
`
`INITIALIZE
`MAN MENU
`STATE
`
`Ex.1029
`APPLE INC. / Page 19 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 19 of 45
`
`5,086,385
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`96
`7
`
`ENTRY
`POINT FROM
`PONG
`LOOP
`
`
`
`
`
`713
`ON BOX
`SELECTED.
`
`7
`
`QUT
`
`BACK
`
`
`
`788
`
`790
`LOAD SCREEN;
`INDICATE STATUS
`OF MENU OPTIONS,
`F NECESSARY
`
`500
`
`TOP
`POLLING
`LOOP
`
`LOAD SPEECH
`RECOG. WOCAB.,
`IF APPLICABLE
`
`798
`
`799
`
`794
`
`SET STATE
`TO CURRENT
`CONTEXUAL STATE
`ENTRY POINT
`
`CALL
`CHECK TOUCH
`
`CAL
`DISPLAY CURSOR
`
`711
`
`BO
`TOUCHED
`Y
`
`N
`
`FIG. 7d
`
`721
`
`717
`
`RA
`
`GO BACK
`TO
`ANOTHER TIMEOUT EVENT
`MENU FROM I.S.I.S;
`INSERT NEW
`"SCREEN TIMEOU"
`I.S.I.S. EVENT
`TOUCHFAG=0
`
`GO BACK
`TO
`MAN MENU
`
`723
`
`INTALZ
`PRIOR
`SUBMENU
`(STATE)
`
`TO MAN
`719 V. MENU
`
`
`
`
`
`
`
`GO
`TO E.
`733
`N
`
`735
`
`500
`
`BLANK HIGH-
`LIGHTED BOX
`
`CLEAN OUT
`TOUCH BUFFER
`
`TOP
`POLLNG
`LOOP
`
`REMOVE "SCREEN TIMEOUT
`EVENT FROM i.S.I.S;
`INSERT NEW "SCREEN
`TIMEOUT" I.S.I.S. EVENT
`731
`NAZE NEW
`SUB-MENU
`
`Ex.1029
`APPLE INC. / Page 20 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 20 of 45
`
`5,086,385
`
`
`
`
`
`
`
`
`
`
`
`MORE
`M.T. DATA
`AVAL
`
`741
`PAUSE 0.25
`SECONDS
`
`MORE
`M.T. DATA
`AVAL2
`
`
`
`
`
`ERASE
`CURSOR
`
`TOUCHED?
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ENABLE/DISABLE
`TOUCHBOX DISPLAYS
`"DISABLE
`ZONE
`
`
`
`REPLACE
`DISABLE ZONE
`TOUCHBOX WITH
`"ENABLE ZONE
`
`ZONE
`NQSHUNEPN N
`AND ENABLE/DISABLE
`TOUCHBOX DISPLAYS
`DISABLE
`205
`
`REPLACE
`"ENABLE ZONE
`TOUCHBOX WITH
`"DISABLE ZONE
`
`
`
`Ex.1029
`APPLE INC. / Page 21 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 21 of 45
`
`5,086,385
`
`410
`
`412
`
`414
`
`500
`
`TOP
`POLLING
`LOOP
`
`STORE FLOOR h;
`LOAD FLOOR
`PLAN SCREEN;
`SPEAK RESPONSE
`
`DISPLAY "PLEASE
`WAIT MESSAGE
`
`420
`ON SUB-STATE
`GO TO ...
`
`SEND ZONE
`MAP REQUEST
`TO S/F
`INTERFACE;
`
`TO "ZONE MAP
`REQUEST STATE,
`INSERT SEC.
`RESPONSE
`EXPECTED"
`I.S.I.S. EVENT
`416
`
`799
`
`SET M.T.
`TASK STATE
`
`CALL
`DISPLAY CURSOR
`
`424
`
`
`
`
`
`ZONE
`MAP
`REQUEST
`ENTRY
`POINT
`
`426
`ON RESULT
`GO TO.
`
`GOOD
`
`NO RESPONSE
`SPEAKNO
`RESPONSE PHRASE
`
`UNEXPECTED
`RESPONSE
`432
`SPEAK UNEXPECTED
`RESPONSE PHRASE
`
`
`
`428
`DECODE SECURITY ARMED,
`READY CONDITIONS
`434
`ERASE PLEASE WAT
`MESSAGE
`
`
`
`
`
`
`
`422
`
`TO
`SUBSTATE
`DECODER
`
`FIG 7 9
`
`436
`
`SHOW
`ZONE
`STATUS
`
`
`
`Ex.1029
`APPLE INC. / Page 22 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 22 of 45
`
`5,086,385
`
`
`
`30
`
`RE-DISPLAY
`SECURITY
`FLOOR PLANS
`
`4.38
`
`
`
`SHOW
`ZONES'
`STATUS
`
`303
`POLLING
`5 \00
`309
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SET FADE COLOR
`TO BLACK;
`LOAD FLOOR PLAN
`SCREEN ACCORDING
`TO FLOOR ;
`SET FADE COLOR
`TO NORMAL
`
`DECODE
`ZONES'
`STATUS
`
`311
`
`
`
`
`
`MARK ZONES ON SCREEN;
`DISPLAY STATUS OF OPEN
`OR SHUNTED ZONES
`
`
`
`FROM
`SUB-STATE
`DECODER
`
`313
`
`SHOW ARMED OR
`READY STATUS
`ON SCREEN
`
`323
`
`INSERT "SCREEN
`TIMEOUT I.S.I.S. EVENT;
`TOUCHFLAG = 0
`
`ANAYZE
`FLOOR
`PLAN
`TOUCHES
`
`
`
`
`
`
`
`ERASE
`PREVIOUS
`ZONE
`MARKER
`
`
`
`CONTINUED
`NEXT PAGE
`AT (A)
`
`
`
`
`
`MARK NEW ZONE
`CALL PRINT ZONE STATUS
`
`Ex.1029
`APPLE INC. / Page 23 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 23 of 45
`
`5,086,385
`
`FIG. 7
`
`R (SR
`
`LOOP
`
`448
`
`PAUSE O.1
`SECONDS
`
`711G
`
`BOX
`TOUCHED
`?
`Y
`
`715
`
`452
`ON BOX TOUCHED
`GO TO.
`
`QUIT
`
`BACK
`
`RETURN
`TO
`DORMANT
`SCREEN
`
`
`
`
`
`
`
`ARM/DISARM
`SYSTEM
`
`ENABLE/DISABLE ZONE
`
`454
`
`456
`
`REMOVE "SCREEN
`TIMEOUT" I.S.I.S.
`EVENT;
`INSERT NEW
`"SCREEN TIMEOU
`I.S...S. EVENT
`
`460
`
`INTAZE
`SEC.
`MANAGEMENT
`SUB-MENU
`
`462
`
`Y
`
`N
`
`HIGHEST
`ATERNATE
`FLOOR
`
`464
`
`SET FLOOR TO HIGHEST
`ALTERNATE FLOOR
`
`LOWEST
`ALTERNATE
`FLOOR
`
`
`
`468
`
`
`
`SET FLOOR TO LOWEST
`ALTERNATE FLOOR
`
`466
`
`REDISPLAY
`SECURITY
`FLOOR PLANS
`
`Ex.1029
`APPLE INC. / Page 24 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 24 of 45
`
`5,086,385
`
`458
`
`
`
`
`
`ARM/DISARM
`SYSTEM
`SUB-STATE
`
`
`
`
`
`REMOVE "SCREEN
`TIMEOUT I.S.I.S.
`EVENT;
`TOUCHFLAG = 0
`
`R (e.
`LOOP
`
`478
`
`SPEAK "ENTER
`PASSWORD
`PHRASE
`
`
`
`
`
`REDISPLAY
`SEC, FLOOR
`PLANS
`
`484
`
`
`
`
`
`490
`
`SEND DISARM MESSAGE .
`PASSWORD TO S/F INTERFACE
`492
`SET S/F STATE TO
`"DSARM SYSTEM
`
`
`
`486
`
`SEND ARM MESSAGE .
`PASSWORD TO S/F INTERFACE
`488
`SES/F STATETO
`ARM SYSTEM
`
`494
`SET "SEC.
`RESPONSE
`EXPECTED
`I.S.I.S. EVENT
`
`
`
`
`
`FROM
`SUB-STATE
`DECODER
`
`SPEAK "PLEASE
`WAT PHRASE
`
`DISPLAY "PLEASE
`WAT MESSAGE
`
`496
`
`498
`
`CALL
`DISPLAY CURSOR
`
`41
`SET
`
`Ex.1029
`APPLE INC. / Page 25 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 25 of 45
`
`5,086,385
`
`
`
`ARM/DISARM
`SEC. SYSTEM
`SUB-STATE
`ENTRY POINT
`
`491
`
`489
`
`ON RESULT
`GO TO.
`
`FIG. 7k
`
`
`
`
`
`
`
`
`
`INSERT WAT
`FOR BAD
`PASSWORD"
`I.S...S. EVENT
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`500
`
`POLNG
`LOOP
`
`ALREADY
`NO
`RESPONSE PASSWORD ARMED/
`DISARMED
`
`NO BAD
`PASSWORD
`MESSAGE
`DURING DELAY
`SEND ZONE MAP SPEAK NO
`REQUEST TO S/F RESPONSE
`INTERFACE;
`PHRASE
`SET S/F STATE
`TO "ZONE MAP
`REQUEST;
`SET SEC.
`
`EXPECTED
`I.S.I.S. EVENT
`
`481
`SET SUB-STATE
`
`
`
`
`
`
`
`ZONE MAP RETURNED
`
`467
`DECODE ARMED/
`DISARMED STATUS
`
`465
`
`
`
`466
`
`461
`SPEAK "SYSTEM
`DISARMED PHRASE
`
`
`
`
`
`SECURITY
`FLOOR
`PLANS
`
`Ex.1029
`APPLE INC. / Page 26 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 26 of 45
`
`5,086,385
`
`() 459
`
`457
`
`FIG. 7
`
`REMOVE "SCREEN TIMEOUT"
`I.S.I.S. EVENT
`TOUCHFLAG = 0
`
`455
`
`
`
`Y
`
`
`
`447
`SEND SHUNT ZONE MESSAGE
`TO S/F INTERFACE
`
`449
`SET SEC. RESPONSE
`EXPECTED I.S.I.S. EVENT;
`STORE ZONE NUMBER
`FOR I.S.I.S. EVENT
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`453
`SPEAK "ENTER
`PASSWORD
`PHRASE
`
`480
`CALL GET
`PASSWORD
`451
`
`4
`66
`
`NULL
`PASSWORD
`p
`
`Y
`
`REDISPLAY
`FLOOR
`PLANS
`
`477
`
`N
`
`SEND SHUNT ZONE COMMAND
`& PASSWORD TO S/F INTERFACE;
`449
`SET SEC. RESPONSE
`EXPECTED I.S.I.S. EVENT;
`STORE ZONE NUMBER
`FOR I.S.I.S. EVENT
`
`445
`
`SET S/F STATE TO
`"SHUNT ZONE
`
`443
`SPEAK PLEASE WAT" PHRASE
`DISPLAY PLEASE WAT MESSAGE
`441
`
`500
`
`POLLING
`
`Ex.1029
`APPLE INC. / Page 27 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 27 of 45
`
`5,086,385
`
`SHUNT
`N
`s
`ZONE SUB
`
`439
`
`437
`
`ON RESULT
`GO TO,
`
`FIG. 7m
`
`NO
`RESPONSE
`
`BAD
`PASSWORD
`
`UNEXPECTED
`RESPONSE
`
`SPEAKNO
`RESPONSE
`PHRASE
`
`479
`
`REMOVEWAT
`FOR BAD
`PASSWORD."
`I.S...S. EVENT
`
`SPEAK
`UNEXPECTED
`RESPONSE
`PHRASE
`
`475
`
`GOOD
`
`487
`SET "WAT FOR
`BAD PASSWORD."
`I.S.S. EVENT
`
`453
`SET SUB-STATE
`
`500
`
`POLNG
`LOOP
`
`427
`
`
`
`NO BAD PASSWORD
`MESSAGE DURING DELAY
`
`466
`
`REDISPLA
`SECURITY
`FLOOR
`PLAN
`
`SET S/F STATE TO
`ZONE MAP REQUEST;
`SEND ZONE MAP REQUEST
`TOS/F INTERFACE
`
`435
`SET SEC. RESPONSE
`EXPECTED I.S...S. EVENT
`
`425
`
`SE SUB-STATE
`
`500
`
`POLNG
`LOOP
`
`423
`4.
`17
`ERASE "SHUNTED
`NDICATOR
`
`42
`
`PLACE "SHUNTED
`INDICATOR
`
`DECODE ARMED/
`DISARMED CONDITION
`
`419
`
`
`
`
`
`CONTINUED
`NEXT PAGE
`AT (E)
`
`Ex.1029
`APPLE INC. / Page 28 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 28 of 45
`
`5,086,385
`
`FIG. 7n
`
`413
`
`SPEAK NOW
`READY" PHRASE
`
`SEC, SYSTEM
`A READY ARMED
`BEFORE
`SHUNTING
`
`405
`SPEAK NOW
`
`409
`
`
`
`WAS
`SEC. SYSTEM
`OT READY BEFOR
`SHUNTING
`
`SPEAK "NOW
`NOT READY"
`PHRASE
`
`
`
`
`
`
`
`
`
`411
`
`300
`
`
`
`WAS
`SEC, SYSTEM
`DISARMED BEFORE
`SHUNTING?
`
`DISARMED PHRASE
`
`
`
`N
`
`306
`ERASE PLEASE
`WAIT MESSAGE
`
`ERASE ZONE MARKER;
`BLANK HIGH-UGHTED
`BOX
`
`308
`
`310
`
`401
`
`304
`
`A.
`
`
`
`REDISPLA
`SECURITY
`FLOOR
`PLAN
`
`
`
`Ex.1029
`APPLE INC. / Page 29 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 29 of 45
`
`5,086,385
`
`REDORMANT
`
`312
`
`FIG. 7o
`
`FIG. 7p
`
`532
`
`334
`
`318
`HANG UP
`PHONE
`
`
`
`
`
`RESET M.T. V-STATE
`
`STORE PREVIOUS TOUCH
`COORDINATES TO NEW
`TOUCH COORDINATES
`
`S4
`
`TURN OFF VOICE
`RESPONSE SPEAKERS
`
`316
`
`OUTGOING
`PHONE CAL
`
`
`
`320
`
`
`
`VIDEO
`MONTORING
`ACTIVE
`
`Y
`
`322
`
`
`
`TURN OFF
`VIDEO MONTORING
`
`M.T.
`MMEDIATE
`RESPONSE
`ROUTINES
`
`324
`
`LOAD DORMANT
`SCREEN
`
`326
`
`
`
`
`
`NCOMING
`PHONE CALL
`ACM
`
`330
`
`CALL
`INTRECOGNITION
`
`
`
`
`
`
`
`328
`PRINT "PHONE
`CAL MESSAGE
`
`500
`
`POLNG
`LOOP
`
`Ex.1029
`APPLE INC. / Page 30 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 30 of 45
`
`5,086,385
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`800 NEW BYTE IN
`S/F QUEUE
`
`804
`V-STATE O-1sfSYNCNY
`
`on v-state (1)
`GO TO,
`
`E32
`
`808
`INCR. V-STATE
`ADD COMPLETE
`SEC. MESSAGE
`EVENT TO I.S.I.S.
`
`long 500
`POLING
`LOOP
`
`1MORE
`S/F DATA
`AVAIL
`
`INCR. V-STATE
`STORE LENGTH
`
`
`
`
`
`
`
`MORE
`S/F DATA
`AVAIL
`
`V-STATE=
`V-STATE 5
`
`
`
`848
`
`
`
`GO TO.
`
`850
`
`GE
`
`FIG. 8O
`
`Ex.1029
`APPLE INC. / Page 31 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 31 of 45
`
`5,086,385
`
`854
`REMOVE 'off
`VSATES - SECURITY ESSAGE--v-sTATE-0
`FROM S...S.
`
`500
`(ER
`OOP
`
`856
`
`N
`
`FIG. 8b
`
`IMMEDIATE
`RESPONSE
`
`858
`ACKNOWLEDGE
`MESSAGE TO
`S/F INTERFACE
`860
`ON STATE
`GO TO.
`
`
`
`
`
`
`
`
`
`
`
`M.T. TASK
`FIRE ALARM
`
`ALL OTHER
`ALARMS
`SET ALL HOUSE
`LIGHTSLIGHTING
`MOOD
`
`868
`
`
`
`"DISARM SYSTEM
`STATE
`
`ON COMMAND
`GO TO.
`
`870
`
`872
`RESULT =
`GOOD
`
`
`
`A READY
`DISARMED
`RESUL=
`A READY
`DSARMED
`
`
`
`PASSWORD
`REJECTED
`RESULT=
`Essword 17
`REJECTED
`880
`
`878
`
`o'E,
`STATES
`
`M.T. TASK
`DISARM SEC. SYSTEM
`SUB-STATE
`
`Ex.1029
`APPLE INC. / Page 32 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 32 of 45
`
`5,086,385
`
`
`
`ON STATE
`GO TO.
`SHUNT ZONE
`STATE
`
`882
`ON COMMAND
`GO TO.
`
`FIG. 8C
`
`A OTHER COMMANDS
`
`878
`
`890
`M. Task
`SHUNT ZONE
`
`ACKNOWLEDGE REJECTED
`PASSWORD
`RESULT=
`PASSWORD
`REVECTED
`
`
`
`RESULT=
`GOOD
`
`
`
`886
`
`REQUEST STATE
`
`ON COMMAND
`GO TO...
`
`ACKNOWLEDGE
`
`REJECTED PASSWORD
`
`RESULT=
`GOOD
`
`RESULTs
`PASSWORD
`REJECTED
`
`896
`
`878
`
`898
`
`ARM
`
`M STATE
`
`899
`ON COMMAND
`GO TO,..
`
`RETURN TO ROUTINE
`REQUESTING A ZONE
`MAP
`
`ACKNOWLEDGE AREADY
`ARMED
`RESULT=
`A READY
`ARMED
`
`
`
`RESULT=
`GOOD
`
`
`
`NOT
`READY
`RESULT=
`NOT
`READY
`
`
`
`PASSWORD
`REVECTED
`RESULT=
`REVECTED
`PASSWORD
`
`97
`8
`
`
`
`91
`8
`
`878
`
`M.T. TASK
`ARM/DISARM SEC.
`SYSTEM SUB-STATE
`
`895
`
`Ex.1029
`APPLE INC. / Page 33 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 33 of 45
`
`5,086,385
`
`900
`
`902
`
`DISPLAY
`SN SCHEDULING SCREEN
`AND OPTIONS
`
`
`
`FIG. 9
`
`920
`
`STORE SCHEDULE &
`RETURN TO
`MAN PROGRAM
`
`906
`DISPLAY GRAPHICS
`FOR START DATE
`AND ACCEPT INPUT
`
`910
`DISPLAY GRAPHICS
`FOR START TIME
`AND ACCEPT INPUT
`
`A
`
`914
`DISPLAY GRAPHICS
`FOR STOP DATE
`AND ACCEPT INPUT
`
`A
`
`918
`DISPLAY GRAPHICS
`FOR STOP TIME
`AND ACCEPT INPUT
`
`Ex.1029
`APPLE INC. / Page 34 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 34 of 45
`
`5,086,385
`
`
`
`80||
`
`Ex.1029
`APPLE INC. / Page 35 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 35 of 45
`
`5,086,385
`
`
`
`Ex.1029
`APPLE INC. / Page 36 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 36 of 45
`
`5,086,385
`
`700
`
`
`
`
`
`701
`
`
`
`
`
`
`
`
`
`
`
`
`
`INSIDE MENU'S
`TOUCHBOXES2
`
`FIG. 11
`
`618
`
`NO
`
`704
`
`F A BOX WAS
`PREVIOUSLY LIT,
`THEN BLANK T
`
`RETURN
`TO ACTIVE
`MENU
`
`500
`
`
`
`
`
`TOP
`POLLING
`
`DORMANT
`SCREEN
`
`
`
`
`
`
`
`
`
`IS MORE
`TOUCHSCREEN DATA
`PENDING?
`
`SCREEN
`
`
`
`
`
`REMOVE PRIOR
`SPEAK GREETING
`"RETURN TO DORMA
`LOAD MAIN MENU
`REMOVE PRIOR
`S. EVENTRERFENrl GRAPHICS AND DATA
`SET NEW "RETURN TO
`.S. EVENT
`SET STATE
`DORMANT" .S. EVENT
`LOAD DORMANT
`TO MAN MENU
`SET UP RETURN TO
`SCREEN GRAPHICS
`LOAD MAN MENU
`DORMANT" i.S. EVENT
`DATA
`GRAPHICS
`DATA
`TO OCCUR IN
`SET STATE TO
`SET TASK 4 STATE
`n SECONDS
`DORMANT SCREEN
`TO MAN MENU
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TOP
`POLLING
`LOOP
`
`
`
`
`
`TOP
`POLLING
`LOOP
`
`
`
`Ex.1029
`APPLE INC. / Page 37 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 37 of 45
`
`5,086,385
`
`FIG. 12
`
`
`
`12B
`
`Ex.1029
`APPLE INC. / Page 38 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 38 of 45
`
`5,086,385
`
`
`
`c.
`
`Ex.1029
`APPLE INC. / Page 39 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 39 of 45
`
`5,086,385
`
`.
`
`.
`
`.
`
`. .
`
`.
`
`.
`
`v.
`a
`s
`s
`s
`s
`s
`
`s
`s
`s
`s
`s
`e
`...
`
`".
`" - " .
`
`.
`
`.
`
`.
`
`. .
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`. .
`
`.
`
`s'
`.
`. s
`
`.
`
`.
`. . .
`
`.
`.
`.
`. . s
`
`.
`
`.
`
`Fic. 12E
`
`
`
`a 's a
`"...
`I was
`state.
`'ss Po' a
`8
`vs. .
`.
`.
`'s
`Ps 8
`a
`
`Ex.1029
`APPLE INC. / Page 40 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 40 of 45
`
`5,086,385
`
`
`
`Ex.1029
`APPLE INC. / Page 41 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 41 of 45
`
`5,086,385
`
`FIG. 130
`
`BLINK OUT BUTTON
`5 TIMES
`
`
`
`
`
`1306
`
`
`
`
`
`NEW
`TOUCHSCREEN
`DATA AVA.
`
`1310
`
`FIG. 1.3b
`1312
`SEC.
`RESPONSE
`EXPECTED
`I.S.I.S.
`EVENT
`
`E)
`1314
`
`
`
`
`
`
`
`RETURN TO
`DORMANT
`SCREEN
`
`
`
`N
`
`SEND MESSAGE TO S/F
`
`1318
`INSERT "SEC. RESPONSE
`EXPECTED I.S.I.S. EVENT
`
`1308
`INSERT NEW "SCREEN
`TIMEOUT" I.S.I.S. EVENT
`
`500
`
`1320
`
`NO RESPONSE
`
`ON M.T. STATE
`GO TO.
`
`
`
`
`
`ZONE SUB
`STATE ENTRY
`
`Ex.1029
`APPLE INC. / Page 42 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 42 of 45
`
`5,086,385
`
`1330
`
`
`
`WAT
`FOR BAD
`PASSWORD
`I.S.I.S.
`EVENT
`
`
`
`
`
`FIG. 13C
`
`SET RESULT TO "NO BAD
`PASSWORD MESSAGE DURING DELAY
`
`1334
`SET S/F STATE TO NEUTRAL
`
`
`
`1336
`ON M.T. STATE
`GO TO.
`
`FIG. 13C
`
`1338
`
`
`
`
`
`COMPLETE
`SECURITY
`MESSAGE
`
`
`
`
`
`1340
`
`DSARM SEC.
`SYSTEM SUB
`STATE ENTRY
`POINT,
`
`RESET S/F V-STATE
`
`
`
`500
`
`FIG. 14
`
`
`
`
`
`
`
`1400
`
`NEW BYTE IN
`S.T. QUEUE
`
`1402
`STORE SECONDARY
`TOUCHSCREEN ID.
`TO ACTIVETSCRN
`
`
`
`
`
`
`
`M.T. TASK
`VALIDATION
`TOUTINE
`
`
`
`
`
`Ex.1029
`APPLE INC. / Page 43 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 43 of 45
`
`5,086,385
`
`1500
`NEW DATA BYTE
`
`1502
`ON V-STATE
`
`
`
`
`
`IS
`
`1504.
`
`Y
`
`1506
`STORE
`COMMAND
`
`1508
`
`ox 500
`
`LOOP
`
`1510
`STORE
`O LENGTH
`
`Y
`
`
`
`N
`
`1514
`STORE 4
`TO LENGTH
`
`INSERT "COMPLETE
`I.O.. CONTROLLER MESSAGE
`I.S...S. EVENT
`
`1516
`
`
`
`
`
`1518
`
`I.O, DATA
`
`W-SATE
`
`STORE BYTE
`OR DATA
`
`FIG. 150
`
`1524 N RESET
`V-STATE
`1526
`REMOVE COMPLETE I/O
`CONTROLLER MESSAGE
`.S...S. EVENT
`
`1512
`
`IMMEDIATE
`RESPONSE
`ROUTINES
`
`was
`
`Ex.1029
`APPLE INC. / Page 44 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 44 of 45
`
`5,086,385
`
`1528
`
`ON COMMAND
`
`FIG. 15b.
`
`1530
`
`ON-TO-OFF OR OFF-TO-ON
`TRANSON REPORT
`
`DECODE
`PORT
`
`
`
`
`
`1532
`
`STORE NEW
`BT MASK
`STORE OLD
`BIT MASK
`
`
`
`COMPARE BIT MASKS
`TO DETERMINE WHICH
`INPUT(S) CAUSED
`TRANSON REPORT
`
`
`
`ACKNOWL
`EDGEMENT
`(DO
`NOTHING)
`
`
`
`DECODE PORT ;
`DECODE DATA BYTES
`CORRESPONDING TO
`INPUT PORTS
`
`1SC500
`PONG
`
`1538
`
`
`
`
`
`
`
`CONTINUED
`NEXT PAGE
`AT C)
`
`COMMAND
`S TRANSiTION
`REPORT
`
`IGNORE ALL OTHER COMMANDS
`
`
`
`FOR EACH
`BT IN
`
`CALL
`OFF TO ON
`
`BTS
`CHECKED
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Ex.1029
`APPLE INC. / Page 45 of 75
`
`

`

`U.S. Patent
`
`Feb. 4, 1992
`
`Sheet 45 of 45
`
`5,086,385
`
`
`
`READ
`DIGITAL
`STATUS
`
`FIG. 15C
`
`
`
`
`
`IS "DIGITAL
`SAS
`
`REMOVE "...O." RESPONSE
`EXPECTED I.S.I.S. EVENT
`
`
`
`
`
`READ
`DIGITAL
`INPUTS S.E.
`ROUTINES
`
`FIG. 150
`
`
`
`1548
`
`1562
`
`PORT n-2
`
`Ex.1029
`APPLE INC. / Page 46 of 75
`
`

`

`O
`
`15
`
`35
`
`1.
`
`EXPANDABLE HOME AUTOMATION SYSTEM
`
`BACKGROUND OF THE INVENTION
`The present invention relates to computer controlled
`systems for automating a plurality of diverse electri
`cally controllable subsystems. More particularly, the
`present invention relates to a microprocessor-based
`electronic control system for use in the automation and
`control of electrical subsystems found in the hone envi
`ronment. Such systems may also be utilized in commer
`cial applications.
`In the past, sophisticated electronic control over
`complex systems has been limited primarily to industrial
`applications, and occasionally commercial applications.
`Such electronic control systems usually required exten
`sive and costly equipment, as well as technically trained
`operators. However, as consumer products and systems
`become more and more complex, untrained people in
`home environments have been increasingly desirous of 20
`obtaining a sophisticated electronic control system for
`enabling an easy to use control over such home prod
`ucts and systems. Many such products and systems are
`also increasingly being used in commercial environ
`25
`ments, such as electronic conference rooms, in which it
`is also desirable to provide an easy to use control system
`for use by individuals who are often not skilled in tech
`nological arts.
`Known home automation systems are generally built
`30
`around a small control box which is connected by
`means of existing household 110 volt AC wiring to one
`or more modules distributed throughout the home. The
`appliances and/or lights to be controlled are in turn
`connected to the modules and may thus be controlled
`from the control console by the homeowner. The main
`advantage of such "power-line carrier' home control
`systems is that they are low in cost and utilize existing
`home wiring. However, such power-line carrier control
`systems can be easily disrupted by outside environmen
`tal electrical disturbances, such as weather conditions.
`In addition, such systems allow the control of only a
`relatively limited number of types of electrical appli
`ances, namely, lights and small electrical appliances.
`They do not, however, allow for any sophisticated
`programming functions other than perhaps a time on
`45
`and time off feature Thus, power-line carrier control
`systems are of relatively limited utility for home auto
`mation purposes.
`More sophisticated home automation system designs
`are known, which are generally built around a program
`50
`mable microprocessor connected to a local bus which
`accepts a limited number of input/output control cards.
`Such systems may allow the connection of one or two
`user control devices such as a keypad or a touchscreen
`for inputting control commands to the home automa
`55
`tion system. However, such systems have a predeter
`mined limited number of how many devices and user
`interfaces the system can support. Generally speaking,
`in order to expand such systems, a second identical
`controller is required with its own programming for
`controlling its own connected devices and user inter
`faces. Although such an approach may be cost effective
`for small home automation systems, it is too limiting for
`more sophisticated automation tasks or for larger
`65
`homes.
`The inventive expandable home automation system
`disclosed in this application overcomes such limitations
`and drawbacks of the prior art systems by being de
`
`5,086,385
`2
`signed as a master controller for intelligent subsystems.
`Although it can also control simple devices directly, the
`primary method of control of the present invention is by
`means of multiple communication channels which are
`compatible with or convertible to a wide variety of
`standard data communications protocols. Thus, the
`system disclosed in this application can be connected to
`virtually any type of electrically controlled device that
`may be presently found in a home or can conceivably be
`connected to either the standard data communication
`buses in existence today, local area networks or future
`home automation data buses such as CEBUS or the
`SMART HOUSE bus. The system may also be con
`nected to devices to be controlled directly by parallel
`and serial ports.
`With the innovative expansion capabilities of the
`inventive system, simultaneous operation of multiple
`types of user devices can now be achieved. For exam
`ple, the home automation system described herein may
`be connected to simple keyboards, serial data keypads,
`touchscreens, voice recognition circuitry, hand-held
`remote controls, computer keyboards or telephones. In
`fact, virtually any type of electronic subsystem may be
`connected, by means of an appropriate interface, to the
`present system.
`The present invention is also compatible with com
`mercially available automation controllers. Thus, for
`example, when a control task requires an extensive
`number of inputs and outputs, the system can become
`the "master controller' for a wide variety of commer
`cial or special purpose automation controllers. Such a
`capability is not available in any other known home
`automation system controller.
`Due to the innovative expansion capabilities dis
`cussed above, the present invention, while allowing
`simultaneous operation of multiple types of user devices
`and compatibility with commercial automation control
`lers, is also compatible with intelligent appliances and
`subsystems and with external information retr