111111
`
`1111111111111111111111111111111111111111111111111111111111111111111111111111
`US 20030073412Al
`
`(19) United States
`(12) Patent Application Publication
`Meade, II
`
`(10) Pub. No.: US 2003/0073412 A1
`Apr. 17, 2003
`(43) Pub. Date:
`
`(54) SYSTEM AND METHOD FOR A MOBILE
`COMPUTING DEVICE TO CONTROL
`APPLIANCES
`
`(76)
`
`Inventor: William K. Meade II, Eagle, ID (US)
`
`Correspondence Address:
`HEWLETT-PACKARD COMPANY
`Intellectual Property Administration
`P.O. Box 272400
`Fort Collins, CO 80527-2400 (US)
`
`(21) Appl. No.:
`
`09/982,247
`
`(22) Filed:
`
`Oct. 16, 2001
`
`Publication Classification
`
`(51)
`
`Int. Cl? ....................................................... H04B 7/00
`
`(52) U.S. Cl. ............................................. 455/70; 455/3.03
`
`(57)
`
`ABSTRACT
`
`An appliance control system of the present invention com(cid:173)
`prises an appliance and a mobile computing device config(cid:173)
`ured for controlling the appliance by at least one of deter(cid:173)
`mining an available content for the appliance, selecting the
`content used by the appliance, and applying user preferences
`to the appliance.
`
`A method of controlling an appliance of the present inven(cid:173)
`tion comprises establishing a wireless communication link
`between an appliance and a mobile computing device, and
`controlling the appliance with the mobile computing device
`includes at least one of determining an available content for
`the appliance, selecting the content used by the appliance,
`and applying user preferences to the appliance.
`
`r 12
`MOBILE COMPUTING
`DEVICE
`
`CONTENT
`
`I
`I USER
`
`h
`'-16
`-~
`-18
`PREFERENCES
`"1----
`
`IWIRELESSI
`
`... ,
`
`-----
`
`... ._..,
`
`r 13
`APPLIANCE
`
`I CONTENT 1--,
`16
`-~
`II
`USER
`18
`PREFERENCES
`-
`
`A
`
`I
`
`---------~---_________ i _____ c~ ~,
`:MOBILE COMPUTINGt
`i
`DEVICE
`
`CONTENT
`
`USER
`: 18
`PREFERENCES
`------------------------·
`
`I
`
`Page 1 of 30
`
`Unified Patents Exhibit 1005
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 1 of 13
`
`US 2003/0073412 A1
`
`f 12
`
`MOBILE COMPUTING
`DEVICE
`
`f 13
`APPLIANCE
`
`CONTENT
`
`USER
`
`1- ...,
`PREFERENCES - -18
`
`~'--16
`
`IWIRELESSI
`
`,.
`
`CONTENT J-I' ~6
`USER
`18
`PREFERENCES 1-- I-"
`
`"'I[~~
`~-~
`
`A.
`
`I
`
`I
`
`MOBILE COMPUTING:
`DEVICE
`:
`I l
`CONTENT
`~~~~~16
`:
`USER
`PREFERENCES r--l-18
`------------------------·
`
`I
`
`Fig. 1
`
`Page 2 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 2 of 13
`
`US 2003/0073412 A1
`
`('t)
`T"""
`
`CD
`('t)
`
`::::>
`~
`a:
`0
`a.. u.
`(f) 1--
`<( z w
`1--z
`0
`0
`
`I
`I
`I
`I
`I
`I
`\
`\
`\
`\
`\
`I
`I
`I
`I
`I
`I
`I
`I
`\
`\
`\
`\
`
`CX)
`C\1
`
`0
`
`T"""
`
`0
`T"""~
`
`'
`
`Page 3 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 3 of 13
`
`US 2003/0073412 A1
`
`62
`{'
`A MOBILE COMPUTING
`DEVICE MOVES WITHIN
`PROXIMITY OF AN
`APPLIANCE AND
`ESTABLISHES WIRELESS
`COMMUNICATION WITH
`THE APPLIANCE
`f
`MOBILE COMPUTING
`DEVICE AUTOMATICALLY
`APPLIES ITS USER
`PREFERENCES TO THE
`APPLIANCE
`f
`MOBILE COMPUTING ~6
`DEVICE AUTOMATICALLY
`OR MANUALLY SELECTS
`CONTENT AVAILABLE
`THROUGH APPLIANCE
`T
`APPLIANCE PERFORMS ;a
`REQUESTED TASK USING
`SELECTED/SUPPLIED
`CONTENT AND APPLIED
`USER PREFERENCES
`
`l'ss
`
`64
`------------------------~----
`WHEN MULTIPLE
`MOBILE COMPUTING
`DEVICES ARE PRESENT,
`THE APPLIANCE AND/OR
`MOBILE COMPUTING
`DEVICES MUST DETERMINE,
`AND GRANT PRIORITY
`:
`TO ONE OF THE MOBILE
`:
`COMPUTING DEVICES
`: I
`-------------------------------
`
`I
`
`[_67
`------------------------------
`MOBILE COMPUTING
`DEVICE SUPPLIES
`CONTENT TO THE
`APPLIANCE FOR
`USE BY APPLIANCE
`
`"'
`
`Fig.3
`
`Page 4 of 30
`
`

`
`~
`~ l_j62
`
`J_j....86
`
`COMMUNICATOR
`
`I WIRELESS
`
`w8
`
`138
`
`1 1 86
`
`WIRELESS
`
`COMMUNICATQRH-
`
`132
`~ 130
`~,,106
`104
`~
`13
`
`MEDIA PLAYER
`MEMORY
`
`I DVD1
`L VCR L
`
`I VIDEO DEVICE I
`
`DISPLAY
`
`LINK
`
`COMMUNICATION
`
`NETWORK
`
`120
`
`100~
`
`14~
`
`T
`t
`80
`
`'"""' ~
`0 ......,
`~
`
`~ .....
`'JJ. =(cid:173)~
`8
`N c
`'"""'
`~-..J
`~ :-;
`.... 0 =
`0' -....
`~
`.... 0 =
`~ 't:l -....
`~ = .....
`~ .....
`""C
`
`~ .....
`
`I")
`
`~ .....
`
`I")
`
`'"""'
`>
`'"""' N
`~
`
`;:;!
`c c
`@
`N c
`'JJ.
`Cj
`
`~13
`
`174
`172
`
`PORTABLE AUDIO FILE
`
`CD
`
`MEDIA PLAYER
`SONG SEARCH
`
`170
`
`Fig.4
`
`•
`
`99
`
`-------------------------
`:
`:
`:CONTENT INTERRUPT I
`.------------------------.
`I
`ELECTRONIC PAYMENT
`
`MECHANISM
`
`MANAGER
`
`WEB SERVER
`
`DISTANCE/LOCATION
`
`IDENTIFIER
`
`MODERATOR
`CONTENTION
`
`PRIORITY
`
`SELECTOR
`CONTENT
`APPLIANCE
`INTERFACE
`
`I USER
`
`DISPLAY
`
`COMMUNICATOR
`
`WIRELESS
`
`MEMORY
`
`MOBILE COMPUTING
`
`DEVICE
`
`Page 5 of 30
`
`

`
`'"""'
`>
`'"""' N
`~
`
`;:;!
`c c
`@
`N c
`'JJ.
`Cj
`
`Fig.5
`206_...)
`
`'"""' ~
`0 ......,
`Ul
`~ .....
`'JJ. =(cid:173)~
`8
`N c
`'"""'
`~-..J
`~ :-;
`.... 0 =
`0' -....
`~
`.... 0 =
`~ 't:l -....
`~ = .....
`~ .....
`""C
`
`~ .....
`
`I")
`
`~ .....
`
`I")
`
`COOKIES
`
`-
`
`278-
`
`FAVORITES
`
`INTERNET
`
`-BROWSER
`
`276'
`IJ 208 ......
`2?2
`
`UPLOAD
`
`DOWNLOAD
`
`210~
`
`[VIDEO! ~
`204
`
`92
`
`I APPLIANCE CONTENT SELECTOR I
`
`LIST
`
`l
`
`270--....... FAX
`268
`266-r---. LAND/CELL SWITCHER
`264-~ ADDRESS BOOK
`260-r--PHONE BOOK I CALL
`
`SYNCHRONIZE
`
`COMMUNICATION
`
`iPROGRAMS
`l PLAY LIST
`RECORDER
`244' 1--PROGRAM
`242 ... HPROGRAMSI
`240~
`H NETWORK I
`
`246~
`
`248~
`
`( -DOCUMENT
`) ... -
`, ... H
`r -!DOCUMENTS I
`l DATA I
`
`RECEIVER
`SCANNER
`
`DISC DRIVE
`
`VIRTUAL
`
`EDITOR
`
`-:l~
`
`2
`
`2
`
`2
`
`2
`
`20
`
`FILE PLAYLIST
`
`PORTABLE AUDIO
`
`I
`
`2
`
`~ ~-"HPROGRAMS
`
`) ~ HsoNG LIST
`)~ H STATIONS
`
`2
`
`2
`
`2
`
`[AUDIO I
`
`2~0
`
`Page 6 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 6 of 13
`
`US 2003/0073412 A1
`
`99
`
`CONTENT INTERRUPTION MANAGER
`
`I APPLIANCE SWITCHER ~180
`
`I MULTIPLE APPLIANCE SPLITTER ~182
`
`I PERFORMANCE CONTINUITY MONITOR ~184
`
`Fig.6
`
`Page 7 of 30
`
`

`
`~ c c
`N c c
`
`'"""'
`>
`'"""' N
`~
`~
`-..J
`
`'JJ.
`Cj
`
`'"""' ~
`0 ......,
`-..J
`~ .....
`'JJ. =-~
`8
`N c
`'"""'
`;-l
`~ :-;
`=
`.... 0
`~ .....
`I")
`...
`0'
`~
`=
`.... 0
`~ .....
`~ 't:l -....
`~ = .....
`~ .....
`""C
`
`-.
`
`I")
`
`~PHONE BOOKj
`MOBILE PHONE
`
`282,
`
`~1 3
`
`]6
`
`.J.
`
`SWITCHER
`
`CALL
`
`COMMUNICATOR
`
`WIRELESS
`
`CALL LIST
`
`~
`
`86
`
`286
`
`"'
`
`~ NETWORK ~
`
`COMMUNICATOR
`
`WIRELESS
`
`SWITCHER
`
`CALL
`
`CALL LIST
`
`r---IPHONE BOOKI
`
`4
`
`s-
`~
`'
`"-..
`
`LAND PHONE
`
`281 ~ INTERNETj
`72-
`
`f
`
`COMMUNICATION
`
`LINK
`
`7\
`
`~
`
`280
`
`I
`
`.,....86
`
`COMMUNICATOR -
`
`WIRELESS
`
`DEVICE
`
`MOBILE COMPUTING
`
`~
`
`SWITCHER
`
`CALL
`
`BOOK
`PHONE
`
`MEMORY
`
`--
`
`-
`
`28
`
`'
`
`- "
`
`28
`
`8
`
`...
`
`12
`
`Page 8 of 30
`
`

`
`'"""'
`>
`'"""' N
`~
`
`~ -c c
`N c c
`
`;:;!
`
`'JJ.
`Cj
`
`'"""' ~
`0 .....,
`QtO
`~ .....
`'JJ. =(cid:173)~
`8
`N c
`'"""'
`~-..J
`~ :-;
`.... 0 =
`0' -....
`~
`.... 0 =
`~ 't:l -....
`~ = .....
`~ .....
`"'C
`
`~ .....
`
`I")
`
`~ .....
`
`I")
`
`90
`
`82
`
`80
`1
`
`16
`
`~
`
`1
`
`I
`r WEB SERVER!
`CONTROLLER
`
`360
`
`;-::;.
`
`v
`lt-~
`
`1-'
`r 0/SICONTROLLER
`
`COMMUNICATOR MEMORY
`
`WORD
`
`WIRELESS
`
`PROGRAMS
`
`82
`
`I COMPUTING WORKSTATION j
`
`....... ~
`
`""
`INTERFACE
`
`13
`
`PUBLIC USER
`
`1--'
`
`DISC DRIVE
`
`INTERNALHARD
`
`396
`\
`
`SELECTOR
`
`MEDIA EXTERNAL ONLY
`STORAGE UNRESTRICTED
`86 ,-394
`
`)
`
`-
`
`Fig.S
`
`...
`~ PROCESSOR
`
`'-.
`370
`
`DRIVE MONITOR
`
`VIRTUAL DISC
`
`PROGRAMS
`
`86-V COMMUNICATOR
`
`~ WIRELESS
`
`SEND
`DIGITAL
`
`r---
`
`MULTIFUNCTION
`
`'f
`
`---
`
`--fGRAPHICS/DATA
`
`342
`
`SERVICE PROVIDER
`
`APPLICATION
`
`340 .. 1-
`
`I WEB SITE
`
`:---
`
`36
`c:
`
`--.,
`
`358-~
`FAX
`356 ~
`~ COPY
`354-
`352 ~ SCAN
`PRINT
`350-
`PRINTER
`2~
`
`~ 11NTERNET I
`72 -
`'--..,
`
`LINK
`
`70 COMMUNICATION
`
`NETWORK
`
`~
`
`READER
`GENERIC
`
`PRESENTATION
`SPREAD SHEET
`
`PROCESSOR
`
`WORD
`
`DATA FILES
`MEMORY
`
`COMMUNICATOR
`:I
`
`WIRELESS
`
`DEVICE
`
`MOBILE COMPUTING
`
`...... 12
`
`-
`
`.....
`, ..
`
`I
`
`30
`30
`
`t--.
`
`.-
`
`336
`
`.___
`t--.
`
`~-----~--
`...
`r--
`
`-
`
`334
`332
`330
`,-
`302
`84
`
`-
`
`:~ 86
`
`Page 9 of 30
`
`

`
`'"""'
`>
`'"""' N
`~
`
`;:;!
`c c
`@
`N c
`'JJ.
`Cj
`
`'"""' ~
`0 ......,
`'0
`~ .....
`'JJ. =(cid:173)~
`8
`N c
`'"""'
`~-..J
`~ :-;
`.... 0 =
`0' -....
`~
`.... 0 =
`~ 't:l -....
`~ = .....
`~ .....
`""C
`
`~ .....
`
`I")
`
`~ .....
`
`I")
`
`1 408
`
`WEB SERVER ftt'482
`
`ENTRY
`
`ENTRY Ht-480
`
`DESKTOP
`
`~0
`
`I ENVIRONMENT
`
`94~ PRIORITY CO-NTENTION~ I INTERFACE
`
`CUSTOM
`
`424 ..
`
`1 1APPLIANCES
`.-f--1.-lHOUSEHOLD
`
`444 1
`
`PHONE
`
`AU DIONISUALj
`
`TYPE
`
`442 ...
`
`440 ....
`422
`
`434+ ~ BEDROOM
`~ OFFICE
`432...
`
`420 ...
`
`1 KITCHEN
`LOCATION
`
`430...
`
`APPLIANCE GROUPING
`
`I
`
`~
`
`404
`
`PASSWORD
`
`LOGIN/
`
`1402
`
`Fig.9
`
`AND TRANSFERS
`INTERACTIONS
`LIGHTING LEVEL
`
`VOLUME
`
`AND STATION LIST
`462
`DEFAULT PROGRAM
`406~ MEDIA SELECTION
`460-IIAUTO ACTIVATION
`
`PREFERENCES
`
`--------------------~
`
`APPLIANCE
`
`IDENTIFIER
`CONTENTION
`
`SELECTOR
`
`MODEL
`
`452
`
`I
`I
`I
`
`450 I
`
`I
`
`CONTENTION
`MODERATOR
`
`~----------
`
`T
`
`USER INTERFACE
`
`Page 10 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 10 of 13
`
`US 2003/0073412 A1
`
`502
`
`'
`
`CONTENTION
`IDENTIFIER
`
`106
`
`500
`
`\
`
`PRIORITY
`CONTENTION MODERATOR
`
`;os
`
`504
`l
`CONTENTION MODEL
`SELECTOR
`
`. .-i--
`520
`
`522 .-i--
`
`.. r-
`524
`... r-
`526
`
`.... I -
`528
`
`.-i--
`530
`
`532 .. i--
`
`534 .. -
`536 ---
`
`MODEL
`
`RULES
`IF MULTIPLE MOBILE COMPUTING DEVICES ARE
`A WITHIN RANGE OF AN APPLIANCE AND ALL MCD1S
`DESIRE SAME FUNCTION, THEN THERE IS NO
`CONTENTION
`THE FIRST MCD TO ESTABLISH COMMUNICATION
`IS THE MASTER OF THE APPLIANCE
`CLOSEST MCD CONTROLS APPLIANCE
`
`8
`c
`D
`
`E
`
`F
`
`HIGHEST PAYING MCD CONTROLS APPLIANCE
`
`MCD SELF SELECTS PRIORITY (LOW, MEDIUM, HIGH)
`
`MCD 1S TAKE TURNS
`
`G
`
`MCD GAIN PRIORITY BY VOLUME WITH PRIORITY
`SOLD AS PAY- FOR- PRIORITY ON INTERNET SITE
`MANUAL PEER-TO-PEER CONTROL: PEERS SET RULE
`H W/ PRIORITY BY TIME OF DAY/WEEK/MONTH OR
`PEER 1 > PEER 2
`GAMING RULE: IF CONTENTION, ALL CONTENDING
`MCD1S PLAY SAME GAME. WINNER GETS PRIORITY
`
`I
`
`Fig. 10
`
`Page 11 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 11 of 13
`
`US 2003/0073412 A1
`
`550
`J!
`USER PREFERENCE
`AUTO MANAGER
`
`5p8
`I
`
`DEFAULT
`SENSORY
`PARAMETERS
`
`554~
`
`RULE
`
`/
`556
`
`SENSORY
`CONTROL
`PROFILES
`
`55 2 ~
`
`MODEL
`
`A
`
`B
`
`c
`
`D
`
`E
`
`F
`
`560 1--
`l ...
`
`56
`2 ~
`
`564 ~-1--
`
`566 r--
`\-
`
`568 i-r-
`
`\ ... 1--
`570
`
`APPLY USER PREFERENCES TO UNRECOGNIZED
`APPLIANCE BASED ON SENSORY CONTROL
`PROFILES OF OTHER APPLIANCES
`
`APPLY LAST SETTINGS OF PREVIOUS
`USER OF APPLIANCE AND/OR OF
`LONGEST DURATION USER OF APPLIANCE
`
`LEARN SETTINGS AS USER PLAYS WITH
`UNRECOGNIZED APPLIANCE AND AFTER DESIRED
`SETTINGS DETERMINED, STORE SETTINGS
`AS USER PREFERENCES FOR THAT APPLIANCE
`
`USER IDENTIFIES ONE APPLIANCE AS
`MASTER APPLIANCE AND USER
`PREFERENCES OF MASTER APPLIANCE
`APPLIED TO ALL UNRECOGNIZED APPLIANCES
`
`SET DEFAULT USER PREFERENCE FOR
`EACH SENSORY PARAMETER(eg. Audio, Visual)
`AND APPLY DEFAULT USER PREFERENCES
`TO UNRECOGNIZED APPLIANCE
`
`APPLY USER PREFERENCES OF SIMILAR
`APPLIANCES FROM DATABASE OF USER
`PREFERENCES OF OTHER OWNER/USERS
`OF MOBILE COMPUTING DEVICE
`
`Fig. 11
`
`Page 12 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 12 of 13
`
`US 2003/0073412 A1
`
`>---602
`
`600
`
`(
`
`6~6
`
`MOBILE COMPUTING
`DEVICE IDENTIFIES
`UNRECOGNIZED
`APPLIANCE
`~
`MOBILE COMPUTING 604
`DEVICE ASSESSES ~-
`SENSORY CONTROL
`PROFILE OF
`UNRECOGNIZED
`APPLIANCE
`
`.-------~----~
`
`IDENTIFY EACH
`DISTINCT SENSORY
`CAPABILITY THAT
`....,.~1(--~:;.~ UNRECOGNIZED
`APPLIANCE
`INTERACTS WITH
`
`610
`
`'
`MOBILE COMPUTING 608
`l.) ~ __/
`DEVICE ACCESSES
`DATABASE OF USER
`PREFERENCES OF
`APPLIANCES TO
`FIND APPLIANCE
`WITH MOST SIMILAR
`SENSORY CONTROL
`PROFILE
`
`SENSORY
`........... '-----~--~ CONTROL-BASED
`DATABASE
`OF USER
`PREFERENCES
`FOR MOST SIMILAR
`APPLIANCE
`
`APPLY USER
`PREFERENCES TO
`UNRECOGNIZED
`APPLIANCE
`FROM MOST
`SIMILAR APPLIANCE
`IN DATABASE
`
`A
`I
`I
`I
`I
`I
`I
`
`_______ ) ___ ..
`
`620
`
`Fig. 12
`
`Page 13 of 30
`
`

`
`'"""'
`>
`'"""' N
`~
`
`;:;!
`c c
`@
`N c
`'JJ.
`Cj
`
`'"""' ~
`0 ......,
`'"""' ~
`~ .....
`'JJ. =(cid:173)~
`8
`N c
`'"""'
`~-..J
`~ :-;
`.... 0 =
`0' -....
`~
`.... 0 =
`~ 't:l -....
`~ = .....
`~ .....
`""C
`
`~ .....
`
`I")
`
`~ .....
`
`I")
`
`DATABASE
`PREFERENCE
`USER
`OWNER AND
`APPLIANCE
`
`APPLIANCE
`HAVE/USE THE UNRECOGNIZED
`TO OTHER USER/OWNERS THAT
`OF MOBILE COMPUTING DEVICE
`SIMILARITY OF USER/OWNER
`FROM DATABASE BASED ON
`SELECTING USER PREFERENCE
`
`662
`
`660
`
`658
`
`656
`
`I-
`
`KNOWN APPLIANCE
`PREFERENCE TO
`KNOWN USER
`DEVICE APPLIES
`MOBILE COMPUTING
`
`YES
`
`APPLIANCE
`THE UNRECOGNIZED
`THAT ARE SIMILAR TO
`FOR KNOWN APPLIANCES
`OF USER PREFERENCES
`TO ACCESS DATABASE
`INTERNET OR MEMORY
`APPLIANCE USE
`DEVICE AND/OR
`MOBILE COMPUTING
`
`~650
`
`652
`
`APPLIANCE
`DEVICE AND AN
`A MOBILE COMPUTING
`LINK BETWEEN
`COMMUNICATION
`WIRELESS
`ESTABLISHING A
`
`MOBILE COMPUTING DEVICE r
`
`UNRECOGNIZED APPLIANCE
`USER PREFERENCE TO
`APPLIES DATABASE-SELECTED ___________________________ j ____ I
`:
`I
`I
`
`Fig. 13
`
`668
`
`664
`
`Page 14 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`1
`
`SYSTEM AND METHOD FOR A MOBILE
`COMPUTING DEVICE TO CONTROL
`APPLIANCES
`
`[0007] Accordingly, the personalized use of one electronic
`device remains isolated and independent of personalized use
`of other electronic devices available to the user.
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`[0001] This patent application is related to the following
`Non-Provisional U.S. Patent Applications: Serial No.
`XX/XXX,XXX, entitled "Mobile Computing Device With
`Method and System for Interrupting Content Performance
`Among Appliances," having Attorney Docket No.
`100110638-1; Serial No. XX/XXX,XXX, entitled "System
`and Method for Automatically Applying a User Preference
`From a Mobile Computing Device to an Appliance," having
`Attorney Docket No. 10011639-1; Serial No. XX/XXX,
`XXX, entitled "System and Method for Determining Prior(cid:173)
`ity Among Multiple Mobile Computing Devices to Control
`an Appliance," having Attorney Docket No. 100110641-1,
`are all assigned to the same assignee as the present appli(cid:173)
`cation, and are all herein incorporated by reference.
`
`FIELD OF THE INVENTION
`[0002] The present invention relates to mobile computing
`devices, and in particular, to mobile computing devices that
`control appliances.
`
`BACKGROUND OF THE INVENTION
`[0003] Man has always tried to control his environment. In
`the last century, man has succeeded in producing totally
`controlled indoor environments complete with water, light,
`heating and cooling, sanitary plumbing, and entertainment.
`We live quite comfortably.
`[0004]
`In the last twenty years, the advent of the remote
`control has further spoiled us. We are disappointed if we
`cannot point and click to control something. We have
`separate remote controls for our TVs, stereos, and lights, as
`well as universal remote controls to permit controlling all
`these appliances with a single device.
`[0005] While a remote control can help you navigate a
`favorites list for TV programming, the favorites list is
`created through and maintained by the cable or satellite
`broadcaster, not the remote control. Accordingly, conven(cid:173)
`tional remote controls are limited to assisting a user select
`content for viewing within the framework already provided
`by the TV signal broadcaster (e.g. network, cable, satellite,
`etc). This fact makes the term remote control somewhat
`misdescriptive since they actually control very little in terms
`of content. Rather, the conventional remote control merely
`allows us to select among content that is already chosen for
`us.
`[0006] Finally, to the extent that any of our favorite media
`devices, such as radios, TVs, internet browsers/appliances,
`etc. permit personalization through favorite lists or user
`preferences, the information in these devices remain islands
`unto themselves. Users constantly re-enter favorites and
`preferences in these devices because it is not currently
`possible to carry them across devices. Moreover, when a
`user desires to use a device, such as a TV or web browser on
`a computer, in a new location such as a hotel room or
`friend's house, the user no longer has access to their
`favorites and user preferences which are stored on the same
`type of device (e.g. TV or web browser) at home.
`
`SUMMARY OF THE INVENTION
`
`[0008] An appliance control system of the present inven(cid:173)
`tion comprises an appliance and a mobile computing device
`configured for controlling the appliance by at least one of
`determining an available content for the appliance, selecting
`the content used by the appliance, and applying user pref(cid:173)
`erences to the appliance.
`
`[0009] A method of controlling an appliance of the present
`invention comprises establishing a wireless communication
`link between an appliance and a mobile computing device,
`and controlling the appliance with the mobile computing
`device including at least one of determining an available
`content for the appliance, selecting the content used by the
`appliance, and applying user preferences to the appliance.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0010] FIG. 1 is a block diagram illustrating an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0011] FIG. 2 is a diagram further illustrating an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0012] FIG. 3 is a flow diagram of a method of controlling
`an appliance, according to one embodiment of the present
`invention.
`
`[0013] FIG. 4 is a block diagram of a video device, an
`audio device, and mobile computing device of an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0014] FIG. 5 is a block diagram of an appliance content
`selector of an appliance control system, according to one
`embodiment of the present invention.
`
`[0015] FIG. 6 is a block diagram of a content interrupt
`manager of an appliance control system, according to one
`embodiment of the present invention.
`
`[0016] FIG. 7 is a block diagram of a mobile phone, a
`land-line phone, and a mobile computing device of an
`appliance control system, according to one embodiment of
`the present invention.
`
`[0017] FIG. 8 is a block diagram of a multi-function
`printer, a computing workstation, a web site and a mobile
`computing device of an appliance control system, according
`to one embodiment of the present invention.
`
`[0018] FIG. 9 is a block diagram of an user interface of an
`appliance control system, according to one embodiment of
`the present invention.
`
`[0019] FIG. 10 is a block diagram of a priority contention
`moderator of an appliance control system, according to one
`embodiment of the present invention.
`
`[0020] FIG. 11 is a block diagram of an user preference
`auto manager of an appliance control system, according to
`one embodiment of the present invention.
`
`Page 15 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`2
`
`[0021] FIG. 12 is a flow diagram of a method of applying
`user preferences across appliances, according
`to one
`embodiment of the present invention.
`
`[0022] FIG. 13 is a flow diagram of a method of applying
`to one
`user preferences across appliances, according
`embodiment of the present invention.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`[0023]
`In the following detailed description of the pre(cid:173)
`ferred embodiments, reference is made to the accompanying
`drawings which form a part hereof, and in which is shown
`by way of illustration specific embodiments in which the
`invention may be practiced. It is to be understood that other
`embodiments may be utilized and structural or logical
`changes may be made without departing from the scope of
`the present invention. The following detailed description,
`therefore, is not to be taken in a limiting sense, and the scope
`of the present invention is defined by the appended claims.
`
`[0024] Components of the wireless access control method
`and system of the present invention can be implemented in
`hardware via a microprocessor, programmable logic, or state
`machine, in firmware, or in software within a given device.
`In one aspect, at least a portion of the software programming
`is web-based and written in HTML and JAVA programming
`languages, including links to graphical user interfaces for
`data collection, such as a windows based operating system,
`and each of the main components may communicate via a
`network using a communication bus protocol. For example,
`the present invention may or may not use a TCP/IP protocol
`suite for data transport. Other programming languages and
`communication bus protocols suitable for use with the
`present invention will become apparent to those skilled in
`the art after reading the present application. Components of
`the present invention may also reside in software on one or
`more computer-readable mediums. The term computer-read(cid:173)
`able medium as used herein is defined to include any kind of
`memory, volatile or non-volatile (e.g., floppy disks, hard
`disks, CD-ROMs, flash memory, read-only memory (ROM),
`and random access memory (RAM)).
`
`[0025] Preferably, the user interfaces described herein run
`on a controller, computer, appliance or other device having
`an operating system which can support one or more appli(cid:173)
`cations. The operating system is stored in memory and
`executes on a processor. The operating system is preferably
`a multi-tasking operating system which allows simultaneous
`execution of multiple applications, although aspects of this
`invention may be implemented using a single-tasking oper(cid:173)
`ating system. The operating system employs a graphical user
`interface windowing environment which presents the appli(cid:173)
`cations or documents in specially delineated areas of the
`display screen called "windows." Each window has its own
`adjustable boundaries which allow the user to enlarge or
`shrink the application or document relative to the display
`screen. Each window can act independently, including its
`own menu, toolbar, pointers, and other controls, as if it were
`a virtual display device. Other software tools may be
`employed via the window, such as a spreadsheet for col(cid:173)
`lecting data. The operating system preferably includes a
`windows-based dynamic display which allows for the entry
`or selection of data in dynamic data field locations via an
`input device such as a keyboard and/or mouse. One pre-
`
`ferred operating system is a Windows® brand operating
`system sold by Microsoft Corporation. However, other oper(cid:173)
`ating systems which provide windowing environments may
`be employed, such as those available from Apple Corpora(cid:173)
`tion or IBM. In another embodiment, the operating system
`does not employ a windowing environment.
`[0026] An appliance control system of the present inven(cid:173)
`tion enables a mobile computing device, such as a personal
`digital assistant, to control appliances like televisions,
`radios, printers, etc. The control can take several forms
`including applying preferences to the appliance such as
`volume level, activation and deactivation along with deter(cid:173)
`mining the content available to the appliance such as sup(cid:173)
`plying a program, song, or file to be acted upon by the
`appliance. In addition, control can include simply selecting
`available content to be used by the appliance, such as
`selecting a TV channel or regularly broadcast program.
`[0027] For example, upon entry within a room, the mobile
`computing device can automatically perform these steps:
`identify an appliance like a TV; activate the TV; turn the TV
`to a channel carrying a favorite program; and select a
`preferred volume level. In the event that the favorite pro(cid:173)
`gram is not being broadcast, the mobile computing device
`can supply its own content. In particular, the mobile com(cid:173)
`puting device can retrieve an episode of that program or
`substitute a program from memory of the mobile computing
`device, transfer that stored program to the TV, and then
`command the appliance to play the program.
`[0028] Of course, the mobile computing device contains
`user preferences for all devices that the user might come into
`contact with and optionally contains virtually any content
`that the user might desire to have performed by an appliance.
`Moreover, control by the mobile computing device is not
`necessarily limited to appliances owned by the user. Rather,
`appliances situated in public places, at friends and neighbors
`homes, etc. can selectively surrender control to a mobile
`computing device. Accordingly, the user now gains unified
`control over appliances in their environment, whether at
`home or out in the world, with a single mobile computing
`device that permits automatic implementation of their user
`preferences and automatic performance of their preferred
`content on the appliances.
`[0029] With the system and method of the present inven(cid:173)
`tion, consumers are no longer relegated to seeking and
`implementing their preferences and preferred content sub(cid:173)
`ject to control by the appliances and subject to the content
`providers associated with the appliances. Rather, with the
`system and method of the present invention, the user obtains
`integrated control over the appliances, becoming the master
`of the appliances. These subservient appliances become
`tools to perform tasks using content supplied by the mobile
`computing device or conventionally supplied by an appli(cid:173)
`ance content provider.
`[0030] Moreover, user preferences and content that was
`previously isolated among independent appliances becomes
`centralized in the mobile computing device and associated
`with the user. After all, user preferences and content were
`created for the enjoyment of the user in the first place.
`Accordingly, the system and method of the present invention
`keeps the user preferences (and some content) with the user
`via the mobile computing device instead of with the appli(cid:173)
`ances, letting the user apply the preferences when and where
`
`Page 16 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`3
`
`they desire to do so without independent programming of
`each device regarding those preferences.
`
`[0031] An appliance control system 10, according to one
`exemplary embodiment of the present invention, is shown in
`FIG. 1. Appliance control system 10 includes at least one
`mobile computing device 12 operating in an environment of
`one or more appliances 13 in which mobile computing
`device 12 controls appliance 13. Both mobile computing
`device 12 and appliance 13 include content 16 and user
`preferences 18. Content 16 generally includes a song, pro(cid:173)
`gram, or any information that can be performed in a task by
`appliance 13 while user preference 18 generally includes
`preferences as to how, when and where that content 16 will
`be performed by appliances 13. Both content 16 and user
`preferences 18 are further defined throughout this applica(cid:173)
`tion in the following examples of the system and method of
`the present invention.
`
`[0032] Mobile computing device 12 is configured to select
`content 16 of appliance 13 for performance by appliance 13
`and/or configured to supply content 16 from mobile com(cid:173)
`puting device 12 (or from another source as controlled by
`mobile computing device 12) to appliance 13 for perfor(cid:173)
`mance by appliance 13. Finally, controlling appliance 13
`includes applying user preferences 18, stored on mobile
`computing device 12, to each appliance 13.
`
`[0033] As shown in FIG. 1, more than one mobile com(cid:173)
`puting device 12 can compete for control over appliance 13.
`In this situation, mobile computing device 12 and appliance
`13 determine priority between multiple computing devices
`12 for control of appliance 13, as will be described in greater
`detail later in this application. The mobile computing device
`12 that obtains priority to control appliance 13 also option(cid:173)
`ally can request, command, and/or coordinate another
`mobile computing device 12 to copy and/or transfer, all or
`a part, of its content 16 to appliance 13 and/or to the
`controlling mobile computing device 12.
`
`[0034] As shown in FIG. 2, appliances 13 in appliance
`control system 10 include, but are not limited to, video
`device 14, computing workstation 16, multifunction printer
`24, mobile phone 26, audio device 28, and web site 36.
`Appliance control system 10 further comprises household
`appliance set 40, which includes heating and cooling ther(cid:173)
`mostat 42, alarm clock 44, lighting unit 46, and beverage
`maker 48. Appliance set 40 also optionally includes con(cid:173)
`ventional household appliance controller 50, which acts an
`appliance 13, for providing local control over household
`appliances 42-48. Each of these appliances 13 and their
`interaction with mobile computing device 12 as part of
`appliance control system 10 is described in further detail in
`association with FIGS. 3-10.
`
`[0035] Appliance control system 10 is used in a method 60
`of controlling appliances, as shown in FIG. 3. Method 60
`includes a first step 62 in which mobile computing device 12
`moves within proximity of at least one appliance 13 and
`establishes wireless communication with appliance 13. First
`step 62 optionally includes mobile computing device 12
`selecting which appliances 13 it will attempt to assert
`control over.
`
`[0036] When multiple computing devices are present, then
`first step 62 further includes step 64 in which appliances 13
`and/or mobile computing devices 12 must determine priority
`
`and grant priority of control over appliances 13 to one of the
`mobile computing devices 12. Next, the master mobile
`computing device 12 automatically applies its user prefer(cid:173)
`ences to appliance 13 (step 65). Mobile computing device 12
`then automatically or manually selects content available
`through appliance 13 for performance on appliance 13 (step
`66). Step 66 also optionally includes mobile computing
`device 12 supplying content to appliance 13 for performance
`by appliance 13 (step 67).
`
`[0037] Finally, in step 68, appliance 13 performs the task
`requested by mobile computing device 12 using content 16
`selected and/or supplied by mobile computing device 12
`along with the user's preferences 18 applied by mobile
`computing device 12 to appliance 13.
`
`[0038] System 10 and method 60 of the present invention
`will now be described in further detail in association with
`FIGS. 4-10, with specific details regarding the interaction of
`mobile computing device 12 and each of appliances 13
`shown and identified in association with FIG. 2.
`
`[0039] For example, each appliance 13 in household appli(cid:173)
`ance set 40 (FIG. 2) may be controlled according to user
`preferences 18 of mobile computing device 12. When user
`with mobile computing device 12 comes within the prox(cid:173)
`imity if appliance set 40, then mobile computing device 12
`preferably causes appliance set 40 to adopt operating con(cid:173)
`ditions preferred by the user. In particular, by applying user
`preferences 18, mobile computing device 12 sets thermostat
`42 at a selected temperature and heating/cooling cycle, sets
`radio 44 at a favorite station, volume and alarm time, sets
`lighting 46 at a favorite on/off cycle and intensity level, and
`sets beverage maker 48 at a favorite on/off cycle. Finally,
`mobile computing device 12 optionally controls household
`appliance controller 50, which in turn controls one or more
`appliances 13 in household appliance set 40. Accordingly,
`mobile computing device 12 carries user preferences 18 of
`the user's ideal living environment so that mobile computing
`device 12 automatically controls the surrounding environ(cid:173)
`ment using available appliances 13 to accommodate the user
`tastes.
`
`[0040]
`In another aspect of the invention, as shown in
`FIG. 4, an appliance control system of the present invention
`includes audiovisual subsystem 80 comprising mobile com(cid:173)
`puting device 12 interacting with appliances 13, such as
`video device 14 and audio device 28. Subsystem 80 is not a
`closed system excluding the interaction of other appliances
`13 or mobile computing devices 12 but rather a convenient
`reference to identify an exemplary interaction between
`mobile computing device 12, video device 14, and audio
`device 28.
`
`[0041] Video device 14 preferably includes a television,
`movie player, or video display monitor while audio device
`28 preferably includes a stereo system, CD player, or other
`audio media player. Mobile computing device 12 preferably
`includes a personal digital assistant, or another computing
`device such as a handheld computer, laptop computer, etc.
`
`[0042]
`In this embodiment, appliance control subsystem
`80 also optionally includes network communication link 70.
`Network