(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2003/0073412 A1
`Meade, II
`(43) Pub. Date:
`Apr. 17, 2003
`
`US 20030073412A1
`
`(54) SYSTEM AND METHOD FORA MOBILE
`COMPUTING DEVICE TO CONTROL
`APPLIANCES
`
`(76) Inventor: William K. Meade II, Eagle, ID (US)
`
`C0rr6SpOnd6nc6 AddreSSI
`HEWLETT-PACKARD COMPANY
`IIltelleCtual PI‘OPEI‘tY AdmiIIiStI‘ZItiOII
`P-()- BOX 272400
`Fort Collins, CO 80527-2400 (US)
`
`(21) APPL NO:
`
`(22) Filed;
`
`09 /982 247
`’
`()CL 16, 2001
`
`Publication Classi?cation
`
`(51) Int. Cl.7 ..................................................... .. H04B 7/00
`
`(52) US. Cl. ........................................... .. 455/70; 455/3.03
`
`(57)
`
`ABSTRACT
`
`An appliance control system of the present invention com
`prises an appliance and a mobile computing device con?g
`ured for controlling the appliance by at least one of deter
`mining an available content for the appliance, selecting the
`content used by the appliance, and applying user preferences
`to the appliance.
`
`A method of controlling an appliance of the present inven
`tion comprises establishing a Wireless communication link
`betWeen an appliance and a mobile computing device, and
`controlling the appliance With the mobile computing device
`includes at least one of determining an available content for
`the appliance, selecting the content used by the appliance,
`and applying user preferences to the appliance.
`
`[12
`MOBILE COMPUTING
`DEVICE
`
`|
`
`CONTENT L, <
`\16
`USER
`PREFERENCES ‘4 8
`
`1 O
`
`/
`
`r13
`APPLIANCE
`
`IWIRELESSI
`
`>
`
`CONTENT \
`\16
`USER
`PREFERENCES *—1 8
`
`~~~~ __
`
`A
`
`12
`‘
`‘3.. __________ "Y ____ "f"--.
`EMOBILE COMPUTINGE
`5
`DEVICE
`;
`5 [@116
`USER
`l
`PREFERENCES “IP18
`
`:
`
`Page 1 of 30
`
`Unified Patents Exhibit 1009
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 1 0f 13
`
`US 2003/0073412 A1
`
`[12
`MOBILE COMPUTING
`DEVICE
`
`1o
`
`/
`
`r13
`APPLIANCE
`
`CONTENT \ <
`\16
`
`WIRELESS
`
`>
`
`uSER
`PREFERENCES ‘48
`
`CONTENT \
`\16
`
`USER
`PREFERENCES ‘48
`
`T ~~~~ __
`
`A
`
`~~~~
`
`iIvIoBILE CoMPuTINGE
`5
`DEVICE
`5
`
`E
`:
`:
`E
`
`CONTENT
`‘
`X16
`USER
`I
`PREFERENCES “F18
`
`Page 2 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 2 0f 13
`
`US 2003/0073412 A1
`
`8
`
`
`mm @mm<
`
`\ 30> mom E5202
`
`I O I I O O O O TEE
`
`or
`
`m:
`
`m_.
`
`mm
`
`0 t:
`
`Page 3 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 3 0f 13
`
`US 2003/0073412 A1
`
`[6O
`
`[62
`{64
`A MOBILE COMPUTING
`.- ---------------------------
`DEVICE MOvES WITHIN
`WHEN MULTIPLE
`I
`5
`PROXIMITY OF AN
`APPUANCE AND ——>: MOBILE COMPUTING :
`ESTABLISHES WIRELESS
`: DEVICES ARE PRESENT, ;
`COMMUMCATION WITH
`: THE APPLIANCE AND/OR :
`THE APPUANCE
`1
`MOBILE COMPUTING
`;
`5DEvICES MUST DETERMINE;
`I AND GRANT PRIORITY I
`i
`MOBILE COMPUTING <-_; TO ONE OF THE MOBILE 5
`DEVICE AUTOMATICALLY
`=____qq_M_FjI_J_T_I_I\I§ _QI_E_v_I_0_I_E_s____ _:
`APPLIES ITS USER \
`PREFERENCES TO THE 65
`APPLIANCE
`
`I. ______________________ . MOBILE COMPUTING 3
`
`
`II MOBILE COMPUTING /66
`
`i
`DEvICE SUPPLIES
`:
`DEvICE AUTOMATICALLY
`OR MANUALLY SELECTS <-_>: CONTENT TO THE
`:
`CONTENT AvAILABLE
`:
`APPLIANCE FOR
`I
`THROUGH APPLIANCE
`i
`USE BY APPLIANCE ;
`V
`"""""""""""""""" "'
`
`APPLIANCE PERFORMS 68
`REQUESTED TASK USING /
`SELECTED/SUPPLIED
`CONTENT AND APPLIED
`USER PREFERENCES
`
`Fig. 3
`
`Page 4 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 4 0f 13
`
`US 2003/0073412 A1
`
`Page 5 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 5 0f 13
`
`US 2003/0073412 A1
`
`Page 6 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 6 0f 13
`
`US 2003/0073412 A1
`
`99
`
`CONTENT INTERRUPTION MANAGER
`
`APPLIANCE SWITCHER —/1 8O
`
`MULTIPLE APPLIANCE SPLITTER -"1 82
`
`PERFORMANCE CONTINUITY MONITOR 184
`
`Fig. 6
`
`Page 7 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 7 0f 13
`
`US 2003/0073412 A1
`
`Page 8 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 8 0f 13
`
`US 2003/0073412 A1
`
`mwk
`
`mam r
`
`Page 9 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 9 0f 13
`
`US 2003/0073412 A1
`
`Page 10 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 10 0f 13
`
`US 2003/0073412 A1
`
`502
`I
`CONTENTION
`
`500
`\
`PRIORITY
`
`504
`\
`CONTENTION MODEL
`
`506
`/
`MODEL
`
`508
`/
`RULES
`IF MULTIPLE MOBILE COMPUTING DEVICES ARE
`WITHIN RANGE OF AN APPLIANCE AND ALL MCD'S
`DESIRE SAME FUNCTION, THEN THERE IS NO
`CONTENTION
`THE FIRST MCD TO ESTABLISH COMMUNICATION
`IS THE MASTER OF THE APPLIANCE
`CLOSEST MCD CoNTRoLS APPLIANCE
`
`A
`
`520"‘
`
`22,_ B
`5
`524w C
`
`526” D
`
`HIGHEST PAYING MCD CoNTRoLS APPLIANCE
`
`528'- E
`
`MCD SELF SELECTS PRICRITY (LOW, MEDIUM, HIGH)
`
`530'“ F
`
`MCD‘S TAKE TuRNS
`
`532,_ G
`
`534" H
`
`MCD GAIN PRICRITY BY VOLUME WITH PRIoRITY
`SOLD AS PAY- FOR- PRIORITY ON INTERNET SITE
`MANUAL PEER-TO-PEER CONTROL: PEERS SET RULE
`W/ PRIORITY BY TIME OF DAY/WEEK/MONTH OR
`PEER 1 > PEER 2
`
`,_ I
`536
`
`GAMING RULE: IF CONTENTION, ALL CONTENDING
`MCD'S PLAY SAME GAME. WINNER GETS PRICRITY
`
`Fig. 10
`
`Page 11 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 11 0f 13
`
`US 2003/0073412 A1
`
`550
`f
`USER PREFERENCE
`AUTO MANAGER
`
`558
`
`DEFAULT
`SENSORY
`PARAMETERS
`
`/, SENSORY
`556 CONTROL
`PROFILES
`
`MODEL
`
`RULE
`
`A
`
`B
`
`C
`
`D
`
`E
`
`560
`
`562
`
`564
`
`566"‘
`
`568-‘
`
`570
`
`APPLY USER PREFERENCES TO UNRECOGNIZED
`APPLIANCE BASED ON SENSORY CONTROL
`PROFILES OF OTHER APPLIANCES
`
`APPLY LAST SETTINGS OF PREVIOUS
`USER OF APPLIANCE AND/OR OF
`LONGEST DURATION USER OF APPLIANCE
`
`LEARN SETTINGS AS USER PLAYS WITH
`UN RECOGNIZED APPLIANCE AND AFTER DESIRED
`SETTINGS DETERMINED, STORE SETTINGS
`AS USER PREFERENCES FOR THAT APPLIANCE
`
`USER IDENTIFIES ONE APPLIANCE AS
`MASTER APPLIANCE AND USER
`PREFERENCES OF MASTER APPLIANCE
`APPLIED TO ALL UNRECOGNIZED APPLIANCES
`
`SET DEFAULT USER PREFERENCE FOR
`EACH SENSORY PARAMETER(eg. Audio, Visual)
`AND APPLY DEFAULT USER PREFERENCES
`TO UNRECOGNIZED APPLIANCE
`
`APPLY USER PREFERENCES OF SIMILAR
`APPLIANCES FROM DATABASE OF USER
`PREFERENCES OF OTHER OWNER/USERS
`OF MOBILE COMPUTING DEVICE
`
`Fig. 11
`
`Page 12 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 12 0f 13
`
`US 2003/0073412 A1
`
`MOBILE COMPUTING
`DEVICE IDENTIFIES
`UNRECOGNIZED
`APPLIANCE
`
`600
`
`_6O2
`
`6(f6
`
`IDENTIFY EACH
`DISTINCT SENSORY
`CAPABILITY THAT
`<—"—> UNRECOGNIzED
`APPLIANCE
`INTERACTS WITH
`
`l
`
`MOBILE COMPUTING 604
`DEVICE ASSESSES _/
`SENSORY CONTROL
`PROFILE OF
`UNRECOGNIZED
`APPLIANCE
`
`e10
`1
`MOBILE COMPUTING 608 /—\)\
`DEvICE ACCESSES / V
`DATABASE OF USER
`PREFERENCES OF
`SENSORY
`APP|_|ANCES T0
`<-———> CONTROL-BASED
`FIND APPLIANCE
`DATABASE
`WITH MOST SIMILAR
`0F USER
`SENSORY CONTROL
`PREFERENCES
`PROFILE
`FOR MOST SIMILAR
`
`612
`APPLY USER
`PREFERENCES TO J
`UNRECOGNIzED
`FROM MOST
`SIMILAR APPLIANCE
`IN DATABASE
`
`APPLIANCE
`
`_____ _ _ _ _ _ I
`
`T
`620
`
`l
`I
`I
`;
`
`Fig. 12
`
`Page 13 of 30
`
`

`
`Patent Application Publication Apr. 17, 2003 Sheet 13 0f 13
`
`US 2003/0073412 A1
`
`Page 14 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`SYSTEM AND METHOD FOR A MOBILE
`COMPUTING DEVICE TO CONTROL
`APPLIANCES
`
`[0007] Accordingly, the personaliZed use of one electronic
`device remains isolated and independent of personaliZed use
`of other electronic devices available to the user.
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This patent application is related to the following
`Non-Provisional US. Patent Applications: Serial No.
`XX/XXX,XXX, entitled “Mobile Computing Device With
`Method and System for Interrupting Content Performance
`Among Appliances,” having Attorney Docket No.
`100110638-1; Serial No. XX/XXX,XXX, entitled “System
`and Method for Automatically Applying a User Preference
`From a Mobile Computing Device to an Appliance,” having
`Attorney Docket No. 10011639-1; Serial No. XX/XXX,
`XXX, entitled “System and Method for Determining Prior
`ity Among Multiple Mobile Computing Devices to Control
`an Appliance,” having Attorney Docket No. 100110641-1,
`are all assigned to the same assignee as the present appli
`cation, and are all herein incorporated by reference.
`
`FIELD OF THE INVENTION
`
`[0002] The present invention relates to mobile computing
`devices, and in particular, to mobile computing devices that
`control appliances.
`
`BACKGROUND OF THE INVENTION
`
`[0003] Man has alWays tried to control his environment. In
`the last century, man has succeeded in producing totally
`controlled indoor environments complete With Water, light,
`heating and cooling, sanitary plumbing, and entertainment.
`We live quite comfortably.
`
`[0004] In the last tWenty years, the advent of the remote
`control has further spoiled us. We are disappointed if We
`cannot point and click to control something. We have
`separate remote controls for our TVs, stereos, and lights, as
`Well as universal remote controls to permit controlling all
`these appliances With a single device.
`
`[0005] While a remote control can help you navigate a
`favorites list for TV programming, the favorites list is
`created through and maintained by the cable or satellite
`broadcaster, not the remote control. Accordingly, conven
`tional remote controls are limited to assisting a user select
`content for vieWing Within the frameWork already provided
`by the TV signal broadcaster (e.g. netWork, cable, satellite,
`etc). This fact makes the term remote control someWhat
`misdescriptive since they actually control very little in terms
`of content. Rather, the conventional remote control merely
`alloWs us to select among content that is already chosen for
`us.
`
`[0006] Finally, to the eXtent that any of our favorite media
`devices, such as radios, TVs, internet broWsers/appliances,
`etc. permit personaliZation through favorite lists or user
`preferences, the information in these devices remain islands
`unto themselves. Users constantly re-enter favorites and
`preferences in these devices because it is not currently
`possible to carry them across devices. Moreover, When a
`user desires to use a device, such as a TV or Web broWser on
`a computer, in a neW location such as a hotel room or
`friend’s house, the user no longer has access to their
`favorites and user preferences Which are stored on the same
`type of device (eg TV or Web broWser) at home.
`
`SUMMARY OF THE INVENTION
`
`[0008] An appliance control system of the present inven
`tion comprises an appliance and a mobile computing device
`con?gured for controlling the appliance by at least one of
`determining an available content for the appliance, selecting
`the content used by the appliance, and applying user pref
`erences to the appliance.
`
`[0009] Amethod of controlling an appliance of the present
`invention comprises establishing a Wireless communication
`link betWeen an appliance and a mobile computing device,
`and controlling the appliance With the mobile computing
`device including at least one of determining an available
`content for the appliance, selecting the content used by the
`appliance, and applying user preferences to the appliance.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0010] FIG. 1 is a block diagram illustrating an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0011] FIG. 2 is a diagram further illustrating an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0012] FIG. 3 is a flow diagram of a method of controlling
`an appliance, according to one embodiment of the present
`invention.
`
`[0013] FIG. 4 is a block diagram of a video device, an
`audio device, and mobile computing device of an appliance
`control system, according to one embodiment of the present
`invention.
`
`[0014] FIG. 5 is a block diagram of an appliance content
`selector of an appliance control system, according to one
`embodiment of the present invention.
`
`[0015] FIG. 6 is a block diagram of a content interrupt
`manager of an appliance control system, according to one
`embodiment of the present invention.
`
`[0016] FIG. 7 is a block diagram of a mobile phone, a
`land-line phone, and a mobile computing device of an
`appliance control system, according to one embodiment of
`the present invention.
`
`[0017] FIG. 8 is a block diagram of a multi-function
`printer, a computing Workstation, a Web site and a mobile
`computing device of an appliance control system, according
`to one embodiment of the present invention.
`
`[0018] FIG. 9 is a block diagram of an user interface of an
`appliance control system, according to one embodiment of
`the present invention.
`
`[0019] FIG. 10 is a block diagram of a priority contention
`moderator of an appliance control system, according to one
`embodiment of the present invention.
`
`[0020] FIG. 11 is a block diagram of an user preference
`auto manager of an appliance control system, according to
`one embodiment of the present invention.
`
`Page 15 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`[0021] FIG. 12 is a How diagram of a method of applying
`user preferences across appliances, according to one
`embodiment of the present invention.
`
`[0022] FIG. 13 is a How diagram of a method of applying
`user preferences across appliances, according to one
`embodiment of the present invention.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`[0023] In the folloWing detailed description of the pre
`ferred embodiments, reference is made to the accompanying
`draWings Which form a part hereof, and in Which is shoWn
`by Way of illustration speci?c embodiments in Which the
`invention may be practiced. It is to be understood that other
`embodiments may be utiliZed and structural or logical
`changes may be made Without departing from the scope of
`the present invention. The folloWing detailed description,
`therefore, is not to be taken in a limiting sense, and the scope
`of the present invention is de?ned by the appended claims.
`
`[0024] Components of the Wireless access control method
`and system of the present invention can be implemented in
`hardWare via a microprocessor, programmable logic, or state
`machine, in ?rmWare, or in softWare Within a given device.
`In one aspect, at least a portion of the softWare programming
`is Web-based and Written in HTML and JAVA programming
`languages, including links to graphical user interfaces for
`data collection, such as a WindoWs based operating system,
`and each of the main components may communicate via a
`netWork using a communication bus protocol. For eXample,
`the present invention may or may not use a TCP/IP protocol
`suite for data transport. Other programming languages and
`communication bus protocols suitable for use With the
`present invention Will become apparent to those skilled in
`the art after reading the present application. Components of
`the present invention may also reside in softWare on one or
`more computer-readable mediums. The term computer-read
`able medium as used herein is de?ned to include any kind of
`memory, volatile or non-volatile (e.g., ?oppy disks, hard
`disks, CD-ROMs, ?ash memory, read-only memory (ROM),
`and random access memory
`
`[0025] Preferably, the user interfaces described herein run
`on a controller, computer, appliance or other device having
`an operating system Which can support one or more appli
`cations. The operating system is stored in memory and
`executes on a processor. The operating system is preferably
`a multi-tasking operating system Which alloWs simultaneous
`eXecution of multiple applications, although aspects of this
`invention may be implemented using a single-tasking oper
`ating system. The operating system employs a graphical user
`interface WindoWing environment Which presents the appli
`cations or documents in specially delineated areas of the
`display screen called “Windows.” Each WindoW has its oWn
`adjustable boundaries Which alloW the user to enlarge or
`shrink the application or document relative to the display
`screen. Each WindoW can act independently, including its
`oWn menu, toolbar, pointers, and other controls, as if it Were
`a virtual display device. Other softWare tools may be
`employed via the WindoW, such as a spreadsheet for col
`lecting data. The operating system preferably includes a
`WindoWs-based dynamic display Which alloWs for the entry
`or selection of data in dynamic data ?eld locations via an
`input device such as a keyboard and/or mouse. One pre
`
`ferred operating system is a Windows@ brand operating
`system sold by Microsoft Corporation. HoWever, other oper
`ating systems Which provide WindoWing environments may
`be employed, such as those available from Apple Corpora
`tion or IBM. In another embodiment, the operating system
`does not employ a WindoWing environment.
`
`[0026] An appliance control system of the present inven
`tion enables a mobile computing device, such as a personal
`digital assistant, to control appliances like televisions,
`radios, printers, etc. The control can take several forms
`including applying preferences to the appliance such as
`volume level, activation and deactivation along With deter
`mining the content available to the appliance such as sup
`plying a program, song, or ?le to be acted upon by the
`appliance. In addition, control can include simply selecting
`available content to be used by the appliance, such as
`selecting a TV channel or regularly broadcast program.
`
`[0027] For eXample, upon entry Within a room, the mobile
`computing device can automatically perform these steps:
`identify an appliance like a TV; activate the TV; turn the TV
`to a channel carrying a favorite program; and select a
`preferred volume level. In the event that the favorite pro
`gram is not being broadcast, the mobile computing device
`can supply its oWn content. In particular, the mobile com
`puting device can retrieve an episode of that program or
`substitute a program from memory of the mobile computing
`device, transfer that stored program to the TV, and then
`command the appliance to play the program.
`
`[0028] Of course, the mobile computing device contains
`user preferences for all devices that the user might come into
`contact With and optionally contains virtually any content
`that the user might desire to have performed by an appliance.
`Moreover, control by the mobile computing device is not
`necessarily limited to appliances oWned by the user. Rather,
`appliances situated in public places, at friends and neighbors
`homes, etc. can selectively surrender control to a mobile
`computing device. Accordingly, the user noW gains uni?ed
`control over appliances in their environment, Whether at
`home or out in the World, With a single mobile computing
`device that permits automatic implementation of their user
`preferences and automatic performance of their preferred
`content on the appliances.
`
`[0029] With the system and method of the present inven
`tion, consumers are no longer relegated to seeking and
`implementing their preferences and preferred content sub
`ject to control by the appliances and subject to the content
`providers associated With the appliances. Rather, With the
`system and method of the present invention, the user obtains
`integrated control over the appliances, becoming the master
`of the appliances. These subservient appliances become
`tools to perform tasks using content supplied by the mobile
`computing device or conventionally supplied by an appli
`ance content provider.
`
`[0030] Moreover, user preferences and content that Was
`previously isolated among independent appliances becomes
`centraliZed in the mobile computing device and associated
`With the user. After all, user preferences and content Were
`created for the enjoyment of the user in the ?rst place.
`Accordingly, the system and method of the present invention
`keeps the user preferences (and some content) With the user
`via the mobile computing device instead of With the appli
`ances, letting the user apply the preferences When and Where
`
`Page 16 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`they desire to do so Without independent programming of
`each device regarding those preferences.
`
`[0031] An appliance control system 10, according to one
`exemplary embodiment of the present invention, is shoWn in
`FIG. 1. Appliance control system 10 includes at least one
`mobile computing device 12 operating in an environment of
`one or more appliances 13 in Which mobile computing
`device 12 controls appliance 13. Both mobile computing
`device 12 and appliance 13 include content 16 and user
`preferences 18. Content 16 generally includes a song, pro
`gram, or any information that can be performed in a task by
`appliance 13 While user preference 18 generally includes
`preferences as to hoW, When and Where that content 16 Will
`be performed by appliances 13. Both content 16 and user
`preferences 18 are further de?ned throughout this applica
`tion in the folloWing examples of the system and method of
`the present invention.
`
`[0032] Mobile computing device 12 is con?gured to select
`content 16 of appliance 13 for performance by appliance 13
`and/or con?gured to supply content 16 from mobile com
`puting device 12 (or from another source as controlled by
`mobile computing device 12) to appliance 13 for perfor
`mance by appliance 13. Finally, controlling appliance 13
`includes applying user preferences 18, stored on mobile
`computing device 12, to each appliance 13.
`
`[0033] As shoWn in FIG. 1, more than one mobile com
`puting device 12 can compete for control over appliance 13.
`In this situation, mobile computing device 12 and appliance
`13 determine priority betWeen multiple computing devices
`12 for control of appliance 13, as Will be described in greater
`detail later in this application. The mobile computing device
`12 that obtains priority to control appliance 13 also option
`ally can request, command, and/or coordinate another
`mobile computing device 12 to copy and/or transfer, all or
`a part, of its content 16 to appliance 13 and/or to the
`controlling mobile computing device 12.
`
`[0034] As shoWn in FIG. 2, appliances 13 in appliance
`control system 10 include, but are not limited to, video
`device 14, computing Workstation 16, multifunction printer
`24, mobile phone 26, audio device 28, and Web site 36.
`Appliance control system 10 further comprises household
`appliance set 40, Which includes heating and cooling ther
`mostat 42, alarm clock 44, lighting unit 46, and beverage
`maker 48. Appliance set 40 also optionally includes con
`ventional household appliance controller 50, Which acts an
`appliance 13, for providing local control over household
`appliances 42-48. Each of these appliances 13 and their
`interaction With mobile computing device 12 as part of
`appliance control system 10 is described in further detail in
`association With FIGS. 3-10.
`
`[0035] Appliance control system 10 is used in a method 60
`of controlling appliances, as shoWn in FIG. 3. Method 60
`includes a ?rst step 62 in Which mobile computing device 12
`moves Within proximity of at least one appliance 13 and
`establishes Wireless communication With appliance 13. First
`step 62 optionally includes mobile computing device 12
`selecting Which appliances 13 it Will attempt to assert
`control over.
`
`[0036] When multiple computing devices are present, then
`?rst step 62 further includes step 64 in Which appliances 13
`and/or mobile computing devices 12 must determine priority
`
`and grant priority of control over appliances 13 to one of the
`mobile computing devices 12. Next, the master mobile
`computing device 12 automatically applies its user prefer
`ences to appliance 13 (step 65). Mobile computing device 12
`then automatically or manually selects content available
`through appliance 13 for performance on appliance 13 (step
`66). Step 66 also optionally includes mobile computing
`device 12 supplying content to appliance 13 for performance
`by appliance 13 (step 67).
`[0037] Finally, in step 68, appliance 13 performs the task
`requested by mobile computing device 12 using content 16
`selected and/or supplied by mobile computing device 12
`along With the user’s preferences 18 applied by mobile
`computing device 12 to appliance 13.
`
`[0038] System 10 and method 60 of the present invention
`Will noW be described in further detail in association With
`FIGS. 4-10, With speci?c details regarding the interaction of
`mobile computing device 12 and each of appliances 13
`shoWn and identi?ed in association With FIG. 2.
`
`[0039] For example, each appliance 13 in household appli
`ance set 40 (FIG. 2) may be controlled according to user
`preferences 18 of mobile computing device 12. When user
`With mobile computing device 12 comes Within the prox
`imity if appliance set 40, then mobile computing device 12
`preferably causes appliance set 40 to adopt operating con
`ditions preferred by the user. In particular, by applying user
`preferences 18, mobile computing device 12 sets thermostat
`42 at a selected temperature and heating/cooling cycle, sets
`radio 44 at a favorite station, volume and alarm time, sets
`lighting 46 at a favorite on/off cycle and intensity level, and
`sets beverage maker 48 at a favorite on/off cycle. Finally,
`mobile computing device 12 optionally controls household
`appliance controller 50, Which in turn controls one or more
`appliances 13 in household appliance set 40. Accordingly,
`mobile computing device 12 carries user preferences 18 of
`the user’s ideal living environment so that mobile computing
`device 12 automatically controls the surrounding environ
`ment using available appliances 13 to accommodate the user
`tastes.
`
`[0040] In another aspect of the invention, as shoWn in
`FIG. 4, an appliance control system of the present invention
`includes audiovisual subsystem 80 comprising mobile com
`puting device 12 interacting With appliances 13, such as
`video device 14 and audio device 28. Subsystem 80 is not a
`closed system excluding the interaction of other appliances
`13 or mobile computing devices 12 but rather a convenient
`reference to identify an exemplary interaction betWeen
`mobile computing device 12, video device 14, and audio
`device 28.
`
`[0041] Video device 14 preferably includes a television,
`movie player, or video display monitor While audio device
`28 preferably includes a stereo system, CD player, or other
`audio media player. Mobile computing device 12 preferably
`includes a personal digital assistant, or another computing
`device such as a handheld computer, laptop computer, etc.
`
`[0042] In this embodiment, appliance control subsystem
`80 also optionally includes netWork communication link 70.
`NetWork communication link 70, as used herein, includes an
`Internet communication link, an intranet communication
`link, or similar high-speed communication link. In one
`preferred embodiment, netWork communication link 70
`
`Page 17 of 30
`
`

`
`US 2003/0073412 A1
`
`Apr. 17, 2003
`
`includes Internet communication link 72. Network commu
`nication link 70 optionally facilitates communication
`betWeen mobile computing device 12 and appliances 13,
`such as video device 14 and audio device 28, and provides
`a route to the internet for obtaining content for performance
`by appliances 13 under the control of mobile computing
`device 12. For audio device 28 this feature Would include the
`ability to obtain audio ?les such as portable audio ?les (e.g.,
`MP3, WindoWs Meta?le, etc.) from the Web site 36 for
`performance on audio device 28.
`[0043] Mobile computing device 12 includes controller 81
`With operating system 82, memory 84, Wireless communi
`cator 86, display 88 With user interface 90, appliance content
`selector 92, priority contention moderator 94, distance/
`location identi?er 96, embedded Web server 97, electronic
`payment mechanism 98, and content interrupt manager 99.
`[0044] Controller 81 of mobile computing device 12
`includes hardWare, softWare, ?rmWare or combination of
`these. In one preferred embodiment controller 81 includes a
`computer server or other microprocessor based system
`capable of performing a sequence and logic operation and
`including memory for storing information. Controller 81
`supports and cooperates With embedded Web server 97.
`Operating system 82 preferably has the attributes and fea
`tures of the previously described operating systems.
`[0045] Memory 84 of mobile computing device 12 pref
`erably includes a high capacity random access memory
`system available on an integrated circuit chip, such as
`SDRAM, DRAM, EDO RAM, etc. Memory 84 also option
`ally comprises a miniaturiZed hard drive siZed for disposi
`tion Within mobile computing device 12 or a silicon based,
`ultra high capacity storage device, such as an atomic reso
`lution storage device, as described in Gibson et. al. US. Pat.
`No. 5,557,596, and Which is hereby incorporated by refer
`ence.
`
`[0046] Wireless communicator 86 of mobile computing
`device 12 uses one or more knoWn communication and
`application protocols such as Wireless Application Protocol
`(WAP), Bluetooth, Infrared (IrDA, FIR), 802.11, as Well as
`other communication and application protocols knoWn to
`those skilled in the art, such as UltraWideBand (UWB).
`Mobile computing device 12 includes communication hard
`Ware and softWare knoWn in the art for implementing these
`protocols, such as distance/location identi?er 96. Distance/
`location identi?er 96 also optionally incorporates or com
`municates With a global positioning satellite system (GPS)
`to provide these functions. Distance/location identi?er 96
`determines the location and distance of appliances 13 rela
`tive to mobile computing device 12 for establishing autho
`riZation and priority of mobile computing device(s) 12 to
`control appliances 13.
`
`[0047] Wireless communication protocols such as infrared
`(e.g., FIR), Bluetooth, and UltraWide Band (UWB) Which
`permit direct radio or beamed communication betWeen tWo
`or more compatible devices that operate independently of a
`netWork and independently of netWork communication link
`70. This feature permits direct one-on-one communication
`betWeen tWo similarly con?gured computing devices With
`out any communication intermediary. In the eXample of the
`Bluetooth protocol, the communication link preferably is
`established by the mere presence of each respective device
`(e.g., mobile computing device 12 and any appliance having
`
`a Wireless communicator 86) in close proximity to each
`other. This instant synchroniZation enables the devices to
`immediately communicate With each other Without taking
`time to manually establish a connection or communication
`link. Finally, if necessary, mobile computing device 12 also
`can communicate With other mobile computing devices 12
`and/or appliances 13 through more conventional indirect
`routes such as Wired or Wireless netWork links, Wired or
`Wireless Internet links, or telecommunications netWorks.
`
`[0048] User interface 90 of mobile computing device 12
`can be implemented in hardWare via a microprocessor,
`programmable logic device, or state machine, and ?rmWare,
`or in softWare. In one aspect, at least a portion of the
`softWare programming is optionally Written in Java pro
`gramming language, and user interface 90 optionally com
`municates With other mobile computing devices 12 and/or
`appliances 13 (FIG. 1) via netWork communication link 70
`using a communication bus protocol. For eXample, the
`present invention optionally can use a TCP/IP protocol suite
`for data transport. In another aspect, the present invention
`does not use a TCP/IP protocol suite for data transport. Other
`programming languages and communication bus protocols
`suitable for use With user interface 90 and appliance control
`system 10 Will be apparent to those skilled in the art, such
`as ultraWideband (UWB), Bluetooth, and infrared (e.g. FiR),
`as described in association With Wireless communicator 86.
`User interface 90 is described in further detail in association
`With FIGS. 5 and 9.
`[0049] Appliance content selector 92 of mobile computing
`device 12 operates in association With user interface 90 to
`determine What content is used or performed by appliance
`13 (FIG. 1) and Where that content is obtained. Appliance
`content selector 92 also operates in association With content
`interrupt manager 99 of mobile computing device 12 to
`control hoW and When that content is used or performed by
`appliance 13 on behalf of the user. Appliance content
`selector 92 is described in further detail in association With
`FIG. 5.
`
`[0050] Priority contention moderator 94 of mobile com
`puting device 12 is brought into play to sort priority When
`more than one mobile computing device 12 seeks to control
`a given appliance 13. Priority sorting is required since
`appliance control system 10 is an open system in Which
`multiple mobil