`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`
`
`US 6,526,335 B1
`
`Page 2
`
`US. PATENT DOCUMENTS
`
`5955979 A
`5,959,57/ A
`599709469 A
`5,970,474 A
`5,977,908 A
`5,979,757 A
`5,995,898 A
`6,009,363 A
`6,101,483 A
`
`----------------- 340/928
`9/1999 Ando 6191-
`9/1999 Fan et91~ ~~~~~~~~~~~~~~ 342/35713
`10/1999 Scroggle eta1~ ~~~~~~~~~~~~~~ 705/14
`
`10/1999 LeRoy et a1.
`.
`705/27
`11/1999 Nichols ................. 342/357.08
`11/1999 Tracy et al~
`~~~~~~~~~~~~~~~~ 235/383
`
`11/1999 Tuttle ...........
`.. 701/102
`............... 701/33
`12/1999 Beckett et a1.
`8/2000 Petrovich et a1.
`............. 705/26
`
`............... 340/988
`8/2000 Volkel et a1.
`6,104,315 A
`..... 340/905
`8/2000 Mulder et a1.
`6,111,521 A
`
`342/35709
`8/2000 Mannings ct a1.
`6,111,539 A
`10/2000 Girerd et a1.
`............... 701/213
`6,131,067 A
`11/2000 Park et a1.
`.................. 455/456
`6,148,212 A
`6,154,658 A * 11/2000 Caci
`6,163,270 A * 120000 Silverman .............. 340/825.15
`6,199,045 B1
`3/2001 Giniger et 61.
`................. 705/1
`6,233,506 B1 *
`5/2001 Obladovich et a1.
`
`* cited by examiner
`
`2
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 1 of 121
`
`US 6,526,335 B1
`
`9
`
`mo_>mo
`
`OZ_._.Dn=>_OOLL
`
`NV
`
`%NF
`
`
`
`8EEOmesoE
`
`vm>Ozm0mm=2m
`
`wm0_>mm_w
`
`sz_._.<O_ZD_>__>_OO
`
`mm=._._.=o<u_
`
`szoz<zH\(\.vm:_mo_>_oS<
`
`
`Axmlv_“.TwmmFZ<I01m=2
`
`
`
`DZ<._.Zm_._.ZOO
`
`wo_>mwm
`
`
`
`.omvmmmoSomn.
`
`oz<Ezmmfiz
`
`FzmkzooEEO
`
`ammoSoE
`
`NV
`
`
`
`om
`
` mm920:fimmFDnSOomm._bn__>_oo
`
`m._m_<EOn_._<zowmm_n_
`
`
`LWvd5:8
`
`NVvm
`
`IODOmIFMSED
`
`
`
`._.Z<m9&me
`
`m..=m_o_>_o.5<
`
`ON
`
`
`
`owmoEozoEfimC365
`
`w<wzofiowjoo
`
`jg
`
`0—.
`
`_\.07.
`
`3
`
`
`
`
`
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 2 of 121
`
`US 6,526,335 B1
`
`GPS
`
`SATELLITES
`
`46
`
`SATELLITE
`
`5V
`V
`
`66
`
`:5 48
`44“
`
`so
`
`
`ANTENNA
`
`
`
`STATION
`
`COMMUNICATIONS
`
`TERRESTWAL
`RADIO AND DATA
`
`BROADCAST
`
`44
`
`L SOURCES
`
`NETWORK (E.G., PUBLIC
`SWITCHED TELEPHONE
`
`NETWORK, INTERNET,
`
`ETC.)
`
`52
`
`
`
`
`
`
`
`58 k\\
`
`
`AUTOMOBILE
`
`ENGINE
`AUTOMOBILE
`
`
`PERSONAL COMPUTER
`
`BASE
`
`
`
`(E.G., DIN SIZED,
`
`
`
`DASHBOARD—MOUNTED,
`
`
`
`FNTENNA
`COMPONENTS TRUNK—MOUNTED, ETC.)
`
`
`
`
`
`7O
`LINK
`PHYSICAL
`
`STATION
`
`54
`
`
`
`56
`
`COMPUTING
`
`
`
`
`
`
`EQUIPMENT
`
`68
`
`
`
`LOCAL
`EQUIPMENT
`
`
`
`4
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 3 of 121
`
`US 6,526,335 B1
`
`PROCESSORISI MICROPROCESSOR
`74
`
`76
`
`DIGITAL
`SIGNAL
`PROCESSOR
`
`STORAGE
`
`HARD DRIVE
`
`82
`
`84 NON-VOLATILE
`96
`MEMORY
`
`
`86
`
`
`
`94
`DISPLAY(S) WITH
`INTERACTIVE
`D'SF’LAYS
`
`LCD DISPLAY
`SENSORS TO
`DISPLAYS (E.G.,
`
`INDICATE WHETHER
`DISPLAYS WITH
`FLATPANEL
`
`DRIVER CAN VIEW
`TOUCH SCREENS)
`D'spLAYS
`
`PER'PHERALS
`FLOPPY
`104
`SCANNER
`114
`—”'100
`DRIVE
`116
`DVD DRIVE
`102
`
`72
`
`88
`
`90
`92
`
`98
`
`
`
`
`
`
`
`
`
`PCMCIA
`
`
`INTERFACE
`172 MEMORY CARD
`FOR PC
`READER
`
`CARDS
`INTERFACE
`
`
`SMART CARD
`FOR VEHICLE
`
`READER
`ELECTRONICS 11o
`
`
`
`
`22 COMMUNICATIONS AND I/O DEVICES 132 GAME CONTROLLER
`
`
`
`
`
`POINTING
`
`DEVICE
`
`
`‘125 128
`
`
`
`KEYS (E.G.,
`
`
`ALPHANUMERIC
`
`
`KEYSAND
`
`DEDICATED KEYS)
`
`
`
`OTHER COMPONENTS
`
`
`BATTERIES
`DIGITAL
`VIDEO
`158
`SPEAKERS
`160 CAMERA CAMERA
`
`MICROPHONE
`162
`CLOCK 16:0
`READER
`
`106
`
`112
`
`118
`
`GPS
`RECEIVER
`OTHER
`REMOVABLE
`STORAGE DRIVE
`130
`
`WIRELESS COMMUNICATIONS CIRCUITRY
`TRANSMITTERS 136
`FMANTENNA 134
`146
`RECEIVERS 148138
`
`AMANTENNA 142
`
`TUNABLE
`
`LOCAL
`SATELLITE
`ANTENNA ANTENNA
`
`TRANSM'TTERS
`OTHER
`TUNABLE
`150 CELLULAR
`
`RECEIVERS 152 ANTENNA ANTENNAS
`
`154
`
`140
`
`
`TEEAESEEEER 168
`
`144
`
`FINGER PRINT 156
`
`FIG. 3
`
`108
`120
`
`24
`
`1 1
`
`
`
`
`
`5
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 4 of 121
`
`US 6,526,335 B1
`
`AUTOMOBILE
`
`PERSONAL
`
`COMPUTER
`
`
`
`14
`
`
`
`
`SENSORS AND CONTROLS FOR DRIVING—RELATED FUNCTIONS
`182
`PROX'M'TY SENSOR
`180
`188" ODOMETER SENSOR
`
`IGNITION SENSOR AND CONTROL
`DEVICES
`
`CONTROL DEVICES
`
`THROTTLE SENSOR AND
`CONTROL DEVICES
`
`CRUISE CONTROL SYSTEM
`
`184
`186
`
`198
`194
`
`ABS SENSOR AND
`CONTROL DEVICES
`
`BRAKE SENSOR AND
`CONTROL DEVICE
`
`196
`
`192..
`
`INERTIAL AND
`COMPASS SENSORS
`
`SENSORS AND CONTROLS FOR OTHER FUNCTIONS 214
`FUEL LEVEL SENSOR
`OIL LEVEL
`
`
`
`
`
`
`
`MEERSOSNET'gOLR
`
`
`
`DEVICES
`
`OTHER DIAGNOSTIC
`SENSORS
`HEAT AND AIR
`CONDITIONING
`SENSOR AND
`CONTROL
`DEVICES
`202
`DOOR LOCK SENSOR
`
`HEADLIGHTS SENSOR
`
`AND CONTROL DEVICE
`228
`210
`EXTERIOR
`TEMPERATURE SENSOR
`AUTOMOBILE
`220
`BATTERY SENSOR
`VEHICLE
`226
`DIAGNOSTIC
`
`SYSTEM
`
`200
`
`AND CONTROL DEVICES
`
`FIG. 4
`
`
`2§162 AND CONTROL DEVICES
`208 TRUNK SENSOR AND
`CONTROL DEVICES
`
`
`
`
`
`
`
`
`
`
`
`
`SENSOR
`ENGINE
`TEMPERATURE
`
`SENSOR
`
`222
`
`205
`204
`
`ELECTRICAL
`SYSTEMS
`224
`SENSORS
`AIRBAG SENSORS
`WINDOW
`
`SENSOR AND
`
`CONTROL
`
`DEVICES
`
`
`6
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 5 of 121
`
`US 6,526,335 B1
`
`230
`
` MOVEABLE
`
`DISPLAY
`
`
`
`/'
`
`POSITION
`
`
`SENSOR
`\
`
`
`DRIVE R'S
`
`
`PASSENGER'S
`
`
`
`
`
`VIEW
`
`VIEW
`
`
`232
`
` FRONT-SEAT AREA
`
`FIG. 5
`
`7
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 6 of 121
`
`US 6,526,335 B1
`
`wmm
`
`mmOzwmm<m
`
`._<.rz.n.=>_m_._n_n_3w
`
`QZ<><41W5
`
`
`
`._._ZD._.Dn_z_
`
`m..=mO_>_O.rD<
`
`._<zOmmm_n_
`
`mmzbn—EOO
`
`
`
`._m_z<n_PZOWE
`
`><._n_m_n_
`
`3
`
`._.<m_w-._.zomn_
`
`<mm<
`
`._.<m_m-m_<m_m_
`
`
`
`><._n_.w_ommOzmmw<m
`
`
`
`mo<u_m_m_._.z_._.sz_DZ<
`
`._.<m_w-m<m_m
`
`
`
`>63memm02mmw<m
`
`
`
`m0<n_mm_._.z_._.Dn_z_Qz<
`
`m.OE
`
`
`
`<mm<._.<m_w-m<m_m
`
`8
`
`
`
`
`
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 7 of 121
`
`US 6,526,335 B1
`
`FRONT-SEAT
`
`AREA
`
`
`
`AUTOMOBILE
`
`PERSONAL
`
`240
`
`
`
`UNIT
`
`
`COMPUTER
`
` COMPUTER
`246
`244
`
`COMPUTER
`
`
`
`DISPLAY
`
`SPEAKER
`
`
`
`USER INPUT
`
`DEVICES
`
`MICROPHONE
`
`248
`
`
`
`
`
`
`
`
`REAR—S EAT
`
`AREA
`
`TRUN K AREA
`
`FIG. 7
`
`SUPPLEMENTAL
`
`254
`
`PROCESSOR
`
`9
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 8 of 121
`
`US 6,526,335 B1
`
`BUTTONS
`
`DISPLAY
`
`FIG.8
`
`10
`
`UJ
`
`z O I L
`
`L 0 n
`
`: 2 2
`
`10
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 9 of 121
`
`US 6,526,335 B1
`
`00000
`
`FIG.9
`
` OPTIONS
`
`270
`
`a,
`
`Z O|
`
`_
`|_
`
`O
`
`11
`
`Dm
`
`11
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 10 of 121
`
`US 6,526,335 B1
`
`><._n_w_n_
`
`owN
`
`
`
`o_‘.OE
`
`
`
`zO_._.<_>_mOn_z_mNN
`
`12
`
`
`
`
`
`ZOFQOm._.0m_._m_wmwm:
`
`
`
`2mmmomIODOFmnm
`
`ZO_._.n_O
`
`9mm
`
`12
`
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 11 of 121
`
`US 6,526,335 B1
`
`ijflrmZTMMmD
`
`zO_._.<0_._n_n_<
`
`ZO_._.<O_._n_n_<
`
`ZO_._.<O_._n_n_<
`
`ZO_._.<O_._n_n_<
`
`Om.._._<._.wz_-m_m_m3
`
`
`
`_>_m_._.w>mOz_.r<m_m_n_0
`
`Z..07.
`
`Nmm
`
`va
`
`13
`
`13
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 12 of 121
`
`US 6,526,335 B1
`
`
`
`
`(E.G., WIRELESS
`290
`UNKORVWRED
`
`
`
`
`
`
`
`ALLOW USER TO CONNECT
`
`
`
`
`
`
`
`
`ESTABUSHIJNK
`
`LINK) WITH
`COMPUTER (E.G.,
`REMOTE SERVER,
`PERSONAL
`
`COMPUTER,
`HANDHELD
`
`
`
`
`
`
`
`
`MEMORY CARD OR CD, OR
`OTHER REMOVABLE
`
`STORAGE MEDIA
`
`CONTAINING NEW
`
`
`COMPUTER, ETC.)
`
`
`
`AUTOMOBILE PERSONAL
`
`
`COMPUTER DRIVE, CARD
`
`DOWN LOAD
`
`PERIPHERAL
`
`
`
`
`SOFTWARE TO BE ADDED
`
`TO APPROPRIATE
`
`
`
`READER OR OTHER
`
`SOFTWARE
`
`
`296
`
`
`USER
`
`CONNECTS
`
`
`
`
`
`
`INSTALL NEW SOFTWARE ONTO HARD DRIVE OF
`
`AUTOMOBILE PERSONAL COMPUTER OR OTHER
`
`SUITABLE STORAGE
`
`292
`
`
`FIG.
`
`12
`
`14
`
`14
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 13 of 121
`
`US 6,526,335 B1
`
`CELLULAR
`
`TELEPHONE
`
`DEDICATED
`
`316
`
`IN-VEHICLE
`
`REMOTE
`
`CONTROL)
`
`IR PORT
`
`USB PORT
`
`CIRCUITRY
`
`
`
`
`DEVICE (E.G., KEY
`
`
`
`EXTERNAL
`CHAIN DEVICE OR
`
`
`
`
`
`
`
`
`AUTOMOBILE PERSONAL
`COMPUTER
`
`
`304
`300
`
`
`
`WIRELESS
`COMMUNICATIONS
`
`
`31$
`
`COMMUNICATIONS
`NETWORK (E.G.,
`310
`
`THE INTERNET)
`
`
`305
`
`
`
`
`
`
`USER COMPUTING
`DEVICE (E.G.,
`
`NOTEBOOK
`
`
`
`
`COMPUTER, LAPTOP
`COMPUTER,
`HANDHELD
`COMPUTING DEVICE,
`
`
`
`
`
`ETC.)
`
`ELECTRONIC
`
`DEVICE
`
`
`
`313
`
`298
`
`312
`
`FIG. 13
`
`15
`
`15
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 14 of 121
`
`US 6,526,335 B1
`
`“.0825%55%
`
`
`
`228%.“.550.293
`
`02_oz<zo>mmmSmgoo
`
`
`
`.66bmmmdmzsmozEmw
`
`#59moBszz.E5
`
`
`
`22:mmmzmm?
`
`0%x23sz_._.<O_ZD_>=>_OO
`
`
`
`
`
`KMHDQEOO4<zowmwam.=mO_>_O._.3<
`
`m.__mo_>_oS<nomozEmm33%
`
`
`
`
`
`1:;3:55.00228me
`
`
`
`
`
`
`
`Im_._m_<._.mm
`
`
`own.1..0_n_wmm
`
`szoz<z.om;mo_>m_ooz_5n=>_oo
`
`
`
`
`
`xoommzbz.mo_>mo02.53200
`
`m_10.12,GB.mmszoo
`
`35020:?miohomBmzzoo
`
`
`
`5:528228me
`
`16
`
`16
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 15 of 121
`
`US 6,526,335 B1
`
`mOZ_._.._.mw
`
`
`
`
`
`
`
`
`
`
`Eimmmmofi35
`.__<_>_-m8Ummmmoo<.__<_>_-m_5.550%m_zO._.O_DD<w02_._.._.m_mFawn—.1
`
`
`IazfizooExoomifltjmbqwv2925
`
`
`
`
`
`mmEbQEOO._<zOmmm_n_m..__mO_>_O._.D<.532”?
`
`EmmaoS<mozEmm05$.
`
`.38:
`
`man
`
`ea;
`
`9%8i05$.to2%:
`
`ix:m20.25EENzoEfimI
`
`_‘ZO_._.<._.w
`
`E2925
`
`2.GE
`
`17
`
`17
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 16 of 121
`
`US 6,526,335 B1
`
` COMMUNBAWONS
`N ETWORK
`
`USER
`
`DEVEE
`
`COMPUWNG
`
`
`
`
` ACCOUNT
`
`DATABASE
`AUTOMOBKE
`
`
`
`PERSONAL
`COMPUTER
`
`
`
`12
`
`14
`
`
`
`CONTENT
`
`SOURCES
`
`ORDER
`
`FACKHY
`
`
`
`PROCESSNG
`
`
`
`
`SERWCEPROVDER
`
`346
`
`FIG. 16
`
`18
`
`18
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 17 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE
`
`
`
`PERSONAL COMPUTER TO
`
`
`
`LISTEN FOR WIRELESS
`
`
`
`
`354
`
`COMMUNICATIONS FROM
`
`
`
`KEY CHAIN DEVICES
`
`
`USER
`
`SENDS
`
`
`COMMANDS
`
`
`
`AUTOMOBILE PERSONAL
`COMPUTER OPENS DOOR LOCKS,
`
`
` 356
`
`
`
`WIPERS, HEADLIGHTS, ETC. IN
`RESPONSE TO COMMANDS FROM
`
`STARTS ENGINE, CONTROLS
`
`WIRELESS KEY CHAIN DEVICE
`
`
`
`USE WIRELESS KEY CHAIN
`
`DEVICE TO CONTROL DEVICES
`
`IN HOME (E.G., DOOR LOCKS,
`LIGHTS, GARAGE DOOR, ETC.
`USING SAME WIRELESS
`
`
`
`
`
`
`
` 358
`
`
`
`KEYCHAIN DEVICE)
`
`FIG. 17
`
`19
`
`19
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 18 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL
`
`COMPUTER TO LISTEN FOR
`
`INFRARED OR R.F. WIRELESS
`
`COMMANDS FROM IN-VEHICLE
`
`REMOTE CONTROL
`
`
`
`TUNE TO RADIO STATIONS,
`
`CHANGE VOLUME, MUTE AUDIO,
`CHANGE SETTINGS, ETC.
`
`BASED ON REMOTE CONTROL
`
`COMMANDS
`
`360
`
`362
`
`FIG. 18
`
`20
`
`20
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 19 of 121
`
`US 6,526,335 B1
`
`THIN SERVER 2
`
`32
`
`
`
`DEDICATED
`
`COMMUNICATIONS
`
`DEVICE (E.G.,
`SHARED-ACCESS
`MODEM)
`
`HANDHELD
`
`COMPUTING
`
`DEVICE
`
`386
`
`PERSONAL
`COMPUTER
`
`SECURITY
`SYSTEM
`
`HANDHELD
`
`COMPUTING
`
`DEVICE
`
`WEB APPLIANCE
`APPLIANCE
`
`HOME SENSORS
`AND CONTROL
`DEVICES
`
`HOME SENSORS
`AND CONTROL
`DEVICES
`
`DEDICATED ELECTRONIC INFORMATION AND CONTROL
`APPLIANCE (E.G., DEDICATED FLAT PANEL DEVICE
`WITH ITS OWN WIRELESS TRANSMITTER AND
`
`RECEIVER OR ITS OWN MEMORY
`
`366$ REMOTE ALOCAL
`
`368
`
`AUTOMOBILE
`
`
`
`
`PERSONAL
`
`COMPUTER
`
`14
`
`FIG. 19
`
`21
`
`21
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 20 of 121
`
`US 6,526,335 B1
`
`416
`
`400
`
`LEAVE HOME
`
`CHECK NEWS
`
`418
`
`TONIGHT -- INCREASING CLOUDS, CHANCE OF SNOW
`
`YOU HAVE 3
`MESSAGES
`
`READ
`
`FORWARD
`
`YOU HAVE NO
`VOICE MAIL
`
`MESSAGES
`
`TIME IS 7:05 AM CURRENT TEMPERATURE
`
`IS 28° COLD, WINDY, HIGH 32°
`
`FIG. 20
`
`22
`
`22
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 21 of 121
`
`US 6,526,335 B1
`
`mm_<._.wn_300
`
`0N.“V
`
`_\N.9“—
`
`23
`
`._.Dn_
`
`n5m_¥<>>
`
`m=>_OI
`
`
`
`m<0._.m<._.m
`
`
`
`O...m=>_OI
`
`.rmmm
`
`23
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 22 of 121
`
`US 6,526,335 B1
`
`444
`
`SPEAKER
`
`430
`
`442
`
`INFORMATION REGION
`
`TUNER
`
`START CAR
`
`GET MAIL
`
`NEWS
`
`446
`
`FIG. 22
`
`24
`
`24
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 23 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`.=<_>_-m_DZ<.=<_>_m0_O>
`
`DZ<m3._.<._.w
`
`
`
`290mmZOF<_>_W_OH_Z_
`
`m3
`
`MZOImmjmt.
`
`._.mwoZ<I
`
`“ED213;.“ECZKD...
`
`
`
`._.<m=._w._.10_._
`
`mmv
`
`mm.®_n_
`
`
`
`mmvvmv
`
`Nm¢
`
`25
`
`25
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 24 of 121
`
`US 6,526,335 B1
`
`PROVIDE OPTION ON REFRIGERATOR -
`
`MOUNTED FLAT-PANEL DISPLAY OR
`OTHER lN-HOME DEVICE TO OPEN
`
`460
`
`GARAGE DOOR, START CAR, SHUT OFF
`
`LIGHTS IN HOME, ADJUST HOME
`
`HEATING AND AIR CONDITIONING, ETC.
`
`
`USER SELECTS OPTION
`
`USE IN—HOME APPLIANCE TO SEND
`
`COMMANDS TO AUTOMOBILE
`
`PERSONAL COMPUTER TO ENSURE
`
`THAT IN—HOME FUNCTIONS ARE
`
`PERFORMED
`
`462
`
`FIG. 24
`
`26
`
`26
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 25 of 121
`
`US 6,526,335 B1
`
`PROVIDE USERS WITH OPPORTUNITY TO
`CREATE OR PROVIDE PERSONAL
`IDENTIFICATION NUMBER (PIN), PASSWORD
`(ALPHANUMERIC OR SPOKEN WORD), OR
`OTHER UNIQUE IDENTIFIER (E.G. VOICE
`PRINT, FINGERPRINT, ETC.)
`
`IDENTITY
`
`USE PIN, PASSWORD, VOICE PRINT,
`FINGERPRINT, OR OTHER SECURITY CODE
`OR PHYSICAL TRAIT TO VERIFY USER'S
`
`464
`
`466
`
`FIG. 25
`
`27
`
`27
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 26 of 121
`
`US 6,526,335 B1
`
`468
`
`PROVIDE USER WITH PROMPT ASKING
`
`USER TO PROVIDE USER ID AND
`
`PASSWORD
`
`470
`
`USE USER ID AND PASSWORD TO
`
`VERIFY IDENTITY OF USER
`
`FIG. 26
`
`28
`
`28
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 27 of 121
`
`US 6,526,335 B1
`
`DETERMINE USER'S
`
`LOCATION
`
`
`
`PROVIDE USER WITH OPPORTUNITY
`
`TO INPUT DIRECTIONS (E.G., USING
`TOUCH SCREEN, SCREEN WITH
`TRACK BALL, PAD—BASED DEVICE, OR
`OTHER USER INTERFACE)
`
`PROVIDE USER WITH DIRECTIONS
`
`BASED ON SELECTED DESTINATION
`
`474
`
`476
`
`FIG. 27
`
`29
`
`29
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 28 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`AUTOMOBILE (E.G., USING GPS
`RECEIVER IN AUTOMOBILE
`
`DETERMINE LOCATION OF
`
`PERSONAL COMPUTER)
`
`
`
`480
`
`
`DETERMINE WHICH STATE THE
`
`
`VEHICLE IS LOCATED IN AND
`
`DETERMINE WHETHER VEHICLE IS
`
`
`
`
`BEING DRIVEN OR IS PARKED
`
`
`
`482
`
`CONTROL THE DISPLAY OR VISUAL
`
`INFORMATION BASED ON LAWS OF THE
`
`
`
`
`
`
`
`
`
`
`
`STATE THE VEHICLE IS LOCATED IN (E.G., NO
`GRAPHICAL INFORMATION, ONLY DRIVING-
`
`RELATED GRAPHICAL INFORMATION, ETC.)
`AND WHETHER OR NOT THE VEHICLE IS
`
`BEING DRIVEN OR IS PARKED
`
`FIG. 28
`
`30
`
`30
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 29 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`.O._.m___>5_n_<_.m.FEOQm—Zr_._<_>_
`$20:85«GEE;
`
`mmo<mm
`
`mugmozoS/u
`
`20.209
`
`x
`
`mkszmwa—msauxx
`
`m9»
`
`wwv
`
`
`
`._.O..022N111
`
`m.=m0_>_0.r:<
`
`m.=mO_>_O.rD<
`
`._<ZO.ww_m_n_
`
`mm.._.Dn=>_Oo
`
`mm.0_n_
`
`31
`
`31
`
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 30 of 121
`
`US 6,526,335 B1
`
`BROADCAST GPS SIGNALS
`
`500
`
`OBTAIN GPS POSITION SIGNAL
`
`FROM SATELLITES AND CLOCK
`
`SIGNALS
`SIGNAL
`ON GPS POSITION SIGNAL
`ALERT DRIVER
`
`502
`
`504
`
`506
`
`508
`
`CORRECT ERRORS IN ON-BOARD
`
`CLOCK USING GPS CLOCK
`
`DETERMINE LOCATION BASED
`
`DETERMINE CURRENT TIME ZONE
`
`BASED ON GPS LOCATION AND
`
`UPDATE CLOCK ACCORDINGLY,
`
`FIG. 30
`
`32
`
`32
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 31 of 121
`
`US 6,526,335 B1
`
`MONITOR LOCATION TO
`
`DETERMINE WHETHER USER IS
`
`ABOUT TO ARRIVE HOME
`
`HEATING OR AIR CONDITIONING
`
`510
`
`512
`
`514
`
`USE AUTOMOBILE PERSONAL
`
`COMPUTER TO OPEN GARAGE
`
`DOOR AND TURN ON LIGHTS,
`
`ADJUST HEATING AND AIR
`
`CONDITIONING IN ANTICIPATION OF
`
`USER'S ARRIVAL
`
`IF USER PASSES HOME WITHOUT
`
`STOPPING, CLOSE GARAGE DOOR
`AND TURN OFF LIGHTS, ADJUST
`
`FIG. 31
`
`33
`
`33
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 32 of 121
`
`US 6,526,335 B1
`
` 516
`
`PROVIDE USER WITH OPPORTUNITY TO
`ESTABLISH ACTIONS TO BE TAKEN WHEN
`
`
`
`CERTAIN VEHICLE CONDITIONS ARE DETECTED
`
`SUCH AS AIRBAG DEPLOYMENT, RAPID
`
`
`
`
`DECELERATION, HIGH SPEED, ROAMING OUTSIDE
`OF A SPECIFIED RANGE, STARTING OF ENGINE,
`EXCEEDING SPEED LIMITS, FOLLOWING TOO
`
`
`
`
`CLOSE BEHIND VEHICLES, ETC.
`
`
`
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`MONITOR VEHICLE CONDITIONS
`
`518
`
`520
`
`
`
`TAKE SPECIFIED ACTIONS (E.G., E-MAIL
`
`
`NOTIFICATION TO USER, CALL PLACED OR MESSAGE
`SENT TO PERSONNEL AT SERVICE PROVIDER,
`
`
`
`
`ETC.)
`
`
`
`POLICE OR EMERGENCY SERVICES NOTIFIED,
`CENTRAL OFFICE NOTIFIED, UPDATE WEB PAGE,
`
`FIG. 32
`
`34
`
`34
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 33 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO
`
`DIRECT AUTOMOBILE PERSONAL COMPUTER
`
`TO MONITOR SPEED OF AUTOMOBILE
`RELATIVE TO SPEED LIMITS AND TO MONITOR
`
`WHEN AUTOMOBILE IS DRIVEN
`
`AUTOMOBILE PERSONAL COMPUTER
`DETERMINES DATE AND TIME AND MONITORS
`DRIVER BY DETERMINING LOCATION AND
`SPEED OF VEHICLE AND BY COMPARING
`MEASURED SPEED TO SPEED LIMITS IN
`
`DATABASE AND AUTOMOBILE PERSONAL
`
`COMPUTER GENERATES REPORTS OR
`
`NOTIFICATIONS
`
`524
`
` 522
`
`PROVIDE RESULTS OF MONITORING TO USER
`(E.G., BY E—MAIL OR BY MAKING AVAILABLE AT
`WEB SITE OR THE LIKE)
`
`526
`
`FIG. 33
`
`35
`
`35
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 34 of 121
`
`US 6,526,335 B1
`
`528
`
`USE DEFAULT TRACKING SETTING OR PROVIDE
`
`TRACKING FEATURE
`
`USER WITH OPPORTUNITY TO INVOKE VEHICLE
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT
`
`FORMATS AND DESTINATIONS FOR
`
`NOTIFICATIONS (E.G., BY E-MAIL, ADDRESSES,
`TELEPHONE NUMBERS, PAGING NUMBERS, ETC.)
`
`530
`
`534
`
`MONITOR SENSORS TO DETERMINE IF VEHICLE IS
`STOLEN
`
`532
`
`IF VEHICLE IS STOLEN, TRACK LOCATION, NOTIFY
`USER, SERVICE PROVIDER, AND POLICE OF
`THEFT, TIME OF THEFT, LOCATION OF THEFT,
`PRESENT LOCATION OF VEHICLE, ETC. (E.G.,
`USING E—MAIL, MESSAGES, PAGING
`NOTIFICATIONS, ETC.)
`
`FIG. 34
`
`36
`
`36
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 35 of 121
`
`US 6,526,335 B1
`
`USE DEFAULT SAFETY MODE OR ALLOW USER TO
`
`PLACE AUTOMOBILE PERSONAL COMPUTER IN A
`
`SAFETY MODE
`
`INTERACT WITH USER TO KEEP USER ENGAGED IN
`
`ACTIVITIES AND TO ASSESS DRIVER FATIGUE
`NOT ALERT
`
`MONITOR USER'S BEHAVIOR WITH VIDEO CAMERA
`
`MICROPHONE, DRIVING-RELATED SENSORS, ETC. TO
`DETERMINE WHETHER USER IS ALERT OR FATIGUED
`
`NOTIFY USER AND TAKE OTHER APPROPRIATE
`
`ACTIONS WHEN IT IS DETERMINED THAT THE USER IS
`
`536
`
`538
`
`540
`
`542
`
`FIG. 35
`
`37
`
`37
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 36 of 121
`
`US 6,526,335 B1
`
`CAPTURE IMAGES USING DIGITAL CAMERA AND
`
`GATHER OTHER VEHICLE INFORMATION
`
`AUTOMOBILE PERSONAL COMPUTER SUPPLIES
`
`IMAGES AND VEHICLE INFORMATION TO SERVER ON
`
`USING WEB BROWSER)
`
`INTERNET
`
`PROVIDE USER WITH OPPORTUNITY TO ACCESS
`
`IMAGES AND OTHER VEHICLE INFORMATION (E.G.,
`
`FIG. 36
`
`38
`
`38
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 37 of 121
`
`US 6,526,335 B1
`
`MONITOR VEHICLE PERFORMANCE (E.G.,
`SPEED, ODOMETER, FUEL USAGE,
`DIAGNOSTIC CODES, ETC.)
`
`AND MAINTENANCE HISTORY, ETC.
`
`550
`
`552
`
`554
`
`COLLECT SERVICE INFORMATION (E.G.,
`MAINTENANCE RECORDS, ETC.)
`
`USE SERVER TO PROVIDE WEB PAGE TO
`
`USER THAT CONTAINS PERFORMANCE
`
`STATISTICS, MAINTENANCE RECORDS,
`
`WARRANTY INFORMATION,
`
`RECOMMENDED MAINTENANCE, ETC.
`
`BASED ON AUTOMOBILE PERSONAL
`
`COMPUTER'S MEASURED PERFORMANCE
`
`FIG. 37
`
`39
`
`39
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 38 of 121
`
`US 6,526,335 B1
`
`
`
`mommmes.3H1525gm:mo<mm><
`
`
`08%Hmoi:m<omo<mm><”50>
`wmmonm0mm
`
`I'mFzmmmmn.”9
`
`«88mm;mz_”m02<zosobmz
`
`mm.07.
`
`40
`
`
`
`
`
`n_>_Ow_n_00.1mmm__>__._.
`
`40
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 39 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY
`
`TO CREATE, EDIT, ORGANISE, AND
`
`PLAY BACK VOICE MEMOS
`
`PROVIDE USER WITH OPPORTUNITY TO
`
`
`
`FORWARD VOICE MEMOS AND OTHER
`
`AUTOMOBILE PERSONAL COMPUTER
`
`CONTENT TO COMPUTER EQUIPMENT
`
`IN HOME OR OFFICE VIA LOCAL OR
`
`REMOTE WIRELESS COMMUNICATIONS
`
`(E.G., USING CORRESPONDING
`"FORWARD" OR DEDICATED "SYNC-TO-
`
`ALL" BUTTON)
`
`572
`
`574
`
`FIG. 39
`
`41
`
`41
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 40 of 121
`
`US 6,526,335 B1
`
`AUTOMOBILE PERSONAL COMPUTER
`DETECTS VEHICLE IS BEING DRIVEN
`
`INFORM E-MAIL SERVICE OF USER'S
`PRESENT LOCATION IN VEHICLE
`
`
`
`E—MAIL SERVICE AUTOMATICALLY
`DIRECTS USER'S E-MAIL (OR COPIES) TO
`VEHICLE
`
`NOTIFY USER WHEN E-MAIL ARRIVES OR
`IF THERE IS E-MAIL THAT HAS NOT BEEN
`READ SINCE LAST TIME VEHICLE WAS
`
`DRIVEN
`
`576
`
`578
`
`580
`
`582
`
`FIG. 40
`
`42
`
`42
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 41 of 121
`
`US 6,526,335 B1
`
`USE DEFAULTS AND/OR PROVIDE
`
`584
`
`USER WITH OPPORTUNITY TO SET
`
`UP ALERTS
`
`PROVIDE ALERT TO USER THAT
`
`MESSAGES OR OTHER CONTENT IS
`
`AVAILABLE
`
`586
`
`USER SELECTS
`
`DESIRED CONTENT
`
` 588
`
`PROVIDE SELECTED CONTENT TO
`
`USER
`
`FIG. 41
`
`43
`
`43
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 42 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO RECORD
`
`VOICE MEMOS
`
`CARD OR COMPUTER (E.G., WIRELESSLY)
`
`PROVIDE USER WITH OPPORTUNITY TO ORGANIZE
`
`VOICE MEMOS AS A CALENDAR AND PROVIDE
`
`USER WITH OPPORTUNITY TO PLAY BOTH VOICE
`
`MEMOS AND EXPORT VOICE MEMOS TO MEMORY
`
`FIG. 42
`
`44
`
`44
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 43 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT
`E-MAIL ALERT FUNCTIONS (E.G. AUTOMATIC
`REPLY, REDUCE AUDIO VOLUME, TONE , VOICE
`
`CLIP, MP3 FILE NOTIFICATION, ETC.)
`
`
`TRANSMIT E-MAIL TO AUTOMOBILE PERSONAL
`
`COMPUTER
`
`594
`
`596
`
`598
`
`ALERT USER OF E-MAIL USING USER-SELECTED
`
`ALERT TECHNIQUE
`
`AUTO REPLY TO EMAIL (E.G., WITH ATTACHED TEXT
`MESSAGE OR AUDIO CLIP)
`
`600
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT ONE
`
`OF MULTIPLE PREDEFINED REPLIES TO USE IN RESPONDING TO THE EMAIL
`
`REPLY USING SELECTED REPLY MESSAGE
`
`602
`
`604
`
`PROVIDE USER WITH OPPORTUNITY TO FORWARD
`
`606
`
`E-MAIL TO WORK, ETC.
`
`FIG. 43
`
`45
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 44 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO REGISTER
`
`WITH SERVICE PROVIDER (E.G., BY SUPPLYING
`AUTOMOBILE PERSONAL COMPUTER IDENTIFIER AND
`
`USER INFORMATION TO SERVICE PROVIDER)
`
`
`
`
`
`
`USING USER DEVICE (E.G., PERSONAL COMPUTER.
`WEB APPLIANCE, HANDHELD COMPUTING DEVICE,
`ETC.) PROVIDE USER WITH OPTION (E.G. AN ON-
`SCREEN OPTION) TO INITIATE REMOTE VEHICLE
`CONTROLS (E.G., UNLOCK DOOR, START ENGINE,
`ETC.)
`
`
`
`
`
`
`
`608
`
`610
`
`612
`
`614
`
`VERIFY USER'S IDENTITY AT USER DEVICE OR
`
`SERVICE PROVIDER
`
`
`
`TRANSMIT REMOTE VEHICLE CONTROL COMMANDS
`
`TO VEHICLE (E.G., TO AUTOMOBILE PERSONAL
`COMPUTER) TO UNLOCK VEHICLE, TO START ENGINE,
`ETC.
`
`FIG. 44
`
`46
`
`46
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 45 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO LIMIT WHICH
`
`DEVICES CAN CONTROL VEHICLE (SETTINGS MAY BE
`STORED IN AUTOMOBILE PERSONAL COMPUTER OR AT
`
`OTHER LOCATIONS)
`
` 616
`
`WHEN REMOTE CONTROL IS ATTEMPTED, DETERMINE
`
`WHETHER CONTROLLING DEVICE IS ONE OF THE
`
`618
`
`SPECIFIED USER DEVICES
`
`IF DEVICE IS ONE OF THE SPECIFIED DEVICES, ALLOW
`
`AUTOMOBILE PERSONAL COMPUTER TO BE
`
`620
`
`CONTROLLED REMOTELY
`
`FIG. 45
`
`47
`
`47
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 46 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`
`PROVIDE USER WITH OPPORTUNITY TO SET UP A USER
`
`DEVICE SUCH AS A COMPUTING DEVICE, PORTABLE
`COMPUTER, PERSONAL COMPUTER, WEB APPLIANCE,
`OR CONTROL AND INFORMATION DEVICE OR THE LIKE
`
`FOR REMOTE VEHICLE CONTROL SERVICES (E.G.,
`PROVIDE USER DEVICE WITH AN IDENTIFIER FOR THE
`
`
`
`
`
`
`622
`
`624
`
`626
`
`628
`
`630
`
`AUTOMOBILE PERSONAL COMPUTER OR VEHICLE, A
`PASSWORD, ETC.)
`
`
`PROVIDE OPTIONS (E.G., ON-SCREEN OPTIONS) WITH
`USER DEVICE THAT THE USER MAY SELECT TO INITIATE
`
`THE PROCEDURE TO UNLOCK THE AUTOMOBILE
`
`DOORS, TO START THE ENGINE, OR TO OTHERWISE
`REMOTELY CONTROL THE AUTOMOBILE'S FUNCTIONS
`
`OR AUTOMOBILE PERSONAL COMPUTER)
`
`USE HANDHELD COMPUTING DEVICE OR OTHER USER
`
`DEVICE TO VERIFY USER'S IDENTITY (E.G., AT SERVER
`
`ALLOW USER TO REMOTELY CONTROL AUTOMOBILE
`
`WITH USER DEVICE
`VEHICLE'S LOCATION
`
`PROVIDE USER WITH CURRENT INFORMATION ON
`
`FIG. 46
`
`48
`
`48
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 47 of 121
`
`US 6,526,335 B1
`
`QUERY AUTOMOBILE ON ITS LOCATION
`
`AUTOMOBILE OBTAINS COORDINATES AND
`DETERMINES ADDRESS OR OTHER CONTEXTUAL
`
`LOCATION INFORMATION USING LOCAL MAP DATABASE
`
`
`
`AUTOMOBILE SUPPLIES STREET ADDRESS AND OTHER
`
`CONTEXTUAL LOCATION INFORMATION TO USER
`
`DEVICE
`
`632
`
`634
`
`636
`
`FIG. 47
`
`49
`
`49
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 48 of 121
`
`US 6,526,335 B1
`
`QUERY AUTOMOBILE ON
`
`LOCATIONS
`
`638
`
`TO USER DEVICE
`
`640
`
`AUTOMOBILE
`
`SUPPLIES LOCATION
`
`COORDINATES
`
`ACCESS DATABASE REMOTE
`
`642
`
`FROM AUTOMOBILE TO
`
`PROVIDE CONTEXTUAL
`
`LOCATION OF AUTOMOBILE
`
`FIG. 48
`
`50
`
`50
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 49 of 121
`
`US 6,526,335 B1
`
`ESTABLISH LOCAL WIRELESS
`
`COMMUNICATIONS LINK BETWEEN
`
`644
`
`WIRELESS DEVICE AND AUTOMOBILE
`
`PERSONAL COMPUTER
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`AUTHORIZE PAYMENT AND USE WIRELESS
`
`DEVICE TO PROVIDE BENEFIT TO USER OF
`
`AUTOMOBILE PERSONAL COMPUTER (E.G.,
`PURCHASE OF PRODUCT OR SERVICE IS
`AUTHORIZED AND TRANSACTION
`
`COMPLETED USING THE WIRELESS DEVICE,
`OR SERVICE IS PROVIDED USING WIRELESS
`
`DEVICE)
`
`INFORMATION OR THE LIKE)
`
`646
`
`648
`
`PROVIDE USER WITH INFORMATION REGARDING
`THE TRANSACTION (E.G., USE AUTOMOTIVE
`PERSONAL COMPUTER TO PROVIDE USER WITH
`
`AN AUDIBLE OR VISUAL CONFIRMATION OF THE
`
`TRANSACTION AND ACCOUNT STATUS
`
`FIG. 49
`
`51
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 50 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`
`650
`SET UP PAYMENT ARRANGEMENT
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`652
`ACCOUNT NUMBER, ETC. LOCALLY IN VEHICLE
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. REMOTELY (E.G. ON SERVER)
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. IN SMART CARD
`
`654
`
`656
`
`
`
`
`
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. IN WIRELESS CARD
`
`658
`
`
`
` INITIATE TRANSACTION (E.G., PLACE ORDER, MAKE OFFER, ETC.)
`
`USE TELEPHONE
`
`662
`
`USE AUTOMOBILE PERSONAL COMPUTER
`AND LOCAL WIRELESS LINK
`
`USE AUTOMOBILE PERSONAL COMPUTER
`AND REMOTE WIRELESS LINK
`
`USE STATIONARY COMPUTER EQUIPMENT
`OR OTHER COMPUTING DEVICE
`
`664
`
`666
`
`668
`
`660
`
`
`
`
`
`
`
`
`
`
`
`COMPLETE TRANSACTION
`670
`
`USE TELEPHONE
`
`572
`
`USE AUTOMOBILE PERSONAL COMPUTER
`
`574
`
`
`
`
`
`
`AND REMOTE WIRELESS LINK
`
`USE AUTOMOBILE PERSONAL COMPUTER
`AND REMOTE WIRELESS LINK
`
`676
`
`678
`
`USE STATIONARY COMPUTER EQUIPMENT
`
`580
`
`USE CREDIT CARD, DEBIT CARD, ACCOUNT
`NUMBER, ETC.
`USE SMART CARD
`682 USE WIRELESS CARD 684
`
`
`
`FIG. 50
`
`
`
`
`
`52
`
`52
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 51 of 121
`
`US 6,526,335 B1
`
`PROVIDE OPPORTUNITY FOR USER TO SUPPLY
`
`AUTOMOBILE PERSONAL COMPUTER OR REMOTE
`SERVER WITH CREDIT CARD INFORMATION, DEBIT
`CARD INFORMATION, INFORMATION ON ACCOUNTS
`
`THAT HAVE BEEN SET UP WITH DIFFERENT
`
`SERVICE PROVIDERS, ETC.
`
`PROVIDE USER WITH OPPORTUNITY TO ASSIGN
`
`MERCHANTS OR CLASSES OF MERCHANTS TO
`
`CERTAIN USER ACCOUNTS OR CREDIT OR DEBIT
`
`CARDS
`
`686
`
`688
`
`SELECTED ACCOUNT OR FINANCIAL INSTRUMENT
`
`WHEN USING AUTOMOBILE PERSONAL COMPUTER
`
`FOR A WIRELESS FINANCIAL TRANSACTION, USE
`THE CREDIT CARD, DEBIT CARD, OR OTHER
`
`690
`
`FIG. 51
`
`53
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 52 of 121
`
`US 6,526,335 B1
`
`USER PURCHASES (E.G., WITH AUTOMOBILE
`PERSONAL COMPUTER AND LOCAL WIRELESS
`
`LINK) SOFTWARE OR PURCHASES OTHER
`PRODUCT THAT ENTITLES USER TO FREE
`
`692
`
`SOFTWARE, ETC.
`
`595
`
`MATERIALS (E.G., AT GAS STATION OR OTHER
`MERCHANT USING LOCAL WIRELESS LINK)
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`DOWNLOAD SOFTWARE OR OTHER
`
`694
`
`RUN SOFTWARE ON AUTOMOBILE PERSONAL
`
`COMPUTER OR OTHERWISE USE
`DOWNLOADED MATERIALS
`
`FIG. 52
`
`54
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 53 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`OBTAIN TOUR INFORMATION (E.G., FROM
`KIOSK USING LOCAL LINK, FROM INTERNET
`USING REMOTE LINK, ETC.)
`
`698
`
`702
`
`DETERMINE LOCATION
`
`700
`
`PLAY BACK DOWNLOADED AUDIO
`
`TOUR BASED ON LOCATION
`
`FIG. 53
`
`55
`
`55
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 54 of 121
`
`US 6,526,335 B1
`
`ESTABLISH LINK BETWEEN AUTOMOBILE PERSONAL
`
`704
`
`706
`
`COMPUTER AND WIRELESS DEVICE
`
`VERIFY USER IS AUTHORIZED
`
`OPEN GATE
`
`USER PARKS FOR DESIRED
`
`AMOUNT OF TIME THEN EXITS
`
`UPON EXIT, ESTABLISH LINK
`
`DETERMINE AMOUNT OF TIME, CALCULATE FEE DUE,
`COMPLETE TRANSACTION BY DEBITING USER, OPEN
`
`GATE
`INFORMATION CONFIRMING THE TRANSACTION)
`
`PROVIDE USER WITH OPPORTUNITY TO REVIEW
`ACCOUNT STATUS (E.G., PROVIDE AUDIBLE
`INFORMATION ON ACCOUNT BALANCE OR AUDIBLE
`
`708
`
`710
`
`712
`
`714
`
`FIG. 54
`
`56
`
`56
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 55 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`ESTABLISH LINK TO ENTRANCE CONTROL DEVICE
`
`716
`
`718
`
`VERIFY USER IS AUTHORIZED
`
`OPEN GATE
`
`720
`
`USER VISITS FACILITY
`
`DETERMINE AMOUNT OF TIME
`
`USER IS IN FACILITY, ISSUE
`ALERT IF OVER THRESHOLD
`
`
`
`
`
`AMOUNT
`
`UPON EXIT, ESTABLISH
`COMMUNICATIONS LINK AND
`
`PERFORM USER CHECK OUT
`
`FIG. 55
`
`722
`
`724
`
`57
`
`57
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 56 of 121
`
`US 6,526,335 B1
`
`726
`
`728
`
`GATE
`
`GATE CONTOL
`
`EQUIPMENT
`
`WIRELESS
`
`
`
`
`
`
`
`COMMUNICATIONS
`
`AND PROCESSING
`
`CIRCUITRY
`
`730
`
`14
`
`AUTOMOBILE
`
`PERSONAL
`
`COMPUTER
`
`AUTOMOBILE
`
`
`
`COMMUNICATIONS
`NETWORK
`
`
`
`736
`
`
`COMPUTER
`
`
`FIG. 56
`
`58
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 57 of 121
`
`US 6,526,335 B1
`
`738
`
`AUTOMOBILE
`
`AUT M BILE
`O O
`PERSONAL
`
`CIRCUITRY
`
`
`
`
`
`
`
`
`WIRELESS ELECTRONIC
`PARKING METER
`
`743
`
`COMPUTER
`
`
`
`
`PROCESSING
`CIRCUITRY
`
`SENSOR
`
`COMMUNICATIONS
`
`WIRELESS
`
`COMMUNICATIONS
`
`NETWORK
`
`COMPUTER
`
`746
`
`744
`
`FIG. 57
`
`59
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 58 of 121
`
`US 6,526,335 B1
`
`
` DETECT PRESENCE OF USER AND ESTABLISH
`
`
`
`
`
`
`
`
`LINK, RECORD START TIME
`
`USER LEAVES
`
`DETECT DEPARTURE OR IMMINENT DEPARTURE
`OF USER, CALCULATE PARKING DURATION AND
`DEBIT USER'S ACCOUNT ACCORDINGLY
`
`750
`
`754
`
`
`
` 756
`
`
`
`
` PROVIDE USER WITH INFORMATION REGARDING
`
`TRANSACTION. (E.G., PROVIDE AUDIO
`CONFIRMATION OF TRANSACTION AND DETAILS,
`USE MAIL, EMAIL OR OTHER MESSAGE FORMAT
`TO SEND INFORMATION TO USER CONFIRMING
`AMOUNT SPENT, ETC.)
`
`FIG. 58
`
`60
`
`60
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 59 of 121
`
`US 6,526,335 B1
`
`AUTOMOBILE
`
`12
`
`760
`
`
`
`AUTOMOBILE
`
`PERSONAL
`
`
`
`
`
`COMPUTER
`
`WIRELESS
`
`
`
`
`COMMUNICATIONS
`
`
`
`
`CIRCUITRY
`
`14
`
`PROCESSOR
`
`758
`
`
`GAS STATION
` 764
`
`752
`
`
`
` 766
`
`
`
`770
`
`COMMUNICATIONS
`
`NET WORK
`
` CENTRAL OFFICE
`768
`
`COMPUTER
`
`FIG. 59
`
`61
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 60 of 121
`
`US 6,526,335 B1
`
`INFORMATION ON PRICE, DISCOUNT, ETC. FOR GAS
`AND PROVIDE INFORMATION TO GAS STATION AND
`
`774
`
`
`
`USE AUTOMOBILE PERSONAL COMPUTER AND
`REMOTE WIRELESS LINK TO NEGOTIATE OR OBTAIN
`
`
`
`
`
`
`CHARGE USER OR PLACE HOLD ON USER'S
`
`ACCOUNT OR THE LIKE. LEW TRANSACTION FEE.
`
`USER TRAVELS TO GAS STATION
`
`ESTABLISH LOCAL LINK BETWEEN GAS PUMP OR
`OTHER WIRELESS DEVICE AT GAS STATION AND
`
`THE AUTOMOBILE PERSONAL COMPUTER
`NEGOTIATED FOR PURCHASE OF GAS)
`
`AUTHORIZE FUELING (E.G., VERIFY USER HAS
`SUFFICIENT FUNDS OR THAT USER HAS ALREADY
`
`VEHICLE IS FUELED
`
`
`
`COMPLETE TRANSACTION (E.G., DEBIT USER'S
`
`
`ACCOUNT BASED ON AMOUNT INDICATED BY PUMP
`METER) AND ANY NEGOTIATED PRICE
`
`ADJUSTMENTS
`
`775
`
`778
`
`780
`
`PROVIDE AUTOMOBILE PERSONAL COMPUTER AND
`USER WITH INFORMATION REGARDING TRANSACTION
`
`782
`
`788
`
`INCLUDE INFORMATION REGARDING TRANSACTION
`IN AN EXPENSE REPORT
`
`FIG. 60
`
`62
`
`62
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 61 of 121
`
`US 6,526,335 B1
`
`
`
`USE AUTOMOBILE PERSONAL COMPUTER
`AND A REMOTE WIRELESS LINK TO
`NEGOTIATE PRICE, DISCOUNT, ETC., FOR
`GAS. PROVIDE INFORMATION TO GAS
`STATION, CHARGE USER OR PLACE HOLD
`ON USER'S ACCOUNT OR THE LIKE. LEW
`TRANSACTION FEE.
`
`
`
`
`
`
`790
`
`
`
`
`
`
`
`
`
`
`
`
`VEHICLE TRAVELS TO GAS
`
`STATION
`
`
`
`USER'S IDENTITY IS VERIFIED BY GAS
`STATION AND FUELING IS AUTHORIZED
`
`
`
`
`
`792
`
`VEHICLE IS FUELED
`
`
`
`
`
`COMPLETE TRANSACTION (E.G., DEBIT
`USER'S ACCOUNT BASED ON AMOUNT
`
`
`INDICATED BY PUMP METER AND ANY
`
`NEGOTIATED PRICE ADJUSTMENTS)
`
`794
`
`FIG. 61
`
`63
`
`63
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 62 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO USE '
`AUTOMOBILE PERSONAL COMPUTER TO
`DETERMINE LOCATION OF GAS STATION OF
`
`796
`
`INTEREST USER DRIVES TO GAS STATION
`
`USER PURCHASES GAS USING AUTOMOBILE
`PERSONAL COMPUTER AND LOCAL
`WIRELESS LINK
`
`798
`
`REWARD USER FOR PURCHASE (E.G.,
`DISCOUNT, REWARD POINTS, ETC.)
`
`800
`
`FIG. 62
`
`64
`
`64
`
`
`
`US. Patent
`
`Feb. 25,2003
`
`Sheet 63 of 121
`
`US 6,526,335 B1
`
`EXPENSE REPORT
`
`FOR TRIP TO PALO ALTO
`
`JANUARY 1 - 7, 2000
`
`$ 1672.00
`
`CATEGORY
`
`GAS
`FOOD
`
`PARKING
`
`TOLLS
`
`LODGING
`
`TOTAL
`
`$ 347.00
`$ 485.00
`$
`48.05
`
`$
`
`97.00
`
`FIG. 63
`
`65
`
`65
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 64 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER
`TO WIRELESSLY PAY FOR GAS, FOOD,
`LODGING, PARKING, TOLLS, ETC.
`
`802
`
`804
`
`806
`
`
`
`SUPPLY INFORMATION ON PURCHASE TO
`REPORT-GENERATION TOOL (E.G., E-MAIL
`INFORMATION TO OFFICE PERSONAL
`COMPUTER OR COLLECT INFORMATION AT
`AUTOMOBILE PERSONAL COMPUTER IN A
`REPORT THAT IS LATER E—MAILED OR
`OTHERWISE TRANSFERRED TO OFFICE
`PERSONAL COMPUTER)
`
`PROVIDE USER WITH OPPORTUNITY TO
`PRINT REPORT (E.G., EXPENSE REPORT)
`
`FIG. 64
`
`66
`
`66
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 65 of 121
`
`US 6,526,335 B1
`
`ESTABLISH LOCAL WIRELESS COMMUNICATIONS
`LINK BETWEEN TOLL COLLECTION FACILITY AND
`
`AUTOMOBILE PERSONAL COMPUTER
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`WIRELESSLY COLLECT TOLL FROM USER (E.G.,
`DEBIT USER'S ACCOUNT IF USER HAS ACCOUNT
`
`OR CHARGE USER'S CREDIT CARD, ETC.)
`
`808
`
`810
`
`PROVIDE USER WITH INFORMATION REGARDING
`TRANSACTION (E.G., AUDIBLY, USING E-MAIL, ETC.)
`
`812
`
`814
`
`INCLUDE INFORMATION IN EXPENSE REPORT
`
`FIG. 65
`
`67
`
`67
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 66 of 121
`
`US 6,526,335 B1
`
`CREATE SHOPPING LIST
`
`
`
`
`
`
`
`
`SHOPPING LIST
`
`USER CREATES
`
`816
`
`AND TRAVELS
`
`TOWARD STORE,
`
`
`
`
`MALL, OR OTHER
`SHOPPING
`
`FACILITY
`
`
`
`
`
`PROVIDE USER WITH OPPORTUNITY TO TRANSFER
`SHOPPING LIST TO COMPUTER EQUIPMENT
`
`
`ASSOCIATED WITH STORE, MALL. OR OTHER
`SHOPPING ESTABLISHMENT
`
`
`
`818
`
`
`
`USE COMPUTER EQUIPMENT TO ASSIST AND
`
`BENEFIT USER DURING IN-STORE SHOPPING (E.G.,
`
`
`ALLOW USER TO PRINT OUT COPY OF SHOPPING
`
`
`LIST ON A PRINTER)
`
`
`820
`
`FIG. 66
`
`68
`
`68
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 67 of 121
`
`US 6,526,335 B1
`
`
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`PROVIDE USER WITH OPPORTUNITY TO
`
`854
`
`856
`
`NEGOTIATE PRICE OF PRODUCT OR SERVICE
`
`
`(E.G., FOOD, GAS, LODGING, ETC.) WITH
`
`
`MERCHANT OR MANUFACTURER
`
`
`PRICE NEGOTIATED
`
`
`
`STORE NEGOTIATED PRICE IN AUTOMOBILE
`PERSONAL COMPUTER MEMORY OR AT
`
`
`MERCHANT, OR AT OTHER SUITABLE LOCATION
`
`
`
`ALLOW USER TO USE AUTOMOBILE PERSONAL
`
`
`COMPUTER TO WIRELESSLY COMPLETE
`
`
`PURCHASE TRANSACTION (E.G., AT
`MERCHANT'S LOCATION) OR OTHERWISE
`
`
`COMPLETE TRANSACTION
`
`
`858
`
`FIG. 67
`
`69
`
`
`
`US. Patent
`
`Feb. 25, 2003
`
`Sheet 68 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`PROVIDE USER WITH OPPORTUNITY TO MAKE
`
`FINANCIAL COMMITMENT TOWARD PURCHASING
`PRODUCT OR SERVICE (E.G., FOOD, GAS, LODGING,
`ETC.)
`
`PROVIDE INFORMATION ON USER'S DESIRE TO
`
`PURCHASE ITEM AND FINANCIAL COMMITMENT TO
`
`MERCHANTS
`
`
`BENEFIT)
`
`INFORM USER OF MERCHANT'S OFFERINGS
`
`USER COMPLETES TRANSACTION AND OBTAINS
`DISCOUNT OR OTHER BENEFIT (E.G., A FINANCIAL
`
`