(12) United States Patent
`Treyz et al.
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 6,526,335 B1
`Feb. 25, 2003
`
`US006526335B1
`
`(54) AUTOMOBILE PERSONAL COMPUTER
`SYSTEMS
`Inventors: G. Victor Treyz, 37 Vanderburgh Ave.,
`La“’hm°“I> NY (US) 10538; Susan M-
`Treylt 37 Vanderburgh AW»
`Larchrnont, NY (US) 10538
`
`(76)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No‘: 09/490,331
`
`(22)
`
`Filed:
`
`Jan. 24, 2000
`
`Int. Cl.7 ................................................ .. G06F 7/00
`(51)
`(52) U.S. Cl.
`..................... .. 701/1; 307/101; 342/357.1;
`701/36
`(58) Field of Search .......................... .. 701/1, 2, 36, 29,
`701/32, 33; 307/91, 10.1; 342/357.09,
`357.13, 357.1; 340/825.15, 825.49, 425.5
`
`W0
`
`W0
`W0
`W0
`W0
`
`FOREIGN PATENT DOCUMENTS
`WO 99/09374
`2/1999
`......... .. G01C/21/00
`33/41529
`7/2000
`/45511
`8/2000
`W0 00/52984
`9/2000
`W0 00/72463 A2
`11/2000
`W0 01/27831 A1
`4/2001
`WO 01/43364 A1
`6/2001
`
`........... .. H03]/1/00
`. H05K/11/00
`.. H04B/7/00
`. G06F/17/60
`......... .. H04L/12/28
`
`
`
`OTHER PUBLICATIONS
`.
`.
`.
`Copies of pages from the OnStar® website as printed from
`the Internet on Jan. 10, 2000.
`.
`.
`ZDNet “The Ultimate Spy Gear—Chapter 9: Putting a Tail
`on Someone” (printed from the Internet on Jan. 4, 2000).
`Mark Moeller, “AutoPC Power: A look at the first year with
`Auto PC with Microsoft” Windows CE Power Magazine
`(printed from the Internet on Dec. 29, 1999).
`Copies of pages from the website of Clarion Corporation as
`printed from the Internet on Dec. 29, 1999.
`Clarion AutoPC 310C Owner’s Manual, Copyright dated
`1998 c1ar10n co. Ltd.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`Primary Examiner—William A. Cuchlinski, Jr.
`Assistant Exami/1er—Edward Pipala
`
`(57)
`
`ABSTRACT
`
`An automobile personal computer system is provided. A
`user of the system may wirelessly interact with merchants,
`communications facilities, information providers, comput-
`ers at the home or office, and other entities. Such interactions
`may involve local wireless links and remote wireless links.
`Wireless communications may involve satellite
`transmissions, cellular transmissions, short-range wireless
`transmissions, etc. Products may be purchased using voice
`commands or by interacting with displays in the automobile.
`The automobile’s location and functions may be monitored
`and controlled. Location information and other information
`
`particular to the user may be used to target promotions to the
`user. The user may obtain information on the goods or
`services available at a merchant while driving and may
`initiate a purchase transaction for those goods or services.
`
`9/1991 Bianco ..................... .. 235/385
`10/1991 Scott et al.
`.
`.. 180/167
`10/1993 Johnsen ....... ..
`235/383
`4/1994 Noreen et al.
`455/3.2
`9/1994 Hassett ............ ..
`364/401
`6/1995 Ruppert et al.
`.
`.. 235/462
`6/1995 Shieh .............. ..
`340/928
`10/1995 Noreen et al.
`370/50
`9/1997 Postman et al.
`.......... .. 395/893
`11/1997 Noreen et al.
`....... .. 340/825.49
`6/1998 Schaphorst
`. . . . . . . .
`. . . . .. 340/988
`
`8/1998 Beckert et al.
`701/1
`.............. .. 705/23
`8/1998 Walker et al.
`11/1998 Fujioka .................... .. 235/382
`1/1999 Wright, Jr. et al.
`....... .. 707/104
`1/1999 Giordano et al.
`.... .. 364/479.01
`9/1999 DeLorme et al.
`...... .. 340/815.41
`9/1999 Beckert et al.
`9/1999 Mardirossian ............ .. 340/936
`
`
`
`5,047,614 A
`5,054,569 A
`5,250,789 A
`5,303,393 A
`5,351,187 A
`5,424,524 A
`5,424,727 A
`5,455,823 A
`5,664,231 A
`5,689,245 A
`5,767,795 A
`5,794,164 A
`5,794,207 A
`5,837,982 A
`5,857,201 A
`5,859,779 A
`5,948,040 A *
`5,949,345 A
`5,952,941 A
`
`(List continued on next page.)
`
`15 Claims, 121 Drawing Sheets
`
`CONTENT AND
`SERVICE
`PROVIDERS (E.G
`INTERNET AND
`OTHER CONTENT
`PROVIDERS)
`
`
`
`30
`
`COMMUNICATIONS
`FACILITIES
`
`32
`\;T/‘‘2 7).
`AUTOMOBILE
`
`EMERGENCY
`SERWCES
`FACILITIES
`
`12 f\
`
`42
`
`34
`
`OTHER
`ENTITIES
`
`36
`
`PEP»
`‘*2
`COMPUTER
`Al)
`PORTABLE
`W‘ HOME
`1%/4:091
`~\{GAS
`TOLL
`COLLECTION
`FACILITY
`
`PERSONAL
`
`14
`
`STATION
`20
`
`281/ MERCHANTS
`26'
`
`HOTEL
`24
`DR|VE—TH ROUGH
`RESTAURANT
`
`| "2"42
`
`4?»
`42
`
`10
`
`AUTOMOBILE COMPUTER
`\
`
`HANDHELD
`COMPUTING
`DEVICE
`
`OFHCE
`
`I5
`
`18
`
`35
`
`40
`
`Samsung Ex. 1109 p. 1
`
`Samsung Ex. 1109 p. 1
`
`

`
`US 6,526,335 B1
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,955,970 A
`5,959,577 A
`5,970,469 A
`5,970,474 A
`5,977,908 A
`5,979,757 A
`5,995,898 A
`6,009,363 A
`6,101,483 A
`
`............... .. 340/928
`9/1999 Ando et al.
`9/1999 Fan eta1~ ~~~~~~~~~~~~ ~ 342/357.13
`
`10/1999 Scroggie et a1 ~
`~~~~~~~~ ~~ 705/14
`............... .. 705/27
`10/1999 LeR0y et al.
`11/1999 Nichols ............... .. 342/357.08
`
`11/1999 Tracy et 211
`~~
`...... ~~ 235/383
`11/1999 Tuttle ....................... .. 701/102
`12/1999 Beckett et al.
`............. .. 701/33
`8/2000 Petrovich et al.
`........... .. 705/26
`
`............. .. 340/988
`8/2000 Volkel et al.
`6,104,315 A
`............ .. 340/905
`8/2000 Mulder et al.
`6,111,521 A
`8/2000 Mannings et al.
`34235709
`6,111,539 A
`10/2000 Girerd et al.
`............. .. 701/213
`6,131,067 A
`11/2000 Park et al.
`................ .. 455/456
`6,148,212 A
`6,154,658 A >x< 11/2000 Cad
`6,163,270 A =x< 12/2000 sflverman ............ N 340/825.15
`6,199,045 B1
`3/2001 Giniger et al.
`............... .. 705/1
`6,233,506 B1 =x=
`5/2001 Obradovich et al.
`
`* cited by examiner
`
`Samsung Ex. 1109 p. 2
`
`Samsung Ex. 1109 p. 2
`
`

`
`U.S. Patent
`
`0
`
`mS
`
`1B
`
`Nv
`
`M.8
`
`KN;m_.__m_o_>_oS<
`
`
`
`5,8oz_Sn__>_oom»z<_._omm_>___\rwmMn:m:ez<:M86mmo_>oE
`3wemm_o_>moLiE.
`
`
`
`mmExpowm__E_oE
`
`vm>ozm_omm__>_m
`
`mm_o_>mm_m
`
`
`
`mzo_p<o_z:_>_s_oomo_>mmm
`
`
`
`QZ<._.Zm_._.ZO0
`
`m.u.__._._.__O<n_
`
`
`
`dmvmmm_o_>omn_
`
`
`
`n_z<Ezmm:z_
`
`
`
`Fzmfizoomm__.:.O
`
`w<wU.39»\
`
`1m__>_o_._/
`
`N.‘
`
`+z<m:<+mm_mmmmfl:o:om_.:-m_>_mo
`
`
`
`.1..Q.«N
`
`sm:m<Eon_3:74<zow~m_n_
`
`umN_m_._.Dn__>_OON_m_._.Dn__>_OO
`m:_m_o_>_oS<E5:8
`
`5I3om_\O_n_
`
`Samsung Ex. 1109 p. 3
`
`Samsung Ex. 1109 p. 3
`
`
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 2 of 121
`
`US 6,526,335 B1
`
`GPS
`
`SATELLITES
`
`45
`
`SATELLITE
`
`
`
`BASE
`
`STATION
`
`
`
`
`
`7/
`
`‘7\
`
`44
`
`TERRESTRIAL
`RADIO AND DATA
`
`BROADCAST
`
`L SOURCES
`
`44
`
`ANTENNA
`
`
`COMMUNICATIONS
`
`NETWORK (E.G., PUBLIC
`SWITCHED TELEPHONE
`
`NETWORK, INTERNET,
`
` 58B1. AUTOMOBILE
`
`
`ETC.)
`
`52
`
`
`
`COMPONENTS TRUNK-MOUNTED, ETC.) FNTENNA
`
`AUTOMOBILE
`
`
`
`
`
`
`PERSONAL COMPUTER
`(E.G., DIN SIZED,
`DASHBOARD-MOUNTED,
`
`OTHER
`
`
`
`
`
`
`
`56
`
`BASE
`STATION
`
`54
`
`70
`PHYSICAL
`LINK
`
`14
`
`52
`
`
`
`COMPUTING
`EQUIPMENT
`
`68
`
`
`
`
`
`LOCAL
`EQUIPMENT
`
`Samsung Ex. 1109 p. 4
`
`Samsung Ex. 1109 p. 4
`
`

`
`U.S. Patent
`
`Feb. 25,2003
`
`Sheet 3 of 121
`
`US 6,526,335 B1
`
`PROCESSORISI MICROPROCESSOR
`
`74
`
`76
`
`DIGITAL
`SIGNAL
`
`
`
`PROCESSOR
`
`STORAGE
`
`HARD DRIVE 82 84 NON—VOLATILE
`96
`MEMORY
`
`as
`
`
`
`
`
`D'5F"-AY5
`94
`D|SPLAY(S) WITH
`
`LCDDISPLAY
`SENSORSTO
`F|_AT_pANEl_
`INDICATE WHETHER
`DRIVER CAN VIEW
`FLOPPY
`
`88
`90
`92
`
`98
`
`172
`
`
`
`
`
`INTERACTIVE
`DISPLAYS(E.G.,
`DISPLAYS WITH
`TOUCH SCREENS)
`
`PERIPHERALS
`114
`100
`115
`
`
`
`
`
`INTERFACE
`MEMORY CARD
`108 FOR PC
`OTHER
`118
`|NTERFACE
`120
`CARDS
`REMOVABLE
`
`FOR VEHICLE
`STORAGE DRIVE
`
`
`
`122 COMMUNICATIONS AND I/O DEVICES 132 GAME CONTROLLER
`POINTING WIRELESS COMMUNICATIONS CIRCUITRY
`
`DEVICE
`TRANSMITTERS 1:26 FM ANTENNA 134
`
`RECEIVERS 148138
`AM ANTENNA 142
`
`TUNABLE
`SATELLITE
`LOCAL
`KEYS (E.G.,
`
`TRANSMITTERS ANTENNA ANTENNA
`ALPHANUMERIC
`KEYSAND
`
`DEDICATED KEYS)
`
`154
`140
`OTHER COMPONENTS
`
`DIGITAL
`BATTERIES
`158 VIDEO
`160 CAMERA CAMERA
`
`170
`CLOCK 166
`162
`MICROPHONE
`
`
`
`
`104
`
`102
`
`PCMCIA
`
`106
`
`GPS
`
`112
`
`
`
`
`
`
`
`
`OTHER
`150 CELLULAR
`TUNABLE
`
`RECEIVERS 152 ANTENNA ANTENNAS
`
`
`
`
`
`
`144
`
`168
`
`
`
`CASSETTE
`TAPEPLAYER
`FINGERPRINT 156
`READER
`
`FIG. 3
`
`Samsung Ex. 1109 p. 5
`
`
`
`24
`
`1
`
`
`
`
`
`
`
`
`
`SPEAKERS
`
`Samsung Ex. 1109 p. 5
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 4 of 121
`
`US 6,526,335 B1
`
`
`
`AUTOMOBILE
`
`PERSONAL
`
`
`
`14
`
`COMPUTER
`
`
`
`SENSORS AND CONTROLS FOR DRIVING-RELATED FUNCTIONS
`IGNITION SENSOR AND CONTROL 1I3820
`RROX"V"TY SENSOR
`DEVICES
`188" ODOMETER SENSOR
`
`
`
`
`
`
`
`
`
`TRANSMISSION SENSOR AND
`
`190 SREEOOMETER SENSOR
`
`CONTROL DEV|CES
`
`CRUISE CONTROL SYSTEM
`
`THROTTUESENSORAND 184
`CONTROL DEV|CES
`185
`
`198
`194
`
`ABSSENSORAND
`CONTROL DEVICES
`
`BRAKE SENSOR AND
`CONTROL DEVICE
`
`1%
`
`192,.
`
`INERTIAL AND
`COMPASS SENSORS
`
`
`
`
`
`
`23162 AND CONTROL DEVICES
`V‘/’,'EER§’OSN'ET':,SO(?_R
`208 TRUNK SENSOR AND
`DEWCES
`
`HEADLIGHTS SENSOR
`CONTROL DEVICES
`OTHER DIAGNOSTIC
`AND CONTROL DEVICE
`SENSORS
`228
`21°
`HEAT AND AIR
`EXTERIOR
`CONDITIONING
`
`TEMPERATURE SENSOR
`SENSOR AND
`AUTOMOBILE
`220
`CONTROL
`BATTERY SENSOR
`DEVICES
`VEHICLE
`226
`202
`
`
`DIAGNOSTIC
`SYSTEM
`
`
`200
`
`SENSORS AND CONTROLS FOR OTHER FUNCTIONS 214
`FUEL LEVEL SENSOR
`OIL LEVEL
`
`
`
`SENSOR
`ENGINE
`TEMPERATURE
`SENSOR
`
`
`
`coNTRoI_
`
`222
`
`20
`
`ELECTRICAL
`SYSTEMS
`224
`SENSORS
`AIRBAG SENSORS
`205
`WINDOW
`
`
`SENSOR AND
`
`DEVICES
`
`
`DOOR LOCK SENSOR
`
`AND CONTROL DEVICES
`
`
`
`FIG. 4
`
`Samsung Ex. 1109 p. 6
`
`Samsung Ex. 1109 p. 6
`
`

`
`U.S. Patent
`
`Feb. 25,2003
`
`Sheet 5 of 121
`
`US 6,526,335 B1
`
`230
` MOVEABLE
`
`DISPLAY
`
` '\
`
`
`
`
`232
`
` FRONT-SEAT AREA
`
`PASSENGER'S
`
`
`
`VIEW
`
`POSITION
`
`SENSOR
`
`
`
`/‘
`
`DRIVER'S
`
`VIEW
`
`
`
`FIG. 5
`
`Samsung Ex. 1109 p. 7
`
`Samsung Ex. 1109 p. 7
`
`

`
`S.U
`
`aP
`
`3m
`
`2M6
`
`.mam
`
`mmozmmm<mm4<zommm_n_Ewm:_mo_>_oS<
`
`m_m_Sn__>_oo4<»zm__>m_.En5mp<m_w-+zoE
`
`
`
`<m_m<M><#_m_oM:2:._.Dn_Z_Moz<><#_m_o._m_z<¢EOE
`
`
`
`
`
`
`
`
`
`1_.<m_m-m_<m_m_»<m_m-m<m_m
`
`
`
`mI||||.I||l.|||||l||.Il|
`
`
`
`>Sn_m_ommozmmmi><#_w_n_mm_ozm_mw<n_
`
`
`
`
`
` «W.mwQ0_n_<m_m<»<m_m-m<m_mu.mm986nWmmamMm_o<u_mm:z_
`
`
`
`:Ez_oz<m_o<u_mm»z_5&2.oz<
`
`100Bn.
`
`Samsung Ex. 1109 p. 8
`
`
`

`
`U.S. Patent
`
`Feb. 25,2003
`
`Sheet 7 of 121
`
`US 6,526,335 B1
`
`
`AUTOMOBILE
`
`240
`
`PERSONAL
`COMPUTER
`UNIT
`
`
`
`FRONT-SEAT
`AREA
`
`
`
`
`COMPUTER
`
`COMPUTER
`
`244
`
`246
`
`D|SPLAY
`
`SPEAKER
`
`242
`
`USER INPUT
`DEVICES
`
`MICROPHONE
`
`248
`
`REAR—SEAT
`AREA
`
`242
`
`252
`
`NKAREA
`
`TRU
`
`HG 7
`
`SUPPLEMENTAL
`
`PROCESSOR
`
`254
`
`Samsung Ex. 1109 p. 9
`
`Samsung Ex. 1109 p. 9
`
`

`
`U.S. Patent
`
`Feb. 25,2003
`
`Sheet 8 of 121
`
`US 6,526,335 B1
`
`DISPLAY
`
`BUTTONS
`
`FIG8
`
`Samsung Ex. 1109 p. 10
`
`UJ
`
`2 O I L
`
`L O 0
`
`: Q E
`
`Samsung Ex. 1109 p. 10
`
`

`
`U.S. Patent
`
`Feb. 25,2003
`
`Sheet 9 of 121
`
`US 6,526,335 B1
`
`OOOOO
`
`FIG.9
`
` OPTIONS
`
`270
`
`0
`
`(D
`Z\E
`
`I-
`8
`
`Samsung Ex. 1109 p. 11
`
`Samsung Ex. 1109 p. 11
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 10 of 121
`
`US 6,526,335 B1
`
`FIG.10
`
`DISPLAY
`
` TOUCH
`OPTION
` INFORMATION USERSELECTS
`
`SCREEN
`
`CO
`I\
`(N
`
`278
`
`278
`
`Samsung Ex. 1109 p. 12
`
`Samsung Ex. 1109 p. 12
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 11 of 121
`
`US 6,526,335 B1
`
`zO_._.<O_._n_n_<gm20_._.<O_._n_n_<
`
`om_j<bwz_-mm_m:
`
`zO_._.<O_._n_n_<
`
`om_j<Bz_-m_m_w:
`
`ZO_._.<O_._nE<
`
`Nmm
`
`2‘.O_n_
`
`
`
`_>_m_5>moz_»<mmn_o
`
`xwm
`
`Samsung Ex. 1109 p. 13
`
`Samsung Ex. 1109 p. 13
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 12 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`290
`
`ESTABLISH LINK
`
`(E.G., WIRELESS
`LINK OR WIRED
`
`
`
`
`
`LINK) WITH
`COMPUTER (E.G.,
`REMOTE SERVER,
`PERSONAL
`COMPUTER’
`HANDHELD
`
`
`
`
`
`
`
`
`
`
`
`ALLOW USER TO CONNECT
`
`MEMORY CARD OR CD, OR
`OTHER REMOVABLE
`STORAGE MEDIA
`CONTAINING NEW
`
`SOFTWARE TO BE ADDED
`
`
`
`
`COMPUTER, ETC.)
`
`
`
`AUTOMOBILE PERSONAL
`COMPUTER DRIVE, CARD
`
`TO APPROPRIATE
`
`
`
`
`
`READER OR OTHER
`
`
`DOWN LOAD
`PERIPHERAL
`
`SOFTWARE
`
`
`
`USER
`CONNECTS
`
` 296
`
`
` INSTALL NEW SOFTWARE ONTO HARD DRIVE OF
`
`
`SUITABLE STORAGE
`
`292
`
`
`AUTOMOBILE PERSONAL COMPUTER OR OTHER
`
`FIG. 12
`
`Samsung Ex. 1109 p. 14
`
`Samsung Ex. 1109 p. 14
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 13 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`
`
`
`EXTERNAL
`CELLULAR
`TELEPHONE
`
`
`
`316
`
`DEDICATED
`DEVICE (E.G., KEY
`CHAIN DEVICE OR
`IN-VEHICLE
`REMOTE
`
`CONTROL)
`
`
`AUTOMOBILE PERSONAL
`COMPUTER
`
`304
`300
`
`
`
`WIRELESS
`
`
`
`IR PORT
`
`USB PORT
`
`COMMUNICATIONS
`
`CIRCUITRY
`
`
`
`
`
`
`USER COMPUTING
`DEVICE (E.G.,
`NOTEBOOK
`
`
`
`COMPUTER. LAPTOP
`COMPUTER,
`HANDHELD
`COMPUTING DEVICE,
`
`ETC.)
`
`
`
`
`
`
`COMMUNICATIONS
`NETWORK (E.G.,
`THE INTERNET)
`
`305
`
`310
`
`ELECTRONIC
`
`
`
`DEVICE
`
`298
`
`312
`
`313
`
`FIG. 13
`
`Samsung Ex. 1109 p. 15
`
`Samsung Ex. 1109 p. 15
`
`

`
`5U
`
`P«mm
`
`
`
`
`
`OHxz:mzo:<o_z:s__>_oo:m_._m_<Bm_
`
`
`
`
`
`mmEE_>_oo4<zowEn_m_.__mO_>_O._.3<
`
`
`
`
`
`m_.__mo_>_oS<n_OmozEm_mm_._.<n_n_D
`
`
`
`
`
`_._.:>>m_m_._.Dn__>_OO4<zowm_mn_
`
`tnwa
`
`mm.5hM
`
`%
`
`/0SU
`
`/025,
`
`3,
`
`1B
`
`m:_m_o_>_oS<w“_omwzfiflmmfi<E: mm_>omrem;5mmm:mm_>>mozEm_mMoz_oz<:o>mm_m_Sn__>_oom4<zommm_n_
`
`
`
`4<oo._moEzmm:z_
`
`
`n:m_:oz<_._om:m_o_>m_oOZ_.rDn=>_OO
`m:_mo_>_oS<mi»OHomfiomzzoo
`
`
`v_OOm_m_._.OZ.m_o_>m_o0Z_._.Dn__>_OO
`
`5mm»
`
`
`
`3.0_n_an
`
`
`
`22:mmm:m_m_>>
`
`
`
`m_:o_:>>ooh..mm_Sn__>_oo
`
`
`
`mm_Sn__>_oo4<zowmm_n_
`
`Samsung Ex. 1109 p. 16
`
`Samsung Ex. 1109 p. 16
`
`

`
`waP3U
`
`uR
`
`
`
`
`
`
`
` mezfifimmmm_Sn__>_oo4<zomm_mn_5_m_o_>_oS<5:3<
`
`>m<ozoommo_n5<mozfifimEmé4_<_>_-m_W§\ mmmEoo<.__<_>_-m_ inoVm >:_n_mMO.FD<WmvZ_.—i_.m_mO_D<N_Io_o<m“E0zmapmE!mzok
`
`
`
`
`
`
`
`
`
`
`\F«EE3.0.25sEE22%MEE:,_oEE
`
`
`
` MH.53..0_n_M3,m61m, 3.0.25m£2.58E
`
`a
`
`Samsung Ex. 1109 p. 17
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 16 of 121
`
`US 6,526,335 B1
`
` COMMUNICATIONS
`NETWORK
`
`USER
`
`DEVICE
`
`COMPUTING
`
`
`
`
` ACCOUNT
`DATABASE
`
`
`
`CONTENT
`
`SOURCES
`
`ORDER
`
`
`
`PROCESSING
`
`FACILITY
`
`
`
`SERVICE PROVIDER
`
`345
`
`Samsung Ex. 1109 p. 18
`
`AUTOMOBILE
`
`PERSONAL
`COMPUTER
`
`14
`
`FIG. 16
`
`Samsung Ex. 1109 p. 18
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 17 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE
`
`
`
` 354
`
`
`PERSONAL COMPUTER TO
`
`LISTEN FOR WIRELESS
`
`COMMUNICATIONS FROM
`
`
`
`KEY CHAIN DEVICES
`
`
`
`USER
`
`
`SENDS
`
`
`
`
`COMMANDS
`
`AUTOMOBILE PERSONAL
`
`COMPUTER OPENS DOOR LOCKS,
`
`STARTS ENGINE, CONTROLS
`
`WIPERS, HEADLIGHTS, ETC. IN
`RESPONSE TO COMMANDS FROM
`
`
`
`
` 356
`
`
`WIRELESS KEY CHAIN DEVICE
`
`
`
`USE WIRELESS KEY CHAIN
`
`
`
`
` 358
`
`
`DEVICE TO CONTROL DEVICES
`
`IN HOME (E.G., DOOR LOCKS,
`LIGHTS, GARAGE DOOR, ETC.
`USING SAME WIRELESS
`
`KEYCHAIN DEVICE)
`
`FIG. 17
`
`Samsung Ex. 1109 p. 19
`
`Samsung Ex. 1109 p. 19
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 18 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL
`
`COMPUTER TO LISTEN FOR
`
`INFRARED OR R.F. WIRELESS
`COMMANDS FROM IN-VEHICLE
`
`350
`
`REMOTE CONTROL
`
`TUNE TO RADIO STATIONS,
`
`CHANGE VOLUME, MUTE AUDIO,
`CHANGE SETTINGS, ETC.
`
`362
`
`BASED ON REMOTE CONTROL
`
`COMMANDS
`
`FIG. 18
`
`Samsung Ex. 1109 p. 20
`
`Samsung Ex. 1109 p. 20
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 19 of 121
`
`US 6,526,335 B1
`
`THIN SERVER
`
`
`
`2
`
`3 2
`
`DEDICATED
`
`COMMUNICATIONS
`
`DEVICE (E.G.,
`SHARED-ACCESS
`
`MODEM)
`
`HANDHELD
`
`COMPUTING
`
`DEVICE
`
`386
`
`PERSONAL
`
`COMPUTER
`
`SECURITY
`
`SYSTEM
`
`HANDHELD
`
`COMPUTING
`
`DEVICE
`
`HOME SENSORS
`
`AND CONTROL
`
`DEVICES
`
`HOME SENSORS
`
`AND CONTROL
`
`DEVICES
`
`DEDICATED ELECTRONIC INFORMATION AND CONTROL
`APPLIANCE (E.G., DEDICATED FLAT PANEL DEVICE
`WITH ITS OWN WIRELESS TRANSMITTER AND
`
`RECEIVER OR ITS OWN MEMORY
`
`366/B
`
`REMOTE A LOCAL
`
`368
`
`AUTOMOBILE
`
`
`PERSONAL
`
`COMPUTER
`
`14
`
`FIG. 19
`
`Samsung Ex. 1109 p. 21
`
`Samsung Ex. 1109 p. 21
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 20 of 121
`
`US 6,526,335 B1
`
`415
`
`400
`
`LEAVE HOME
`
`CHECK NEWS
`
`YOU HAVE 3
`E-MAIL
`MESSAGES
`
`READ
`
`FORWARD
`
`YOU HAVE NO
`VOICE MAIL
`
`MESSAGES
`
`TIME IS 7:05 AM CURRENT TEMPERATURE
`
`IS 28° COLD, WINDY, HIGH 32°
`
`TONIGHT -- INCREASING CLOUDS, CHANCE OF SNOW
`
`FIG. 20
`
`Samsung Ex. 1109 p. 22
`
`Samsung Ex. 1109 p. 22
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 21 of 121
`
`US 6,526,335 B1
`
`FIG.21
`
`Samsung Ex. 1109 p. 23
`
`
`
`WAKEUPHOMEGOUPSTAIRS
`
`0:
`<1:
`
`0 I
`
`-
`BE
`I-
`(O
`
`PUTHOMETO REST
`
`420
`
`422
`
`Samsung Ex. 1109 p. 23
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 22 of 121
`
`US 6,526,335 B1
`
`444
`
`SPEAKER
`
`430
`
`442
`
`INFORMATION REGION
`
`TUNER
`
`START CAR
`
`GET MAIL
`
`RADIO
`
`EWS
`
`446
`
`FIG. 22
`
`Samsung Ex. 1109 p. 24
`
`Samsung Ex. 1109 p. 24
`
`

`
`U
`
`tnwaP
`
`m
`
`.3.m
`
`S2%
`
`
`
`.3zo_0m_mzo:<_>_m_o¢z_moz<mabfim
`
`4_<_>_-m_oz<4_<_>_mo_o>
`
`3mzoznmzmfi
`
`Emoz<:N3
`
`n.Em:wEo_._muio2%»“E02%»
`
`m35.D.3mm.0_u_93,m61Q,
`08mMmmvEvg
`Um
`
`ma
`
`n
`
`Samsung Ex. 1109 p. 25
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 24 of 121
`
`US 6,526,335 B1
`
`PROVIDE OPTION ON REFRIGERATOR —
`
`MOUNTED FLAT—PANEL DISPLAY OR
`OTHER IN-HOME DEVICE TO OPEN
`
`460
`
`GARAGE DOOR, START CAR, SHUT OFF
`
`LIGHTS IN HOME, ADJUST HOME
`
`USER SELECTS OPTION
`
`HEATING AND AIR CONDITIONING, ETC.
`
`
`USE IN-HOME APPLIANCE TO SEND
`
`COMMANDS TO AUTOMOBILE
`
`PERSONAL COMPUTER TO ENSURE
`
`THAT IN-HOME FUNCTIONS ARE
`
`PERFORMED
`
`462
`
`FIG. 24
`
`Samsung Ex. 1109 p. 26
`
`Samsung Ex. 1109 p. 26
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 25 of 121
`
`US 6,526,335 B1
`
`PROVIDE USERS WITH OPPORTUNITY TO
`CREATE OR PROVIDE PERSONAL
`IDENTIFICATION NUMBER (PIN), PASSWORD
`(ALPHANUMERIC OR SPOKEN WORD), OR
`OTHER UNIQUE IDENTIFIER (E.G. VOICE
`PRINT, FINGERPRINT, ETC.)
`
`464
`
`USE PIN, PASSWORD, VOICE PRINT,
`FINGERPRINT, OR OTHER SECURITY CODE
`OR PHYSICAL TRAIT TO VERIFY USER'S
`
`466
`
`IDENTITY
`
`FIG. 25
`
`Samsung Ex. 1109 p. 27
`
`Samsung Ex. 1109 p. 27
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 26 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH PROMPT ASKING
`
`USER TO PROVIDE USER ID AND
`
`PASSWORD
`
`468
`
`USE USER ID AND PASSWORD TO
`
`VERIFY IDENTITY OF USER
`
`470
`
`FIG. 26
`
`Samsung Ex. 1109 p. 28
`
`Samsung Ex. 1109 p. 28
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 27 of 121
`
`US 6,526,335 B1
`
`DETERMINE USER'S
`
`LOCATION
`
`PROVIDE USER WITH OPPORTUNITY
`
`TO INPUT DIRECTIONS (E.G., USING
`TOUCH SCREEN, SCREEN WITH
`TRACK BALL, PAD-BASED DEVICE, OR
`OTHER USER INTERFACE)
`
`474
`
`PROVIDE USER WITH DIRECTIONS
`BASED ON SELECTED DESTINATION
`
`475
`
`FIG. 27
`
`Samsung Ex. 1109 p. 29
`
`Samsung Ex. 1109 p. 29
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 28 of 121
`
`US 6,526,335 B1
`
`
`
`
`DETERMINE LOCATION OF
`
`AUTOMOBILE (E.G., USING GPS
`RECEIVER IN AUTOMOBILE
`
`PERSONAL COMPUTER)
`
`480
`
`
`
`
`DETERMINE WHICH STATE THE
`
`
`VEHICLE IS LOCATED IN AND
`
`DETERMINE WHETHER VEHICLE IS
`
`
`
`
`
`
`
`BEING DRIVEN OR IS PARKED
`
`CONTROL THE DISPLAY OR VISUAL
`
`482
`
`
`
`
`
`INFORMATION BASED ON LAWS OF THE
`
`STATE THE VEHICLE IS LOCATED IN (E.G., NO
`GRAPHICAL INFORMATION, ONLY DRIVING-
`
`RELATED GRAPHICAL INFORMATION, ETC.)
`AND WHETHER OR NOT THE VEHICLE IS
`
`
`
`BEING DRIVEN OR IS PARKED
`
`FIG. 28
`
`Samsung Ex. 1109 p. 30
`
`Samsung Ex. 1109 p. 30
`
`

`
`U.S. Patent
`
`yd
`
`m.,
`
`N.W
`
`/0925,6
`
`1B
`
`
`
`m.05.__>5_o<B.Eoam_<.j<_>_
`
`
`
`
`
`5I3mmOr.
`
`WX
`
`m_E_mo_>_o5$
`
`Azo:<o9
`
`Mm+zm_>m_m_Em>o<
`
`nmmo<mmm9.5:85mEz_E
`
`9%
`
`8...
`
`
`
`._.O._0Z_xm<n_
`
`m:_m_o_>_oS<
`
`m:_mo_>_oS<
`
`4<zomm_mn_
`
`mm_5n_s_oo
`
`Samsung Ex. 1109 p. 31
`
`Samsung Ex. 1109 p. 31
`
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 30 of 121
`
`US 6,526,335 B1
`
`BROADCAST GPS SIGNALS
`
`500
`
`OBTAIN GPS POSITION SIGNAL
`
`FROM SATELLITES AND CLOCK
`
`SIGNALS
`SIGNAL
`DETERMINE LOCATION BASED ON GPS POSITION SIGNAL
`ALERT DRIVER
`
`502
`
`504
`
`505
`
`508
`
`CORRECT ERRORS IN ON-BOARD
`
`CLOCK USING GPS CLOCK
`
`DETERMINE CURRENT TIME ZONE
`BASED ON GPS LOCATION AND
`UPDATE CLOCK ACCORDINGLY,
`
`FIG. 30
`
`Samsung Ex. 1109 p. 32
`
`Samsung Ex. 1109 p. 32
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 31 of 121
`
`US 6,526,335 B1
`
`MONITOR LOCATION TO
`
`DETERMINE WHETHER USER IS
`
`ABOUT TO ARRIVE HOME
`
`USE AUTOMOBILE PERSONAL
`
`COMPUTER TO OPEN GARAGE
`
`DOOR AND TURN ON LIGHTS,
`
`ADJUST HEATING AND AIR
`
`CONDITIONING IN ANTICIPATION OF
`
`USER'S ARRIVAL
`
`IF USER PASSES HOME WITHOUT
`
`STOPPING, CLOSE GARAGE DOOR
`AND TURN OFF LIGHTS, ADJUST
`HEATING OR AIR CONDITIONING
`
`FIG. 31
`
`Samsung Ex. 1109 p. 33
`
`Samsung Ex. 1109 p. 33
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 32 of 121
`
`US 6,526,335 B1
`
`
`
`PROVIDE USER WITH OPPORTUNITY TO
`
`ESTABLISH ACTIONS TO BE TAKEN WHEN
`
` 516
`
`
`
`520
`
`
`
`
`
`TAKE SPECIFIED ACTIONS (E.G., E-MAIL
`NOTIFICATION TO USER, CALL PLACED OR MESSAGE
`SENT TO PERSONNEL AT SERVICE PROVIDER,
`
`
`
`POLICE OR EMERGENCY SERVICES NOTIFIED,
`
`CENTRAL OFFICE NOTIFIED, UPDATE WEB PAGE,
`
`
`
`ETC.)
`
`FIG. 32
`
`Samsung Ex. 1109 p. 34
`
`
`
`
`
`
`
`CERTAIN VEHICLE CONDITIONS ARE DETECTED
`
`SUCH AS AIRBAG DEPLOYMENT, RAPID
`
`DECELERATION, HIGH SPEED, ROAMING OUTSIDE
`OF A SPECIFIED RANGE, STARTING OF ENGINE,
`EXCEEDING SPEED LIMITS, FOLLOWING TOO
`
`CLOSE BEHIND VEHICLES, ETC.
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`MONITOR VEHICLE CONDITIONS
`
`
`
`518
`
`
`
`Samsung Ex. 1109 p. 34
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 33 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO
`
`DIRECT AUTOMOBILE PERSONAL COMPUTER
`TO MONITOR SPEED OF AUTOMOBILE
`RELATIVE TO SPEED LIMITS AND TO MONITOR
`
`522
`
`WHEN AUTOMOBILE IS DRIVEN
`
`AUTOMOBILE PERSONAL COMPUTER
`DETERMINES DATE AND TIME AND MONITORS
`DRIVER BY DETERMINING LOCATION AND
`SPEED OF VEHICLE AND BY COMPARING
`MEASURED SPEED TO SPEED LIMITS IN
`
`DATABASE AND AUTOMOBILE PERSONAL
`
`COMPUTER GENERATES REPORTS OR
`
`NOTIFICATIONS
`
`524
`
`PROVIDE RESULTS OF MONITORING TO USER
`(E.G., BY E-MAIL OR BY MAKING AVAILABLE AT
`WEB SITE OR THE LIKE)
`
`525
`
`FIG. 33
`
`Samsung Ex. 1109 p. 35
`
`Samsung Ex. 1109 p. 35
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 34 of 121
`
`US 6,526,335 B1
`
`USE DEFAULT TRACKING SETTING OR PROVIDE
`
`TRACKING FEATURE
`
`USER WITH OPPORTUNITY TO INVOKE VEHICLE
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT
`
`FORMATS AND DESTINATIONS FOR
`
`NOTIFICATIONS (E.G., BY E-MAIL, ADDRESSES,
`TELEPHONE NUMBERS, PAGING NUMBERS, ETC.)
`
`MONITOR SENSORS TO DETERMINE IF VEHICLE IS
`
`STOLEN
`
`IF VEHICLE IS STOLEN, TRACK LOCATION, NOTIFY
`USER, SERVICE PROVIDER, AND POLICE OF
`THEFT, TIME OF THEFT, LOCATION OF THEFT,
`PRESENT LOCATION OF VEHICLE, ETC. (E.G.,
`USING E—MA|L, MESSAGES, PAGING
`NOTIFICATIONS, ETC.)
`
`528
`
`530
`
`532
`
`534
`
`FIG. 34
`
`Samsung Ex. 1109 p. 36
`
`Samsung Ex. 1109 p. 36
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 35 of 121
`
`US 6,526,335 B1
`
`USE DEFAULT SAFETY MODE OR ALLOW USER TO
`
`PLACE AUTOMOBILE PERSONAL COMPUTER IN A
`
`ACTIVITIES AND TO ASSESS DRIVER FATIGUE
`
`SAFETY MODE
`
`INTERACT WITH USER TO KEEP USER ENGAGED IN
`
`536
`
`538
`
`MONITOR USER'S BEHAVIOR WITH VIDEO CAMERA
`
`MICROPHONE, DRIVING-RELATED SENSORS, ETC. TO
`DETERMINE WHETHER USER IS ALERT OR FATIGUED
`
`540
`
`NOTIFY USER AND TAKE OTHER APPROPRIATE
`
`ACTIONS WHEN IT IS DETERMINED THAT THE USER IS
`
`542
`
`NOT ALERT
`
`FIG. 35
`
`Samsung Ex. 1109 p. 37
`
`Samsung Ex. 1109 p. 37
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 36 of 121
`
`US 6,526,335 B1
`
`CAPTURE IMAGES USING DIGITAL CAMERA AND
`
`GATHER OTHER VEHICLE INFORMATION
`
`AUTOMOBILE PERSONAL COMPUTER SUPPLIES
`
`IMAGES AND VEHICLE INFORMATION TO SERVER ON
`
`INTERNET
`
`PROVIDE USER WITH OPPORTUNITY TO ACCESS
`
`IMAGES AND OTHER VEHICLE INFORMATION (E.G.,
`USING WEB BROWSER)
`
`FIG. 36
`
`Samsung Ex. 1109 p. 38
`
`Samsung Ex. 1109 p. 38
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 37 of 121
`
`US 6,526,335 B1
`
`MONITOR VEHICLE PERFORMANCE (E.G.,
`SPEED, ODOMETER, FUEL USAGE,
`
`DIAGNOSTIC CODES, ETC.)
`
`550
`
`COLLECT SERVICE INFORMATION (E.G.,
`MAINTENANCE RECORDS, ETC.)
`
`552
`
`USE SERVER TO PROVIDE WEB PAGE TO
`
`USER THAT CONTAINS PERFORMANCE
`
`STATISTICS, MAINTENANCE RECORDS,
`
`WARRANTY INFORMATION,
`
`RECOMMENDED MAINTENANCE, ETC.
`BASED ON AUTOMOBILE PERSONAL
`COMPUTER'S MEASURED PERFORMANCE
`
`554
`
`AND MAINTENANCE HISTORY, ETC.
`
`FIG. 37
`
`Samsung Ex. 1109 p. 39
`
`Samsung Ex. 1109 p. 39
`
`

`
`tnCtaP3U
`
`M
`
`5
`
`00
`
`m
`
`m.2,I!kzmmmmm.9
`
`
`
`
`
`MSow:ooimim__>__+
`
`
`
`m_o<mm_><m:o>MNewmm_.___>_8152m:n__m_._.m_o<mm><%8mOn=>_mmm_oS__>_m<o
`
`
`
`
`
`MEmmxm_m>>mz_m_oz<:osobmz
`
`
`
` mw.«Wmmo:am3N/09momEmmam1.mm6,maSuUS
`
`M
`
`Samsung Ex. 1109 p. 40
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 39 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY
`
`572
`
`TO CREATE, EDIT, ORGANISE, AND
`
`PLAY BACK VOICE MEMOS
`
`PROVIDE USER WITH OPPORTUNITY TO
`
`FORWARD VOICE MEMOS AND OTHER
`
`AUTOMOBILE PERSONAL COMPUTER
`CONTENT TO COMPUTER EQUIPMENT
`IN HOME OR OFFICE VIA LOCAL OR
`
`REMOTE WIRELESS COMMUNICATIONS
`
`(E.G., USING CORRESPONDING
`"FORWARD" OR DEDICATED "SYNC-TO-
`
`ALL" BUTTON)
`
`574
`
`FIG. 39
`
`Samsung Ex. 1109 p. 41
`
`Samsung Ex. 1109 p. 41
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 40 of 121
`
`US 6,526,335 B1
`
`AUTOMOBILE PERSONAL COMPUTER
`DETECTS VEHICLE IS BEING DRIVEN
`
`576
`
`INFORM E-MAIL SERVICE OF USER'S
`PRESENT LOCATION IN VEHICLE
`
`578
`
`E-MAIL SERVICE AUTOMATICALLY
`DIRECTS USER'S E-MAIL (OR COPIES) TO
`VEHICLE
`
`580
`
`NOTIFY USER WHEN E-MAIL ARRIVES OR
`IF THERE IS E-MAIL THAT HAS NOT BEEN
`READ SINCE LAST TIME VEHICLE WAS
`
`582
`
`DRIVEN
`
`FIG. 40
`
`Samsung Ex. 1109 p. 42
`
`Samsung Ex. 1109 p. 42
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 41 of 121
`
`US 6,526,335 B1
`
`USE DEFAULTS AND/OR PROVIDE
`USER WITH OPPORTUNITY TO SET
`
`534
`
`UP ALERTS
`
`PROVIDE ALERT TO USER THAT
`
`MESSAGES OR OTHER CONTENT IS
`
`AVAILABLE
`
`586
`
`USER SELECTS
`
`DESIRED CONTENT
`
`PROVIDE SELECTED CONTENT TO
`
`USER
`
`588
`
`FIG. 41
`
`Samsung Ex. 1109 p. 43
`
`Samsung Ex. 1109 p. 43
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 42 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO RECORD
`
`VOICE MEMOS
`
`PROVIDE USER WITH OPPORTUNITY TO ORGANIZE
`
`VOICE MEMOS AS A CALENDAR AND PROVIDE
`
`USER WITH OPPORTUNITY TO PLAY BOTH VOICE
`
`MEMOS AND EXPORT VOICE MEMOS TO MEMORY
`
`CARD OR COMPUTER (E.G., WIRELESSLY)
`
`FIG. 42
`
`Samsung Ex. 1109 p. 44
`
`Samsung Ex. 1109 p. 44
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 43 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT
`E-MAIL ALERT FUNCTIONS (E.G. AUTOMATIC
`REPLY, REDUCE AUDIO VOLUME, TONE , VOICE
`
`CLIP, MP3 FILE NOTIFICATION, ETC.)
`
`
`TRANSMIT E—MA|L TO AUTOMOBILE PERSONAL
`
`COMPUTER
`
`594
`
`596
`
`598
`
`ALERT USER OF E-MAIL USING USER-SELECTED
`
`ALERT TECHNIQUE
`
`AUTO REPLY TO E-MAIL (E.G., WITH ATTACHED TEXT
`MESSAGE OR AUDIO CLIP)
`
`500
`
`PROVIDE USER WITH OPPORTUNITY TO SELECT ONE
`
`OF MULTIPLE PREDEFINED REPLIES TO USE IN RESPONDING TO THE E-MAIL
`
`REPLY USING SELECTED REPLY MESSAGE
`
`602
`
`604
`
`PROVIDE USER WITH OPPORTUNITY TO FORWARD
`
`606
`
`E-MAIL TO WORK, ETC.
`
`FIG. 43
`
`Samsung Ex. 1109 p. 45
`
`Samsung Ex. 1109 p. 45
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 44 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO REGISTER
`
`WITH SERVICE PROVIDER (E.G., BY SUPPLYING
`AUTOMOBILE PERSONAL COMPUTER IDENTIFIER AND
`
`USER INFORMATION TO SERVICE PROVIDER)
`
`
`
`
`
`USING USER DEVICE (E.G., PERSONAL COMPUTER,
`WEB APPLIANCE, HANDHELD COMPUTING DEVICE,
`ETC.) PROVIDE USER WITH OPTION (E.G. AN ON-
`SCREEN OPTION) TO INITIATE REMOTE VEHICLE
`CONTROLS (E.G., UNLOCK DOOR, START ENGINE,
`ETC.)
`
`608
`
`610
`
`612
`
`614
`
`VERIFY USER'S IDENTITY AT USER DEVICE OR
`
`SERVICE PROVIDER
`
`ETC.
`
`TRANSMIT REMOTE VEHICLE CONTROL COMMANDS
`
`TO VEHICLE (E.G., TO AUTOMOBILE PERSONAL
`COMPUTER) TO UNLOCK VEHICLE, TO START ENGINE,
`
`FIG. 44
`
`Samsung Ex. 1109 p. 46
`
`Samsung Ex. 1109 p. 46
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 45 of 121
`
`US 6,526,335 B1
`
`PROVIDE USER WITH OPPORTUNITY TO LIMIT WHICH
`DEVICES CAN CONTROL VEHICLE (SETTINGS MAY BE
`STORED IN AUTOMOBILE PERSONAL COMPUTER OR AT
`
`616
`
`OTHER LOCATIONS)
`
`WHEN REMOTE CONTROL IS ATTEMPTED, DETERMINE
`WHETHER CONTROLLING DEVICE IS ONE OF THE
`
`618
`
`SPECIFIED USER DEVICES
`
`IF DEVICE IS ONE OF THE SPECIFIED DEVICES, ALLOW
`AUTOMOBILE PERSONAL COMPUTER TO BE
`
`520
`
`CONTROLLED REMOTELY
`
`FIG. 45
`
`Samsung Ex. 1109 p. 47
`
`Samsung Ex. 1109 p. 47
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 46 of 121
`
`US 6,526,335 B1
`
`
`
`
`
`622
`
`
`
`PROVIDE OPTIONS (E.G., ON-SCREEN OPTIONS) WITH
`USER DEVICE THAT THE USER MAY SELECT TO INITIATE
`
`THE PROCEDURE TO UNLOCK THE AUTOMOBILE
`
`DOORS, TO START THE ENGINE, OR TO OTHERWISE
`REMOTELY CONTROL THE AUTOMOBILE'S FUNCTIONS
`
`OR AUTOMOBILE PERSONAL COMPUTER)
`
`USE HANDHELD COMPUTING DEVICE OR OTHER USER
`DEVICE TO VERIFY USER'S IDENTITY (E.G., AT SERVER
`
`ALLOW USER TO REMOTELY CONTROL AUTOMOBILE
`
`WITH USER DEVICE
`VEH|CLE'S LOCATION
`
`PROVIDE USER WITH CURRENT INFORMATION ON
`
`624
`
`626
`
`628
`
`630
`
`FIG. 46
`
`Samsung Ex. 1109 p. 48
`
`
`
`
`
`
`PROVIDE USER WITH OPPORTUNITY TO SET UP A USER
`
`DEVICE SUCH AS A COMPUTING DEVICE, PORTABLE
`COMPUTER, PERSONAL COMPUTER, WEB APPLIANCE,
`OR CONTROL AND INFORMATION DEVICE OR THE LIKE
`
`FOR REMOTE VEHICLE CONTROL SERVICES (E.G.,
`PROVIDE USER DEVICE WITH AN IDENTIFIER FOR THE
`
`AUTOMOBILE PERSONAL COMPUTER OR VEHICLE, A
`
`PASSWORD, ETC.)
`
`Samsung Ex. 1109 p. 48
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 47 of 121
`
`US 6,526,335 B1
`
`QUERY AUTOMOBILE ON ITS LOCATION
`
`632
`
`AUTOMOBILE OBTAINS COORDINATES AND
`DETERMINES ADDRESS OR OTHER CONTEXTUAL
`LOCATION INFORMATION USING LOCAL MAP DATABASE
`
`634
`
`AUTOMOBILE SUPPLIES STREET ADDRESS AND OTHER
`
`CONTEXTUAL LOCATION INFORMATION TO USER
`
`636
`
`DEVICE
`
`FIG. 47
`
`Samsung Ex. 1109 p. 49
`
`Samsung Ex. 1109 p. 49
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 48 of 121
`
`US 6,526,335 B1
`
`QUERY AUTOMOBILE ON
`LOCATIONS
`
`533
`
`640
`
`AUTOMOBILE
`
`SUPPLIES LOCATION
`
`COORDINATES
`
`ACCESS DATABASE REMOTE
`
`542
`
`FROM AUTOMOBILE TO
`
`PROVIDE CONTEXTUAL
`
`LOCATION OF AUTOMOBILE
`
`TO USER DEVICE
`
`FIG. 48
`
`Samsung Ex. 1109 p. 50
`
`Samsung Ex. 1109 p. 50
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 49 of 121
`
`US 6,526,335 B1
`
`ESTABLISH LOCAL WIRELESS
`
`COMMUNICATIONS LINK BETWEEN
`
`WIRELESS DEVICE AND AUTOMOBILE
`
`PERSONAL COMPUTER
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`AUTHORIzE PAYMENT AND USE wIRELESS
`
`DEVICE TO PROVIDE BENEFIT TO USER OF
`
`AUTOMOBILE PERSONAL COMPUTER (E.G.,
`PURCHASE OF PRODUCT OR SERVICE IS
`AUTHORIZED AND TRANSACTION
`
`COMPLETED USING THE wIRELESS DEVICE,
`OR SERVICE IS PROVIDED USING WIRELESS
`
`DEVICE)
`
`644
`
`646
`
`PROVIDE USER WITH INFORMATION REGARDING
`THE TRANSACTION (E.G., USE AUTOMOTIVE
`PERSONAL COMPUTER TO PROVIDE USER WITH
`
`648
`
`AN AUDIBLE OR VISUAL CONFIRMATION OF THE
`
`TRANSACTION AND ACCOUNT STATUS
`
`INFORMATION OR THE LIKE)
`
`FIG. 49
`
`Samsung Ex. 1109 p. 51
`
`Samsung Ex. 1109 p. 51
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 50 of 121
`
`US 6,526,335 B1
`
`SET UP PAYMENT ARRANGEMENT
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. LOCALLY IN VEHICLE
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. REMOTELY (E.G. ON SERVER)
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. IN SMART CARD
`
`STORE INFORMATION FOR CREDIT CARD, DEBIT CARD,
`ACCOUNT NUMBER, ETC. IN WIRELESS CARD
`
`
`
`
`
`
`
`
`658
`
` INITIATE TRANSACTION (E.G., PLACE ORDER, MAKE OFFER, ETC.)
`
`
`
`
`USE TELEPHONE
`
`662
`
`USE AUTOMOBILE PERSONAL COMPUTER
`
`AND LOCAL WIRELESS LINK
`
`USE AUTOMOBILE PERSONAL COMPUTER
`AND REMOTE WIRELESS LINK
`
`USE STATIONARY COMPUTER EQUIPMENT
`OR OTHER COMPUTING DEVICE
`
`664
`
`666
`
`668
`
`650
`
`652
`
`654
`
`656
`
`550
`
`
`
`
`COMPLETE TRANSACTION
`USE TELEPHONE
`
`572
`
`670
`
`
`
`
`
`
`
`USE AUTOMOBILE PERSONAL COMPUTER
`
`574
`
`AND REMOTE WIRELESS LINK
`
`USE AUTOMOBILE PERSONAL COMPUTER
`
`676
`
`AND REMOTE WIRELESS LINK
`
`678
`
`USE STATIONARY COMPUTER EQUIPMENT
`
`530
`
`
`
`USE CREDIT CARD, DEBIT CARD, ACCOUNT
`NUMBER, ETC.
`USE SMART CARD
`682 USE WIRELESS CARD 684
`
`
`
`FIG. 50
`
`Samsung Ex. 1109 p. 52
`
`
`
`
`Samsung Ex. 1109 p. 52
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 51 of 121
`
`US 6,526,335 B1
`
`PROVIDE OPPORTUNITY FOR USER TO SUPPLY
`
`AUTOMOBILE PERSONAL COMPUTER OR REMOTE
`SERVER WITH CREDIT CARD INFORMATION, DEBIT
`CARD INFORMATION, INFORMATION ON ACCOUNTS
`
`635
`
`THAT HAVE BEEN SET UP WITH DIFFERENT
`
`SERVICE PROVIDERS, ETC.
`
`PROVIDE USER WITH OPPORTUNITY TO ASSIGN
`
`MERCHANTS OR CLASSES OF MERCHANTS TO
`
`688
`
`CERTAIN USER ACCOUNTS OR CREDIT OR DEBIT
`
`CARDS
`
`WHEN USING AUTOMOBILE PERSONAL COMPUTER
`
`FOR A WIRELESS FINANCIAL TRANSACTION, USE
`THE CREDIT CARD, DEBIT CARD, OR OTHER
`SELECTED ACCOUNT OR FINANCIAL INSTRUMENT
`
`690
`
`FIG. 51
`
`Samsung Ex. 1109 p. 53
`
`Samsung Ex. 1109 p. 53
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 52 of 121
`
`US 6,526,335 B1
`
`USER PURCHASES (E.G., WITH AUTOMOBILE
`PERSONAL COMPUTER AND LOCAL WIRELESS
`
`LINK) SOFTWARE OR PURCHASES OTHER
`PRODUCT THAT ENTITLES USER TO FREE
`
`692
`
`SOFTWARE, ETC.
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`DOWNLOAD SOFTWARE OR OTHER
`
`MATERIALS (E.G., AT GAS STATION OR OTHER
`MERCHANT USING LOCAL WIRELESS LINK)
`
`694
`
`RUN SOFTWARE ON AUTOMOBILE PERSONAL
`
`COMPUTER OR OTHERWISE USE
`DOWNLOADED MATERIALS
`
`595
`
`FIG. 52
`
`Samsung Ex. 1109 p. 54
`
`Samsung Ex. 1109 p. 54
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 53 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`OBTAIN TOUR INFORMATION (E.G., FROM
`KIOSK USING LOCAL LINK, FROM INTERNET
`USING REMOTE LINK, ETC.)
`
`698
`
`DETERMINE LOCATION
`
`PLAY BACK DOWNLOADED AUDIO
`
`TOUR BASED ON LOCATION
`
`700
`
`702
`
`FIG. 53
`
`Samsung Ex. 1109 p. 55
`
`Samsung Ex. 1109 p. 55
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 54 of 121
`
`US 6,526,335 B1
`
`ESTABLISH LINK BETWEEN AUTOMOBILE PERSONAL
`
`704
`
`COMPUTER AND WIRELESS DEVICE
`
`706
`
`VERIFY USER IS AUTHORIZED
`
`OPEN GATE
`
`USER PARKS FOR DESIRED
`
`AMOUNT OF TIME THEN EXITS
`
`708
`
`710
`
`UPON EXIT, ESTABLISH LINK
`
`DETERMINE AMOUNT OF TIME, CALCULATE FEE DUE,
`COMPLETE TRANSACTION BY DEBITING USER, OPEN
`GATE
`
`712
`
`714
`
`PROVIDE USER WITH OPPORTUNITY TO REVIEW
`
`ACCOUNT STATUS (E.G., PROVIDE AUDIBLE
`INFORMATION ON ACCOUNT BALANCE OR AUDIBLE
`
`INFORMATION CONFIRMING THE TRANSACTION)
`
`FIG. 54
`
`Samsung Ex. 1109 p. 56
`
`Samsung Ex. 1109 p. 56
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 55 of 121
`
`US 6,526,335 B1
`
`USE AUTOMOBILE PERSONAL COMPUTER TO
`
`ESTABLISH LINK TO ENTRANCE CONTROL DEVICE
`
`VERIFY USER IS AUTHORIZED
`
`716
`
`OPEN GATE
`
`720
`
`USER VISITS FACILITY
`
`DETERMINE AMOUNT OF TIME
`
`USER IS IN FACILITY, ISSUE
`ALERT IF OVER THRESHOLD
`
`
`
`
`
`AMOUNT
`
`UPON EXIT, ESTABLISH
`COMMUNICATIONS LINK AND
`
`PERFORM USER CHECK OUT
`
`FIG. 55
`
`722
`
`724
`
`Samsung Ex. 1109 p. 57
`
`Samsung Ex. 1109 p. 57
`
`

`
`U.S. Patent
`
`Feb. 25, 2003
`
`Sheet 56 of 121
`
`US 6,526,335 B1
`
`726
`
`723
`
`GATE
`
`
`
`
`
`GATE CONTOL
`
`EQUIPMENT
`
`WIRELESS
`
`COMMUNICATIONS
`
`AND PROCESSING
`
`CIRCUITRY
`
`14
`
`730
`
`AUTOMOBILE
`
`PERSONAL
`
`COMPUTER
`
`AUTOMOBILE
`
`COMMUNICATIONS
`
`NETWORK
`
`736
`
`COMPUTER
`
`FIG. 5