I IIIII IIIIIIII II llllll lllll lllll lllll lllll lllll lllll lllll lllll lllll lllll 111111111111111111
`US 20040093155Al
`
`(19) United States
`(12) Patent Application Publication
`Simonds et al.
`
`(10) Pub. No.: US 2004/0093155 Al
`May 13, 2004
`(43) Pub. Date:
`
`(54) SYSTEM AND METHOD FOR PROVIDING
`VEHICLE CONTEXT INFORMATION
`
`(76)
`
`Inventors: Craig John Simonds, Dearborn, MI
`(US); John Loring Yester, Bloomfield
`Hills, MI (US); Krishnaswamy
`Venkatesh Prasad, Ann Arbor, MI
`(US)
`
`Correspondence Address:
`PRICE, HENEVELD, COOPER, DEWITT &
`LITTON
`695 KENMOOR S.E.
`P. 0. BOX 2567
`GRAND RAPIDS, MI 49501-2567 (US)
`
`(21)
`
`Appl. No.:
`
`10/696,597
`
`(22)
`
`Filed:
`
`Oct. 29, 2003
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/425,526, filed on Nov.
`12, 2002.
`
`Publication Classification
`
`Int. Cl.7 ..................................................... GOlC 21/26
`(51)
`(52) U.S. Cl. ............................................ 701/200; 701/211
`
`(57)
`
`ABSTRACT
`
`An infotainment system is provided which efficiently man(cid:173)
`ages and provides for the availability of information onboard
`a vehicle. The infotainment system includes an infogas agent
`for acquiring information from an external source. The
`infotainment system further includes a context-based deliv(cid:173)
`ery system for delivering context-based information. The
`context-based information includes a vehicle context advi(cid:173)
`sor for monitoring and storing information relative to
`vehicle devices and services available on the vehicle. The
`context advisor further includes a personalization context
`advisor for monitoring and storing personalization informa(cid:173)
`tion made available to devices and services onboard the
`vehicle. The context advisor further includes an environ(cid:173)
`mental context advisor for monitoring and storing environ(cid:173)
`mental information made available to devices and services
`onboard the vehicle.
`
`,-25
`
`SPEEDOMETER
`
`26
`
`CHASSIS
`VEHICLE CONSUMER
`CONTROL
`SERVICES INTERFACE
`MODULE VEHICLE BUS
`-~~--'--~'----+----'--='-'r"---'2""0 =++l
`
`(v Cs 0
`
`18
`
`30
`
`48
`
`!KEYFofil
`/
`/',../
`, CELL PHONE
`/
`46
`' - - - - - - - - - - '
`,• /
`1
`,--( 50
`-~ - - -~ ' ,,,, "
`WIRELESS LINK
`-----,--~
`52
`
`/\-/ IBLUETOOTH, 802.11, etc. ',,
`
`51
`
`POWER
`TRAIN CONTROL
`MODULE
`
`28
`
`29
`
`MAIN VISUAL HMI
`
`REAR SEAT
`ENTERTAINMENT
`HMI
`
`VOICE-BASED
`HMI
`
`RADIO
`TUNER
`
`',:,,,~
`
`AUDIO
`AMPLIFIER
`
`CD/DVD
`
`36
`
`38
`
`40
`
`42
`
`Page 1 of 33
`
`Daimler Exhibit 1005
`
`

`

`Patent Application Publication May 13, 2004 Sheet 1 of 17
`
`US 2004/0093155 Al
`
`0
`
`l'.J
`LL
`
`0000
`00000
`0000
`
`0000
`
`Page 2 of 33
`
`

`

`/25
`
`/, 24
`
`SPEEDOMETER
`
`,
`
`,
`
`,
`
`CHASSIS
`CONTROL
`MODULE
`I
`
`VEHICLE BUS
`20
`
`POWER
`TRAIN CONTROLI
`MODULE
`
`29
`ADJUST ABLE SEAT
`CONTROLLER
`23
`
`ON-BOARD
`DIAGNOSTICS
`
`28
`
`MAIN VISUAL HMI
`
`REAR SEAT
`ENTERTAINMENT
`HMI
`
`VOICE-BASED
`HMI
`
`RADIO
`TUNER
`
`J
`HIGH SPEED BUS
`(MOSTI
`
`I
`
`I
`
`26
`
`18
`
`r 30
`
`46
`
`VEHICLE CONSUMER
`SERVICES INTERFACE
`r;
`,\
`'-V CS!;
`
`~ 5 1
`~
`/
`/\/
`/1CELL PHONE J
`/
`/".,/
`/
`, - ( SO
`,/
`-----z--~
`
`48
`
`',,,,:,, ,-( s2
`'~
`
`WIRELESS LINK
`..---"'-..---~ (BLUETOOTH, 802.11, etc.
`
`36
`
`38
`
`40
`
`42
`
`AUDIO
`AMPLIFIER
`
`CD/DVD
`
`NAVIGATION
`SYSTEM
`
`GPS
`RECEIVER
`
`FIG. 2
`
`""C
`
`~ .... ~ = ....
`~ "Cl -....
`~ ....
`.... 0 =
`~
`O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`~
`~
`'-<
`"'"" ~~
`N
`C
`C
`,i;;..
`
`'JJ. =(cid:173)~
`~ ....
`N
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 3 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 3 of 17
`
`US 2004/0093155 Al
`
`CX)
`Ln
`
`l~Od ~3/\13JSNV~l
`
`I
`
`.....
`
`UJ
`V)
`<t
`_,
`UJ
`a..
`::::c
`I-
`a::
`0
`3
`V)
`a::
`_,
`<t
`
`C'-•
`....J
`....J
`LL
`>-
`<t
`:E
`:c
`u
`:::::,
`:E
`3
`0
`:c
`l'T"I
`
`.....
`V)
`<t
`l::1
`0
`LL
`z
`a
`UJ
`UJ z
`......
`
`a
`>-
`:E
`V)
`
`UJ
`a::
`UJ
`:c
`I
`I
`
`V)
`UJ
`>-
`N
`
`C'·
`UJ
`
`V) I
`
`UJ
`
`V)
`
`UJ
`a::
`:::::,
`V)
`
`rn
`.
`~
`LL
`
`UJ_,
`:I: UJ
`I- l::1
`a::z
`o -
`u. :I:
`I- V)
`V>>- ~ >
`<tz z
`a::
`l::1 <t <t
`a
`:c
`.....
`0
`u.
`.
`zv,
`I-
`UJ
`u.
`_U,J 0
`<t
`UJ
`UJ ::::::!'
`z
`a::
`UJ >~
`V)
`<to I-
`<t
`:I:
`:::::,
`:I: 0
`al
`UJ
`:::::, ...:t
`>
`:::::,
`<t
`OI-
`>-X 0
`::::c
`• UJ >-
`\oOZ
`
`Ln
`
`~
`
`CX)
`
`! I ! ....J 0 ! ! z !
`
`
`
`a
`<t
`...:t
`
`<(
`:I:
`I-
`r-
`
`lt!Od ~3/\13JSNVtll
`
`0 ......
`
`Page 4 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 4 of 17
`
`US 2004/0093155 Al
`
`/
`( 10
`~-------V-E-HI-CL-E-----'-----~1 TRANSCEIVER PORTI
`
`4
`
`~
`(56
`/58
`~--------------'-------l
`I DISTRIBUTION LOCATION (e.g., REFUELING ST A TION) TRANSCEIVER PORT
`i
`i
`
`SUPPLIER
`
`(60
`
`62
`
`CONTENT AND SERVICE PROVIDERS
`
`FIG. 4
`
`Page 5 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 5 of 17
`
`US 2004/0093155 Al
`
`CX) ©
`
`C)
`
`Lf)
`
`L9
`LL
`
`CX)
`CX)
`
`-----
`
`Page 6 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 6 of 17
`
`US 2004/0093155 Al
`
`/100
`
`106
`
`IDENTIFY DRIVER AND ACCESS
`STORED INFORMATION REGARDING
`DRIVER INTERESTS,PREFERENCES,
`DESTINATIONS AND PREDICTOR DAT A
`~----......__ ____ _,_, 108
`READ VEHICLE LOCATION AND TIME
`
`HAS
`DRIVER
`REQUESTED SPECIFIC TYP
`OR CATEGORY OF INFORMATION
`FROM THE CURRENT DAT ABASE
`OR FROM A FUTURE
`NFOGAS SERVICE
`
`NO
`
`112
`
`IS
`VEHICLE
`CONNECTED TO
`INFOGAS
`SERVICE
`7
`
`114
`
`REQUEST INFORMATION FROM INFOGAS
`SERVICE ACCESS (SPECIFIC, INTERNAL,
`AND ADDITIONAL INFORMATION)
`
`PROVIDE REQUESTED
`INFORMATION TO DRIVER {i.e., POINTS OF
`INTEREST, ENTERTAINMENT, NEWS, etc.)
`
`116
`
`118
`
`PROVIDE INFERRED AND
`ADDITIONAL TYPES OF INFORMATION
`TO THE DRIVER
`
`FIG. 6
`
`120
`
`HAS
`DRIVER
`EXITED THE
`VEHICLE
`7
`
`122
`
`Page 7 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 7 of 17
`
`US 2004/0093155 Al
`
`.
`L:J
`LL
`
`(X)
`
`D
`(X)
`
`N -
`N - u
`
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`>(cid:173)
`Lu u z
`v, -0
`
`<(
`t(cid:173)
`
`(~~
`z l
`))c.n
`\ ' -
`
`ra
`(X)
`N
`-
`
`UJ
`
`X
`
`Lu u z
`
`<:(
`t(cid:173)
`v,
`0
`
`-
`
`Page 8 of 33
`
`

`

`SERVICE AGENTS
`
`S64
`
`CONTEXT ADVISORS
`
`72
`
`73
`
`I APPLICATIONS r'66
`I SECURITY FILTER r'68
`I I i SAFETY FILTER r10
`
`SERVICE
`AV AIL ABILITY
`
`IDENTIFIERS
`
`DEVICE MANAGER
`
`I SERVICE DISCOVERY AND MONITORING
`
`MECHANISM
`
`PHYSICAL HARDWARE INTERFACE
`
`7 4
`
`75
`
`~
`
`76
`
`'
`I (44
`MOST
`BUS
`
`( 46
`
`20
`
`(
`VEHICLE
`BUS
`
`WIRELESS BUS
`(BLUETOOTH, 802.11,
`MIO-RANGE AND
`LONG-RANGE WIRELESS)
`
`FIG. 8
`
`/30
`
`MESSAGES/
`REQUESTS
`
`""C
`
`~ .... ~ = ....
`~ "Cl -....
`~ ....
`.... 0 =
`~
`O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`~
`~
`'-<
`"""" ~~
`N
`C
`C
`,i;;..
`
`'JJ. =(cid:173)~
`~ ....
`00
`0 ....,
`""""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`~
`"""" Ul
`Ul
`>
`""""
`
`Page 9 of 33
`
`

`

`~ .... ~ = ....
`~ "Cl -....
`~ ....
`.... 0 =
`~
`O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`""C
`
`INFOGAS AGENT
`
`152
`I TRIP AGENT
`
`c 154
`r 156
`I ENTERTAINMENT
`AGENT
`
`158
`
`PIM AGENT
`
`SAFETY FILTER
`
`SECURITY FILTER
`
`PHYSICAL (e.g., CELL PHONE) DEVICES AND SERVICES
`
`70
`68
`
`48
`
`FIG. 9
`
`~
`~
`'-<
`"'"" ~~
`N
`C
`C
`,i;;..
`
`'JJ. =(cid:173)~
`~ ....
`\C
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 10 of 33
`
`

`

`ENVIRONMENT AL
`CONTEXT ADVISOR
`
`OFF-BOARD
`SERVICES
`CONTEXT ADVISOR
`
`300
`
`150
`
`170
`
`SERVICES CONTEX~
`ADVISOR
`
`4
`
`130
`
`• I VEHICLE CONTEXT ADVISOR
`(SERVICES)
`
`200
`PERSONALIZATION
`(MOBILE SERVICES)
`CONTEXT ADVISOR
`
`(A)
`START
`
`VEHICLE
`ENABLED
`SERVICE
`
`(DI PLACE
`ORDER
`
`(Bl
`ENABLE HMI
`
`(Cl
`LOCATION SPECIFIC
`m-COMMERCE AND SERVICE
`INTEGRATION
`
`FIG. 10
`
`""C
`
`~ .... ~ = ....
`> "Cl
`"Cl -....
`~ ....
`.... 0 =
`""C = O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`~
`~
`'-<
`"'"" ~~
`N
`C
`C
`,i;;..
`
`'JJ. =-~
`~ ....
`"'"" C
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 11 of 33
`
`

`

`VEHICLE ON-BOARD K
`
`DIAGNOSTICS SYSTEM
`
`VEHICLE CONTEXT II
`
`ADVISOR
`
`IDENTIFIER
`
`11 \
`
`131
`
`\
`
`VEHICLE SERVICES
`GATEWAY
`
`134
`
`136
`
`\
`
`"I OFF-BOARD SERVICE
`PROVIDER
`
`I
`
`146
`
`OTHER VEHICLE-RELATED
`DAT A & INFORMATION SOURCES
`
`PERSONAL DEVICES
`(PDA, CELL PHONE, etc.) I
`
`FIG. 11
`
`VEHICLE MONITORING
`AND CONTROL MODULES
`
`138
`I
`
`/140
`s TORED AND ACQUIRED I
`(MEASURED) DAT A
`
`INFORMATION DAT ABASE
`
`142
`
`144
`
`""C
`~
`
`.... ~ = ....
`> "Cl
`"Cl -....
`~ ....
`.... 0
`=
`""C =
`O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`~
`~
`'-<
`"'"" ~~
`N
`C
`C
`,i;;..
`
`~
`~
`
`'JJ. =-
`....
`"'""
`"'"" 0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 12 of 33
`
`

`

`Patent Application Publication May 13, 2004 Sheet 12 of 17
`
`US 2004/0093155 Al
`
`N ..--
`l.'.:J
`LL
`
`C
`N
`N
`
`\
`
`C
`IT\
`N
`
`c.n
`UJ r
`
`'° N
`
`N
`
`ro::
`L.LUJ ->
`I - _
`co::
`Z:Cl
`
`N
`N
`N
`
`UJ
`I(cid:173)
`<(
`
`1-(cid:173)z
`
`N
`IT\
`N
`
`......
`IT\
`N
`
`UJ z:
`0
`:::c .....J
`a.. .....J
`UJ<C u u
`<(
`.....J a..
`
`a..
`:::::,
`l!J z
`<(
`:::c
`
`Page 13 of 33
`
`

`

`f /
`
`PERSONALIZATION
`CONTEXT ADVISOR
`
`IDENTIFIER
`
`I I '\.
`
`201
`
`"'
`
`208
`VEHICLE MONITORING I
`AND CONTROL MODULES
`
`/"210
`STORED AND ACQUIRED I
`(MEASURED I DAT A
`
`212
`
`INFORMATION DAT ABASE
`
`OFF-BOARD SERVICE
`PROVIDER
`
`PDA
`
`PHONE
`
`~214
`
`I
`216
`
`I
`
`218
`
`I
`
`VEHICLE CONTROL K
`
`MODULES
`
`OFF-BOARD SERVICES
`GATEWAY
`
`PERSONAL ELECTRONICS 1
`DEVICES INTERFACE
`
`-----
`
`FIG. 13
`
`I")
`~
`
`I")
`
`""C
`~ ....
`~ = ....
`> "Cl
`"Cl -....
`....
`....
`0 =
`""C
`= O' -
`....
`~ ....
`....
`0 =
`~
`~
`'-<
`"'"" ~
`N
`C
`C
`,i;;..
`
`~
`
`'JJ. =-~
`~ ....
`"'"" ~
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 14 of 33
`
`

`

`,.256
`
`!YES ...
`
`260
`
`KRESTAR~ERMINAT~
`
`250~
`
`252
`
`x.-
`
`/'254
`
`NOTIFY
`DRIVER
`
`262
`
`ACCESS PERSONAL INFORMATION 1
`FROM VARIOUS SOURCES
`(e.g., PDA, VECHICLE SYSTEMS,
`OFF-BOARD SERVICE PROVIDER, ETC.)
`
`264
`DETERMINE CURRENT ACTIVITY I
`
`COMBINE INFORMATION FROM INFORMATION
`SOURCES AND CURRENT ACTIVITY TO GENERA TE
`. A COMPATIBILITY ANALYSIS
`
`266
`
`270 .
`
`DETERMINE
`AND SET
`CHANG ABLE
`VARIABLES
`
`FIG. 14
`
`t
`I PRESENT ACTIVITY SCHEDULE
`
`1272
`
`""C
`
`"Cl
`
`I")
`~
`
`~ .... ~
`= ....
`>
`"Cl -
`....
`....
`.... 0
`=
`""C = O' -....
`~ ....
`.... 0
`=
`~
`~
`'-<
`"'""
`~~
`N
`C
`C
`,i;;..
`
`I
`
`I
`
`I
`
`I")
`
`'JJ. =-~
`~ ....
`"'""
`,i;;..
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`"'""
`Ul
`Ul
`>
`"'""
`
`Page 15 of 33
`
`

`

`12:31 PM
`
`myPREFERENCES
`
`280
`
`I::,.
`,-
`
`-
`
`SELECT NAME BELOW
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, POM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, POM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, POM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, POM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, POM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR. PDM
`
`INTROTONICS TECHNOLOGIES PROJECT. MMR. PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`INTROTONICS TECHNOLOGIES PROJECT, MMR, PDM
`
`..._
`'v
`
`I JOHN DOE
`NAME:
`TITLE: I TECHNICAL SPECIALIST
`AUTO COMPANY
`COMPANY:
`
`ADDRESS:
`
`12345 UNKNOWN RD, DEARBORN, Ml 48301
`
`E-MAIL:
`
`JOOE@)AUTO.COM
`
`WORK:
`
`(123) 456-7890
`
`FAX:
`
`(123) 765-4321
`
`I IHOME: 11 (123) 987-6543
`I
`
`1198.7
`
`I 1911
`
`I I 96.3
`
`11101.9
`
`11101.s
`
`I
`
`I
`
`I::,.
`
`JAZZ
`I ACCEPT
`CLASSICAL
`I READ FORM
`COUNTRY
`BOOKS & SPOKEN TEXT
`I READ BUTTON
`ALTERNATIVE
`ROCK
`I SELECT YOUR NAME FROM LIST ON LEFT USING MOUSE.
`
`""C
`
`I")
`
`~ .... ~
`= ....
`> "Cl
`"Cl -....
`~ ....
`....
`0 =
`""C = O' -....
`....
`.... 0 =
`
`I")
`~
`
`~
`~
`'-<
`'""" ~~
`N
`C
`C
`,i;;..
`
`~
`
`'JJ.
`
`=-
`~ ....
`'""" Ul
`0 ....,
`'"""
`-..J
`
`FIG. 15
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`'""" Ul
`Ul
`>
`'"""
`
`Page 16 of 33
`
`

`

`VEHICLE CONTROL
`MODULES
`
`K
`
`OFF-BOARD SERVICES
`GATEWAY
`
`ENVIRONMENT AL
`CONTEXT ADVISOR
`
`[:/
`
`IDENTIFIER
`
`I I "\.
`
`301
`
`"'
`
`208
`VEHICLE MONITORING I
`AND CONTROL MODULES
`
`/210
`STORED AND ACQUIRED I
`(MEASURED) DAT A
`
`, 212
`INFORMATION DAT ABASE
`
`OFF-BOARD SERVICE
`PROVIDER
`
`I
`
`PDA
`
`""C
`~
`
`I")
`
`0
`
`.... ~ = ....
`> "Cl
`"Cl -....
`~ ....
`....
`=
`""C =
`O' -....
`~ ....
`....
`0 =
`~
`~
`'-<
`"'"" ~
`N
`C
`C
`,i;;..
`
`I")
`
`~
`
`~
`
`'JJ.
`
`=-~
`....
`"'"" O'I
`....,
`0
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`\C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`214
`
`216
`
`I
`
`218
`I
`
`PERSONAL ELECTRONICS
`DEVICES INTERFACE
`
`I ........._
`
`FIG. 16
`
`~I
`
`PHONE
`
`Page 17 of 33
`
`

`

`_,--330
`
`VIRTUAL INFO. SOURCE
`
`/' 340
`
`312
`
`/310
`
`PDA, OFF-BOARD
`3321 CALENDAR, etc.
`
`3341VEHICLE SYSTEMS
`
`WEATHER
`336'1 TRAFFIC, ROAD
`CONDITIONS
`INFORMATION
`CENTERS
`
`3381
`
`PERSONAL
`PROFILE
`INFORMATION
`(PREFER
`SHORTEST,
`FASTEST,
`SAFEST PATH)
`
`AGGREGATED
`INFO.
`MIDDLEWARE
`
`ACCESS WEATHER, TRAFFIC,
`ROAD CONDITIONS, AND DESTINATION
`INFORMATION FROM VARIOUS VIRTUAL
`INFORMATION SOURCES
`
`322
`
`DETERMINE IMPACT OF ENVIRONMENTAL
`CONDITIONS ON CURRENT DESTINATION AND
`TRAVEL PLANS
`
`.---~~~~----'-~~~~-----'---,324
`ANALYZE IMPACT TO DETERMINE IF
`AL TERNA TE ROUTE OR A CHANGE OF
`PLANS IS SUGGESTED
`
`FIG. 17
`
`328
`
`PRESENT INFORMATION
`TO DRIVER
`
`""C
`
`~ .... ~ = ....
`~ "Cl -....
`~ ....
`.... 0 =
`~
`O' -....
`~ ....
`.... 0 =
`
`I")
`
`I")
`
`~
`~
`'-<
`"'"" ~~
`N
`C
`C
`,i;;..
`
`'JJ. =(cid:173)~
`~ ....
`"'""
`-..J
`0 ....,
`"'""
`-..J
`
`d
`'JJ.
`N
`C
`C
`~
`C
`C
`~
`"'"" Ul
`Ul
`>
`"'""
`
`Page 18 of 33
`
`

`

`US 2004/0093155 Al
`
`May 13, 2004
`
`1
`
`SYSTEM AND METHOD FOR PROVIDING
`VEHICLE CONTEXT INFORMATION
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`[0001] This application claims the benefit of U.S. Provi(cid:173)
`sional Application No. 60/425,526, filed Nov. 12, 2002, the
`entire disclosure of which is hereby incorporated herein by
`reference.
`
`BACKGROUND OF THE INVENTION
`
`[0002] The present invention generally relates to systems
`and services for providing information on a vehicle and,
`more particularly, to integrated electronics systems that
`provide enhanced vehicle information services onboard a
`vehicle.
`
`[0003] Current and future automotive vehicles are being
`equipped with increasing numbers of electronic controllers
`and related devices. Conventional vehicles generally employ
`multiple sensors and control modules that may communicate
`a very limited and defined set of data via a proprietary
`communication protocol on a dedicated vehicle data com(cid:173)
`munication bus. For example, the vehicle original equipment
`manufacturer (OEM) data communication bus is generally
`coupled to an engine control module, a chassis control
`module, a power train control module, a body module,
`onboard diagnostics, a speedometer, a fuel level sensor
`(gauge), and various other electronic devices.
`
`[0004] These many vehicles may also be equipped with
`various infotainment devices such as an audio radio tuner, a
`compact disc (CD) or digital versatile disc (DVD) player, a
`navigation system, and one or more human machine inter(cid:173)
`faces (HMis), such as a visual display with user input
`keypads or a voice-based human machine interface employ(cid:173)
`ing a microphone and one or more audio speakers. These
`devices may be individually coupled to a multi-media bus,
`which is typically separated from the vehicle OEM data
`communication bus.
`
`[0005] Various wireless consumer devices may also be
`utilized in the vehicle. For example, cellular phones, per(cid:173)
`sonal digital assistants (PDAs), and digital music players,
`such as an MP3, brought into a vehicle may have some
`limited ability to communicate with one or more vehicle
`devices via wire or wireless (e.g., Bluetooth) data commu(cid:173)
`nication links.
`
`[0006] These devices and communication systems collec(cid:173)
`tively provide multiple sources of data and information that
`can be useful in performing a particular task or objective.
`For example, it may be desirable for a vehicle navigation
`system to provide customized navigation services based on
`vehicle status information, user preferences, and/or weather
`and traffic information. However, the sources for this diverse
`data and information are typically implemented within sepa(cid:173)
`rate and distinct independent systems, thus requiring a very
`complex dedicated system to be able to gather and process
`this data for use by a specific system, such as a navigation
`system.
`
`[0007] As future vehicles become even more "intelligent,"
`the amount of information available regarding the state of
`devices and systems employed in the vehicle is generally
`expected to continue to increase. The uses for this informa-
`
`tion may range from informing the driver that the vehicle
`needs some specific type of service (e.g., refueling, diag(cid:173)
`nostic repair, etc.), to enabling dynamic reconfiguration of
`in-vehicle services and features. To accomplish this with
`presently available vehicular systems, each device or system
`interfacing on the vehicle would be required to implement
`and support numerous separate and unique methods for
`accessing and processing data from the various sources, both
`within the vehicle and from off-board.
`
`[0008] Further, current infotronics devices and services,
`which generally include the combination of off-board ser(cid:173)
`vices, telematics, and personal information and communi(cid:173)
`cation devices used to provide advanced in-vehicle infor(cid:173)
`mation access, generally offer additional information and
`communication features and services to the vehicle. These
`infotronics devices and services typically include onboard
`and off-board navigation capability, access to a variety of
`information and assistance related services, including: traffic
`conditions reporting, roadside assistance, travel, and con(cid:173)
`cierge services, as well as other types of services. However,
`vehicles generally do not manage and provide a consistent
`configuration of such information and, thus, the information
`is not readily made available to various other devices
`onboard the vehicle.
`
`[0009] Accordingly, it is desirable to provide for a system
`and method of providing increased availability and access to
`information onboard a vehicle. It is also desirable to inte(cid:173)
`grate informational services to make a wide variety of
`information available onboard the vehicle. It is further
`desirable to provide for a system and method of integrating
`various types of information made available onboard a
`vehicle. For example, it is desirable to provide for and make
`available, vehicle-related information, personalization infor(cid:173)
`mation and environmental information which may be
`employed by various devices onboard a vehicle to create a
`cohesive system which enables new features and enhances
`the vehicle driving experience.
`
`SUMMARY OF THE INVENTION
`
`[0010] According to one aspect of the present invention, a
`system and method are provided for providing remote data
`to a vehicle. The system includes an off-board data source
`remote from the vehicle. The system also includes a com(cid:173)
`pute platform (e.g., processor) for accessing the data source
`to acquire information and generating a stream of data as a
`function of time and location of the vehicle. The system
`further includes a data communication link for communi(cid:173)
`cating data between the off-board data source and the
`vehicle. The stream of data is supplied to the vehicle for use
`onboard the vehicle. Accordingly, updated time and loca(cid:173)
`tion-based information is readily made available onboard the
`vehicle.
`
`[0011] According to another aspect of the present inven(cid:173)
`tion, a system and method are provided for delivering
`context-based services to a vehicle. The system includes a
`plurality of context advisors each providing a source of
`information for a designated category. In one embodiment,
`the context advisors may include a vehicle context advisor,
`a personalization context advisor and an environmental
`context advisor. The system also includes a plurality of
`service agents. The service agents perform context informa(cid:173)
`tion filtering based on a requested service. The system
`
`Page 19 of 33
`
`

`

`US 2004/0093155 Al
`
`May 13, 2004
`
`2
`
`further includes an interface for interfacing with an onboard
`device on a vehicle. The context advisors perform informa(cid:173)
`tion collection, and the service agents employ the collected
`information to acquire and store pertinent information. Thus,
`the efficient delivery of context-based services to a vehicle
`is realized.
`
`[0012] According to yet another aspect of the present
`invention, a system and method for providing vehicle con(cid:173)
`text information for onboard vehicle devices are provided.
`The system includes a monitor for monitoring a plurality of
`onboard vehicle devices and receiving context information.
`An identifier identifies context information related to each of
`the plurality of monitored onboard vehicle devices. The
`system also includes a data storage device having memory
`for storing vehicle context information for the plurality of
`onboard vehicle devices. The system further includes an
`application programming interface for communicating the
`data storage device with a requesting device onboard the
`vehicle. The application programming interface downloads
`the vehicle context information to the requesting device.
`Thus, the system advantageously makes available informa(cid:173)
`tion to onboard vehicle devices (including services) from
`vanous sources.
`
`[0013] According to a further aspect of the present inven(cid:173)
`tion, a system and method are provided for providing
`personalized context information for use with onboard
`vehicle devices. The system includes an input for accessing
`and receiving context information, and an identifier for
`identifying context information related to a person as per(cid:173)
`sonal context information. The system also includes a data
`storage device having memory for storing the identified
`personal context information. The system also includes an
`interface for communicating the data storage device with a
`plurality of onboard vehicle devices. The system further
`includes an agent for downloading personal context infor(cid:173)
`mation to one or more vehicle devices. Accordingly, user
`personal information is made available from a plurality of
`sources for use on devices (including services) onboard the
`vehicle.
`
`[0014] According to yet a further aspect of the present
`invention, a system and method for providing environmental
`context information for use with onboard vehicle devices is
`provided. The system includes an input for accessing and
`receiving context information, and an identifier for identi(cid:173)
`fying context information related to the environment as
`environmental context
`information. The system also
`includes a data storage device having memory for storing the
`identified environmental context information, and an inter(cid:173)
`face for communicating the data storage device with a
`plurality of onboard vehicle devices. The system further
`includes an agent for downloading environmental context
`information to one or more of the vehicle devices. The
`system advantageously monitors environmental information
`from various sources and makes the environmental infor(cid:173)
`mation readily available to devices (including services)
`onboard the vehicle.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`[0016] The present invention will now be described, by
`way of example, with reference to the accompanying draw(cid:173)
`ings.
`[0017] FIG. 1 is a perspective view of the cockpit of a
`vehicle equipped with an infotainment system having user
`interfacing electronics.
`[0018] FIG. 2 is a block diagram illustrating a vehicle
`consumer services interface (VCSI) host platform interfac(cid:173)
`ing with a plurality of electronic host devices in the vehicle.
`[0019] FIG. 3 is a block diagram illustrating one example
`of an information transaction using an infogas system
`according to one aspect of the present invention.
`[0020] FIG. 4 is a block diagram illustrating a vehicle
`communicating with off-board context and service providers
`to acquire information for use in the vehicle.
`[0021] FIG. 5 is a state diagram illustrating the acquisition
`of off-board information using an infogas system according
`to the present invention.
`[0022] FIG. 6 is a flow diagram illustrating a routine for
`acquiring information from off-board the vehicle using the
`infogas system.
`[0023] FIG. 7 is a graph illustrating blocks of spaciotem(cid:173)
`poral data that may be acquired and stored in memory for
`use onboard the vehicle.
`[0024] FIG. 8 is a block diagram illustrating the func(cid:173)
`tional layout of the VCSI host platform shown in FIG. 2.
`[0025] FIG. 9 is a block diagram illustrating the advisors
`and agents implemented in the VCSI host platform.
`[0026] FIG. 10 is a block/state diagram illustrating vari(cid:173)
`ous context advisors that may be employed to provide
`information for use onboard the vehicle.
`[0027] FIG. 11 is a block diagram illustrating the vehicle
`context advisor in communication with various vehicle
`devices.
`[0028] FIG. 12 is a flow diagram illustrating a routine for
`placing a phone call using the vehicle context advisor.
`[0029] FIG. 13 is a block diagram of the personalization
`context advisor in communication with various vehicle
`devices.
`[0030] FIG. 14 is a flowchart illustrating a routine for
`presenting an activity schedule by employing the personal(cid:173)
`ization context advisor.
`[0031] FIG.15 is an example of an input screen displayed
`to a user for entering user preference information.
`[0032] FIG. 16 is a block diagram illustrating the envi(cid:173)
`ronmental context advisor in communication with various
`vehicle devices.
`[0033] FIG. 17 is a flow diagram illustrating a routine for
`providing navigation services using the environmental con(cid:173)
`text advisor.
`
`[0015] These and other features, advantages and objects of
`the present invention will be further understood and appre(cid:173)
`ciated by those skilled in the art by reference to the follow(cid:173)
`ing specification, claims and appended drawings.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`[0034] Referring to FIG. 1, the cockpit of a vehicle 10 is
`generally shown having an electronic system, also referred
`
`Page 20 of 33
`
`

`

`US 2004/0093155 Al
`
`May 13, 2004
`
`3
`
`to herein as an infotainment system, generally located in the
`vehicle dash. The infotainment system serves to provide any
`of a number of services generally related to handling infor(cid:173)
`mation. The infotainment system may provide informational
`services including entertainment services and telematics
`services, and thus may serve as an entertainment/telematics
`system.
`[0035] The electronic system shown includes a main
`visual human machine interface (HMI) 12 in the form of a
`touch-screen display 14 that allows passengers in the vehicle
`10 to interface with the electronic system to communicate
`with one or more electronic devices, including services, that
`are made available onboard the vehicle 10. The touch-screen
`display 14 may include a conventional screen for displaying
`visual images and for providing a plurality of touch-screen
`inputs, such as the "dial" input button 24 and the following
`menu inputs 16: audio input, climate input, phone input,
`navigation input, vehicle input, home input, and work input,
`as well as a wide variety of other menu selections (not
`shown). It should be appreciated that various user inputs and
`outputs may be made available on the HMI 12 for inputting
`and outputting information used for any of a plurality of
`electronic host devices to allow a user to interface with the
`electronic host devices (i.e., machines).
`
`[0036] Also shown located within the cockpit of the
`vehicle 10 is a microphone 32A and audio speakers 32B,
`which together form a voice-based HMI 12. The microphone
`32A is an audio input device that allows for voice speech
`recognition as a means to provide audio command inputs to
`the system. The speakers 32B are audio output devices that
`may
`include audio entertainment speakers commonly
`employed for audio devices in the vehicle 10 and/or may
`include an audio speaker dedicated to providing voice
`command outputs to passengers in the vehicle 10. It should
`be appreciated that the electronic system, including the
`HMis 12 and 32, may be located at various locations within
`the vehicle 10. In addition, the vehicle 10 may be equipped
`with other HMis, such as a visual HMI employed in front of
`the rear passenger seat to allow occupants in the rear seat of
`the vehicle to interface with an entertainment system or
`other electronic device(s).
`
`[0037] The electronic system also includes a plurality of
`information and entertainment host devices that are used
`onboard the vehicle 10. An example of various electronic
`host devices included with an infotainment system provid(cid:173)
`ing entertainment and telematics services onboard the
`vehicle 10 is illustrated in FIG. 2. The electronic (e.g.,
`infotainment) system
`includes various electronic host
`devices coupled to a vehicle consumer services interface
`(VCSI) host platform 30. The VCSI host platform 30 inter(cid:173)
`faces with the various electronic host devices within the
`vehicle 10. VCSI host platform 30 is shown coupled to the
`vehicle data bus 20, a high speed media oriented system
`transport (MOS1) bus 44, and one or more wireless links 46.
`The vehicle bus 20 may include a conventional original
`equipment manufacturer (OEM) bus, such as a CAN or
`11850 bus, utilizing a proprietary or non-proprietary proto(cid:173)
`col dedicated to communicating information among vehicle
`dedicated control devices including the chassis control mod(cid:173)
`ule 26 and powertrain control module 28. The vehicle data
`bus 20 is also coupled to various other vehicle devices and
`sensors including a vehicle speedometer 24, a fuel level
`sensor 25, onboard diagnostics 27, heating, ventilation and
`
`air conditioning (HVAC) controls 27, and adjustable seat
`controls 29, as well as various other vehicle devices and
`services (not shown) as should be evident to those in the art.
`The vehicle bus 20 is coupled to the VCSI host platform 30
`via a firewall 18 which serves to shield mission critical
`functions of the vehicle 10 from potentially harmful com(cid:173)
`munications.
`[0038] The VCSI host platform 30 allows various elec(cid:173)
`tronic host devices in the vehicle 10 to interface with each
`other, to interface with off-board devices, and to interface
`with the HMis. The VCSI host platform 30 serves as the
`interface between consumers, networks (both internal and
`external networks), devices (either factory installed or pur(cid:173)
`chased by consumers "off the shelf'), and the vehicle 10.
`The VCSI host platform 30 serves as a bridge between
`different protocols to provide a standardized interface that
`makes the task of creating in-vehicle applications easy, and
`further serves to synchronize non-automotive technology
`devices to that of the vehicle 10. The applications provide
`services that are implemented through intelligent devices
`that reside on one or more of the networks. The VCSI host
`platform 30 may implement network protocols already
`designed into the vehicle 10, and may enable communica(cid:173)
`tion between devices (including services) residing on dif(cid:173)
`ferent networks. The VCSI host platform 30 may also
`implement application programming interfaces (APis), thus
`enabling compatibility and communication between devices
`(services) provided by a variety of different suppliers. It
`should be appreciated that the VCSI host platform 30 further
`includes a communication manager that handles the sending
`and receiving of messages that are communicated through
`the VCSI host platform 30.
`
`[0039] The VCSI host platform 30 includes a compute
`platform and memory for storing and executing a plurality of
`software routines. The memory in the VCSI host platform 30
`includes both volatile and non-volatile memory such as
`random access memory (RAM), read-only memory (ROM),
`electronically erasable programmable read-only memory
`(EEPROM), and flash memory. The compute platform
`includes a processor, such as a microprocessor, for executing
`the various routines. The VCSI host platform 30 stores and
`executes HMI applications, service agents, context advisors,
`and various other applications to perform program services
`as des