(12) United States Patent
`United States Patent
`(12)
`Berry
`Berry
`
`Illlllllllllllll US006559773B1
`
`US006559773B1
`(io) Patent No.:
`US 6,559,773 B1
`(10) Patent N0.:
`US 6,559,773 B1
`(45) Date of Patent:
`May 6, 2003
`(45) Date of Patent:
`May 6, 2003
`
`(54) RECONFIGURABLE DISPLAY
`(54) RECONFIGURABLE DISPLAY
`ARCHITECTURE WITH SPONTANEOUS
`ARCHITECTURE WITH SPONTANEOUS
`RE C ONFIGURATION
`RECONFIGURATION
`
`Inventor: Richard Charles Berry, West
`(75)
`(75) Inventor: Richard Charles Berry, West
`Bloomfield, MI (US)
`Bloom?eld, MI (US)
`_
`_
`_
`(73) Assignee: Visteon Global Technologies, Inc.,
`(73) Asslgnee? Vlsteon Global Technologles, Inc»
`Dearborn, MI (US)
`Dearborn, MI (Us)
`_
`_
`_
`_
`Subject to any disclaimer,
`the
`term
`SubJect to any disclaimer, the term of this
`patent is extended or adjusted under 35
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`U.S.C. 154(b) by 0 days.
`
`_
`( * ) Notice:
`Notice:
`( * )
`
`(21) Appl. No.: 09/468,170
`(21) Appl. No.: 09/468,170
`(22) Filed:
`Dec- 21’ 1999
`Dec. 21, 1999
`(22) Filed:
`7
`GO,SB 5/00
`(51) Int. CI.7
`(51) Int. Cl. ................................................ .. G08B 5/00
`(52) U.S. CI.
`340/815.4; 340/531; 701/29;
`(52) US. Cl. .................... .. 340/815.4; 340/531; 701/29;
`701/33; 700/17; 700/83;
`345/326
`701/33; 700/17; 700/83; 345/326
`(58) Field of Search
`340/815.4, 531;
`(58) Field of Search ............................ .. 340/8154, 531;
`701/29, 33; 700/17, 83; 345/326
`701/29, 33; 700/17, 83; 345/326
`
`(56)
`(56)
`
`References Cited
`References Cited
`
`U.S. PATENT DOCUMENTS
`U.S. PATENT DOCUMENTS
`
`5/1995 Bodin et al.
`5,418,962 A
`5/1995 Bodin et al.
`5,418,962 A
`5/1997 Ramaswamy et al.
`5,627,547 A *
`.. 342/357
`5,627,547 A * 5/1997 Ramaswamy et al. .... .. 342/357
`5,742,226 A *
`4/1998 Szabo et al
`340/425.5
`5,742,226 A * 4/1998 SZabo et al. ........... .. 340/4255
`
`8/1998 Beckert et al.
`5,794,164 A
`8/1998 Beckert et al.
`5,794,164 A
`OTHER PUBLICATIONS
`OTHER PUBLICATIONS
`Sun Microsystems,
`Inc.,
`"Why Jini
`
`Now", 1,1998, pp.
`Sun Microsystems, Inc., “Why Jini NoW”, Aug. 1, 1998, pp.
`1-14.
`1—14.
`Sun Microsystems,
`Inc.,
`
`"What Jini?"—Summary. is
`
`Sun Microsystems, Inc., “What is Jini?”—Summary.
`Clohessy, Kim, Object Technology, Inc., Virtual Machine
`Clohessy, Kim, Object Technology, Inc., Virtual Machine
`Technology: Managing Complexity and Providing Portabil
`
`Technology: Managing Complexity and Providing Portabil­
`ity for Embedded Systems.
`ity for Embedded Systems.
`Mobile GT, "The Architecture for Driver Information Sys­
`Mobile GT, “The Architecture for Driver Information Sys
`ol
`this
`terns?
`tems".
`_
`_
`* cited by examiner
`* Clted by examlner
`Primary Examiner—Daniel J. Wu
`Primary Examiner—Daniel J. Wu
`Assistant Examiner—Tai T. Nguyen
`Assistant Examiner—Tai T. Nguyen
`(74) Attorney, Agent, or Firm—-John E. Kajander
`(74) Attorney, Agent, or Firm—John E. Kajander
`ABSTRACT
`(57)
`(57)
`ABSTRACT
`
`A control panel/display
`subsystem
`acts
`as a
`Acontrol panel/display subsystem acts as a device portal for
`interacting with multiple devices interconnected via a
`interacting With multiple devices interconnected via a
`dynamic local network. Display content and the human-
`dynamic local network Display Content and the human
`machine interface (HMI) implemented using the display
`machine interface (HMI) implemented using the display
`subsystem automatically reconfigures itself when new
`subsystem automatically recon?gures itself When neW
`devices are added to the vehicle network. An interface
`devices are added to the vehicle network. An interface
`specifier enabling
`each new device to work with the device
`speci?er enabling each neW device to Work With the device
`portal is obtained either from a local archive or a remote
`portal is obtained either from a local archive or a remote
`archive via connection with a remote network.
`archive via connection With a remote network.
`
`18 Claims, 3 Drawing Sheets
`18 Claims, 3 Drawing Sheets
`
`Aug.
`
`device
`
`POWER
`21
`h) VOL
`[ U 10:53 pm
`2.» VOL E:::::
`:I 10:53 pm
`J
`CD
`START MENU
`J
`“A123
`START MENU
`('*') A
`'V' © <8> & r
`AM-FM
`e4
`(0 1))
`‘AM-H124
`@ we“, ? sir PgE @ ,5;
`<?
`©
`PHONE,
`25
`
`//
`
`[ll
`f
`(T»>)
`f’ n)
`
`& mm
`
`AM-FM
`
`CD
`
`MAX/
`
`E-NET
`
`PHONE
`
`NAVIGATION
`NAVIGATION
`
`VOL
`
`/#•
`/9
`
`.<
`
`[BACI
`
`>
`
`A
`
`V
`
`^ADI^M| ^NTE^= ©Y v
`
`Press Enter for Address Book
`Press Enter for Address Book
`
`20
`
`BOOK
`
`MEMO
`
`APPT
`
`RADIO
`
`CD
`
`NEWS
`
`12
`
`13
`
`14
`
`15
`
`/6
`
`17
`
`OPEN, o
`J
`\0
`
`32
`
`E-NET
`
`H
`NAV
`26
`
`Petitioners
`Exhibit 1004, Page 1
`
`

`
`U.S. Patent
`U.S. Patent
`
`May 6, 2003
`May 6, 2003
`
`Sheet 1 of3
`Sheet 1 of 3
`
`US 6,559,773 B1
`US 6,559,773 B1
`
`• • • • «
`• • • • •
`
`VOL
`
`/<?
`/9
`
`[BACI
`
`A
`< >
`y
`
`@
`
`POWER
`2!
`[ ] 10:53 pm
`'h VOL
`J
`START MENU
`START MENU J
`(V © <0> § r
`(v »»
`AMAFM % @] E?T P?l; @
`©
`AM-FM
`
`//
`
`L
`
`(T-))
`
`CD
`
`E-NET
`NAV
`NAVIGATION
`NAVIGATION
`
`PHONE
`
`32
`
`CD
`es
`('*>) A
`AM-FM
`e4
`r
`
`PHONE,
`<?5
`
`E-NET
`
`36
`
`Press Enter for Address Book
`Press Enter for Address Book
`
`BOOK
`
`MEMO
`
`APPT
`
`RADIO
`
`CD
`
`©Y ^
`OPEN, o
`J
`
`30
`
`12
`
`10
`
`13
`
`15
`
`14
`FIG. 1
`6 !
`JL.
`Disglay
`Display
`T
`I
`l
`
`16
`
`17
`
`62
`/62
`Z
`Server
`
`60
`Z
`Device
`T
`
`1: R istration
`
`1: Registration •o
`U 2:
`
`A 2: HMI Check
`
`'
`
`3: HMI Request
`3: HMI Re uest
`
`*0
`
`'
`'
`
`g
`
`X
`
`4: HMI Report
`4 HMI Re on
`
`5: Cleanup
`
`FIG. 4
`
`Petitioners
`Exhibit 1004, Page 2
`
`

`
`Cd
`Iti
`<1
`N» <1
`so
`in
`in
`ON
`x/i
`
`(X
`Ms
`©
`
`n>
`=r
`CZ2
`
`©
`o
`tN>
`
`s P
`
`<<
`
`9
`n
`PS
`
`Vl
`ej
`
`yDevice ny
`1
`f HMI A
`
`n
`
`for ]' • • I for
`
`yDeviceiy
`I
`/ HMI A
`
`/ HMI \
`HMI Archive for Display Type
`
`Device Oj
`
`for
`
`^^
`
`V Device n/
`
`J
`{ HMI \
`
`] • • • I for
`
`I
`/ HMI \
`
`for
`
`)
`"N
`
`y Device Oy VDeviceiy
`I for
`/ HMI
`HMI Archive for Display Type
`
`1
`
`43^
`
`FIG. 2
`
`Inside Vehicle
`
`Outside Vehicle
`
`J
`
`Modem
`4Ss Wireless
`
`Modem
`^ Wireless
`
`4&
`
`y Device n /
`J
`\
`f m
`V
`J /
`44
`
`] • • • I for
`
`y Device 1/
`
`J
`y Device 0
`11 for
`\ / HMI \
`for Display Type 0 L
`
`i
`
`I
`r an Reconfigurable
`i—i,
`
`I
`
`Type: n
`Display
`
`-27
`
`Reconfigurable Display
`
`Type. 1
`
`L-^v
`u
`
`, Memory
`•——^
`/
`48
`
`30
`
`Typ«o
`
`*=^1
`32
`
`33 HuNllTI. Cntjj Reconfigurable Display
`3!
`
`35"
`34
`
`VR
`
`for
`riiiJii
`HMI Archive
`
`_
`
`7
`HMI Server www.AnyServer.com/hmicode
`Device Type: n
`Palm-size PC
`
`42
`
`HMI Server www.MyVehicle.com/hmicode
`Device Type: 1
`MP3 Player
`
`4/
`
`HMI Server www.visteon.com/hnfiicode
`Device Type: 0
`Cell Phone
`
`z
`4^
`
`V Device n/
`J
`f HMI \
`
`| * * • I for
`
`\ Device 1/
`
`V Device 0/
`[
`f HMI \ ( HMI \
`HMI Archive for Display Type n
`
`for II for
`
`Type 1
`
`for Display
`
`*
`
`•
`
`y Device ny
`II for 1 • • • I for 1
`/ HMI \
`
`V Device 0/ VQewceiy
`I for
`/ HMI A
`HMI Archive for Display Type 0
`
`/ HMI A
`
`L
`47
`
`y Device nj
`)
`f HMI \
`
`) * * * I for
`
`V Device
`for
`I
`f HMI \ [ HMI \
`HMI Archive
`
`0/ \Device1/
`I
`
`for
`
`)
`
`Petitioners
`Exhibit 1004, Page 3
`
`

`
`U.S. Patent
`U.S. Patent
`
`May 6, 2003
`May 6, 2003
`
`Sheet 3 of 3
`Sheet 3 of3
`
`B1
`US 6,559,773
`US 6,559,773 B1
`
`50^
`50w
`
`Human-Machine Interface (HMI)
`Human-Machine Interface (HMI)
`Application Objects For a
`Application Objects For a
`Climate Control, Radio Tuner, Wireless, E-Mail, Cellular Phone,
`Climate Control, Radio Tuner, Wireless, E-Mail, Cellular Phone,
`Audio, CD Player, etc...
`Audio, CD Player, etc...
`
`i
`i
`
`\
`5 /
`5/ \ HMI Vl?dgets Component Library
`HMI Widgets Component Library
`Objects For
`Objects For
`Button Metaphor, List Box, Window, Text Box, Time, etc...
`Button Metaphor, List Box, Vlhndow, Text Box, lime, etc...
`
`i
`i
`
`se
`Graphics Primitives (Graphics Device Interface (GDI))
`52 Graphics Primitives (Graphics Device interface (GDl))
`VECTOR: Line, Rectangle, Polygon, Arc,
`\
`VECTOR: Line, Rectangle, Polygon, Arc, etc"
`RASTER: Bitmap, Font, etc...
`RASTER: Bitmap, Font, etc...
`WINDOW MANAGEMENT: Clipping, Scrolling, etc...
`WINDOW MANAGEMENT: Clipping, Scrolling, etc...
`ATTRIBUTES: Color, Rotation, LineStyle, etc...
`ATTRIBUTES: Color, Rotation, LineStyle, etc...
`
`etc..
`
`i
`
`S3
`5 {_ Display Frame Buffer
`Display Frame Buffer
`Bit Plane(s) Target Selection
`Bit Plane(s) Target Selection
`Bit Plane(s) Visibility Selection
`Bit Plane(s) Visibility Selection
`Draw Mode (BOOLEAN Operation or REPLACE)
`Draw Mode (BOOLEAN Operation or REPLACE)
`
`FIG. 3
`FIG. 3
`
`Petitioners
`Exhibit 1004, Page 4
`
`

`
`US 6,559,773 B1
`US 6,559,773 B1
`
`1
`1
`RECONFIGURABLE DISPLAY
`RECONFIGURABLE DISPLAY
`ARCHITECTURE WITH SPONTANEOUS
`ARCHITECTURE WITH SPONTANEOUS
`RECONFIGURATION
`RECONFIGURATION
`
`and
`
`If
`
`to
`
`2
`2
`In one aspect of the invention, an electronic accessory
`In one aspect of the invention, an electronic accessory
`display/control system is provided for a transportation
`display/control system is provided for a transportation
`vehicle. A reconfigurable
`
`control has a visual display panel
`
`vehicle. A recon?gurable control panel has a visual display
`for displaying menu items for an electronic accessory and
`for displaying menu items for an electronic accessory and
`5 has at least one
`control
`
`actuator. A human-machine
`interface
`has at least one control actuator. Ahurnan-rnachine interface
`BACKGROUND OF THE INVENTION
`BACKGROUND OF THE INVENTION
`controller
`
`
`to is coupled the reconfigurable
`control
`panel
`controller is coupled to the recon?gurable control panel and
`The present invention relates in general to a reconfig­
`The present invention relates in general to a recon?g
`includes a local archive for storing a plurality of interface
`includes a local archive for storing a plurality of interface
`urable display/control panel for controlling various elec­
`urable display/control panel for controlling various elec
`specifiers. Each specifier defines interaction between the
`speci?ers. Each speci?er de?nes interaction betWeen the
`tronic accessories, and more specifically to an architecture
`reconfigurable control panel and a respective electronic
`tronic accessories, and more speci?cally to an architecture
`recon?gurable control panel and a respective electronic
`for reconfigurable displays and an overall network for ^ accessory for performing operations via the menu items
`for recon?gurable displays and an overall netWork for
`accessory for performing operations via the menu items
`10
`spontaneously interconnecting the displays with various
`spontaneously interconnecting the displays With various
`using a predetermined communications protocol. The sys­
`using a predetermined communications protocol. The sys
`electronic accessories or devices in a manner which auto-
`tem includes an expandable interconnection link for cou­
`electronic accessories or devices in a manner Which auto
`tern includes an eXpandable interconnection link for cou
`matically reconfigures menu elements
`shown on the recon­
`pling compatible electronic accessories with the human-
`rnatically recon?gures rnenu elernents shoWn on the recon
`pling cornpatible electronic accessories With the human
`figurable display to interact with each electronic accessory.
`?gurable display to interact With each electronic accessory.
`machine interface controller. A wireless transceiver is
`rnachine interface controller. A Wireless transceiver is
`Reconfigurable displays are used in automotive vehicles is provided for accessing a remote archive of interface speci­
`Recon?gurable displays are used in automotive vehicles
`provided for accessing a remote archive of interface speci
`15
`in order to control a plurality of electronic accessories from
`fiers. The remote archive includes interface specifiers each
`in order to control a plurality of electronic accessories from
`?ers. The remote archive includes interface speci?ers each
`a single control panel. Such a system reduces cost, saves
`adapted for a corresponding combination of a particular
`a single control panel. Such a system reduces cost, saves
`adapted for a corresponding combination of a particular
`space on the vehicle instrument panel, and makes the
`electronic accessory and a particular reconfigurable control
`space on the vehicle instrument panel, and makes the
`electronic accessory and a particular recon?gurable control
`electronic accessories easier to control. A reconfigurable
`panel. The human-machine interface controller responds to
`electronic accessories easier to control. A recon?gurable
`panel. The hurnan-rnachine interface controller responds to
`display includes a
`generic
`graphic
`display
`
`surface, 20 a coupling of an electronic accessory to the expandable such as a
`
`
`
`display includes a generic graphic display surface, such as a
`a coupling of an electronic accessory to the expandable
`dot matrix, and a collection of "soft keys" (i.e., program­
`interconnection
`link by checking the local archive for pres­
`interconnection link by checking the local archive for pres
`dot matrix, and a collection of “soft keys” (i.e., prograrn
`mable buttons). The function of each key is dynamically
`ence of a desired interface specifier corresponding to the
`rnable buttons). The function of each key is dynamically
`ence of a desired interface speci?er corresponding to the
`reconfigured via
`software
`to
`allow
`access
`all
`the
`available
`electronic accessory
`and
`the reconfigurable control
`
`panel.
`electronic accessory and the recon?gurable control panel. If
`recon?gured via softWare to alloW access to all the available
`functions or the accessories, typically using a menu struc­
`the desired interface specifier is not present in the local
`the desired interface speci?er is not present in the local
`functions or the accessories, typically using a menu struc
`ture. A typical reconfigurable display subsystem may also 25 archive, then the wireless transceiver is activated to auto-
`ture. A typical recon?gurable display subsystern may also
`archive, then the Wireless transceiver is activated to auto
`25
`include a number of
`"hard
`
`keys", buttons that provide instant
`matically obtain the desired interface specifier from the
`include a number of “hard keys”, buttons that provide instant
`rnatically obtain the desired interface speci?er from the
`access to frequently
`used
`
`
`(e.g., functions navigation, climate
`remote archive.
`access to frequently used functions (e. g., navigation, climate
`remote archive.
`control, audio players, etc.).
`control, audio players, etc.).
`Because of their generic, reusable nature, reconfigurable
`Because of their generic, reusable nature, recon?gurable
`automotive displays have facilitated an increase in the 30
`autornotive displays have facilitated an increase in the
`number of features that are made available to the user.
`number of features that are made available to the user.
`Consumers are demanding ever-greater functionality from
`Consumers are demanding ever-greater functionality from
`their electronic accessories, while product design cycles of
`their electronic accessories, While product design cycles of
`the accessories are simultaneously becoming shorter. Thus,
`the accessories are simultaneously becorning shorter. Thus,
`it becomes a major challenge for manufacturers to provide 35
`it becomes a major challenge for manufacturers to provide
`35
`new and innovative system architectures while delivering
`neW and innovative system architectures While delivering
`high content, high quality
`
`
`and products features at a reason­
`high content, high quality products and features at a reason
`able cost.
`able cost.
`First generation automotive reconfigurable display sys­
`First generation autornotive recon?gurable display sys
`tems utilize embedded architectures
`that build specific
`fea- 40
`terns utiliZe ernbedded architectures that build speci?c fea
`DETAILED DESCRIPTION OF PREFERRED
`DETAILED DESCRIPTION OF PREFERRED
`ture content into
`the display
`
`design that cannot be altered or
`ture content into the display design that cannot be altered or
`EMBODIMENTS
`EMBODIMENTS
`augmented after the design is implemented. All supported
`augrnented after the design is implemented. All supported
`The present invention creates a device portal within a
`The present invention creates a device portal Within a
`
`features must be identified at the
`time of
`initial
`
`design. While
`features must be identi?ed at the time of initial design. While
`network architecture having a dynamically constructed
`netWork architecture having a dynamically constructed
`this approach provides high performance and low cost, it
`this approach provides high performance and loW cost, it
`45 human-machine interface (HMI). A control panel/display
`hurnan-rnachine interface (HMI). A control panel/display
`lacks flexibility.
`lacks ?exibility.
`45
`subsystem
`includes a
`
`collection of hard and soft
`controls
`subsystern includes a collection of hard and soft controls and
`Second generation automotive
`reconfigurable
`display
`sys­
`Second generation autornotive recon?gurable display sys
`is made available as a network resource on a dynamic local
`is made available as a netWork resource on a dynamic local
`tems utilize a personal computer (PC) type of architecture,
`terns utiliZe a personal computer (PC) type of architecture,
`network. The display subsystem of the device portal may
`netWork. The display subsystem of the device portal may
`such as the AutoPC platform. Such systems enable incre­
`such as the AutoPC platforrn. Such systems enable incre
`include standard embedded features
`such as an audio tuner
`include standard ernbedded features such as an audio tuner
`mental feature deployment, wherein new features can be
`rnental feature deployrnent, Wherein neW features can be
`50 or CD player, but its main purpose is to be dynamically
`or CD player, but its main purpose is to be dynarnically
`integrated seamlessly with those already present. However,
`integrated seamlessly with those already present. HoWever,
`reconfigurable to
`interact with
`other
`network
`recon?gurable to interact With other netWork resources via a
`such feature deployment
`is essentially a static model since
`such feature deployment is essentially a static model since
`collection of standard protocols. These other network
`collection of standard protocols. These other netWork
`installed software applications occupy a percentage of the
`installed softWare applications occupy a percentage of the
`resources include devices such as a navigation system,
`resources include devices such as a navigation system,
`display resources at all times. Thus, it is distinctly possible
`display resources at all times. Thus, it is distinctly possible
`cellular phone, audio player, a palm-size PC, or any other
`cellular phone, audio player, a palrn-siZe PC, or any other
`that system resources
`
`
`be could inadvertently depleted
`during
`that system resources could be inadvertently depleted during
`
`55 device employing an HMI in the vehicle. These devices need
`device employing an HMI in the vehicle. These devices need
`installation of a new feature. Furthermore,
`
`such customiza­
`55
`installation of a neW feature. Furthermore, such custorniZa
`not be present in the network at all times. Using Java/Jini
`not be present in the netWork at all times. Using Java/Jini
`tion requires installation skills on the part of the users (not
`tion requires installation skills on the part of the users (not
`technology or
`similar
`technology, a
`dynamic
`technology or similar technology, a dynamic netWork can be
`just system developers and integrators), which limits the
`just system developers and integrators), which limits the
`constructed which allows automatic installation of devices
`constructed Which alloWs autornatic installation of devices
`utility of such customization
`for a significant percentage of
`utility of such custorniZation for a signi?cant percentage of
`into the network.
`into the netWork.
`customers. Such
`
`systems are not truly "plug-and-play"
`since
`customers. Such systems are not truly “plug-and-play” since
`Referring to FIG.
`1, a
`control
`panel/display
`Referring to FIG. 1, a control panel/display subsystern 10
`60
`a manual installation procedure
`is required.
`a manual installation procedure is required.
`includes a multi-element
`graphical
`
`display plurality of 11.
`
`includes a rnulti-elernent graphical display 11. Aplurality of
`
`SUMMARY OF THE INVENTION
`SUMMARY OF THE INVENTION
`push buttons 12-17 provide soft keys for accessing func­
`push buttons 12—17 provide soft keys for accessing func
`The present invention has the advantage of providing a
`tions as identified by graphic/text
`
`labels displayed on display
`tions as identi?ed by graphic/text labels displayed on display
`The present invention has the advantage of providing a
`reconfigurable display architecture in which a human-
`screen 11. Hard
`controls
`include a
`knob
`recon?gurable display architecture in Which a human
`screen 11. Hard controls include a knob 18 Which is pressed
`machine interface (HMI) is dynamically constructed in 65 to control system power and can be rotated to control audio
`rnachine interface (HMI) is dynamically constructed in
`to control system poWer and can be rotated to control audio
`65
`
`volume. An arrow pad 19 is used to navigate
`through
`response to the electronic accessories which are present in
`volurne. An arroW pad 19 is used to navigate through rnenus
`response to the electronic accessories Which are present in
`displayed on display screen 11. An enter button 20 and a
`the system.
`the system.
`displayed on display screen 11. An enter button 20 and a
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG.
`
`1 is a front, plan view of a reconfigurable display
`FIG. 1 is a front, plan vieW of a recon?gurable display
`employing the present invention.
`employing the present invention.
`FIG. 2 is a schematic diagram showing the overall net­
`FIG. 2 is a schematic diagram shoWing the overall net
`work system of the present invention.
`Work system of the present invention.
`FIG. 3 is a block diagram showing the interaction of
`FIG. 3 is a block diagram shoWing the interaction of
`software objects
`for
`
`forming a human-machine
`interface
`and
`softWare objects for forming a hurnan-rnachine interface and
`its interaction with the reconfigurable display.
`its interaction With the recon?gurable display.
`FIG. 4 illustrates the main tasks executed when a new
`FIG. 4 illustrates the main tasks eXecuted When a neW
`device is joined into the vehicle network.
`device is joined into the vehicle netWork.
`
`and
`
`resources
`
`network
`
`subsystem
`
`18
`
`menus
`
`Petitioners
`Exhibit 1004, Page 5
`
`

`
`US 6,559,773 B1
`US 6,559,773 B1
`
`using
`
`a
`
`of
`
`display
`
`interface
`order
`
`devices
`
`4
`3
`3
`4
`for the accessory and checks whether it currently has an
`back button 21 are also used to navigate through menu
`for the accessory and checks Whether it currently has an
`back button 21 are also used to navigate through menu
`interface specifier to support interaction with the device
`
`screens. A plurality of shortcut buttons
`
`22-26 are provided
`interface speci?er to support interaction With the device
`screens. A plurality of shortcut buttons 22—26 are provided
`stored in memory 35. If the desired interface specifier is
`to create shortcuts to menu screens for device
`functionality
`stored in memory 35. If the desired interface speci?er is
`to create shortcuts to menu screens for device functionality
`present, then HMI controller 34 can communicate core
`embedded in subsystem 10 (e.g., CD player or AM/FM
`present, then HMI controller 34 can communicate core
`embedded in subsystem 10 (e.g., CD player or AM/FM
`5 functionality messages between the reconfigurable display
`functionality messages betWeen the recon?gurable display
`radio).
`radio).
`and the accessory device. If an appropriate
`interface speci­
`and the accessory device. If an appropriate interface speci
`An HMI for a particular electronic accessory device
`An HMI for a particular electronic accessory device
`fier is not already contained in memory 35, then HMI
`?er is not already contained in memory 35, then HMI
`includes graphical display elements to identify the device
`includes graphical display elements to identify the device
`controller 34
`takes
`steps
`
`
`retrieve to an appropriate interface
`controller 34 takes steps to retrieve an appropriate interface
`and its available
`
`
`A features. menu screen
`for
`each
`accessory
`and its available features. Amenu screen for each accessory
`speci?er, if possible.
`specifier, if possible.
`device includes labels to be displayed associated with par­
`device includes labels to be displayed associated With par
`A memory in each reconfigurable display subsystem
`A memory in each recon?gurable display subsystem
`ticular soft keys
`
`
`to 12-17 identify controllable functions of 1°
`ticular soft keys 12—17 to identify controllable functions of
`10
`provides a local archive for storing a plurality of interface
`provides a local archive for storing a plurality of interface
`the device. For the electronic accessory of a cellular phone,
`the device. For the electronic accessory of a cellular phone,
`specifiers each of which defines interaction between the
`speci?ers each of Which de?nes interaction betWeen the
`the soft keys may be associated with cellular phone func­
`the soft keys may be associated With cellular phone func
`reconfigurable display
`subsystem
`and a
`respective
`recon?gurable display subsystem and a respective electronic
`tions of accessing memory
`
`locations, initiating a call,
`ending
`tions of accessing memory locations, initiating a call, ending
`accessory. Whenever an additional interface specifier must
`accessory. Whenever an additional interface speci?er must
`a call, or other
`
`functions performable by
`the
`phone.
`Display-
`a call, or other functions performable by the phone. Display
`15 be retrieved, it may
`preferably
`be
`
`obtained universal
`be retrieved, it may preferably be obtained using a universal
`
`screen 11 can also be used to display event information as
`15
`screen 11 can also be used to display event information as
`resource locator (URL) of a server that contains a further
`resource locator (URL) of a server that contains a further
`communicated
`from the cellular phone, such as connection
`communicated from the cellular phone, such as connection
`collection of HMI interface specifiers. Such a server may
`collection of HMI interface speci?ers. Such a server may
`status, duration of
`call,
`
`
`other and information communicated
`status, duration of call, and other information communicated
`also be a local archive in the vehicle directly connected to
`also be a local archive in the vehicle directly connected to
`by the cellular phone to display subsystem 10.
`by the cellular phone to display subsystem 10.
`dynamic local network
`36 as shown by a server 43 in FIG.
`
`dynamic local netWork 36 as shoWn by a server 43 in FIG.
`The use of the recon?gurable display subsystem as a
`The use of the reconfigurable display subsystem as a
`2. Server 43 is a local server
`containing a first
`group
`2. Server 43 is a local server containing a ?rst group of HMI
`device portal in a dynamic local network is shown in FIG.
`device portal in a dynamic local netWork is shoWn in FIG.
`interface specifiers 44 corresponding to the configurable
`interface speci?ers 44 corresponding to the con?gurable
`2. Reconfigurable display subsystem 30 includes a display
`2. Recon?gurable display subsystem 30 includes a display
`display type zero. Additional HMI interface specifiers are
`display type Zero. Additional HMI interface speci?ers are
`
`
`screen 31 and hard and soft keys 32. Display subsystem 30
`screen 31 and hard and soft keys 32. Display subsystem 30
`stored in other groups
`for
`other
`
`reconfigurable types
`stored in other groups for other recon?gurable display types
`may also receive input commands
`
`from a voice recognition
`may also receive input commands from a voice recognition
`,
`as shown. For each reconfigurable display type, a plurality
`as shoWn. For each recon?gurable display type, a plurality
`unit 33. An HMI
`
`
`34 controller resides in display
`subsystem of
`unit 33. An HMI controller 34 resides in display subsystem
`interface
`ifiers
`are
`
`as
`stored indexed b device
`t
`of interface speci?ers are stored as indexed by device type.
`30 and controls graphical display screen 31, monitors keys
`30 and controls graphical display screen 31, monitors keys
`Server 43 may be
`constructed
`with
`some
`Server 43 may be constructed With some interface speci?ers
`32, accepts
`input
`from voice recognition (VR) unit 33, and
`32, accepts input from voice recognition (VR) unit 33, and
`contained in a
`read-only memory
`(ROM)
`in
`contained in a read-only memory (ROM) in order to provide
`interfaces with devices
`
`on the dynamic
`local network
`36.
`A
`interfaces With devices on the dynamic local netWork 36. A
`a fixed set of interface specifiers for a known set of elec­
`a ?xed set of interface speci?ers for a knoWn set of elec
`memory 35
`stores
`interface
`specifiers
`(i.e., used by
`
`drivers)
`memory 35 stores interface speci?ers (i.e., drivers) used by
`tronic accessories which are expected to be utilized in a
`tronic accessories Which are expected to be utiliZed in a
`controller 34 to drive graphic display screen 31 and to
`controller 34 to drive graphic display screen 31 and to
`particular vehicle. In addition, re-writeable memory may
`particular vehicle. In addition, re-Writeable memory may
`communicate with the various electronic accessory devices 30
`communicate With the various electronic accessory devices
`also be included for subsequent storage of interface speci­
`also be included for subsequent storage of interface speci
`on dynamic local network 36.
`on dynamic local netWork 36.
`fiers for other device
`types
`in
`
`order to provide flexibility
`for
`?ers for other device types in order to provide ?exibility for
`Each particular display subsystem (“device portal”)
`Each particular display subsystem ("device portal")
`groWth.
`growth.
`design is uniquely identified by a type identifier. Thus,
`design is uniquely identi?ed by a type identi?er. Thus,
`In order to accommodate
`electronic
`accessory
`In order to accommodate electronic accessory devices not
`display subsystem
`
`30 is identified as type 0, while additional 35
`display subsystem 30 is identi?ed as type 0, While additional
`included in local server 43, the present invention also
`included in local server 43, the present invention also
`35
`display subsystems which may be connected to the local
`display subsystems Which may be connected to the local
`provides access to a remote archive web server outside the
`provides access to a remote archive Web server outside the
`dynamic network 36 have different identifiers such as type
`dynamic netWork 36 have different identi?ers such as type
`vehicle. Thus, a wireless modem 45 is interconnected with
`vehicle. Thus, a Wireless modem 45 is interconnected With
`1 for a display subsystem 37 and type n for a display
`1 for a display subsystem 37 and type n for a display
`dynamic local network
`36
`
`and be used to communicate can
`
`dynamic local netWork 36 and can be used to communicate
`subsystem 38.
`subsystem 38.
`with a remote wireless modem 46 which is connected to a
`With a remote Wireless modem 46 Which is connected to a
`Dynamic local network 36 includes a collection of soft- 40 remote web server 47 containing additional
`
`interface speci­
`Dynamic local netWork 36 includes a collection of soft
`remote Web server 47 containing additional interface speci
`ware and communication specifications and
`standard proto­
`fiers in a remote archive. Remote server 47 may be con­
`Ware and communication speci?cations and standard proto
`?ers in a remote archive. Remote server 47 may be con
`cols for hardware interconnection. Examples of such a
`nected to the world-wide web or internet and wireless
`cols for hardWare interconnection. Examples of such a
`nected to the World-Wide Web or internet and Wireless
`system are Jini by Sun Microsystems, Inc., JetSend by
`modem 46 may be connected to an internet service
`provider
`system are Jini by Sun Microsystems, Inc., JetSend by
`modem 46 may be connected to an internet service provider
`Hewlett-Packard, and Bluetooth by the Bluetooth Special
`(ISP), for example. The URL address for remote server 47
`HeWlett-Packard, and Bluetooth by the Bluetooth Special
`(ISP), for example. The URL address for remote server 47
`Interest Group. System resources such as reconfigurabl