SAE TECHNICAL
`PAPER SERIES
`
`982901
`E
`
`"The Network Vehicle -A Glimpse into
`the Future of Mobile Multi-Media"
`
`R.Lind
`Delphi Delco Electronics Systems
`
`R. Schumacher
`Delphi Delco Electronics Systems
`
`R. Reger
`Delphi Delco Electronics Systems
`
`R. Olney
`Delphi Delco Electronics Systems
`
`H.Yen
`Delphi Delco Electronics Systems
`
`M. Laur
`Delphi Delco Electronics Systems
`
`R. Freeman
`IBM Corporation
`
`‘調同属面@岡 田 ， . ‘m・.
`
`~A Il!!' "~A~ ••
`
`U旭川 ~Jl r
`
`‘調F・ー晶INTERNATlONAL -
`
`錯 1 .98
`
`Vlllnternational Mobility Technology
`Conference & Exhibit
`Sao Paulo， Brazil
`November 9 to 11，1998
`
`AV. PAULlSTA， 2073・HORSA11 -CJ. 2001・CEP01311・940・SAOPAULO・SP
`
`VWGoA - Ex. 1016
`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`

`
`The app回 ranceof the ISSN code at the bottαn of this page indicates SAE's consent
`that copies of the paper may be made for personal or intemal use of specific clients.
`This cons伺 tis given on the ∞ndition however， that the copier pay a $ 7.00 per article
`copy f伺 through the Copyright Clearance Center， Inc. Operations C伺 ter，222
`Rosewood Drive， Danvers， MA 01923 for copying beyond that permitted by Sections
`107 or 108 of U.S. Copyright Law. This consent does nol extend to other kinds of
`copying such as copying for general distribution， for advertising or promotional
`purposes， for creating new collective works， or for resale.
`
`SAE routinely stocks printed papers for a period of three years following date of
`publication. Direct your orders to SAE Customer Sales and Satisfaction
`Department.
`
`Quantity reprint rates can be obtained from the Customer Sales and Satisfaction
`Depa川ment.
`
`To request permission 10 reprint a technical paper or permission 10 use copyrighted
`SAE pu削にalionsin other works， contact the SAE Publications Group.
`
`GLOOAL鰍 沼 山TY04.TA臥 SE
`
`AII SAE papers， standards， and selected
`books are abstracted and indexed in the
`GわbalMobility Oatabase.
`
`No part of this publication may be reproduced in any form， in an electronic retrieval
`system or otherwise， without the prior written permission of the publisher.
`
`ISSN 0148・7191
`Copyrlght 1998 Soclety of Automotlve Englneers， Inc.
`
`Positions and opinions advan偲 d in this paper are tho鵠 ofthe author(s) and not
`necessarily those of SAE. The author is solely responsible for the ∞ntent of the
`paper. A pr'∞ess is available by which discussions will be printed with the paper if it is
`published in SAE Transactions. For permi悶 onto仰 blishthis paper in full or in part，
`contact the SAE Publications Group.
`
`Per釦 nswishing to submit papers to be considered for presentation or publication
`through SAE should send the manuscript or a 300 word abstract of a proposed
`manuscript to: Secretary， Engineering M田 tingsBoard， SAE.
`
`2
`
`

`
`982901
`
`“The Network Vehicle -A Glimpse into the Future of
`Mobile Multi-Media"
`
`R. Lind， R. Schumacher， R. Reger， R. Olney， H. Yen and M. Laur
`Delphi Delco Electronics Systems
`
`R. Freeman
`IBM Corporation
`
`Copyright@ 1998 Society of Automotive Engineers. Inc.
`
`ABSTRACT
`
`The Network Vehicle is the Delphi Automotive
`Systems' vision for the future convergence of the
`communications infrastructure， computers， and the
`automobile. It features many advanced functions
`such as: satellite video， Internet access， virtual
`navigation， remote vehicle diagnostics and control，
`games， mobile office， automotive web site， and
`customized real-time stock quotes and Sports scores.
`These features are enabled by an integrated planar
`antenna that is capable of multiple satellite reception，
`a client-server network architecture， and unique
`human-vehicle-interfaces. The software application
`is written in Java， using API's (Application
`Programming Inteげaces)to reduce the complexity
`and cost of the source code.
`
`INTRODUCTION
`
`The Network Vehicle， a new technology
`initiative by Delphi Delco Electronics Systems and its
`pa巾 ers(18M， Netscape Communications， and Sun
`Microsystems) is aimed at offering more productivity
`tools， convenience， safety， and entertainment to
`millions of commuters who spend hours each day
`cruising the roads or stuck in traffic. It is designed to
`demonstrate what technologies and software can do
`for the vehicle of the future. The Network Vehicle，
`pictured in Figure 1， made its debut at COMDEX '97
`and has since been all over the world appearing in
`demos， conferences， and technology shows，
`including SAE Congress ・98，and Ce8it‘98.
`
`SYSTEM OVERV医W
`
`The Network Vehicle was created by integrating
`existing hardware and software technologies
`including voice recognition， wireless communications，
`
`global positioning via satellite， head-up displays，
`Java™ technology， microprocessors， Web access，
`and other Internetlintranet features. The voice
`recognition technology allows drivers and
`passengers to verbally request and listen to e-mail
`messages being read out loud， locate a restaurant or
`hotel， ask for navigation help or for specific music or
`spoパs scores， and use voice-activated telephone
`services， all done safely without interfering with
`driving. Drivers can use a head-up display projected
`through the windshield to navigate to their destination
`or check vehicle functions without taking their eyes
`off the road.
`
`Figure 1. The Network Vehicle
`
`Passengers using individual terminals next to
`their seats can do even more， including interacting
`with the Internet， watching television or playing
`games. Existing services that could be integrated
`include theft deterrent technologies and， emergency
`services. These "smart" features are enabled mainly
`because of the reaトtimedata-streaming capabilities
`over a wireless network. The Network Vehicle also
`
`3
`
`

`
`has an integrated cellular phone; Netscape
`Communicator software for Web browsing and e-
`mail; a removable personal digital assistant (PDA)
`and docking station; and a vehicle web site which
`provides driver suppoパ for a wide array of
`customized capabilities such as enabling remote
`monitoring and control of vehicle systems in
`emergency situations.
`
`Onboard And Off-Board Communications
`Networks ・Thekey to the functions of the Network
`Vehicle is its ability to communicate efficiently both
`onboard and off-board of the vehicle. Figure 2
`depicts the onboard network architecture.
`
`Figure 2. On Board Network Architecture
`
`Amplif1.ro/S同 組 軒S
`
`At the heart of the onboard system is a network
`computer that links up a number of sub-networks，
`including a Class 11 bus (for engine， head-up and
`head-down displays， door lock and door actuator，
`RFID， and cell phone， etc.)， an Ethernet (for
`passenger computers and displays)， and a mobile
`media link (for speakers and CD players). Since the
`subnetworks all have different clock speed and
`functionality， gateways are used to ensure proper
`isolation and harmonious operations.
`
`The off-board network is shown in Figure 3.
`The high bandwidth requirement for on-demand
`audio and video functions was fulfilled with DirecPC
`and DirecTV satellite links. A wireless modem
`provides the uplink out of the vehicle directly to
`Internet service providers. The downlink return path
`from the Internet to the Network Vehicle can come
`through either the satellite (higher speed)， or through
`the wireless modem (Iower speed). The downlink
`satellites vidωand data signals are picked up by the
`Network Vehicle's roof-mounted antenna.
`
`KEY TECHNOLOGIES AND SYSTEM
`COMPONENTS
`
`The key technologies and system components
`behind the Network Vehicle are advanced speech
`
`recognition software， mobile media link (high叩 田d
`fiber optic data bus)， reconfigurable HUD， high-
`bandwidth communications that connect the vehicle
`with the outside world， and a suite of automotive
`computer software. These elements are described
`below.
`
`Figure 3. 0符-BoardNetwork Architecture
`
`~同60' 〆 ~ LWC
`
`パ ダ ノす 「 目IIIIII~IIIII
`守 桝 /〆"~
`‘ トmaぺ町、
`ん/ ///山口rm
`
`噂 2尋覇P 附 Z即 時
`
`Homel'酎 fi帥
`Computer
`
`Speech Recognition and Text-to・SpeechSystem -
`IBM has modified its advanced speech recognition
`and text-to-speech system， ViaVoice TM， for the
`automotive environment. ViaVoice allows the driver
`to access virtually all the vehicle's features through
`voice commands and enables the vehicle to talk back
`using synthesized speech. The driver can: execute
`vehicle system commands such as lock doors， play
`CD， and change radio station， request travel
`directions and traffic updates from the Web or other
`sources， check e-mail and voicemail， request news，
`stock information and sports. The speech
`recognition system can understand most drivers
`instantly， with no system training required， and it has
`been tuned to offer optimal performance even in a
`potentially noisy vehicle environment.
`
`Driver and Center Console Displays ・TheNetwork
`Vehicle is equipped with three displays for the driver:
`the head-down display (HDD)， the head-up display
`(HUD)， and the center console display. The HDD
`system displays standard graphics for an instrument
`panel: road speed， engine speed， engine status， door
`lock/ajar， and fuel level. It also displays the functions
`for the steering wheel buttons. For example，the
`same buUon can be "change track" for CD mode or
`"tune up" for radio mode. The HUD projects an
`virtual image through the windshield that gives
`information to drivers without requiring them to take
`their eyes 0符 the road. It displays road speed，
`engine status， waiting e-mail indication， navigation
`information， microphone on/off， and a text message
`area for giving feedback to the driver.
`
`4
`
`

`
`The center console's touch-screen LCD serves
`as a user interface for controlling nearly all of the
`Network Vehicle's functions (ente陶 inment，
`navigation， office， and information). When in
`entertainment mode， the display is configured as a
`radio- or CD-style faceplate whose buttons and
`controls are activated by touch. This display is
`reconfigured to display e-mail， navigation maps， Web
`browser， cellular phone faceplate (shown in Figure
`4)， and more. Voice-activated commands can be
`used with all of the center console functions and， in
`some cases， is combined with text-to-speech input to
`minimize driver distraction.
`
`Figure 4. Cellular Phone Faceplate Display
`
`Passenger Displays ・ The Network Vehicle
`has color LCD touch panels for the back-seat and
`front-seat passengers. As with the center console
`display， the passenger displays serve as user
`interfaces for controlling nearly all of the functions on
`the Network Vehicle. Unlike the center console
`display， however， the passenger displays can show
`video from DirecTV or DVD players， and they allow
`touch-screen access to entertainment， navigation，
`office， and information. When in entertainment
`mode， the display is configured as a radio-or CD・
`style faceplate with touch-activated buUons and
`controls.
`
`Planar Satellite Antenna ・Theantenna technology
`used in the Network Vehicle is the Continuous
`Transverse Stub (CTS) array. It is chosen because
`of its simplicity， planar construction， and potential for
`being an inexpensive pr，吋 uct. Figure 5 shows the
`cross sectional view of a typical CTS antenna，
`realized as an array of broad continuous transverse
`radiating stubs， finite in height， extending from the
`upper conductive plate of an open parallel-plate
`transmission-line structure.
`
`剖 ;、
`
`~
`
`/"
`
`Figure 5. CTS Antenna Cross Section
`
`As a receiving antenna， the induced longitudinal
`current components in the parallel plate structure are
`interrupted by the transverse-oriented stubs and
`excite propagating waves in the parallel-plate
`structure. This simple architecture allows for a
`complex two-dimensional planar array to be realized
`as an “extrusion" of a one-dimensional (constant
`cross-section) geometry. This has the effect of
`replacing a conventional "NxN=W" element structure
`(of discrete radiators， couplers， etc.) with a less
`complex “monolithic" array comprised of “N'
`integrated coupler/radiator features. The simple “tee"
`cross-section of the integrated CTS coupleげradiator
`forms an inherently low-"Q" (non-resonant) element
`which exhibits significant advantages (as compared
`to slot or patch radiators) in terms of wide-angle
`scanning capability， polarization purity， bandwidth，
`and dimensional insensitivity.
`
`Customer Application Web Site・ Thedriver and
`passengers of the Network Vehicle can take
`advantage of Internet services provided by
`automotive動 oriented ISPs (Internet Service
`Providers). The customer service site developed for
`the Network Vehicle showcases the types of features
`that could be offered when intelligent vehicle systems
`are connected to the Internet.
`
`Because the Network Vehicle's systems are
`accessible via its command and control application，
`which also has secure access to the Internet， many
`scenarios are possible. Functions like parking lights
`and door locks on the Network Vehicle can be
`controlled remotely， providing safety and
`convenience. Under voice control of the driver， the
`Network Vehicle can upload vehicle status according
`to a profile set up in advance. An application
`monitors the diagnostic information available from
`components in the engine compaパment. Should the
`diagnostics indicate that the latest reading from
`engine sensors falls outside a normal range， the
`application can notify the customer service Web site，
`where the severity of the reading can be determined.
`According to this determination， the control on the
`Network Vehicle could be used by the service
`
`5
`
`

`
`representative to alert the driver; the alert could be
`done using text-to・speechand head-up display， and
`then features of the application，争mail，and office
`could be used to arrange a service appointment.
`
`Other features take advantage of Internet
`service provideぱ abilityto communicate with the
`Network Vehicle. Trip plans created by vehicle
`owners or concierge services can be stored at the
`Internet service provider. By accessing global
`positioning satellite (GPS) data directly from the
`vehicle， the driver and passengers can obtain maps，
`route guidance， fuel， lodging， and restaurant
`information while traveling. Owners of the Network
`Vehicle can also use their Web browser to set up a
`profile， including preferences like radio stations，
`personalized audio content， service records， and
`emergency service numbers.
`
`Personal Digital Assistant Docking -An important
`role of the Network Vehicle is providing office
`functions to mobile users， using the same data the
`users have in their office desktop computers. This
`function is mainly provided through vehicle
`applications， Internet connectivity， and advanced，
`voice-based user interfaces. It is important for the
`Network Vehicle to access and synchronize personal
`and business data with PDAs， which is becoming
`increasingly important in our mobile， connected
`world.
`
`A slot built into the center console of the
`Network Vehicle accepts the IBM WorkPad™ and
`uses the Network Vehicle's computer to add speech
`recognition and text-to-speech functions. This
`enables the driver to listen to schedules and to
`u凶ate files and other office data stored in the
`WorkPad. So the driver could， for example， issue a
`voice command to read calendar entries from the
`WorkPad or dictate a to-do list while driving. As PDA
`and smaパcardtechnology advances， the Network
`Vehicle's PDA integration could support the use of
`PDA-type devices for the secure transport and
`access of personal， financial， and business
`information as people move from one network access
`point to another.
`
`Automotive Computer Software ・Virtualmachine-
`based， object-oriented technologies were applied to
`the Network Vehicle's development because they
`support the special requirements posed by the
`vehicle. Smalltalk， a well-proven， advanced， object-
`oriented environment and the latest JavaτM
`technologies were chosen to develop the Network
`Vehicle's software. Some of the software developed
`are described below.
`
`A command and control appl悶 tionwritten in
`Smalltalk， interfaces to the car's control buses and
`
`electronics. This application， running on the vehicle's
`main processor and buses， monitors vehicle status，
`controls devices such as cell phone and microphone，
`supplies driver information via head-up display，
`manages off-vehicle information flow， and controls
`vehicle software， such as the voice recognition and
`various convenience passenger appli伺 tions. This
`application coordinates with the voice recognition， the
`head-up display， and the touch screen to provide
`feedback and control of the various systems， helping
`to keep the driver's eyes on the road. For driver
`convenience and safety， this application also
`interfaces via the Internet to a customer service
`provider， who can remotely monitor the vehicle
`status， unlock doors， turn on exterior lighting， etc.
`
`Graphical user interfaces for Network Vehicle's
`center console and passenger displays were
`developed with Java to provide access to various in-
`vehicle and off-vehicle applications， such as
`navigation， audio/video entertainment， and office. An
`Internet server application was developed with
`VisualAge@ for Java to provide communication
`between Internet岨 based customer applications and
`the vehicle systems. These applications suppoバa
`message司 basedprotocol communicating through the
`Internet to the in-vehicle co灯、mand and control
`application， which in turn interfaces to the vehicle
`systems and the user interface application. Java
`applets were also developed for the customer site in
`order to provide animated vehicle status and control
`graphics.
`
`Media BUS and In-Vehicle Electronics - The
`Network Vehicle contains a number of audio and
`video components that are configured and controlled
`via a high-speed (100 Mbps) digital fiber-optic mobile
`media link (MML). Audio and video devices like CD
`players can send their output signals via the
`multiplexed， fiber-optic bus to drive other
`components like amplifiers and displays. A control
`signal is also carried on the MML bus to configure
`and control the devices. On the Network Vehicle， the
`command and control appli伺 tionhas access to the
`CD player and amplifier via the M Mし Thecommand
`and control application can then configure the
`components， switch signals， and adjust variables
`such as volume， fade， and balance. The MML gives
`the application full use of the vehicle's multimedia
`systems to develop functions and user interfaces
`tailored to driver and passenger use.
`
`Combining a command and control application
`with the MML in the Network Vehicle made possible
`features such as context-sensitive volume reduction
`during the use of the phone and the text-to-speech
`feature. It also allows "faceplate-style" user
`interfaces to integrate Internet radio with the sound
`system， and common and consistent user interfaces
`to define， review， and play the audio and video
`
`6
`
`

`
`content preferred by the driver and passengers. The
`vehicle also features a satellite receiver system，
`which provides DirecTV and DirecPC access.
`DirecPC offers Internet access via cellular modem to
`the vehicle for conventional Web applications as well
`as high-speed (400 kbps) download of data including
`audio， video， and text.
`
`FEATURES AND FUNCTIONS OF THE NETWORK
`VEHIClE
`
`The main features of the Network Vehicle are
`manifested in the following three areas: (1) Driving
`Aids， (2) Business Tools， and (3) News and
`Entertainment. The Network Vehicle is designed
`such that， through so代wareupgrades the customer
`can be provided with new features and functions as
`they become available.
`
`Driving Aids -Get Where You're Going Efficiently
`-The Network Vehicle can access a simulated
`integrated global positioning system and hence
`advanced navigation capabilities via Internet.
`Therefore， it literally knows where it is and where it's
`going. It can display the appropriate maps or simply
`provide route directions on the head-up display，
`command console or as spoken instructions. Drivers
`could control the navigation system using commands
`like “destination" to select a new destination or "route
`guidance" to get turn-by-turn instructions. An
`example of such a display is shown in Figure 6.
`
`Figure 6. Example of a Navigation Function Display
`
`If you think you left the Network Vehicle's doors
`unlocked or the lights on， just visit the vehicle web
`site from your home of office computer to check， then
`fix the problem remotely. The Network Vehicle's
`future remote control capabilities could not only allow
`you to actually start the vehicle in the parking lot from
`the office， but to even set the heater or air conditioner
`from your office computer， so that the vehicle is
`
`comfortable and ready to roll when you are. You
`could even plan trips on the vehicle web site， then
`download them to your vehicle. Figure 7 shows an
`example page of the vehicle web site where control
`parameters can be set.
`
`Figure 7. Example of a Vehicle Web Site Page for
`Remote Monitoring and Control
`
`Business Tools - You're Never Out of Touch -
`The Network Vehicle is on the Web， with a DirecPC
`satellite link beaming the Internet to the vehicle at
`400 kbps， more than 15 times the speed of a
`standard 28.8 kbps modem. Web sites can be
`viewed on the color reconfigurable displays at each
`of the three passenger seats， and the Network
`Vehicle can download selected information to the
`driver such as maps for navigation.
`
`The Network Vehicle is an extension of your
`office， seamlessly offering access to everything from
`e-mail and address book to the criti回 Ifiles you n田 d.
`The driver can be alerted to new e-mail via the head-
`up display and can ask the vehicle to read e-mail.
`With voice commands， a t仁川olist 回 nbe called up
`from the docked Workpad.
`E-mails and
`appointments can be downloaded to the docked
`Workpad PDA， for review after leaving the vehicle. In
`the future， the Network Vehicle will be able to
`communicate pages and play voice mail. The driver
`will be able to use voice commands to call up a
`personal address book， then dictate e-mail messages
`which the vehicle can turn into text and send.
`Passengers will be able to view faxes on their LCD
`displays.
`
`The Network Vehicle's cell phone is fully
`integrated with other systems， so a simple voice
`command tells the phone to dial any number. The
`Network Vehicle uses its own in-vehicle audio system
`as a speakerphone， 剖lowing hands-free
`conversations.
`
`7
`
`

`
`News and Entertainment -Getting There is More
`Than Half the Fun ・Viathe DirecTV satellite link，
`passengers will be able to view hundreds of
`broadcast and cable channels. Each passenger回 n
`watch a different channel at the same time， with
`headsets to keep the noise level to a minimum.
`Using the Network Vehicle web site， you can
`preprogram your favorite channels and shows. In the
`future， the Network Vehicle will include a DVD player
`so you'lI be able to watch the latest movies on disc.
`
`The Network Vehicle offers AM/FM radio， a CD
`player and audio from the Internet， all accessible with
`voice commands. From the Network Vehicle web
`site， one can program personal radio presets. Or，
`take advantage of various capabilities on the Internet，
`such as downloadable audio books， or audio-on-
`demand for an infinite choice of music selections or
`radio stations worldwide that are now broadcasting
`over the Web. Each passenger can also use an LCD
`display to watch movies， surf the Net or play the
`latest computer games.
`Using Netscape
`Communicator， the Network Vehicle will allow you to
`speak "Read Stocks" and hear the cu昨entvalue of
`each stock in your portfolio. In the future， the vehicle
`will read you the latest news from Web sites， or
`provide customized news from the vehicle web site.
`
`CONCLUSION
`
`The Network Vehicle has proven that by
`properly integrating several existing functions and
`technologies one can get a good glimpse of what the
`future of mobile multimedia holds. The range of
`applications enabled by the availability of wideband
`co町、munications to the car is enormous.
`Reconfigurable displays and upgradable software will
`allow vehicle owners to take advantages of the latest
`applications and services. However， to make this
`vision a reality， a great deal of improvement and
`development is still needed. For example， an
`affordable and robust mobile satellite tracking
`antenna system is yet to be realized. It is clear
`though， the integration of computer， communications，
`and software technologies with vehicles will have a
`dramatic impact on the future of automotive industry.
`
`8