`PAPER SERIES
`
`982901
`E
`
`"The Network Vehicle -A Glimpse into
`the Future of Mobile Multi-Media"
`
`R.Lind
`Delphi Delco Electronics Systems
`
`R. Schumacher
`Delphi Delco Electronics Systems
`
`R. Reger
`Delphi Delco Electronics Systems
`
`R. Olney
`Delphi Delco Electronics Systems
`
`H.Yen
`Delphi Delco Electronics Systems
`
`M. Laur
`Delphi Delco Electronics Systems
`
`R. Freeman
`IBM Corporation
`
`‘調同属面@岡 田 , . ‘m・.
`
`~A Il!!' "~A~ ••
`
`U旭川 ~Jl r
`
`‘調F・ー晶INTERNATlONAL -
`
`錯 1 .98
`
`Vlllnternational Mobility Technology
`Conference & Exhibit
`Sao Paulo, Brazil
`November 9 to 11,1998
`
`AV. PAULlSTA, 2073・HORSA11 -CJ. 2001・CEP01311・940・SAOPAULO・SP
`
`VWGoA - Ex. 1013
`Volkswagen Group of America, Inc. - Petitioner
`
`1
`
`
`
`The app回 ranceof the ISSN code at the bottαn of this page indicates SAE's consent
`that copies of the paper may be made for personal or intemal use of specific clients.
`This cons伺 tis given on the ∞ndition however, that the copier pay a $ 7.00 per article
`copy f伺 through the Copyright Clearance Center, Inc. Operations C伺 ter,222
`Rosewood Drive, Danvers, MA 01923 for copying beyond that permitted by Sections
`107 or 108 of U.S. Copyright Law. This consent does nol extend to other kinds of
`copying such as copying for general distribution, for advertising or promotional
`purposes, for creating new collective works, or for resale.
`
`SAE routinely stocks printed papers for a period of three years following date of
`publication. Direct your orders to SAE Customer Sales and Satisfaction
`Department.
`
`Quantity reprint rates can be obtained from the Customer Sales and Satisfaction
`Depa川ment.
`
`To request permission 10 reprint a technical paper or permission 10 use copyrighted
`SAE pu削にalionsin other works, contact the SAE Publications Group.
`
`GLOOAL鰍 沼 山TY04.TA臥 SE
`
`AII SAE papers, standards, and selected
`books are abstracted and indexed in the
`GわbalMobility Oatabase.
`
`No part of this publication may be reproduced in any form, in an electronic retrieval
`system or otherwise, without the prior written permission of the publisher.
`
`ISSN 0148・7191
`Copyrlght 1998 Soclety of Automotlve Englneers, Inc.
`
`Positions and opinions advan偲 d in this paper are tho鵠 ofthe author(s) and not
`necessarily those of SAE. The author is solely responsible for the ∞ntent of the
`paper. A pr'∞ess is available by which discussions will be printed with the paper if it is
`published in SAE Transactions. For permi悶 onto仰 blishthis paper in full or in part,
`contact the SAE Publications Group.
`
`Per釦 nswishing to submit papers to be considered for presentation or publication
`through SAE should send the manuscript or a 300 word abstract of a proposed
`manuscript to: Secretary, Engineering M田 tingsBoard, SAE.
`
`2
`
`
`
`982901
`
`“The Network Vehicle -A Glimpse into the Future of
`Mobile Multi-Media"
`
`R. Lind, R. Schumacher, R. Reger, R. Olney, H. Yen and M. Laur
`Delphi Delco Electronics Systems
`
`R. Freeman
`IBM Corporation
`
`Copyright@ 1998 Society of Automotive Engineers. Inc.
`
`ABSTRACT
`
`The Network Vehicle is the Delphi Automotive
`Systems' vision for the future convergence of the
`communications infrastructure, computers, and the
`automobile. It features many advanced functions
`such as: satellite video, Internet access, virtual
`navigation, remote vehicle diagnostics and control,
`games, mobile office, automotive web site, and
`customized real-time stock quotes and Sports scores.
`These features are enabled by an integrated planar
`antenna that is capable of multiple satellite reception,
`a client-server network architecture, and unique
`human-vehicle-interfaces. The software application
`is written in Java, using API's (Application
`Programming Inteげaces)to reduce the complexity
`and cost of the source code.
`
`INTRODUCTION
`
`The Network Vehicle, a new technology
`initiative by Delphi Delco Electronics Systems and its
`pa巾 ers(18M, Netscape Communications, and Sun
`Microsystems) is aimed at offering more productivity
`tools, convenience, safety, and entertainment to
`millions of commuters who spend hours each day
`cruising the roads or stuck in traffic. It is designed to
`demonstrate what technologies and software can do
`for the vehicle of the future. The Network Vehicle,
`pictured in Figure 1, made its debut at COMDEX '97
`and has since been all over the world appearing in
`demos, conferences, and technology shows,
`including SAE Congress ・98,and Ce8it‘98.
`
`SYSTEM OVERV医W
`
`The Network Vehicle was created by integrating
`existing hardware and software technologies
`including voice recognition, wireless communications,
`
`global positioning via satellite, head-up displays,
`Java™ technology, microprocessors, Web access,
`and other Internetlintranet features. The voice
`recognition technology allows drivers and
`passengers to verbally request and listen to e-mail
`messages being read out loud, locate a restaurant or
`hotel, ask for navigation help or for specific music or
`spoパs scores, and use voice-activated telephone
`services, all done safely without interfering with
`driving. Drivers can use a head-up display projected
`through the windshield to navigate to their destination
`or check vehicle functions without taking their eyes
`off the road.
`
`Figure 1. The Network Vehicle
`
`Passengers using individual terminals next to
`their seats can do even more, including interacting
`with the Internet, watching television or playing
`games. Existing services that could be integrated
`include theft deterrent technologies and, emergency
`services. These "smart" features are enabled mainly
`because of the reaトtimedata-streaming capabilities
`over a wireless network. The Network Vehicle also
`
`3
`
`
`
`has an integrated cellular phone; Netscape
`Communicator software for Web browsing and e-
`mail; a removable personal digital assistant (PDA)
`and docking station; and a vehicle web site which
`provides driver suppoパ for a wide array of
`customized capabilities such as enabling remote
`monitoring and control of vehicle systems in
`emergency situations.
`
`Onboard And Off-Board Communications
`Networks ・Thekey to the functions of the Network
`Vehicle is its ability to communicate efficiently both
`onboard and off-board of the vehicle. Figure 2
`depicts the onboard network architecture.
`
`Figure 2. On Board Network Architecture
`
`Amplif1.ro/S同 組 軒S
`
`At the heart of the onboard system is a network
`computer that links up a number of sub-networks,
`including a Class 11 bus (for engine, head-up and
`head-down displays, door lock and door actuator,
`RFID, and cell phone, etc.), an Ethernet (for
`passenger computers and displays), and a mobile
`media link (for speakers and CD players). Since the
`subnetworks all have different clock speed and
`functionality, gateways are used to ensure proper
`isolation and harmonious operations.
`
`The off-board network is shown in Figure 3.
`The high bandwidth requirement for on-demand
`audio and video functions was fulfilled with DirecPC
`and DirecTV satellite links. A wireless modem
`provides the uplink out of the vehicle directly to
`Internet service providers. The downlink return path
`from the Internet to the Network Vehicle can come
`through either the satellite (higher speed), or through
`the wireless modem (Iower speed). The downlink
`satellites vidωand data signals are picked up by the
`Network Vehicle's roof-mounted antenna.
`
`KEY TECHNOLOGIES AND SYSTEM
`COMPONENTS
`
`The key technologies and system components
`behind the Network Vehicle are advanced speech
`
`recognition software, mobile media link (high叩 田d
`fiber optic data bus), reconfigurable HUD, high-
`bandwidth communications that connect the vehicle
`with the outside world, and a suite of automotive
`computer software. These elements are described
`below.
`
`Figure 3. 0符-BoardNetwork Architecture
`
`~同60' 〆 ~ LWC
`
`パ ダ ノす 「 目IIIIII~IIIII
`守 桝 /〆"~
`‘ トmaぺ町、
`ん/ ///山口rm
`
`噂 2尋覇P 附 Z即 時
`
`Homel'酎 fi帥
`Computer
`
`Speech Recognition and Text-to・SpeechSystem -
`IBM has modified its advanced speech recognition
`and text-to-speech system, ViaVoice TM, for the
`automotive environment. ViaVoice allows the driver
`to access virtually all the vehicle's features through
`voice commands and enables the vehicle to talk back
`using synthesized speech. The driver can: execute
`vehicle system commands such as lock doors, play
`CD, and change radio station, request travel
`directions and traffic updates from the Web or other
`sources, check e-mail and voicemail, request news,
`stock information and sports. The speech
`recognition system can understand most drivers
`instantly, with no system training required, and it has
`been tuned to offer optimal performance even in a
`potentially noisy vehicle environment.
`
`Driver and Center Console Displays ・TheNetwork
`Vehicle is equipped with three displays for the driver:
`the head-down display (HDD), the head-up display
`(HUD), and the center console display. The HDD
`system displays standard graphics for an instrument
`panel: road speed, engine speed, engine status, door
`lock/ajar, and fuel level. It also displays the functions
`for the steering wheel buttons. For example,the
`same buUon can be "change track" for CD mode or
`"tune up" for radio mode. The HUD projects an
`virtual image through the windshield that gives
`information to drivers without requiring them to take
`their eyes 0符 the road. It displays road speed,
`engine status, waiting e-mail indication, navigation
`information, microphone on/off, and a text message
`area for giving feedback to the driver.
`
`4
`
`
`
`The center console's touch-screen LCD serves
`as a user interface for controlling nearly all of the
`Network Vehicle's functions (ente陶 inment,
`navigation, office, and information). When in
`entertainment mode, the display is configured as a
`radio- or CD-style faceplate whose buttons and
`controls are activated by touch. This display is
`reconfigured to display e-mail, navigation maps, Web
`browser, cellular phone faceplate (shown in Figure
`4), and more. Voice-activated commands can be
`used with all of the center console functions and, in
`some cases, is combined with text-to-speech input to
`minimize driver distraction.
`
`Figure 4. Cellular Phone Faceplate Display
`
`Passenger Displays ・ The Network Vehicle
`has color LCD touch panels for the back-seat and
`front-seat passengers. As with the center console
`display, the passenger displays serve as user
`interfaces for controlling nearly all of the functions on
`the Network Vehicle. Unlike the center console
`display, however, the passenger displays can show
`video from DirecTV or DVD players, and they allow
`touch-screen access to entertainment, navigation,
`office, and information. When in entertainment
`mode, the display is configured as a radio-or CD・
`style faceplate with touch-activated buUons and
`controls.
`
`Planar Satellite Antenna ・Theantenna technology
`used in the Network Vehicle is the Continuous
`Transverse Stub (CTS) array. It is chosen because
`of its simplicity, planar construction, and potential for
`being an inexpensive pr,吋 uct. Figure 5 shows the
`cross sectional view of a typical CTS antenna,
`realized as an array of broad continuous transverse
`radiating stubs, finite in height, extending from the
`upper conductive plate of an open parallel-plate
`transmission-line structure.
`
`剖 ;、
`
`~
`
`/"
`
`Figure 5. CTS Antenna Cross Section
`
`As a receiving antenna, the induced longitudinal
`current components in the parallel plate structure are
`interrupted by the transverse-oriented stubs and
`excite propagating waves in the parallel-plate
`structure. This simple architecture allows for a
`complex two-dimensional planar array to be realized
`as an “extrusion" of a one-dimensional (constant
`cross-section) geometry. This has the effect of
`replacing a conventional "NxN=W" element structure
`(of discrete radiators, couplers, etc.) with a less
`complex “monolithic" array comprised of “N'
`integrated coupler/radiator features. The simple “tee"
`cross-section of the integrated CTS coupleげradiator
`forms an inherently low-"Q" (non-resonant) element
`which exhibits significant advantages (as compared
`to slot or patch radiators) in terms of wide-angle
`scanning capability, polarization purity, bandwidth,
`and dimensional insensitivity.
`
`Customer Application Web Site・ Thedriver and
`passengers of the Network Vehicle can take
`advantage of Internet services provided by
`automotive動 oriented ISPs (Internet Service
`Providers). The customer service site developed for
`the Network Vehicle showcases the types of features
`that could be offered when intelligent vehicle systems
`are connected to the Internet.
`
`Because the Network Vehicle's systems are
`accessible via its command and control application,
`which also has secure access to the Internet, many
`scenarios are possible. Functions like parking lights
`and door locks on the Network Vehicle can be
`controlled remotely, providing safety and
`convenience. Under voice control of the driver, the
`Network Vehicle can upload vehicle status according
`to a profile set up in advance. An application
`monitors the diagnostic information available from
`components in the engine compaパment. Should the
`diagnostics indicate that the latest reading from
`engine sensors falls outside a normal range, the
`application can notify the customer service Web site,
`where the severity of the reading can be determined.
`According to this determination, the control on the
`Network Vehicle could be used by the service
`
`5
`
`
`
`representative to alert the driver; the alert could be
`done using text-to・speechand head-up display, and
`then features of the application,争mail,and office
`could be used to arrange a service appointment.
`
`Other features take advantage of Internet
`service provideぱ abilityto communicate with the
`Network Vehicle. Trip plans created by vehicle
`owners or concierge services can be stored at the
`Internet service provider. By accessing global
`positioning satellite (GPS) data directly from the
`vehicle, the driver and passengers can obtain maps,
`route guidance, fuel, lodging, and restaurant
`information while traveling. Owners of the Network
`Vehicle can also use their Web browser to set up a
`profile, including preferences like radio stations,
`personalized audio content, service records, and
`emergency service numbers.
`
`Personal Digital Assistant Docking -An important
`role of the Network Vehicle is providing office
`functions to mobile users, using the same data the
`users have in their office desktop computers. This
`function is mainly provided through vehicle
`applications, Internet connectivity, and advanced,
`voice-based user interfaces. It is important for the
`Network Vehicle to access and synchronize personal
`and business data with PDAs, which is becoming
`increasingly important in our mobile, connected
`world.
`
`A slot built into the center console of the
`Network Vehicle accepts the IBM WorkPad™ and
`uses the Network Vehicle's computer to add speech
`recognition and text-to-speech functions. This
`enables the driver to listen to schedules and to
`u凶ate files and other office data stored in the
`WorkPad. So the driver could, for example, issue a
`voice command to read calendar entries from the
`WorkPad or dictate a to-do list while driving. As PDA
`and smaパcardtechnology advances, the Network
`Vehicle's PDA integration could support the use of
`PDA-type devices for the secure transport and
`access of personal, financial, and business
`information as people move from one network access
`point to another.
`
`Automotive Computer Software ・Virtualmachine-
`based, object-oriented technologies were applied to
`the Network Vehicle's development because they
`support the special requirements posed by the
`vehicle. Smalltalk, a well-proven, advanced, object-
`oriented environment and the latest JavaτM
`technologies were chosen to develop the Network
`Vehicle's software. Some of the software developed
`are described below.
`
`A command and control appl悶 tionwritten in
`Smalltalk, interfaces to the car's control buses and
`
`electronics. This application, running on the vehicle's
`main processor and buses, monitors vehicle status,
`controls devices such as cell phone and microphone,
`supplies driver information via head-up display,
`manages off-vehicle information flow, and controls
`vehicle software, such as the voice recognition and
`various convenience passenger appli伺 tions. This
`application coordinates with the voice recognition, the
`head-up display, and the touch screen to provide
`feedback and control of the various systems, helping
`to keep the driver's eyes on the road. For driver
`convenience and safety, this application also
`interfaces via the Internet to a customer service
`provider, who can remotely monitor the vehicle
`status, unlock doors, turn on exterior lighting, etc.
`
`Graphical user interfaces for Network Vehicle's
`center console and passenger displays were
`developed with Java to provide access to various in-
`vehicle and off-vehicle applications, such as
`navigation, audio/video entertainment, and office. An
`Internet server application was developed with
`VisualAge@ for Java to provide communication
`between Internet岨 based customer applications and
`the vehicle systems. These applications suppoバa
`message司 basedprotocol communicating through the
`Internet to the in-vehicle co灯、mand and control
`application, which in turn interfaces to the vehicle
`systems and the user interface application. Java
`applets were also developed for the customer site in
`order to provide animated vehicle status and control
`graphics.
`
`Media BUS and In-Vehicle Electronics - The
`Network Vehicle contains a number of audio and
`video components that are configured and controlled
`via a high-speed (100 Mbps) digital fiber-optic mobile
`media link (MML). Audio and video devices like CD
`players can send their output signals via the
`multiplexed, fiber-optic bus to drive other
`components like amplifiers and displays. A control
`signal is also carried on the MML bus to configure
`and control the devices. On the Network Vehicle, the
`command and control appli伺 tionhas access to the
`CD player and amplifier via the M Mし Thecommand
`and control application can then configure the
`components, switch signals, and adjust variables
`such as volume, fade, and balance. The MML gives
`the application full use of the vehicle's multimedia
`systems to develop functions and user interfaces
`tailored to driver and passenger use.
`
`Combining a command and control application
`with the MML in the Network Vehicle made possible
`features such as context-sensitive volume reduction
`during the use of the phone and the text-to-speech
`feature. It also allows "faceplate-style" user
`interfaces to integrate Internet radio with the sound
`system, and common and consistent user interfaces
`to define, review, and play the audio and video
`
`6
`
`
`
`content preferred by the driver and passengers. The
`vehicle also features a satellite receiver system,
`which provides DirecTV and DirecPC access.
`DirecPC offers Internet access via cellular modem to
`the vehicle for conventional Web applications as well
`as high-speed (400 kbps) download of data including
`audio, video, and text.
`
`FEATURES AND FUNCTIONS OF THE NETWORK
`VEHIClE
`
`The main features of the Network Vehicle are
`manifested in the following three areas: (1) Driving
`Aids, (2) Business Tools, and (3) News and
`Entertainment. The Network Vehicle is designed
`such that, through so代wareupgrades the customer
`can be provided with new features and functions as
`they become available.
`
`Driving Aids -Get Where You're Going Efficiently
`-The Network Vehicle can access a simulated
`integrated global positioning system and hence
`advanced navigation capabilities via Internet.
`Therefore, it literally knows where it is and where it's
`going. It can display the appropriate maps or simply
`provide route directions on the head-up display,
`command console or as spoken instructions. Drivers
`could control the navigation system using commands
`like “destination" to select a new destination or "route
`guidance" to get turn-by-turn instructions. An
`example of such a display is shown in Figure 6.
`
`Figure 6. Example of a Navigation Function Display
`
`If you think you left the Network Vehicle's doors
`unlocked or the lights on, just visit the vehicle web
`site from your home of office computer to check, then
`fix the problem remotely. The Network Vehicle's
`future remote control capabilities could not only allow
`you to actually start the vehicle in the parking lot from
`the office, but to even set the heater or air conditioner
`from your office computer, so that the vehicle is
`
`comfortable and ready to roll when you are. You
`could even plan trips on the vehicle web site, then
`download them to your vehicle. Figure 7 shows an
`example page of the vehicle web site where control
`parameters can be set.
`
`Figure 7. Example of a Vehicle Web Site Page for
`Remote Monitoring and Control
`
`Business Tools - You're Never Out of Touch -
`The Network Vehicle is on the Web, with a DirecPC
`satellite link beaming the Internet to the vehicle at
`400 kbps, more than 15 times the speed of a
`standard 28.8 kbps modem. Web sites can be
`viewed on the color reconfigurable displays at each
`of the three passenger seats, and the Network
`Vehicle can download selected information to the
`driver such as maps for navigation.
`
`The Network Vehicle is an extension of your
`office, seamlessly offering access to everything from
`e-mail and address book to the criti回 Ifiles you n田 d.
`The driver can be alerted to new e-mail via the head-
`up display and can ask the vehicle to read e-mail.
`With voice commands, a t仁川olist 回 nbe called up
`from the docked Workpad.
`E-mails and
`appointments can be downloaded to the docked
`Workpad PDA, for review after leaving the vehicle. In
`the future, the Network Vehicle will be able to
`communicate pages and play voice mail. The driver
`will be able to use voice commands to call up a
`personal address book, then dictate e-mail messages
`which the vehicle can turn into text and send.
`Passengers will be able to view faxes on their LCD
`displays.
`
`The Network Vehicle's cell phone is fully
`integrated with other systems, so a simple voice
`command tells the phone to dial any number. The
`Network Vehicle uses its own in-vehicle audio system
`as a speakerphone, 剖lowing hands-free
`conversations.
`
`7
`
`
`
`News and Entertainment -Getting There is More
`Than Half the Fun ・Viathe DirecTV satellite link,
`passengers will be able to view hundreds of
`broadcast and cable channels. Each passenger回 n
`watch a different channel at the same time, with
`headsets to keep the noise level to a minimum.
`Using the Network Vehicle web site, you can
`preprogram your favorite channels and shows. In the
`future, the Network Vehicle will include a DVD player
`so you'lI be able to watch the latest movies on disc.
`
`The Network Vehicle offers AM/FM radio, a CD
`player and audio from the Internet, all accessible with
`voice commands. From the Network Vehicle web
`site, one can program personal radio presets. Or,
`take advantage of various capabilities on the Internet,
`such as downloadable audio books, or audio-on-
`demand for an infinite choice of music selections or
`radio stations worldwide that are now broadcasting
`over the Web. Each passenger can also use an LCD
`display to watch movies, surf the Net or play the
`latest computer games.
`Using Netscape
`Communicator, the Network Vehicle will allow you to
`speak "Read Stocks" and hear the cu昨entvalue of
`each stock in your portfolio. In the future, the vehicle
`will read you the latest news from Web sites, or
`provide customized news from the vehicle web site.
`
`CONCLUSION
`
`The Network Vehicle has proven that by
`properly integrating several existing functions and
`technologies one can get a good glimpse of what the
`future of mobile multimedia holds. The range of
`applications enabled by the availability of wideband
`co町、munications to the car is enormous.
`Reconfigurable displays and upgradable software will
`allow vehicle owners to take advantages of the latest
`applications and services. However, to make this
`vision a reality, a great deal of improvement and
`development is still needed. For example, an
`affordable and robust mobile satellite tracking
`antenna system is yet to be realized. It is clear
`though, the integration of computer, communications,
`and software technologies with vehicles will have a
`dramatic impact on the future of automotive industry.
`
`8