VWGoA - Ex. 1015
`Volkswagen Group of America, Inc., Petitioner
`
`1
`
`

`

`The appearance of the ISSN code at the bottom of this page indicates SAE‘s consent
`that Copies of the paper may be made for personal or internal use of specific cl ients.
`This consent is given on the condition however. that the copier pay a $ 7.00 per article
`copy fee through the Copyright Clearance Center.
`Inc. Operations Center. 222
`Rosewood Drive, Danvers. MA 01923 for copying beyond that permitted by Sections
`107 or 108 of US. Copyright Law. This consent does not extend to other kinds of
`copying such as copying for general distribution.
`for advertising or promotional
`purposes, for creating new collective works. or for resale.
`
`SAE routinely stocks printed papers for a period of three years following date of
`pubiication.
`Direct
`your
`orders
`to SAE Customer Sales and Satisfaction
`Department.
`
`Quantity reprint rates can be obtained from the Customer Sales and Satisfaction
`Department.
`
`To request permission to reprint a technical paper or permission to use copyrighted
`SAE publications in other works. contact the SAE Publications Group.
`
`MMWWABASE
`
`At! SAE papers, standards. and seiected
`books are abstracted and indexed in the
`Global Mobriity Database.
`
`in an etectronic retrieval
`No part of this publication may be reproduced in any form,
`system or otherwise, without the prior written permission of the publisher.
`
`ISSN 0148-7191
`Copyright 1993 Society of Automotive Engineers, Inc.
`
`Positions and opinions advanced in this paper are those of the authoris) and not
`necessarin those of SAE.
`The author is solely responsible for the content of the
`paper. A process is available by which discussions will be printed with the paper if it is
`published in SAE Transactions. For permission to publish this paper in full or in part,
`contact the SAE Publications Group.
`
`Persons wishing to submit papers to be considered for presentation or publication
`through SAE should send the manuscript or a 300 word abstract of a proposed
`manuscript to: Secretary. Engineering Meetings Board, SAE.
`
`2
`
`

`

`“The Network Vehicle — A Glimpse into the Future of
`
`Mobile Multi-Media”
`
`982901
`
`R. Lind, R. Schumacher, R. Reger, R. Olney. H. Yen and M. Laur
`Delphi Delco Electronics Systems
`
`R. Freeman
`IBM Corporation
`
`Copyright © 1998 Society of Automotive Engineers. Inc.
`
`ABSTRACT
`
`The Network Vehicle is the Delphi Automotive
`Systems‘ vision for the future convergence of the
`communications infrastructure, computers. and the
`automobiie.
`It features many advanced functions
`such as:
`satellite video.
`Internet access, virtual
`navigation, remote vehicle diagnostics and control,
`games, mobile office. automotive web site, and
`customized real-time stock quotes and sports scores.
`These features are enabled by an integrated planar
`antenna that is capable of multiple satellite reception,
`a client-server network architecture, and unique
`human-vehicIe-interfaces. The software application
`is written
`in
`Java.
`using API's
`(Application
`Programming Interfaces) to reduce the complexity
`and cost of the source code.
`
`INTRODUCTION
`
`new technology
`a
`The Network Vehicle,
`initiative by Delphi Delco Electronics Systems and its
`partners (IBM. Netscape Communications. and Sun
`Microsystems) is aimed at offering more productivity
`tools. convenience.
`safety. and entertainment
`to
`millions of commuters who spend hours each day
`cruising the roads or stuck in traffic.
`it is designed to
`demonstrate what technologies and software can do
`for the vehicle of the future. The Network Vehicle.
`pictured in Figure ‘I. made its debut at COMDEX '97
`and has since been all over the world appearing in
`demos.
`conferences.
`and
`technology
`shows.
`including SAE Congress '98, and CeBit '98.
`
`SYSTEM OVERVIEW
`
`The Network Vehicle was created by integrating
`existing
`hardware
`and
`software
`technologies
`including voice recognition. wireless communications,
`
`global positioning via satellite. head-up displays.
`Javam technology. microprocessors. Web access,
`and other
`Internet/intranet
`features.
`The voice
`
`and
`drivers
`allows
`technology
`recognition
`passengers to verbaity request and listen to e-mail
`messages being read out loud, locate a restaurant or
`hotel. ask for navigation help or for specific music or
`sports scores. and use voice-activated telephone
`services.
`all done safely without
`interfering with
`driving. Drivers can use a head-up display projected
`through the windshield to navigate to their destination
`or check vehicle functions without taking their eyes
`off the road.
`
`
`
`Figure 1. The Network Vehicle
`
`Passengers using individual terminals next to
`their seats can do even more,
`inctuding interacting
`with the lnternet. watching television or playing
`games. Existing services that could be integrated
`include theft deterrent technologies and, emergency
`services. These "smart" features are enabled mainly
`because of the real-time data-streaming capabilities
`over a wireless network. The Network Vehicle also
`
`3
`
`

`

`phone; Netscape
`cellular
`integrated
`an
`has
`Communicator software for Web browsing and e-
`mail: a removable personal digital assistant (FDA)
`and docking station; and a vehicle web site which
`provides driver
`support
`for
`a wide
`array
`of
`customized capabilities such as enabling remote
`monitoring
`and control
`of vehicle
`systems
`in
`emergency situations.
`
`Communications
`Off-Board
`And
`Onboard
`Networks - The key to the functions of the Network
`Vehicle is its ability to communicate efficiently both
`onboard and off-board of the vehicle.
`Figure 2
`depicts the onboard network architecture.
`
`
`
`Amplmnrsifipnakcrs
`
`Figure 2. On Board Network Architecture
`
`At the heart of the onboard system is a network
`computer that links up a number of sub-networks.
`including a Class ll bus (for engine. head-up and
`head-down displays. door lock and door actuator,
`RFID. and cell phone. etc).
`an Ethernet
`(for
`passenger computers and displays). and a mobile
`media link (for speakers and CD players). Since the
`subnetworks all have different clock speed and
`functionality. gateways are used to ensure proper
`isolation and harmonious operations.
`
`The off-board network is shown in Figure 3.
`The high bandwidth requirement
`for on-demand
`audio and video functions was fulfilled with DirecPC
`and DirecTV satellite links.
`A wireless modern
`
`provides the uplink out of the vehicle directly to
`Internet service providers. The downlink return path
`from the Internet to the Network Vehicle can come
`
`through either the satellite (higher speed). or through
`the wireless modem (lower speed}. The downlink
`satellites video and data signals are picked up by the
`Network Vehicle's roof-mounted antenna.
`
`TECHNOLOGIES
`KEY
`COMPONENTS
`
`AND
`
`SYSTEM
`
`The key technologies and system components
`behind the Network Vehicle are advanced speech
`
`recognition software. mobile media link (high-speed
`fiber optic data bus).
`reconfigurable HUD. high-
`bandwidth communications that connect the vehicle
`with the outside world. and a suite of automotive
`computer software. These elements are described
`below.
`
`Figure 3. Off-Board Network Architecture
`
`caram5&1
`
`’nsrm x
`
`r:IrJ'
`l.
`
`‘
`
`I“
`
`.‘
`ii
`
`I)"
`
`,4'
`
`_.
`
`."
`DIME“!
`Ground matron .'
`.'
`.'
`VF
`
`1."
`'
`
`fr"
`
`.3"
`.2'7
`J"
`,‘1 MMMIMGQM
`mun-d
`
`:
`
`‘
`
`DlrchC
`Ground
`Station
`
`‘\
`
`Ehbmfl)
`
`H
`ll
`mum
`rare
`Wen Server
`
`.
`
`Internal Service
`Shoulder
`
`Homelflfliu
`
`tom butur
`
`Speech Recognition and Text-to-Speech System -
`IBM has modified its advanced speech recognition
`and text-to—speech system. ViaVoiceT".
`for
`the
`automotive environment. ViaVoice allows the driver
`to access virtually all the vehicle's features through
`voice commands and enables the vehicle to talk back
`
`using synthesized speech. The driver can: execute
`vehicle system commands such as lock doors. play
`CD.
`and change
`radio station.
`request
`travel
`directions and traffic updates from the Web or other
`sources. check e-mail and voicemail. request news.
`stock
`information
`and
`sports.
`The
`speech
`recognition system can understand most drivers
`instantly. with no system training required. and it has
`been tuned to offer optimal performance even in a
`potentially noisy vehicle environment.
`
`Driver and Center Console Displays - The Network
`Vehicle is equipped with three displays for the driver".
`the head-down display (HDD). the head-up display
`(HUD). and the center console display. The HDD
`system displays standard graphics for an instrument
`panel: road speed. engine speed. engine status. door
`Iocldajar, and fuel level.
`It also displays the functions
`for the steering wheel buttons.
`For examplethe
`same button can be ”change track" for CD mode or
`"tune up" for radio mode. The HUD projects an
`virtual
`image through the windshield that gives
`information to drivers without requiring them to take
`their eyes off the road.
`It displays road speed.
`engine status. waiting e-mail
`indication, navigation
`information. microphone onioff. and a text message
`area for giving feedback to the driver.
`
`4
`
`

`

`The center console's touch-screen LCD serves
`
`as a user interface for controlling nearly all of the
`Network
`Vehicle's
`functions
`(entertainment.
`navigation.
`office.
`and information).
`When in
`entertainment mode. the display is configured as a
`radio- or CD-style faceplate whose buttons and
`controls are activated by touch.
`This display is
`reconfigured to display e-mail. navigation maps. Web
`browser. cellular phone faceplate (shown in Figure
`4). and more. Voice-activated commands can be
`used with all of the center console functions and. in
`some cases. is combined with text-to-speech input to
`minimize driver distraction.
`
`SIJH'I'J 11.21:
`
`GM 11.13:".-
`
`IEIII 93.5
`
`Figure 4. Cellular Phone Faceplate Display
`
`Passenger Displays - The Network Vehicle
`has color LCD touch panels for the back-seat and
`front-seat passengers. As with the center console
`display,
`the passenger displays
`serve as user
`interfaces for controlling nearly all of the functions on
`the Network Vehicle. Unlike the center console
`
`display. however. the passenger displays can show
`video from DirecTV or DVD players. and they allow
`touch-screen access to entertainment. navigation.
`office, and information. When in entertainment
`mode. the display is configured as a radio- or CD—
`style faceplate with touch-activated buttons and
`controls.
`
`Planar Satellite Antenna - The antenna technology
`used in
`the Netwurk Vehicle is
`the Continuous
`Transverse Stub (CTS) array.
`It is chosen because
`of its simplicity. planar construction. and potential for
`being an inexpensive product. Figure 5 shows the
`cross sectional view of a typical CTS antenna.
`realized as an array of broad continuous transverse
`radiating stubs. finite in height. extending from the
`upper conductive plate of an open parallel-plate
`transmission~line structure.
`
`RadiatingICou pling Stub
`
`(Coupled) E-Fielcl
`
`Parallel-Plats Region
`
`«Iv
`Propagating +
`Plane-Wave
`
`Figure 5. CTS Antenna Cross Section
`
`As a receiving antenna. the induced longitudinal
`current components in the parallel plate structure are
`interrupted by the transverse-oriented stubs and
`excite
`propagating waves
`in
`the
`parallel-plate
`structure.
`This simple architecture allows for a
`complex two-dimensional planar array to be realized
`as an “extrusion" of a one—dimensional
`(constant
`cross—section) geometry.
`This has the effect of
`replacing a conventional “NxN—-'N2“ element structure
`(of discrete radiators couplers etc.) with a less
`complex
`"monolithic“
`array
`comprised
`of
`"N'
`integrated couplen'radiator features. The simple “tee"
`cross-section of the integrated CTS couplerfradiator
`forms an inherently low-“Q" (non—resonant} element
`which exhibits significant advantages (as compared
`to slot or patch radiators) in terms of wide-angle
`scanning capability. polarization purity. bandwidth.
`and dimensional insensitivity.
`
`Customer Application Web Site - The driver and
`passengers of
`the Network Vehicle
`can take
`advantage
`of
`Internet
`services
`provided
`by
`automotive—oriented
`ISPs
`(Internet
`Service
`Providers). The customer service site developed for
`the Network Vehicle showcases the types of features
`that could be offered when intelligent vehicle systems
`are connected to the Internet.
`
`Because the Network Vehicle's systems are
`accessible via its command and control application.
`which also has secure access to the Internet. many
`scenarios are possible. Functions like parking lights
`and door
`locks on the Network Vehicle can be
`
`and
`safety
`providing
`remotely.
`controlled
`convenience. Under voice control of the driver. the
`Network Vehicle can upload vehicle status according
`to a profile set up in advance.
`An application
`monitors the diagnostic information available from
`components in the engine compartment. Should the
`diagnostics indicate that
`the latest
`reading from
`engine sensors falls outside a normal
`range.
`the
`application can notify the customer service Web site.
`where the severity of the reading can be determined.
`According to this determination.
`the control on the
`Network Vehicle could be used by the service
`
`5
`
`

`

`representative to alert the driver; the alert could be
`done using text-to~speech and head—up display, and
`then features of the application, e-mail. and office
`could be used to arrange a service appointment.
`
`internet
`take advantage of
`features
`Other
`service providers‘ ability to communicate with the
`Network Vehicle.
`Trip plans created by vehicle
`owners or concierge services can be stored at the
`Internet
`service provider.
`By accessing global
`positioning satellite (GPS) data directly from the
`vehicle, the driver and passengers can obtain maps.
`route
`guidance.
`fuel.
`lodging.
`and
`restaurant
`information while traveling. DWners of the Network
`Vehicle can also use their Web browser to set up a
`profile.
`including preferences
`like
`radio stations,
`personalized audio content. service records. and
`emergency service numbers.
`
`Personal Digital Assistant Docking - An important
`role of
`the Network Vehicle is providing office
`functions to mobile users. using the same data the
`users have in their office desktop computers. This
`function
`is mainly
`provided
`through
`vehicle
`applications,
`Internet connectivity. and advanced.
`voice-based user interfaces.
`it is important for the
`Network Vehicle to access and synchronize personal
`and business data with PDAs. which is becoming
`increasingly important
`in our mobile. connected
`world.
`
`into the center console of the
`A slot built
`Network Vehicle accepts the IBM WorkPadW and
`uses the Network Vehicle‘s computer to add speech
`recognition and text-to-speech functions.
`This
`enables the driver to listen to schedules and to
`
`update files and other office data stored in the
`WorkPad. So the driver could. for example. issue a
`voice command to read calendar entries from the
`WorkPad or dictate a to-do list while driving. As FDA
`and smart card technology advances. the Network
`Vehicle's FDA integration could support the use of
`FDA-type devices for
`the secure transport and
`access
`of
`personal,
`financial.
`and
`business
`information as people move from one network access
`point to another.
`
`Automotive Computer Software - Virtual machine-
`based. object-oriented technologies were applied to
`the Network Vehicle's development because they
`support
`the special
`requirements posed by the
`vehicle. Smalltalk, a well-proven. advanced. object—
`oriented
`environment
`and
`the
`latest
`JavaT'“
`
`technologies were chosen to develop the Network
`Vehicle‘s software. Some of the software developed
`are described below.
`
`A command and control application written in
`Smalltalk.
`interfaces to the car‘s control buses and
`
`electronics. This application. running on the vehicle's
`main processor and buses. monitors vehicle status.
`controls devices such as cell phone and microphone.
`supplies driver
`information via head-up display.
`manages off-vehicle information flow. and controls
`vehicle software. such as the voice recognition and
`various convenience passenger applications. This
`application coordinates with the voice recognition. the
`head-up display. and the touch screen to provide
`feedback and control of the various systems. helping
`to keep the driver's eyes on the road.
`For driver
`convenience
`and
`safety.
`this
`application
`also
`interfaces via the Internet
`to a customer service
`
`the vehicle
`provider, who can remotely monitor
`status. unlock doors. turn on exterior lighting. etc.
`
`Graphical user interfaces for Network Vehicle‘s
`center
`console
`and
`passenger displays were
`developed with Java to provide access to various in-
`vehicle
`and
`off-vehicle
`applications,
`such
`as
`navigation, audioivideo entertainment. and office. An
`lntemet
`server application was developed with
`VisualAge® for Java to provide
`communication
`betwaen Internet-based customer applications and
`the vehicle systems. These applications support a
`message-based protocol communicating through the
`lntemet
`to the in-vehicle command and control
`
`application. which in turn interfaces to the vehicle
`systems and the user interface application.
`Java
`applets were also developed for the customer site in
`order to provide animated vehicle status and control
`graphics.
`
`- The
`Media BUS and ln-Vehicle Electronics
`Network Vehicle contains a number of audio and
`
`video components that are configured and controlled
`via a high-speed (100 Mbps) digital fiber~optic mobile
`media link (MML). Audio and video devices like CD
`players can send their output signals via
`the
`multiplexed.
`fiber—optic
`bus
`to
`drive
`other
`components like amplifiers and displays. A control
`signal is also carried on the MML bus to configure
`and control the devices. On the Network Vehicle. the
`command and control application has access to the
`CD player and amplifier via the MML. The command
`and control
`application can then configure
`the
`components. switch signals. and adjust variables
`such as volume, fade. and balance. The MML gives
`the application full use of the vehicle's multimedia
`systems to develop functions and user interfaces
`tailored to driver and passenger use.
`
`Combining a command and control application
`with the MML in the Network Vehicle made possible
`features such as context-sensitive volume reduction
`
`during the use of the phone and the text-to-speech
`feature.
`It
`also allows
`"faceplate—style" user
`interfaces to integrate Internet radio with the sound
`system, and common and consistent user interfaces
`to define,
`review. and play the audio and video
`
`6
`
`

`

`content preferred by the driver and passengers. The
`vehicle also features a satellite receiver system,
`which provides DirecTV and DirecPC access.
`DirecPC offers lntemet access via cellular modem to
`the vehicle for conventional Web applications as well
`as high-speed (400 kbps) download of data including
`audio, video, and text.
`
`FEATURES AND FUNCTIONS OF THE NETWORK
`VEHICLE
`
`The main features of the Network Vehicle are
`
`manifested in the following three areas: (1) Driving
`Aids.
`(2} Business Tools,
`and (3) News
`and
`Entertainment. The Network Vehicle is designed
`such that, through software upgrades the Customer
`can be provided with new features and functions as
`they become available.
`
`Driving Aids - Get Where You're Going Efficiently
`- The Network Vehicle can access a simulated
`
`integrated global positioning system and hence
`advanced
`navigation
`capabilities
`via
`Internet.
`Therefore, it literally knows where it is and where it's
`going.
`it can display the appropriate maps or simply
`provide route directions on the head—up display,
`command console or as spoken instructions. Drivers
`could control the navigation system using commands
`like “destination" to select a new destination or ”route
`
`turn-by-tum instructions.
`guidance” to get
`example of such a display is shown in Figure 6.
`
`An
`
`Ennrh 1mnr
`
`-
`
`.
`
`
`
`AuroWeb IL—'-4Iicnmistrul'l
`
`SLIHW' 11.21.
`
`\TIMEJJEI'J
`
`lat-19331:
`
`Figure 6. Example of a Navigation Function Display
`
`if you think you left the Network Vehicle's doors
`unlocked or the lights on. just visit the vehicle web
`site from your home of office computer to check. then
`fix the problem remotely. The Network Vehicle's
`future remote control capabilities could not only allow
`you to actually start the vehicle in the parking lot from
`the office, but to even set the heater or air conditioner
`from your office computer. so that the vehicle is
`
`comfortable and ready to roll when you are. You
`could even plan trips on the vehicle web site, then
`download them to your vehicle. Figure 7 shows an
`example page of the vehicle web site where control
`parameters can be set.
`
`
`
`
`Figure 7. Example of a Vehicle Web Site Page for
`Remote Monitoring and Control
`
`Business Tools - You’re Never Out of Touch -
`The Network Vehicle is on the Web, with a DirecPC
`satellite link beaming the Internet to the vehicle at
`400 kbps, more than 15 times the speed of a
`standard 28.8 kbps modem. Web sites can be
`viewed on the color reconfigurable displays at each
`of
`the three paSsenger seats. and the Network
`Vehicle can download selected information to the
`
`driver such as maps for navigation.
`
`The Network Vehicle is an extension of your
`office, seamlessly offering access to everything from
`e-mail and address book to the critical files you need.
`The driver can be alerted to new e-mail via the head-
`
`up display and can ask the vehicle to read e-mail.
`With voice commands, a to—do list can be called up
`from the
`docked Workpad.
`E-mails
`and
`appointments can be downloaded to the docked
`Workpad FDA. for review after leaving the vehicle.
`In
`the future,
`the Network Vehicle will be able to
`communicate pages and play voice mail. The driver
`will be able to use voice commands to call up a
`personal address book, then dictate e—mail messages
`which the vehicle can turn into text and send.
`
`Passengers will be able to view faxes on their LCD
`displays.
`
`fully
`cell phone is
`The Network Vehicle's
`integrated with other systems, so a simple voice
`command tells the phone to dial any number. The
`Network Vehicle uses its own in-vehicle audio system
`as
`a
`speakerphone,
`allowing
`hands-free
`conversations.
`
`7
`
`

`

`News and Entertainment - Getting There is More
`Than Half the Fun — Via the DirecTV satellite link,
`passengers will be able to view hundreds of
`broadcast and cable channels. Each passenger can
`watch a different channel at the same time, with
`headsets to keep the noise level
`to a minimum.
`Using the Network Vehicle web site, you can
`preprogram your favorite channels and showa.
`In the
`future, the Network Vehicle will include a DVD player
`so you'll be able to watch the latest movies on disc.
`
`The Network Vehicle offers AM/FM radio. a CD
`player and audio from the Internet, all accessible with
`voice commands.
`From the Network Vehicle web
`
`site, one can program personal radio presets. Or,
`take advantage of various capabilities on the lntemet.
`such as downloadable audio books, or audio-on-
`demand for an infinite choice of music selections or
`radio stations worldwide that are now broadcasting
`over the Web. Each passenger can also use an LCD
`display to watch movies, surf the Net or play the
`latest
`computer
`games.
`Using Netscape
`Communicator. the Network Vehicle will allow you to
`speak “Read Stocks" and hear the current value of
`each stock in your portfolio.
`In the future. the vehicle
`will read you the latest news from Web sites, or
`provide customized newe from the vehicle web site.
`
`CONCLUSION
`
`The Network Vehicle has proven that by
`properly integrating several existing functions and
`technologies one can get a good glimpse of what the
`future of mobile multimedia holds. The range of
`applications enabled by the availability of wideband
`communications
`to
`the
`car
`is
`enormous.
`
`Reconfigurable displays and upgradable software will
`allow vehicle owners to take advantages of the latest
`applications and services. However,
`to make this
`vision a reality. a great deal of improvement and
`development
`is
`still needed.
`For example, an
`affordable
`and
`robust mobile
`satellite
`tracking
`It
`antenna system is yet to be realized.
`is clear
`though, the integration of computer, communications,
`and software technologies with vehicles will have a
`dramatic impact on the future of automotive industry.
`
`8
`
`