`
`References Cited
`
`
`U.S. PATENT DOCUMENTS
`
`
`
`2/1986 Tachi et al.
`........................... .. 701/202
`4,570,227
`
`
`
`
`
`7/1987 'l'sujii et al.
`........................ .. 701/211
`4,679,147
`
`
`
`
`
`11/1989 Nimura et al.
`,. 701/211
`4,882,696
`.
`
`
`
`
`11/1991 Person
`5,067,081
`701/202
`
`
`
`
`1/1993 Davis ct al.
`5,177,685
`.. 701/200
`
`
`
`
`
`
`
`4/1995 Kishi et al.
`5,410,486
`.. 701/211
`
`
`
`
`
`
`9/1995 Yokoyama et a1.
`5,452,212
`.. 701/211
`
`
`
`
`
`5,463,554 10/1995 Araki et a1.
`...... ..
`.. 701/211
`
`
`
`
`
`
`
`12/1995 Yokoyama et a1.
`5,475,599
`................... .. 701/211
`
`
`
`
`
`
`OTHER PUBLICATIONS
`
`
`Abstract—Driver performance results from the travtek
`
`
`
`
`
`IVHS camera car evaluation study, 1994.
`
`
`
`
`
`
`AbstractiDesign of TraVek auditory interface, 1992.
`
`
`
`
`
`Abstract—Pathfinder status and implementation experience,
`
`
`
`
`1991.
`
`AbstractiAutomobile navigation information systems.
`
`
`
`
`Legacy of the ancient Chinese south—pointing chariot, 1990.
`
`
`
`
`
`
`
`Abstract—Dynamic route guidance and interactive transport
`
`
`
`
`
`
`management with ALI—SCOUT, 1991.
`
`
`
`
`Abstract—Route Guidance System for Automobile Drivers
`
`
`
`
`
`by Speech Synthesis, 1987.
`
`
`
`
`Abstract—An Electronic Traffic Pilot for Motorists, 1986.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[54] PORTABLE SYSTEM FOR PROVIDING
`
`
`
`
`
`VOICE DRIVING DIRECTIONS
`
`
`
`
`[75]
`
`
`Inventors: Karen I. Trovato, Putnam Valley;
`
`
`
`
`
`Daniel L. Pelleticr, Peekskill, both of
`
`
`
`
`N.Y.
`
`
`[73] Assignee: Philips Electronics North America
`
`
`
`
`
`Corporation, New York, NY.
`
`
`
`
`
`
`
`[21] Appl, No.: 587,266
`
`
`
`
`[22]
`Filed:
`Jan. 16, I996
`
`
`
`
`
`[51]
`Int. Cl.6 ................................................. .. G06F 165/00
`
`
`
`
`
`
`[52] U.S. Cl.
`........................... 701/211; 701/200; 340/988
`
`
`
`
`
`
`[58] Field of Search
`........................... .. 701/200, 201,
`
`
`
`
`
`
`701/202, 211, 212, 213, 208; 73/178 R;
`
`
`
`
`
`
`340/988, 990, 995
`
`
`
`
`[56]
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`TEXT T0
`
`
`VOICE
`CONVERTER
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[19]
`United States Patent
`
`
`
`[11] Patent Number:
`5,835,881
`
`Trovato et al.
`
`
`
`
`
`
`
`
`[45] Date of Patent:
`Nov. 10, 1998
`
`U8005835881A
`
`
`
`Abstract—RMSI: the Microsystems’robot. I. Speech ree-
`
`
`
`
`
`ognition, May 1985.
`
`
`
`Abstract—‘Intelligent’ cars are already on the roads of
`
`
`
`
`
`
`
`
`Europe, AugnSep. 1983.
`
`
`
`“Communications: Teletrac’s Agenda for Location Network
`
`
`
`
`Includes IVHS Services”, Feb. 1, 1993.
`
`
`
`
`
`“Turn—0n, Tune—In to Latest Traffic News—Industries In
`
`
`
`
`
`Transition”, Apr. 1995.
`
`
`
`“Car Nav Points the Way to the Future—Japanese Market to
`
`
`
`
`
`
`
`
`Top Y2OO Billion by 1995”, apr. 1993.
`
`
`
`
`
`
`“Greek Start—Up Seeks Capital Infusion for Navigation Roll
`
`
`
`
`
`
`
`Out”, Mar. 1, 1993.
`
`
`
`
`
`
`
`
`
`
`(List continued on next page.)
`
`
`
`
`
`
`[57]
`
`Primary Examiner—Gary Chin
`
`
`
`Attorney, Agent,
`01‘ Firm—Anne E. Rarschall; Brian J.
`
`
`
`
`
`
`Wieghaus; David Schreiber
`
`
`
`ABSTRACT
`
`
`
`Atravel direction speaking system that is based on a portable
`
`
`
`
`
`
`
`laptop computer. The computer determines a route between
`
`
`
`
`
`
`
`an origin and a destination using an electronic map, and
`
`
`
`
`
`
`
`
`
`prepares driving instructions based on the route. Each driv—
`
`
`
`
`
`
`
`
`ing instruction includes the spatial position (longitude and
`
`
`
`
`
`
`
`
`latitude) of a change in direction at which the driving
`
`
`
`
`
`
`
`
`instruction applies. The system includes a Global Position—
`
`
`
`
`
`
`
`ing System (GPS) unit that provides the GPS determined
`
`
`
`
`
`
`
`
`
`position of the laptop computer. The computer compares the
`
`
`
`
`
`
`
`
`GPS position to the spatial position and outputs the corre—
`
`
`
`
`
`
`
`
`
`sponding driving instruction when the two positions are
`
`
`
`
`
`
`
`
`inferred to be Within a specified range of each other. The
`
`
`
`
`
`
`
`
`
`range can be determined based distance or on a time period
`
`
`
`
`
`
`
`required to travel from the current position to a position at
`
`
`
`
`
`
`
`which the instructions should be spoken. The time period
`
`
`
`
`
`
`
`
`accounts for the amount of time required to speak the
`
`
`
`
`
`
`
`
`
`directions, for the reaction time of the driver at the speed that
`
`
`
`
`
`
`
`
`
`
`the laptop computer is moving Within a vehicle and for an
`
`
`
`
`
`
`
`
`
`error in position associated with GPS commercial systems.
`
`
`
`
`
`
`
`When the time period has elapsed the directions are spoken.
`
`
`
`
`
`
`
`
`
`The system also includes a text to voice unit that converts
`
`
`
`
`
`
`
`
`
`the text driving instructions into a voice signal.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Page 1 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`5,835,881
`Page 2
`
`
`US. Application Entitled: Differential Budding: Method and
`
`
`
`
`
`
`Apparatus for Path Planning With Moving Obstacles and
`
`
`
`
`
`
`
`Goals, Ref. No. 1504—0384.
`
`
`
`
`US. Application Entitled: Method and Apparatus for Path
`
`
`
`
`
`
`
`Planning, Ref. No. 1504—0355.
`
`
`
`
`
`
`
`
`
`
`US. Application Entitled: Improved Very Long Instruction
`Word Processor Architecture, Ref. No. 1504—0689.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`OTHER PUBLICATIONS
`
`
`
`“Navigation: Boston Startup Aims Navigation System At
`
`
`
`
`
`
`Commercial Markets”, Jun. 21, 1993.
`
`
`
`
`
`“Smart Car Passes Test”, Apr. 19, 1993.
`
`
`
`
`
`
`
`“AT&T, Lockheed Become Latest Strategic Partners”, Apr.
`
`
`
`
`
`
`27, 1992.
`
`“Toyota’s GPS Voice Navigation System”, Jul. 1992.
`
`
`
`
`
`
`
`
`
`
`
`Page2 of 12
`
`Unified Patents Exhibit 1005
`
`Page 2 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`US. Patent
`
`
`
`Nov. 10,1998
`
`Sheet 1 0f5
`
`5,835,881
`
`
`
`
`
`
`
`TEXT T0
`VOICE
`CONVERTER
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`109
`
`
`
`
`
`
`LONG.
`
`
`
`
`
`
`
`
`
`
`
`ASCII TEXT
`
`
`
`PHONETIC REPRESENTATION
`
`
`
`
`
`
`
`
`SPEAKINGTIME
`
`
`
`
`
`Page 3 of 12
`
`Unified Patents Exhibit 1005
`
`Page 3 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`US. Patent
`
`
`
`
`
`Nov. 10,1998
`
`
`Sheet 2 0f5
`
`
`
`5,835,881
`
`
`
`
`
`‘ 304
`
`
`
`
`
`310
`
`
`
`A
`
`302
`
`312
`
`300
`
`
`301
`
`
`
`
`
`305
`
`319
`
`
`
`
`FIG. 3(a)
`
`
`
`Page 4 of 12
`
`Unified Patents Exhibit 1005
`
`Page 4 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`US. Patent
`
`
`
`
`Nov. 10,1998
`
`
`
`
`Sheet 3 0f5
`
`
`
`5,835,881
`
`
`
`320
`
`FIG. 3(b)
`
`Page 5 of 12
`
`Unified Patents Exhibit 1005
`
`Page 5 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`US. Patent
`
`
`
`
`
`Nov. 10,1998
`
`
`Sheet 4 0f5
`
`
`
`5,835,881
`
`
`
`
`
`
`FIG. 3(6)
`
`
`
`Page 6 of 12
`
`Unified Patents Exhibit 1005
`
`Page 6 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`US. Patent
`
`
`
`
`
`Nov. 10,1998
`
`
`Sheet 5 0f5
`
`
`
`5,835,881
`
`
`
`
`
`ENTER ORIGIN
`
`AND DESTINATION
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`GPS READING
`
`ELAPSED TIME
`COMPARISON
`
`
`
`YES
`
`
`
`
`
`
`SPEAK
`
`
`
`SET POINT
`
`DIRECTIONS
`
`
`
`SET POINT
`
`EQUAL
`DESTINATION
`
`
`
`416
`
`
`
`
`
`Page 7 of 12
`
`Unified Patents Exhibit 1005
`
`402
`
`
`COMPUTE PATH
`OF SET POINTS
`
`
`
`
`
`
`
`
`
`
`
`
`
`STORE SET POINTS
`
`
`
`
`
`
`
`
`GET NEXT
`
`
`SET POINT
`
`
`
`418
`
`
`
`
`
`
`
`
`
`
`DETERMINE
`CURRENT
`
`
`POSITION
`
`AS ORIGIN
`
`
`
`
`
`Page 7 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`5,835,881
`
`
`
`2
`
`It is also an object of the present invention to allow the
`
`
`
`
`
`
`
`
`
`
`system to report progress along a route to a central station by
`
`
`
`
`
`
`
`indicating that various points along the route have been
`
`
`
`
`
`
`
`
`
`reached.
`
`The above objects can be attained by a system that is
`
`
`
`
`
`
`
`
`
`
`based on a portable laptop computer. The computer deter-
`
`
`
`
`
`
`
`mines a route between an origin and a destination using an
`
`
`
`
`
`
`
`electronic map. The computer prepares driving instructions
`
`
`
`
`
`
`
`based on the route with each driving instruction including
`
`
`
`
`
`
`
`
`the spatial position (longitude and latitude) of the turn at
`
`
`
`
`
`
`
`
`
`which the driving instruction applies. The system includes a
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Global Positioning System (GPS) unit that provides the GPS
`determined position of the laptop computer. The computer
`
`
`
`
`
`
`
`compares the GPS reading to the spatial position or setpoint
`
`
`
`
`
`
`
`
`and outputs the instruction when the two positions are within
`
`
`
`
`
`
`
`
`
`a specified range of each other. The range can be determined
`
`
`
`
`
`
`
`
`
`based on a time period required to travel from the current
`
`
`
`
`
`
`
`
`position to a position associated with a speech initiation
`
`
`
`
`
`
`
`point at which the instructions should be spoken. The time
`
`
`
`
`
`
`
`
`period accounts for the amount of time required to speak the
`
`
`
`
`
`
`
`
`
`directions, for the reaction time of the driver at the speed that
`
`
`
`
`
`
`
`
`
`
`the laptop computer
`is moving. The time period also
`
`
`
`
`
`
`
`
`accounts for the time to carry out the desired maneuver of
`
`
`
`
`
`
`
`
`
`the car at the speed and for an associated buffer time or
`
`
`
`
`
`
`
`
`
`
`
`distance which can be fixed or variable based on speed and
`
`
`
`
`
`
`
`
`is designed to allow for changes in driving conditions, road
`
`
`
`
`
`
`
`
`conditions, personal preference, etc. The speaking point
`
`
`
`
`
`
`
`accounts for an error in position associated with GPS. The
`
`
`
`
`
`
`
`
`
`speaking point is an inferred position of the system at which
`
`
`
`
`
`
`
`
`the instructions should be spoken. The time period and the
`
`
`
`
`
`
`
`
`
`associated speaking point time/distance can also be used to
`
`
`
`
`
`
`
`determine a distance from the setpoint point which is
`
`
`
`
`
`
`
`compared to the current position to trigger the speaking of
`
`
`
`
`
`
`
`the directions. The system also includes a text to voice unit
`
`
`
`
`
`
`
`
`
`that converts the text driving instructions into a voice signal.
`
`
`
`
`
`
`
`
`
`These together with other objects and advantages which
`
`
`
`
`
`
`
`
`will be subsequently apparent,
`reside in the details of
`
`
`
`
`
`
`
`
`
`construction and operation as more fully hereinafter
`
`
`
`
`
`
`
`described and claimed, reference being had to the accom-
`
`
`
`
`
`
`
`
`panying drawings forming a part hereof, wherein like
`
`
`
`
`
`
`
`numerals refer to like parts throughout.
`
`
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`
`
`
`
`
`1
`
`PORTABLE SYSTEM FOR PROVIDING
`
`
`
`
`VOICE DRIVING DIRECTIONS
`
`
`
`BACKGROUND OF THE INVENTION
`
`
`
`1. Field of the Invention
`
`
`
`
`The present invention is directed to a portable system for
`
`
`
`
`
`
`
`providing voice or audio driving directions and, more
`
`
`
`
`
`
`
`
`particularly, to a portable laptop computer based system that
`
`
`
`
`
`
`
`creates a set of driving directions that
`includes spatial
`
`
`
`
`
`
`
`
`indicators of the points at which the driving direction should
`
`
`
`
`
`
`
`change, monitors the current position and the time or dis-
`
`
`
`
`
`
`
`
`
`tance to a position at which the instructions should be issued
`
`
`
`
`
`
`and estimates or infers a time that voice instructions should
`
`
`
`
`
`
`
`
`begin in advance of the points of direction change.
`
`
`
`
`
`
`2. Description of the Related Art
`
`
`
`
`
`
`
`
`
`
`
`
`Systems currently exist that provide driving directions.
`Some of these systems are fixed base or position systems
`
`
`
`
`
`
`
`
`that print out a set of driving directions when the user enters
`
`
`
`
`
`
`
`
`
`an origin and a destination. Other systems are included in
`
`
`
`
`
`
`
`
`vehicles. These systems typically cannot be hand carried
`
`
`
`
`
`
`
`
`from vehicle to vehicle, that is, they are not hand portable.
`
`
`
`
`
`
`
`
`
`
`Such vehicle based systems also typically provide directions
`
`
`
`
`
`
`
`
`in the form of a route map displayed for review by the driver.
`
`
`
`
`
`
`
`
`
`The systems receive position information from Global Posi-
`
`
`
`
`
`
`
`
`tioning System devices and dead-reckoning devices attached
`
`
`
`
`
`
`
`to a vehicle transmission. These systems require that the
`
`
`
`
`
`
`
`
`current location be matched precisely to the map using GPS
`
`
`
`
`
`
`
`
`and dead reckoning. At each turning point
`the user is
`
`
`
`
`
`
`
`
`
`
`notified. Other systems are available that do not plan routes
`
`
`
`
`
`
`
`
`
`but that show route progress along an electronic map.
`
`
`
`
`
`
`
`
`
`What is needed is a portable system that infers its own
`
`
`
`
`
`
`
`
`location and based on that inferred location provides verbal
`
`
`
`
`
`
`
`
`driving instructions sufficiently in advance of a change in
`
`
`
`
`
`direction that the driver has enough time to listen to the
`
`
`
`
`
`
`
`
`
`
`instructions and make the change in direction.
`
`
`
`
`
`SUMMARY OF THE INVENTION
`
`
`
`It is an object of the present invention to provide a hand
`
`
`
`
`
`
`
`
`
`portable device that can provide driving direction instruc-
`
`
`
`
`
`
`
`
`tions.
`
`It is another object of the present invention to provide a
`
`
`
`
`
`
`
`
`device that provides directions verbally.
`
`
`
`
`
`It is a further object of the present invention to provide a
`
`
`
`
`
`
`
`
`system that uses the estimated speed of travel, a predeter-
`
`
`
`
`
`
`
`
`mined drivers reaction time, a time for speaking the driving
`
`
`
`
`
`
`
`
`
`instruction message and a time for positional error to pro-
`
`
`
`
`
`
`
`
`vide the instructions in advance of a turn.
`
`
`
`
`
`invention to
`is an additional object of the present
`It
`
`
`
`
`
`
`
`
`
`
`indicate to the user that the user is off track or not on the
`
`
`
`
`
`
`
`
`
`
`path/route to the destination.
`
`
`
`It is an object of the present invention to compute a time
`
`
`
`
`
`
`
`
`
`at which instructions should be spoken, which is translated
`
`
`
`
`
`
`
`into distance providing a target point around which a GPS
`
`
`
`
`
`
`
`
`error radius is calculated which radius is called a speech
`
`
`
`
`
`
`
`radius and when a point, a speech initiation point, on the
`
`
`
`
`
`
`
`
`
`radius is reached, there is enough time to speak the direc-
`
`
`
`
`
`
`
`
`tions sufficiently in advance of the turn to allow the driver
`
`
`
`
`
`
`
`
`to make the turn.
`
`
`
`It is another object of the present invention to allow the
`
`
`
`
`
`
`
`
`
`entry of origin and destination which are transmitted to a
`
`
`
`
`
`
`
`
`remote computer that generates and downloads driving
`
`
`
`
`
`
`
`instructions and targets and optionally all driving segments
`
`
`
`
`
`
`
`
`with road type and speed limits between the origin and
`
`
`
`
`
`
`
`
`
`
`destination, allowing the route to incorporate current-real
`
`
`
`
`
`
`
`time traffic information.
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`25
`
`
`
`30
`
`35
`
`
`
`40
`
`45
`
`
`
`50
`
`55
`
`
`
`60
`
`65
`
`
`
`FIG. 1 depicts the components of the present invention.
`
`
`
`
`
`
`
`FIG. 2 depicts a typical data structure or database used in
`
`
`
`
`
`
`
`the present invention.
`
`
`
`FIGS. 3(a)—3(c) depict example routes.
`
`
`
`
`
`FIG. 4 depicts the flow of operation of the system of the
`
`
`
`
`
`
`
`present invention.
`
`
`DESCRIPTION OF THE PREFERRED
`
`
`EMBODIMENTS
`
`
`
`
`
`
`
`The system 100 of the present invention is based on a
`
`
`
`
`
`
`
`typical portable laptop type computer system 102, such as
`
`
`
`
`
`
`
`
`illustrated in FIG. 1. Such systems 102 are produced by a
`
`
`
`
`
`
`
`
`number of companies and typically include a central pro-
`
`
`
`
`
`
`
`cessor 104 with an associated real time clock, a display 106,
`
`
`
`
`
`
`
`
`
`a keyboard (not shown), an audio unit 107 that includes a
`
`
`
`
`
`
`
`
`
`digital-to-analog converter and a speaker, and various types
`
`
`
`
`
`
`
`of memories 108, 109, 110, 112 and 114 connected to a
`
`
`
`
`
`
`
`
`
`system bus 116. The process databases described herein can
`
`
`
`
`
`
`
`
`
`be stored in the RAM 110, ROM 112, the hard disk 114 or
`
`
`
`
`
`
`
`
`
`a floppy disk or other portable media associated with a
`
`
`
`
`
`
`
`
`
`portable media device, such as the floppy disk drive 108 or
`
`
`
`
`
`
`
`
`
`CD ROM drive 109 or a PCMCIA flash card (not shown).
`
`
`
`
`
`
`
`
`
`
`Page 8 of 12
`
`Unified Patents Exhibit 1005
`
`Page 8 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`
`
`
`
`
`4
`
`available from a number of producers including Navigation
`
`
`
`
`
`Technologies of Sunnyvale, Calif. US. Pat. No. 4,949,277
`
`
`
`
`
`
`also describes how to determine a path.
`
`
`
`
`
`The text instructions and the corresponding spatial posi-
`
`
`
`
`
`
`
`
`tions are preferably provided in a searchable data structure
`
`
`
`
`
`
`
`or database 200, such as the array illustrated in FIG. 2. This
`
`
`
`
`
`
`
`
`
`database 200 stores the text 202 of the driving instructions,
`
`
`
`
`
`
`
`
`
`like the text set forth above, and stores the longitude 204 and
`
`
`
`
`
`
`
`
`
`
`
`
`latitude 206 of the spatial positions of the turns or setpoints
`
`
`
`
`
`
`
`
`associated with the directions as well as of the origin and
`
`
`
`
`
`
`
`
`
`
`destination. The database 200 also preferably stores the
`
`
`
`
`
`
`
`
`phonetic representation 208 that is the equivalent of the text
`
`
`
`
`
`
`
`
`instructions which can be conventionally obtained from the
`
`
`
`
`
`
`
`text using a text to phonetic conversion system. The instruc-
`
`
`
`
`
`
`
`
`tions can also be based on “canned” speech downloaded
`
`
`
`
`
`
`
`
`
`from a remote computer or a stored database of the laptop.
`
`
`
`
`
`
`
`The phonetic representation can then be converted into an
`
`
`
`
`
`
`
`
`audio voice signal that can be broadcast or made audible by
`
`
`
`
`
`
`
`
`a speaker. The database 200 preferably includes a speaking
`
`
`
`
`
`
`
`
`time variable 210 that indicates the time required for speak-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ing the corresponding text using the corresponding phonetic
`representation. Other types of data structures, such as a
`
`
`
`
`
`
`
`linked list, or databases can also be used. The database 200
`
`
`
`
`
`
`
`
`
`
`can also be used as temporary storage for the variables that
`
`
`
`
`
`
`
`
`
`are determined in the process of the present invention.
`
`
`
`
`
`
`
`Before discussing the process performed by the present
`
`
`
`
`
`
`
`invention the conventions or definitions of various points
`
`
`
`
`
`
`
`along a route will be discussed. In the following discussion
`
`
`
`
`
`
`
`distance/time will be referenced. This flexible terminology
`
`
`
`
`
`
`is necessary because the instant during a trip at which a
`
`
`
`
`
`
`
`
`
`particular driving instruction is spoken can be inferred based
`
`
`
`
`
`
`
`on either a time period required to reach a set point or turn
`
`
`
`
`
`
`
`
`
`or on a distance from the setpoint. Whenever the fixed or
`
`
`
`
`
`
`
`
`
`variable parameter is time, the distance traveled in the time
`
`
`
`
`
`
`
`
`period can be calculated based on the current or posted speed
`
`
`
`
`
`
`
`on route. Whenever the parameter is distance, the time of
`
`
`
`
`
`
`
`
`
`travel can also be calculated based on the current or posted
`
`
`
`
`
`
`
`
`speed. The current speed can be estimated from the time and
`
`
`
`
`
`
`
`
`
`
`distance between the two GPS readings, preferably the most
`
`
`
`
`
`
`
`
`recent two. More complicated methods can also be used to
`
`
`
`
`
`
`
`
`determine the speed, for example, the average of the elapsed
`
`
`
`
`
`
`
`
`
`time of the two prior segments. And outliers can be dis-
`
`
`
`
`
`
`
`
`
`
`
`carded in this way.
`
`
`
`FIG. 3(a) depicts a section 300 of a typical route 301
`
`
`
`
`
`
`
`
`determined by a navigation package. The direction of travel
`
`
`
`
`
`
`is indicated by arrows 302. The route 300 includes a turn (a
`
`
`
`
`
`
`
`
`
`right turn) at setpoint 304. This is a point on the route 300
`
`
`
`
`
`
`
`
`
`at which the driver must change directions and for which a
`
`
`
`
`
`
`
`
`
`
`direction change instruction is provided by the navigation
`
`
`
`
`
`
`package. The longitude and latitude of the setpoint 304 is
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`also provided by the navigation package. The point (speech
`point) at which the direction change instruction associated
`
`
`
`
`
`
`
`with the setpoint 304 are to be spoken can be determined in
`
`
`
`
`
`
`
`
`a number of different ways. FIG. 3(a) depicts a method in
`
`
`
`
`
`
`
`
`which the point at which an instruction is spoken is deter-
`
`
`
`
`
`
`
`mined by traversing the route backwards along the path of
`
`
`
`
`
`
`
`
`travel. A target point 306 is determined by combining a
`
`
`
`
`
`
`
`distance/time 308 required for the driver to react to the
`
`
`
`
`
`
`
`
`
`
`instructions, a distance/time 310 required for speaking the
`
`
`
`
`
`
`
`instructions (see 210 of FIG. 2) and a distance/time 312
`
`
`
`
`
`
`
`which provides a buffer for variations in road conditions,
`
`
`
`
`
`
`
`time of day, driver comfort, etc. as defined by the user. The
`
`
`
`
`
`
`
`
`
`
`reaction time can include the time it takes a user to prepare
`
`
`
`
`
`
`
`
`
`for a turn and can be a function of the expected turn type and
`
`
`
`
`
`
`
`
`
`
`road classification. For example, a right turn from an inter-
`
`
`
`
`
`
`
`
`state highway may require more time for preparation than a
`
`
`
`
`
`
`
`
`
`right turn on a neighborhood street. The reaction time can be
`
`
`
`
`
`
`
`
`
`10
`
`
`
`15
`
`
`
`20
`
`
`
`25
`
`
`
`30
`
`
`
`35
`
`
`
`40
`
`
`
`45
`
`
`
`50
`
`
`
`55
`
`
`
`60
`
`
`
`65
`
`
`
`Navigation packages such as those described above can also
`
`
`
`
`
`
`
`
`generate the spatial positions, particularly the longitude and
`
`
`
`
`
`
`
`
`latitude, of the map positions where a change in direction or
`
`
`
`
`
`
`
`a turn is located. They can also generate spatial position or
`
`
`
`
`
`
`
`
`
`progress points along the route. Such packages are readily
`
`
`
`
`
`
`
`
`
`
`Page 9 of 12
`
`Unified Patents Exhibit 1005
`
`5,835,881
`
`
`3
`Various types of plug in units, as well as the software needed
`
`
`
`
`
`
`
`
`to use the units, are available for laptop computers. The
`
`
`
`
`
`
`
`
`
`
`present invention, in addition to the typical laptop compo-
`
`
`
`
`
`
`
`nents noted above, includes a conventional PCMCIA GPS
`
`
`
`
`
`
`
`unit 118, such as available from Rockwell International, that
`
`
`
`
`
`
`
`
`provides the longitude and latitude of the unit 118 and the
`
`
`
`
`
`
`
`
`
`
`
`current time based on signals from global positioning sat-
`
`
`
`
`
`
`
`
`ellites. The present invention also includes a conventional
`
`
`
`
`
`
`
`text to voice converter 120. The converter 120 is preferably
`
`
`
`
`
`
`
`
`an integrated voice synthesizer which is part of the laptop
`
`
`
`
`
`
`
`
`102 when it
`is produced. Of course the laptop can be
`
`
`
`
`
`
`
`
`
`
`produced with both the GPS unit 118 and the converter 120
`
`
`
`
`
`
`
`
`
`
`
`if desired. The system 100 can also transmit the current
`
`
`
`
`
`
`
`
`
`
`status, including the set points that have been reached to a
`
`
`
`
`
`
`
`
`
`central station using the transmitter which is useful in traffic
`
`
`
`
`
`
`
`
`control.
`
`Although not shown, it is possible for the laptop 102 to
`
`
`
`
`
`
`
`
`
`include a transmitter and a receiver, such as a cell phone
`
`
`
`
`
`
`
`with modem or a radio link like ARDIS, that can be used to
`
`
`
`
`
`
`
`
`
`send an origin and destination to a central traffic computer.
`
`
`
`
`
`
`
`The computer will determine a route based on current or real
`
`
`
`
`
`
`
`
`time traffic conditions, prepare appropriate driving instruc-
`
`
`
`
`
`
`
`tions with turn or set points and download the instructions,
`
`
`
`
`
`
`
`
`
`etc. to the laptop system 102.
`
`
`
`
`
`
`The system 100 also includes a conventional point to
`
`
`
`
`
`
`
`
`point software navigation package (a program and an elec-
`
`
`
`
`
`
`
`tronic map database) of the type that can determine a route
`
`
`
`
`
`
`
`
`
`between an origin and a destination. These packages typi-
`
`
`
`
`
`
`
`cally produce text driving instructions such as those set forth
`
`
`
`
`
`
`
`
`
`below.
`
`
`Your Route from:
`
`
`
`345 Scarborough Road, BRIARCLIFF MANOR, NY
`To:
`
`
`
`
`
`
`91 AMSTERDAM AVE, MANHATTAN, NY
`
`
`
`
`About 31.2 miles, 56 minutes.
`
`
`
`
`
`
`Total
`Miles Directions
`
`0.0 Start out going South on SCARBOROUGH RD
`towards LONG HILL RD W.
`
`
`
`
`
`
`Drive 1.0 mi es.
`
`
`
`Turn LEFT onto ALBANY POST RD.
`
`
`
`Drive 2.0 mi es.
`
`
`
`
`
`
`ALBANY POST RD becomes N BROADWAY
`
`
`
`Drive 3.3 mi es.
`
`
`
`
`
`
`
`Take the I-287 EAST/I-87 SOUTH ramp.
`Drive 2.2 mi es.
`
`
`
`
`
`
`
`
`
`Take the SAW MILL RIVER PKWY SOUTH exit, exit
`number 7A.
`
`
`
`
`
`
`
`
`
`Drive 10.2 miles.
`
`
`SAW MILL {IVER PKWY SOUTH RAMP becomes
`
`
`
`HENRY HUDSON PKY.
`
`
`
`
`
`
`
`Drive 9.9 mi es.
`
`
`
`Take the exit toward 96 ST.
`
`
`
`Drive 0.3 mi es.
`
`
`
`
`
`
`
`
`Merge onto HENRY HUDSON PKY.
`Drive a short distance.
`
`
`
`
`
`Take the W 96TH ST EAST RAMP exit.
`
`
`
`Drive 0.3 mi es.
`
`
`
`
`Turn RIGHT onto BROADWAY.
`
`
`
`Drive 1.8 mi es.
`
`
`
`
`Turn RIGHT onto W 62ND ST.
`
`
`
`Drive 0.2 mi es.
`
`
`
`Turn RIGHT onto AMSTERDAM AVE.
`
`
`
`Drive 0.1 mi es to 91 AMSTERDAM AVE.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1.0
`
`
`
`3.0
`
`6.3
`
`
`
`8.5
`
`
`18.7
`
`
`28.5
`28.8
`
`
`
`28.9
`
`29.1
`
`30.9
`
`31.2
`
`
`
`
`1)
`
`
`
`2)
`
`3)
`
`4)
`
`5)
`
`
`
`
`
`
`
`
`
`6)
`
`
`
`7)
`
`
`
`8)
`
`9)
`
`
`
`
`
`Page 9 of 12
`
`Unified Patents Exhibit 1005
`
`
`
`5,835,881
`
`
`
`
`6
`The process 400 starts with a step 402 of determining the
`
`
`
`
`
`
`
`
`
`origin and destination. The destination is entered by the user
`
`
`
`
`
`
`
`while the origin can be entered by the user or estimated by
`
`
`
`
`
`
`
`
`obtaining a current spatial position or reading from the GPS
`
`
`
`
`
`
`
`
`unit 118 and finding the map location of the spatial position
`
`
`
`
`
`
`
`
`
`
`in the electronic map. Because the commercial GPS includes
`
`
`
`
`
`
`
`
`
`the built in error in position determination, if the GPS is used
`
`
`
`
`
`
`
`
`to determine the origin the user should be allowed to confirm
`
`
`
`
`
`
`
`
`
`that the origin is correct and allowed to enter a correction.
`
`
`
`
`
`
`
`
`Once the origin and destination are known, in the next step
`
`
`
`
`
`
`
`
`
`
`404, a path or route between the two points is conventionally
`
`
`
`
`
`
`
`determined. This route includes direction change points and
`
`
`
`
`
`
`
`
`the spatial positions or set points of the direction change
`
`
`
`
`
`
`
`
`
`
`points. These set points, along with the directions are stored,
`
`
`
`
`
`
`
`
`
`
`in a database, such as that illustrated in FIG. 2.
`
`
`
`
`
`
`
`Once the set points are stored the system then enters a
`
`
`
`
`
`
`
`
`
`
`loop in which determinations are made as to when to speak
`
`
`
`
`
`
`
`the directions.
`
`
`The first step 408 of the loop is to retrieve the next set
`
`
`
`
`
`
`
`
`
`
`
`point from the database 200. The information associated
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`with the setpoint includes (see FIG. 2) the spatial positions
`204 (longitude) and 206 (latitude), the ASCII text directions
`
`
`
`
`
`
`
`
`
`202, optionally the phonetic representation 208 and the time
`
`
`
`
`
`
`
`
`
`210 required to speak the instructions. In the first cycle
`
`
`
`
`
`
`
`
`
`through this loop this is the first set point of the array and in
`
`
`
`
`
`
`
`
`
`
`
`the second cycle it is the second set point, etc. That is, the
`
`
`
`
`
`
`
`
`
`
`
`system steps sequentially through the set points as they are
`
`
`
`
`
`
`
`
`
`encountered. The computer then monitors 410 the GPS
`
`
`
`
`
`
`
`
`position to determine if the driver has gotten off track. If
`
`
`
`
`
`
`
`
`
`off-track the system can determine 418 the current position
`
`
`
`
`
`
`
`
`
`as a new origin and return to the route determination step
`
`
`
`
`
`
`
`
`
`404. If not off-track, the GPS reading is compared 412 to
`
`
`
`
`
`
`
`
`determine whether speaking of the corresponding instruc-
`
`
`
`
`
`
`tions should be initiated. As noted above, this can be a
`
`
`
`
`
`
`
`
`
`
`comparison to the initiation point, a comparison to the
`
`
`
`
`
`
`distance (radius) from the target point or a comparison to the
`
`
`
`
`
`
`
`distance (radius) from the setpoint or a comparison to
`
`
`
`
`
`
`
`something in between. Because of the error in the GPS
`
`
`
`
`
`
`
`
`reading this is an inference that the instruction should be
`
`
`
`
`
`
`
`
`
`
`spoken.
`The use of distances to infer when to initiate the speaking
`
`
`
`
`
`
`
`
`of the instructions is one way in which the process of the
`
`
`
`
`
`
`
`
`
`invention can be performed. Adistance based process works
`
`
`
`
`
`
`
`well when the GPS is functioning. However, when the GPS
`
`
`
`
`
`
`
`is not functioning, such as when the satellites are obscured
`
`
`
`
`
`
`
`
`by tall buildings, the inference can be based on elapsed time.
`
`
`
`
`
`
`
`
`
`As previously discussed, it is possible to calculate the travel
`
`
`
`
`
`
`
`
`time required to travel from a spatial position determined
`
`
`
`
`
`
`
`based on a most recent GPS reading to the initiation point.
`
`
`
`
`
`
`
`
`This can be done using the posted speed or the most recent
`
`
`
`
`
`
`
`
`
`
`speed. It is also possible to determine an elapsed time since
`
`
`
`
`
`
`
`
`the last or most recent GPS reading using the real time clock.
`
`
`
`
`
`
`
`
`
`
`
`When the elapsed time exceeds the travel time, the system
`
`
`
`
`
`
`
`
`
`can infer that the initiation point has been reached and output
`
`
`
`
`
`
`
`
`
`
`
`the corresponding driving direction instruction.
`
`
`
`
`
`The determination as to when to speak the directions can
`
`
`
`
`
`
`
`also be made using the progress points by determining a
`
`
`
`
`
`
`
`
`
`target progress point at which the directions should be
`
`
`
`
`
`
`
`
`
`spoken and then comparing the GPS position to the target
`
`
`
`
`
`
`
`
`
`progress points along the route.
`
`
`
`
`
`As noted above, determinations made based on inferred
`
`
`
`
`
`
`
`distance and which require knowing the current position
`
`
`
`
`
`
`
`
`may not work well when the satellite signals are obscured.
`
`
`
`
`
`
`
`
`As a result, the time and distance inferences can be com-
`
`
`
`
`
`
`
`
`
`bined such that when the current position cannot be deter-
`
`
`
`
`
`
`
`
`mined the last current position can be used to determine the
`
`
`
`
`
`
`
`
`time at which the direction can be spoken.
`
`
`
`
`
`
`
`10
`
`15
`
`
`
`20
`
`25
`
`
`
`30
`
`35
`
`
`
`40
`
`45
`
`
`
`50
`
`55
`
`
`
`60
`
`65
`
`
`
`5
`
`set by the user, if desired, but it is expected that a standard
`
`
`
`
`
`
`
`
`
`25 seconds would be an acceptable reaction time. At the
`
`
`
`
`
`
`
`
`
`target point 306 an error radius 314 of distance/time is
`
`
`
`
`
`
`
`determined based on the maximum error in spatial position
`
`
`
`
`
`
`
`determination that
`is inherent
`in commercial GPS. The
`
`
`
`
`
`
`
`
`accuracy of the commercial GPS is about 100 meters and if
`
`
`
`
`
`
`
`
`the actual speed or speed limit is 30 meters per second the
`
`
`
`
`
`
`
`
`
`
`error is about 3.33 seconds. When the system 202 is posi-
`
`
`
`
`
`
`
`
`tioned within this radius 314 of the target point 306, the
`
`
`
`
`
`
`
`
`
`
`system 100 is considered as having reached the target point.
`
`
`
`
`
`
`
`
`If the system 100 is traveling along the route 301, the system
`
`
`
`
`
`
`
`
`
`
`
`100 will be within the circle 316 defined by the radius 314
`
`
`
`
`
`
`
`
`
`
`at which time the directions will start being output as a voice
`
`
`
`
`
`
`
`
`
`
`signal to the user.
`
`
`
`When the system is at a current position 318, the distance
`
`
`
`
`
`
`
`319 that the system 100 must travel from the current position
`
`
`
`
`
`
`
`
`
`
`318 to the circle 316, can be determined. From this distance
`
`
`
`
`
`
`
`
`
`and the estimated current speed, the time of travel between
`
`
`
`
`
`
`
`
`
`the current point 318 and the circle 316 can be determined
`
`
`
`
`
`
`
`
`
`
`and used with an elapsed time, determined with the laptop
`
`
`
`
`
`
`
`
`
`computer real time clock, to trigger the initiation of instruc-
`
`
`
`
`
`
`
`
`tion output.
`
`
`FIG. 3(b) depicts another way of determining the point at
`
`
`
`
`
`
`
`
`which the directions should be spoken. In this approach a
`
`
`
`
`
`
`
`section 320 of a route 322 with a left turn is shown when
`
`
`
`
`
`
`
`
`
`traveling in the direction of travel 324. The setpoint 326 (left
`
`
`
`
`
`
`
`
`
`turn) is the center of a radius 327 that includes reaction
`
`
`
`
`
`
`
`
`
`
`time/distance 3