`(12) Patent Application Publication (10) Pub. No.: US 2005/0065779 A1
`Odinak
`(43) Pub. Date:
`Mar. 24, 2005
`
`US 2005OO65779A1
`
`(54) COMPREHENSIVE MULTIPLE FEATURE
`TELEMATICS SYSTEM
`
`(76) Inventor: Gilad Odinak, Bellevue, WA (US)
`Correspondence Address:
`BLACKLOWE & GRAHAM, PLLC
`701 FIFTHAVENUE
`SUTE 4800
`SEATTLE, WA 98104 (US)
`(21) Appl. No.:
`10/910,801
`(22) Filed:
`Aug. 2, 2004
`O
`O
`Related U.S. Application Data
`(63) tip? application No. 09/884,854,
`Continuation-in-part of application No. 09/884,902,
`filed on Jun. 18, 2001.
`Continuation-in-part of application No. 09/955,476,
`filed on Sep. 17, 2001, now abandoned.
`Continuation-in-part of application No. 10,059,905,
`filed on Jan. 29, 2002.
`Continuation-in-part of application No. 10/689,504,
`filed on Oct. 21, 2003, which is a continuation of
`application No. 10/273,403, filed on Oct. 16, 2002,
`now Pat. No. 6,671,617, which is a continuation of
`application No. 09/884.856, filed on Jun. 18, 2001,
`now Pat. No. 6,487,494.
`Continuation-in-part of application No. 10/765,720,
`filed on Jan. 26, 2004, which is a continuation of
`application No. 10/076,027, filed on Feb. 12, 2002,
`now Pat. No. 6,748,244.
`Continuation-in-part of application No. 10/454,390,
`filed on Jun. 3, 2003, which is a continuation of
`application No. 09/955,475, filed on Sep. 17, 2001,
`now Pat. No. 6,591,168.
`
`Continuation-in-part of application No. 10/440,023,
`filed on May 16, 2003.
`Continuation-in-part of application No. 10/076,874,
`filed on Feb. 14, 2002.
`(60) Provisional application No. 60/280,375, filed on Mar.
`29, 2001. Provisional application No. 60/280,377,
`filed on Mar. 29, 2001. Provisional application No.
`60/278,454, filed on Apr. 2, 2001. Provisional appli
`cation No. 60/281.231, filed on Apr. 2, 2001. Provi
`sional application No. 60/280,376, filed on Mar. 29,
`2001. Provisional application No. 60/281.231, filed
`on Apr. 2, 2001. Provisional application No. 60/280,
`379, filed on Mar. 29, 2001. Provisional application
`No. 60/280,378, filed on Mar. 29, 2001. Provisional
`application No. 60/332,025, filed on Nov. 21, 2001.
`Provisional application No. 60/316,650, filed on Aug.
`31, 2001. Provisional application No. 60/381,142,
`filed on May 16, 2002. Provisional application No.
`60/345,939, filed on Oct. 26, 2001.
`Publication Classificati
`DCOSSCO
`(51) Int. C.7. G10L 19/00; HO4B 1/38
`(525 U.S.C. ....704,201
`
`(57)
`
`ABSTRACT
`
`A comprehensive System and method for telematics includ
`ing the following features individually or in Sub-combina
`tions: Vehicle user interfaces, telecommunications, speech
`recognition, digital commerce and vehicle parking, digital
`Signal processing, wireleSS transmission of digitized Voice
`input, navigational assistance for motorists, data communi
`cation to vehicles, mobile client-Server communication,
`extending coverage and bandwidth of wireleSS communica
`tion Services, and noise reduction.
`
`54
`
`LOOK UP ORIGIN
`OF SIGNAL IN
`DATABASE
`
`IS
`SIGNAL FROM
`ANASR
`SERVER2
`
`SEND ANASR
`SERVER CALL
`INFORMATION
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SEND CALLER
`IDENTIFICATION
`INFORMATION
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 1 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 1 of 39
`
`US 2005/0065779 A1
`
`
`
`FROM VEHICLESYSTEMS
`OR OTHER DEVICES
`
`MICROPHONE DISPLAY SPEAKER INTERFACE
`24
`26
`28
`
`PROCESSOR
`32
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 2 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 2 of 39
`
`US 2005/0065779 A1
`
`60
`
`RECEIVE
`PRESENTATION
`CONTENT
`
`IS THERE
`A VEHICLEEMERGENCY
`CONDITION?
`
`NOOUTPUT OF
`PRESENTATION
`CONTENT
`
`RECEIVE VEHICLE
`CONDITION
`INFORMATION
`
`
`
`OUTPUT OF PRESENTATION
`CONTENT BASED ON VEHICLE
`CONDITION INFORMATION
`(FIG 3)
`
`A2, 2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 3 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 3 of 39
`80
`
`US 2005/0065779 A1
`
`
`
`0<SPEED <= 25MPH
`
`VEHICLE
`SPEED2
`
`70<SPEED
`
`25<SPEED <= 40MPH
`
`
`
`40 <SPEED (= 70MPH
`
`DISPLAYIN
`DETAIL THE
`PRESENTATION
`CONTENT
`
`DISPLAYIN
`LESSER
`DETAL THE
`PRESENTATION
`CONTENT
`
`
`
`
`
`DISPLAY
`EVENLESS
`PRESENTATION
`CONTENTAND
`INCREASE TEXT
`FONTSIZE
`
`STOP DISPLAY
`OF ANY
`PRESENTATION
`CONTENTAND
`SENDAUDIO
`PORTIONS OF
`PRESENTATION
`CONTENT TO
`SPEAKERS
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 4 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 4 of 39
`
`US 2005/0065779 A1
`
`
`
`20
`
`30
`
`32
`
`TELEMATICS
`CONTROL UNIT
`
`
`
`
`
`WIRELESS
`COMMUNICATION
`NETWORK
`
`
`
`
`
`
`
`Fig. 21
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 5 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 5 of 39
`
`US 2005/0065779 A1
`
`DETECT PRESENCE OFA
`COMPATIBLEPHONE
`
`INFORM USER OF
`DETECTED PHONE
`
`I
`O)
`
`IO2
`
`ALLOWSELECTION OF DETECTED
`PHONEACCOUNTINFORMATION
`
`OBTAIN THE MOBILE SUBSCRIBER
`IDENTIFICATION NUMBER FROM
`THE DETECTED PHONE
`
`SEND THE MOBILE SUBSCRIBER
`IDENTIFICATION NUMBERTOA
`WIRELESS NETWORKACCESS
`AUTHORITY
`
`THE WIRELESS NETWORKACCESS
`AUTHORITY RETURNSAREQUEST
`FOR AUTHENTICATION TO THE
`EMBEDDED PHONE
`
`I04
`
`106
`
`18
`O
`
`110
`
`THE EMBEDDED PHONESENDS THE
`REQUEST FOR AUTHENTICATION TO
`THE DETECTED PHONE
`
`II2
`
`PERFORMAUTHENTICATION AND
`SENDA SESSION KEY TO THE
`EMBEDDED PHONE
`
`EMBEDDED PHONESENDS THE
`SESSION KEY TO THE WIRELESS
`NETWORKACCESSAUTHORITV
`
`THE WIRELESS NETWORKACCESS
`AUTHORITY BEGINS INTERACTION
`WITHEMBEDDED PHONE
`
`
`
`
`
`14
`
`II6
`
`118
`
`Fig. 22
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 6 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 6 of 39
`
`US 2005/0065779 A1
`
`
`
`26
`
`10
`
`?
`
`e OOOOOOO n
`
`H
`SERVER
`
`-
`
`
`
`16
`
`24- O
`4.
`USER UNIT
`
`TRANSMITTER 12
`
`as a
`
`s\s
`
`PROCESSOR
`IZ
`
`RECEIVER
`
`...
`
`24- O
`W
`
`USER UNIT
`
`DATABASE
`
`20
`
`Fig. 31
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 7 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 7 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`RECEIVE
`SIGNAL
`
`LOOK UP DESTINATION OF
`SIGNAL IN DATABASE TABLE
`OF PHONE NUMBERS
`
`34
`
`
`
`
`
`
`
`ASSOCATED
`DESTINATIONAN
`ASRSERVER2
`
`
`
`PROCESSSIGNAL
`ACCORDING TO
`ALGORITHM FOR ASR
`SERVER AND SEND TO
`DESTINATION
`
`
`
`PROCESSSIGNAL FOR HUMAN
`AUDITORY MEANS AND SEND
`TO DESTINATION
`(FIG. 3)
`
`Fig. 32
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 8 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 8 of 39
`
`US 2005/0065779 A1
`
`54
`
`LOOK UP ORIGIN
`OF SIGNAL IN
`DATABASE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IS
`SIGNAL FROM
`ANASR
`SERVER2
`
`
`
`SEND ANASR
`SERVER CALL
`INFORMATION
`
`SEND CALLER
`IDENTIFICATION
`INFORMATION
`
`Fig. 33
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 9 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 9 of 39
`
`US 2005/0065779 A1
`
`PROCESSA VOICE
`SIGNAL USING
`ALGORITHM FORASR
`SERVERS
`
`
`
`RECEIVE
`VOICE INPUT
`
`
`
`72
`
`74
`
`ISADDRESS
`ASSOCIATED WITH
`THE OUTBOUND VOICE
`SIGNAL FORASR
`SERVERSP
`
`
`
`
`
`
`
`
`
`PROCESS VOICESIGNAL FOR
`HUMAN AUDITORY MEANS
`
`78
`
`Fig. 34
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 10 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 10 of 39
`
`US 2005/0065779 A1
`
`(STARD
`
`
`
`PROCESSANOUTBOUND VOICE
`SIGNAL USINGALGORITHM
`FOR HUMAN AUDITORY MEANS
`
`SEND PROCESSED
`OUTBOUND VOICE
`SIGNAL TO RECIPIENT
`
`IF RECIPIENTIS ANASRSERVER, THE ASR
`SERVERSENDSA SIGNAL BACK TO THE SENDER
`INSTRUCTING THE PROCESSOR TOSWITCH TO A
`SPEECH RECOGNITIONALGORITHM
`
`94
`
`SWITCH TO PROCESS
`OUTBOUND VOICESIGNAL
`FORASRSERVERS
`
`Fig. 35
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 11 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 11 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`If ’5,
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 12 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 12 of 39
`
`US 2005/0065779 A1
`
`
`
`VEHICLE
`ENGINESTOPPED
`
`
`
`YES
`
`WEHICLE NOTIFIESSERVER THAT VEHICLESTOPPED
`AND PROVIDESSERVER WITH GPS COORDINATES
`
`SERVER DETERMINES VEHICLE
`LOCATION VIA GPS COORDINATES
`
`fr104
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SVEHICLE
`IN PAY PARKING
`LOCATION?
`
`MESSAGE AND
`RESETAFTER
`ENGINE RESTART
`
`DOES WEHICLE
`HAVEACCOUNT FOR
`LOCATION?
`
`MESSAGE AND
`RESETAFTER
`ENGINE RESTART
`
`YES
`
`SENDAMESSAGE TO THESERVER
`TO BEGIN BILLING CLOCK
`
`
`
`
`
`VEHICLE
`ENGINESTART
`
`YES
`
`SENDAMESSAGE TO THESERVER
`TO STOP BILLING CLOCK
`
`CHARGE VEHICLE
`OWNERSACCOUNT
`
`120
`
`
`
`Fig. 42
`
`UPDATESERVER WITH
`WEHICLE PARKING
`INFORMATION
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 13 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 13 of 39
`
`US 2005/0065779 A1
`
`ATTENDANT TRANSMITSIDENTIFICATION
`INFORMATION TOSERVER, INCLUDING
`ATTENDANTAND PARKING
`LOCATION IDENTIFICATION
`
`
`
`
`
`SERVERSENDSA LIST OF PREVIOUSLY
`REGISTERED VEHICLES KNOWN TO BE
`AT THE PARKINGLOCATION
`
`
`
`ATTENDANT PASSES BYA PARKED
`VEHICLE CHECKING IF THE
`WEHICLEAPPEARS IN THE LIST
`
`SENDERROR
`MESSAGE TO
`ATTENDANT
`
`
`
`
`
`HAS
`VEHICLE PAID FOR
`LOCATION?
`
`NOTIFYATTENDANT
`THAT VEHICLE
`HAS NOT PAID
`
`
`
`
`
`
`
`
`
`
`
`NOTIFYATTENDANT THAT
`VEHICLE HASPAD
`
`
`
`UPDATESERVER WITH
`WEHICLE PARKING
`INFORMATION
`
`Fig. 43
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 14 of 69
`
`
`
`Patent Application Publication Mar. 24,2005 Sheet 14 of 39
`
`US 2005/0065779 Al
`
`NOILVAYOANI SIIINOS
`INIOd[79
`JOVATTINI
`89UTHVTS||AV
`TdSIC||INOHAOUIN
`[S‘81
`
`cz
`
`0¢
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 15 of 69
`
`STDINOS
`
`YAANTS
`
`SSIOOV
`
`5
`
`643
`
`LAY]ayi
`
`PP
`
`NOLLVWYOANI
`
`
`
`sooaYOSSTIONdOFA
`
`OE
`
`.c
`
`g
`
`FLITTALVS
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 15 of 69
`
`
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 15 of 39
`
`US 2005/0065779 A1
`
`RECEIVE USER's VOICE ATUSERsysTEM20 ?'
`
`PERFORM FRONTEND SOUND
`PROCESSING USINGPROCESSOR34
`
`102
`
`PACKAGE PROCESSED VOICE
`INFORMATION FOR WIRELESS DELIVERY
`
`104
`
`TRANSMITPACKAGED PROCESSED WOICE
`INFORMATION FROM USERSYSTEM 20 TOSERVER
`SYSTEM 40 VIA WIRELESS DATA CHANNEL 60
`
`106
`
`COMPLETESPEECHRECOGNITION?
`PROCESSING USING SERVER 42
`
`
`
`
`
`PERFORMREQUIRED FUNCTIONSACCORDING
`TO THE COMPLETED SPEECH
`RECOGNITION PROCESSING INSTRUCTIONS
`
`110
`
`Fig. 52
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 16 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 16 of 39
`
`US 2005/0065779 A1
`
`MICROPHONE 24 CONVERTsAcousTICAUDIO/200
`INPUTTOANALOGELECTRICAL SIGNAL
`
`ANALOGSIGNALISSAMPLED ANDDIGITIZED AND u?20
`EACHSAMPLE ISASSIGNEDANUMERICAL VALUE
`
`
`
`SAMPLES ARE GROUPED INTO SETS REPRESENTING
`ACOUSTICAUDIO FORSET TIME PERIODS
`
`204
`
`
`
`PROCESSOR34 CONVERTS GROUPEDSETS
`FROM TIMEDOMAIN TO FREQUENCYDOMAIN
`
`206
`
`Fig. 53
`
`304
`
`306
`
`302
`
`312
`
`314
`
`?t role I Dr.
`
`300
`
`Fig. 54A
`
`310
`
`Fig. 54B
`
`322
`
`324
`
`320
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 17 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 17 of 39
`
`US 2005/0065779 A1
`
`350
`
`352
`
`FORMAT TRANSMISSIONS FOR
`ONLYDATA TRANSMISSION
`
`
`
`356
`
`DOES
`ANYDATANEED
`TO BESENT WITH THE
`SPEECH
`9
`
`
`
`
`
`
`
`
`
`
`
`YES
`
`360
`
`INTERSPERSE DATAPACKETS
`WITHVOICEPACKETS
`
`358
`
`USE MAXIMUMPACKET.BANDWIDTH
`FOR WOICE TRANSMISSION
`
`Fig. 55
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 18 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 18 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SERVER
`
`16
`
`I
`OOOOOOO
`PROCESSOR
`
`DATABASE
`32
`
`NETWORK
`
`
`
`VEHICLE
`
`12
`TELEMATIC CONTROL UNIT 14
`
`PROCESSOR
`20
`
`USER INTERFACE
`22
`
`
`
`
`
`GPS UNIT
`24
`
`MEMORY
`28
`
`RADIOMODULE
`26
`
`Fig. 61
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 19 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 19 of 39
`
`US 2005/0065779 A1
`
`INITIATEA TRIPREQUEST
`
`SEND VEHICLE GPS
`COORDINATES TOSERVER
`
`SEND VOICE INSTRUCTION
`OF DESTINATION TOSERVER
`
`INTERPRET VOICE INSTRUCTION
`OF DESTINATION
`
`O
`5
`
`52
`
`54
`
`56
`
`
`
`
`
`GENERATEA TRIPPLANACCORDING TO STORED MAP
`INFORMATION, VEHICLE GPS COORDINATES, AND
`INTERPRETED VOICE INSTRUCTION OF DESTINATION
`
`58
`
`GENERATEA TABLE OF LOCATIONS INCLUDING
`ASSOCIATED VOICE OR TEXT PROMPTS
`
`60
`
`SEND THE TRIPPLAN WITH THE
`TABLE TO THE VEHICLE
`
`62
`
`
`
`
`
`
`
`CONTACTSERVER
`AND REQUEST NEW
`TRIPPLAN
`ACCORDING TO
`PRESENT VEHICLE
`LOCATION
`
`Fig. 62
`
`64
`
`IS
`VEHICLE
`ADHERING TO
`THE TRIP
`PLAN
`p
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IS
`VEHICLEATA
`LOCATION IN THE
`TRIPPLAN
`TABLE
`
`
`
`
`
`
`
`70
`
`PLAY THE
`VOICE PROMPT
`ASSOCATED
`WITH THE
`LOCATION IN
`THE TABLE
`THAT
`CORRESPONDS
`TO THE
`VEHICLES
`LOCATION
`
`
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 20 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 20 of 39
`
`US 2005/0065779 A1
`
`Receive trip Reouest r"
`
`CALCULATE TRIPPLAN,
`CREATE TRIPPLAN TABLE
`AND SEND TO REQUESTER
`
`COMPARE THE VEHICLE'S
`PRESENT LOCATION TO THE
`RECEIVED TABLE
`
`82
`
`84
`
`
`
`
`
`IS PRESENT
`LOCATION
`LISTED IN THE
`TABLEP
`
`
`
`
`
`88
`
`YES
`
`DOES THE
`TABLE HAVE A
`STORED VOICE
`PROMPTP
`
`RETRIEVE
`AND PLAY
`THE
`CORRESPONDING
`STORED
`VOICE
`PROMPT
`
`SEND AREQUEST TO THE
`SERVER TO SENDA VOICE
`PROMPTACCORDING TO A
`TAGIDENTIFIER
`
`SERVERSENDS REQUESTED VOICE PROMPT
`
`94
`
`PLAY RECEIVED VOICE PROMPT
`
`96
`
`STORE RECEIVED VOICE PROMPT
`
`98
`
`PURGE SAVED VOICE PROMPTSACCORDING TO A
`SCHEDULED PURGE REQUEST, TO A USER PURGE REQUEST,
`OR TO A PURGE REQUEST SENT FROM THESERVER
`
`I00
`
`Fig. 63
`
`
`
`
`
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 21 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 21 of 39
`
`US 2005/0065779 A1
`
`
`
`?IS VIVIVCI
`
`COED
`
`
`
`OII WIWI?TOEHI,
`
`
`
`JINQ TOXIN00
`
`
`
`
`
`
`
`9I OIGIVNI
`
`NOII WIS
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 22 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 22 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`„LINII Sd5)
`
`zZ ‘8,
`
`
`
`NOII VOIN[]]WW00
`
`SSHTOEHHIAA
`
`
`
`
`
`
`
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 23 of 69
`
`
`
`Patent Application Publication Mar. 24,2005 Sheet 23 of 39
`
`US 2005/0065779 Al
`
`
`
`|0NULLITYNVNOLLVNYOANIFATAL
`
`
`
`£Z‘olyUIAOSNOILOVSNVULAUVLINOWAOSETASTY
`8AOVANAINIYASAOLTAINNVHDVLVO
`
`
`
`Cana~Sada
`
`eZYISANOSLTASAYAVTdSIC
`GSAA
`ISINOTaVSSIIOUdOL
`LOATISWASN
`6FOVANAINI
`UASALIXT
`
`
`
`SITASTYFHL10NOLEFWHTINOD79NOTEVWUOANIANINNALACVNOVATdYOJOVANAINI
`
`09
`
`PL
`
`ald
`
`6
`
`9
`
`84UIANASAHLOLLSVIAVONTO1UVA
`
`
`
`LSANOTE¥@ON99]SSAIOUdOLNOILVWUOANISENASNOL
`
`
`
`ONSNOILIVSNVALAYVIANOWYONOLLVWAOANT
`
`
`
`
`99CaILVIDOSSVNOLLVWYOANIYOIASVEVIVOHOUVAS
`
`
`
`YOdLSINOTYTHLONISSAIOUdHLIM
`FHLHLIM(ALVIDOSSV
`
`
`(Q9D)LINNTOYINODJILVWATAL
`
`LSVIQVOUTOLGVAOLCILVTIN
`LYLSVIQVOUNEO1GVaATAIAIIA
`CYNINUILIASTATAOAYADL
`
`OLCALVTIXNOILVAUOIANI
`LSVICVOUOLAVTHI
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 24 of 69
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 24 of 69
`
`
`
`
`
`
`
`
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 24 of 39
`
`US 2005/0065779 A1
`
`20
`
`
`
`TELEMATICS CONTROL UNIT
`
`28
`
`at:
`
`MEMORY
`
`PROCESSOR
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 25 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 25 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FINDALOCAL SYSTEMPHONE
`NUMBER IN MEMORY OF THE
`TELEMATICS UNITBASED ON THE
`WEHICLE GPS COORDINATES
`
`100
`
`PHONE NUMBEREXIST
`IN MEMORYTHAT CORRESPONDS
`TO THE GPS COORDINATES
`9
`
`I04
`PLACE CALL TO THE
`CORRESPONDING
`PHONE NUMBER
`
`
`
`
`
`CALL DEFAULTNUMBER
`AND DELIVER THE VEHICLE
`GPS COORDINATES
`
`SERVER ASSOCATED WITH THE
`DEFAULTNUMBER RETRIEVESA
`PHONE NUMBER THAT CORRESPONDS
`TO THE VEHICLE GPS COORDINATES
`
`
`
`
`
`
`
`
`
`SERVERSENDS THE
`RETRIEVED PHONENUMBER
`TO THE TELEMATICS UNIT
`
`THE TELEMATICS UNITSTORES
`THESENTNUMBER BASED ON
`ITS REGIONOR LOCATION
`
`Fig. 82
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 26 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 26 of 39
`
`US 2005/0065779 A1
`
`130
`
`
`
`----------
`
`100
`
`Fig. 91
`(Prior Art)
`
`V
`
`-
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 27 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 27 of 39
`
`US 2005/0065779 A1
`
`*
`
`Telephone
`Handset
`
`220
`
`Communication
`Controller
`
`Device
`
`Alert Key
`
`260
`
`270
`
`240
`
`230
`
`
`
`Primary
`Communicator
`
`Secondary
`Communicator
`
`Fig. 92
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 28 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 28 of 39
`
`US 2005/0065779 A1
`
`
`
`330
`
`1.
`
`Fig. 93
`
`as
`
`11
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 29 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 29 of 39
`
`US 2005/0065779 A1
`
`400
`C
`
`430
`
`-------
`Relay
`Transmitter
`(in communication
`with service
`network)
`
`440
`
`L
`
`420
`
`
`
`Wireless
`Telephone
`
`450
`
`Logging
`Device
`
`Transceiver
`(in communication
`with secondary
`communicator)
`
`Fig. 94
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 30 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 30 of 39
`
`US 2005/0065779 A1
`
`Cat from initiated from remote
`location via first communicator first
`network
`
`Controller transmits location and
`first set of signals via first
`Communicator
`
`504
`
`506
`
`
`
`No
`
`Second network needed
`for communication of
`infotation?
`
`508
`
`500
`
`514
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`User within existing
`range of
`second network?
`
`Service operator
`distpatches mobile
`access point enabled
`vehicle
`
`Mobile access point
`enabled vehicle travels
`to user location
`
`Controller transmits additional
`information via second
`communicator
`
`
`
`obile access point enabled
`ehicle within range of user2
`
`.
`Additional information
`received from remote location
`
`516
`
`All desired
`information logged from
`remote location?
`
`522
`
`Objective of transmission from
`remote location resolved
`
`
`
`524
`
`Fig. 95
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 31 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 31 of 39
`
`US 2005/0065779 A1
`
`
`
`FROM VEHICLESYSTEMS
`OR OTHERDEVICES
`
`MICROPHONE DISPLAY SPEAKER INTERFACE
`24
`26
`28
`
`PROCESSOR
`32
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 32 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 32 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`60
`
`RECEIVE
`PRESENTATION
`CONTENT
`
`IS THERE
`A VEHICLEEMERGENCY
`CONDITION?
`
`
`
`NOOUTPUT OF
`PRESENTATION
`CONTENT
`
`RECEIVE WEHICLE
`CONDITION
`INFORMATION
`
`
`
`OUTPUT OF PRESENTATION
`CONTENTBASED ON VEHICLE
`CONDITION INFORMATION
`(FIG 3)
`
`Fig. 102
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 33 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 33 of 39
`
`US 2005/0065779 A1
`
`
`
`0<SPEED <= 25MPH
`
`80
`
`VEHICLE
`SPEED2
`
`70<SPEED
`
`25<SPEED <= 40MPH
`
`40 <SPEED <= 70MPH
`
`
`
`
`
`DISPLAYIN
`DETAIL THE
`PRESENTATION
`CONTENT
`
`DISPLAYIN
`LESSER
`DETAIL THE
`PRESENTATION
`CONTENT
`
`
`
`
`
`
`
`DISPLAY
`EVENLESS
`PRESENTATION
`CONTENTAND
`INCREASE TEXT
`FONTSIZE
`
`STOP DISPLAY
`OFANY
`PRESENTATION
`CONTENTAND
`SENDAUDIO
`PORTIONS OF
`PRESENTATION
`CONTENT TO
`SPEAKERS
`
`
`
`Fig. 103
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 34 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 34 of 39
`
`US 2005/0065779 A1
`
`VEHICLESYSTEM
`
`
`
`120
`
`
`
`USER
`INTERFACE
`
`PROCESSOR
`
`Fig. 104
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 35 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 35 of 39
`
`US 2005/0065779 A1
`
`PROVIDE VOICE
`INSTRUCTIONS
`
`210
`
`PROCESS VOICE
`INSTRUCTIONS
`
`PRESENT THE PROCESSED
`VOICE INSTRUCTIONS TO
`THE USER
`
`
`
`
`
`
`
`
`
`
`
`
`
`DOES
`THE USER
`APPROVE OF THE
`PRESENTED VOICE
`INSTRUCTIONS
`p
`
`
`
`SEND THE PROCESSED
`VOICE TO ASERVER
`
`
`
`
`
`DOES
`THE USER WANT TO
`CONTACTA HUMAN
`OPERATORP
`
`
`
`SEND A DIGEST OF THE
`INTERACTION BETWEEN THE
`USER AND PROCESSOR TO THE
`HUMAN OPERATOR
`
`
`
`224
`
`CONNECT USER TO
`THE HUMAN OPERATOR
`
`Fig. 105
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 36 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 36 of 39
`
`US 2005/0065779 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`MICROPHONE
`
`22
`
`PROCESSING COMPONENT
`
`SPEECH
`PREPROCESSING
`COMPONENT
`30
`SPEECH
`RECOGNITION
`ENGINE
`
`32
`
`24
`
`USER
`INTERFACE
`
`CONTROL SYSTEM
`APPLICATION
`COMPONENT
`34.
`
`SYSTEM
`COMPONENTS
`
`Fig. 121
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 37 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 37 of 39
`
`US 2005/0065779 A1
`
`
`
`OBTAINESTIMATE
`OFNOISE
`
`40
`
`42
`
`44
`
`46
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`SUBTRACT NOISE FROM
`INPUTSIGNAL
`
`PERFORMAPREDICTION
`OF THE RESULT OF THE
`SUBTRACTION
`
`O
`
`SEND THE PREDICTION
`RESULT TO THE SPEECH
`RECOGNITION ENGINE
`
`
`
`Fig. 122
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 38 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 38 of 39
`
`US 2005/0065779 A1
`
`Fig. 123
`
`SETA BASE
`THRESHOLD
`ENERGY VALUE
`
`50
`
`52
`
`
`
`ISENERGY
`LEVEL OF RECEIVED
`SIGNALABOVE THE
`SET THRESHOLD
`ENERGYWALUE?
`
`
`
`DETERMINEA PREDICTIVE/54
`SIGNAL USING THE
`RECEIVEDSIGNAL
`
`SUBTRACT THE
`PREDICTIVESIGNAL FROM
`THE RECEIVEDSIGNAL
`
`56
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`RESET THE
`THRESHOLDENERGY
`VALUE TO THE LEVEL
`OF THE PRESENT
`RECEIVEDSIGNAL
`
`
`
`58
`
`DOES THE
`RESULT OF THE
`SUBTRACTION INDICATE
`THE PRESENCE OF
`SPEECH2
`
`
`
`SEND RECEIVEDSIGNAL
`THROUGHNOISE
`REDUCTIONALGORITHM
`(FIG 2)
`
`SEND RESULTOFNOISE
`REDUCTIONALGORITHM
`TOSPEECHRECOGNITION
`ENGINE
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 39 of 69
`
`
`
`Patent Application Publication Mar. 24, 2005 Sheet 39 of 39
`
`US 2005/0065779 A1
`
`s
`
`s
`
`s
`
`Fig. 124
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 40 of 69
`
`
`
`US 2005/0065779 A1
`
`Mar. 24, 2005
`
`COMPREHENSIVE MULTIPLE FEATURE
`TELEMATICS SYSTEM
`
`PRIORITY CLAIM
`0001. This application is a Continuation-in-Part of U.S.
`application Ser. No. 09/884.854 filed Jun. 18, 2001 (Attor
`ney Docket No. INTL-1-1016), which claims priority from
`U.S. application Ser. No. 09/860,024 filed May 16, 2001
`(now abandoned) (Attorney Docket No. INTL-1-1009),
`which claims priority to U.S. Provisional Application Ser.
`No. 60/280,375 filed Mar. 29, 2001 (Attorney Docket No.
`INTL-1-1001).
`0002 This application is also a Continuation-in-Part of
`U.S. application Ser. No. 09/884,902 filed Jun. 18, 2001
`(Attorney Docket No. INTL-1-1015), which claims priority
`to U.S. application Ser. No. 09/859,967 filed May 16, 2001
`(now abandoned) (Attorney Docket No. INTL-1-1010),
`which claims priority to U.S. Provisional Application Ser.
`Nos. 60/280,377 filed Mar. 29, 2001 (Attorney Docket No.
`INTL-1-1002), 60/278,454 filed Apr. 2, 2001 (Attorney
`Docket No. INTL-1-1006) and 60/281.231 filed Apr. 2, 2001
`(Attorney Docket No. INTL-1-1008).
`0003. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 09/955,476 filed Sep. 17, 2001
`(Attorney Docket No. INTL-1-1012), which claims priority
`to U.S. Provisional Application Ser. Nos. 60/280,376 filed
`Mar. 29, 2001 (Attorney Docket No. INTL-1-1004) and
`60/281.231 filed Apr. 2, 2001 (Attorney Docket No. INTL
`1-1008).
`0004. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/059,905 filed Jan. 29, 2002,
`(Attorney Docket No. INTL-1-1007), which claims priority
`to U.S. Provisional Application Ser. No. 60/280,379 filed
`Mar. 29, 2001 (Attorney Docket No. INTL-1-1 003).
`0005. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/689,504 filed Oct. 21, 2003
`(Attorney Docket No. INTL-1-1038), which is a Continua
`tion of U.S. application Ser. No. 10/273,403 filed Oct. 16,
`2002 (U.S. Pat. No. 6,671,617 issued Dec. 30, 2003) (Attor
`ney Docket No. INTL-1-1036), which is a Continuation of
`U.S. application Ser. No. 09/884,856 filed Jun. 18, 2001
`(Attorney Docket No. INTL-1-1011), which claims priority
`to U.S. Provisional Application Ser. No. 60/280,378 filed
`Mar. 29, 2001 (Attorney Docket No. INTL-1-1005).
`0006. This application also claims priority to currently
`pending PCT Application No. PCT/US03/07976 filed Mar.
`14, 2003 (Attorney Docket No. INTL-11-1019) which
`claims priority to U.S. application Ser. No. 10/142,670 filed
`May 10, 2002 (U.S. Pat. No. 6,691,026 issued Feb. 10,
`2004) (Attorney Docket No. INTL-1-1030), which claims
`priority to U.S. Provisional Application Ser. No. 60/364,538
`filed Mar. 15, 2002 (Attorney Docket No. INTL-1-1031) and
`is a Continuation-in-Part of U.S. application Ser. No.
`09/884.856 filed June 18, 2001 (U.S. Pat. No. 6,487,494
`issued Nov. 26, 2002) (Attorney Docket No. INTL-1-1011),
`which claims priority to U.S. Provisional Application Ser.
`No. 60/280,378 filed Mar. 29, 2001 (Attorney Docket No.
`INTL-1-1 005).
`0007. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/765,720 filed Jan. 26, 2004
`(Attorney Docket No. INTL-1-1039), which is a Continua
`
`tion of U.S. application Ser. No. 10/076,027 filed Feb. 12,
`2002 (U.S. Pat. No. 6,748,244 issued Jun. 8, 2004), which
`claims priority to U.S. Provisional Application Ser. No.
`60/332,025 filed Nov. 21, 2001 (Attorney Docket No. INTL
`1-1 028).
`0008. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/454,390 filed Jun. 3, 2003
`(Attorney Docket No. INTL-1-1037), which is a Continua
`tion of U.S. application Ser. No. 09/955,475 filed Sep. 17,
`2001 (U.S. Pat. No. 6,591,168 issued Jul. 8, 2003) (Attorney
`Docket No. INTL-1-1013), which claims priority to U.S.
`Provisional Application Ser. No. 60/316,650 filed Aug. 31,
`2001 (Attorney Docket No. INTL-1-1020).
`0009. This application is also a Continuation-in-Part of
`European National Phase Application No. EUR 02731874.0
`(European National Phase entered Nov. 15, 2003), proceed
`ing from PCT Application No. PCT/US02/15917 (Attorney
`Docket No. INTL-11-1012), which claims priority to U.S.
`application Ser. No. 09/955,474 filed Sep. 17, 2001 (U.S.
`Pat. No. 6,766,233 issued Jul. 20, 2004) (Attorney Docket
`No. INTL-1-1017) which claims priority to U.S. Provisional
`Application No. 60/291,203 filed May 15, 2001 (Attorney
`Docket No. INTL-1-1014).
`0010 This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/440,023 filed May 16, 2003
`(Attorney Docket No. INTL-1-1034) which claims priority
`to U.S. Provisional Application Ser. No. 60/381,142 filed
`May 16, 2002 (Attorney Docket No. INTL-1-1034P).
`0011. This application is also a Continuation-in-Part of
`U.S. application Ser. No. 10/076,874 filed Feb. 14, 2002
`(Attorney Docket No. INTL-1-1027) which claims priority
`to U.S. Provisional Application Ser. No. 60/345,939 filed
`Oct. 26, 2001 (Attorney Docket No. INTL-1-1025).
`0012 Each and all of the foregoing applications are
`incorporated by reference as if fully set forth herein.
`
`FIELD OF THE INVENTION
`0013 This invention relates generally or preferably to the
`fields of telematics, vehicle user interfaces, telecommunica
`tions, Speech recognition, digital commerce and vehicle
`parking, digital signal processing, wireleSS transmission of
`digitized voice input, navigational assistance for motorists,
`data communication to vehicles, mobile client-server com
`munication, extending coverage and bandwidth of wireleSS
`communication Services.
`
`BACKGROUND OF THE INVENTION
`0014. The full potential of the telematics industry has yet
`to be realized in part because of Several deficiencies in
`functionality, features, performance, reliability, cost-effec
`tiveness, and convenience of existing Systems. There is a
`need for a comprehensively improved telematics System.
`The improved System preferably includes improvements
`and/or features to address one or more, or any combination
`of the following problems.
`0015 1) Various vehicle devices exist that are designed to
`provide a vehicle operator with travel-related information.
`For example, a display coupled to a global positioning
`system (GPS) may be used to present to the vehicle operator
`a detailed map showing the vehicle location, a desired
`
`UNIFIED PATENTS EXHIBIT 1026
`Page 41 of 69
`
`
`
`US 2005/0065779 A1
`
`Mar. 24, 2005
`
`destination, and the geographic details of the Surrounding
`area. Under certain situations, the vehicle operator has the
`opportunity to study the map in exact and thorough detail.
`An example is a parked vehicle. There are other times,
`however, when the vehicle operator is too busy operating the
`vehicle to Safely view the displayed information, let alone
`Study the displayed information in exacting detail. This is
`particularly the case where the vehicle operator is in the
`midst of a particularly taxing circumstance, for example,
`driving in heavy traffic, driving at high Speed, or otherwise
`distracted by an emergency Situation or telephone conver
`sation. In Such situations, the display presentation distracts
`the vehicle operator because the operator focuses attention
`on the details shown on the display.
`0016. Therefore, there exists a need to provide valuable
`and timely travel-related information to a vehicle operator
`while minimizing potentially dangerous distractions to the
`vehicle operator. See our co-pending application entitled
`SYSTEM AND METHOD FOR ADAPTABLE MOBILE
`USER INTERFACE, U.S. patent application Ser. No.
`10/454,390 filed Jun. 3, 2003 (Attorney Docket No. INTL
`1-1037).
`0017 2) Worldwide, regulatory bodies have begun to
`mandate the use of hands free Systems for phone conversa
`tions in vehicles. A hands free system enables the driver to
`carry on a phone conversation without holding a phone to
`their ear. While Some Systems incorporate a headset, typi
`cally a hands free System comprises a microphone and
`Speaker mounted in the vehicle and connected to a cellular
`phone mounted in a cradle. Existing Systems typically
`require pressing keys on the phone or on a separate keypad
`embedded in the dashboard to dial a phone number. Newer
`Systems use Voice recognition, implemented as part of the
`hands free System or embedded phone System, to enable a
`true hands free operation. Some providers of applications
`attempt to use hands free Systems (a.k.a. hands free kits) in
`tandem with the user's personal phone to deliver their
`Service, removing the need for an in-vehicle embedded
`phone.
`0.018. There exist disadvantages with current systems. A
`System based on a portable phone mounted in a cradle is
`inherently unreliable as the phone may become detached
`from its cradle at the time it is most needed (e.g., because of
`crash impact.) In addition, the driver may have forgotten
`their phone outside of the vehicle and only discover that
`when the phone is needed.
`0019 Bluetooth (BT) is a short-range wireless technol
`ogy originally designed to replace patch cable between
`personal computers and related peripherals. This technology
`is making its way into mobile cellular phones to enable them
`to communicate over Short range with other devices. BT
`applications may be connected to a personal phone in an
`in-vehicle hands free System. In one Scenario, the driver gets
`into their vehicle and Starts driving without pulling their
`phone out of their pocket. ABT transceiver that is part of the
`in-vehicle hands free system and the BT transceiver in the
`phone discover each other and establish a continuous wire
`less link. The hands free system now uses the driver's
`personal phone to connect with the cellular network.
`0020. The above solution suffers from limitations similar
`to the cradle Solution and more Severe. For example, wire
`leSS connections are inherently unreliable. On occasions the
`
`two Systems do not establish a connection when the driver
`enters the car. Unlike when placing a phone into a cradle,
`there is no physical, tangible cue to the driver to indicate a
`likely connection failure. Even after the initial connection
`has been established, it may be dropped at any time; even in
`the middle of a conversation. In addition, the phone may be
`placed at a location in the vehicle with poor cellular recep
`tion (e.g. below glass window level) that does not have
`access to a vehicle mounted external antenna. Lastly, in
`dense traffic and given BT Security issues, conversation
`privacy may be compromised as it may leak over the BT
`network to other vehicles in close proximity.
`0021. Therefore, there exists a need to provide a more
`reliable, less costly, hands free vehicle phone System. See
`our co-pending application entitled SHARING ACCOUNT
`INFORMATION AND A PHONE NUMBER BETWEEN
`PERSONAL MOBILE PHONE AND AN IN-VEHICLE
`EMBEDDED PHONE, U.S. patent application Ser. No.
`10/765,720 filed Jan. 26, 2004 (Attorney Docket No. INTL
`1-1039).
`0022 Voice transmission over a digital wireless network
`involves capturing Sound waves using a microphone and
`converting them to electrical Signals and then binary data.
`The process comprises Sampling, digitizing, and other digi
`tal signal processes at the receiver unit (e.g., telematics
`module or cell phone.)
`0023 There is a fundamental difference between the way
`humans process auditory input and the wa