United States Patent
`
`[19]
`
`[11] Patent Number:
`
`6,100,811
`
`Hsu et al.
`
`[45] Date of Patent:
`
`*Aug. 8, 2000
`
`US006100811A
`
`[54] FINGERPRINT ACTUATION OF
`CUSTOMIZED VEHICLE FEATURES
`
`5,559,504
`5,572,597
`5,631,971
`
`. 340/825.3
`..
`9/1996 Itsumi et al.
`
`.
`11/1996 Chang et al.
`382/125
`
`5/1997 Sparrow ...... ..
`382/125
`
`[75]
`
`Inventors, Shi_Ping Hsu’ pasadena; Bruce W_
`EV311S; Arthur F- Messenger, b0th Of
`Red0l1d0 Beach; Defies L- Z50]113y,
`Rolling Hills Estates, 311 Of Calif
`
`...................... .. 382/115
`9/1998 Pare, Jr. et al.
`5,802,199
`Primary Examiner—Michael Horabik
`Assistant Examiner—YVes Dalencourt
`Attorney, Agent, or Firm—Michael S. Yatsko
`
`[73] Assignee: TRW Inc., Redondo Beach, Calif.
`
`[*] Notice:
`
`This patent issued on a continued pros-
`av
`1'53(d)’ and is Subject to the twenty year
`patent
`term provisions of 35 U'S'C'
`154(a)(2)'
`
`[21] APPL N05 08/9953564
`[22]
`Filed,
`Dec 22, 1997
`
`Int. Cl.7 ...................................................... .. G06F 7/04
`[51]
`[52] U.S. Cl.
`................................ .. 340/825.31; 340/825.3;
`340/825 .34; 340/430; 340/539; 340/825 .69;
`382/115; 382/124; 382/125; 382/126
`[58] Field of Search .......................... .. 340/825.31, 825.3,
`340/825,34, 430, 539, 825,69; 382/115,
`224, 126, 124, 125
`
`[56]
`
`References Cited
`
`4,451,887
`4,754,255
`4,997,053
`5,054,569
`5,067,162
`
`Us‘ PATENT DOCUMENTS
`5/1984 Harada et al.
`........................ .. 364/424
`6/1988 sanders et a1,
`,, 340/430
`3/1991 Drori et al.
`.. 180/287
`....... ..
`10/1991 Scott et al.
`.. 180/167
`11/1991 Driscoll, Jr. et al.
`................. .. 382/126
`
`
`
`ABSTRACT
`[57]
`Apparatus, and a corresponding method for its use, for
`
`inside the Vehicle at a convenient location and optionally
`outside the Vehicle (at 14), in or near a door handle (12)?
`Once an authorized user’s identify has been Verified in a
`fingerprint matching device (30), Various Vehicle sub-
`systems are automatically adjusted to the identified user’s
`preferred settings, which are stored. in a memory (.98). ‘In
`addition, starting the Vehicle engine is enabled if an interior
`fingerprint sensor has been used, or the Vehicle is unlocked
`if an exterior fingerprint sensor has been used. Vehicle
`subsystems that are automatically adjusted to the user pref-
`erences include seats (38), mirrors (40), steering Wheel (42),
`climate control (44), airbag (52), telephone (46), radio (50)
`and onboard computer (54), as Well as performance control
`features (48) such as suspension and transmission adjust-
`ment. Door locks (34) and security system features (36) are
`also automatically controlled, as is a radio transmitter (56)
`that is automatically customized to open the user’s home
`garage door or office parking entry gate. Features of a
`number Of different fingerprints are Stored in the deVlee t0
`allow for operation of the Vehicle (10) by different family
`members, as authorized by a primary user.
`
`26 Claims, 7 Drawing Sheets
`
`DOOR-
`MOUNTED
`FINGERPRINT
`
`SCAN ;
`F-WEELI
`
`32
`
`FINGERPRINT
`MATCHING
`
`3EV'CE
`CHECKID
`
`INTERIOR
`FINGERPRINT
`
`SCAN
`]
`E
`
`
`
`HOME GARAGE
`DOOR
`OPEN/CLOSE
`
`
`
`TRANSMITTER
`SENSOR
`CONTROL
`[ ACCESS
`OFFICE
`
`PARKING GATE
`6 4
`OPEN/CLOSE
`
`40
`
`42
`
`AIRBAG
`ADJUST
`FORCE
`
`/34
`DOOR I-0C_K
`LOCK/
`]
`UNLOCK
`—
`
`ENGINE
`_,
`,,_
`[RUN/STOP
`*
`—
`
`—
`
`SECURITY SYSTEM
`CONTROL “ALARM
`
`[ CALL FOR HELP’ 7
`
`44
`
`CLIMATE
`CONTROL
`[ADJUST
`
`
`
`50
`
`TEMP,
`POSN.
`ENTERTAIN‘
`MENT
`CENTER
`ADJUST
`RADIO I
`
`CONTROL
`ADJUST
`SUSPN. &
`TRANSMN.
`
`I
`
` SENSOR
`PERF.
`
`SEATS
`ADJUST
`POSNS
`
`
`
`MIRRORS
`ADJUST
`POSNS.
`
`48
`
`C
`
`
`PHONE
`4
`SELECT
`ACC., SET
`
`SPEED
`DIAL
`
`
`
` MOBILE
`
`STEERING
`WHE_EL_
`ADJUST I
`
`
`
`|N—CAR COMPUTER
`
`—
`
`SELECT
`DATA
`SUBSCRNS.
`
`MAIL
`
`APPOINT—
`MENT BOOK
`
`TRAWC
`.7
`WEATHER
`
`NAVIGA-
`] TION PREFS.
`I
`V
`
`SPEECH
`
`RECOGNTN_
`SET VOICE
`PROFILE
`’
`
`’”
`
`,
`I
`
`_
`SPORTS
`
`Valeo Exhibit 1013_001
`
`Valeo Exhibit 1013_001
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 1 of7
`
`6,100,811
`
`FIG. 3
`
`Valeo Exhibit 1013_002
`
`Valeo Exhibit 1013_002
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 2 of7
`
`6,100,811
`
`FIG. 4
`
`Valeo Exhibit 1013_003
`
`Valeo Exhibit 1013_003
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 3 of7
`
`6,100,811
`
`
`
`
`
`IWIH<W\SXOOQ.2<mS~.~.m5s.Q<
`
`@605
`
`-<0\><2
`
`mummmZOEvv
`
`women
`
`
`
`m_m5n__2oom<o-z_
`
`Smzmm
`
`«Q.«G
`
`wzmommsm
`
`0F.n:\wfi
`
`2504
`
`.mIuhml
`
`..~2\OQn:\
`
`w<mm_<
`
`
`
`mw<m_<om__2o:
`
`moon
`
`mmofixzmnxfl
`
`m_o_&o
`
`
`
`m._.<Ooz_xm<n_
`
`mmodémmo
`
`mmE_s_wz<E
`
`.~Owt.ZOQ
`mmmoo<%
`
`mo_mmFz_
`
`»z_m.Em_oz:
`
`momzmm
`
`2<om
`
`MMOZI
`
`»z_~Emmoz_“_
`
`OZ_IO._.<_>_
`
`mo_>m_n_
`
`_Qxommo
`
`-w_OOD
`
`n_m._.ZDO_>_
`
`+z_m_n_~m_oz_u_
`
`momzmm
`
`12<om
`1Emmi
`
`m_z_ozm
`
`Q0...
`
`v_oo._mooo
`
`E004
`
`X00423
`
`
`
`sm:w>mEmaomw
`
`
`
`Em.:\::\qOK.:<O0
`
`
`
`
`
`n3mT.\mom.3<O.
`
`
`
`
`
`
`
`m_._.<_>__._Ooz_mm_m»wmmomm__>_wbmw
`
`Wmmum
`
`...m.D\..Q<
`
`
`
`zommim.m2mOQ
`
`5:2?
`
`._Om.rZOO
`
`._mm=._>>
`
`hm.D\..Q<
`
`5:3.‘
`
`wzmom
`
`
`
`‘.Z._.zOO0m_w_
`
`
`
`.93.”:zmom
`
`mama.mzozaW.u§o>Emm:_mO_>_
`Smdmowmemomm-z_<Em+zm__.zm_>_._oEzoo
`
`
`
`
`
`
`
`
`mmfizmo5:3.‘Em..oo<
`
`
`
`m.0_n_05$.2:m2<E..<E
`
`
`
`
`
`533.‘M.zmmamQmmmm
`
`Valeo Exhibit 1013 004
`
`Valeo Exhibit 1013_004
`
`
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 4 of7
`
`6,100,811
`
`16
`
`INTERIOR
`
`74
`
`FINGERPRINT
`SENSOR
`
`D00R—MOUNTED
`
`SENSOR
`
`5- --------- --
`5
`
`5
`
`80
`
`USER INTERFACE
`
`(SELECT MODE,
`
`I................................127?.............
`(CONTROL)
`___________________________________________________________ R
`781
`
`g
`
`F'N"\3M'i$(':§'NT
`CONTROLLER
`
`INTERFACE
`WITH
`
`ACTUATORS
`
`SELECT USER ID.) FINGERPRINT
`
`94
`
`84
`
`MA-I-CH
`
`86
`
`SENSED
`FINGERPRINT
`
`FINGERPRINT
`
`
`
`CORRELATOR
`
`ENROLL
`
`VERIFY
`92
`
`90
`
`88
`
`REFERENCE
`FINGERPRINT
`
`MEMORY
`
`I:|C3.(3
`
`ACTUATOR
`SETTINGS
`MEMORY
`
`Valeo Exhibit 1013_005
`
`Valeo Exhibit 1013_005
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 5 of7
`
`6,100,811
`
`108
` PRIMARY USER
`
`ENGINE OFF IN
`SELECTS COMBO MODE
`OMBINATION
`AND FINGERPRINT IS
`MODE
`VERIFIED
`
` SECRET COMBI-
`NATION DIALED
`AT IGNITION
`
`
`
`
`
`
`
`PRIMARY USER
`EXITS COMBO MODE
`AND FINGERPRINT IS
`VERIFIED
`
`100
`
`
`
` ENGINE SHUT OFF FOR
`ONE MINUTE
`
`ENROLLED USER
`ENROLLED USER
`
`
`SELECTS SDEST MODE
`SELECTS USER ID AND
`AND FINGERPRINT Is’
`I
`
`
`VERIFIED
`F N?,E,I:I:',SE'I‘[I,T '3
`
` 112
` GUEST
`MODE
`
`
`
`
`
`(NOT
`LOCKED)
`
`PRIMARY USER
`
`SELECTS SET MODE
`AND FINGERPRINT IS
`VERIFIED
`
`
`
`ON COMPLETION OF
`ENROLLMENT OR
`UNENROLLMENT
`
`
`
`
`
`PRIMARY USER
`ENROLLED
`
`CLEARED
`MODE
`
`104
`
`
`
`SET MODE
`(ENROLL
`OR
`
`
`
`
`
`TAMPERING
`DETECTEDIN
`
`ANY MODE
`
`110
`
`UNENROLL)
`
`ENROLL/UNENROLL
`ADDITIONAL USERS
`
`
`
`PRIMARY USER
`UNENROLLED
`
`F I G' 7
`
`SECRET COMBINATION
`DIALED
`
`Valeo Exhibit 1013_006
`
`
`
`102
`
` UNLOCKED
`MODE
`
`ENROLLED USER
`SELECTS USER ID AND
`FINGERPRINT IS
`VERIFIED
`
`
`
`LOCKED
`MODE
`
`
`
`
`
`
`Valeo Exhibit 1013_006
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 6 of7
`
`6,100,811
`
`VERIFICATION
`
`USER
`OPTION A
`
`USER
`OPTION B
`
`USER
`OPTION C
`
`PRIM. USER
`
` ACTIVATE
`
`SELECT NEXT MOST
`LIKELY REFERENCE
`FINGERPRINT
`
`LAST USER
`
`ALL USERS
`PRIM. USER
`ADDL. USERS ADDE USERS IN SELECTED
`IN SELECTED 'N SELECTED
`ORDER
`ORDER
`ORDER
`
`
`
`
`FINGERPRINT
`CORRELATOR
`
` CHECKED
`
`BOTH USER
`FINGERS?
`
`
`
`
`134
`
`
`INTERIOR
`
`SENSOR
`USED?
`
`
`
`138
`
`ENTER
`SELECTED
`MODE
`
`
`
`136
`
`ALLOW ONLY
`TRASITION FROM
`LOCKED TO
`
`UNLOCKED MODE
`
`Valeo Exhibit 1013_007
`
`*(IF OTHER USERS
`PERMITTED FOR THIS
`TYPE OF MODE
`
`TRANSITION)
`
`FIG. 8
`
`130
`
`
`
`CHECKED
`
`
`ALL ENROLLED
`
`
`USERS*?
`
`
`
`Y
`
`132
`
`DENY
`ACCESS
`
`Valeo Exhibit 1013_007
`
`

`
`U.S. Patent
`
`Aug. 8,2000
`
`Sheet 7 of7
`
`6,100,811
`
`14
`
`2
`
`1
`
`44
`
`UNLOCKED
`MODE
`
`102
`
`140
`
`
` DOOR
`SENSOR
`
`USED?
`
`UNLOCK
`ENGINE
`
`UNLOCK
`DOORS
`
`TURN OFF
`ALARM
`
`
`
`LOCK DOORS
`
`RETRI EVE
`ACTUATOR
`
`SETTINGS
`
`152
`
`146
`
`148
`
`150
`
`CUSTOMIZE ALL VEHICLE SUBSYSTEM
`SETTINGS FOR IDENTIFIED USER
`
`154
`
` LEAVING
`UNLOCKED
`MODE?
`
`
`
`
`Y
`
`1
`
`LOCK ENGINE
`
`SAVE
`ACTUATOR
`SETTINGS
`
`UPDATE
`USAGE LOG
`
`56
`
`158
`
`160
`
`100
`
`GO TO
`LOCKED
`MODE
`
`FIG. 9
`
`Valeo Exhibit 1013_008
`
`Valeo Exhibit 1013_008
`
`

`
`6,100,811
`
`1
`FINGERPRINT ACTUATION OF
`CUSTOMIZED VEHICLE FEATURES
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates generally to personal iden-
`tification or verification systems and, more particularly, to
`systems that automatically verify a person’s identity before
`granting access to a vehicle. Traditionally, keys and locks, or
`combination locks, have been used to limit access to
`property, on the theory that only persons with a right to
`access the property will have the required key or combina-
`tion. This traditional approach is, of course, still widely used
`to limit access to a variety of enclosed spaces, including
`automobiles.
`
`Many automobiles are protected both by locks and by
`intrusion alarms, which are typically activated and deacti-
`vated using a small radio or infrared transmitter carried by
`the car owner as a key-chain fob. Although this type of
`device is convenient, its loss by the owner may render the
`vehicle just as vulnerable to theft as if mechanical keys had
`been used for protection.
`Access to automobiles poses some special problems that
`have not been addressed by presently available security
`systems. Although fobs are widely used to transmit signals
`to a car security system, for door access and to activate and
`deactivate intrusion alarms, once in the car a car owner or
`user must typically resort to a mechanical key to start the car.
`Moreover, selection of customized features of the car, such
`as seat and mirror adjustments, must be made manually,
`although some cars include a mechanism for memorizing
`settings of the some of the vehicle’s main features.
`Accordingly, there is a widely felt need for a more reliable
`technique for accessing and using automobiles. Ideally, the
`technique should positively verify the identity of the person
`seeking access, should provide access to all
`the car’s
`features, and should eliminate the need to carry multiple
`keys and fobs, or to memorize combinations or passwords.
`Another desirable goal is that the technique should operate
`rapidly enough that it does not significantly delay a person’s
`access to and use of the vehicle. The present invention
`satisfies all of these needs.
`
`SUMMARY OF THE INVENTION
`
`The present invention resides in apparatus, and a method
`for its use, for automatically verifying the identity of a
`person seeking entry to and use of a protected vehicle.
`Briefly, and in general terms, the apparatus of the present
`invention comprises a fingerprint sensor mounted in a con-
`venient interior location in a vehicle; a high-speed finger-
`print matcher, for comparing a sensed fingerprint image with
`features of a previously stored reference fingerprint image,
`to verify the identity of a user of the vehicle; a fingerprint
`match controller, for selecting from a plurality of stored
`reference fingerprint images for presentation to the finger-
`print matcher, and having a locked mode or operation and an
`unlocked mode of operation; an engine enabling switch, to
`prevent operation of the vehicle in the locked mode; means
`included in the fingerprint match controller, for switching
`from the locked mode to the unlocked mode upon success-
`fully verifying the identity of a vehicle user; means operable
`in the unlocked mode, for actuating the engine enabling
`switch to allow operation of the vehicle; one or more
`actuators for adjusting vehicle subsystems in accordance
`with users’ preferred settings; storage means for recording
`actuator settings associated with user identities; and means
`operable in the unlocked mode, for operating the actuators
`based on settings retrieved from the storage means for an
`identified user.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`More specifically, the actuators may include a seat adjust-
`ment actuator, a mirror actuator, a steering wheel position
`actuator, a climate control actuator, a mobile telephone
`actuator, a vehicle performance control actuator, an enter-
`tainment device actuator, an airbag setting actuator, and an
`onboard computer actuator.
`The illustrative embodiment of the invention also includes
`
`a second fingerprint sensor, mounted in a convenient exte-
`rior location on the vehicle. The fingerprint matching con-
`troller includes means for determining which fingerprint
`sensor has been used, and means for unlocking at least one
`vehicle passenger access door upon verification of the
`identity of a user placing a finger in the second fingerprint
`sensor. Preferably, the second fingerprint sensor is located
`near, or integrated into a door handle, for ease of operation
`while opening a door of the vehicle.
`The apparatus also includes means for switching from the
`unlocked mode to the locked mode upon detection of engine
`non-operation for a selected period of time. Thus, the vehicle
`may be driven, and even restarted after an engine stall,
`without further identity verification, but will return to the
`locked mode once the engine has been shut down for a short
`time, such as a minute or two.
`Ideally, the apparatus of the invention also includes a user
`interface for selection of modes of operation and user
`identities. An authorized user can speed up the verification
`process by manually selecting his or her own identity in the
`user interface, so that only one fingerprint matching opera-
`tion is needed. An authorized user may also select a new
`mode of operation at the user interface. The fingerprint
`match controller will automatically switch to a new selected
`mode of operation immediately upon verification of the
`identity of a user.
`Among the modes of operation that may be selected by a
`primary user are a “set” mode that permits enrollment of
`additional users. For this purpose,
`the apparatus further
`comprises means for obtaining and storing reference finger-
`print
`image data pertaining to additional users. Another
`mode that may be selected is a “guest” mode that permits
`operation of the vehicle without fingerprint verification. Any
`enrolled user may request transition to or from the guest
`mode upon identity verification.
`Another mode that may be selected by the primary user of
`the vehicle is the “combination” mode, which permits opera-
`tion of the vehicle without fingerprint verification, but using
`a secret combination.
`
`The apparatus of the invention may also be defined as
`comprising a fingerprint matching system for verifying the
`identity of a person who wishes to use the vehicle; an engine
`enabling switch coupled to the fingerprint matching system,
`to prevent operation of the vehicle until the identity of the
`person has been verified; and at
`least one actuator for
`adjusting a vehicle subsystem to an individually preferred
`setting. The fingerprint matching system includes means,
`operable upon successful verification of a user’s identity, for
`retrieving personal preference data associated with the iden-
`tified user and for supplying selected personal preference
`data to the actuator, for automatic adjustment of the vehicle
`subsystem to the user’s preference.
`The invention may also be defined in terms of a method
`for controlling a vehicle using fingerprint identification, the
`method comprising the steps of sensing a vehicle user’s
`fingerprint
`image in a fingerprint sensor mounted in a
`convenient location in the vehicle; selecting from a plurality
`of previously stored reference fingerprint images of autho-
`rized users of the vehicle; comparing the sensed fingerprint
`
`Valeo Exhibit 1013_009
`
`Valeo Exhibit 1013_009
`
`

`
`6,100,811
`
`3
`image with features of the selected previously stored refer-
`ence fingerprint image of an authorized user of the vehicle;
`verifying, in a fingerprint matching system, that the sensed
`fingerprint
`image matches the selected reference image;
`upon verification in the previous step, switching the finger-
`print matching system from a locked mode to an unlocked
`mode and enabling operation of the vehicle; and actuating at
`least one vehicle subsystem to conform with adjustment
`settings associated with the identified vehicle user.
`The method may further comprise the steps of switching
`the fingerprint matching system to a guest mode upon
`verification of an authorized user’s fingerprint, wherein any
`driver may operate the vehicle while in guest mode; and
`switching the fingerprint matching system back to the
`unlocked mode upon obtaining another verification of an
`authorized user. Further steps of the method include sensing
`when the vehicle engine has been inactive for a prescribed
`period of time; and then automatically switching the finger-
`print matching system back to the locked mode.
`The method may also include the steps of switching the
`fingerprint matching system to a “set” mode if requested by
`a primary authorized user; and enrolling additional users in
`the set mode, by analyzing and storing fingerprint features of
`the additional users. The method may then include unen-
`rolling selected users by removing their stored fingerprint
`features. Unenrollment of the primary authorized user places
`the fingerprint matching system in a cleared mode in which
`no fingerprint matching is needed to operate the vehicle.
`In accordance with another feature of the invention, the
`method further comprises the step of switching the finger-
`print matching system to a combination mode if requested
`by a primary authorized user. Operation of the vehicle in the
`combination mode does not require fingerprint matching but
`does require the use of a secret combination. Leaving the
`combination mode requires the further step of switching the
`fingerprint matching system from the combination mode to
`the unlocked mode upon another verification of the primary
`user’s identity in the fingerprint matching system.
`Finally, the method may also include the step of recording
`usage data pertaining to the identified users and selected
`parameters of vehicle operation.
`It will be appreciated from the foregoing that the present
`invention represents a significant advance in providing
`secure access to vehicles. More particularly, the invention
`allows multiple users to gain entry to a vehicle and to have
`selected vehicle subsystem settings adjusted to personal
`preferences automatically. Each authorized user enrolls at
`least one fingerprint in the apparatus of the invention. Then,
`upon entering or starting the vehicle, an authorized user has
`only to touch a fingerprint sensor and the vehicle will be
`automatically adjusted to preferred settings that were saved
`when the user last operated the vehicle. Other aspects and
`advantages of the invention will become apparent from the
`following more detailed description, taken in conjunction
`with the accompanying drawings.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a fragmentary elevation view of a car, showing
`one location of an exterior fingerprint sensor used in the
`present invention;
`FIG. 2 is a view similar to FIG. 1, but showing an
`alternative location for a fingerprint sensor, integrated into a
`door handle;
`FIG. 3 is an enlarged view of the door handle shown in
`FIG. 2;
`FIG. 4 is a simplified fragmentary perspective drawing of
`a car interior, showing alternative locations for an interior
`fingerprint sensor used in the present invention;
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`FIG. 5 is a block diagram showing the principal features
`and functions of the present invention;
`FIG. 6 is block diagram showing a fingerprint match
`controller and other hardware components of the present
`invention;
`FIG. 7 is a state diagram depicting the various modes of
`operation of the fingerprint match controller of FIG. 6, and
`showing the conditions needed to effect transitions between
`different pairs of modes;
`FIG. 8 is a flowchart showing functions performed by the
`fingerprint match controller during verification of a finger-
`print image; and
`FIG. 9 is a flowchart showing functions performed by the
`fingerprint match controller in an unlocked mode of opera-
`tion.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`As shown in the drawings for purposes of illustration, the
`present invention pertains to a system for automatic verifi-
`cation of the identity of a person seeking to enter and operate
`a car. Traditionally, cars are protected by mechanical locks
`and keys, or by combination locks or electronic devices,
`such as hand-held fobs.
`
`the person
`invention,
`In accordance with the present
`seeking access to a car, or wanting to start the car, does so
`by first placing a finger over a conveniently located sensor.
`The car user’s fingerprint image is employed to control
`access though the car doors, to unlock the car engine, and to
`customize a number of car subsystem features automatically
`to the personal preference of the user. FIG. 1 is an exterior
`view of part of a car, indicated by reference numeral 10,
`having a door handle 12 and a fingerprint sensor 14 located
`adjacent to the door handle. The user gains access to the car
`10 by placing a finger, such as the index finger, momentarily
`on the sensor 14. As will be discussed in more detail, the
`system of the invention has the ability to verify the identity
`of the user very rapidly, and to unlock the door (or all doors)
`upon completion of the verification process.
`FIG. 2 is similar to FIG. 1, but shows an alternative
`location for the sensor 14, on the underside of the door
`handle 12, as best shown in FIG. 3. This approach works
`best for door handles of the recessed type that have to be
`pivoted out of a recess by placing a finger beneath the handle
`and pulling it out.
`FIG. 4 shows four possible locations for an interior sensor
`16: (a) near the position of a conventional ignition key
`switch on the car steering column 18, as indicated at 16a, (b)
`on the car dashboard 20, such as shown at 16b, (c), on the
`central console 22, as indicated at 16c, or (d) on a centrally
`mounted parking brake lever 24, as indicated at 16d.
`FIG. 5 shows the principal functions controlled in asso-
`ciation with the fingerprint sensors 14 and 16, both of which
`are connected to a fingerprint matching device 30 in the car
`10. The fingerprint matching device 30 matches the finger-
`print image obtained by one of the sensors with one or more
`internally stored reference fingerprint images obtained from
`the principal car user and a number of other frequent users
`who wish to be enrolled to use the car. If a match is
`
`the fingerprint matching device 30 transmits
`determined,
`control signals to a number of car subsystems. Principal
`among these subsystems is an engine control switch 32 and
`a door locking switch 34. It will be understood that, for most
`cars, the exterior fingerprint sensor 14 will be used to unlock
`the car and to disable a security system 36, but not to enable
`
`Valeo Exhibit 1013_010
`
`Valeo Exhibit 1013_010
`
`

`
`6,100,811
`
`5
`the engine control switch 32. One approach for accomplish-
`ing a division of functions between the exterior and interior
`sensors 14 and 16 is further discussed below.
`
`In addition to the more essential functions of engine
`enabling, door unlocking and control of security alarms, the
`fingerprint matching device 30 also performs a number of
`control functions that customize the car for the user whose
`
`identity has been verified. Thus, as soon as the driver’s
`identity has been verified through one of the sensors 14 or
`16, actuator control signals are transmitted to the car seats
`38, mirrors 40, steering wheel 42, climate control 44, mobile
`telephone 46, vehicle performance controls 48, entertain-
`ment center 50, airbag controls 52, in-car computer 54, and
`radio transmitter 56. The seats, mirrors, steering wheel,
`climate control and airbag control are adjusted to the settings
`preferred by the identified user. In the case of the airbag
`controls 52, adjustment is made on the basis of the user’s
`previously sensed weight, height, or both. These and other
`adjustments are made on the basis of positional settings that
`were memorized when the same user last drove the car.
`
`Performance controls may include suspension and transmis-
`sion settings that were either previously selected by the user
`or were stored after automatically adjusting to the user’s
`weight or other characteristics.
`The entertainment center adjustments 50 include preset
`stations stored by user when previously in the car, and a
`selection of compact disks or other music media previously
`selected. If the user is new to the car, no settings will be
`available but selections made while operating the vehicle
`will be stored for use when the same user drives on a later
`
`occasion. The mobile telephone controls 46 make an appro-
`priate selection of a telephone account for the user, and
`retrieve a list of speed-dial numbers previously stored by the
`user.
`
`The radio transmitter controls 56 are used to enable a
`
`transmitter for opening a home garage door, as indicated at
`58, or an office parking access gate, as indicated at 60. Since
`each user may have different requirements in this regard,
`customized frequencies or control signals are stored for each
`user. Programming these selections into the system is
`accomplished either by manually entering the data or by
`utilizing a “training” mode in which signals from each user’s
`separate garage door opener and parking gate opener or
`transponder are captured and analyzed.
`If the car has an onboard computer 54, the user’s verified
`identity may be used to log in automatically, to fetch any
`electronic mail (e-mail), to retrieve the user’s appointment
`book, navigation system preferences, and speech profile (to
`condition the computer to accept voice commands from the
`user). The user’s personal preferences for subscription data
`services may also be initialized in the computer, such as data
`subscriptions to services pertaining to traffic, weather,
`stocks, news, or sports.
`FIG. 6 shows the principal hardware components of the
`fingerprint checking device 30. The fingerprint sensors 14
`and 16 interface with a fingerprint match controller 70, the
`structure and function of which will be described with
`
`reference to FIGS. 7-9. The controller 70 receives finger-
`print image data over lines 72 and 74 from the sensors 14
`and 16, and transmits control signals to the sensors over
`lines 76 and 78, respectively. The fingerprint matching
`device 30 also includes a user interface 80, which is coupled
`to the controller 70 over lines 82. The specific structure of
`the interface 80 is not critical to the invention. It may, for
`example, include a small display screen and a control panel
`for the selection of a mode of operation and an enrolled user
`
`6
`name. As will be discussed with reference to FIG. 7, a user
`may select a mode of operation on the user interface 80, and
`then render that mode active by placing a finger on one of
`the sensors 14 and 16 for identity verification.
`An important component of the fingerprint matching
`device 30 is a fingerprint correlator 84. In an enroll mode of
`correlator operation, the sensed fingerprint image, on line
`86, is processed to extract distinctive features of the image,
`which are transmitted over line 88 to a reference fingerprint
`memory 90. In a verification mode of operation, the corr-
`elator 84 compares a fingerprint image received over line 86
`with the fingerprint features stored in the memory 90 and
`transmitted to the correlator over line 92. The result of the
`
`10
`
`15
`
`correlation process is simply a match or no-match signal on
`line 94, which is coupled back to the fingerprint match
`controller 70.
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`The fingerprint correlator 84 performs the matching func-
`tion very rapidly by using special-purpose hardware in the
`form of an application-specific integrated circuit (ASIC),
`which employs a high degree of parallel processing to search
`an entire fingerprint image for instances of distinctive ref-
`erence features that have been previously stored in the
`memory 90. Aspecific form of the fingerprint correlator that
`can achieve the desired speed of matching is disclosed in a
`patent application by Bruce W. Evans et al., entitled “Fin-
`gerprint Feature Correlator,” filed concurrently with this
`application. The Evans et al. patent application is hereby
`incorporated by reference into this specification. Acorrelator
`constructed in accordance with the principles described in
`the Evans et al. specification is capable of verifying a user’s
`identity in less than a second, and closer to half a second if
`only one reference fingerprint image has to be compared
`with a sensed fingerprint image. The matching process can
`be easily arranged such that,
`in most cases, only one
`comparison is needed, since the user’s identity is usually
`known in advance.
`
`When a user’s identity has been verified by the fingerprint
`correlator 84,
`the fingerprint match controller 70 issues
`appropriate commands to an interface 96 with various
`actuators and controls described with reference to FIG. 5.
`
`Actuator settings are retrieved from a memory 98 and used
`to generate these commands.
`The structure and operation of the fingerprint match
`controller 70 is best illustrated in the form of a state diagram,
`as shown in FIG. 7. The state diagram shows (as circles) the
`principal operational modes or states of the controller 70 and
`the conditions needed to effect transfers from one state to
`another. The conditions are described in text associated with
`each transition line from one state to another. The two
`
`principal states of the controller 70 are the locked mode 100
`and the unlocked mode 102. In the locked mode, the car’s
`conventional ignition key switch (not shown) is disabled by
`another, series-connected, switch controlled by the finger-
`print matching device. In the locked mode, the doors may be
`either locked or unlocked. The car cannot bestarted in the
`
`locked mode 100 until the identity of an enrolled user is
`verified by the system. In the unlocked mode 102, the engine
`or ignition switch is enabled and the engine may be started
`by turning the ignition key or other device used for this
`purpose. To make the transition from locked to unlocked
`mode, a user first selects his or her enrolled identity on the
`user interface 80, and then places a finger over the interior
`sensor 16. If the exterior sensor 14 is used, the user cannot
`access the user interface, and simply places a finger over the
`sensor to unlock the car and transition to the unlocked mode,
`but without
`the ability to start
`the car. As previously
`mentioned, enabling starting the car still requires use of the
`
`Valeo Exhibit 1013_011
`
`Valeo Exhibit 1013_011
`
`

`
`6,100,811
`
`7
`interior sensor 16, but other user customization functions
`may be initiated from the external sensor 14. Employing the
`user interface 80 to specify a user identity potentially speeds
`up the verification process because the fingerprint match
`controller 70 does not have to search through multiple
`reference fingerprint images to find one that matches this
`user.
`
`In the unlocked mode 102, the car may be started and
`driven, and the various customization functions are per-
`formed to prepare the car for driving by the identified user.
`Transition back to the locked mode 100 occurs when the
`
`engine has been shut off for some short period, such as a
`minute or two. Thus, temporary engine stalls do not prevent
`the user from driving the vehicle.
`When a car is first purchased, it is delivered in a “cleared”
`mode 104, in which the engine controls are not locked and
`the car may be driven and delivered using a conventional
`ignition key. When a first user is enrolled,
`that user is
`designated the primary user. His or her fingerprint features
`are stored as the primary user’s and the controller 70
`assumes the unlocked mode 102. Enrollment includes the
`
`recording of the fingerprints of two fingers, preferably the
`index and ring fingers of the right hand. The second finger-
`print serves as a back-up feature, for use if a finger is injured
`or, for some reason, is ineffective in attempting to access or
`drive the car.
`
`The primary user may enroll others to be authorized to
`drive the car. The enrollment process is started by selecting
`a “set” mode in the user interface and having the primary
`user place his or her finger on the sensor. In the set mode
`106, other users, such as family members of the primary
`user, may have their fingerprints analyzed and recorded.
`Users may also be unenrolled in the set mode of operation.
`After enrollment, any of these additional users may enter
`and start the car with the same authority as the primary user.
`The primary user, however, has some additional powers that
`the additional users do not have. The primary user may
`select a combination mode 108 in the user interface 80 and,
`after fingerprint verification of the primary user, the con-
`troller 70 enters the combination mode. In this mode, which
`is useful for granting temporary, but still secured, access to
`an unenrolled driver, the unlocked mode 102 can only be
`reached by dialing a secret combination at
`the ignition
`switch. The primary user can disable the combination mode
`108 and go to the unlocked mode 102, upon fingerprint
`verification, and can also change the secret comb