United States Patent (19)
`Hsu et al.
`
`USOO6100811A
`Patent Number:
`11
`(45) Date of Patent:
`
`6,100,811
`*Aug. 8, 2000
`
`54 FINGERPRINT ACTUATION OF
`CUSTOMIZED VEHICLE FEATURES
`
`75 Inventors: Shi-Ping Hsu, Pasadena; Bruce W.
`Evans; Arthur F. Messenger, both of
`Redondo Beach; Denes L. Zsolnay,
`Rolling Hills Estates, all of Calif.
`73 Assignee: TRW Inc., Redondo Beach, Calif.
`*
`Notice:
`This patent issued on a continued pros-
`ecution application filed under 37 CFR
`1.53(d), and is subject to the twenty year
`patent term provisions of 35 U.S.C.
`154(a)(2
`(a)(2).
`21 Appl. No.: 08/995,564
`22 Filed
`Dec. 22, 1997
`9
`(51) Int. Cl. .................................................. G06F 7/04
`52 U.S. Cl. .................................. 340/825.31; 340/825.3;
`340/825.34; 340/430; 340/539; 340/825.69;
`382/115; 382/124; 382/125; 382/126
`58 Field of Search ............................ 340/825.31, 825.3,
`340/825.34, 430, 539, 825.69; 382/115,
`224, 126, 124, 125
`
`56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`4,451,887 5/1984 Harada et al. .......................... 364/424
`4,754.255
`6/1988 Sanders et al. ...
`... 340/430
`4,997,053 3/1991 Drori et al. ...
`... 180/287
`5,054,569 10/1991 Scott et al.........
`... 180/167
`5,067,162 11/1991 Driscoll, Jr. et al. ................... 382/126
`
`5,559,504 9/1996 Itsumi et al. ......................... 340/825.3
`5,572,597 11/1996 Chang et al. ........................... 382/125
`5,631,971
`5/1997 Sparrow .................................. 382/125
`5,802,199 9/1998 Pare, Jr. et al. ........................ 382/115
`Primary Examiner Michael Horabik
`ASSistant Examiner Yves Dalencourt
`Attorney, Agent, or Firm Michael S. Yatsko
`57
`ABSTRACT
`Apparatus, and a corresponding method for its use, for
`gaining access to and operating a vehicle, Such as a car (10),
`by means of at least one fingerprint Sensor (16) installed
`inside the vehicle at a convenient location and, optionally,
`outside the vehicle (at 14), in or near a door handle (12).
`Once an authorized user's identify has been verified in a
`fingerprint matching device (30), various vehicle Sub
`Systems are automatically adjusted to the identified user's
`preferred settings, which are stored in a memory (98). In
`addition, Starting the vehicle engine is enabled if an interior
`fingerprint Sensor has been used, or the vehicle is unlocked
`if an exterior fingerprint Sensor has been used. Vehicle
`Subsystems that are automatically adjusted to the user pref
`erences include seats (38), mirrors (40), steering wheel (42),
`climate control (44), airbag (52), telephone (46), radio (50)
`and onboard computer (54), as well as performance control
`features (48) Such as Suspension and transmission adjust
`ment. Door locks (34) and security system features (36) are
`also automatically controlled, as is a radio transmitter (56)
`that is automatically customized to open the user's home
`garage door or office parking entry gate. Features of a
`number of different fingerprints are stored in the device to
`allow for operation of the vehicle (10) by different family
`members, as authorized by a primary user.
`
`26 Claims, 7 Drawing Sheets
`
`
`
`
`
`16
`
`INTERIOR
`FINGERPRNT
`SENSOR
`
`| SCAN
`FINGER
`FINGER
`
`FNGERPRINT
`MATCHING
`DEVICE
`CHECKID
`
`TRANSMITTER
`CONTROL
`ACCESS
`
`6
`
`
`
`HOME GARAGE
`DOOR
`OPEN/CLOSE
`
`OFFICE
`PARKING GAE
`OPEN/CLOSE
`
`
`
`DOOR-
`MOUNTED
`FINGERPRINT
`SENSOR
`SCAN
`FINGER
`"INGER
`
`32
`
`-34
`DOOR LOCK
`LOCKW
`UNLOCK
`
`ENGINE
`RUNSTOP
`
`. ... ---
`
`
`
`SECURITY SYSTEM
`conTROLALARM
`CALL FOR HELP
`
`AIRBAG
`ADIUST
`FORCE
`
`44
`
`CIMATE
`CONTROL
`ADJUST
`TEMP
`
`SEERING
`WHEEL
`ADJUST
`POSN
`
`50
`
`
`
`ENTERTAIN
`MEN
`CENTER
`ADJUST
`RADIO
`
`SEATS 2:
`
`POSNS.
`
`
`
`
`
`MOBILE
`PHONE
`SELECT
`ACC, SET
`SPEED
`DAL
`
`MIRRORS
`ADJUST
`POSNS.
`-48
`PERF.
`CONTROL
`ADJUST
`SUSPN. &
`TRANSMN.
`
`N-CAR COMPUTER
`SELECT
`SUBSCRNS
`TRAFFIC
`weATHER
`
`MAIL
`APPOINT
`MENT BOOK
`
`DATA
`
`NAWIGA
`TION PREFS.
`SPEECH
`RECOGNTN
`SET VOICE
`PROFILE ||
`
`SPORTS
`
`IPR2022-00602
`Apple EX1039 Page 1
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 1 of 7
`
`6,100,811
`
`
`
`FIG 3
`
`IPR2022-00602
`Apple EX1039 Page 2
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 2 of 7
`
`6,100,811
`
`
`
`FIG. 4
`
`IPR2022-00602
`Apple EX1039 Page 3
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 3 of 7
`
`6,100,811
`
`
`
`LOATAS
`
`VLVG
`
`
`
`
`VIN
`
`es
`
`
`
`OVaYIV
`
`
`
`
`
`TSSHM
`
`LSNFAV
`
`‘NSOd
`
`
`
`
`3SOTOINIAO|
`
`
`
`
`
`
` SNYOSENS
`SL1YOdS
`
`MOOLNAW
`‘SddudNOIL
`‘NLNSOO4UY
`“LNIOddV
`“adHOLA
`“VOIAVN
`HOAAdS
`YALLINSNVaL
`
`JOULNOD
`
`
`LSNFaV
`FIMO
`
`
`0S“|-NIVLYSLNA
`LNIdYAONIS
`
`
`YOIYALNI
`YAONIS
`NVOS
`
` |dtMOFHO
`isnrav
`olaval
`ONIMSSLS
`LNIYdyAONIS
`ONIHOLVA
`‘NANSNVAYL?NdSNS
`JTOYLNOD
`
`
`SYOMYIA
`LOATAS
`
`NIDOT
`
`
`
`
`
`ADVYVSAIWOH
`
`YyOod
`
`
`
`ALVSONINYVd
`
`491440
`
`ASOTO/NAdO
`
`
`
`09
`
`g_7
`
`
`
`YALNdWODYVO-NI
`
`
`
`YOSNAS
`
`SDIAAG
`
`“dood
`
`QaLNNOW
`
`INIYddySONIA
`
`YOSNAS |HONE
`|NVOS
`A901YOO
`
`
`
`007
`
`MOOTNN
`
`ze”
`
`dOLS/NNY|ANIDNA
`
`
`
`WALSASALIMNOAS
`
`|FOIOAL4S
`
`FlAOdd
`
`
`
`‘Olas
`
`INaW
`
`SEMNES
`
`
`
`isnrayv
`LS“DOV
`
`dads
`
`WI
`
`‘AYAd
`
`ATGOW
`
`ANOHd
`
`
`
`Or
`
`
`
`isnrayv
`
`‘SNSOd
`
`
`
`SLVAS
`
`LSnrav
`
`‘SNSOd
`
`IPR2022-00602
`Apple EX1039 Page 4
`
`
`
`
`
`
`
`WaVIYTOYLNOD
`
`
`
`
`
`
`
`d13HYOdTIVO
`
`
`
`IPR2022-00602
`Apple EX1039 Page 4
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 4 of 7
`
`6,100,811
`
`16
`
`INTERIOR
`--- FINGERPRINT
`:
`SENSOR
`
`
`
`74
`
`DOOR-MOUNTED
`FNGERPRINT
`SENSOR
`
`:-----
`:
`
`USER INTERFACE
`(SELECT MODE,
`SELECT USER ID.)
`
`
`
`76 i- (... :
`(CONTROL)
`78-7
`
`- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
`
`FINEERINT
`CONTROLLER
`
`INTERFACE
`WITH
`
`ACTUATORS
`
`94
`
`86
`
`84
`
`
`
`SENSED
`FINGERPRINT ACTUATOR
`SETTINGS
`MEMORY
`
`FINGERPRINT
`MATCH | CORRELATOR
`
`ENROLL
`
`VERIFY
`92
`90
`
`88
`
`
`
`REFERENCE
`FINGERPRINT
`MEMORY
`
`F.G. 6
`
`IPR2022-00602
`Apple EX1039 Page 5
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 5 of 7
`
`6,100,811
`
`PRIMARY USER
`SELECTS COMBO MODE
`AND FINGERPRINTS
`VERIFED
`
`
`
`
`
`108
`
`COMB
`NATION
`MODE
`
`ENGINE OFFIN
`OMBINATION
`MODE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`LOCKED
`MODE
`
`1OO
`
`
`
`
`
`SECRET COMBIN
`NATION DIALED
`AT (GNITION
`
`PRIMARY USER
`EXITS COMBO MODE
`AND FINGERPRINTS
`VERIFIED
`
`ENROLLED USER
`SELECTS USER ID AND
`FINGERPRINTS
`VERIFED
`
`
`
`102
`
`UNLOCKED
`MODE
`
`ENGINE SHUT OFF FOR
`ONE MINUTE
`
`ENROLLED USER
`ENROLLED USER
`SELECTS GUEST MODE SELECTS USERDAND
`AND FINGERPRINT IS
`FINGERPRINTIS
`VERIFED
`VERIFED
`
`112
`
`GUEST
`MODE
`(NOT
`LOCKED)
`
`PRIMARY USER
`SELECTS SET MODE
`AND FINGERPRINT IS ON COMPLETION OF
`VERIFED
`ENROLLMENT OR
`UNENROLLMENT
`
`
`
`
`
`
`
`SERE
`(
`OR
`UNENROLL)
`
`ENROLL/UNENROLL
`ADDITIONAL USERS
`
`
`
`PRIMARY USER
`ENROLLED
`
`PRIMARY USER
`UNENROLLED
`
`TAMPERING
`DETECTED IN
`ANY MODE
`
`110
`
`CLEARED
`MODE
`
`104
`
`FIG. 7
`
`SECRET COMBINATION
`DALED
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IPR2022-00602
`Apple EX1039 Page 6
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 6 of 7
`
`6,100,811
`
`
`
`
`
`
`
`
`
`VERIFICATION
`
`
`
`SELECT NEXT MOST
`LIKELY REFERENCE
`FINGERPRINT
`
`ACTIVATE
`FINGERPRINT
`CORRELATOR
`
`USER
`OPTONA
`
`USER
`OPTION B
`
`USER
`OPTION C
`
`LAST USER PRIM USER
`PRIM USER
`ALLUSERS
`ADDL USERSADDLUSERS IN SELECTED
`INSELECTED IN SELECTED
`ORDER
`ORDER
`ORDER
`
`
`
`134
`
`138
`
`
`
`
`
`
`
`INTERIOR
`SENSOR
`USED?
`
`
`
`ENTER
`SELECTED
`MODE
`
`136
`
`
`
`ALLOW ONLY
`TRASITION FROM
`LOCKED TO
`UNLOCKED MODE
`
`*(IF OTHER USERS
`PERMITTED FOR THIS
`TYPE OF MODE
`TRANSITION)
`
`FG 8
`
`
`
`
`
`CHECKED
`BOTH USER
`FINGERSP
`
`
`
`130
`
`
`
`
`
`CHECKED
`ALL ENROLLED
`USERSP
`
`
`
`132
`
`Y
`
`DENY
`ACCESS
`
`IPR2022-00602
`Apple EX1039 Page 7
`
`

`

`U.S. Patent
`
`Aug. 8, 2000
`
`Sheet 7 of 7
`
`6,100,811
`
`UNLOCKED
`MODE
`
`
`
`
`
`DOOR
`SENSOR
`USED?
`
`102
`140
`
`
`
`14 2
`
`1
`44
`
`146
`
`148
`
`150
`
`
`
`UNLOCK
`ENGINE
`
`
`
`UNLOCK
`DOORS
`
`LOCK DOORS
`
`TURN OFF
`ALARM
`
`RETRIEVE
`ACTUATOR
`SETTINGS
`
`152
`
`CUSTOMIZE ALL VEHICLE SUBSYSTEM
`SETTINGS FOR IDENTIFIED USER
`
`
`
`
`
`154
`
`
`
`LEAVING
`UNLOCKED
`MODE?
`
`Y
`
`56
`1
`
`LOCK ENGINE
`
`158
`
`160
`
`1OO
`
`SAVE
`ACTUATOR
`SETINGS
`
`UPDATE
`USAGE LOG
`
`GO TO
`LOCKED
`MODE
`
`FIG. 9
`
`IPR2022-00602
`Apple EX1039 Page 8
`
`

`

`1
`FINGERPRINT ACTUATION OF
`CUSTOMIZED VEHICLE FEATURES
`BACKGROUND OF THE INVENTION
`The present invention relates generally to personal iden
`tification or verification Systems and, more particularly, to
`Systems that automatically verify a perSon's identity before
`granting access to a vehicle. Traditionally, keys and locks, or
`combination locks, have been used to limit access to
`property, on the theory that only perSons with a right to
`access the property will have the required key or combina
`tion. This traditional approach is, of course, Still widely used
`to limit access to a variety of enclosed spaces, including
`automobiles.
`Many automobiles are protected both by locks and by
`intrusion alarms, which are typically activated and deacti
`Vated using a Small radio or infrared transmitter carried by
`the car owner as a key-chain fob. Although this type of
`device is convenient, its loSS by the owner may render the
`vehicle just as Vulnerable to theft as if mechanical keys had
`been used for protection.
`Access to automobiles poses. Some special problems that
`have not been addressed by presently available Security
`Systems. Although fobs are widely used to transmit signals
`to a car Security System, for door acceSS and to activate and
`deactivate intrusion alarms, once in the car a car owner or
`user must typically resort to a mechanical key to Start the car.
`Moreover, Selection of customized features of the car, Such
`as Seat and mirror adjustments, must be made manually,
`although Some cars include a mechanism for memorizing
`Settings of the Some of the vehicle's main features.
`Accordingly, there is a widely felt need for a more reliable
`technique for accessing and using automobileS. Ideally, the
`technique should positively verify the identity of the person
`Seeking access, should provide access to all the car's
`features, and should eliminate the need to carry multiple
`keys and fobs, or to memorize combinations or passwords.
`Another desirable goal is that the technique should operate
`rapidly enough that it does not significantly delay a perSon's
`access to and use of the vehicle. The present invention
`Satisfies all of these needs.
`SUMMARY OF THE INVENTION
`The present invention resides in apparatus, and a method
`for its use, for automatically Verifying the identity of a
`perSon Seeking entry to and use of a protected vehicle.
`Briefly, and in general terms, the apparatus of the present
`invention comprises a fingerprint Sensor mounted in a con
`Venient interior location in a vehicle; a high-Speed finger
`print matcher, for comparing a Sensed fingerprint image with
`features of a previously Stored reference fingerprint image,
`to Verify the identity of a user of the vehicle; a fingerprint
`match controller, for Selecting from a plurality of Stored
`reference fingerprint images for presentation to the finger
`print matcher, and having a locked mode or operation and an
`unlocked mode of operation; an engine enabling Switch, to
`prevent operation of the vehicle in the locked mode; means
`included in the fingerprint match controller, for Switching
`from the locked mode to the unlocked mode upon Success
`fully verifying the identity of a vehicle user; means operable
`in the unlocked mode, for actuating the engine enabling
`Switch to allow operation of the vehicle; one or more
`actuators for adjusting vehicle Subsystems in accordance
`with users preferred Settings, Storage means for recording
`actuator Settings associated with user identities, and means
`operable in the unlocked mode, for operating the actuators
`based on Settings retrieved from the Storage means for an
`identified user.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6,100,811
`
`2
`More Specifically, the actuators may include a Seat adjust
`ment actuator, a mirror actuator, a Steering wheel position
`actuator, a climate control actuator, a mobile telephone
`actuator, a vehicle performance control actuator, an enter
`tainment device actuator, an airbag Setting actuator, and an
`onboard computer actuator.
`The illustrative embodiment of the invention also includes
`a Second fingerprint Sensor, mounted in a convenient eXte
`rior location on the vehicle. The fingerprint matching con
`troller includes means for determining which fingerprint
`Sensor has been used, and means for unlocking at least one
`vehicle passenger access door upon verification of the
`identity of a user placing a finger in the Second fingerprint
`Sensor. Preferably, the Second fingerprint Sensor is located
`near, or integrated into a door handle, for ease of operation
`while opening a door of the vehicle.
`The apparatus also includes means for Switching from the
`unlocked mode to the locked mode upon detection of engine
`non-operation for a Selected period of time. Thus, the vehicle
`may be driven, and even restarted after an engine Stall,
`without further identity verification, but will return to the
`locked mode once the engine has been shut down for a short
`time, Such as a minute or two.
`Ideally, the apparatus of the invention also includes a user
`interface for Selection of modes of operation and user
`identities. An authorized user can Speed up the Verification
`process by manually Selecting his or her own identity in the
`user interface, So that only one fingerprint matching opera
`tion is needed. An authorized user may also Select a new
`mode of operation at the user interface. The fingerprint
`match controller will automatically Switch to a new Selected
`mode of operation immediately upon Verification of the
`identity of a user.
`Among the modes of operation that may be Selected by a
`primary user are a “set' mode that permits enrollment of
`additional users. For this purpose, the apparatus further
`comprises means for obtaining and Storing reference finger
`print image data pertaining to additional users. Another
`mode that may be Selected is a "guest' mode that permits
`operation of the vehicle without fingerprint verification. Any
`enrolled user may request transition to or from the guest
`mode upon identity Verification.
`Another mode that may be Selected by the primary user of
`the vehicle is the “combination” mode, which permits opera
`tion of the vehicle without fingerprint Verification, but using
`a Secret combination.
`The apparatus of the invention may also be defined as
`comprising a fingerprint matching System for verifying the
`identity of a perSon who wishes to use the vehicle; an engine
`enabling Switch coupled to the fingerprint matching System,
`to prevent operation of the vehicle until the identity of the
`perSon has been verified; and at least one actuator for
`adjusting a vehicle Subsystem to an individually preferred
`Setting. The fingerprint matching System includes means,
`operable upon Successful verification of a user's identity, for
`retrieving personal preference data associated with the iden
`tified user and for Supplying Selected personal preference
`data to the actuator, for automatic adjustment of the vehicle
`Subsystem to the user's preference.
`The invention may also be defined in terms of a method
`for controlling a vehicle using fingerprint identification, the
`method comprising the Steps of Sensing a vehicle user's
`fingerprint image in a fingerprint Sensor mounted in a
`convenient location in the vehicle, Selecting from a plurality
`of previously stored reference fingerprint images of autho
`rized users of the vehicle; comparing the Sensed fingerprint
`
`IPR2022-00602
`Apple EX1039 Page 9
`
`

`

`6,100,811
`
`3
`image with features of the Selected previously stored refer
`ence fingerprint image of an authorized user of the vehicle;
`Verifying, in a fingerprint matching System, that the Sensed
`fingerprint image matches the Selected reference image;
`upon verification in the previous Step, Switching the finger
`print matching System from a locked mode to an unlocked
`mode and enabling operation of the vehicle; and actuating at
`least one vehicle Subsystem to conform with adjustment
`Settings associated with the identified vehicle user.
`The method may further comprise the Steps of Switching
`the fingerprint matching System to a guest mode upon
`Verification of an authorized user's fingerprint, wherein any
`driver may operate the vehicle while in guest mode, and
`Switching the fingerprint matching System back to the
`unlocked mode upon obtaining another verification of an
`authorized user. Further Steps of the method include Sensing
`when the vehicle engine has been inactive for a prescribed
`period of time; and then automatically Switching the finger
`print matching System back to the locked mode.
`The method may also include the Steps of Switching the
`fingerprint matching System to a “set' mode if requested by
`a primary authorized user; and enrolling additional users in
`the Set mode, by analyzing and Storing fingerprint features of
`the additional users. The method may then include unen
`rolling Selected users by removing their Stored fingerprint
`features. Unenrollment of the primary authorized user places
`the fingerprint matching System in a cleared mode in which
`no fingerprint matching is needed to operate the vehicle.
`In accordance with another feature of the invention, the
`method further comprises the Step of Switching the finger
`print matching System to a combination mode if requested
`by a primary authorized user. Operation of the vehicle in the
`combination mode does not require fingerprint matching but
`does require the use of a Secret combination. Leaving the
`combination mode requires the further Step of Switching the
`fingerprint matching System from the combination mode to
`the unlocked mode upon another verification of the primary
`user's identity in the fingerprint matching System.
`Finally, the method may also include the Step of recording
`usage data pertaining to the identified users and Selected
`parameters of vehicle operation.
`It will be appreciated from the foregoing that the present
`invention represents a significant advance in providing
`Secure access to vehicles. More particularly, the invention
`allows multiple users to gain entry to a vehicle and to have
`Selected vehicle Subsystem Settings adjusted to personal
`preferences automatically. Each authorized user enrolls at
`least one fingerprint in the apparatus of the invention. Then,
`upon entering or starting the vehicle, an authorized user has
`only to touch a fingerprint Sensor and the vehicle will be
`automatically adjusted to preferred Settings that were Saved
`when the user last operated the vehicle. Other aspects and
`advantages of the invention will become apparent from the
`following more detailed description, taken in conjunction
`with the accompanying drawings.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a fragmentary elevation View of a car, showing
`one location of an exterior fingerprint Sensor used in the
`present invention;
`FIG. 2 is a view similar to FIG. 1, but showing an
`alternative location for a fingerprint Sensor, integrated into a
`door handle;
`FIG. 3 is an enlarged view of the door handle shown in
`FIG. 2;
`FIG. 4 is a simplified fragmentary perspective drawing of
`a car interior, showing alternative locations for an interior
`fingerprint Sensor used in the present invention;
`
`1O
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`FIG. 5 is a block diagram showing the principal features
`and functions of the present invention;
`FIG. 6 is block diagram Showing a fingerprint match
`controller and other hardware components of the present
`invention;
`FIG. 7 is a State diagram depicting the various modes of
`operation of the fingerprint match controller of FIG. 6, and
`showing the conditions needed to effect transitions between
`different pairs of modes;
`FIG. 8 is a flowchart showing functions performed by the
`fingerprint match controller during verification of a finger
`print image; and
`FIG. 9 is a flowchart showing functions performed by the
`fingerprint match controller in an unlocked mode of opera
`tion.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`AS shown in the drawings for purposes of illustration, the
`present invention pertains to a System for automatic verifi
`cation of the identity of a perSon Seeking to enter and operate
`a car. Traditionally, cars are protected by mechanical lockS
`and keys, or by combination lockS or electronic devices,
`Such as hand-held fobs.
`In accordance with the present invention, the perSon
`Seeking access to a car, or wanting to Start the car, does So
`by first placing a finger over a conveniently located Sensor.
`The car user's fingerprint image is employed to control
`access though the car doors, to unlock the car engine, and to
`customize a number of car Subsystem features automatically
`to the personal preference of the user. FIG. 1 is an exterior
`view of part of a car, indicated by reference numeral 10,
`having a door handle 12 and a fingerprint Sensor 14 located
`adjacent to the door handle. The user gains access to the car
`10 by placing a finger, Such as the index finger, momentarily
`on the sensor 14. As will be discussed in more detail, the
`system of the invention has the ability to verify the identity
`of the user very rapidly, and to unlock the door (or all doors)
`upon completion of the Verification process.
`FIG. 2 is similar to FIG. 1, but shows an alternative
`location for the sensor 14, on the underside of the door
`handle 12, as best shown in FIG. 3. This approach works
`best for door handles of the recessed type that have to be
`pivoted out of a receSS by placing a finger beneath the handle
`and pulling it out.
`FIG. 4 shows four possible locations for an interior sensor
`16: (a) near the position of a conventional ignition key
`Switch on the car Steering column 18, as indicated at 16a, (b)
`on the car dashboard 20, such as shown at 16b, (c), on the
`central console 22, as indicated at 16c, or (d) on a centrally
`mounted parking brake lever 24, as indicated at 16d.
`FIG. 5 shows the principal functions controlled in asso
`ciation with the fingerprint sensors 14 and 16, both of which
`are connected to a fingerprint matching device 30 in the car
`10. The fingerprint matching device 30 matches the finger
`print image obtained by one of the Sensors with one or more
`internally Stored reference fingerprint images obtained from
`the principal car user and a number of other frequent users
`who wish to be enrolled to use the car. If a match is
`determined, the fingerprint matching device 30 transmits
`control Signals to a number of car Subsystems. Principal
`among these Subsystems is an engine control Switch 32 and
`a door locking Switch 34. It will be understood that, for most
`cars, the exterior fingerprint Sensor 14 will be used to unlock
`the car and to disable a security system 36, but not to enable
`
`IPR2022-00602
`Apple EX1039 Page 10
`
`

`

`S
`the engine control Switch 32. One approach for accomplish
`ing a division of functions between the exterior and interior
`sensors 14 and 16 is further discussed below.
`In addition to the more essential functions of engine
`enabling, door unlocking and control of Security alarms, the
`fingerprint matching device 30 also performs a number of
`control functions that customize the car for the user whose
`identity has been verified. Thus, as soon as the driver's
`identity has been verified through one of the sensors 14 or
`16, actuator control signals are transmitted to the car Seats
`38, mirrors 40, steering wheel 42, climate control 44, mobile
`telephone 46, vehicle performance controls 48, entertain
`ment center 50, airbag controls 52, in-car computer 54, and
`radio transmitter 56. The Seats, mirrors, Steering wheel,
`climate control and airbag control are adjusted to the Settings
`preferred by the identified user. In the case of the airbag
`controls 52, adjustment is made on the basis of the user's
`previously Sensed weight, height, or both. These and other
`adjustments are made on the basis of positional Settings that
`were memorized when the Same user last drove the car.
`Performance controls may include Suspension and transmis
`Sion Settings that were either previously Selected by the user
`or were Stored after automatically adjusting to the user's
`weight or other characteristics.
`The entertainment center adjustments 50 include preset
`Stations Stored by user when previously in the car, and a
`Selection of compact disks or other music media previously
`Selected. If the user is new to the car, no Settings will be
`available but Selections made while operating the vehicle
`will be stored for use when the same user drives on a later
`occasion. The mobile telephone controls 46 make an appro
`priate Selection of a telephone account for the user, and
`retrieve a list of speed-dial numbers previously stored by the
`USC.
`The radio transmitter controls 56 are used to enable a
`transmitter for opening a home garage door, as indicated at
`58, or an office parking access gate, as indicated at 60. Since
`each user may have different requirements in this regard,
`customized frequencies or control Signals are Stored for each
`user. Programming these Selections into the System is
`accomplished either by manually entering the data or by
`utilizing a “training” mode in which Signals from each user's
`Separate garage door opener and parking gate opener or
`transponder are captured and analyzed.
`If the car has an onboard computer 54, the user's verified
`identity may be used to log in automatically, to fetch any
`electronic mail (e-mail), to retrieve the user's appointment
`book, navigation System preferences, and speech profile (to
`condition the computer to accept voice commands from the
`user). The user's personal preferences for Subscription data
`Services may also be initialized in the computer, Such as data
`Subscriptions to Services pertaining to traffic, weather,
`Stocks, news, or Sports.
`FIG. 6 shows the principal hardware components of the
`fingerprint checking device 30. The fingerprint Sensors 14
`and 16 interface with a fingerprint match controller 70, the
`structure and function of which will be described with
`reference to FIGS. 7–9. The controller 70 receives finger
`print image data over lines 72 and 74 from the sensors 14
`and 16, and transmits control Signals to the Sensors over
`lines 76 and 78, respectively. The fingerprint matching
`device 30 also includes a user interface 80, which is coupled
`to the controller 70 over lines 82. The specific structure of
`the interface 80 is not critical to the invention. It may, for
`example, include a Small display Screen and a control panel
`for the Selection of a mode of operation and an enrolled user
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6,100,811
`
`6
`name. As will be discussed with reference to FIG. 7, a user
`may select a mode of operation on the user interface 80, and
`then render that mode active by placing a finger on one of
`the sensors 14 and 16 for identity verification.
`An important component of the fingerprint matching
`device 30 is a fingerprint correlator 84. In an enroll mode of
`correlator operation, the Sensed fingerprint image, on line
`86, is processed to extract distinctive features of the image,
`which are transmitted over line 88 to a reference fingerprint
`memory 90. In a verification mode of operation, the corr
`elator 84 compares a fingerprint image received over line 86
`with the fingerprint features stored in the memory 90 and
`transmitted to the correlator over line 92. The result of the
`correlation process is simply a match or no-match Signal on
`line 94, which is coupled back to the fingerprint match
`controller 70.
`The fingerprint correlator 84 performs the matching func
`tion very rapidly by using Special-purpose hardware in the
`form of an application-specific integrated circuit (ASIC),
`which employs a high degree of parallel processing to Search
`an entire fingerprint image for instances of distinctive ref
`erence features that have been previously Stored in the
`memory 90. A specific form of the fingerprint correlator that
`can achieve the desired speed of matching is disclosed in a
`patent application by Bruce W. Evans et al., entitled “Fin
`gerprint Feature Correlator, filed concurrently with this
`application. The Evans et al. patent application is hereby
`incorporated by reference into this specification. A correlator
`constructed in accordance with the principles described in
`the Evans et al. Specification is capable of Verifying a user's
`identity in less than a Second, and closer to half a Second if
`only one reference fingerprint image has to be compared
`with a sensed fingerprint image. The matching process can
`be easily arranged Such that, in most cases, only one
`comparison is needed, Since the user's identity is usually
`known in advance.
`When a user's identity has been verified by the fingerprint
`correlator 84, the fingerprint match controller 70 issues
`appropriate commands to an interface 96 with various
`actuators and controls described with reference to FIG. 5.
`Actuator settings are retrieved from a memory 98 and used
`to generate these commands.
`The Structure and operation of the fingerprint match
`controller 70 is best illustrated in the form of a state diagram,
`as shown in FIG. 7. The state diagram shows (as circles) the
`principal operational modes or states of the controller 70 and
`the conditions needed to effect transferS from one State to
`another. The conditions are described in text associated with
`each transition line from one State to another. The two
`principal states of the controller 70 are the locked mode 100
`and the unlocked mode 102. In the locked mode, the car's
`conventional ignition key Switch (not shown) is disabled by
`another, Series-connected, Switch controlled by the finger
`print matching device. In the locked mode, the doors may be
`either locked or unlocked. The car cannot beStarted in the
`locked mode 100 until the identity of an enrolled user is
`verified by the system. In the unlocked mode 102, the engine
`or ignition Switch is enabled and the engine may be started
`by turning the ignition key or other device used for this
`purpose. To make the transition from locked to unlocked
`mode, a user first Selects his or her enrolled identity on the
`user interface 80, and then places a finger over the interior
`Sensor 16. If the exterior Sensor 14 is used, the user cannot
`access the user interface, and Simply places a finger over the
`Sensor to unlock the car and transition to the unlocked mode,
`but without the ability to start the car. As previously
`mentioned, enabling Starting the car Still requires use of the
`
`IPR2022-00602
`Apple EX1039 Page 11
`
`

`

`7
`interior Sensor 16, but other user customization functions
`may be initiated from the external Sensor 14. Employing the
`user interface 80 to specify a user identity potentially Speeds
`up the verification process because the fingerprint match
`controller 70 does not have to search through multiple
`reference fingerprint images to find one that matches this
`USC.
`In the unlocked mode 102, the car may be started and
`driven, and the various customization functions are per
`formed to prepare the car for driving by the identified user.
`Transition back to the locked mode 100 occurs when the
`engine has been shut off for Some short period, Such as a
`minute or two. Thus, temporary engine Stalls do not prevent
`the user from driving the vehicle.
`When a car is first purchased, it is delivered in a “cleared”
`mode 104, in which the engine controls are not locked and
`the car may be driven and delivered using a conventional
`ignition key. When a first user is enrolled, that user is
`designated the primary user. His or her fingerprint features
`are stored as the primary user's and the controller 70
`assumes the unlocked mode 102. Enrollment includes the
`recording of the fingerprints of two fingers, preferably the
`indeX and ring fingers of the right hand. The Second finger
`print Serves as a back-up feature, for use if a finger is injured
`or, for Some reason, is ineffective in attempting to access or
`drive the car.
`The primary user may enroll others to be authorized to
`drive the car. The enrollment proceSS is started by Selecting
`a “Set' mode in the user interface and having the primary
`user place his or her finger on the Sensor. In the Set mode
`106, other users, such as family members of the primary
`user, may have their fingerprints analy