( 12 ) United States Patent
`Lamego
`
`( 10 ) Patent No .: US 10,524,671 B2
`( 45 ) Date of Patent :
`* Jan . 7 , 2020
`
`USO10524671B2
`
`( 54 ) ELECTRONIC DEVICE THAT COMPUTES
`HEALTH DATA
`( 71 ) Applicant : Apple Inc. , Cupertino , CA ( US )
`Inventor : Marcelo M. Lamego , Cupertino , CA
`( 72 )
`( US )
`( 73 ) Assignee : Apple Inc. , Cupertino , CA ( US )
`Subject to any disclaimer , the term of this
`( * ) Notice :
`patent is extended or adjusted under 35
`U.S.C. 154 ( b ) by 185 days .
`This patent is subject to a terminal dis
`claimer .
`( 21 ) Appl . No .: 15 / 667,832
`Aug. 3 , 2017
`( 22 ) Filed :
`( 65 )
`Prior Publication Data
`US 2017/0354332 A1 Dec. 14 , 2017
`Related U.S. Application Data
`Continuation of application No. 14 / 617,422 , filed on
`Feb. 9 , 2015 , now Pat . No. 9,723,997 .
`( Continued )
`
`( 63 )
`
`Int . Cl .
`A61B 5/0205
`A61B 5/00
`
`U.S. CI .
`CPC
`
`( 51 )
`
`( 52 )
`
`( 58 )
`
`( 2006.01 )
`( 2006.01 )
`( Continued )
`
`A61B 5/0205 ( 2013.01 ) ; A61B 5/0402
`( 2013.01 ) ; A61B 5/14551 ( 2013.01 ) ;
`( Continued )
`Field of Classification Search
`CPC
`A61B 5/0205 ; A61B 5/007 ; A61B 5/0402 ;
`A61B 5/14551 ; A61B 5/6898 ; A61B
`5/70 ;
`
`( Continued )
`
`( 56 )
`
`References Cited
`U.S. PATENT DOCUMENTS
`7,486,386 B1
`7,729,748 B2
`
`2/2009 Holcombe
`6/2010 Florian
`( Continued )
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`
`5/2012
`102483608
`7/2014
`203732900
`( Continued )
`
`OTHER PUBLICATIONS
`Ohgi et al . , “ Stroke phase discrimination in breaststroke swimming
`using a tri - axial acceleration sensor device , ” Sports Engineering ,
`vol . 6 , No. 2 , Jun . 1 , 2003 , pp . 113-123 .
`( Continued )
`Primary Examiner Paula J Stice
`( 74 ) Attorney , Agent , or Firm
`Brownstein Hyatt Farber
`Schreck , LLP
`( 57 )
`ABSTRACT
`An electronic device includes a camera , an ambient light
`sensor , and a proximity sensor . The electronic device uses
`one or more of the camera and the proximity sensor to emit
`light into a body part of a user touching a surface of the
`electronic device and one or more of the camera , the ambient
`light sensor , and the proximity sensor to receive at least part
`of the emitted light reflected by the body part of the user . The
`electronic device computes health data of the user based
`upon sensor data regarding the received light . In some
`implementations , the electronic device may also include one
`or more electrical contacts that contact one or more body
`parts of the user . In such implementations , the health data
`may be further computed based on the an electrical mea
`surement obtained using the electrical contacts .
`20 Claims , 7 Drawing Sheets
`
`100
`
`106 105 104
`
`07
`
`4 0 103
`
`-108
`
`-102
`
`*
`
`10
`
`1076
`
`-1-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`US 10,524,671 B2
`Page 2
`
`Related U.S. Application Data
`( 60 ) Provisional application No. 62 / 056,299 , filed on Sep.
`26 , 2014 .
`( 51 ) Int . Ci .
`A61B 5/1455
`A61B 5/0402
`A61B 5/021
`A61B 5/024
`A61B 5/026
`A61B 5/053
`( 52 ) U.S. CI .
`CPC
`
`( 2006.01 )
`( 2006.01 )
`( 2006.01 )
`( 2006.01 )
`( 2006.01 )
`( 2006.01 )
`
`A61B 5/6898 ( 2013.01 ) ; A61B 5/70
`( 2013.01 ) ; A61B 5/7203 ( 2013.01 ) ; A61B
`5/742 ( 2013.01 ) ; A61B 5/7405 ( 2013.01 ) ;
`A61B 5/7455 ( 2013.01 ) ; A61B 5/021
`( 2013.01 ) ; A61B 5/0261 ( 2013.01 ) ; ACIB
`5/02416 ( 2013.01 ) ; A61B 5/0537 ( 2013.01 )
`Field of Classification Search
`A61B 5/703 ; A61B 5/4705 ; A61B 5/7455 ;
`CPC
`A61B 5/02055 ; A61B 5/021 ; A61B
`5/02416 ; A61B 5/02438 ; A61B 5/0245 ;
`A61B 5/0261 ; A61B 5/0537
`See application file for complete search history .
`References Cited
`U.S. PATENT DOCUMENTS
`
`( 58 )
`
`( 56 )
`
`7,822,469 B2
`7,915,601 B2
`7,957,762 B2
`8,954,135 B2
`8,988,372 B2
`9,042,971 B2 *
`9,100,579 B2
`9,348,322 B2
`9,485,345 B2
`9,557,716 B1
`9,620,312 B2
`9,627,163 B2
`9,723,997 B1
`9,848,823 B2
`10,123,710 B2
`10,126,194 B2
`
`10/2010 Lo
`3/2011 Setlak et al .
`6/2011 Herz et al .
`2/2015 Yuen et al .
`3/2015 Messerschmidt et al .
`5/2015 Brumback ......... A61B 5/02438
`600/509
`8/2015 Schatvet et al .
`5/2016 Fraser et al .
`11/2016 Dantu
`1/2017 Inamdar
`4/2017 Ely et al .
`4/2017 Ely et al .
`8/2017 Lamego
`12/2017
`ghuram et al .
`11/2018 Gassoway et al .
`11/2018 Lee
`
`A61B 5/02055
`600/301
`
`2011/0015496 A1
`2013/0310656 A1
`2014/0128690 A1 *
`
`1/2011 Sherman et al .
`11/2013 Lim
`5/2014 LeBoeuf
`
`2014/0275832 Al
`2016/0058313 A1
`2016/0058309 Al
`2016/0058375 A1
`2016/0198966 A1
`2016/0242659 Al
`2016/0338598 A1
`2016/0338642 Al
`2016/0349803 A1
`2016/0378071 Al
`2017/0011210 A1
`2017/0090599 Al
`2017/0181644 Al
`2017/0354332 A1
`2019/0072912 A1
`2019/0090806 Al
`2019/0101870 A1
`2019/0220069 Al
`
`9/2014 Muehlsteff et al .
`2/2016 Weil et al .
`3/2016 Han
`3/2016 Rothkopf
`7/2016 Uernatsu et al .
`8/2016 Yamashita et al .
`11/2016 Kegasawa
`11/2016 Parara et al .
`12/2016 Dusan
`12/2016 Rothkopf
`1/2017 Cheong et al .
`3/2017 Kuboyama et al .
`6/2017 Meer et al .
`12/2017 Lamego
`3/2019 Pandya et al .
`3/2019 Harrison - Noonan et al .
`4/2019 Pandya et al .
`7/2019 Dusan
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`CN
`JP
`KR
`TW
`TW
`WO
`WO
`WO
`
`104050444
`105339871
`106462665
`2001145607
`1020160145284
`201610621
`201621491
`WO 15/030712
`WO 16/040392
`WO 16/204443
`
`9/2014
`2/2016
`2/2017
`5/2001
`12/2016
`3/2016
`6/2016
`3/2015
`3/2016
`12/2016
`
`OTHER PUBLICATIONS
`Zijlstra et al . , “ Assessment of spatio - temporal gait parameters from
`trunk accelerations during human walking , ” Gait & Posture , vol .
`18 , No. 2 , Oct. 1 , 2003 , pp . 1-10 .
`U.S. Appl . No. 16 / 118,254 , filed Aug. 30 , 2018 , Harrison - Noonan
`et al .
`U.S. Appl . No. 16 / 118,282 , filed Aug. 30 , 2018 , Clavelle et al .
`U.S. Appl . No. 16 / 193,836 , filed Nov. 16 , 2018 , Pandya et al .
`U.S. Appl . No. 15 / 296,681 , filed Apr. 25 , 2017 , Dusan .
`Onizuka et al . , Head Ballistocardiogram Based on Wireless Multi
`Location Sensors , 2015 EEE , pp . 1275-1278 .
`* cited by examiner
`
`-2-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 1 of 7
`
`US 10,524,671 B2
`
`106 105
`
`O
`
`103
`
`- 102
`
`1076
`
`-3-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 2 of 7
`
`US 10,524,671 B2
`
`202
`
`01
`
`DERWYWA
`
`1076
`
`( )
`
`o
`
`-4-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 3 of 7
`
`US 10,524,671 B2
`
`202
`
`1078
`
`111
`
`301
`
`+
`
`304
`
`303
`
`PROGRESS
`
`O
`
`1076
`
`O
`
`-5-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 4 of 7
`
`US 10,524,671 B2
`
`ul
`
`202
`
`107a
`
`22
`
`120
`
`PR
`
`p %
`2,5
`
`ECG whawhich
`PPG in
`( 0 )
`
`e
`
`- 1075
`
`-6-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 5 of 7
`
`US 10,524,671 B2
`
`USE AT LEAST ONE OF CAMERA AND A PROXIMITY SENSOR TO EMIT
`LIGHT INTO A BODY PART OF A USER TOUCHING A SURFACE OF THE DEVICE
`
`USE AT LEAST ONE OF THE CAMERA , AN AMBIENT LIGHT SENSOR , OR THE
`PROXIMITY SENSOR TO RECEIVE AT LEAST PART OF THE EMITTED LIGHT
`REFLECTED BY THE BODY PART OF THE USER
`
`COMPUTE HEALTH DATA OF THE USER BASED AT LEAST UPON
`SENSOR DATA REGARDING THE RECEIVED LIGHT
`
`PROVIDE THE COMPUTED HEALTH DATA FOR THE USER
`
`502
`
`503
`
`- 504
`
`-7-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 6 of 7
`
`US 10,524,671 B2
`
`DETECT , UTILIZING A CAMERA , A PROFILE OF A BODY PART OF
`A USER CONTACTING THE CAMERA
`
`USE THE PROFILE , IF THE BODY PART IS MISALIGNED WITH A
`COMBINATION OF THE CAMERA , AN AMBIENT LIGHT SENSOR , AND A
`PROXIMITY SENSOR FOR PURPOSES OF OBTAINING HEALTH DATA
`FOR THE USER
`
`PROVIDE GUIDANCE TO CORRECT THE MISALIGNMENT
`
`FIG . 6
`
`-8-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`U.S. Patent
`
`Jan. 7 , 2020
`
`Sheet 7 of 7
`
`US 10,524,671 B2
`
`ELECTRONIC DEVICE
`
`701
`
`PROCESSING UNIT
`
`CAMERA
`
`702
`
`STORAGE
`MEDIUM
`
`703
`
`COMMUNICATION
`COMPONENT
`
`108
`
`DISPLAY
`
`PROXIMITY
`SENSOR
`
`COMPONENT
`
`ELECTRICAL
`CONTACTS
`
`ELECTRICAL
`CONTACTS
`
`101
`
`- 704
`
`107a
`
`1076
`
`-9-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`5
`
`30
`
`SUMMARY
`
`1
`ELECTRONIC DEVICE THAT COMPUTES
`HEALTH DATA
`
`US 10,524,671 B2
`
`TECHNICAL FIELD
`This disclosure relates generally to health data , and more
`specifically to an electronic device that computes health data
`BACKGROUND
`
`2
`health data of the user , utilizing the processing unit , using at
`least the sensor data regarding the received light .
`In some embodiments , a method for using a mobile
`personal computing device to obtain health data may
`CROSS - REFERENCE TO RELATED
`include : using at least one of camera and a proximity sensor
`APPLICATION
`to emit light into a body part of a user touching a surface of
`the device ; using at least one of the camera , an ambient light
`This application is a continuation of U.S. patent applica
`sensor , or the proximity sensor to receive at least part of the
`tion Ser . No. 14 / 617,422 , filed Feb. 9 , 2015 , and entitled
`emitted light reflected by the body part of the user and
`“ Electronic Device that Computer Health Data , ” which
`claims the benefit under 35 U.S.C. § 119 ( e ) of U.S. Provi . 10 generate sensor data ; and computing health data of the user ,
`utilizing the processing unit , using at least the sensor data
`sional Patent Application No. 62 / 056,299 , filed on Sep. 26 ,
`regarding the received light .
`2014 , and entitled “ Electronic Device that Computes Health
`In one or more embodiments , a method for guiding use of
`Data , ” both of which are incorporated by reference as if fully
`a mobile personal computing device to obtain health data
`may include : detecting , utilizing a camera , a profile of a
`disclosed herein .
`15 body part of a user contacting the camera ; determining ,
`using the profile , if the body part is misaligned with a
`combination of the camera , an ambient light sensor , and a
`proximity sensor for purposes of obtaining health data for
`the user ; and providing guidance to correct the misalign
`20 ment .
`In various embodiments , a computer program product
`including a non - transitory storage medium may include a
`first set of instructions , stored in the non - transitory storage
`It may be beneficial for a user to have information about
`medium , executable by at least one processing unit to use at
`his or her health data , including fitness data and wellness
`data . For example , health data may indicate emergency 25 least one of a camera and a proximity sensor to emit light
`into a body part of a user touching a surface of a mobile
`conditions or to enable the user to maximize fitness or
`personal computing device ; a second set of instructions ,
`wellness activities . Traditionally , health data is provided to
`stored in the non - transitory storage medium , executable by
`users by health care professionals . However , it may be
`the least one processing unit to use at least one of the
`beneficial for users to have more access to health data .
`camera , an ambient light sensor , or the proximity sensor to
`receive at least part of the emitted light reflected by the body
`part of the user and generate sensor data ; and a third set of
`instructions , stored in the non - transitory storage medium ,
`executable by the least one processing unit to compute
`The present disclosure discloses systems , apparatuses ,
`health data of the user using at least the sensor data regard
`and methods related to an electric device that computes
`health data . An electronic device may include a camera , an 35 ing the received light .
`ambient light sensor , and a proximity sensor . The electronic
`It is to be understood that both the foregoing general
`device may use one or more of the camera and the proximity
`description and the following detailed description are for
`sensor to emit light into a body part of a user touching a
`purposes of example and explanation and do not necessarily
`limit the present disclosure . The accompanying drawings ,
`surface of the electronic device and one or more of the
`camera , the ambient light sensor , and the proximity sensor 40 which are incorporated in and constitute a part of the
`to receive at least part of the emitted light reflected by the
`specification , illustrate subject matter of the disclosure .
`body part of the user . The electronic device may compute
`Together , the descriptions and the drawings serve to explain
`health data of the user based upon sensor data regarding the
`the principles of the disclosure .
`received light . In some implementations , the electronic
`device may also include one or more electrical contacts that 45
`BRIEF DESCRIPTION OF THE DRAWINGS
`contact one or more body parts of the user . In such imple
`for
`mentations , the health data may be further computed based
`FIG . 1 is an isometric view an example system
`on the an electrical measurement obtained using the elec
`obtaining health data utilizing an electronic device .
`trical contacts .
`FIG . 2 illustrates the view of FIG . 1 while the example
`In some implementations , the electronic device may uti- 50 system is being utilized to obtain health data .
`lize the camera to determine the user's body part is mis
`FIG . 3 illustrates the view of FIG . 2 while the example
`aligned with the camera , the ambient light sensor , and the
`system is providing guidance to obtain health data .
`proximity sensor for purposes of detecting the information
`FIG . 4 illustrates the view of FIG . 2 while the example
`about the body part of the user . In such implementations , the
`system is providing the obtained health data .
`electronic device may provide guidance to correct the mis- 55
`FIG . 5 is a flow chart illustrating an example method for
`alignment .
`using an electronic device to obtain health data . This method
`In various embodiments , a mobile personal computing
`may be performed by the system of FIG . 1 .
`FIG . 6 is a flow chart illustrating an example method for
`device may include a camera , an ambient light sensor , a
`proximity sensor , and a processing unit communicably
`guiding use of an electronic device to obtain health data .
`coupled to the camera , the ambient light sensor , and the 60 This method may be performed by the system of FIG . 1 .
`proximity sensor . The processing unit may be configured to :
`FIG . 7 is a block diagram illustrating functional relation
`use at least one of camera and a proximity sensor to emit
`ships among components of the example system of FIG . 1 .
`light into a body part of a user touching a surface of the
`mobile personal computing device ; use at least one of the
`DETAILED DESCRIPTION
`camera , an ambient light sensor , or the proximity sensor to 65
`receive at least part of the emitted light reflected by the body
`The description that follows includes sample systems ,
`part of the user and generate sensor data ; and computing
`apparatuses , and methods that embody various elements of
`
`-10-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`US 10,524,671 B2
`
`3
`4
`the present disclosure . However , it should be understood that
`some implementations , the electronic device may provide
`the described disclosure may be practiced in a variety of
`the computed health data to the user .
`FIG . 1 is an isometric view an example system 100 for
`forms in addition to those described herein .
`The present disclosure details systems , apparatuses , and
`obtaining health data utilizing an electronic device . As
`methods related to an electric device that computes health 5 illustrated , the system may include an electronic device 101 .
`data . An electronic device ( such as a smart phone , tablet
`The electronic device is shown as a smart phone . However ,
`computer , mobile computer , digital media player , wearable
`it is understood that this is an example . In various imple
`device , or other electronic device ) may include a camera , an
`mentations , the electronic device may be any kind of elec
`ambient light sensor , and a proximity sensor . The electronic
`tronic device such as any kind of mobile personal computing
`device may use one or more of the camera and the proximity 10 device ( such as a smart phone , tablet computer , a mobile
`sensor to emit light into a body part of a user ( such as a
`computer , a digital media player , a cellular telephone , a
`finger , and ear , and so on ) touching a surface of the elec
`laptop computer , a wearable device , and so on ) , a desktop
`tronic device . The electronic device may use one or more of
`computer , a display , and / or any other electronic device .
`the camera , the ambient light sensor , and the proximity
`As also illustrated , the electronic device 101 may include
`sensor to receive at least part of the emitted light reflected by 15 a housing 102 with a surface 103 where a camera 104 , an
`the body part of the user . The electronic device may compute
`ambient light sensor 105 , and a proximity sensor 106 are
`health data of the user based upon sensor data regarding the
`positioned . As illustrated in FIG . 2 , the camera , ambient
`received light . In this way , the health data of the user may
`light sensor , and proximity sensor may be positioned such
`be detected utilizing an electronic device including a cam
`that they are partially or entirely covered ( and / or contacted )
`era , ambient light sensor , and proximity sensor without 20 by the body part 202 of a user ( illustrated as a finger though
`making the user obtain access to a dedicated fitness and / or
`such a body part may be an ear , a palm , and / or other body
`part of the user ) at the same time . At such a time , the
`wellness device .
`In various implementations , the camera , ambient light
`electronic device may compute health data for the user .
`Traditionally , a camera may be capture images using a
`sensor , and proximity sensor may be positioned such that
`they are all at least partially covered ( and / or contacted ) by 25 visible light imaging sensor and a lens focused at a focal
`the user's body part at the same time , such as when the
`distance away from the lens , an ambient light sensor may
`health data is computed . In one or more implementations ,
`use a broad range photodiode or similar non - imaging light
`the electronic device may also include electrical contacts .
`detector to determine ambient light conditions , and a prox
`The health data of the user may also be computed using an
`imity sensor may use a limited range light source ( such as an
`electrical measurement obtained using from the electrical 30 infrared light emitting diode or “ LED " ) to emit limited range
`contacts . In some examples of such implementations , the
`light and a limited range non - imaging light detector to detect
`electrical contacts may be positioned to contact the body
`if the emitted limited range light is reflected by one or more
`part of the user and an additional body part such that
`object to determine whether or not such an object is proxi
`electrical measurement represents the electrical properties of
`mate to the proximity sensor . However , the electronic device
`organs or portions of the body located between the two 35 101 may camera 104 , the ambient light sensor 105 , and the
`contacting body parts . In some embodiments , the two body
`proximity sensor 106 in non - traditional ways to detect
`parts are the user's left and right hands and the electrical
`information about the body part 202 .
`measurement corresponds to an electrical property that is
`The electronic device 101 may use one or more of the
`camera 104 and the proximity sensor 106 to emit light into
`measured across the user's chest .
`In some implementations , the electronic device may uti- 40 a body part 202 of a user touching a surface 103 of the
`electronic device . The electronic device may use one or
`lize the camera to determine the user's body part is mis
`aligned with the camera , the ambient light sensor , and the
`more of the camera , the ambient light sensor 105 , and the
`proximity sensor for purposes of detecting the information
`proximity sensor to receive at least part of the emitted light
`about the body part of the user . In such implementations , the
`reflected by the body part of the user . The electronic device
`electronic device may provide guidance ( such as visual , 45 may compute health data of the user based upon sensor ( such
`audio , haptic , and / or other guidance ) to correct the misalign
`as the camera , the ambient light sensor , and / or the proximity
`ment . The information from the camera may be utilized to
`sensor ) data regarding the received light .
`detect this misalignment even in implementations where the
`For example , one or more of the camera 104 , the ambient
`camera is configured with a focal distance greater than a
`light sensor 105 , and the proximity sensor 106 may receive
`distance between the camera and the user's body part when 50 light reflected off of the body part 202 of the user . Such light
`the user's body part is touching the surface of the electronic
`may originate from one or more of the camera ( in imple
`mentations where the camera includes a light source such as
`device .
`In various implementations , the proximity sensor may be
`a LED used as a flash ) , the ambient light sensor ( which may
`a multiple light wavelength sensor ( such as a sensor that
`be a non - imaging photodiode in some implementations ) , the
`utilizes infrared and visible light , infrared and red light , and 55 proximity sensor ( such as in implementations where the
`so on ) . In some implementations , the ambient light sensor
`proximity sensor is a non - imaging photodiode and one or
`may be a silicon ambient light sensor , an indium gallium
`more LEDs that determine proximity by measuring the time
`arsenide ambient light sensor , and / or other kind of ambient
`between transmission of light by the LED and receipt of the
`light sensor . In various implementations , the camera may be
`light by the non - imaging photodiode after reflection off of an
`60 object such as the body part 202 of the user ) , and / or other
`both an infrared and visible light camera .
`The health data may include one or more of a variety of
`light source . The electronic device 101 may analyze sensor
`different wellness , fitness , and / or other parameters relating
`data regarding the received light and compute information
`to the health of a user . For example , in various implemen
`such as the light absorption of the body part . Various health
`tations the health data may include : a blood pressure index ,
`data for the user may be computed from the computed light
`a blood hydration , a body fat content , an oxygen saturation , 65 absorption of the body part .
`a pulse rate , a perfusion index , an electrocardiogram , a
`By way of illustration , sensor data regarding the received
`photoplethysmogram , and / or any other such health data . In
`light may be used to estimate changes in the volume of the
`
`-11-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`US 10,524,671 B2
`
`5
`6
`user ( such as during the time when the information is being
`body part 202 of the user . In general , as light passes through
`detected ) and / or an additional body part 201 of the user . For
`the user's skin and into the underlying tissue , some light is
`example , as shown a finger of the user may contact a top
`reflected , some light is scattered , and some light is absorbed ,
`electrical contact 107a while a palm of the user contacts a
`depending on what the light encounters . In some instances ,
`blood may absorb light more than surrounding tissue , so less 5 bottom electrical contact 107b . However , it is understood
`reflected light may be sensed when more blood is present .
`that this is an example and the electrical contacts may be
`the user's blood volume generally increases and decreases
`configured to contact other body parts of the user ( such as an
`with each heartbeat . Thus , analysis of sensor data regarding
`ear , a cheek , and so on ) without departing from the scope of
`the reflected light may reflect changes in blood volume and
`the present disclosure .
`thus allow health data such as oxygen saturation , pulse rate , 10
`In some implementations , the electrical contacts 107a and
`perfusion index , and such to be computed .
`107b may be positioned to contact the body part 202 of the
`By way of another example , one or more images of the
`user and an additional body part of the user such that
`body part 202 of the user captured by the camera 104 may
`electrical measurement obtained using the electrical contacts
`be analyze to compute various health data for the user . In
`some implementations , the camera may be an infrared 15 corresponds to an electrical characteristic across the user's
`chest . For example , as shown a finger of the user's left hand
`camera and / or a combined visible light and infrared camera .
`In such implementations , infrared data in the image may be
`may contact a top electrical contact 107a while a right palm
`of the user ( connected to each other through the user's chest )
`analyzed to compute temperature of the body part , changing
`blood flow in the body part , and so on . In various imple
`contacts a bottom electrical contact 1075. Positioning the
`mentations , the ambient light sensor and / or proximity sensor 20 electrical contacts to contact user body parts such that the
`may be utilized to obtain such infrared data regarding the
`electrical measurement obtained using the electrical contacts
`corresponds to an electrical property across the user's chest .
`body part .
`In various implementations , various information may be
`Such a measurement may enable information related to
`obtained regarding the body part 202 utilizing data from the
`health data ( such as an electrocardiogram ) to be obtained
`camera 104 , the ambient light sensor 105 , and the proximity 25 that might not otherwise be possible absent such positioning .
`sensor 106. Such information may be utilized in a variety of
`By way of illustration , electrical measurements may be
`different ways . For example , in some implementations each
`taken via the electrical contacts 107a and 107b ( which may
`of the camera , the ambient light sensor , and the proximity
`respectively be configured as positive and negative termi
`sensor may capture sensor data regarding light absorption of
`nals ) that may be used to detect electrical activity of the
`the body part 202. However , the light absorption represented 30 user's body . Such electrical measurements may be used in
`by the light received by each may be different based on the
`some cases along with analysis of the received light ) to
`particular sensor strengths and / or weaknesses of the respec
`measure heart function , compute an electrocardiogram ,
`tive device . In such an implementation , the sensor data
`compute a galvanic skin response that may be indicative of
`related to light absorption from each may be compared to the
`emotional state and / or other physiological condition , and / or
`others and / or combined in order to obtain a more accurate , 35 compute other health data such as body fat , or blood
`single light absorption measurement .
`pressure .
`By way of another example , in some implementations
`Although FIG . 1 illustrates a specific configuration
`sensor data from one or more of the camera 104 , the ambient
`including the camera 104 , the ambient light sensor 105 , the
`light sensor 105 , and the proximity sensor 106 may be used
`proximity sensor 106 , and the electrical contacts 107a and
`to adjust information from one or more others of the camera , 40 107b , it is understood that this in an example . In various
`the ambient light sensor , and the proximity sensor . For
`implementations other configurations are possible and con
`example , in various implementations the proximity sensor
`templated without departing from the scope of the present
`may be utilized to obtain sensor data related to light absorp
`disclosure .
`tion of the body part 202 and the camera may be utilized to
`For example , the ambient light sensor 105 and the prox
`determine the specific area of the body part the information 45 imity sensor 106 are illustrated and described as separated
`relates to . Light absorption may be interpreted differently in
`sensors . However , in some implementations the ambient
`computing health data for different areas of the body part
`light sensor and the proximity sensor may be incorporated
`( such as where the area of the body part is hairless versus
`into a single , unified sensor that may detect both ambient
`containing hair , where the area is a highly callused area as
`light and proximity without departing from the scope of the
`opposed to a non - callused area , and so on ) . As such , the 50 present disclosure .
`sensor data from the camera regarding the specific area of
`In some implementations , the proximity sensor 106 may
`the body part being analyzed may be utilized to adjust the
`operate utilizing a single wavelength of light , such as the
`sensor data related to light absorption obtained from the
`infrared portion of the light spectrum . However , in other
`proximity sensor to account for the specific characteristics of
`implementations the proximity sensor ( and / or the camera
`the area of the body part that may influence interpretation of 55 104 and / or the ambient light sensor 105 ) may be a multiple
`light absorption for computing health data for the user .
`wavelength proximity sensor that operates utilizing multiple
`As also illustrated in FIGS . 1 and 2 , the electronic device
`wavelengths of light .
`101 may also include electrical contacts such as electrical
`For example , in various implementations the proximity
`contacts 107a and 107b disposed on an exterior surface of
`sensor 106 may operate utilizing infrared and visible light
`the electronic device . In various implementations , the elec- 60 ( such as red light ) . In some embodiments of such an
`tronic device 101 may compute health data of the user based
`implementation , the proximity sensor may include an infra
`upon sensor data obtained from the camera 104 , the ambient
`red LED for producing infrared light and a red LED for
`light sensor 105 , and the proximity sensor 106 as well as an
`producing red light .
`electrical measurement obtained using the electrical con
`Sensor data obtained utilizing different wavelengths of
`65 light may be different based on the particular detection
`tacts .
`As illustrated in FIG . 2 , the electrical contacts 107a and
`strengths and / or weaknesses of the respective wavelength .
`By utilizing multiple wavelengths , the information detected
`107b may be positioned to contact the body part 202 of the
`
`-12-
`
`MASIMO 2022
`Apple v. Masimo
`IPR2022-01291
`
`

`

`US 10,524,671 B2
`
`15
`
`7
`8
`utilizing the various wavelengths may be combined and / or
`the guidance may aid in the detection of the information
`utilized to adjust each other in order to obtain greater
`and / or the computing of the health data .
`For example , FIG . 3 illustrates the view of FIG . 2 while
`accuracy .
`For example , dark and light hairs may have different light
`the example system 100 is providing guidance to obtain
`absorption due to their different pigmentation regardless of 5 health data . As illustrated in this example , the electronic
`device 101 provides a current body part position indicator
`their other physical characteristics . By averaging light
`301 and a goal position indicator 302. A user may compare
`absorption detected utilizing both infrared and red light , a
`the visual positions of the current body part position indi
`more accurate light absorption that accounts for such color
`cator and the goal position indicator to determine how to
`difference may be possible such that detecting light absorp
`tion of different colored hairs does not result in inaccurate 10 move the user's body part 202 into correct alignment . As
`shown , the user may move the user's body part down and to
`measurements .
`the right , aligning the current body part position indicator
`In some implementations , the ambient light sensor 105
`with the goal position indicator 302 , to move the user's body
`may be a silicon ambient light sensor , such as a silicon
`part into correct alignment .
`non - imaging photodiode . In other implementations , the
`Further , the electronic device 101 may also provide a
`ambient light sensor 105 may be an indium gallium arsenide
`status indicator 303 that indicates a progress 304 of obtain
`ambient light sensor , such as an indium gallium arsenide
`ing the information .