1111111111111111 IIIIII IIIII 111111111111111 111111111111111 11111 lllll 111111111111111 11111111
`US 20120197093Al
`
`c19) United States
`c12) Patent Application Publication
`LeBoeuf et al.
`
`c10) Pub. No.: US 2012/0197093 Al
`Aug. 2, 2012
`(43) Pub. Date:
`
`(54) APPARATUS AND METHODS FOR
`MONITORING PHYSIOLOGICAL DATA
`DURING ENVIRONMENTAL
`INTERFERENCE
`
`(76)
`
`Inventors:
`
`Steven Francis LeBoeuf, Raleigh,
`NC (US); Jesse Berkley Tucker,
`Knightdale, NC (US); Michael
`Edward Aumer, Raleigh, NC (US);
`Eric Douglas Romesburg, Chapel
`Hill, NC (US); Joseph Norman
`Morris, Chapel Hill, NC (US)
`
`(21) Appl. No.:
`
`13/358,102
`
`(22) Filed:
`
`Jan.25,2012
`
`Related U.S. Application Data
`
`(60) Provisional application No. 61/436,664, filed on Jan.
`27, 2011.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`A61B 5100
`(2006.01)
`A61B 6/00
`(2006.01)
`A61B 8/00
`(2006.01)
`H0JL 31/16
`(2006.01)
`A61B 5105
`(2006.01)
`(52) U.S. Cl. ......... 600/301; 250/226; 600/409; 600/437;
`600/436; 600/476
`
`(57)
`
`ABSTRACT
`
`Apparatus and methods for attenuating environmental inter(cid:173)
`ference are described. A wearable monitoring apparatus
`includes a housing configured to be attached to the body of a
`subject and a sensor module that includes an energy emitter
`that directs energy at a target region of the subject, a detector
`that detects an energy response signal----or physiological con(cid:173)
`dition-from the subject, a filter that removes time-varying
`environmental interference from the energy response signal,
`and at least one processor that controls operations of the
`energy emitter, detector, and filter.
`
`100
`
`\-...
`
`l04
`
`106
`'-,
`INTERFERENCE
`FILTER
`
`107 I
`
`FURTHER
`PROCESSING
`
`109
`
`Petitioner Apple Inc. – Ex. 1005, p. 1
`
`

`

`~
`1,0
`0
`-....J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`....
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`QO
`N
`
`0 ....
`N
`j'-J
`~
`~
`
`N
`
`.... 0 =
`~ .....
`O" = (')
`a'
`.... 0 =
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`109
`
`PROCESSING
`FURTHER
`
`107
`
`I
`
`I
`
`INTERFERENCE
`~
`106
`
`FILTER
`
`ADC
`
`\
`
`105
`
`140
`
`)
`
`103
`
`(
`\l
`/ -----------------1-------------------------------,,,
`
`104
`
`111
`I MOTION/POSITION I
`
`SENSOR
`
`! TIME-VARYJN~-
`~ ~ I DETECTOR
`
`FIG.1
`
`INTERFERENCE
`
`130
`
`\ ___________ 11_~--~~-----
`l
`: I EMITTER I ~
`
`\
`
`!
`
`120
`
`\
`
`102
`
`DRIVE
`PULSED
`
`___rr_n_
`
`\
`
`101
`
`~
`100
`
`Petitioner Apple Inc. – Ex. 1005, p. 2
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 2 of 28
`
`US 2012/0197093 Al
`
`~I
`
`Petitioner Apple Inc. – Ex. 1005, p. 3
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 3 of 28
`
`US 2012/0197093 Al
`
`\;,,Di \I
`
`<Jo[>
`
`t> V ~
`
`.....I
`
`.....
`"""
`
`I--::c:
`
`t.!) -......1
`8
`I.I.I ex::
`I.I.I
`§
`~
`t:;
`I.I.I
`
`cx:: -Q z -
`
`~
`~
`
`Petitioner Apple Inc. – Ex. 1005, p. 4
`
`

`

`N
`N
`~
`~
`.... 0 =
`.... 0 = ""O = O" -....
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`~
`1,0
`0
`-....J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`.....
`rJJ =(cid:173)
`
`.i;...
`
`('D
`('D
`
`QO
`N
`
`0 ....
`
`N
`
`~
`
`130
`EAR
`
`' J I
`
`FIG. 48
`
`' I
`
`,/
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`
`... ___ ....
`
`MODULE
`SENSOR
`
`207
`
`:
`i
`'
`'
`'
`'
`
`I
`I
`
`I
`I
`
`\
`\
`\
`
`,
`'
`,
`'
`... ----...
`
`I
`I
`I
`
`:
`'
`'
`'
`'
`
`I
`I
`
`I
`I
`
`404
`
`404
`
`FOSSA
`TRIANGULAR
`
`EAR FRONT VIEW
`
`EAR SIDE VIEW
`
`FIG. 4A
`
`MODULE
`SENSOR
`
`207
`
`MODULE
`SENSOR
`
`207
`
`NOTCH
`INTERTRAGI(
`
`'--
`h
`::,1 l
`f/TRAGUS
`!Y~I
`~P~
`
`~
`130
`
`~
`
`400
`
`Petitioner Apple Inc. – Ex. 1005, p. 5
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 5 of 28
`
`US 2012/0197093 Al
`
`500
`
`\
`
`EARBUD
`HOUSING
`
`........ ---...
`,
`
`130
`{EAR)
`
`I
`I
`I
`I
`I
`I
`I
`
`I ,·
`
`I
`I
`I
`I
`I
`
`EXCITATION LIGHT
`SCATTERED IN THE EAR
`
`EXTERNAL LIGHT
`SCATTERED IN THE EAR
`
`207
`SENSOR .
`MODULE
`
`EXTERNAL
`LIGHT
`
`EL1
`
`EXTERNAL
`LIGHT
`
`FIG.5
`
`Petitioner Apple Inc. – Ex. 1005, p. 6
`
`

`

`N
`N
`~
`~
`.... 0 =
`.... 0 = ""O = O" -....
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`0 ....
`
`N
`
`~
`
`I
`
`THROUGH EAR ~
`SCATTERED
`SUNLIGHT
`
`DIRECT SUNLIGHT
`
`HITTING EAR
`
`OPTICAL INTENSITY vs. WAVELENGTH FOR SUNLIGHT HITTING EAR
`
`~
`1,0
`0
`-....J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`O'I
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`QO
`N
`
`FIG. 6
`
`WAVELENGTH (nm}
`
`1050
`
`950
`
`850
`
`750
`
`650
`
`550
`
`450
`
`350
`
`0
`
`5000
`
`10000
`
`0
`l:i:
`
`::z: -....I § 15000
`
`~ 20000
`
`,,
`
`-v
`
`~ 25000
`::, .
`_ 30000
`
`35000
`
`40000
`
`600~
`
`Petitioner Apple Inc. – Ex. 1005, p. 7
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 7 of 28
`
`US 2012/0197093 Al
`
`c:::::,
`,--......
`
`.....
`
`/
`
`(
`
`Petitioner Apple Inc. – Ex. 1005, p. 8
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 8 of 28
`
`US 2012/0197093 Al
`
`~ z:
`.....
`
`L,U
`
`c.:::
`c:::,
`~ ::z
`
`L,U
`~
`
`C)
`CV)
`
`......
`
`~ z:
`.....
`
`L,U
`
`;
`
`(
`
`Petitioner Apple Inc. – Ex. 1005, p. 9
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 9 of 28
`
`US 2012/0197093 Al
`
`o 0 o
`000
`000
`
`~ ->
`C -V'I
`
`U-1
`
`Petitioner Apple Inc. – Ex. 1005, p. 10
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 10 of 28
`
`US 2012/0197093 Al
`
`1000
`
`\
`
`700
`
`B
`
`B
`
`A
`
`715
`
`910~
`
`A
`
`FIG.10
`
`Petitioner Apple Inc. – Ex. 1005, p. 11
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 11 of 28
`
`US 2012/0197093 Al
`
`1100
`
`\_
`
`901
`~
`
`FIG. 11
`
`Petitioner Apple Inc. – Ex. 1005, p. 12
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 12 of 28
`
`US 2012/0197093 Al
`
`1201
`
`~
`
`1202
`
`FIG.12A
`
`1202
`
`1201
`
`~
`
`FIG.12(
`
`FIG.128
`
`Petitioner Apple Inc. – Ex. 1005, p. 13
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 13 of 28
`
`US 2012/0197093 Al
`
`--
`
`/ - \
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`---------------------------------------~✓
`
`,--
`'
`
`~ ~ / / 1 - - - - - - - 1 1
`I
`i
`\
`\, .. ___ -_-_~---~-
`
`(
`
`Petitioner Apple Inc. – Ex. 1005, p. 14
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 14 of 28
`
`US 2012/0197093 Al
`
`(
`
`Petitioner Apple Inc. – Ex. 1005, p. 15
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 15 of 28
`
`US 2012/0197093 Al
`
`c:::::,
`
`.....
`.....
`
`L.l"'I
`
`----
`
`c:::::,
`
`.....
`
`L.l"'I
`,--
`
`Petitioner Apple Inc. – Ex. 1005, p. 16
`
`

`

`~
`1,0
`0
`-....J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`O'I
`....
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`QO
`N
`
`0 ....
`
`N
`
`~
`
`N
`N
`~
`~
`.... 0 =
`.... 0 = ""O = O" -....
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`902
`
`FIG. 168
`
`1610
`
`902
`
`!.J
`
`l7
`
`1612
`
`FIG.16A
`
`1606
`
`1605/ '; -
`
`(TOWARDS EAR)
`FRONT
`
`(
`
`1605
`
`)
`1600
`
`\
`
`901
`
`117
`B -SIDE VIEW
`
`\
`
`901
`
`(AWAY FROM EAR)
`BACK
`
`A-SIDE VIEW
`
`~
`1600
`
`Petitioner Apple Inc. – Ex. 1005, p. 17
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 17 of 28
`
`US 2012/0197093 Al
`
`B - BACK VIEW
`
`1601
`
`\
`
`1700
`~
`
`1-- -----1--- -----:
`
`I
`
`1710
`
`1612
`
`EMITTER COUPLING PART
`
`I
`I
`I
`I
`I
`\
`\
`
`•
`
`'
`
`'
`
`,....
`
`~ DETECTOR COUPLING PART
`
`I
`I
`I
`I
`r
`I
`J
`
`,
`✓
`
`,, ...
`
`FIG. 17
`
`Petitioner Apple Inc. – Ex. 1005, p. 18
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 18 of 28
`
`US 2012/0197093 Al
`
`START
`
`READ AT LEAST ONE ADC SAMPLE WHEN THE EMITTER IS ON
`
`READ AT LEAST ONE ADC SAMPLE WHEN THE EMITTER IS OFF
`
`INPUT RELEVANT ON/OFF SAMPLES TO AN INTERFERENCE FILTER
`
`OUTPUT AT LEAST ONE SAMPLE FROM THE INTERFERENCE FILTER
`FOR FURTHER PROCESSING
`
`1800
`
`1802
`
`1804
`
`1806
`
`END
`
`FIG. 18
`
`Petitioner Apple Inc. – Ex. 1005, p. 19
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 19 of 28
`
`US 2012/0197093 Al
`
`--
`c:,-. -
`
`00
`-1--
`....... °'
`........
`==
`(.,!)
`~
`
`A.LISNUNI 1VN9IS ~OSN3S
`
`-
`
`A.LISNUNI 1VN9IS ~OSN3S
`
`Petitioner Apple Inc. – Ex. 1005, p. 20
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 20 of 28
`
`US 2012/0197093 Al
`
`2000
`~
`
`y(n)
`
`z-1
`
`z-1
`
`z-1
`
`z-1
`
`z-1
`
`FIG. 20
`
`Petitioner Apple Inc. – Ex. 1005, p. 21
`
`

`

`~
`1,0
`0
`-...J
`1,0
`
`> .....
`
`N --- 0 .....
`0 .....
`N
`rJJ
`c
`
`QO
`N
`0 .....
`N .....
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`N
`0 .....
`N
`N
`~
`~
`.... 0 =
`.... 0 = ""O = O" -....
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`~
`
`FIG. 21
`
`0.9
`
`0.8
`
`0.7
`
`0.5
`
`I
`I
`: ________ :--------~
`
`1
`:
`
`I
`
`-
`
`I
`:
`:
`
`I -------~--------t-------~
`
`I
`I
`I
`:
`
`I
`I
`
`I
`
`1
`
`I
`I
`I
`
`I
`I
`
`:
`
`I
`
`i 2160
`
`-----1----
`
`I
`I
`I
`I
`
`I
`I
`I
`l
`
`I
`I
`
`:
`
`I
`I
`I
`I
`
`I
`
`I
`__
`I
`I
`I
`I
`I
`'--------,-------r
`I
`I
`
`-
`
`:
`I
`I
`
`I
`
`_ -------,
`
`I
`
`I
`
`:
`: -------1--------:--------r
`'
`
`:
`'
`
`-'--------,
`
`:
`
`:
`'
`
`:
`I
`I
`I
`
`---~
`
`1
`I
`
`------'--------1-----
`
`I
`I
`:
`I
`
`:
`I
`I
`:
`
`I
`I
`
`I
`I
`
`-
`
`...---
`
`I
`
`I
`I
`I
`I
`
`_,,,....-
`
`'
`
`-----
`
`:
`
`:
`I
`I
`
`I
`I
`
`I
`I
`I
`I
`
`: 2130
`
`,
`
`/
`
`------r------i-------r ~=~~;;;~r~~~=~--~f------
`
`MAGNITUDE RESPONSE (dB}
`
`2110
`
`I
`
`V
`
`I
`
`.:_ _______ -,1.L-----~--
`
`I
`
`I ---I
`
`: 'J I
`
`I
`
`I
`
`:
`
`--
`
`/
`
`I
`
`I
`
`:
`
`,
`
`--
`
`~-... ----
`
`-1----1------J'--t--
`/,
`I
`r I 2120
`I
`,Y\ I
`-,.-<"'--+------~------,-✓;------:
`I,' I
`---1
`l---1----......---1--------I
`~ I
`_ .. -
`:
`-"'!-
`
`I
`
`I
`I
`I
`
`--I
`
`---r--i--
`
`I
`I
`
`0.2
`0.3
`\:i
`:
`--I
`\ 'J
`---~ ------~t--------7
`:
`I
`: I
`:
`l---'-r------,---
`: ____ _l _______ ; ______ --f-------1-------+------i
`i ,
`I
`--+--l; j"-----J_
`_l
`~/ ___ l_
`_J ________ ~-------~--------:-------:
`~
`
`-20 r---1 '·
`
`/----+
`----1-:
`,,
`,,
`
`I
`I
`I
`
`:
`I
`
`I
`,
`
`/
`I
`--
`
`I
`I
`I
`
`,,...,
`
`I 1 I
`~ 50 -L
`
`2140
`
`I
`
`-
`
`:::E
`
`40
`-30
`
`•
`
`-10 I
`
`Z:
`.,._.
`:::i
`1--
`~
`u.J
`3
`CCI
`
`-
`
`0
`10
`
`2100~
`
`I
`I
`------+--------1-
`I -------+---------/---
`1
`I
`I
`I
`I
`
`:
`I
`I------7-------r
`I
`I
`
`------r-,,C------T
`
`/
`
`'
`
`/
`
`I
`I
`I
`
`I
`
`I
`I
`
`,
`
`/
`
`I,
`
`:
`
`NORMALIZED FREQUENCY
`0.6
`
`0.4
`
`0.1
`
`0
`
`I
`
`:
`
`I"
`
`I
`
`A'
`
`I
`
`---
`
`----:--2-1-SO_t_____ i
`
`Petitioner Apple Inc. – Ex. 1005, p. 22
`
`

`

`~
`1,0
`0
`-...J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`('D ....
`rJJ =(cid:173)
`
`N
`N
`
`('D
`
`QO
`N
`
`0 0 50 l 00 150 200 250 300 350 400 450 500 550
`
`4
`
`TIME IN SECONDS
`
`FIG.22D
`
`2220
`
`-"'"""''r'
`
`ct:::,
`
`... ~----..._
`
`JJ-v-:::;-)1
`
`~----\
`
`2210
`
`SPECTRUM PEAK DURING MOTION (-)
`HEART RATE(---} & ACCELEROMETER
`
`....... 60
`S 80 =
`S 100~/--✓
`~ 120
`== 140
`:;; 160
`=e 180
`200
`220
`
`0 50 100 150 200 250 300 350 400 450 500 550
`
`TIME IN SECONDS
`
`,....._,,.,,-.. ~
`
`'v--
`
`,
`
`'-...............
`
`I
`
`22\20 r,~
`
`/'...,,_,A,.,,_,,.,.,._,.,.,--..__,'-.-)
`,
`V r-
`
`40
`...... 60
`~ 80
`S100l±===,
`~120
`== 140
`:;; 160
`=e 180
`200
`220
`
`FIG.228
`
`2210
`
`SPECTRUM PEAK DURING MOTION (-)
`HEART RATE(---) & ACCELEROMETER
`
`0 ....
`N
`j'-J
`~
`~
`
`N
`
`l 00 l 50 200 250 300 350 400 450 500 550
`
`TIME IN SECONDS
`
`50
`
`.... 0 =
`~ ....
`O" = (')
`a'
`.... 0 =
`~ ....
`t "e -....
`
`('D = ....
`~ ....
`""O
`
`(')
`
`FIG.22(
`
`FILE=HS_2010_7 _6_16_22_1 l .CSV
`
`DIFFERENCE SPECTRUM
`
`SPECTRAL-DOMAIN PROCESSING OF HEART
`
`RATE WITH INTERFERENCE FILTER
`
`2210
`
`40
`....... 60
`~ 80
`S 100
`·~ 120
`== 140
`:;; 160
`=e 180
`200
`220
`
`50 l 00 150 200 250 300 350 400 450 500 550
`
`TIME IN SECONDS
`
`2220
`
`SPECTRAL-DOMAIN PROCESSING OF HEART
`
`FILE=HS_2010_7 _6_ 16_22_ 11.CSV
`RATE WITHOUT INTERFERENCE FILTER
`
`DIFFERENCE SPECTRUM
`
`40
`....... 60
`~ 80
`S 100
`~ 120
`== 140
`:;; 160
`=e 180
`200
`220
`
`FIG.22A
`
`Petitioner Apple Inc. – Ex. 1005, p. 23
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 23 of 28
`
`US 2012/0197093 Al
`
`Petitioner Apple Inc. – Ex. 1005, p. 24
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 24 of 28
`
`US 2012/0197093 Al
`
`SENSOR MODULE
`700,800
`
`ISOlATION
`REGION
`2304
`
`SIDE VIEW
`
`~2300
`
`2302
`
`LIGHT GUIDING REGION
`2306
`
`FIG. 24
`
`Petitioner Apple Inc. – Ex. 1005, p. 25
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 25 of 28
`
`US 2012/0197093 Al
`
`c:::,
`c:::,
`
`co ...
`c:::,
`c:::,
`.......
`
`Petitioner Apple Inc. – Ex. 1005, p. 26
`
`

`

`~
`1,0
`0
`-....J
`1,0
`
`> ....
`
`N --- 0 ....
`0 ....
`N
`rJJ
`c
`
`0 ....
`
`QO
`N
`
`O'I
`N
`.....
`rJJ =(cid:173)
`
`('D
`('D
`
`0 ....
`N
`j'-J
`~
`~
`
`N
`
`.... 0 =
`~ .....
`O" = (')
`a'
`.... 0 =
`('D = ..... t "e -....
`
`~ .....
`
`(')
`
`~ .....
`""O
`
`FIG.27
`
`(UGHT GUIDING
`
`2306
`REGION
`
`2304
`REGION
`ISOLATION
`
`2304
`REGION
`ISOLATION
`
`700,800
`
`LIGHT GUIDING REGION
`
`FIG.26
`2306
`
`(cid:143)
`
`700,800
`
`Petitioner Apple Inc. – Ex. 1005, p. 27
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 27 of 28
`
`US 2012/0197093 Al
`
`c:::::,
`c:::::,
`co
`c:::::,~
`c:::::,
`......
`
`Petitioner Apple Inc. – Ex. 1005, p. 28
`
`

`

`Patent Application Publication
`
`Aug. 2, 2012 Sheet 28 of 28
`
`US 2012/0197093 Al
`
`Petitioner Apple Inc. – Ex. 1005, p. 29
`
`

`

`US 2012/0197093 Al
`
`Aug. 2, 2012
`
`1
`
`APPARATUS AND METHODS FOR
`MONITORING PHYSIOLOGICAL DATA
`DURING ENVIRONMENTAL
`INTERFERENCE
`
`RELATED APPLICATION
`
`[0001] This application claims the benefit of and priority to
`U.S. Provisional Patent Application No. 61/436,664 filed Jan.
`27, 2011, the disclosure of which is incorporated herein by
`reference as if set forth in its entirety.
`
`FIELD OF THE INVENTION
`
`[0002] The present invention relates generally to monitor(cid:173)
`ing apparatus and methods and, more particularly, to physi(cid:173)
`ological monitoring apparatus and methods.
`
`BACKGROUND OF THE INVENTION
`
`[0003] There is growing market demand for personal health
`and environmental monitors, for example, for gauging overall
`health, fitness, metabolism, and vital status during exercise,
`athletic training, work, public safety activities, dieting, daily
`life activities, sickness, and physical therapy. However, tra(cid:173)
`ditional wearable health monitors cannot measure physi(cid:173)
`ological information accurately in typical daily environ(cid:173)
`ments. For example, environmental
`interference from
`sunlight, temperature changes, and motion-coupled environ(cid:173)
`mental noise can present measurement artifacts on wearable
`health monitors. These measurement artifacts can reduce sen(cid:173)
`sor accuracy, generate false measurements, and prevent accu(cid:173)
`rate health, fitness, and vital status monitoring. As such,
`improved ways of removing or preventing environmental
`interference from measurements taken from wearable sensors
`are needed.
`
`SUMMARY
`
`[0004]
`It should be appreciated that this Summary is pro(cid:173)
`vided to introduce a selection of concepts in a simplified
`form, the concepts being further described below in the
`Detailed Description. This Summary is not intended to iden(cid:173)
`tify key features or essential features of this disclosure, nor is
`it intended to limit the scope of the invention.
`[0005] According to some embodiments of the present
`invention, a medium ( e.g., physiological material of a sub(cid:173)
`ject), having a region of interest, is monitored via a sensor
`module having at least one energy emitter for interrogating
`the medium with energy to generate an energy response asso(cid:173)
`ciated with the medium, at least one circuit to drive at least
`one energy emitter, at least one detector for detecting the
`energy response associated with the medium, a filter that
`removes time-varying environmental interference from the
`energy response signal, and a processor that controls opera(cid:173)
`tions of the energy emitter, detector, and filter.
`[0006] According to some embodiments of the present
`invention, a wearable monitoring apparatus includes a hous(cid:173)
`ing (e.g., an earpiece, earbud, etc.), and a sensor module
`disposed within or attached to the housing. The housing is
`configured to be attached to a body of a subject, for example
`the ear. The sensor module includes an energy emitter, a
`detector, a filter, and at least one processor. The energy emit(cid:173)
`ter directs energy ( e.g., optical energy, acoustic energy, ultra(cid:173)
`sonic energy, electromagnetic radiation, electrical energy,
`mechanical energy, magnetic energy, nuclear energy, etc.) at
`a target region of the subject and the detector detects an
`
`energy response signal from the subject. The energy response
`signal is associated with a physiological condition of the
`subject ( e.g., heart rate, pulse pressure, respiration rate, lactic
`threshold, blood pressure, volume of blood flow through a
`blood vessel, blood metabolite level, blood oxygen level, size
`of at least one blood vessel, etc.). The filter removes or attenu(cid:173)
`ates time-varying environmental interference from the energy
`response signal, wherein the time-varying environmental
`interference is caused by one or more of the following: sun(cid:173)
`light, ambient light, airflow, temperature, etc.
`[0007] The at least one processor controls operations of the
`energy emitter, detector, and/or filter. In some embodiments
`of the present invention, the at least one processor is config(cid:173)
`ured to process the detected energy response signal and pro(cid:173)
`duce an extracted energy response signal.
`[0008]
`In some embodiments of the present invention, the
`energy emitter emits pulsed or modulated energy.
`[0009]
`In some embodiments of the present invention, the
`energy emitter comprises at least one optical emitter, and the
`detector comprises at least one optical detector. Exemplary
`optical emitters include, but are not limited to, laser diodes
`(LDs), light-emitting diodes (LEDs), and organic light-emit(cid:173)
`ting diodes (OLEDs). Exemplary optical detectors include,
`but are not limited to, photodetectors, photodiodes, pho(cid:173)
`totransistors, photoactive resistors, photomultiplier tubes,
`photomultiplier diodes, photodetector modules, and the like.
`[0010]
`In some embodiments of the present invention, at
`least one portion of the housing comprises optically transmis(cid:173)
`sive material through which light from the at least one optical
`emitter can pass. In some embodiments of the present inven(cid:173)
`tion, at least one portion of the housing comprises material
`configured to attenuate ( e.g., reduce or block) light reaching
`the at least one optical detector at one or more selected wave(cid:173)
`lengths.
`[0011]
`In some embodiments of the present invention, the
`monitoring apparatus includes at least one analog-to-digital
`(ADC) converter that converts analog signals generated by
`the detector to digital signals.
`[0012] According to some embodiments of the present
`invention, a monitoring apparatus includes a housing config(cid:173)
`ured to be attached to the ear of a subject, and a sensor module
`disposed within or attached to the housing. The sensor mod(cid:173)
`ule includes an optical emitter, a detector, a motion/position
`sensor, a filter, and at least one processor that controls opera(cid:173)
`tions of the optical emitter, detector, and/or filter. The optical
`emitter directs optical energy at a target region of the subject
`and the detector detects an optical energy response signal
`from the subject, wherein the energy response signal is asso(cid:173)
`ciated with a physiological condition of the subject. Light(cid:173)
`opaque material surrounds at least part of the sensor module
`to prevent ambient light from interfering with the detector.
`Output from the motion/position sensor is associated with the
`motion or position between the housing andearofthe subject.
`The filter removes or attenuates time-varying environmental
`interference from the optical energy response signal, wherein
`the time-varying environmental interference is caused by one
`or more of the following: sunlight, ambient light, airflow, and
`temperature.
`[0013] According to some embodiments of the present
`invention, a sensor module includes a printed circuit board
`(PCB), in some cases having opposite first and second sides,
`an optical emitter attached to at least one side of the PCB, an
`optical detector attached to at least one side of the PCB
`adjacent to the optical emitter, an optical filter overlying at
`
`Petitioner Apple Inc. – Ex. 1005, p. 30
`
`

`

`US 2012/0197093 Al
`
`Aug. 2, 2012
`
`2
`
`least a portion of the optical detector, and light-opaque mate(cid:173)
`rial adjacent to the optical detector. The optical filter is con(cid:173)
`figured to attenuate ( e.g., reduce or block) light at one or more
`selected wavelengths, and the light-opaque material prevents
`ambient light from interfering with the optical detector.
`[0014]
`In some embodiments of the present invention, the
`optical filter has a surface area greater than a surface area of
`the optical detector, and the optical filter overlies the optical
`detector such that a periphery of the optical filter overlaps a
`periphery of the optical detector.
`[0015]
`In some embodiments of the present invention,
`light-opaque material surrounds the optical emitter and opti(cid:173)
`cal detector such that the optical emitter and optical detector
`are not in direct optical communication with each other. In
`some embodiments of the present invention, the light-opaque
`material includes a first aperture in communication with the
`optical emitter, and a second aperture in communication with
`the optical detector.
`[0016]
`In some embodiments of the present invention, the
`sensor module includes a lens positioned above at least one of
`the optical emitter and filter. The lens may include respective
`first and second portions configured to matingly engage
`respective first and second apertures in the light-opaque mate(cid:173)
`rial.
`[0017]
`In other embodiments of the present invention, a
`first lens is positioned within the first aperture and is in optical
`communication with the optical emitter, and a second lens is
`positioned within the second aperture and is in optical com(cid:173)
`munication with the optical detector. The first lens focuses
`light emitted by the optical emitter and the second lens
`focuses light toward the optical detector.
`[0018]
`In some embodiments of the present invention, a
`second optical detector is attached to the PCB second side.
`[0019] According to other embodiments of the present
`invention, an earbud for a headset includes a housing that is
`configured to be positioned within an ear of a subject, a
`speaker, and at least one sensor module disposed within or
`attached to the housing. The at least one sensor module
`includes a printed circuit board (PCB) having opposite first
`and second sides, an optical emitter attached to at least one
`side of the PCB that directs electromagnetic radiation at a
`target region of the ear, an optical detector attached to at least
`one side of the PCB adjacent to the optical emitter that detects
`an energy response signal associated with a physiological
`condition of the subject from the subject, and an optical filter
`overlying at least a portion of the optical detector, wherein the
`optical filter is configured to attenuate ( e.g., reduce or block)
`light at one or more selected wavelengths. A filter may be
`included that removes time-varying environmental interfer(cid:173)
`ence from the energy response signal. Time-varying environ(cid:173)
`mental interference may be caused by one or more of the
`following: sunlight, ambient light, airflow, temperature, etc.
`The at least one sensor module may include at least one
`processor that controls operations of the optical emitter, opti(cid:173)
`cal detector, and/or filter.
`[0020]
`In some embodiments of the present invention, the
`optical filter has a surface area greater than a surface area of
`the optical detector, and the optical filter overlies the optical
`detector such that a periphery of the optical filter overlaps a
`periphery of the optical detector.
`[0021]
`In some embodiments of the present invention,
`light-opaque material surrounds the optical emitter and opti(cid:173)
`cal detector such that the optical emitter and optical detector
`are not in direct optical communication with each other. In
`
`some embodiments of the present invention, the light-opaque
`material includes a first aperture in communication with the
`optical emitter, and a second aperture in communication with
`the optical detector.
`[0022]
`In some embodiments of the present invention, the
`at least one sensor module include a lens positioned above at
`least one of the optical emitter and filter. The lens may include
`respective first and second portions configured to matingly
`engage respective first and second apertures in the light(cid:173)
`opaque material.
`[0023]
`In other embodiments of the present invention, a
`first lens is positioned within the first aperture and is in optical
`communication with the optical emitter, and a second lens is
`positioned within the second aperture and is in optical com(cid:173)
`munication with the optical detector. The first lens focuses
`light emitted by the optical emitter and the second lens
`focuses light toward the optical detector.
`[0024]
`In some embodiments of the present invention, a
`second optical detector is attached to the PCB second side.
`[0025]
`In some embodiments of the present invention, one
`or more portions of the earbud housing include optically
`transmissive material through which light from the optical
`emitter can pass.
`[0026]
`In some embodiments of the present invention, one
`or more portions of the housing include material configured
`to attenuate ( e.g., reduce or block) light reaching the optical
`detector at one or more selected wavelengths.
`[0027]
`In some embodiments of the present invention, the
`at least one sensor module includes an analog-to-digital
`(ADC) converter that converts analog signals generated by
`the optical detector to digital signals.
`[0028]
`In some embodiments of the present invention, the
`at least one sensor module includes at least one motion/
`position sensor attached to at least one side of the PCB.
`[0029]
`In some embodiments of the present invention, the
`at least one sensor module housing includes a soft material
`which deforms when inserted within an ear and that facilitates
`retention of the earbud within an ear. In other embodiments,
`the at least one sensor module housing has a shape that facili(cid:173)
`tates retention of the earbud within an ear.
`[0030]
`In some embodiments of the present invention, a
`portion of the at least one sensor module housing includes
`optically transmissive material through which light from the
`optical emitter can pass, and wherein the housing includes a
`soft material adjacent to the optically transmissive material
`which deforms when inserted within an ear and that facilitates
`retention of the earbud within an ear.
`[0031]
`In some embodiments of the present invention, a
`portion of the at least one sensor module housing includes
`material configured to diffuse light from the optical detector
`and/or diffuse light to the optical detector.
`[0032]
`In some embodiments of the present invention, the
`at least one sensor module comprises two sensor modules in
`spaced apart relationship.
`[0033] According to other embodiments of the present
`invention, a method of monitoring at least one physiological
`property of a subject includes directing pulsed energy at a
`target region of the subject via an energy emitter, obtaining a
`first energy response signal from the subject when the emitter
`is on, obtaining a second energy response signal from the
`subject when the emitter is off, and processing the first and
`second energy response signals via an interference filter to
`produce a processed energy response signal that is associated
`with a physiological condition (e.g., heart rate, pulse pres-
`
`Petitioner Apple Inc. – Ex. 1005, p. 31
`
`

`

`US 2012/0197093 Al
`
`Aug. 2, 2012
`
`3
`
`sure, respiration rate, lactic threshold, blood pressure, volume
`of blood flow through a blood vessel, blood metabolite level,
`blood oxygen level, size of at least one blood vessel, etc.) of
`the subject, wherein the filter removes or attenuates time(cid:173)
`varying environmental interference caused by one or more of
`the following: sunlight, ambient light, airflow, temperature,
`etc. Directing pulsed energy at a target region may include
`directing energy selected from the group consisting of optical
`energy, acoustic energy, ultrasonic energy, electromagnetic
`radiation, electrical energy, magnetic energy, mechanical
`energy, nuclear energy, etc.
`In some embodiments of the present invention, the
`[0034]
`interference filter employs a spectral method to remove or
`attenuate time-varying environmental interference. In some
`embodiments of the present invention, the interference filter
`employs an FIR filtering method to remove or attenuate time(cid:173)
`varying environmental interference.
`In some embodiments of the present invention, the
`[0035]
`processed energy response signal is transmitted to a remote
`device, for example wirelessly transmitted.
`In some embodiments of the present invention, the
`[0036]
`environmental interference may comprise ambient light, sun(cid:173)
`light, room light, wind, sound, mechanical interference, elec(cid:173)
`trical interference, temperature changes, or the like.
`In some embodiments of the present invention, the
`[0037]
`geometrical configuration of an emitter and detector may be
`oriented to maximize the collection of the energy response
`signal associated with physiological conditions and to mini(cid:173)
`mize the collection of the unwanted scattered light response.
`In some embodiments, multiple emitters, detectors,
`[0038]
`lenses, light guides, and/or diffusion regions may be
`employed within a sensor module.
`[0039] Emitters and detectors, according to some embodi(cid:173)
`ments of the present invention, may be configured to generate
`a more universal earbud sensor design. In some embodi(cid:173)
`ments, this may be achieved by employing a diffusion area.
`In some embodiments of the present invention, an
`[0040]
`earbud may comprise an interchangeable tip, wherein optical
`coupling may be integrated within the earbud to communicate
`light to/from the ear region through the interchangeable tip.
`In some embodiments of the present invention, a
`[0041]
`physiological condition monitored, such as heart rate, for
`example, may be modulated to improve filtering and then
`demodulated to generate the desired output.
`In some embodiments of the present invention, an
`[0042]
`interference filter may employ at least one motion/position
`sensor to remove interference from a desired physiological
`signal, such as to remove motion-coupled sunlight interfer(cid:173)
`ence from a heart rate signal.
`[0043] According to some embodiments of the present
`invention, a wearable monitoring apparatus includes a sub(cid:173)
`strate configured to be attached to a body of a subject, and a
`sensor module attached to the substrate. The substrate may be
`configured to surround a portion of a body, and may be
`flexible. For example, the substrate may be a wristband, arm(cid:173)
`band, legband, neckband, waistband, ankleband, footband,
`handband, ringband, headband, etc. In other embodiments,
`the substrate is configured to be adhesively attached to the
`body of the subject, similar to a bandage.
`[0044] The sensor module includes an energy emitter, a
`detector, a filter, and at least one processor. The energy emit(cid:173)
`ter directs energy ( e.g., optical energy, acoustic energy, ultra(cid:173)
`sonic energy, electromagnetic radiation, electrical energy,
`mechanical energy, magnetic energy, nuclear energy, etc.) at
`
`a target region of the subject and the detector detects an
`energy response signal from the subject. The energy response
`signal is associated with a physiological condition of the
`subject ( e.g., heart rate, pulse pressure, respiration rate, lactic
`threshold, blood pressure, volume of blood flow through a
`blood vessel, blood metabolite level, blood oxygen level, size
`of at least one blood vessel, etc.). The filter removes or attenu(cid:173)
`ates time-varying environmental interference from the energy
`response signal, wherein the time-varying environmental
`interference is caused by one or more of the following: sun(cid:173)
`light, ambient light, airflow, temperature, etc.
`[0045] The at least one processor controls operations of the
`energy emitter, detector, and/or filter. In some embodiments
`of the present invention, the at least one processor is config(cid:173)
`ured to process the detected energy response signal and pro(cid:173)
`duce an extracted energy response signal.
`In some embodiments of the present invention, the
`[0046]
`energy emitter emits p