I 1111111111111111 11111 lllll lllll lllll lllll lllll lllll 111111111111111 11111111
`US008172761Bl
`
`c12) United States Patent
`Rulkov et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,172,761 Bl
`*May 8, 2012
`
`(54) MONITORING DEVICE WITH AN
`ACCELEROMETER, METHOD AND SYSTEM
`
`(75)
`
`Inventors: Nikolai Rulkov, San Diego, CA (US);
`Mark Hunt, San Diego, CA (US);
`Donald Brady, Las Vegas, NV (US)
`
`(73) Assignee: Impact Sports Technologies, Inc., Las
`Vegas, NV (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by O days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 13/253,046
`
`(22) Filed:
`
`Oct. 4, 2011
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 13/191,907,
`filed on Jul. 27, 2011, and a continuation-in-part of
`application No. 12/561,222, filed on Sep. 16, 2009,
`which is a continuation-in-part of application No.
`11/856,056, filed on Sep. 16, 2007, now Pat. No.
`7,625,344, which is a continuation of application No.
`11/762,078, filed on Jun. 13, 2007, now Pat. No.
`7,468,036, which
`is a continuation-in-part of
`application No. 11/388,707, filed on Mar. 24, 2006,
`which is a continuation-in-part of application No.
`11/085,778, filed on Mar. 21, 2005, now abandoned.
`
`(60) Provisional application No. 61/408,656, filed on Nov.
`1, 2010, provisional application No. 61/394,744, filed
`on Oct. 19, 2010, provisional application No.
`61/368,262, filed on Jul. 28, 2010, provisional
`application No. 61/097,844, filed on Sep. 17, 2008,
`provisional application No. 60/665,116, filed on Mar.
`25, 2005, provisional application No. 60/613,785,
`filed on Sep. 28, 2004.
`
`(51)
`
`Int. Cl.
`(2006.01)
`A61B 5102
`(52) U.S. Cl. ......... 600/503; 600/500; 600/301; 600/481
`(58) Field of Classification Search .......... 600/300-301,
`600/310,323,481,483, 500-504
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`6,241,684 Bl*
`6/2001 Amano et al ................. 600/531
`6,721,584 B2
`4/2004 Baker, Jr. et al.
`7,035,796 Bl
`4/2006 Zhang et al.
`7,261,690 B2
`8/2007 Teller et al.
`(Continued)
`
`EP
`
`FOREIGN PATENT DOCUMENTS
`1297784
`4/2003
`(Continued)
`
`Primary Examiner - Patricia Mallari
`Assistant Examiner - Michael D' Angelo
`(74) Attorney, Agent, or Firm - Clause Eight IPS; Michael
`Catania
`
`(57)
`
`ABSTRACT
`
`A monitoring device for monitoring the vital signs of a user is
`disclosed herein. The monitoring device is preferably com(cid:173)
`prises an article, an optical sensor, an accelerometer and
`processor. The optical sensor preferably comprises a photo(cid:173)
`detector and a plurality of light emitting diodes. A sensor
`signal from the optical sensor is processed with a filtered
`accelerometer output signal from the accelerometer to create
`a filtered vital sign signal used to generate a real-time vital
`sign for a user.
`
`4 Claims, 18 Drawing Sheets
`
`/
`/
`
`Petitioner Apple Inc. – Ex. 1014, p. 1
`
`

`

`US 8,172,761 Bl
`Page 2
`
`U.S. PATENT DOCUMENTS
`2/2008 Baker, Jr. et al.
`7,336,983 B2
`5/2010 Chin et al.
`7,720,516 B2
`2001/0049471 Al*
`12/2001 Suzuki et al. ................. 600/300
`2009/0082994 Al
`3/2009 Schuler et al.
`2009/0306736 Al
`12/2009 Dobak, III
`2010/0298655 Al
`11/2010 Mccombie et al.
`
`2011/0081969 Al
`2011/0098583 Al
`2011/0118800 Al
`
`Ikeda et al.
`4/2011
`4/2011 Pandia et al.
`5/2011 Sullivan
`
`FOREIGN PATENT DOCUMENTS
`EP
`2327360
`6/2011
`* cited by examiner
`
`Petitioner Apple Inc. – Ex. 1014, p. 2
`
`

`

`U.S. Patent
`U.S. Patent
`
`May8, 2012
`May 8, 2012
`
`Sheet 1 of 18
`Sheet 1 of 18
`
`US 8,172,761 B1
`US 8,172,761 Bl
`
`
`
`FIG. l
`
`Petitioner Apple Inc. — Ex. 1014, p. 3
`
`Petitioner Apple Inc. – Ex. 1014, p. 3
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 2 of 18
`
`US 8,172,761 Bl
`
`/ 25
`
`FICi. 2
`
`10
`\
`
`_ 26h
`, 2,. ,r
`
`\~.
`
`··):-
`(' ;Ha.
`
`.. ,.:-h
`;H, .
`
`(
`
`;,-J~~, (.?;,l,
`. ~--··.. (}}:;; ~
`
`••• ·.·i .• :~.:.··.::::·,,.
`
`.. 1• •.. ·.:.··.· •• :.·-·:·'.::.··:.·.~ •.• :.·.·:··:,,.···.·:·-
`
`----
`
`-::,;,
`
`~T
`
`':'.\. "'\\
`/?
`.. ,,--------------------_,,•"':>'
`..
`·,, ....... •.················.,.P,....--------·
`
`F1Ci, 3
`
`FIG, 4
`
`25
`
`/
`
`~····· ... 26a
`/}-:, .. ·
`m1..1m~~\11=<-r------------,i'-....:::;=------r:\
`
`J ~
`
`·,.!
`
`Fl(}. 5
`
`Petitioner Apple Inc. – Ex. 1014, p. 4
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 3 of 18
`
`US 8,172,761 Bl
`
`l,.;
`,-45
`40
`_1_,·~/-I
`
`.:..2:~~~;~;~;;i~:~?
`t,J
`<
`,
`;. ....... }
`
`20'
`\
`
`FICi. 6
`
`FIG. 7
`
`Fl(J. 8
`
`Petitioner Apple Inc. – Ex. 1014, p. 5
`
`

`

`U.S. Patent
`U.S. Patent
`
`May8, 2012
`May 8, 2012
`
`Sheet 4 of 18
`Sheet 4 of 18
`
`US 8,172,761 B1
`US 8,172,761 Bl
`
`3{)
`'·--:::.
`
`.......................
`
`i
`
`1::7,
`)---~
`
`51 i
`
`35
`38
`
`[':';:«~5~~.. . . -· .....
`LJ
`
`··························_'.<~ .......... _......,:• . .......-.·.-· ......... 57
`
`I
`
`'····································································· 1 ...................................................................... /
`
`r~1·c--:-<
`t.J
`r .. J. 2
`
` 30he,
`
`JO
`30
`
`·r
`1-----J~--J:.;;.;;...:.,;.;,,.•,i:i..i: ~-=~~~~~~-~---;! L
`
`.... :1
`
`H
`I
`
`Me,“8.
`
`36 ./
`
`r~··1··0,
`FIG. 10
`·t (}
`l.
`.. l. -. .
`.
`*
`
`Petitioner Apple Inc. — Ex. 1014, p. 6
`
`Petitioner Apple Inc. – Ex. 1014, p. 6
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 5 of 18
`
`US 8,172,761 Bl
`
`57 j
`
`; 35 ~···
`
`_$7 J
`
`FIG. 11
`
`LED1
`
`200{!
`\~.,,::.:
`
`lnput ·\A>1t~g.e- f::;:{
`in~>:it~~~;y {\:-ii~r'.~~l
`J
`2(!{!]···✓
`
`VDD
`
`FIG. 12
`
`Petitioner Apple Inc. – Ex. 1014, p. 7
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 8, 2012
`May 8, 2012
`
`Sheet 6 of 18
`Sheet 6 of 18
`
`US 8,172,761 Bl
`US 8,172,761 Bl
`
`HF in at no leins noeins noon ins ne wnint ovat ins ie oat ns wen: nn a inne ne oa -Gas ne oan ne oenk ne nonin oenite seins nena int nena ‘nt eva. nt oe va: nt eva: nvoe wasn oe os ne oe
`
`sie ae ae
`
`et fe eee
`
`BIELbe;?*SOSRRnnlnRlnliiiSiSiSiSRSSESSRSRSEREEERSEPEOESEREEEREEDRSETESOSEESRPSeRROEPPE
`
`?44:vgeeng::
`
`~
`
`
`
` eFongedhngebongennnggennnpstinngetnagediognebnngetnngedngnebongedesi5S.’$‘3¥‘3$:L.vehweecledocebacdonead5::$Leaenenenenen:=::%::<
`
`(<-":
`
`\ •.
`
`apedenepe.
`
`OyLOA
`
`' ' f {,
`
`'
`
`{
`
`
`
`:3%::s¢:4i:
`
`LEE OE IEG OE IEEE IEEEEOCENE EBLE NEE IEEE DEAE LEE EAA ID
`..,..,.. .......... ..,...,..._ ... ..,...,.. .... ..,...,... ... ..,.. ....... ..,.. ............... _ ................................... ..,.. ................... ..,.. ...................................................................... ..,.. ......... .,
`~
`
`CORRIRERRIERERRRRIIIAEREEERIERIERRRAREAREAEAEAt8x|spauenauniounnonnunniouneninniTOITENG
`
`WDEMESETRTEEYsscssoommmnnosnooiing
`
`t|
`
`‘OL
`
`Petitioner Apple Inc. — Ex. 1014, p. 8
`
`l i
`
`i
`i
`
`i,.! _ _ _ _ ,.,;
`
`l
`
`,. ..................... .,.. ...... l ....... ..,...,., ...... ..,...,... ...
`-:
`
`Petitioner Apple Inc. – Ex. 1014, p. 8
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 7 of 18
`
`US 8,172,761 Bl
`
`!300
`
`SenU)J
`Ai:n:p!i!'h:,r
`
`\1k\H),,:\mknll<Xt 1,.......--------------------'
`
`i\iD " " " " '~ -~ -~ -~ -~ -~ -~ -~ -~ - -
`
`E-,~·1····0"'
`--~
`
`.
`
`. .
`·14·
`
`/
`
`"•
`
`ON
`ON
`LEI) ti--: ___ , ___ ...,_ ___ O_F_F _______ .,_(_)f_'F_
`
`~
`
`~~--.~~-'7.~
`.
`
`~
`
`l
`
`r- c--.~....---.--.
`
`.
`
`,...,..,....,. ................. .-.;.... .. ~
`f'./
`I
`!
`It:~';:;;,,,,.
`
`/
`
`I
`>
`
`hiie·g;~::~-~-~:;: t!--____ t/_ ..... __ .,,,=/-..... ~-... -i]__..·_,_f ~_:) _ _ _ _ _ _ ....... L_---_--·/_· _r ....
`'·-_1 .... 1
`_(~_::i_+_l
`t
`I
`tfotei:!:rn.!kmi
`l 1iint
`I
`[
`
`Ptth>d d' SMnpfaw
`
`•mMMMMMM1o - i ,MMMMMMMMMMMMMMA ;MM7 • :MMMMMMd ' t ,
`
`·p,·1·c~,
`... .. .J.
`
`·1 s
`
`..,,.
`
`u
`
`FI(]. 16
`
`Petitioner Apple Inc. – Ex. 1014, p. 9
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 8 of 18
`
`US 8,172,761 Bl
`
`tvh)nhor the inte11si tv H'
`of the hght so:urce
`
`,❖-❖ •~-10
`t
`...... •.•.•
`J.
`
`Detennine if the sensor is
`S:11hnwttd by the intensity
`of the H~ht source
`
`-1-.,.·.
`
`h1ndifv the imensitv
`. ....
`.,...
`
`.
`
`.
`
`. .
`
`/'520
`i
`
`kve 1 t1f the Ii ght soutce
`and Hdiust
`
`.
`
`·:.:.::•
`
`.•Y
`
`FIG. 1'7
`
`Petitioner Apple Inc. – Ex. 1014, p. 10
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`fo]
`iN—oo=M
`Sheet 9 of 18
`ee=Sm
`
`N=S“Ni
`>,3Sssancesnedpnecennecsnacenecetied
`U.S. Patent
`
`-"T'
`
`f··,
`>...
`·'-:-.:
`
`:;;,. ..
`·::::l
`•.•.•.•~
`C.
`
`·-./'.c a
`
`~t"\
`,t.,..~
`t~· -.....
`
`US 8,172,761 Bl
`US 8,172,761 Bl
`
`~ STOL
`
`v ~
`
`Petitioner Apple Inc. — Ex. 1014, p. 11
`
`Petitioner Apple Inc. – Ex. 1014, p. 11
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 10 of 18
`
`US 8,172,761 Bl
`
`:-.r-~
`f',l
`f''•!""t ____ ....,
`
`~,
`
`c~,._ ____ ...,
`t··l f''.·~----~
`\,_ I
`T
`
`;,i~
`
`·>-<
`·~
`~~
`:~ :t::
`s ~.;z
`,£; ~
`p
`-:...J,
`
`.•.•.•.•.•.•·•
`
`'\
`
`-./''} -(·•,!
`
`l_i!~ w.
`
`"\ .
`.-.. •:,,,. ... -.• ·-"-.. -·•r-··
`i
`
`'.··.l·-"·- .. ---
`
`~-~J:
`
`............... ~ .....
`
`....... ...,. ___ ......,.,,
`
`,,...,
`·-C
`r--i
`
`,-~-!...-.·· ..
`
`~;: 1:
`
`.._ _ _ ...,, _ _ _ ...,
`
`·~,:
`r·•{!:
`;:
`
`..ti' .
`........ .
`,,..., ;:
`('·{ ·~--~--~--~--~--~--~-·
`:-
`...........
`
`~l
`
`.
`
`\
`C:
`
`-
`
`Petitioner Apple Inc. – Ex. 1014, p. 12
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 8, 2012
`May8, 2012
`
`Sheet 11 of 18
`Sheet 11 of 18
`
`US 8,172,761 Bl
`US 8,172,761 Bl
`
`:
`
`:
`
`···········~····· Ql
`
`* :
`
`W.·
`
`:
`
`+
`
`(,..-'"...,
`
`A -t'..!"'~
`
`KHe,
`
`OC1gAD
`
`ememnnnenennmnnns
`
`z4Trnemnnnanannanannanannanannnd
`
`[Old
`
`snGy”LO"MDMayceOg*
`PPOpenegee
`
`H
`
`··············";~ l -.
`[H
`
`. .
`.
`
`Petitioner Apple Inc. — Ex. 1014, p. 13
`
`Petitioner Apple Inc. – Ex. 1014, p. 13
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 8, 2012
`May8, 2012
`
`Sheet 12 of 18
`Sheet 12 of 18
`
`US 8,172,761 Bl
`US 8,172,761 Bl
`
`iweniey
`
`........... \
`x
`a
`+ai
`rTBe
`inegt
`
`ewe
`wh,
`
`~ ... ~·
`< } ·-
`
`.......
`~\
`
`>-t·~
`
`~
`;;,-.,
`«:
`··ti
`fl:~
`<"',
`;:, ... "":' ...
`
`+
`
`NNONC
`
`ARENTELE-Pp
`
`settee
`
`!'"tl
`'
`
`~AD
`PrBx
`
`Petitioner Apple Inc. — Ex. 1014, p. 14
`
`Petitioner Apple Inc. – Ex. 1014, p. 14
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`May 8, 2012
`May8, 2012
`
`Sheet 13 of 18
`Sheet 13 of 18
`
`US 8,172,761 Bl
`US 8,172,761 Bl
`
`q3LNNOD
`
`eZLO
`
`~
`
`.,_
`0::: w
`M
`....
`N ,.,
`z
`~
`"' 0
`0 u
`
`·O· .,..,_ _ _ ........,
`~-..--..
`t•..--..
`
`
`
`sasaanannnannnaaananannnaananananannnffAAAAMAnnSAAARAMA
`
`|peEEE
`
`f-Y'{
`
`~ J
`
`{::•:.:•:.:•:.:•:.:•:.:•:.:•:::.:::.:::.::/
`\··················t
`
`,.SUI/
`( \> /
`;., \f
`;;
`\/
`
`r-M
`
`
`
`AeA
`
`‘afetete
`
`+
`a4
`7
`gt
`<..::.t
`~ ··+
`
`-r
`
`~ v-j.
`
`ene¢4D
`
`EEE
`
`gulingy#
`
`~
`&
`~ \
`
`3
`
`. r~. v ~
`
`~
`
`
`
`“TAe
`x)
`
`Petitioner Apple Inc. — Ex. 1014, p. 15
`
`Petitioner Apple Inc. – Ex. 1014, p. 15
`
`
`
`
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 14 of 18
`
`US 8,172,761 Bl
`
`,r,.
`,to(-;.
`"t'
`.,,,,,,,,,,f,,,,,,,.,,,", J
`t<"': .
`..,
`
`(cid:141)······························
`
`°'=r ,,-____ _
`
`~~
`:r~
`
`+
`
`!--t;
`I
`"'¢
`~ ./
`
`. .-...
`._,
`0
`7!
`·~ ,_,,~//' .
`ct""';
`
`=~ u
`
`(.::(cid:173)-(cid:173)'¢
`
`('>'°'}
`........... ~,...l
`-/'
`
`Petitioner Apple Inc. – Ex. 1014, p. 16
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 15 of 18
`
`US 8,172,761 Bl
`
`1520
`~
`
`User Interface
`
`Display/Touchscreen
`1511
`
`Camera
`1512
`
`Speaker
`1513
`
`Battery
`1514
`
`Microphone
`1515
`
`Power
`Management
`1516
`
`Memory
`
`1517
`
`GPS
`Receiver
`1518
`
`RF
`Transceiver
`1521
`
`Video/Image
`Processor
`
`1519
`
`Applications
`Processor
`
`1522
`
`Accelerometer
`1520
`
`FIG. 25
`
`Petitioner Apple Inc. – Ex. 1014, p. 17
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 16 of 18
`
`US 8,172,761 Bl
`
`i.:Q
`
`C
`~
`::e;
`z ~ - >
`ifj µ.]
`µ.] z ~ 0
`[--, <:
`:,)
`0
`{J] z -
`U-1 @
`N cc
`r.w u -
`- ~
`[--, V'J
`µ:i
`0 ~ ~
`~ q ~
`< ~ X ;;<
`~ < ill <
`u
`~
`
`~
`
`D
`4. s
`lr~
`-, ~
`-
`0
`.£,)
`
`I.I")
`O'\
`
`~
`
`~
`
`f
`I
`\
`0
`N i.n
`
`~
`
`Petitioner Apple Inc. – Ex. 1014, p. 18
`
`

`

`U.S. Patent
`U.S. Patent
`
`May8, 2012
`May 8, 2012
`
`Sheet 17 of 18
`Sheet 17 of 18
`
`US 8,172,761 B1
`US 8,172,761 Bl
`
`1700
`~
`
`
`
`FIG-. 27
`FIG. 27
`
`Petitioner Apple Inc. — Ex. 1014, p. 19
`
`Petitioner Apple Inc. – Ex. 1014, p. 19
`
`

`

`U.S. Patent
`
`May 8, 2012
`
`Sheet 18 of 18
`
`US 8,172,761 Bl
`
`/ 1520
`
`. . ✓
`
`(
`
`)
`
`111!0l
`
`10:15 AlVI
`
`Lunge
`again!
`
`95 bp111 V
`
`1525 -
`
`@
`
`FICi. 28
`
`Petitioner Apple Inc. – Ex. 1014, p. 20
`
`

`

`US 8,172,761 Bl
`
`1
`MONITORING DEVICE WITH AN
`ACCELEROMETER, METHOD AND SYSTEM
`
`CROSS REFERENCES TO RELATED
`APPLICATIONS
`
`The present application claims priority to U.S. Provisional
`Patent Application No. 61/408,656, filed on Nov. 1, 2010 and
`U.S. Provisional Patent Application No. 61/394,744, filed on
`Oct. 19, 2010. The Present Application is also a continuation(cid:173)
`in-part application ofU .S. patent application Ser. No. l 3/ 191,
`907, filed on Jul. 27, 2011, which claims priority to U.S.
`Provisional Patent Application No. 61/368,262, filed Jul. 28,
`2010, now abandoned. The present application is also a con(cid:173)
`tinuation-in-part application of U.S. patent application Ser.
`No. 12/561,222, filed on Sep. 16, 2009, which claims priority
`to U.S. Provisional Patent Application No. 61/097,844, filed
`on Sep. 17, 2008, now abandoned, and which is a continua(cid:173)
`tion-in-part application of U.S. patent application Ser. No.
`11/856,056, filed Sep. 16, 2007, now U.S. Pat. No. 7,625,344,
`which is a continuation application of U.S. patent application
`Ser. No.11/762,078, filed on Jun. 13, 2007, now U.S. Pat. No.
`7,468,036, and which is also a continuation-in-part applica(cid:173)
`tion of U.S. patent application Ser. No. 11/388,707, filed on
`Mar. 24, 2006, which claims priority to U.S. Provisional 25
`Application No. 60/665,116, filed on Mar. 25, 2005, now
`abandoned, and which is also a continuation-in-part applica(cid:173)
`tion of U.S. patent application Ser. No. 11/085,778, filed on
`Mar. 21, 2005, now abandoned, which claims priority to U.S.
`Provisional Application No. 60/613,785, filed on Sep. 28, 30
`2004, now abandoned. All of the above mentioned applica(cid:173)
`tions are hereby incorporated by reference in their entireties.
`
`STATEMENT REGARDING FEDERALLY
`SPONSORED RESEARCH OR DEVELOPMENT
`
`Not Applicable
`
`BACKGROUND OF THE INVENTION
`
`2
`ration and is relatively inexpensive. The disadvantages of
`pulse oximetry devices are that it is prone to artifact, it is
`inaccurate at saturation levels below 70%, and there is a
`minimal risk of bums in poor perfusion states. Several factors
`5 can cause inaccurate readings using pulse oximetry including
`ambient light, deep skin pigment, excessive motion, finger(cid:173)
`nail polish, low flow caused by cardiac bypass, hypotension,
`vasoconstriction, and the like.
`In monitoring one's health there is a constant need to know
`10 how many calories have been expended whether exercising or
`going about one's daily routine. A calorie is a measure ofheat,
`generated when energy is produced in our bodies. The amount
`of calories burned during exercise is a measure of the total
`amount of energy used during a workout. This can be impor-
`15 tant, since increased energy usage through exercise helps
`reduce body fat. There are several means to measure this
`expenditure of energy. To calculate the calories burned during
`exercise one multiplies the intensity level of the exercise by
`one's body weight (in kilograms). This provides the amount
`20 of calories burned in an hour. A unit of measurement called a
`MET is used to rate the intensity of an exercise. One MET is
`equal to the amount of energy expended at rest.
`For example, the intensity of walking 3 miles per hour
`("mph") is about 3.3 METS. At this speed, a person who
`weighs 132 pounds (60 kilograms) will bum about 200 calo(cid:173)
`ries per hour ( 60x3 .3= 198).
`The computer controls in higher-quality exercise equip-
`ment can provide a calculation of how many calories are
`burned by an individual using the equipment. Based on the
`workload, the computer controls of the equipment calculate
`exercise intensity and calories burned according to estab-
`lished formulae.
`The readings provided by equipment are only accurate if
`one is able to input one's body weight. If the machine does not
`35 allow this, then the "calories per hour" or "calories used"
`displays are only approximations. The machines have built-in
`standard weights (usually 174 pounds) that are used when
`there is no specific user weight. There are devices that utilize
`a watch-type monitor to provide the wearer with heart rate as
`40 measured by a heartbeat sensor in a chest belt.
`However, the prior art devices often suffer from noise, light
`and motion related problems. These problems are increased
`when the user participates in an athletic activity such as
`running. Further, attempting to correct one problem often
`45 creates additional problems such as increasing a sensor out(cid:173)
`put which results in a shorter battery life. The prior art has
`failed to provide a means for monitoring one's health that is
`accurate, easy to wear on one's body for extended time peri(cid:173)
`ods, allows the user to input information and control the
`50 output, and provides sufficient information to the user about
`the user's health. Thus, there is a need for a monitoring device
`that can be worn for an extended period and provide health
`information to a user.
`
`1. Field of the Invention
`The present invention is related to real-time vital sign
`monitoring devices. More specifically, the present invention
`relates to a device for monitoring a user's vital signs that is
`used in conjunction with a Smartphone.
`2. Description of the Related Art
`There is a need to know how one is doing from a health
`perspective. In some individuals, there is a daily, even hourly,
`need to know one's health. The prior art has provided some
`devices to meet this need.
`One such device is a pulse oximetry device. Pulse oximetry
`is used to determine the oxygen saturation of arterial blood.
`Pulse oximeter devices typically contain two light emitting
`diodes: one in the red band oflight (660 nanometers) and one
`in the infrared band oflight (940 nanometers). Oxyhemoglo- 55
`bin absorbs infrared light while deoxyhemoglobin absorbs
`visible red light. Pulse oximeter devices also contain sensors
`that detect the ratio of red/infrared absorption several hundred
`times per second. A preferred algorithm for calculating the
`absorption is derived from the Beer-Lambert Law, which 60
`determines the transmitted light from the incident light mul(cid:173)
`tiplied by the exponential of the negative of the product of the
`distance through the medium, the concentration of the solute
`and the extinction coefficient of the solute.
`The major advantages of pulse oximetry devices include
`the fact that the devices are non-invasive, easy to use, allows
`for continuous monitoring, permits early detection of desatu-
`
`BRIEF SUMMARY OF THE INVENTION
`
`The present invention provides a solution to the shortcom-
`ings of the prior art. The present invention is accurate, com(cid:173)
`fortable to wear by a user for extended time periods, allows
`for input and controlled output by the user, is light weight, and
`provides sufficient real-time information to the user about the
`user's health.
`One aspect of the present invention is a method for moni(cid:173)
`toring a real-time vital sign of a user by using a signal from an
`65 optical sensor and a signal from a multiple axis accelerometer
`that generates an X-axis signal, a Y-axis signal and a Z-axis
`signal.
`
`Petitioner Apple Inc. – Ex. 1014, p. 21
`
`

`

`US 8,172,761 Bl
`
`5
`
`3
`Another aspect of the present invention is of the present
`invention is a system for monitoring a real-time vital sign of
`a user. The system for monitoring a real-time vital sign of a
`user comprises a monitoring device comprising an optical
`sensor for generating a real-time digitized optical signal cor-
`responding to a flow of blood through an artery of the user and
`an accelerometer for generating real-time accelerometer data
`comprising a X-axis signal, a Y-axis signal and a Z-axis signal
`based on a movement of the user. The system further com(cid:173)
`prises a first transceiver for transmitting the real-time digi- 10
`tized optical signal and the real-time accelerometer data from
`the monitoring device. Additionally, the system comprises a
`mobile communication device comprising a second trans(cid:173)
`ceiver for receiving the real-time digitized optical signal and
`the real-time accelerometer data from the monitoring device. 15
`Additionally, the system comprises a processor in electrical
`communication with the second transceiver, the processor
`configured to receive the real-time digitized signal and the
`real-time accelerometer data, the processor configured to cal(cid:173)
`culate a period of motion related harmonics from the real- 20
`time accelerometer data utilizing a repetitive motion pattern
`analyzer, the processor configured to modify the real-time
`digitized optical signal by suppressing the motion related
`harmonics calculated by the motion pattern analyzer to gen(cid:173)
`erate a modified optical signal, the processor configured to 25
`generate a real-time heart rate for the user from the modified
`optical signal,
`Optionally, the modified optical signal is filtered with a
`narrow band filter adaptively tuned to a heart rate frequency
`calculated by a heart rate evaluator to generate the real-time 30
`heart rate for the user. Preferably, the repetitive motion pat(cid:173)
`tern analyzer comprises an array of Comb filters. Preferably,
`the optical sensor comprises two green LEDs and a photode(cid:173)
`tector.
`Having briefly described the present invention, the above 35
`and further objects, features and advantages thereof will be
`recognized by those skilled in the pertinent art from the fol(cid:173)
`lowing detailed description of the invention when taken in
`conjunction with the accompanying drawings.
`
`4
`FIG. 14 is a schematic flow chart of the signal acquisition
`step of the flow chart of FIG. 13.
`FIG. 15 is an illustration of the waveforms of the data
`sampling during the signal processing method.
`FIG. 16 is a graph illustrating the method and mechanism
`of controlling the intensity of the light source over time.
`FIG. 17 is a flow chart of a signal processing method of the
`present invention.
`FIG. 18 is a block diagram of signal processing for a
`monitoring device.
`FIG. 19 is a block diagram of signal processing of a prior
`art device.
`FIG. 20 is a block diagram of signal processing for a
`monitoring device.
`FIG. 21 is a block diagram of a comb filter type 2 for signal
`processing.
`FIG. 22 is a block diagram of a comb filter type 1 for signal
`processing.
`FIG. 23 is a block diagram of a four-cycle comb filter type
`1 with a filter delay for signal processing.
`FIG. 24 is a block diagram of a four-cycle comb filter type
`1 with a filter delay for signal processing.
`FIG. 25 is a block diagram of a mobile communication
`device such as a mobile phone.
`FIG. 26 is an illustration of a system including a monitor(cid:173)
`ing device and a mobile phone which receives a signal from
`the monitoring device.
`FIG. 27 is an illustration of a runner with a monitoring
`device and a mobile phone.
`FIG. 28 is an isolated view ofa mobile phone with a display
`of information generated from a signal from a monitoring
`device.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`BRIEF DESCRIPTION OF THE SEVERAL
`VIEWS OF THE DRAWINGS
`
`FIG. 1 is a plan view of a preferred embodiment of a
`monitoring device worn by a user.
`FIG. 2 is a side view of a monitoring device.
`FIG. 3 is an interior surface plan view of a monitoring
`device.
`FIG. 4 is a side view of a monitoring device.
`FIG. 5 is an exterior surface view of a monitoring device.
`FIG. 6 is an isolated view of the electrical components of a
`monitoring device.
`FIG. 7 is isolated side view of the electrical components of
`a monitoring device.
`FIG. 8 is an isolated exterior surface view of an optical
`sensor for a monitoring device.
`FIG. 9 is an isolated top plan view of an optical sensor for
`a monitoring device.
`FIG. 10 is an isolated cross section view of an optical
`sensor for a monitoring device.
`FIG. 11 is an isolated cross section view of an optical
`sensor for a monitoring device with light reflecting off of an
`artery of a user.
`FIG. 12 is a block diagram of electrical components for a
`monitoring device.
`FIG. 13 is a block diagram of signal processing for a
`monitoring device.
`
`45
`
`As shown in FIGS. 1-5, a monitoring device is generally
`designated 20. The monitoring device 20 preferably includes
`an article 25 and an attachment band 26 having an exterior
`surface 26a and interior surface 26b. The monitoring device
`40 20 is preferably secured with VELCRO® hook and loop
`material 31a and 31b. The article 25 preferably includes an
`optical sensor 30, control components 43a-43c and option(cid:173)
`ally a display member 40. The monitoring device 20 is pref-
`erably worn on a user's wrist, arm or ankle.
`The article 25 preferably has a USB port for a wired con(cid:173)
`nection to a computer, tablet, video monitor or mobile com(cid:173)
`munication device such as smartphone.
`It is desirous to adapt the monitoring device 20 to the
`anatomy of the user's arm or even the user's ankle. The band
`50 26 is preferably composed of neoprene, leather, synthetic
`leather, LYCRA, another similar material, or a combination
`thereof. The article 25 is preferably composed of a semi-rigid
`or rigid plastic with a rubber-like or semi-flex plastic bottom
`layer for contact with the user's body. The bottom layer of the
`55 article 25 may have a curve surface for contact with a user's
`body. The article 25 preferably has a mass ranging from 5
`grams to 50 grams. Preferably, the lower the mass of the
`article 25, the more comfort to the user. The article 25 pref(cid:173)
`erably has a thickness ranging from 5 mm to 10 mm, and is
`60 most preferably 6.5 mm.
`Although the monitoring device 20 is described in refer(cid:173)
`ence to an article worn on a user's arm, wrist or ankle, those
`skilled in the pertinent art will recognize that the monitoring
`device 20 may take other forms such as eyewear disclosed in
`65 Brady et al, U.S. Pat. No. 7,648,463, for a Monitoring Device,
`Method And System, which is hereby incorporated by refer(cid:173)
`ence in its entirety or a glove such as disclosed in Rulkov et
`
`Petitioner Apple Inc. – Ex. 1014, p. 22
`
`

`

`US 8,172,761 Bl
`
`5
`al., U.S. Pat. No. 7,887,492, for a Monitoring Device, Method
`And System, which is hereby incorporated by reference in its
`entirety.
`The optical sensor 30 of the monitoring device 20 is pref(cid:173)
`erably positioned over the radial artery or ulnar artery if the
`article 25 is worn on the user's arm. The optical sensor 30 of
`the monitoring device 20 is preferably positioned over the
`posterior tibial artery of a user if the article 25 is worn on the
`user's ankle. However, those skilled in the pertinent art will
`recognize that the optical sensor may be placed over other
`arteries of the user without departing from the scope and spirit
`of the present invention. Further, the optical sensor 30 need
`only be in proximity to an artery of the user in order to obtain
`a reading or signal.
`In a preferred embodiment, the optical sensor 30 is a plu(cid:173)
`rality of light emitting diodes ("LED") 35 based on green
`light wherein the LEDs 35 generate green light (wavelength
`of 500-570 nm), and a photodetector 36 detects the green
`light. Yet in an alternative embodiment, the optical sensor 30
`is a photodetector 36 and a single LED 35 transmitting light at
`a wavelength of approximately 900 nanometers as a pulsed
`infrared LED. Yet further, the optical sensor is a combination
`of a green light LED and a pulsed infrared LED to offset noise
`affects of ambient light and sunlight. As the heart pumps
`blood through the arteries in the user's arm, ankle or wrist, the
`photodetector 36, which is typically a photodiode, detects
`reflectance/transmission at the wavelengths (green, red or
`infrared), and in response generates a radiation-induced sig(cid:173)
`nal.
`A preferred optical sensor 30 utilizing green light is a
`TRS1755 sensor from TAOS, Inc of Plano Tex. TheTRSl 755
`comprises a green LED light source (567 nm wavelength) and
`a light-to-voltage converter. The output voltage is directly
`proportional to the reflected light intensity. Another preferred
`photodetector 36 is a light-to-voltage photodetector such as
`the TSL260R and TSL261, TSL261R photodetectors avail(cid:173)
`able from TAOS, Inc of Plano Tex. Alternatively, the photo(cid:173)
`detector 130 is a light-to-frequency photodetector such as the
`TSL245R, which is also available from TAOS, Inc. The light(cid:173)
`to-voltage photodetectors have an integrated transimpedance
`amplifier on a single monolithic integrated circuit, which
`reduces the need for ambient light filtering. The TSL261
`photodetector preferably operates at a wavelength greater
`than 750 nanometers, and optimally at 940 nanometers,
`which would preferably have a LED that radiates light at
`those wavelengths.
`In one embodiment, discussed below, the display member
`40 is removed and the signal is sent to a device such as a
`personal digital assistant, laptop computer, mobile telephone,
`exercise equipment, or the like for display and even process(cid:173)
`ing of the user's real-time vital signs information. Alterna(cid:173)
`tively, the circuitry assembly includes a flexible microproces(cid:173)
`sor board which is a low power, micro-size easily integrated
`board which provides blood oxygenation level, pulse rate
`(heart rate), signal strength bargraph, plethysmogram and
`status bits data. The microprocessor can also store data. The
`microprocessor can process the data to display pulse rate,
`blood oxygenation levels, calories expended by the user of a
`pre-set time period, target zone activity, time and dynamic
`blood pressure. Further, microprocessor preferably includes
`an automatic gain control for preventing saturation of the
`photodetector, which allows for the device to be used on
`different portions of the human body.
`The display member 40 is preferably a light emitting diode 65
`("LED"). Alternatively, the display member 40 is a liquid
`crystal display ("LCD") or other similar display device.
`
`6
`A microprocessor processes the signal generated from the
`optical sensor 30 to generate the plurality of vital sign infor(cid:173)
`mation for the user which is displayed on the display member
`40. The control components 43a-c are connected to the pro-
`5 cessor to control the input of information and the output of
`information displayed on the display member 40.
`The monitoring device 20 is preferably powered by a
`power source positioned on the article 25. Preferably the
`power source is a battery. The power source 360 is preferably
`10 an AA or AAA disposable or rechargeable battery. The power
`source is alternatively a lithium ion rechargeable battery such
`as available from NEC-Tokin. The power source preferably
`has an accessible port for recharging. The circuit assembly of
`the monitoring device preferably requires 5 volts and draws a
`15 current of 20- to 40 milliamps. The power source preferably
`provides at least 900 milliamp hours of power to the moni(cid:173)
`toring device 20.
`A connection wire arrangement 45 is shown in FIGS. 6 and
`8, wherein the connection 45 between the microprocessor and
`20 the optical sensor 30 is preferably non-planar or non-straight
`in order to reduce noise in the signal. The optical sensor 30
`preferably comprises a photodetector 36, and first and second
`LEDs 35 which transmit light. Using two LEDs on each side
`of a photodetector creates a more mechanically stable optical
`25 sensor 3 0.
`The monitoring device 20 alternatively has a short-range
`wireless transceiver which is preferably a transmitter operat(cid:173)
`ing on a wireless protocol, e.g. BLUETOOTH, part-15, or
`802.11. "Part-15" refers to a conventional low-power, short-
`30 range wireless protocol, such as that used in cordless tele(cid:173)
`phones. Other communication protocols include a part 15 low
`power short range radio, standard BLUETOOTH or BLUE(cid:173)
`TOOTH Low Energy to conserve power or other low power
`short range communications means. The short-range wireless
`35 transmitter ( e.g., a BLUE TOOTH transmitter) receives infor(cid:173)
`mation from the microprocessor and transmits this informa(cid:173)
`tion in the form of a packet through an antenna. An external
`laptop computer or hand-held device features a similar
`antenna coupled to a matched wireless, short-range receiver
`40 that receives the packet. In certain embodiments, the hand(cid:173)
`held device is a cellular telephone wi