(12) Unlted States Patent
`(10) Patent No.:
`US 8,998,815 B2
`
`Venkatraman et al.
`(45) Date of Patent:
`Apr. 7, 2015
`
`USOO8998815B2
`
`(54) WEARABLE HEART RATE MONITOR
`
`(71) Applicant: Fitbit, Inc., San Francisco, CA (US)
`
`(72)
`
`Inventors: Subramaniam Venkatraman, Walnut
`Creek, CA (US); Shelten Gee Jao Yuen,
`Berkeley, CA (US)
`
`(73) Assignee: Fitbit, Inc., San Francisco, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 14/295,059
`.
`Flledi
`
`J‘m- 3, 2014
`
`(22)
`
`(52) US. Cl.
`CPC ............. A613 5/02405 (2013.01); A613 5/721
`(2013.01); A613 5/0205 (2013.01); A613
`5/1118 (2013.01); A613 5/681(2013.01);A613
`5/742 (2013.01); A613 5/1123 (2013.01); A613
`5/02416 (2013.01); A613 5/0245 (2013.01);
`A613 5/0402 (2013.01); A613 5/6831
`(2013.01); A613 5/6824 (2013.01)
`(58) Field of Classification Search
`USPC .................................. 600/300, 301, 500, 503
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`US. PATENT DOCUMENTS
`4,367,752 A
`1/1983 Jimenez et al.
`4,771,792 A
`9/1988 Scale
`
`(65)
`
`Prior Publication Data
`
`(Continued)
`
`US 2014/0275854 A1
`
`Sep. 18, 2014
`
`FOREIGN PATENT DOCUMENTS
`
`Related US. Application Data
`
`EP
`
`1 721 237 B1
`
`8/2012
`
`(63) Continuation of application No. 14/292,673, filed on
`May 30: 2014': Wthh 15 a Commuatl011'111'133rt Of
`application No. 13/924,784, filed on Jun. 24, 2013.
`
`OTHER PUBLICATIONS
`US Notice of Allowance (Corrected Notice of Allowability), dated
`Dec. 31, 2014, issued in U.S.App1. No. 14/292,669.
`
`(60) Provisional application No. 61/662,961, filed on Jun.
`22, 2012, provisional application No. 61/752,826,
`filed on Jan. 15, 2013, provisional application No.
`61/946,439,
`filed on Feb. 28, 2014, provisional
`application No. 61/955,045, filed on Mar. 18, 2014,
`provisional application No. 61/973,614, filed on Apr.
`1, 2014, provisional application No. 61/830, 600, filed
`on Jun.
`3,
`2013, provisional
`application No.
`62/001 ,624,
`filed on May 21, 2014, provisional
`application No. 62/001,585, filed on May 213 2014.
`
`(51)
`
`Int Cl
`A 613 5/02
`A 613 5/024
`
`A613 5/00
`A613 5/0205
`A613 5”]
`A613 5/0245
`A613 5/0402
`
`(2006 01)
`2006.01
`(
`’
`)
`(200601)
`(200601)
`(200601)
`(2006.01)
`(2006.01)
`
`(Continued)
`.
`Primary Examiner * M1chael D’Angelo
`(74) Attorney, Agent, or Firm 7Weaver Austin Villeneuve
`& Sampson LLP
`
`ABSTRACT
`(57)
`A biometric monitoring device is used to determine a user’s
`heart rate by using a heartbeat waveform sensor and a motion
`detecting sensor. In some embodiments, the device collects
`collecting concurrent output data from the heartbeat wave-
`form sensor and output data from the motion detecting sensor,
`detects a periodic component of the output data from the
`motion detecting sensor, and uses the periodic component of
`the output data from the motion detecting sensor to remove a
`corresponding periodic component from the output data from
`the heartbeat waveform sensor. From this result, the device
`may determine and present the user’s heart rate.
`
`13 Claims, 29 Drawing Sheets
`
`—————————
`
` M u Iti-Spectra
`
`Optical
`PPG Signal
`
`Motion
`Signal
`
`Tracker
`
`Track
`
`Heart Rate
`
`Selector
`
`Activity
`
`Discriminator
`
`1
`
`APPLE 1005
`
`APPLE 1005
`
`1
`
`

`

`US 8,998,815 B2
`
`Page 2
`
`2013/0218053 A1
`2014/0073486 A1
`2014/0099614 A1
`2014/0107493 A1
`2014/0135631 A1
`2014/0142403 A1
`2014/0241626 A1
`2014/0275821 A1
`2014/0275852 A1
`2014/0276119 A1
`2014/0278139 A1
`2014/0288390 A1
`2014/0288391 A1
`2014/0288392 A1
`2014/0288435 A1
`2014/0288436 A1
`2014/0288438 A1
`2014/0303523 A1
`2014/0378786 A1
`2014/0378787 A1
`2014/0378872 A1
`2015/0025393 A1
`2015/0025394 A1
`
`8/2013 Kaiser et al.
`3/2014 Ahmed et al.
`4/2014 Hu et al.
`4/2014 Yuen et al.
`5/2014 Brumback et al.
`5/2014 Brumback et al.
`8/2014 Sull et al.
`9/2014 Beckman
`9/2014 Hong et al.
`9/2014 Venkatraman et al.
`9/2014 Hong et al.
`9/2014 Hong et al.
`9/2014 Hong et al.
`9/2014 Hong et al.
`9/2014 Richards et al.
`9/2014 Venkatraman et al.
`9/2014 Venkatraman et al.
`10/2014 Hong et al.
`l2/2014 Hong et al.
`l2/2014 Brumback et al.
`l2/2014 Hong et al.
`l/2015 Hong et al.
`l/2015 Hong et al.
`OTHER PUBLICATIONS
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/1991
`4/1992
`6/1994
`4/1998
`10/2000
`6/2001
`7/2002
`6/2003
`5/2004
`2/2006
`5/2009
`5/2010
`10/2011
`4/2012
`7/2012
`l/2013
`2/2013
`5/2013
`7/2013
`11/2013
`7/2014
`12/2014
`2/2015
`2/2015
`2/2015
`2/2015
`ll/2001
`8/2003
`ll/2004
`3/2005
`ll/2005
`8/2006
`4/2008
`l/2009
`ll/2009
`4/2010
`6/2010
`8/2010
`9/2010
`10/2010
`ll/2010
`ll/2010
`ll/2010
`ll/2010
`ll/2010
`l2/2010
`l2/2010
`l/2011
`2/2011
`3/2011
`4/2012
`4/2012
`4/2012
`4/2012
`4/2012
`4/2012
`5/2012
`6/2012
`7/2012
`9/2012
`9/2012
`9/2012
`9/2012
`10/2012
`ll/2012
`l2/2012
`l/2013
`3/2013
`3/2013
`3/2013
`3/2013
`5/2013
`6/2013
`6/2013
`8/2013
`
`Thornton
`............... 600/500
`Koyama et al.
`Hauck et al.
`.................... 607/20
`Lo et al.
`Stephan et al.
`................ 600/53l
`Amano et al.
`Puolakanaho et al.
`Montagnino et al.
`Turcott
`Parker et al.
`Tran
`Gardiner et al.
`Dickinson
`Smith et al.
`Tsao et al.
`Mannheimer et al.
`Yudovsky et al.
`Bourget et al.
`Yuen et al.
`................. 600/503
`Rulkov et al.
`Yudovsky et al.
`Hong et al.
`Venkatraman et al.
`Hong et al.
`Yuen et al.
`Hong et al.
`Mault
`Ortiz et al.
`Gueissaz
`Almen
`Hilton et al.
`Martin et al.
`Florian
`Fernstrom et al.
`Li et al.
`Linderman
`Droitcour et al.
`Heneghan et al.
`Droitcour et al.
`Behar et al.
`Droitcour et al.
`Moon et al.
`Moon et al.
`McCombie et al.
`McCombie et al.
`Lakovic et al.
`Mensinger et al.
`Mensinger et al.
`Hoffman et al.
`Moon et al.
`Yuen et al.
`Yuen et al.
`Yuen et al.
`Yuen et al.
`Yuen et al.
`Yuen et al.
`Najarian et al.
`Yanev et al.
`Park
`Yuen et al.
`Yuen et al.
`Kahn et al.
`Andre et al.
`Vicente et al.
`Brown et al.
`Rahman et al.
`Wittling et al.
`Yuen et al.
`Yuen et al.
`Cowperthwaite et al.
`Yuen et al.
`Weast et al.
`Yuen et al.
`Yuen et al.
`Bedingham et al.
`
`382/103
`
`AA
`
`*
`A*
`A
`
`5,036,856
`5,101,831
`5,318,597
`5,738,104
`6,131,076
`6,241,684
`6,418,394
`6,583,369
`6,731,967
`6,997,882
`7,539,532
`7,720,306
`8,040,758
`8,152,745
`8,211,503
`8,346,328
`8,386,042
`8,444,578
`8,475,367
`8,579,827
`8,792,981
`8,920,332
`8,945,017
`8,948,832
`8,954,135
`8,956,303
`2001/0044588
`2003/0163710
`2004/0236227
`2005/0054940
`2005/0245793
`2006/0195020
`2008/0097221
`2009/0012433
`2009/0292332
`2010/0106044
`2010/0152600
`2010/0204550
`2010/0249633
`2010/0274100
`2010/0292568
`2010/0298650
`2010/0298651
`2010/0298653
`2010/0298661
`2010/0331145
`2010/0331657
`2011/0009727
`2011/0032105
`2011/0066010
`2012/0083705
`2012/0083714
`2012/0083715
`2012/0083716
`2012/0084053
`2012/0084054
`2012/0123232
`2012/0150074
`2012/0172733
`2012/0226471
`2012/0226472
`2012/0232432
`2012/0245439
`2012/0255875
`2012/0274508
`2012/0316471
`2013/0009779
`2013/0073254
`2013/0073255
`2013/0077826
`2013/0080113
`2013/0106684
`2013/0151196
`2013/0158369
`2013/0211265
`
`LS Notice of Allowance (Corrected Notice of Allowability), dated
`Dec. 31, 2014, issued in US. Appl. No. 14/295,158.
`S Office Action, dated Dec. 24, 2014, issued in US. Appl. No.
`4/295,076.
`S Notice of Allowance (Corrected Notice of Allowability), dated
`an. 5, 2015, issued in US. Appl. No. l4/295,l22.
`.8. Appl. No. l4/48l,020, Sep. 9, 2014, Hong et al.
`.8. Appl. No. l4/48l,762, Sep. 9, 2014, Hong et al.
`.8. Appl. No. l4/484,104, Sep. 11, 2014, Brumback et al.
`.8. Appl. No. l4/507,l73, Oct. 6, 2014, Hong et al.
`.8. Appl. No. l4/507,l84, Oct. 6, 2014, Hong et al.
`S \Iotice of Allowance, dated Nov. 19, 2014, issued in L .8. Appl.
`o. 13/924,784.
`S Office Action, dated Oct. 22, 2014, issued in US. Appl. No.
`4 290,884.
`\Iotice of Allowance, dated Sep. 23, 2014, issued in L .8. Appl.
`. 14/292,669.
`\Iotice of Allowance (Corrected Notice of Allowability), dated
`ct. 14,2014, issued in US. Appl. No. l4/292,669.
`\Iotice ofAllowance, dated Oct. 14, 2014, issued in L .8. Appl.
`14/295,144.
`Notice ofAllowance, dated Dec. 3, 2014, issued in US. Appl. V0.
`/295, 144.
`\Iotice of Allowance, dated Sep. 26, 2014, issued in L .8. Appl.
`.14/295,158.
`Notice ofAllowance, dated Dec. 8, 2014, issued in US. Appl. V0.
`4 292,673.
`\Iotice of Allowance, dated Nov. 24, 2014, issued in L .8. Appl.
`o.14/295,122.
`S Office Action, dated Sep. 29, 2014, issued in US. Appl. \Io.
`4/154,009.
`S Office Action, dated Nov. 25, 2014, issued in US. Appl. \Io.
`4/154,019.
`S Office Action, dated Dec. 10, 2014, issued in US. Appl. \Io.
`4/484,104.
`S Office Action, dated Dec. 4, 2014, issued in US. Appl. \Io.
`4/216,743.
`S Final Office Action, dated Nov. 21, 2014, issued in US. Appl. \Io.
`4/250,256.
`S Office Action, dated Oct. 7, 2014, issued in US. Appl. \Io.
`*-‘("
`4/481,762.
`S Final Office Action, dated Dec. 19, 20 14, issued in US. Appl. \Io.
`4/481,762.
`.8. Appl. No. l4/2l4,655, Mar. 14, 2014, Hong et al.
`.8. Appl. No. l4/2l6,743, Mar. 17, 2014, Hong et al.
`.8. Appl. No. l4/250,256, Apr. 10, 2014, Hong et al.
`.8. Appl. No. l4/290,884, May 29,2014, Richards et al.
`.8. Appl. No. l4/292,669, May 30,2014, Hong et al.
`.8. Appl. No. l4/292,673, May 30, 2014, Venkatraman et al.
`
`
`
`
`
`
`
`/So S So S
`
`So S/S
`
`4
`
`“FM-W“
`
`(“AFH-‘F‘AF‘HF‘AF‘OF‘AF‘HF‘AF‘F‘F‘F‘F‘F‘
`
`
`*-‘("
`
`("(“(“(“(“(“
`
`2
`
`

`

`US 8,998,815 B2
`
`Page 3
`
`(56)
`
`References Cited
`OTHER PUBLICATIONS
`
`*-‘(“(“(“(“(“(“
`
`*-‘("*-‘("*-‘("
`
`.S. Appl. No. 14/295,076, Jun. 3, 2014, Venkatraman et al.
`.S. Appl. No. 14/295,122, Jun. 3, 2014, Venkatraman et al.
`.S. Appl. No. 14/295,144, Jun. 3, 2014, Hong et al.
`.S. Appl. No. 14/295,158, Jun. 3, 2014, Hong et al.
`.S. Appl. No. 14/295,161, Jun. 3, 2014, Hong et al.
`S Office Action, dated Aug. 4, 2014, issued in US. Appl. No.
`3/924,784.
`S Office Action, dated Aug. 5, 2014, issued in US. Appl. No.
`4/292,673.
`S Office Action, dated Jul. 31, 2014, issued in US. Appl. No.
`4/295,122.
`S Office Action, dated Mar. 14, 2014, issued in US. Appl. No.
`4/ 154,009.
`LS Office Action, dated Aug. 22, 2014, issued in US. Appl. No.
`14/250,256.
`“Activator is One of the Best Cydia iPhone Hacks | Control your
`iPhone with Gestures,” Iphone-tips-and-advice.com, [retrieved on
`Jul. 9, 2013 at http://www.iphone-tips-and-advice.com/activatior.
`htrnl], 10 pp.
`Chudnow, Alan (Dec. 3, 2012) “Basis Wristband Make Its Debut,”
`The Wired Self, Living in a Wired World, published in Health
`[retrieved on Jul. 22, 2013 at http://thewiredself.com/health/basis-
`wrist-band-make-its-debut/], 3pp.
`Cooper, Daniel (Aug. 16th, 2013) Withings Pulse review, http://www.
`engadget.com/2013/08/ 16/withings-pulse-revew/, 8 pages.
`DesMarais, Christina (posted on Sep. 3, 2013) “Which New Activity
`Tracker is Best for You?” Health and Home, Health & Fitness ,
`Guides &Reviews, [Retrieved on Sep. 23, 2013 at http://www.techli-
`cious.com/guide/which-new-activity-tracker-is-right-for-you/ 4 pp.
`Empson, Rip, (Sep. 22, 2011) “Basis Reveals an Awesome New
`Affordable Heart and Health Tracker You Can Wear on Your Wrist,”
`[retrieved on Sep. 23, 2013 at http://techcrunch.com/2011/09/22/
`basis-reveals-an-awesome-new .
`.
`. ], 3 pp.
`Fitbit User’s Manual, Last Updated Oct. 22, 2009, 15 pages.
`Forerunner® 201 personal trainer owner’s manual, (Feb. 2006)
`Garmin Ltd., 48 pp.
`Forerunner® 301 personal trainer owner’s manual, (Feb. 2006)
`Garmin Ltd., 66 pp.
`Forerunner® 50 with ANT+SportTM wireless technology, Owner’s
`Manual, (Nov. 2007) Garmin Ltd., 44 pp.
`Forerunner® 205/305 Owner’s Manual, GPS-enabled trainer for run-
`ners, (2006-2008), Garmin Ltd., 80 pp.
`Forerunner® 405CX Owner’s Manual, “GPS-Enabled Sports Watch
`With Wireless Sync,” (Mar. 2009), Garmin Ltd., 56 pp.
`Forerunner® 110 Owner’s Manual, (2010) “GPS-Enabled Sport
`Watch,” Garmin Ltd., 16 pp.
`Forerunner® 210 Owner’s Manual, (2010) “GPS-Enabled Sport
`Watch,” Garmin Ltd., 28 pp.
`
`Forerunner® 410 Owner’ 3 Manual, (Jul. 2012) “GPS-Enabled Sport
`Watch With Wireless Sync,” Garmin Ltd., 52 pp.
`Forerunner® 10 Owner’s Manual (Aug. 2012), Garmin Ltd., 10 pp.
`Forerunner® 310XT Owner’s Manual, Multisport GPS Training
`Device, (2009-2013), Garmin Ltd., 56 pp.
`Forerunner® 405 Owner’s Manual,
`(Mar. 2011) “GPS-Enabled
`Sport Watch With Wireless Sync,”. Garmin Ltd., 56 pp.
`Forerunner® 910XT Owner’s Manual, (Jan. 2013) Garmin Ltd., 56
`PP
`Garmin SwimTM Owner’s Manual (Jun. 2012), 12 pp.
`Larklife, User Manual, (2012) Lark Technologies, 7 pp.
`LarldLarkpro, User Manual, (2012) “What’s in the box,” Lark Tech—
`nologies, 7 pp.
`Lifetrnr, User Manual (2003, specific date unknown), NB new bal-
`ance®, Implus Footcare, LLC, 3 pages.
`Nike+ FuelBand GPS Manual, User’s Guide (Product Release Date
`Unknown, downloaded Jul. 22, 2013), 26 pages.
`Nike+SportBand User’s Guide, (Product Release Date Unknown,
`downloaded Jul. 22, 2013), 36 pages.
`Nike+SportWatch GPS Manual, User’s Guide, Powered by
`TOMTOM, (Product Release Date Unknown, downloaded Jul. 22,
`2013), 42 pages.
`“Parts onour Band,” (Product Release Date Unknown, downloaded
`Jul. 22, 2013) Jawbone UP Band, 1 page.
`Polar WearLink® + Coded Transmitter 31 Coded Transmitter W.I.N.
`D. User Manual, Polar® Listen to Your Body, Manufactured by Polar
`Electro 0y, 11 pages.
`Rainmaker, (Jun. 25, 2012, updated Feb 16, 2013) “Garmin Swim
`watch In-Depth Review,” [retrieved on Sep. 9, 2013 at http://www.
`dcrainmaker.com/20 1 2/06/garmin-swim-in-depth-reviewhtml,
`38
`PP
`Rainmaker, (Jul. 25, 2013) “Basis B 1 Watch In-Depth Review,”
`[retrieved on Feb. 4, 2014 at http://www.dcrainmaker.com/2013/07/
`basis-bl-reviewhtml], 56 pp.
`“Withings pulse, Quick Installation Guide” (Jul. 24, 2013) Withings
`Pulse QIG, v 1.3, withings.com/pulse, 16 pages.
`Zijlstra, Wiebren, (2004) “Assessment of spatio-temporal parameters
`during unconstrained walking,” Eur JAppl Physiol, 92:39-44.
`U.S. Appl. No. 14/599,039, filed Jan. 16, 2015, Venkatraman et al.
`US Notice ofAllowance, dated Feb. 6, 2015, issued in US. Appl. No.
`14/290,884.
`US Office Action, dated Jan. 23, 2015, issued in US. Appl. No.
`14/507, 184.
`US Office Action, dated Jan. 26, 2015, issued in US. Appl. No.
`14/295, 161 .
`US Office Action, dated Jan. 27, 2015, issued in US. Appl. No.
`14/507, 173.
`US Notice of Allowance, dated Jan. 21, 2015, issued in US. Appl.
`No. 14/154,009.
`
`* cited by examiner
`
`3
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 1 of 29
`
`US 8,998,815 B2
`
`Lommmooi
`
`0:wa05
`
`285%
`
`.mEmEcoL__>:m_
`
`whomcmw
`
`mmm_m:_>>
`
`62825:.
`
`89:95
`Em:.-
`5:09.95
`
`Em:
`
`_.2:9".
`
`4
`
`
`
`
`
`

`

`92f02teehS
`
`US 8,998,815 B2
`
`U.S. Patent
`
`pA
`
`7r.
`
`HV0bcmm2,E05532,
`
` 22:5
`
`<~2:9".
`
`awflo
`
`
`
`000...25x00:
`
`
`
`60:35.EoEwSowm
`
`
`
`
`
`#5822wamcmucmm
`
`5
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 3 of 29
`
`US 8,998,815 B2
`
`wcotzm
`
`.25m«55532
`
`mm2:9”.
`
`395:0
`
`menus.
`
`38mm
`
`3w«5me
`
`
`
`.3330:8300
`
`
`
`.E=:_E=_<.329
`
`~.owcmm
`
`52952.".
`
`\..
`
`.x...
`
`nmflo
`
`
`
`goo...ucmxoo:
`
`32:223553:3
`
`
`
`60502EwESaomw
`
`6
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 4 of 29
`
`US 8,998,815 B2
`
`mun.Ems.
`
`>235
`
`:ofisben—
`
`homcomm
`
`.
`
`c
`may,.Mu.w.u.,M...,w.».w,.,.mumnw‘MPWJWJM.W,
`
`i.:~
`$
`k.‘p
`,
`.2
`
`cm959...
`
`.23.5553“?
`
`7
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 5 of 29
`
`US 8,998,815 B2
`
`«:8me
`
`won.
`
`
`9:83-294...‘,9:022".
`
`.fiV§§“1%mumwwwwwwwwwwwwwwm§§§§iii
`
`
`
`
`.7IlliIfllflfllilfiillflffl!ffidiiliifllIfllflidlxilliwvl‘ldnnpidfliIIliMlii.dd1l.llii1fl1l,ll1IIi.fld,1JilljfidddlllillfliddVllll.Ufliflll/llffffIlllftlrflrilflll/flllf
`
`
`
`..ggng/xfi,.Rhonouonfionfiwuon%»»onh¢»¢uEgg.“//§333380;."—Lfit
`
`
`
`323m:E2338...
`
`mam::3
`
`.3225En:
`
`50>m4
`
`mom
`
`<m2:9".
`
`
`m:_xoo_n-Em_._62530.n—
`
`fix‘L§§gWm“wwwwwmwwwwwwwm§§§§I/
`
`
`fffiflflfllltlffiiiflftlliliififl!!!’flflffflf4fluiffflfifflf!fflflff€£rllfffdiff!!!’iffffillfffflflflf!!liffdflilt.rffflfffllffflldlll
`§ig§
`
`‘xx?..v‘tiff!!!,5.fJi!!!
`
`3532923.".
`
`\\\\/
`
`viii!!!
`Iii!!!
`
`
`
`ESE:Emfiamcflh
`
`mm959“.
`
`
`
`mom.....m.o
`
`.mmoSomEm:
`
`Lm>m4
`
`.58
`
`.mom
`
`8
`
`
`
`
`

`

`U.S. Patent
`
`r.
`
`pA
`
`m7.,
`
`w.hS
`
`US 8,998,815 B2
`
`9.28.—mEEmamcmfim2.830
`
`
`
`u..W/%g/
`
`jig/x
`
`”M44.“
`
`0»2:9”.
`
`non.
`
`hon—UQHWUOHOCL
`
`flE302.53
`
`@250
`
`mOMJmum-0
`
`.mouhzowEm:
`
`uwgSwme—n—
`
`o>Ewcow
`
`028:3.
`
`>com
`
`9
`
`
`
`
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 7 of 29
`
`US 8,998,815 B2
`
`LEDs
`
` Photodetector
`
`................'
`
`SmartWatCH
`Back
`
`
`
`Pipe Support
`
`Optically
`Opaque Light
`
`Light Pipes
`
`Figure 4B
`
`Prggrg§ion Detail
`
`,_
`
`Figure 4C
`
`10
`
`10
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 8 of 29
`
`US 8,998,815 B2
`
`
`
`Em:o.85:22auntsm
`
`_
`
`«55:85.3.802qu\mugzow
`mc=asoux2“.K
`
`
`Em
`
`
`
`Em:Bashfiamo
`
`7|Zoom_cufigtmEm
`
`11
`
`
`
`
`
`25:3.888.55?3EEm:sausage
`
`
`
`mountswUPSOEOU
`
`Fll
`
`IIIIL
`
`howuflwuoaocm
`
`11
`
`
`
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 9 of 29
`
`US 8,998,815 B2
`
`Band-Mounted Optical
`Sensors and Light
`Emitters
`
`Figure 6A
`
`
`
`Wristband
`
`Side-Mounted Optical
`Heart Rate Detection _
`Sensors and/or
`Emitters
`
`
`
`
`
`Figure 6B
`
`12
`
`12
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 10 of 29
`
`US 8,998,815 B2
`
`83%6mom9:mmmwwaEm
`
`
`
`02mE0:EoEmSmmeMIm9.92
`
`
`
`cozowumuBEtam:$260nszoE
`
`n9.sz
`
`
`
`86282mm:8:
`
`58Eu3%:8:
`
`13
`
`13
`
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 11 of 29
`
`US 8,998,815 B2
`
`User-Set Alarm Window
`
`l
`
`
`
`Deep Sleep
`
`Light Sleep
`
`
`
`
`
`
`
`5am
`
`6:4'5am
`
`Smart Alarm is Triggered
`by a Light Sleep State
`During Alarm Window
`
`Onset
`
`l
`
`Figure 8
`
`Motion
`Detected?
`
`
`nitrate ow samp Ing
`Initiate high sampling
`rate HR detection to
`rate HR detection to
`reduce motion artifacts
`
`reduce power
`
`
`
`
`
`ofion
`
`
`
`tétblt
`
`32:45 pm:
`
`HR 11% buns
`
`. Aisha-Ty Lewei: l Eligh.
`
`fi‘iifiii
`
`(
`
`8:16 pm
`
`HF ?3 bzgm,
`
`Amway Le'iet. Low 5
`
`Figure 9
`
`14
`
`14
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 12 0f 29
`
`US 8,998,815 B2
`
`{‘1‘1.
`
`
`KN...1.9960moo»...
`
`
`4.0.!.11.,A9......A.
`
`Uuzm>=o<.6«Emma;
`
`ENE.
`
`
`
`Emmica:w_u>o_m
`
`15
`
`S2:9”.
`
`
`
`5:85...mmm_w,__>>
`
`
`
`02599:33:22
`
`15
`
`
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 13 of 29
`
`US 8,998,815 B2
`
`Light Source
`Intensity & Onl
`
`Off Control
`
`.
`
`Light Source
`Intensity & On]
`Off Control
`
`DACIGPIOs
`
`‘ na 09
`Signal
`
`I Condntnomn- I ADC
`
`5'?"
`
`Figure 118
`
`MCU
`
`
`
`,
`SL'ght
`°”’°e
`
`Light Source
`Intensity & On/
`Off Control
`
`I------ I
`I
`I
`I
`
`II I I I I l
`
`L _____ J
`
`SI?“
`
`Figure 116
`
`16
`
`“—3.
`5
`
`7
`a:
`2
`
`16
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 14 of 29
`
`US 8,998,815 B2
`
`{—Iigh?————|
`| -Source1
`
`
`
`__Nicg__
`
`
`
`I
`
`_
`Light Source
`Intensity & Onl
`Off Control
`
`| |
`
`
`U ADC
`
`5'?"
`
`Figure 11D
`
`'— ————— 4
`
`Light Source
`Intensity & On]
`Off Control
`
`Demodulator
`
`5’?"
`
`Figure 11E
`
`
`
`Light Source
`Off Control DACIGPIOS
`Intensity & On/
`
`
`
`Processor
`
`
`
`Sign
`
`Figure 11 F
`
`17
`
`17
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 15 of 29
`
`US 8,998,815 B2
`
`
` Light Source ______ 1
`
`Intensity & Onl
`Off Control
`
`"88%
`
`
`
`Demodulator
`
`Figure 116
`
`18
`
`18
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 16 of 29
`
`US 8,998,815 B2
`
`Heart Rate
`Sensor
`
`
`
`
`Processor
`
`
`
`
`
`
`
`
`Communication Circuitry
`(e.g., wireless radio)
`
`
`
`
`
`Communication Circuitry
`(e.g., wireless radio)
`
`
`
`
`
`
`Skin Conductance]
`Wet Sensor
`
`
`
` Physiological
`
`Figure 12A
`
`Location Sensor
`
`(e.g., GPS)
`
`
`
`Heart Rate
`
`Motion Sensor
`
`Processor
`
`Altitude
`
`Display
`
`
`
`Figure 123
`
`Sensors
`
`Environmental
`Sensors
`
`Location
`Sensors
`
`Processor
`
`Figure 12C
`
`19
`
`19
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 17 of 29
`
`US 8,998,815 B2
`
`Optical
`PPG Signal
`
`I
`
`| Spectra Estimator
`
`
`
`Multi-Spectra
`Track
`Tracker
`Selector
`
`
`
`
`Motion
`Signal
`
`_________
`
`|
`_________ _|
`|
`Spectra Estimator
`l
`
`Activity
`Discriminator
`
`Figure 13A
`
`Optical PPG
`Signal
`
`
`
`
`Motion
`Signal
`
`
`
`
`Spectra
`Estimator
`
`Multi-Spectra
`Tracker
`
`Track Selector
`
`Spectra
`Estimator
`
`Activity
`Discriminator
`
`Heart Rate
`
`Heart Rate
`
`Figure 133
`
` Analog
`Connection
`
`
`
`Processor
`
`
`
`Figure 14A (Prior Art)
`
`Analog
`Connection
`
`Digital
`Connection
`
`
`
`Application
`Processor
`
`Sensor
`Processor
`
`Figure 143
`
`20
`
`20
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 18 of 29
`
`US 8,998,815 B2
`
`Processor
`
`Application
`
`Figure 14C
`
`Sensor
`
`Processor 1
`
`Sensor
`
`Processor 2
`Sensor
`
`Processor 3
`
`Application
`Processor
`
`Processor
`
`Sensor 3A
`
`Sensor 33
`
`Sensor
`
`Figure 14D
`
`21
`
`21
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 19 0f 29
`
`US 8,998,815 B2
`
`
`
`Stroke
`Detection
`
`
`Stroke Type
`Detection
`
`
`
` Tu rn
`Detection
`
`
`
`Update Summary of
`Metrics
`
`
`
`User
`Finished
`
`
`Swimming?
`
`
`
`Figure 15A
`
`22
`
`22
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 20 of 29
`
`US 8,998,815 B2
`
`
`
`Detection
`
`Detection
`
`Detection
`
`
`
`
`Stroke Type - Stroke Count
`
`Metrics
`
`
`
`Update Summary of
`
`User
`Finished
`
`
`
`Swimming?
`
`Figure 153
`
`23
`
`23
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 21 of 29
`
`US 8,998,815 B2
`
`Detection
`
`Detection
`
`Stroke Count
`
`Detection
`
`Update Summary of
`Metrics
`
`
`
`
`
`
`
`
`
`User
`
`Finished
`
`
`Swimming?
`
`Figure 15C
`
`24
`
`24
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 22 of 29
`
`US 8,998,815 B2
`
`Detection
`
`Detection
`
`Detection
`
`Update Summary of
`
`
`
`
`
`Metrics
`
`
`
`
`User
`
`Finished
`
`Swimming?
`
`Figure 15D
`
`25
`
`25
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 23 of 29
`
`US 8,998,815 B2
`
`
`
`Trigger
`
`
`Output Signal
`
`Differential
`
`Amplifier or
`instrumentation
`
`Amplifier
`
`Reference
`
`Figure 16A
`
`Figure 163
`
`Switch Trigger
`
`
`Output Signal
`
`
`Output Signal
`
`
`
`Figure 160
`
`26
`
`26
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 24 of 29
`
`US 8,998,815 B2
`
`Trigger 2
`
`Differential
`
`Amplifier or
`Instrumentation
`
`Output Signal
`Output Signal
`
`Amplifier
`
`Output Signal
`
`Figure 16F
`
`27
`
`27
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 25 of 29
`
`US 8,998,815 B2
`
`Figure 166
`
`Output Signal iTrigger
`Output Signal
`Output Signal
`
`Figure 16|
`
`28
`
`28
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 26 of 29
`
`US 8,998,815 B2
`
`Differential
`
`Amplifier or
`Instrumentation
`
`Amplifier
`
`Output Signal
`
`W
`
`I
`
`Figure 16J
`
`29
`
`29
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 27 of 29
`
`US 8,998,815 B2
`
`
`
`Nmnr>
` .mmEEOOEm.r!!!!!!!L
`
`
`
`
`N@222
`
`‘
`
`
`
`>ocmscmi9$280
`
`EmEoD
`
`
`
`at3:w€23
`Emu—notm>coOm>OEmm>:>zo<.IwLQ
`
`
`
`commEEzomE0988.05fig,cacao8:88GEEm:69“.23%:
`
`
`
`
`
`
`32255St
`
`mo:
`
`25%08
`
`8:92
`
`Lomcmw
`
`59:0
`
`
`
`mEEmmmEEmw
`
`
`
`
`
`mEELEmQ
`
`m:be3:30
`
`2535
`
`KI
`
`
`
`
`
`
`
`35an
`
`
`
`am?:03
`
`ASE
`
`
`
`.5oSmEmm:
`
`
`
`wamumgme
`
`30
`
`30
`
`
`
`
`
`
`
`
`
`
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 28 of 29
`
`US 8,998,815 B2
`
`Figure18
`
`mm“@4535@3353E80?
`
`WW}
`
`8W
`
`BED
`
`fimeg}
`
`
`
`
`
`AKE"Ti{KimCBET!penaaiiSH
`
`112::
`C)
`[M
`
`£3
`lI‘ZI
`T“
`
`(:3
`if.)
`1”"
`
`v:::,-
`LE3
`
`IS)
`C211:
`["d
`
`{I}
`lfin
`1“"
`
`{Z}
`£3
`1*"
`
`m
`
`11:)
`[D
`
`[ugLu ,1 $19an xiczuanb‘ejgj
`
`(u! uuglrg 9L1) Aguanbmgj
`
`31
`
`31
`
`

`

`US. Patent
`
`Apr. 7, 2015
`
`Sheet 29 of 29
`
`US 8,998,815 B2
`
`Stationary
`
`Running
`
`40
`
`Figure19
`
`Time(min)
`
` Stationary O
`
`18
`
`16
`
`V‘
`T—
`
`N
`‘—
`
`O
`v.
`
`00
`
`CO
`
`d”
`
`(wdq) 91m ueaH
`
`32
`
`32
`
`

`

`US 8,998,815 B2
`
`1
`WEARABLE HEART RATE MONITOR
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a continuation of US. patent applica-
`tion Ser. No. 14/292,673,
`titled “WEARABLE HEART
`RATE MONITOR” and filed on May 30, 2014, which is a
`continuation-in-part of US. patent application Ser. No.
`13/924,784, titled “PORTABLE BIOMETRIC MONITOR-
`ING DEVICES AND METHODS OF OPERATING SAME”
`
`and filed on Jun. 24, 2013, which claims benefit of priority
`under 35 U.S.C. §119(e) to US. Provisional Patent Applica-
`tion No. 61/662,961, titled “WIRELESS PERSONAL BIO-
`METRICS MONITOR” and filed on Jun. 22, 2012 and
`61/752,826, titled “PORTABLE MONITORING DEVICES
`AND METHODS OF OPERATING SAME” and filed on
`
`Jan. 15, 2013; this application also claims benefit of priority
`under 35 U.S.C. §119(e) to US. Provisional Patent Applica-
`tion No. 61/830,600, titled “PORTABLE MONITORING
`DEVICES AND METHODS OF OPERATING SAME” and
`filed on Jun. 3, 2013, 61/946,439, titled “HEART RATE
`DATA COLLECTION” and filed on Feb. 28, 2014, 61/955,
`045, titled “GPS POWER CONSERVATION USING ENVI-
`RONMENTAL DAT ” and filed on Mar. 18, 2014, 61/973,
`614,
`titled “GPS ACCURACY REFINEMENT USING
`EXTERNAL SENSORS” and filed on Apr. 1, 2014, 62/001,
`624,
`titled “FITNESS MONITORING DEVICE WITH
`ALTIMETER” and filed on May 21, 2014, and 62/001,585,
`titled “WEARABLE HEART RATE MONITOR” and filed
`
`on May 21, 2014, all of which are hereby incorporated by
`reference herein in their entireties.
`
`BACKGROUND
`
`Recent consumer interest in personal health has led to a
`variety of personal health monitoring devices being offered
`on the market. Such devices, until recently, tended to be
`complicated to use and were typically designed for use with
`one activity, e.g., bicycle trip computers.
`Recent advances in sensor, electronics, and power source
`miniaturization have allowed the size of personal health
`monitoring devices, also referred to herein as “biometric
`tracking” or “biometric monitoring” devices, to be offered in
`extremely small sizes that were previously impractical. For
`example, the Fitbit Ultra is a biometric monitoring device that
`is approximately 2" long, 0.75" wide, and 0.5" deep; it has a
`pixelated display, battery, sensors, wireless communications
`capability, power source, and interface button, as well as an
`integrated clip for attaching the device to a pocket or other
`portion of clothing, packaged within this small volume.
`The disclosure provides methods and devices for activat-
`ing, in energy efficient ways, HR monitor based on user
`motion and skin proximity. The disclosure also provides
`methods for operating the LED and photo detector of heart
`rate monitors to obtain accurate reading of heart rate tailored
`for different user characteristics such as skin colors.
`
`SUMMARY
`
`One aspect of the disclosure provides methods of deter-
`mining a user’s heart rate when wearing a biometric moni-
`toring device having a plurality of sensors including a heart-
`beat waveform sensor and a motion detecting sensor. The
`methods may remove motion artifacts from heartbeat wave-
`form signals when determining a user’s heart rate. The meth-
`ods may be characterized by the following operations: (a)
`
`2
`
`collecting concurrent output data from the heartbeat wave-
`form sensor and output data from the motion detecting sensor,
`wherein the output data from the heartbeat waveform sensor
`provides information about the user’s heart rate and wherein
`the output data from the motion detecting sensor provides
`information about the user’s periodic physical movements
`other than heartbeats; (b) determining a periodic component
`ofthe output data from the motion detecting sensor; (c) using
`the periodic component of the output data from the motion
`detecting sensor to remove a corresponding periodic compo-
`nent from the output data from the heartbeat waveform sen-
`sor; (d) determining the user’s heart rate; and (e) presenting
`the user’s heart rate. In some implementations, the motion
`detecting sensor is an accelerometer or a gyroscope. In some
`embodiments, the heartbeat waveform sensor may be a pho-
`toplethysmography sensor or an ECG sensor.
`In certain embodiments, the method contains an additional
`operation of removing a harmonic of the corresponding peri-
`odic component from the output data from the heartbeat
`waveform sensor. In such embodiments, the periodic compo-
`nent of the output data from the motion detecting sensor may
`be a fundamental frequency produced from the user’s peri-
`odic movement.
`In certain embodiments,
`the operation
`removing a corresponding periodic component from the out-
`put data from the heartbeat waveform sensor includes apply-
`ing an adaptive filter to the output data from the heartbeat
`waveform sensor and the output data from the motion detect-
`ing sensor. In certain embodiments, removing a correspond-
`ing periodic component from the output data from the heart-
`beat waveform sensor includes the operation applying an
`adaptive filter function to the output data from the motion
`detecting sensor that minimizes the difference between the
`output data from the heartbeat waveform sensor and the out-
`put data from the motion detecting sensor.
`In some implementations, the method includes the follow-
`ing additional operations: (i) determining the user’s activity
`level and/or activity type; and (ii) determining parameters of
`the function based on the user’s activity level and/or activity
`type.
`In some implementations, the method includes the follow-
`ing additional operations: (i) analyzing the output data from
`the motion detecting sensor to infer that the user is substan-
`tially stationary; and (ii) temporarily suspending operation
`(c).
`In some method implementations, the operation collecting
`the output data from the heartbeat waveform sensor includes
`the following operations: (i) pulsing a light source in the worn
`biometric monitoring device at a first frequency; and (ii)
`detecting light from the light source at the first frequency.
`Pulsing the light source at the first frequency may involve
`emitting a succession of light pulses of substantially constant
`intensity.
`In certain embodiments, presenting the user’s heart rate
`includes presenting the heart rate on the worn biometric
`monitoring device. In certain embodiments, presenting the
`user’s heart rate includes presenting the heart rate on an
`external device that periodically communicates with the worn
`biometric monitoring device.
`Another aspect ofthe invention pertains to wearable fitness
`monitoring devices designed or configured to remove motion
`artifacts from heartbeat waveform signals when determining
`a user’s heart rate. Such devices may be characterized by the
`following features: a motion sensor configured to provide
`output corresponding to motion by a user wearing the fitness
`monitoring device; a heartbeat waveform sensor; and control
`logic. The control logic includes instructions for: (a) collect-
`ing concurrent output data from the heartbeat waveform sen-
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`33
`
`33
`
`

`

`US 8,998,815 B2
`
`3
`sor and output data from the motion detecting sensor, wherein
`the output data from the heartbeat waveform sensor provides
`information about the user’s heart rate and wherein the output
`data from the motion detecting sensor provides information
`about the user’s periodic physical movements other than
`heartbeats; (b) determining a periodic component of the out-
`put data from the motion detecting sensor; (c) using the peri-
`odic component of the output data from the motion detecting
`sensor to remove a corresponding periodic component from
`the output data from the heartbeat waveform sensor; (d) deter-
`mining the user’s heart rate; and (e) presenting the user’s
`heart rate.
`
`though not necessarily,
`logic is typically,
`The control
`located on the fitness monitoring device. It may be imple-
`mented as hardware, software, firmware, or any combination
`thereof. The data used by the control logic in executing the
`instructions described herein may be stored (e.g., buffered)
`by associated memory, registers, and the like, which may be
`entirely resident on the device or partially resident on a paired
`secondary device. Examples of suitable architectures for
`implementing the control logic are presented below with
`reference to, e.g., FIGS. 11A-G, 12A-C, 13A-B, and 14A-D.
`In some devices, the motion detecting sensor is an accel-
`erometer or a gyroscope.
`In certain embodiments,
`the
`device’s heartbeat waveform sensor is a photoplethysmo-
`graphic sensor having (i) a periodic light source, (ii) a photo
`detector positioned to receive periodic light emitted by the
`light source after interacting with the user’s skin, and (iii)
`circuitry determining the user’s heart rate from output of the
`photo detector. In some implementations, the photoplethys-
`mographic sensor includes two periodic light sources strad-
`dling the photo detector. In some implementations, the pho-
`toplethysmographic sensor additionally includes a housing
`having a recess in which the photo detector is disposed. The
`housing of the photoplethysmographic sensor may have a
`second recess in which the periodic light source is disposed.
`In some designs, the housing protrudes at least about 1 mm
`above a base surface of the wearable fitness monitoring
`device arranged to press against the user’s skin when worn.
`Further,
`the photoplethysmographic sensor further may
`include a spring configured to resist compression when the
`protruding housing presses against the user’s skin. In certain
`embodiments,
`the photoplethysmographic
`sensor
`also
`includes an IML film over the photo detector and the periodic
`light source. In certain embodiments,
`the periodic light
`source is an LED.
`
`In some embodiments, the device’s control logic includes
`instructions for removing a harmonic of the corresponding
`periodic component from the output data from the heartbeat
`waveform sensor; in such cases the periodic component ofthe
`output data from the motion detecting sensor may be a fun-
`damental frequency produced from the user’s periodic move-
`ment.
`
`In some implementations, the instructions for removing a
`corresponding periodic component from the output data from
`the heartbeat waveform sensor include instructions for apply-
`ing an adaptive filter to the output data from the heartbeat
`waveform sensor and the output data from the motion detect-
`ing sensor. In some implementations, the instructions for
`removing a corresponding periodic component from the out-
`put data from the heartbeat waveform sensor include instruc-
`tions for applying an adaptive filter function to the output data
`from the motion detecting sensor that minimizes the differ